[2025-09-18T17:00:01.698377] [INFO ] [MAIN ] Using last completed trading day: 2025-09-18 [2025-09-18T17:00:01.698958] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-18T17:00:01.699068] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-18T17:00:01.699109] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-18T17:00:03.362305] [DEBUG] [SYMBOL ] Found 2424 valid NYSE symbols. [2025-09-18T17:00:03.362470] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-18T17:00:03.362722] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-18T17:00:03.363534] [INFO ] [LOCAL ] Symbols cache updated with 2372 symbols. [2025-09-18T17:00:03.363592] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-18T17:00:03.363624] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-18T17:00:03.363716] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-18T17:00:03.363859] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-18T17:00:03.364267] [DEBUG] [LOCAL ] Found 2372 symbols in cached list. [2025-09-18T17:00:03.364320] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-18T17:00:03.364524] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-18T17:00:03.364588] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2372 valid symbols. [2025-09-18T17:00:03.364623] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-18T17:00:03.364690] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-18T17:00:03.390559] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-18T17:00:03.417592] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-18T17:00:03.417715] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-18T17:00:03.417761] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-18T17:00:03.417791] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-18T17:00:03.418101] [WARN ] [STATE ] State set to: RUNNING [2025-09-18T17:00:03.418730] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-18T17:00:03.419123] [DEBUG] [LOCAL ] Found 2372 symbols in cached list. [2025-09-18T17:00:03.419160] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-18T17:00:03.419192] [INFO ] [MAIN ] Starting incremental update for 2372 symbols. [2025-09-18T17:00:03.419221] [INFO ] [MAIN ] Running in parallel mode [2025-09-18T17:00:03.419388] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2372 symbols [2025-09-18T17:00:04.230813] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:00:04.234192] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:00:04.161188] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:00:04.222485] [INFO ] [MAIN ] AACT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:00:04.234494] [DEBUG] [LOCAL ] A: No existing data file found in primary storage. [2025-09-18T17:00:04.234595] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-18T17:00:04.234796] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-18T17:00:04.235970] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-18T17:00:04.236493] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-18T17:00:04.236581] [DEBUG] [LOCAL ] AACT: No existing data file found in primary storage. [2025-09-18T17:00:04.234978] [WARN ] [MAIN ] A: No existing data found, performing full refresh instead. [2025-09-18T17:00:04.238180] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-18T17:00:04.238374] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-18T17:00:04.236914] [WARN ] [MAIN ] AACT: No existing data found, performing full refresh instead. [2025-09-18T17:00:04.243725] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-18T17:00:04.259947] [INFO ] [MAIN ] AACT: Wiping existing primary data before full refresh. [2025-09-18T17:00:04.269227] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-18T17:00:04.274510] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-18T17:00:04.279747] [DEBUG] [LOCAL ] AACT: No primary data file found to delete. [2025-09-18T17:00:04.303124] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-09-18T17:00:04.303304] [INFO ] [MAIN ] AACT: Starting full primary refresh. [2025-09-18T17:00:04.343747] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-18T17:00:05.188361] [DEBUG] [LOCAL ] AA: Loaded 53585 existing records from primary storage. [2025-09-18T17:00:05.270337] [INFO ] [MAIN ] AA: Loaded 53585 existing records. [2025-09-18T17:00:05.210412] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:00:05.319404] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-11. [2025-09-18T17:00:05.328047] [INFO ] [REMOTE ] AACT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:00:05.360298] [INFO ] [REMOTE ] AACT: Fetching primary data for 2024-11. [2025-09-18T17:00:05.569707] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:00:05.612876] [INFO ] [REMOTE ] A: Fetching primary data for 2024-11. [2025-09-18T17:00:05.642516] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:00:05.642735] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-18T17:00:05.642806] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-18T17:00:05.645266] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-09-18T17:00:05.645331] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-18T17:00:06.010485] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:00:06.010852] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-11. [2025-09-18T17:00:06.071660] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-18T17:00:06.073395] [INFO ] [REMOTE ] AACT: Fetching primary data for 2024-12. [2025-09-18T17:00:06.171412] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-18T17:00:06.172494] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-18T17:00:06.342484] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-09-18T17:00:06.343676] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-01. [2025-09-18T17:00:06.507080] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-18T17:00:06.508116] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-18T17:00:06.688859] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-18T17:00:06.690005] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-02. [2025-09-18T17:00:06.778263] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-18T17:00:06.779242] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-18T17:00:07.057386] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-18T17:00:07.067795] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-09-18T17:00:07.075825] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-18T17:00:07.076822] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-03. [2025-09-18T17:00:07.085959] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-18T17:00:07.086816] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-18T17:00:07.363113] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-18T17:00:07.364145] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-18T17:00:07.480755] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-18T17:00:07.482280] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-04. [2025-09-18T17:00:07.631735] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-18T17:00:07.632835] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-18T17:00:07.674163] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-18T17:00:07.684957] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-09-18T17:00:07.904613] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-18T17:00:07.905496] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-18T17:00:08.031149] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-18T17:00:08.033730] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-05. [2025-09-18T17:00:08.144547] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-18T17:00:08.145492] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-18T17:00:08.453527] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-18T17:00:08.473027] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-18T17:00:08.475413] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-18T17:00:08.486684] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-09-18T17:00:08.765687] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-18T17:00:08.767002] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-18T17:00:08.910608] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-18T17:00:08.913286] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-06. [2025-09-18T17:00:09.295202] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-18T17:00:09.295944] [INFO ] [REMOTE ] AAM: Full fetch complete (1003 records). [2025-09-18T17:00:09.296019] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-18T17:00:09.512128] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-18T17:00:09.513250] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:00:09.513385] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:00:09.513563] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-18T17:00:09.519434] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-18T17:00:09.525525] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-18T17:00:09.525634] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-18T17:00:09.529419] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-07. [2025-09-18T17:00:09.530618] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-18T17:00:09.530780] [INFO ] [MAIN ] Update Progress: 1/2372 symbols completed. AAM took 6.1s. Estimated remaining: 4h 1m 30s. Rate: 9.8 symbols/min [2025-09-18T17:00:09.651677] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-18T17:00:09.707941] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-09-18T17:00:09.788231] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:00:09.788568] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-18T17:00:09.788639] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-18T17:00:09.789821] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-18T17:00:09.789922] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-18T17:00:09.790129] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-18T17:00:09.790186] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-18T17:00:10.201226] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:00:10.201911] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-11. [2025-09-18T17:00:10.221524] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-18T17:00:10.241676] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-08. [2025-09-18T17:00:10.244867] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-18T17:00:10.255993] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-18T17:00:10.425104] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:00:10.425420] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-11 [2025-09-18T17:00:10.426241] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-18T17:00:10.641235] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:00:10.641547] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-18T17:00:10.642036] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-09-18T17:00:11.330255] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-18T17:00:11.334441] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-09-18T17:00:11.670314] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-18T17:00:11.680935] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-18T17:00:11.707423] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T17:00:11.710746] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-09. [2025-09-18T17:00:11.962205] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-18T17:00:11.966134] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-09-18T17:00:12.740894] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-18T17:00:12.745907] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-09-18T17:00:13.327360] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-18T17:00:13.338295] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-18T17:00:13.501005] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (3.25 seconds). [2025-09-18T17:00:13.511296] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-18T17:00:13.862217] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-18T17:00:13.868859] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-09-18T17:00:13.967547] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-18T17:00:13.970267] [INFO ] [REMOTE ] AACT: Full fetch complete (10354 records). [2025-09-18T17:00:13.970379] [DEBUG] [VALIDATOR ] AACT: Validating primary data. [2025-09-18T17:00:14.159051] [WARN ] [VALIDATOR ] AACT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-18T17:00:14.159432] [FATAL] [MAIN ] AACT: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:00:14.159535] [WARN ] [MAIN ] AACT: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:00:14.159631] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-18T17:00:14.159772] [DEBUG] [LOCAL ] AACT: No primary data file found to delete. [2025-09-18T17:00:14.159856] [INFO ] [LOCAL ] AACT: Starting deletion of derivative data. [2025-09-18T17:00:14.159941] [DEBUG] [LOCAL ] AACT: No derivative data file found to delete. [2025-09-18T17:00:14.160037] [INFO ] [MAIN ] Update Progress: 2/2372 symbols completed. AACT took 10.7s. Estimated remaining: 3h 32m 8s. Rate: 11.2 symbols/min [2025-09-18T17:00:14.346515] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:00:14.423608] [DEBUG] [LOCAL ] AAP: Loaded 52189 existing records from primary storage. [2025-09-18T17:00:14.423802] [INFO ] [MAIN ] AAP: Loaded 52189 existing records. [2025-09-18T17:00:14.615233] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:00:14.615583] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-18T17:00:14.615667] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-18T17:00:14.618704] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-09-18T17:00:14.618772] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-18T17:00:14.999844] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:00:15.000901] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-11. [2025-09-18T17:00:15.149425] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T17:00:15.191212] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-18T17:00:15.193171] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-18T17:00:15.205472] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-18T17:00:15.415346] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-18T17:00:15.423116] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-09-18T17:00:16.280414] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-18T17:00:16.286065] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-09-18T17:00:16.625627] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T17:00:16.636815] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-18T17:00:17.463221] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-18T17:00:17.475174] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-18T17:00:17.814299] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-11 (2.81 seconds). [2025-09-18T17:00:17.824467] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-09-18T17:00:18.389281] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-18T17:00:18.400438] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-18T17:00:19.558899] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-18T17:00:19.575402] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-18T17:00:20.266138] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-18T17:00:20.276928] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-18T17:00:20.865308] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (4.58 seconds). [2025-09-18T17:00:20.871189] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-09-18T17:00:21.106533] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-18T17:00:21.119047] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-18T17:00:21.640926] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-18T17:00:21.646782] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-09-18T17:00:21.773076] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (3.95 seconds). [2025-09-18T17:00:21.783823] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-09-18T17:00:21.873518] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-18T17:00:21.885849] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-18T17:00:22.651147] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-18T17:00:22.655877] [INFO ] [REMOTE ] AAMI: Full fetch complete (29517 records). [2025-09-18T17:00:22.655987] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-09-18T17:00:22.656603] [FATAL] [VALIDATOR ] AAMI: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:00:22.656713] [FATAL] [MAIN ] AAMI: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:00:22.656759] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:00:22.656827] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-18T17:00:22.656897] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-18T17:00:22.656934] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-18T17:00:22.656975] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-18T17:00:22.657034] [INFO ] [MAIN ] Update Progress: 3/2372 symbols completed. AAMI took 13.1s. Estimated remaining: 4h 13m 11s. Rate: 9.4 symbols/min [2025-09-18T17:00:22.834801] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:00:22.877381] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-18T17:00:22.898397] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-18T17:00:22.913230] [DEBUG] [LOCAL ] AAT: Loaded 30591 existing records from primary storage. [2025-09-18T17:00:22.913370] [INFO ] [MAIN ] AAT: Loaded 30591 existing records. [2025-09-18T17:00:23.097978] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:00:23.098230] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-18T17:00:23.098287] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-18T17:00:23.099307] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-09-18T17:00:23.099368] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-18T17:00:23.478586] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:00:23.479100] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-11. [2025-09-18T17:00:23.520959] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T17:00:23.547935] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-18T17:00:23.561412] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-18T17:00:23.572228] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-18T17:00:24.389957] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-18T17:00:24.395452] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-09-18T17:00:24.566579] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-18T17:00:24.578596] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-18T17:00:24.938409] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-18T17:00:24.946341] [INFO ] [REMOTE ] A: Full fetch complete (72586 records). [2025-09-18T17:00:24.946527] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-18T17:00:24.948857] [FATAL] [VALIDATOR ] A: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:00:24.949268] [FATAL] [MAIN ] A: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:00:24.949344] [WARN ] [MAIN ] A: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:00:24.949420] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-18T17:00:24.949541] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-09-18T17:00:24.949587] [INFO ] [LOCAL ] A: Starting deletion of derivative data. [2025-09-18T17:00:24.949629] [DEBUG] [LOCAL ] A: No derivative data file found to delete. [2025-09-18T17:00:24.949834] [INFO ] [MAIN ] Update Progress: 4/2372 symbols completed. A took 21.5s. Estimated remaining: 3h 32m 26s. Rate: 11.1 symbols/min [2025-09-18T17:00:25.152411] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:00:25.152824] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-18T17:00:25.152953] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-18T17:00:25.153397] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-18T17:00:25.153452] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-18T17:00:25.153498] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-18T17:00:25.153541] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-18T17:00:25.268284] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-18T17:00:25.320955] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-18T17:00:25.575952] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-18T17:00:25.592070] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-09-18T17:00:25.613126] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:00:25.613445] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-11. [2025-09-18T17:00:25.848198] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:00:25.848536] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-11 [2025-09-18T17:00:25.849026] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-18T17:00:26.060518] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:00:26.060895] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-18T17:00:26.061367] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-09-18T17:00:26.269462] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:00:26.269840] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-09-18T17:00:26.270296] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-02. [2025-09-18T17:00:26.305639] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-18T17:00:26.314338] [INFO ] [REMOTE ] AA: Full fetch complete (76978 records). [2025-09-18T17:00:26.314514] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-18T17:00:26.315467] [FATAL] [VALIDATOR ] AA: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:00:26.315570] [FATAL] [MAIN ] AA: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:00:26.315615] [WARN ] [MAIN ] AA: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:00:26.315688] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-18T17:00:26.315768] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-09-18T17:00:26.315808] [INFO ] [LOCAL ] AA: Starting deletion of derivative data. [2025-09-18T17:00:26.316335] [DEBUG] [LOCAL ] AA: Deleted derivative data file. [2025-09-18T17:00:26.317080] [INFO ] [MAIN ] Update Progress: 5/2372 symbols completed. AA took 22.9s. Estimated remaining: 3h 0m 40s. Rate: 13.1 symbols/min [2025-09-18T17:00:26.462578] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:00:26.514180] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-02 [2025-09-18T17:00:26.513623] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:00:26.515013] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-03. [2025-09-18T17:00:26.533426] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-18T17:00:26.539540] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-18T17:00:26.571887] [DEBUG] [LOCAL ] AB: Loaded 29113 existing records from primary storage. [2025-09-18T17:00:26.572038] [INFO ] [MAIN ] AB: Loaded 29113 existing records. [2025-09-18T17:00:26.721701] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:00:26.754408] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-03 [2025-09-18T17:00:26.760117] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-04. [2025-09-18T17:00:26.760455] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:00:26.761397] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-18T17:00:26.761449] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-18T17:00:26.762399] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-09-18T17:00:26.762464] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-18T17:00:26.999462] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:00:27.043795] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-04 [2025-09-18T17:00:27.047786] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-05. [2025-09-18T17:00:27.131490] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:00:27.131850] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-11. [2025-09-18T17:00:27.161886] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-18T17:00:27.173912] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-18T17:00:27.318158] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:00:27.318505] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-05 [2025-09-18T17:00:27.319092] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-06. [2025-09-18T17:00:27.518960] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-18T17:00:27.524858] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-18T17:00:28.143108] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-18T17:00:28.145333] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-07. [2025-09-18T17:00:28.393902] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-18T17:00:28.401115] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-09-18T17:00:28.635949] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-18T17:00:28.649852] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-18T17:00:28.650774] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-18T17:00:28.654549] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-08. [2025-09-18T17:00:28.862347] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-18T17:00:28.873534] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-18T17:00:29.237187] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-18T17:00:29.241112] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-09. [2025-09-18T17:00:29.568327] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-18T17:00:29.575531] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-09-18T17:00:29.715436] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-18T17:00:29.723222] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-18T17:00:30.174703] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-18T17:00:30.177915] [INFO ] [REMOTE ] AAUC: Full fetch complete (6821 records). [2025-09-18T17:00:30.178038] [DEBUG] [VALIDATOR ] AAUC: Validating primary data. [2025-09-18T17:00:30.371485] [WARN ] [VALIDATOR ] AAUC: Validation failed - insufficient historical data. Have 71 unique days, need 200 days [2025-09-18T17:00:30.371844] [FATAL] [MAIN ] AAUC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:00:30.371937] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:00:30.372056] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-18T17:00:30.372163] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-18T17:00:30.372235] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-18T17:00:30.372305] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-18T17:00:30.372451] [INFO ] [MAIN ] Update Progress: 6/2372 symbols completed. AAUC took 5.4s. Estimated remaining: 2h 57m 9s. Rate: 13.4 symbols/min [2025-09-18T17:00:30.550559] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:00:30.587144] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-18T17:00:30.600104] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-18T17:00:30.625583] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-18T17:00:30.634323] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-18T17:00:30.655827] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-18T17:00:30.683836] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-18T17:00:30.705697] [DEBUG] [LOCAL ] ABBV: Loaded 53689 existing records from primary storage. [2025-09-18T17:00:30.705879] [INFO ] [MAIN ] ABBV: Loaded 53689 existing records. [2025-09-18T17:00:30.886855] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:00:30.887100] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-18T17:00:30.887157] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-18T17:00:30.888637] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-18T17:00:30.888731] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-18T17:00:31.245844] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:00:31.246191] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-11. [2025-09-18T17:00:31.547710] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-18T17:00:31.554277] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-18T17:00:31.834519] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-18T17:00:31.843540] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-18T17:00:32.017352] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-18T17:00:32.028160] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-18T17:00:32.770275] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-18T17:00:32.778490] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-18T17:00:33.354074] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T17:00:33.363777] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-18T17:00:33.411250] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-11 (2.17 seconds). [2025-09-18T17:00:33.421595] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-09-18T17:00:33.560850] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T17:00:33.578315] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-18T17:00:33.781695] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-18T17:00:33.788271] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-18T17:00:34.542214] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-18T17:00:34.556941] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-18T17:00:34.988754] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-18T17:00:35.015045] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-18T17:00:35.015373] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-18T17:00:35.024133] [INFO ] [REMOTE ] AAT: Full fetch complete (42631 records). [2025-09-18T17:00:35.024277] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-18T17:00:35.414601] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-09-18T17:00:35.414811] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-09-18T17:00:35.415337] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-09-18T17:00:35.415455] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-09-18T17:00:35.416925] [DEBUG] [LOCAL ] AAT: Trimmed 42631 records to 30832 (keeping 200 days of data) [2025-09-18T17:00:35.649875] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-18T17:00:35.664033] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-09-18T17:00:35.684025] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-18T17:00:35.692776] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-18T17:00:35.707956] [DEBUG] [LOCAL ] AAT: Primary data saved (30832 records). [2025-09-18T17:00:35.708137] [INFO ] [MAIN ] AAT: Full history saved. [2025-09-18T17:00:35.708248] [INFO ] [MAIN ] Update Progress: 7/2372 symbols completed. AAT took 13.1s. Estimated remaining: 3h 1m 49s. Rate: 13.0 symbols/min [2025-09-18T17:00:35.887490] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:00:35.935618] [DEBUG] [LOCAL ] ABCB: Loaded 30743 existing records from primary storage. [2025-09-18T17:00:35.935835] [INFO ] [MAIN ] ABCB: Loaded 30743 existing records. [2025-09-18T17:00:36.123342] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:00:36.123619] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-18T17:00:36.123703] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-18T17:00:36.124505] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-09-18T17:00:36.124568] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-18T17:00:36.528816] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:00:36.529156] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-11. [2025-09-18T17:00:36.643374] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-18T17:00:36.648265] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-18T17:00:36.744695] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-18T17:00:36.757009] [INFO ] [REMOTE ] AAP: Full fetch complete (75119 records). [2025-09-18T17:00:36.757179] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-18T17:00:37.149013] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-09-18T17:00:37.149174] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-09-18T17:00:37.150053] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-09-18T17:00:37.150134] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-09-18T17:00:37.151819] [DEBUG] [LOCAL ] AAP: Trimmed 75119 records to 52568 (keeping 200 days of data) [2025-09-18T17:00:37.500181] [DEBUG] [LOCAL ] AAP: Primary data saved (52568 records). [2025-09-18T17:00:37.500459] [INFO ] [MAIN ] AAP: Full history saved. [2025-09-18T17:00:37.500955] [INFO ] [MAIN ] Update Progress: 8/2372 symbols completed. AAP took 23.3s. Estimated remaining: 2h 47m 51s. Rate: 14.1 symbols/min [2025-09-18T17:00:37.706676] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:00:37.709090] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-18T17:00:37.720604] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-18T17:00:37.775483] [DEBUG] [LOCAL ] ABEV: Loaded 53272 existing records from primary storage. [2025-09-18T17:00:37.775666] [INFO ] [MAIN ] ABEV: Loaded 53272 existing records. [2025-09-18T17:00:37.962932] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:00:37.964327] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-18T17:00:37.964580] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-18T17:00:37.970741] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-18T17:00:37.970858] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-18T17:00:37.981818] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-18T17:00:38.011714] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-09-18T17:00:38.195669] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-18T17:00:38.275991] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-18T17:00:38.398168] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:00:38.398637] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-11. [2025-09-18T17:00:39.102971] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-18T17:00:39.109103] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-09-18T17:00:39.268738] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-18T17:00:39.274801] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-18T17:00:39.428415] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-18T17:00:39.438989] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-18T17:00:39.952381] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-18T17:00:39.962541] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-09-18T17:00:40.031691] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-18T17:00:40.038444] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-18T17:00:40.048055] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-18T17:00:40.053130] [INFO ] [REMOTE ] AB: Full fetch complete (45958 records). [2025-09-18T17:00:40.053225] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-18T17:00:40.053898] [FATAL] [VALIDATOR ] AB: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:00:40.053997] [FATAL] [MAIN ] AB: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:00:40.054089] [WARN ] [MAIN ] AB: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:00:40.054164] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-18T17:00:40.054241] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-09-18T17:00:40.054298] [INFO ] [LOCAL ] AB: Starting deletion of derivative data. [2025-09-18T17:00:40.054793] [DEBUG] [LOCAL ] AB: Deleted derivative data file. [2025-09-18T17:00:40.054891] [INFO ] [MAIN ] Update Progress: 9/2372 symbols completed. AB took 13.7s. Estimated remaining: 2h 40m 19s. Rate: 14.7 symbols/min [2025-09-18T17:00:40.223495] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:00:40.249329] [DEBUG] [LOCAL ] ABG: Loaded 18939 existing records from primary storage. [2025-09-18T17:00:40.249452] [INFO ] [MAIN ] ABG: Loaded 18939 existing records. [2025-09-18T17:00:40.433150] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:00:40.433406] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-18T17:00:40.433455] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-18T17:00:40.434131] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-09-18T17:00:40.434192] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-18T17:00:40.784868] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:00:40.785208] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-11. [2025-09-18T17:00:41.267638] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-18T17:00:41.278935] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-18T17:00:41.332391] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-18T17:00:41.339536] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-18T17:00:41.402436] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-18T17:00:41.413407] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-09-18T17:00:41.519843] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-18T17:00:41.523544] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-09-18T17:00:42.220142] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-18T17:00:42.223543] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-09-18T17:00:42.313619] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-18T17:00:42.323310] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-18T17:00:42.903541] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T17:00:42.914256] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-18T17:00:43.015600] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-18T17:00:43.020845] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-18T17:00:43.134550] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-18T17:00:43.151698] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-18T17:00:43.424989] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-18T17:00:43.433142] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-18T17:00:43.739806] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-18T17:00:43.743545] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-18T17:00:44.321064] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-18T17:00:44.327500] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-18T17:00:44.406595] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T17:00:44.519574] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-18T17:00:44.542059] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-18T17:00:44.999712] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-18T17:00:45.158510] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-18T17:00:45.319565] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-18T17:00:46.119630] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-18T17:00:46.508239] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-18T17:00:46.919517] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-18T17:00:47.374260] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-18T17:00:47.438267] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T17:00:47.719697] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-18T17:00:47.796380] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-18T17:00:48.519701] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-18T17:00:49.319537] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-18T17:00:49.366823] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-18T17:00:49.566841] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-18T17:00:50.119552] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-18T17:00:50.919594] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-18T17:00:51.103271] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-18T17:00:51.108030] [INFO ] [REMOTE ] ABCB: Full fetch complete (44043 records). [2025-09-18T17:00:51.108187] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-18T17:00:51.338427] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-18T17:00:51.580253] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-18T17:00:51.580364] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-18T17:00:51.580835] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-18T17:00:51.580903] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-18T17:00:51.582266] [DEBUG] [LOCAL ] ABCB: Trimmed 44043 records to 31012 (keeping 200 days of data) [2025-09-18T17:00:51.733465] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-18T17:00:51.771586] [DEBUG] [LOCAL ] ABCB: Primary data saved (31012 records). [2025-09-18T17:00:51.771749] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-18T17:00:51.772873] [INFO ] [MAIN ] Update Progress: 10/2372 symbols completed. ABCB took 16.1s. Estimated remaining: 3h 10m 21s. Rate: 12.4 symbols/min [2025-09-18T17:00:51.949888] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:00:51.985284] [DEBUG] [LOCAL ] ABM: Loaded 32236 existing records from primary storage. [2025-09-18T17:00:51.985554] [INFO ] [MAIN ] ABM: Loaded 32236 existing records. [2025-09-18T17:00:52.180744] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-18T17:00:52.194861] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:00:52.198874] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-18T17:00:52.199218] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-18T17:00:52.200246] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-18T17:00:52.200307] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-18T17:00:52.520506] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-18T17:00:52.605927] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:00:53.319588] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-11. [2025-09-18T17:00:53.507148] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-18T17:00:54.119565] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-18T17:00:54.491443] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-18T17:00:54.549939] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-18T17:00:54.796030] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-18T17:00:54.919586] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-09-18T17:00:55.719603] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-18T17:00:55.970492] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T17:00:56.502839] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-18T17:00:56.519502] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-18T17:00:57.324464] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-18T17:00:57.332032] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-18T17:00:58.119639] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-09-18T17:00:58.919626] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-18T17:00:59.044936] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-18T17:00:59.108125] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-18T17:00:59.116002] [INFO ] [REMOTE ] ABBV: Full fetch complete (77600 records). [2025-09-18T17:00:59.116204] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-18T17:00:59.513682] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-09-18T17:00:59.513774] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-09-18T17:00:59.514498] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-09-18T17:00:59.514562] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-09-18T17:00:59.516106] [DEBUG] [LOCAL ] ABBV: Trimmed 77600 records to 54077 (keeping 200 days of data) [2025-09-18T17:00:59.744094] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-18T17:00:59.864392] [DEBUG] [LOCAL ] ABBV: Primary data saved (54077 records). [2025-09-18T17:00:59.864527] [INFO ] [MAIN ] ABBV: Full history saved. [2025-09-18T17:00:59.864613] [INFO ] [MAIN ] Update Progress: 11/2372 symbols completed. ABBV took 29.5s. Estimated remaining: 3h 21m 55s. Rate: 11.7 symbols/min [2025-09-18T17:01:00.033162] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:01:00.082604] [DEBUG] [LOCAL ] ABR: Loaded 52166 existing records from primary storage. [2025-09-18T17:01:00.082795] [INFO ] [MAIN ] ABR: Loaded 52166 existing records. [2025-09-18T17:01:00.306245] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:01:00.306861] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-18T17:01:00.307054] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-18T17:01:00.308791] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-18T17:01:00.308981] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-18T17:01:00.447974] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-18T17:01:00.520821] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-18T17:01:00.667754] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-18T17:01:00.686738] [INFO ] [REMOTE ] ABG: Full fetch complete (26254 records). [2025-09-18T17:01:00.711155] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-18T17:01:00.863228] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:01:01.139052] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-09-18T17:01:01.139143] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-09-18T17:01:01.139444] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-09-18T17:01:01.139486] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-09-18T17:01:01.140373] [DEBUG] [LOCAL ] ABG: Trimmed 26254 records to 19091 (keeping 200 days of data) [2025-09-18T17:01:01.256366] [DEBUG] [LOCAL ] ABG: Primary data saved (19091 records). [2025-09-18T17:01:01.256565] [INFO ] [MAIN ] ABG: Full history saved. [2025-09-18T17:01:01.256707] [INFO ] [MAIN ] Update Progress: 12/2372 symbols completed. ABG took 21.2s. Estimated remaining: 3h 9m 35s. Rate: 12.4 symbols/min [2025-09-18T17:01:01.324749] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-11. [2025-09-18T17:01:01.431329] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:01:01.498741] [DEBUG] [LOCAL ] ABT: Loaded 53621 existing records from primary storage. [2025-09-18T17:01:01.508824] [INFO ] [MAIN ] ABT: Loaded 53621 existing records. [2025-09-18T17:01:01.509717] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-18T17:01:01.698451] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:01:01.699158] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-18T17:01:01.699210] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-18T17:01:01.700609] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-09-18T17:01:01.700700] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-18T17:01:02.073999] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:01:02.119576] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-18T17:01:02.919597] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-11. [2025-09-18T17:01:03.325212] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-18T17:01:03.574031] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T17:01:03.719560] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-09-18T17:01:04.415283] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-18T17:01:04.519550] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-18T17:01:05.096331] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-18T17:01:05.319547] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-09-18T17:01:05.610595] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-18T17:01:06.119558] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-18T17:01:06.866236] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T17:01:06.919498] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-18T17:01:07.111602] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-18T17:01:07.719551] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-09-18T17:01:08.519587] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-18T17:01:09.009304] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-18T17:01:09.319556] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-18T17:01:09.909576] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-18T17:01:09.983048] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-18T17:01:10.124615] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-09-18T17:01:10.135493] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-18T17:01:10.919571] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-18T17:01:11.719560] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-18T17:01:11.794034] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-18T17:01:12.519589] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-18T17:01:12.916587] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-18T17:01:12.989528] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-18T17:01:13.319548] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-18T17:01:13.904227] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T17:01:14.119588] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-18T17:01:14.919571] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-18T17:01:15.063363] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-18T17:01:15.719565] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-18T17:01:16.073580] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-18T17:01:16.130758] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-18T17:01:16.519595] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-18T17:01:17.172830] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T17:01:17.180127] [INFO ] [REMOTE ] ABEV: Full fetch complete (77066 records). [2025-09-18T17:01:17.180251] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-18T17:01:17.326083] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-18T17:01:17.597727] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-18T17:01:17.597838] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-18T17:01:17.598604] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-18T17:01:17.598693] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-18T17:01:17.600215] [DEBUG] [LOCAL ] ABEV: Trimmed 77066 records to 53660 (keeping 200 days of data) [2025-09-18T17:01:17.901395] [DEBUG] [LOCAL ] ABEV: Primary data saved (53660 records). [2025-09-18T17:01:17.901536] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-18T17:01:17.902401] [INFO ] [MAIN ] Update Progress: 13/2372 symbols completed. ABEV took 40.4s. Estimated remaining: 3h 45m 16s. Rate: 10.5 symbols/min [2025-09-18T17:01:18.078110] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:01:18.102188] [DEBUG] [LOCAL ] ACA: Loaded 24269 existing records from primary storage. [2025-09-18T17:01:18.102324] [INFO ] [MAIN ] ACA: Loaded 24269 existing records. [2025-09-18T17:01:18.124679] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-18T17:01:18.307749] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:01:18.325135] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-18T17:01:18.325283] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-18T17:01:18.326876] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-09-18T17:01:18.326800] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-18T17:01:18.327081] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-18T17:01:18.748142] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:01:18.919557] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-18T17:01:19.502384] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-18T17:01:19.540916] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-18T17:01:19.719599] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-18T17:01:20.345629] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T17:01:20.519576] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-18T17:01:20.779584] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-18T17:01:20.785347] [INFO ] [REMOTE ] ABM: Full fetch complete (44144 records). [2025-09-18T17:01:20.785506] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-18T17:01:21.180011] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-18T17:01:21.180099] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-18T17:01:21.180535] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-18T17:01:21.180577] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-18T17:01:21.182013] [DEBUG] [LOCAL ] ABM: Trimmed 44144 records to 32511 (keeping 200 days of data) [2025-09-18T17:01:21.331381] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-18T17:01:21.376803] [DEBUG] [LOCAL ] ABM: Primary data saved (32511 records). [2025-09-18T17:01:21.376923] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-18T17:01:21.378075] [INFO ] [MAIN ] Update Progress: 14/2372 symbols completed. ABM took 29.6s. Estimated remaining: 3h 38m 50s. Rate: 10.8 symbols/min [2025-09-18T17:01:21.552608] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:01:21.591913] [DEBUG] [LOCAL ] ACCO: Loaded 38079 existing records from primary storage. [2025-09-18T17:01:21.592060] [INFO ] [MAIN ] ACCO: Loaded 38079 existing records. [2025-09-18T17:01:21.775565] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:01:21.775888] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-18T17:01:21.775968] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-18T17:01:21.776980] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-09-18T17:01:21.777047] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-18T17:01:22.123664] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-11. [2025-09-18T17:01:22.148144] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:01:22.210314] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-18T17:01:22.919591] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-11. [2025-09-18T17:01:23.424857] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-18T17:01:23.452185] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-18T17:01:23.719592] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-18T17:01:24.096819] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-18T17:01:24.519568] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-09-18T17:01:25.156517] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T17:01:25.319592] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-18T17:01:25.879481] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T17:01:26.119581] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-09-18T17:01:26.919581] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-09-18T17:01:26.986504] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-18T17:01:27.440254] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-18T17:01:27.600428] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-18T17:01:27.719595] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-18T17:01:28.519545] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-18T17:01:29.278193] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-18T17:01:29.319509] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-18T17:01:30.119848] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-18T17:01:30.122776] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-18T17:01:30.881254] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-18T17:01:30.889052] [INFO ] [REMOTE ] ABT: Full fetch complete (77429 records). [2025-09-18T17:01:30.889203] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-18T17:01:30.924743] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-09-18T17:01:31.306552] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-09-18T17:01:31.306678] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-09-18T17:01:31.307407] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-09-18T17:01:31.307474] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-09-18T17:01:31.309109] [DEBUG] [LOCAL ] ABT: Trimmed 77429 records to 54011 (keeping 200 days of data) [2025-09-18T17:01:31.651148] [DEBUG] [LOCAL ] ABT: Primary data saved (54011 records). [2025-09-18T17:01:31.651459] [INFO ] [MAIN ] ABT: Full history saved. [2025-09-18T17:01:31.653438] [INFO ] [MAIN ] Update Progress: 15/2372 symbols completed. ABT took 30.4s. Estimated remaining: 3h 51m 5s. Rate: 10.2 symbols/min [2025-09-18T17:01:31.731940] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-18T17:01:31.812952] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-18T17:01:31.889843] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:01:31.904769] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-18T17:01:31.935719] [DEBUG] [LOCAL ] ACEL: Loaded 27453 existing records from primary storage. [2025-09-18T17:01:31.935882] [INFO ] [MAIN ] ACEL: Loaded 27453 existing records. [2025-09-18T17:01:32.128501] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:01:32.128893] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-18T17:01:32.128957] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-18T17:01:32.129627] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-09-18T17:01:32.129726] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-18T17:01:32.532984] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-18T17:01:32.539664] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:01:33.319571] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-11. [2025-09-18T17:01:33.496758] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-18T17:01:33.504634] [INFO ] [REMOTE ] ABR: Full fetch complete (75051 records). [2025-09-18T17:01:33.504837] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-18T17:01:33.898620] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-18T17:01:33.937166] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-18T17:01:33.942409] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-18T17:01:33.943539] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-18T17:01:33.943605] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-18T17:01:33.945148] [DEBUG] [LOCAL ] ABR: Trimmed 75051 records to 52531 (keeping 200 days of data) [2025-09-18T17:01:34.093473] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-18T17:01:34.154623] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-09-18T17:01:34.312310] [DEBUG] [LOCAL ] ABR: Primary data saved (52531 records). [2025-09-18T17:01:34.312476] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-18T17:01:34.313550] [INFO ] [MAIN ] Update Progress: 16/2372 symbols completed. ABR took 34.4s. Estimated remaining: 3h 43m 4s. Rate: 10.6 symbols/min [2025-09-18T17:01:34.514684] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:01:34.576370] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-09-18T17:01:34.576530] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-09-18T17:01:34.780709] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:01:34.780965] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-18T17:01:34.781016] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-18T17:01:34.782246] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-09-18T17:01:34.782311] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-18T17:01:34.924638] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-18T17:01:35.178727] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:01:35.193713] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-18T17:01:35.719565] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-09-18T17:01:36.033820] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-18T17:01:36.519555] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-11. [2025-09-18T17:01:37.209468] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T17:01:37.319574] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-18T17:01:38.119586] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-18T17:01:38.629101] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-11 (2.11 seconds). [2025-09-18T17:01:38.823937] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-18T17:01:38.919587] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-09-18T17:01:39.035174] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-18T17:01:39.719554] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-18T17:01:40.519594] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-18T17:01:40.906525] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-18T17:01:41.197442] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-18T17:01:41.306110] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-18T17:01:41.319502] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-18T17:01:42.119563] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-18T17:01:42.315042] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-18T17:01:42.919553] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-18T17:01:43.638106] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T17:01:43.700484] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-18T17:01:43.719489] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-18T17:01:44.506129] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-18T17:01:44.519557] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-18T17:01:45.319581] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-09-18T17:01:46.020777] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-18T17:01:46.119533] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-18T17:01:46.919550] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-18T17:01:47.369778] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-18T17:01:47.719539] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-18T17:01:47.768956] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-09-18T17:01:47.835293] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-18T17:01:48.519561] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-18T17:01:49.011292] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-18T17:01:49.319569] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-18T17:01:50.119598] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-18T17:01:50.310326] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-18T17:01:50.894926] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-18T17:01:50.925813] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-18T17:01:50.947534] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-18T17:01:51.719613] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-18T17:01:51.838991] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-18T17:01:52.519608] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-18T17:01:52.555768] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-18T17:01:52.562412] [INFO ] [REMOTE ] ACEL: Full fetch complete (38979 records). [2025-09-18T17:01:52.562674] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-18T17:01:52.997621] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-09-18T17:01:52.997756] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-09-18T17:01:52.998271] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-09-18T17:01:52.998336] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-09-18T17:01:52.999796] [DEBUG] [LOCAL ] ACEL: Trimmed 38979 records to 27701 (keeping 200 days of data) [2025-09-18T17:01:53.168958] [DEBUG] [LOCAL ] ACEL: Primary data saved (27701 records). [2025-09-18T17:01:53.169097] [INFO ] [MAIN ] ACEL: Full history saved. [2025-09-18T17:01:53.169196] [INFO ] [MAIN ] Update Progress: 17/2372 symbols completed. ACEL took 21.5s. Estimated remaining: 4h 13m 24s. Rate: 9.3 symbols/min [2025-09-18T17:01:53.343427] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-18T17:01:53.346912] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:01:53.402751] [DEBUG] [LOCAL ] ACI: Loaded 53274 existing records from primary storage. [2025-09-18T17:01:53.402895] [INFO ] [MAIN ] ACI: Loaded 53274 existing records. [2025-09-18T17:01:53.584621] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:01:53.584901] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-18T17:01:53.584963] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-18T17:01:53.586103] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-18T17:01:53.586164] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-18T17:01:53.969966] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:01:53.991825] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T17:01:54.096883] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-18T17:01:54.119584] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-18T17:01:54.910980] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T17:01:54.919501] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-18T17:01:55.719563] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-11. [2025-09-18T17:01:56.251776] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T17:01:56.259202] [INFO ] [REMOTE ] ACCO: Full fetch complete (54177 records). [2025-09-18T17:01:56.259384] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-18T17:01:56.527450] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-18T17:01:56.669021] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-09-18T17:01:56.669124] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-09-18T17:01:56.669681] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-09-18T17:01:56.669793] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-09-18T17:01:56.671379] [DEBUG] [LOCAL ] ACCO: Trimmed 54177 records to 38341 (keeping 200 days of data) [2025-09-18T17:01:56.900759] [DEBUG] [LOCAL ] ACCO: Primary data saved (38341 records). [2025-09-18T17:01:56.900948] [INFO ] [MAIN ] ACCO: Full history saved. [2025-09-18T17:01:56.903615] [INFO ] [MAIN ] Update Progress: 18/2372 symbols completed. ACCO took 35.5s. Estimated remaining: 4h 7m 21s. Rate: 9.5 symbols/min [2025-09-18T17:01:57.087609] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:01:57.138973] [DEBUG] [LOCAL ] ACM: Loaded 43121 existing records from primary storage. [2025-09-18T17:01:57.139117] [INFO ] [MAIN ] ACM: Loaded 43121 existing records. [2025-09-18T17:01:57.321672] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-18T17:01:57.343993] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:01:57.346841] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-18T17:01:57.347005] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-18T17:01:57.359137] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-18T17:01:57.362310] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-18T17:01:57.363367] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-18T17:01:57.376376] [INFO ] [REMOTE ] ACA: Full fetch complete (34214 records). [2025-09-18T17:01:57.387976] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-18T17:01:57.767002] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-18T17:01:58.123152] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-09-18T17:01:58.292845] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:01:58.293798] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-18T17:01:58.294023] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-18T17:01:58.294683] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-18T17:01:58.295013] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-18T17:01:58.296417] [DEBUG] [LOCAL ] ACA: Trimmed 34214 records to 24478 (keeping 200 days of data) [2025-09-18T17:01:58.455339] [DEBUG] [LOCAL ] ACA: Primary data saved (24478 records). [2025-09-18T17:01:58.455490] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-18T17:01:58.455604] [INFO ] [MAIN ] Update Progress: 19/2372 symbols completed. ACA took 40.6s. Estimated remaining: 3h 57m 26s. Rate: 9.9 symbols/min [2025-09-18T17:01:58.642790] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:01:58.705851] [DEBUG] [LOCAL ] ACN: Loaded 53419 existing records from primary storage. [2025-09-18T17:01:58.706006] [INFO ] [MAIN ] ACN: Loaded 53419 existing records. [2025-09-18T17:01:58.884591] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:01:58.884876] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-18T17:01:58.884928] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-18T17:01:58.886176] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-09-18T17:01:58.886240] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-18T17:01:58.929919] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-11. [2025-09-18T17:01:59.380360] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:01:59.719595] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-11. [2025-09-18T17:02:00.114356] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-09-18T17:02:00.195757] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-18T17:02:00.519613] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-09-18T17:02:00.603486] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-18T17:02:01.319566] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-09-18T17:02:01.368693] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T17:02:01.851220] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-18T17:02:02.119558] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-18T17:02:02.893786] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-18T17:02:02.919499] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-09-18T17:02:03.388865] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-18T17:02:03.719744] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-18T17:02:04.519533] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-09-18T17:02:04.598201] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-18T17:02:05.081942] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T17:02:05.319549] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-18T17:02:05.968829] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-18T17:02:06.119519] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-09-18T17:02:06.615721] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-18T17:02:06.919543] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-18T17:02:07.644174] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T17:02:07.719600] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-18T17:02:08.519549] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-18T17:02:09.192614] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-18T17:02:09.319602] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-18T17:02:09.644590] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-18T17:02:10.106062] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-18T17:02:10.119490] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-18T17:02:10.818151] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-18T17:02:10.919558] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-18T17:02:11.435322] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T17:02:11.719556] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-18T17:02:12.297834] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-18T17:02:12.519592] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-18T17:02:13.319559] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-18T17:02:13.476327] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-18T17:02:13.700556] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-18T17:02:14.119585] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-18T17:02:14.919621] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-18T17:02:15.451614] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-18T17:02:15.719560] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-18T17:02:16.035027] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-18T17:02:16.519564] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-18T17:02:16.552757] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-18T17:02:17.319623] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-18T17:02:17.947597] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-18T17:02:18.119582] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-18T17:02:18.325770] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-18T17:02:18.919563] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-18T17:02:19.306509] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-18T17:02:19.591408] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-18T17:02:19.719591] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-18T17:02:20.519527] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-18T17:02:20.965712] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-18T17:02:21.319545] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-18T17:02:22.119575] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-18T17:02:22.166978] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-18T17:02:22.241420] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-18T17:02:22.919615] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-18T17:02:23.013567] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-18T17:02:23.395491] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-18T17:02:23.719586] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-18T17:02:24.519594] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-18T17:02:25.302601] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-18T17:02:25.319502] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-18T17:02:25.360784] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-18T17:02:25.368234] [INFO ] [REMOTE ] ACI: Full fetch complete (76870 records). [2025-09-18T17:02:25.368416] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-18T17:02:25.785513] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-09-18T17:02:25.785635] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-09-18T17:02:25.786501] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-09-18T17:02:25.786588] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-09-18T17:02:25.789313] [DEBUG] [LOCAL ] ACI: Trimmed 76870 records to 53663 (keeping 200 days of data) [2025-09-18T17:02:26.121767] [DEBUG] [LOCAL ] ACI: Primary data saved (53663 records). [2025-09-18T17:02:26.121892] [INFO ] [MAIN ] ACI: Full history saved. [2025-09-18T17:02:26.121628] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-18T17:02:26.125793] [INFO ] [MAIN ] Update Progress: 20/2372 symbols completed. ACI took 33.0s. Estimated remaining: 4h 39m 42s. Rate: 8.4 symbols/min [2025-09-18T17:02:26.312294] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:02:26.348139] [DEBUG] [LOCAL ] ACP: Loaded 31453 existing records from primary storage. [2025-09-18T17:02:26.348331] [INFO ] [MAIN ] ACP: Loaded 31453 existing records. [2025-09-18T17:02:26.548307] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:02:26.548838] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-18T17:02:26.548917] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-18T17:02:26.561105] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-09-18T17:02:26.582503] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-18T17:02:26.585539] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-18T17:02:26.924781] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-18T17:02:27.019316] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:02:27.691355] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-18T17:02:27.700830] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-09-18T17:02:27.701006] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-18T17:02:27.736251] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-11. [2025-09-18T17:02:28.088341] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-18T17:02:28.153414] [INFO ] [REMOTE ] ACM: Full fetch complete (62376 records). [2025-09-18T17:02:28.175244] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-09-18T17:02:28.175012] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-18T17:02:28.175416] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-09-18T17:02:28.176545] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-09-18T17:02:28.176810] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-09-18T17:02:28.281178] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 54208 (keeping 200 days of data) [2025-09-18T17:02:28.909327] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-18T17:02:28.909871] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-18T17:02:28.913239] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-18T17:02:28.914181] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-18T17:02:28.930697] [DEBUG] [LOCAL ] ACM: Trimmed 62376 records to 43495 (keeping 200 days of data) [2025-09-18T17:02:29.115511] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-18T17:02:29.125400] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-09-18T17:02:29.343805] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-18T17:02:29.360163] [DEBUG] [LOCAL ] ACHR: Primary data saved (54208 records). [2025-09-18T17:02:29.361113] [INFO ] [MAIN ] ACHR: Full history saved. [2025-09-18T17:02:29.362587] [INFO ] [MAIN ] Update Progress: 21/2372 symbols completed. ACHR took 55.0s. Estimated remaining: 4h 32m 19s. Rate: 8.6 symbols/min [2025-09-18T17:02:29.397508] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-18T17:02:29.553106] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:02:29.565713] [DEBUG] [LOCAL ] ACR: Loaded 6484 existing records from primary storage. [2025-09-18T17:02:29.567192] [INFO ] [MAIN ] ACR: Loaded 6484 existing records. [2025-09-18T17:02:29.757235] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:02:29.764780] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-18T17:02:29.765169] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-18T17:02:29.783247] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-18T17:02:29.785876] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-18T17:02:29.872155] [DEBUG] [LOCAL ] ACM: Primary data saved (43495 records). [2025-09-18T17:02:29.895895] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-18T17:02:29.900480] [INFO ] [MAIN ] Update Progress: 22/2372 symbols completed. ACM took 33.0s. Estimated remaining: 4h 20m 47s. Rate: 9.0 symbols/min [2025-09-18T17:02:30.298861] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:02:30.385736] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:02:30.390788] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-11. [2025-09-18T17:02:30.417932] [DEBUG] [LOCAL ] ACRE: Loaded 33725 existing records from primary storage. [2025-09-18T17:02:30.418099] [INFO ] [MAIN ] ACRE: Loaded 33725 existing records. [2025-09-18T17:02:30.635510] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-18T17:02:30.658708] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:02:30.668534] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-18T17:02:30.669112] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-18T17:02:30.670236] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-09-18T17:02:30.670321] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-18T17:02:30.873975] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-18T17:02:30.924927] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-09-18T17:02:31.085169] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:02:31.367882] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-18T17:02:31.657837] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-18T17:02:31.670447] [INFO ] [REMOTE ] ACN: Full fetch complete (76940 records). [2025-09-18T17:02:31.670626] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-18T17:02:31.725994] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-11. [2025-09-18T17:02:32.079085] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-09-18T17:02:32.079174] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-09-18T17:02:32.079942] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-09-18T17:02:32.080010] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-09-18T17:02:32.082885] [DEBUG] [LOCAL ] ACN: Trimmed 76940 records to 53809 (keeping 200 days of data) [2025-09-18T17:02:32.444409] [DEBUG] [LOCAL ] ACN: Primary data saved (53809 records). [2025-09-18T17:02:32.444720] [INFO ] [MAIN ] ACN: Full history saved. [2025-09-18T17:02:32.446154] [INFO ] [MAIN ] Update Progress: 23/2372 symbols completed. ACN took 34.0s. Estimated remaining: 4h 13m 40s. Rate: 9.3 symbols/min [2025-09-18T17:02:32.527745] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-09-18T17:02:32.636717] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:02:32.636896] [DEBUG] [LOCAL ] ACV: No existing data file found in primary storage. [2025-09-18T17:02:32.636933] [WARN ] [MAIN ] ACV: No existing data found, performing full refresh instead. [2025-09-18T17:02:32.637103] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-18T17:02:32.637340] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-18T17:02:32.637382] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-09-18T17:02:32.637416] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-18T17:02:33.067755] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:02:33.089818] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-18T17:02:33.319558] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-09-18T17:02:33.586606] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-18T17:02:33.921832] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-18T17:02:34.119548] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-11. [2025-09-18T17:02:34.640948] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-18T17:02:34.919583] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-09-18T17:02:35.385502] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-18T17:02:35.719550] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-18T17:02:36.135573] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-18T17:02:36.519612] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-18T17:02:37.319561] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-18T17:02:37.448041] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-18T17:02:38.119581] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-18T17:02:38.274776] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-18T17:02:38.919597] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-18T17:02:39.157574] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-18T17:02:39.715183] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-18T17:02:39.719501] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-18T17:02:40.166707] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-18T17:02:40.519576] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-09-18T17:02:41.319592] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-18T17:02:42.131852] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-18T17:02:42.138365] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-18T17:02:42.271072] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-18T17:02:42.595850] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-18T17:02:42.919708] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-09-18T17:02:43.532881] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-18T17:02:43.719736] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-18T17:02:44.326333] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-18T17:02:44.519615] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-18T17:02:44.872056] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-18T17:02:45.319609] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-18T17:02:46.013788] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-18T17:02:46.119580] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-18T17:02:46.596958] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-18T17:02:46.919554] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-18T17:02:47.409952] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-18T17:02:47.411183] [INFO ] [REMOTE ] ACR: Full fetch complete (8568 records). [2025-09-18T17:02:47.411269] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-18T17:02:47.722844] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-18T17:02:47.819549] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-09-18T17:02:47.819693] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-09-18T17:02:47.819882] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-09-18T17:02:47.819923] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-09-18T17:02:47.820361] [DEBUG] [LOCAL ] ACR: Trimmed 8568 records to 6525 (keeping 200 days of data) [2025-09-18T17:02:47.858585] [DEBUG] [LOCAL ] ACR: Primary data saved (6525 records). [2025-09-18T17:02:47.858716] [INFO ] [MAIN ] ACR: Full history saved. [2025-09-18T17:02:47.858823] [INFO ] [MAIN ] Update Progress: 24/2372 symbols completed. ACR took 18.5s. Estimated remaining: 4h 28m 8s. Rate: 8.8 symbols/min [2025-09-18T17:02:48.039938] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:02:48.091352] [DEBUG] [LOCAL ] ACVA: Loaded 49377 existing records from primary storage. [2025-09-18T17:02:48.091498] [INFO ] [MAIN ] ACVA: Loaded 49377 existing records. [2025-09-18T17:02:48.277020] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:02:48.277352] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-18T17:02:48.277410] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-18T17:02:48.278581] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-18T17:02:48.278672] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-18T17:02:48.531927] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-18T17:02:48.669869] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:02:48.787014] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-18T17:02:49.319553] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-18T17:02:49.386851] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-18T17:02:50.119551] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-18T17:02:50.531733] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-18T17:02:50.919573] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-18T17:02:51.007688] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-18T17:02:51.509237] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-18T17:02:51.719555] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-18T17:02:52.402288] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-18T17:02:52.519539] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-18T17:02:52.938228] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-18T17:02:53.319559] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-18T17:02:54.089798] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-18T17:02:54.092155] [INFO ] [REMOTE ] ACV: Full fetch complete (9500 records). [2025-09-18T17:02:54.092262] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-18T17:02:54.092910] [FATAL] [VALIDATOR ] ACV: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:02:54.093040] [FATAL] [MAIN ] ACV: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:02:54.093122] [WARN ] [MAIN ] ACV: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:02:54.093207] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-18T17:02:54.093295] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-09-18T17:02:54.093368] [INFO ] [LOCAL ] ACV: Starting deletion of derivative data. [2025-09-18T17:02:54.093536] [DEBUG] [LOCAL ] ACV: No derivative data file found to delete. [2025-09-18T17:02:54.093669] [INFO ] [MAIN ] Update Progress: 25/2372 symbols completed. ACV took 21.6s. Estimated remaining: 4h 27m 3s. Rate: 8.8 symbols/min [2025-09-18T17:02:54.128262] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-18T17:02:54.270709] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:02:54.270891] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-18T17:02:54.270929] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-18T17:02:54.271079] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-18T17:02:54.271122] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-18T17:02:54.271163] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-18T17:02:54.271196] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-18T17:02:54.637628] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:02:54.919569] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-11. [2025-09-18T17:02:55.122489] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:02:55.122861] [WARN ] [REMOTE ] AD: No data returned for month 2024-11 [2025-09-18T17:02:55.167924] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-18T17:02:55.719607] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-11. [2025-09-18T17:02:56.519569] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-09-18T17:02:57.328127] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-18T17:02:57.345895] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-18T17:02:57.555820] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:02:57.556067] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-18T17:02:57.703884] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-18T17:02:58.119539] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-18T17:02:58.919567] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-18T17:02:59.533288] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T17:02:59.719577] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-09-18T17:02:59.843929] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-18T17:03:00.519550] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-18T17:03:01.215806] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T17:03:01.319510] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-09-18T17:03:01.960943] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-18T17:03:01.965373] [INFO ] [REMOTE ] ACP: Full fetch complete (47951 records). [2025-09-18T17:03:01.965501] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-18T17:03:02.124680] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-09-18T17:03:02.386578] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-09-18T17:03:02.386738] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-09-18T17:03:02.387471] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-09-18T17:03:02.387557] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-09-18T17:03:02.389340] [DEBUG] [LOCAL ] ACP: Trimmed 47951 records to 31597 (keeping 200 days of data) [2025-09-18T17:03:02.597714] [DEBUG] [LOCAL ] ACP: Primary data saved (31597 records). [2025-09-18T17:03:02.597862] [INFO ] [MAIN ] ACP: Full history saved. [2025-09-18T17:03:02.598844] [INFO ] [MAIN ] Update Progress: 26/2372 symbols completed. ACP took 36.5s. Estimated remaining: 4h 29m 28s. Rate: 8.7 symbols/min [2025-09-18T17:03:02.772471] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:03:02.830283] [DEBUG] [LOCAL ] ADC: Loaded 46645 existing records from primary storage. [2025-09-18T17:03:02.830457] [INFO ] [MAIN ] ADC: Loaded 46645 existing records. [2025-09-18T17:03:02.929413] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-18T17:03:03.011444] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:03:03.011734] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-18T17:03:03.011790] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-18T17:03:03.012977] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-09-18T17:03:03.013037] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-18T17:03:03.408435] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:03:03.444523] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-18T17:03:03.719625] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-11. [2025-09-18T17:03:03.877277] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:03:03.877697] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-09-18T17:03:04.519504] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-02. [2025-09-18T17:03:04.599343] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-18T17:03:04.744900] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:03:04.745227] [WARN ] [REMOTE ] AD: No data returned for month 2025-02 [2025-09-18T17:03:05.319579] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-03. [2025-09-18T17:03:05.530698] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:03:05.531198] [WARN ] [REMOTE ] AD: No data returned for month 2025-03 [2025-09-18T17:03:05.534070] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-18T17:03:06.119621] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-04. [2025-09-18T17:03:06.333315] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:03:06.333686] [WARN ] [REMOTE ] AD: No data returned for month 2025-04 [2025-09-18T17:03:06.919594] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-18T17:03:07.719583] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-18T17:03:08.519588] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-09-18T17:03:08.648369] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-18T17:03:09.183743] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-18T17:03:09.319588] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-05. [2025-09-18T17:03:09.548042] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:03:09.548377] [WARN ] [REMOTE ] AD: No data returned for month 2025-05 [2025-09-18T17:03:09.702871] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-18T17:03:10.119551] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-18T17:03:10.919595] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-18T17:03:11.719548] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-06. [2025-09-18T17:03:11.787480] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-18T17:03:11.940791] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:03:11.941485] [WARN ] [REMOTE ] AD: No data returned for month 2025-06 [2025-09-18T17:03:11.942522] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-18T17:03:12.519582] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-18T17:03:13.319551] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-09-18T17:03:13.931047] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-18T17:03:14.119557] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-07. [2025-09-18T17:03:14.362291] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:03:14.362739] [WARN ] [REMOTE ] AD: No data returned for month 2025-07 [2025-09-18T17:03:14.540928] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-18T17:03:14.919561] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-08. [2025-09-18T17:03:15.719582] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-18T17:03:16.519568] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-18T17:03:16.659494] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-18T17:03:17.319593] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-18T17:03:17.906606] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-18T17:03:18.119596] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-09. [2025-09-18T17:03:18.330228] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-18T17:03:18.714474] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-18T17:03:18.919568] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-18T17:03:19.127085] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T17:03:19.132705] [INFO ] [REMOTE ] AD: Full fetch complete (5417 records). [2025-09-18T17:03:19.132890] [DEBUG] [VALIDATOR ] AD: Validating primary data. [2025-09-18T17:03:19.328673] [WARN ] [VALIDATOR ] AD: Validation failed - insufficient historical data. Have 27 unique days, need 200 days [2025-09-18T17:03:19.328947] [FATAL] [MAIN ] AD: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:03:19.329030] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:03:19.329115] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-18T17:03:19.329213] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-18T17:03:19.329270] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-18T17:03:19.329316] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-18T17:03:19.329376] [INFO ] [MAIN ] Update Progress: 27/2372 symbols completed. AD took 25.2s. Estimated remaining: 4h 43m 35s. Rate: 8.3 symbols/min [2025-09-18T17:03:19.501734] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:03:19.501937] [DEBUG] [LOCAL ] ADCT: No existing data file found in primary storage. [2025-09-18T17:03:19.501975] [WARN ] [MAIN ] ADCT: No existing data found, performing full refresh instead. [2025-09-18T17:03:19.502123] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-18T17:03:19.502165] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-18T17:03:19.502206] [DEBUG] [LOCAL ] ADCT: No primary data file found to delete. [2025-09-18T17:03:19.502239] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-18T17:03:19.724733] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-18T17:03:19.888093] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:03:20.399196] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-18T17:03:20.519522] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-18T17:03:21.165600] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-18T17:03:21.319571] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-18T17:03:21.673934] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-18T17:03:22.119558] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-18T17:03:22.432330] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-18T17:03:22.919561] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-18T17:03:23.719516] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-11. [2025-09-18T17:03:23.760735] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T17:03:24.168436] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T17:03:24.519578] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-18T17:03:24.803541] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-18T17:03:25.319548] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-09-18T17:03:25.778875] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-18T17:03:26.119597] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-18T17:03:26.919598] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-18T17:03:27.001126] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-18T17:03:27.020189] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-18T17:03:27.024708] [INFO ] [REMOTE ] ACRE: Full fetch complete (50180 records). [2025-09-18T17:03:27.024806] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-18T17:03:27.025475] [FATAL] [VALIDATOR ] ACRE: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:03:27.025563] [FATAL] [MAIN ] ACRE: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:03:27.025607] [WARN ] [MAIN ] ACRE: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:03:27.025703] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-18T17:03:27.025784] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-09-18T17:03:27.025820] [INFO ] [LOCAL ] ACRE: Starting deletion of derivative data. [2025-09-18T17:03:27.026306] [DEBUG] [LOCAL ] ACRE: Deleted derivative data file. [2025-09-18T17:03:27.026400] [INFO ] [MAIN ] Update Progress: 28/2372 symbols completed. ACRE took 57.1s. Estimated remaining: 4h 44m 5s. Rate: 8.3 symbols/min [2025-09-18T17:03:27.202624] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:03:27.261378] [DEBUG] [LOCAL ] ADM: Loaded 53399 existing records from primary storage. [2025-09-18T17:03:27.261551] [INFO ] [MAIN ] ADM: Loaded 53399 existing records. [2025-09-18T17:03:27.468052] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:03:27.468296] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-18T17:03:27.468346] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-18T17:03:27.469688] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-09-18T17:03:27.469751] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-18T17:03:27.724671] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-09-18T17:03:27.893343] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:03:28.484732] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-18T17:03:28.493518] [INFO ] [REMOTE ] ACVA: Full fetch complete (69968 records). [2025-09-18T17:03:28.493759] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-18T17:03:28.530003] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-18T17:03:28.912484] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-18T17:03:28.912698] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-18T17:03:28.913550] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-18T17:03:28.913636] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-18T17:03:28.935120] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-18T17:03:28.942852] [DEBUG] [LOCAL ] ACVA: Trimmed 69968 records to 49750 (keeping 200 days of data) [2025-09-18T17:03:29.229716] [DEBUG] [LOCAL ] ACVA: Primary data saved (49750 records). [2025-09-18T17:03:29.229872] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-18T17:03:29.229966] [INFO ] [MAIN ] Update Progress: 29/2372 symbols completed. ACVA took 41.4s. Estimated remaining: 4h 37m 8s. Rate: 8.5 symbols/min [2025-09-18T17:03:29.328526] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-11. [2025-09-18T17:03:29.403754] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:03:29.403911] [DEBUG] [LOCAL ] ADNT: No existing data file found in primary storage. [2025-09-18T17:03:29.403965] [WARN ] [MAIN ] ADNT: No existing data found, performing full refresh instead. [2025-09-18T17:03:29.404137] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-18T17:03:29.404184] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-18T17:03:29.404230] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-09-18T17:03:29.404262] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-18T17:03:29.763928] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:03:29.950805] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-18T17:03:30.119555] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-11. [2025-09-18T17:03:30.919566] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-18T17:03:31.325928] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-18T17:03:31.361080] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-18T17:03:31.719590] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-09-18T17:03:32.437136] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-18T17:03:32.519510] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-18T17:03:33.319600] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-09-18T17:03:33.631700] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-18T17:03:33.661056] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-18T17:03:34.119587] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-09-18T17:03:34.653131] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T17:03:34.919598] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-18T17:03:35.647681] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-18T17:03:35.719554] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-18T17:03:36.167349] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-18T17:03:36.519595] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-18T17:03:37.319695] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-09-18T17:03:37.572943] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-18T17:03:37.794539] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-18T17:03:38.119594] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-18T17:03:38.426508] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-18T17:03:38.919581] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-18T17:03:39.314690] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-18T17:03:39.719569] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-18T17:03:40.520506] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-18T17:03:40.522902] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-18T17:03:41.225889] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T17:03:41.233934] [INFO ] [REMOTE ] ADC: Full fetch complete (65850 records). [2025-09-18T17:03:41.234238] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-18T17:03:41.324901] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-18T17:03:41.690481] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-09-18T17:03:41.690592] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-09-18T17:03:41.691226] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-09-18T17:03:41.691298] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-09-18T17:03:41.692703] [DEBUG] [LOCAL ] ADC: Trimmed 65850 records to 46911 (keeping 200 days of data) [2025-09-18T17:03:41.994419] [DEBUG] [LOCAL ] ADC: Primary data saved (46911 records). [2025-09-18T17:03:41.994556] [INFO ] [MAIN ] ADC: Full history saved. [2025-09-18T17:03:41.995274] [INFO ] [MAIN ] Update Progress: 30/2372 symbols completed. ADC took 39.4s. Estimated remaining: 4h 44m 23s. Rate: 8.2 symbols/min [2025-09-18T17:03:42.124744] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-18T17:03:42.172716] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:03:42.229586] [DEBUG] [LOCAL ] ADT: Loaded 53454 existing records from primary storage. [2025-09-18T17:03:42.229766] [INFO ] [MAIN ] ADT: Loaded 53454 existing records. [2025-09-18T17:03:42.416602] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:03:42.417138] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-18T17:03:42.423022] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-18T17:03:42.434723] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-18T17:03:42.434622] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-18T17:03:42.434919] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-18T17:03:42.816591] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:03:42.848689] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-18T17:03:42.919527] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-11. [2025-09-18T17:03:43.724727] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-18T17:03:43.748347] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-18T17:03:44.505098] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-18T17:03:44.519503] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-09-18T17:03:45.110410] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-18T17:03:45.319584] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-18T17:03:45.961210] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-18T17:03:46.119608] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-09-18T17:03:46.928118] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-18T17:03:46.930810] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-18T17:03:47.528518] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-18T17:03:47.719606] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-18T17:03:48.463524] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T17:03:48.519507] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-18T17:03:49.319580] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-18T17:03:49.496469] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-18T17:03:50.085404] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T17:03:50.119490] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-18T17:03:50.395516] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-18T17:03:50.919548] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-18T17:03:51.719563] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-18T17:03:51.829248] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-18T17:03:51.926103] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-18T17:03:52.519541] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-18T17:03:52.942678] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T17:03:53.319589] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-18T17:03:54.113575] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-18T17:03:54.123056] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-18T17:03:54.919611] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-18T17:03:55.281235] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-18T17:03:55.719632] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-18T17:03:56.080814] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-18T17:03:56.087000] [INFO ] [REMOTE ] ADCT: Full fetch complete (51352 records). [2025-09-18T17:03:56.087201] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-18T17:03:56.502727] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-18T17:03:56.502937] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-18T17:03:56.503667] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-18T17:03:56.503752] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-18T17:03:56.505357] [DEBUG] [LOCAL ] ADCT: Trimmed 51352 records to 33823 (keeping 200 days of data) [2025-09-18T17:03:56.519528] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-18T17:03:56.651546] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-18T17:03:56.767240] [DEBUG] [LOCAL ] ADCT: Primary data saved (33823 records). [2025-09-18T17:03:56.767411] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-18T17:03:56.767498] [INFO ] [MAIN ] Update Progress: 31/2372 symbols completed. ADCT took 37.4s. Estimated remaining: 4h 53m 42s. Rate: 8.0 symbols/min [2025-09-18T17:03:56.957975] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:03:56.958180] [DEBUG] [LOCAL ] ADX: No existing data file found in primary storage. [2025-09-18T17:03:56.958235] [WARN ] [MAIN ] ADX: No existing data found, performing full refresh instead. [2025-09-18T17:03:56.958389] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-18T17:03:56.958432] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-18T17:03:56.958473] [DEBUG] [LOCAL ] ADX: No primary data file found to delete. [2025-09-18T17:03:56.958505] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-18T17:03:57.337040] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:03:57.330702] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-18T17:03:57.400806] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-18T17:03:58.119566] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-18T17:03:58.193686] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-18T17:03:58.693925] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-18T17:03:58.919547] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-18T17:03:59.595171] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-18T17:03:59.603639] [INFO ] [REMOTE ] ADM: Full fetch complete (77057 records). [2025-09-18T17:03:59.603902] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-18T17:03:59.724756] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-18T17:04:00.013137] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-09-18T17:04:00.013238] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-09-18T17:04:00.014125] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-09-18T17:04:00.014209] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-09-18T17:04:00.016035] [DEBUG] [LOCAL ] ADM: Trimmed 77057 records to 53786 (keeping 200 days of data) [2025-09-18T17:04:00.368882] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T17:04:00.396716] [DEBUG] [LOCAL ] ADM: Primary data saved (53786 records). [2025-09-18T17:04:00.396926] [INFO ] [MAIN ] ADM: Full history saved. [2025-09-18T17:04:00.397768] [INFO ] [MAIN ] Update Progress: 32/2372 symbols completed. ADM took 33.4s. Estimated remaining: 4h 48m 49s. Rate: 8.1 symbols/min [2025-09-18T17:04:00.524798] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-11. [2025-09-18T17:04:00.589889] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:04:00.644581] [DEBUG] [LOCAL ] AEE: Loaded 50329 existing records from primary storage. [2025-09-18T17:04:00.644763] [INFO ] [MAIN ] AEE: Loaded 50329 existing records. [2025-09-18T17:04:00.828019] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:04:00.828348] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-18T17:04:00.828405] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-18T17:04:00.829510] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-09-18T17:04:00.829572] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-18T17:04:01.203555] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:04:01.265960] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-18T17:04:01.319513] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-18T17:04:01.713351] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-18T17:04:02.119549] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-18T17:04:02.919567] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-11. [2025-09-18T17:04:03.147950] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-18T17:04:03.273998] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-18T17:04:03.719582] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-18T17:04:04.334782] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T17:04:04.519570] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-09-18T17:04:05.165666] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T17:04:05.319509] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-18T17:04:06.119545] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-09-18T17:04:06.294537] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-18T17:04:06.838157] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-18T17:04:06.919548] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-09-18T17:04:07.012240] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-18T17:04:07.719549] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-09-18T17:04:08.371235] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-18T17:04:08.519566] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-18T17:04:09.137992] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-18T17:04:09.319545] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-18T17:04:09.968353] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T17:04:10.119575] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-18T17:04:10.192415] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-18T17:04:10.919571] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-18T17:04:11.539545] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-18T17:04:11.547067] [INFO ] [REMOTE ] ADT: Full fetch complete (77050 records). [2025-09-18T17:04:11.547247] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-18T17:04:11.729152] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-18T17:04:11.955757] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-18T17:04:11.955846] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-18T17:04:11.956539] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-18T17:04:11.956586] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-18T17:04:11.958069] [DEBUG] [LOCAL ] ADT: Trimmed 77050 records to 53843 (keeping 200 days of data) [2025-09-18T17:04:12.279635] [DEBUG] [LOCAL ] ADT: Primary data saved (53843 records). [2025-09-18T17:04:12.279848] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-18T17:04:12.280607] [INFO ] [MAIN ] Update Progress: 33/2372 symbols completed. ADT took 30.3s. Estimated remaining: 4h 53m 59s. Rate: 8.0 symbols/min [2025-09-18T17:04:12.462804] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:04:12.463109] [DEBUG] [LOCAL ] AEFC: No existing data file found in primary storage. [2025-09-18T17:04:12.463300] [WARN ] [MAIN ] AEFC: No existing data found, performing full refresh instead. [2025-09-18T17:04:12.463519] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-18T17:04:12.463603] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-18T17:04:12.469819] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-09-18T17:04:12.480188] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-18T17:04:12.486734] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T17:04:12.523310] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-18T17:04:12.874127] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:04:13.231910] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-18T17:04:13.239017] [INFO ] [REMOTE ] ADNT: Full fetch complete (68014 records). [2025-09-18T17:04:13.239201] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-18T17:04:13.324827] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-18T17:04:13.643309] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-09-18T17:04:13.643468] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-09-18T17:04:13.644291] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-09-18T17:04:13.644368] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-09-18T17:04:13.645951] [DEBUG] [LOCAL ] ADNT: Trimmed 68014 records to 48010 (keeping 200 days of data) [2025-09-18T17:04:13.942680] [DEBUG] [LOCAL ] ADNT: Primary data saved (48010 records). [2025-09-18T17:04:13.942825] [INFO ] [MAIN ] ADNT: Full history saved. [2025-09-18T17:04:13.942905] [INFO ] [MAIN ] Update Progress: 34/2372 symbols completed. ADNT took 44.7s. Estimated remaining: 4h 47m 7s. Rate: 8.1 symbols/min [2025-09-18T17:04:14.117125] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:04:14.134138] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-11. [2025-09-18T17:04:14.149256] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-18T17:04:14.199430] [DEBUG] [LOCAL ] AEG: Loaded 49607 existing records from primary storage. [2025-09-18T17:04:14.199579] [INFO ] [MAIN ] AEG: Loaded 49607 existing records. [2025-09-18T17:04:14.389684] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:04:14.390275] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-18T17:04:14.390407] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-18T17:04:14.398179] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-09-18T17:04:14.407081] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-18T17:04:14.440317] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-18T17:04:14.788112] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:04:14.795004] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-18T17:04:14.919559] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-09-18T17:04:15.705676] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-18T17:04:15.719494] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-09-18T17:04:16.243201] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-18T17:04:16.519551] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-18T17:04:17.319547] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-18T17:04:18.030545] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-18T17:04:18.119554] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-11. [2025-09-18T17:04:18.583584] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-18T17:04:18.919562] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-18T17:04:19.337723] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-18T17:04:19.524438] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-18T17:04:19.719562] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-18T17:04:20.491804] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-18T17:04:20.519503] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-09-18T17:04:21.319566] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-18T17:04:21.830738] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T17:04:22.123486] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-18T17:04:22.125417] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-18T17:04:22.919572] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-18T17:04:23.598234] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-18T17:04:23.614131] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-18T17:04:23.719571] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-18T17:04:24.215956] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-18T17:04:24.519553] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-18T17:04:25.027157] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-18T17:04:25.319566] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-18T17:04:26.119552] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-18T17:04:26.848465] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-18T17:04:26.919519] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-18T17:04:27.103098] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-18T17:04:27.425438] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-18T17:04:27.426859] [INFO ] [REMOTE ] AEFC: Full fetch complete (12453 records). [2025-09-18T17:04:27.426953] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-18T17:04:27.724727] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-09-18T17:04:27.822914] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-18T17:04:27.822998] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-18T17:04:27.823207] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-18T17:04:27.823264] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-18T17:04:27.823827] [DEBUG] [LOCAL ] AEFC: Trimmed 12453 records to 8742 (keeping 200 days of data) [2025-09-18T17:04:27.883164] [DEBUG] [LOCAL ] AEFC: Primary data saved (8742 records). [2025-09-18T17:04:27.883299] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-18T17:04:27.883396] [INFO ] [MAIN ] Update Progress: 35/2372 symbols completed. AEFC took 15.6s. Estimated remaining: 4h 54m 19s. Rate: 7.9 symbols/min [2025-09-18T17:04:28.058616] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:04:28.123761] [DEBUG] [LOCAL ] AEM: Loaded 53464 existing records from primary storage. [2025-09-18T17:04:28.123930] [INFO ] [MAIN ] AEM: Loaded 53464 existing records. [2025-09-18T17:04:28.301981] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:04:28.302242] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-18T17:04:28.302290] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-18T17:04:28.303760] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-09-18T17:04:28.303822] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-18T17:04:28.525073] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-18T17:04:28.668947] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:04:29.319559] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-18T17:04:29.369577] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-18T17:04:29.929906] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-18T17:04:30.119532] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-18T17:04:30.323028] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-18T17:04:30.919545] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-11. [2025-09-18T17:04:31.719563] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-18T17:04:31.838476] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-18T17:04:32.459827] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-18T17:04:32.519562] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-18T17:04:33.091543] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-18T17:04:33.319571] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-18T17:04:33.845149] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-18T17:04:34.119620] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-18T17:04:34.919533] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-09-18T17:04:35.000131] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-18T17:04:35.064826] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-18T17:04:35.719586] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-18T17:04:36.396943] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-18T17:04:36.519522] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-09-18T17:04:37.319533] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-18T17:04:37.411483] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-18T17:04:38.044803] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-18T17:04:38.119571] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-18T17:04:38.919569] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-18T17:04:38.977428] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-18T17:04:38.984631] [INFO ] [REMOTE ] AEE: Full fetch complete (72359 records). [2025-09-18T17:04:38.984780] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-18T17:04:39.399003] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-09-18T17:04:39.399142] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-09-18T17:04:39.399928] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-09-18T17:04:39.399996] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-09-18T17:04:39.401637] [DEBUG] [LOCAL ] AEE: Trimmed 72359 records to 50683 (keeping 200 days of data) [2025-09-18T17:04:39.690696] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-18T17:04:39.720639] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-18T17:04:39.789893] [DEBUG] [LOCAL ] AEE: Primary data saved (50683 records). [2025-09-18T17:04:39.790086] [INFO ] [MAIN ] AEE: Full history saved. [2025-09-18T17:04:39.792247] [INFO ] [MAIN ] Update Progress: 36/2372 symbols completed. AEE took 39.4s. Estimated remaining: 4h 58m 54s. Rate: 7.8 symbols/min [2025-09-18T17:04:39.973982] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:04:39.986459] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-18T17:04:39.992003] [INFO ] [REMOTE ] ADX: Full fetch complete (42097 records). [2025-09-18T17:04:39.992122] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-18T17:04:40.343690] [DEBUG] [LOCAL ] AEO: Loaded 53557 existing records from primary storage. [2025-09-18T17:04:40.349634] [INFO ] [MAIN ] AEO: Loaded 53557 existing records. [2025-09-18T17:04:40.529738] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-18T17:04:40.587883] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-18T17:04:40.650446] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-18T17:04:40.650668] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:04:40.652685] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-18T17:04:40.652805] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-18T17:04:40.653211] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-18T17:04:40.653277] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-18T17:04:40.655013] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-18T17:04:40.655092] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-18T17:04:40.660463] [DEBUG] [LOCAL ] ADX: Trimmed 42097 records to 28341 (keeping 200 days of data) [2025-09-18T17:04:41.160896] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:04:41.236407] [DEBUG] [LOCAL ] ADX: Primary data saved (28341 records). [2025-09-18T17:04:41.236579] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-18T17:04:41.236705] [INFO ] [MAIN ] Update Progress: 37/2372 symbols completed. ADX took 44.5s. Estimated remaining: 4h 52m 13s. Rate: 8.0 symbols/min [2025-09-18T17:04:41.319571] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-11. [2025-09-18T17:04:41.531089] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-18T17:04:41.986534] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-18T17:04:42.119546] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-18T17:04:42.761637] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-18T17:04:42.919567] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-09-18T17:04:43.415833] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T17:04:43.719565] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-18T17:04:44.519610] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-18T17:04:44.566555] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-18T17:04:45.319592] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-09-18T17:04:45.720869] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-18T17:04:45.869009] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-18T17:04:46.119558] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-18T17:04:46.838149] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T17:04:46.919550] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-18T17:04:47.729804] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-18T17:04:47.737313] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-18T17:04:48.165300] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T17:04:48.519571] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-18T17:04:49.109684] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-18T17:04:49.319615] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-18T17:04:50.000343] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T17:04:50.119835] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-18T17:04:50.919578] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-18T17:04:51.132239] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-18T17:04:51.139089] [INFO ] [REMOTE ] AEG: Full fetch complete (69999 records). [2025-09-18T17:04:51.139212] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-18T17:04:51.528597] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-09-18T17:04:51.528711] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-09-18T17:04:51.529402] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-09-18T17:04:51.529448] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-09-18T17:04:51.530871] [DEBUG] [LOCAL ] AEG: Trimmed 69999 records to 49975 (keeping 200 days of data) [2025-09-18T17:04:51.783771] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T17:04:51.816005] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-18T17:04:51.892005] [DEBUG] [LOCAL ] AEG: Primary data saved (49975 records). [2025-09-18T17:04:51.892165] [INFO ] [MAIN ] AEG: Full history saved. [2025-09-18T17:04:51.892278] [INFO ] [MAIN ] Update Progress: 38/2372 symbols completed. AEG took 37.9s. Estimated remaining: 4h 55m 18s. Rate: 7.9 symbols/min [2025-09-18T17:04:52.702695] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-18T17:04:52.713427] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-18T17:04:53.585003] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-18T17:04:53.600716] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-18T17:04:54.350846] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-18T17:04:54.362672] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-18T17:04:55.039254] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T17:04:55.050608] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-18T17:04:56.066328] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-18T17:04:56.078382] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-18T17:04:56.768041] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-18T17:04:56.782146] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-18T17:04:58.030606] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-18T17:04:58.042303] [INFO ] [REMOTE ] AEM: Full fetch complete (76951 records). [2025-09-18T17:04:58.042494] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-18T17:04:58.469978] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-09-18T17:04:58.470106] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-09-18T17:04:58.470903] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-09-18T17:04:58.470982] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-09-18T17:04:58.472700] [DEBUG] [LOCAL ] AEM: Trimmed 76951 records to 53854 (keeping 200 days of data) [2025-09-18T17:04:58.842912] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-18T17:04:58.860903] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-18T17:04:58.881424] [DEBUG] [LOCAL ] AEM: Primary data saved (53854 records). [2025-09-18T17:04:58.881546] [INFO ] [MAIN ] AEM: Full history saved. [2025-09-18T17:04:58.882550] [INFO ] [MAIN ] Update Progress: 39/2372 symbols completed. AEM took 31.0s. Estimated remaining: 4h 54m 35s. Rate: 7.9 symbols/min [2025-09-18T17:05:01.381615] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-18T17:05:01.390306] [INFO ] [REMOTE ] AEO: Full fetch complete (77288 records). [2025-09-18T17:05:01.390509] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-18T17:05:01.841959] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-18T17:05:01.842131] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-18T17:05:01.842999] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-18T17:05:01.843072] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-18T17:05:01.844943] [DEBUG] [LOCAL ] AEO: Trimmed 77288 records to 53947 (keeping 200 days of data) [2025-09-18T17:05:02.197454] [DEBUG] [LOCAL ] AEO: Primary data saved (53947 records). [2025-09-18T17:05:02.197626] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-18T17:05:02.199071] [INFO ] [MAIN ] Update Progress: 40/2372 symbols completed. AEO took 22.4s. Estimated remaining: 4h 50m 19s. Rate: 8.0 symbols/min [2025-09-18T17:05:02.861968] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:05:02.998972] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:05:02.982149] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:05:03.001838] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:05:03.003391] [DEBUG] [LOCAL ] AESI: No existing data file found in primary storage. [2025-09-18T17:05:03.003450] [WARN ] [MAIN ] AESI: No existing data found, performing full refresh instead. [2025-09-18T17:05:03.003914] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-18T17:05:03.003980] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-18T17:05:03.004072] [DEBUG] [LOCAL ] AESI: No primary data file found to delete. [2025-09-18T17:05:03.004118] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-18T17:05:03.118919] [DEBUG] [LOCAL ] AFB: Loaded 11493 existing records from primary storage. [2025-09-18T17:05:03.138190] [INFO ] [MAIN ] AFB: Loaded 11493 existing records. [2025-09-18T17:05:03.611176] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:05:03.657980] [DEBUG] [LOCAL ] AER: Loaded 48860 existing records from primary storage. [2025-09-18T17:05:03.651873] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-18T17:05:03.668959] [INFO ] [MAIN ] AER: Loaded 48860 existing records. [2025-09-18T17:05:03.692255] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:05:03.698810] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-18T17:05:03.693582] [DEBUG] [LOCAL ] AES: Loaded 53674 existing records from primary storage. [2025-09-18T17:05:03.704823] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-11. [2025-09-18T17:05:03.723959] [INFO ] [MAIN ] AES: Loaded 53674 existing records. [2025-09-18T17:05:03.739566] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-18T17:05:03.752104] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-18T17:05:04.159423] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:05:04.277287] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-18T17:05:04.258723] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:05:04.294755] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-18T17:05:04.328105] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-18T17:05:04.336317] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-09-18T17:05:04.358015] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-18T17:05:04.341588] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-18T17:05:04.375301] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-18T17:05:04.403348] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-18T17:05:04.724697] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:05:04.793308] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-11. [2025-09-18T17:05:05.329563] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:05:05.333330] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:05:05.334137] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-11. [2025-09-18T17:05:05.334497] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-11. [2025-09-18T17:05:05.667970] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-11 (1.96 seconds). [2025-09-18T17:05:05.676908] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-09-18T17:05:05.917215] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T17:05:05.919537] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-09-18T17:05:06.472948] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-18T17:05:06.476050] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-09-18T17:05:06.642817] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-18T17:05:06.652334] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-09-18T17:05:06.873132] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-18T17:05:06.883919] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-09-18T17:05:06.940925] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-18T17:05:06.950084] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-09-18T17:05:06.972589] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-18T17:05:06.975612] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-18T17:05:07.505496] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-18T17:05:07.509595] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-18T17:05:07.968055] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-18T17:05:07.977325] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-09-18T17:05:08.062738] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-18T17:05:08.124061] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T17:05:08.519504] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-18T17:05:08.557892] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-18T17:05:09.197625] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-18T17:05:09.227293] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T17:05:09.319544] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-18T17:05:09.814686] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-18T17:05:10.119546] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-18T17:05:10.919565] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-18T17:05:11.421522] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-18T17:05:11.722262] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-18T17:05:11.725467] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-18T17:05:12.519550] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-09-18T17:05:13.319557] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-18T17:05:13.427112] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-18T17:05:13.911951] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-18T17:05:14.124754] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-18T17:05:14.140670] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-18T17:05:14.919605] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-18T17:05:15.682505] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-18T17:05:15.719534] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-18T17:05:15.805673] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-18T17:05:16.519543] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-18T17:05:16.784052] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-18T17:05:16.786059] [INFO ] [REMOTE ] AFB: Full fetch complete (16382 records). [2025-09-18T17:05:16.786138] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-18T17:05:16.786594] [FATAL] [VALIDATOR ] AFB: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:05:16.786708] [FATAL] [MAIN ] AFB: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:05:16.786756] [WARN ] [MAIN ] AFB: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:05:16.786825] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-18T17:05:16.786891] [DEBUG] [LOCAL ] AFB: No primary data file found to delete. [2025-09-18T17:05:16.786929] [INFO ] [LOCAL ] AFB: Starting deletion of derivative data. [2025-09-18T17:05:16.787620] [DEBUG] [LOCAL ] AFB: Deleted derivative data file. [2025-09-18T17:05:16.787742] [INFO ] [MAIN ] Update Progress: 41/2372 symbols completed. AFB took 14.6s. Estimated remaining: 4h 56m 56s. Rate: 7.9 symbols/min [2025-09-18T17:05:16.967209] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:05:17.010912] [DEBUG] [LOCAL ] AFG: Loaded 32758 existing records from primary storage. [2025-09-18T17:05:17.011065] [INFO ] [MAIN ] AFG: Loaded 32758 existing records. [2025-09-18T17:05:17.195328] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:05:17.195602] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-18T17:05:17.195682] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-18T17:05:17.196587] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-18T17:05:17.196697] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-18T17:05:17.324750] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-18T17:05:17.589809] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:05:18.121270] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-18T17:05:18.134762] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-18T17:05:18.715257] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T17:05:18.919543] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-18T17:05:19.722125] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-18T17:05:19.725636] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-18T17:05:20.519592] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-18T17:05:20.733853] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-18T17:05:21.132672] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-18T17:05:21.319591] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-11. [2025-09-18T17:05:22.119591] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-18T17:05:22.320935] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-18T17:05:22.381503] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-18T17:05:22.919601] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-18T17:05:23.422751] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T17:05:23.719574] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-09-18T17:05:24.519596] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-18T17:05:24.560683] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T17:05:25.013195] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-18T17:05:25.319572] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-18T17:05:25.846949] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T17:05:26.119576] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-18T17:05:26.919543] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-09-18T17:05:27.320473] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-18T17:05:27.417709] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T17:05:27.719719] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-18T17:05:27.780021] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-18T17:05:28.519530] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-18T17:05:28.980720] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-18T17:05:29.319545] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-18T17:05:29.588877] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-18T17:05:30.119606] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-18T17:05:30.919527] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-18T17:05:30.983560] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-18T17:05:31.699483] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-18T17:05:31.719502] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-18T17:05:32.519557] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-18T17:05:32.645857] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-18T17:05:33.034748] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-18T17:05:33.319550] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-18T17:05:34.042492] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-18T17:05:34.119560] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-18T17:05:34.919598] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-18T17:05:35.127129] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-18T17:05:35.472407] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-18T17:05:35.719595] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-18T17:05:36.519618] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-18T17:05:36.672813] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-18T17:05:36.680122] [INFO ] [REMOTE ] AER: Full fetch complete (69326 records). [2025-09-18T17:05:36.680300] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-18T17:05:37.099225] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-09-18T17:05:37.099349] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-09-18T17:05:37.100333] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-09-18T17:05:37.100426] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-09-18T17:05:37.102479] [DEBUG] [LOCAL ] AER: Trimmed 69326 records to 49227 (keeping 200 days of data) [2025-09-18T17:05:37.331114] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-18T17:05:37.399993] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-18T17:05:37.489748] [DEBUG] [LOCAL ] AER: Primary data saved (49227 records). [2025-09-18T17:05:37.489911] [INFO ] [MAIN ] AER: Full history saved. [2025-09-18T17:05:37.492160] [INFO ] [MAIN ] Update Progress: 42/2372 symbols completed. AER took 35.3s. Estimated remaining: 5h 8m 53s. Rate: 7.5 symbols/min [2025-09-18T17:05:37.668776] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:05:37.673613] [DEBUG] [LOCAL ] AFGB: Loaded 2510 existing records from primary storage. [2025-09-18T17:05:37.673755] [INFO ] [MAIN ] AFGB: Loaded 2510 existing records. [2025-09-18T17:05:37.857363] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:05:37.857717] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-18T17:05:37.857775] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-18T17:05:37.858061] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-09-18T17:05:37.858124] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-18T17:05:38.009206] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T17:05:38.124755] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-18T17:05:38.260505] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:05:38.658458] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T17:05:38.665053] [INFO ] [REMOTE ] AESI: Full fetch complete (69692 records). [2025-09-18T17:05:38.665208] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-18T17:05:38.666028] [FATAL] [VALIDATOR ] AESI: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:05:38.666119] [FATAL] [MAIN ] AESI: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:05:38.666163] [WARN ] [MAIN ] AESI: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:05:38.666231] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-18T17:05:38.666298] [DEBUG] [LOCAL ] AESI: No primary data file found to delete. [2025-09-18T17:05:38.666335] [INFO ] [LOCAL ] AESI: Starting deletion of derivative data. [2025-09-18T17:05:38.666374] [DEBUG] [LOCAL ] AESI: No derivative data file found to delete. [2025-09-18T17:05:38.666436] [INFO ] [MAIN ] Update Progress: 43/2372 symbols completed. AESI took 36.5s. Estimated remaining: 5h 2m 38s. Rate: 7.7 symbols/min [2025-09-18T17:05:38.859856] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:05:38.864418] [DEBUG] [LOCAL ] AFGC: Loaded 2530 existing records from primary storage. [2025-09-18T17:05:38.864516] [INFO ] [MAIN ] AFGC: Loaded 2530 existing records. [2025-09-18T17:05:38.927169] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-11. [2025-09-18T17:05:39.046804] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:05:39.047084] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-18T17:05:39.047131] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-18T17:05:39.047405] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-18T17:05:39.047465] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-18T17:05:39.421891] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:05:39.441266] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-18T17:05:39.515620] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-18T17:05:39.719521] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-18T17:05:40.519582] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-09-18T17:05:41.033513] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-18T17:05:41.307701] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-18T17:05:41.315969] [INFO ] [REMOTE ] AES: Full fetch complete (77586 records). [2025-09-18T17:05:41.316179] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-18T17:05:41.324845] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-09-18T17:05:41.863867] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-18T17:05:41.863994] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-18T17:05:41.865072] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-18T17:05:41.865180] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-18T17:05:41.868165] [DEBUG] [LOCAL ] AES: Trimmed 77586 records to 54064 (keeping 200 days of data) [2025-09-18T17:05:42.005588] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-18T17:05:42.154263] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-18T17:05:42.386524] [DEBUG] [LOCAL ] AES: Primary data saved (54064 records). [2025-09-18T17:05:42.386780] [INFO ] [MAIN ] AES: Full history saved. [2025-09-18T17:05:42.386927] [INFO ] [MAIN ] Update Progress: 44/2372 symbols completed. AES took 40.2s. Estimated remaining: 4h 58m 54s. Rate: 7.8 symbols/min [2025-09-18T17:05:42.556752] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-18T17:05:42.651270] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:05:42.656986] [DEBUG] [LOCAL ] AFGD: Loaded 1882 existing records from primary storage. [2025-09-18T17:05:42.657149] [INFO ] [MAIN ] AFGD: Loaded 1882 existing records. [2025-09-18T17:05:42.904943] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:05:42.905218] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-18T17:05:42.905271] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-18T17:05:42.905468] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-18T17:05:42.905529] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-18T17:05:42.927216] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-11. [2025-09-18T17:05:43.311506] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:05:43.631944] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-18T17:05:43.719590] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-11. [2025-09-18T17:05:44.160745] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-18T17:05:44.519543] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-09-18T17:05:44.862184] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-18T17:05:45.319596] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-09-18T17:05:45.662466] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-18T17:05:46.119569] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-18T17:05:46.672982] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-18T17:05:46.919572] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-18T17:05:47.269873] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-18T17:05:47.719546] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-09-18T17:05:48.048383] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-18T17:05:48.519555] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-18T17:05:48.990974] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-18T17:05:49.319545] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-18T17:05:50.119561] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-18T17:05:50.919530] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-18T17:05:50.951839] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-18T17:05:50.974921] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-18T17:05:51.389064] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-18T17:05:51.719548] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-18T17:05:52.519557] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-18T17:05:52.816343] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-18T17:05:53.126824] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-18T17:05:53.319567] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-09-18T17:05:53.876887] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-18T17:05:54.119556] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-18T17:05:54.435092] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-18T17:05:54.919565] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-18T17:05:55.504284] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-18T17:05:55.719542] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-18T17:05:56.163377] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-18T17:05:56.519536] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-18T17:05:57.048629] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-18T17:05:57.049865] [INFO ] [REMOTE ] AFGB: Full fetch complete (3643 records). [2025-09-18T17:05:57.049940] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-18T17:05:57.324726] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-18T17:05:57.449094] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-09-18T17:05:57.449185] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-09-18T17:05:57.449320] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-09-18T17:05:57.449363] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-09-18T17:05:57.449820] [DEBUG] [LOCAL ] AFGB: Trimmed 3643 records to 2536 (keeping 200 days of data) [2025-09-18T17:05:57.466160] [DEBUG] [LOCAL ] AFGB: Primary data saved (2536 records). [2025-09-18T17:05:57.466286] [INFO ] [MAIN ] AFGB: Full history saved. [2025-09-18T17:05:57.466372] [INFO ] [MAIN ] Update Progress: 45/2372 symbols completed. AFGB took 20.0s. Estimated remaining: 5h 5m 8s. Rate: 7.6 symbols/min [2025-09-18T17:05:57.662077] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:05:57.667235] [DEBUG] [LOCAL ] AFGE: Loaded 2507 existing records from primary storage. [2025-09-18T17:05:57.667359] [INFO ] [MAIN ] AFGE: Loaded 2507 existing records. [2025-09-18T17:05:57.782485] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-18T17:05:57.865688] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:05:57.865990] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-18T17:05:57.866048] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-18T17:05:57.866298] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-09-18T17:05:57.866372] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-18T17:05:58.124761] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-18T17:05:58.255362] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:05:58.693349] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-18T17:05:58.919577] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-18T17:05:59.212718] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-18T17:05:59.719562] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-11. [2025-09-18T17:06:00.318307] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-18T17:06:00.519531] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-18T17:06:00.975728] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-18T17:06:01.319564] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-18T17:06:02.119580] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-18T17:06:02.831100] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T17:06:02.836086] [INFO ] [REMOTE ] AFG: Full fetch complete (45537 records). [2025-09-18T17:06:02.836213] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-18T17:06:02.928933] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-09-18T17:06:03.218751] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-18T17:06:03.218862] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-18T17:06:03.219353] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-18T17:06:03.219823] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-18T17:06:03.220865] [DEBUG] [LOCAL ] AFG: Trimmed 45537 records to 32981 (keeping 200 days of data) [2025-09-18T17:06:03.416038] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T17:06:03.443255] [DEBUG] [LOCAL ] AFG: Primary data saved (32981 records). [2025-09-18T17:06:03.443447] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-18T17:06:03.444575] [INFO ] [MAIN ] Update Progress: 46/2372 symbols completed. AFG took 46.7s. Estimated remaining: 5h 3m 25s. Rate: 7.7 symbols/min [2025-09-18T17:06:03.622703] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:06:03.681758] [DEBUG] [LOCAL ] AFL: Loaded 53148 existing records from primary storage. [2025-09-18T17:06:03.681935] [INFO ] [MAIN ] AFL: Loaded 53148 existing records. [2025-09-18T17:06:03.724777] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-18T17:06:03.862226] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:06:03.862468] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-18T17:06:03.862517] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-18T17:06:03.863907] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-09-18T17:06:03.863969] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-18T17:06:04.243545] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:06:04.519541] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-18T17:06:04.723439] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-18T17:06:04.827903] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-18T17:06:04.852102] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-18T17:06:05.319585] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-18T17:06:05.751889] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-18T17:06:06.119553] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-18T17:06:06.629086] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-18T17:06:06.919562] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-09-18T17:06:07.381156] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-18T17:06:07.719582] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-18T17:06:08.308832] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-18T17:06:08.309940] [INFO ] [REMOTE ] AFGD: Full fetch complete (3232 records). [2025-09-18T17:06:08.310015] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-18T17:06:08.524785] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-18T17:06:08.693261] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-09-18T17:06:08.693345] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-09-18T17:06:08.693472] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-09-18T17:06:08.693516] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-09-18T17:06:08.693913] [DEBUG] [LOCAL ] AFGD: Trimmed 3232 records to 1906 (keeping 200 days of data) [2025-09-18T17:06:08.706976] [DEBUG] [LOCAL ] AFGD: Primary data saved (1906 records). [2025-09-18T17:06:08.707046] [INFO ] [MAIN ] AFGD: Full history saved. [2025-09-18T17:06:08.707120] [INFO ] [MAIN ] Update Progress: 47/2372 symbols completed. AFGD took 26.3s. Estimated remaining: 5h 1m 10s. Rate: 7.7 symbols/min [2025-09-18T17:06:08.902344] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:06:08.965252] [DEBUG] [LOCAL ] AG: Loaded 53641 existing records from primary storage. [2025-09-18T17:06:08.965445] [INFO ] [MAIN ] AG: Loaded 53641 existing records. [2025-09-18T17:06:09.084940] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-18T17:06:09.177744] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:06:09.178082] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-18T17:06:09.178142] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-18T17:06:09.179359] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-09-18T17:06:09.179424] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-18T17:06:09.324761] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-18T17:06:09.587517] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:06:09.833072] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-18T17:06:10.119612] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-11. [2025-09-18T17:06:10.919562] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-11. [2025-09-18T17:06:11.719611] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-18T17:06:11.903537] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-18T17:06:12.193516] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-18T17:06:12.519559] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-18T17:06:12.756601] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-18T17:06:12.855347] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-18T17:06:13.319534] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-09-18T17:06:14.119572] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-09-18T17:06:14.881968] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-18T17:06:14.919496] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-18T17:06:15.436055] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-18T17:06:15.719606] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-09-18T17:06:15.929374] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-18T17:06:16.519556] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-09-18T17:06:17.319588] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-18T17:06:17.882417] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-18T17:06:18.081002] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-18T17:06:18.119551] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-18T17:06:18.465850] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-18T17:06:18.919618] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-18T17:06:19.163939] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-09-18T17:06:19.413013] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-18T17:06:19.719600] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-18T17:06:20.240787] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-18T17:06:20.241751] [INFO ] [REMOTE ] AFGE: Full fetch complete (3489 records). [2025-09-18T17:06:20.241826] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-18T17:06:20.524791] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-18T17:06:20.649730] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-09-18T17:06:20.649817] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-09-18T17:06:20.649956] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-09-18T17:06:20.650018] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-09-18T17:06:20.650447] [DEBUG] [LOCAL ] AFGE: Trimmed 3489 records to 2533 (keeping 200 days of data) [2025-09-18T17:06:20.666621] [DEBUG] [LOCAL ] AFGE: Primary data saved (2533 records). [2025-09-18T17:06:20.666775] [INFO ] [MAIN ] AFGE: Full history saved. [2025-09-18T17:06:20.666865] [INFO ] [MAIN ] Update Progress: 48/2372 symbols completed. AFGE took 23.2s. Estimated remaining: 5h 4m 25s. Rate: 7.6 symbols/min [2025-09-18T17:06:20.843015] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:06:20.898052] [DEBUG] [LOCAL ] AGCO: Loaded 42813 existing records from primary storage. [2025-09-18T17:06:20.898205] [INFO ] [MAIN ] AGCO: Loaded 42813 existing records. [2025-09-18T17:06:21.014290] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-18T17:06:21.092133] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:06:21.092389] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-18T17:06:21.092464] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-18T17:06:21.093804] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-18T17:06:21.093871] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-18T17:06:21.328805] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-18T17:06:21.470007] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:06:22.119595] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-18T17:06:22.919557] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-18T17:06:23.110425] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-18T17:06:23.327143] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-18T17:06:23.328217] [INFO ] [REMOTE ] AFGC: Full fetch complete (3703 records). [2025-09-18T17:06:23.328289] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-18T17:06:23.708929] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-09-18T17:06:23.709024] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-09-18T17:06:23.709163] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-09-18T17:06:23.709216] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-09-18T17:06:23.709680] [DEBUG] [LOCAL ] AFGC: Trimmed 3703 records to 2566 (keeping 200 days of data) [2025-09-18T17:06:23.722063] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-18T17:06:23.728005] [DEBUG] [LOCAL ] AFGC: Primary data saved (2566 records). [2025-09-18T17:06:23.728101] [INFO ] [MAIN ] AFGC: Full history saved. [2025-09-18T17:06:23.728202] [INFO ] [MAIN ] Update Progress: 49/2372 symbols completed. AFGC took 45.1s. Estimated remaining: 5h 0m 30s. Rate: 7.7 symbols/min [2025-09-18T17:06:23.922889] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:06:23.971347] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-18T17:06:23.989313] [DEBUG] [LOCAL ] AGD: Loaded 17614 existing records from primary storage. [2025-09-18T17:06:23.989456] [INFO ] [MAIN ] AGD: Loaded 17614 existing records. [2025-09-18T17:06:24.170483] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:06:24.170822] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-18T17:06:24.170880] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-18T17:06:24.171431] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-18T17:06:24.171493] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-18T17:06:24.524668] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-11. [2025-09-18T17:06:24.567719] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:06:25.167094] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-18T17:06:25.319562] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-11. [2025-09-18T17:06:25.900364] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-18T17:06:26.119586] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-09-18T17:06:26.234730] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-18T17:06:26.919552] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-18T17:06:27.389303] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-18T17:06:27.719591] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-18T17:06:28.318973] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T17:06:28.519542] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-18T17:06:29.319518] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-09-18T17:06:29.371719] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-18T17:06:30.057820] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-18T17:06:30.119573] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-18T17:06:30.582116] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-18T17:06:30.919585] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-09-18T17:06:31.722388] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-18T17:06:31.727820] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-18T17:06:31.780464] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-18T17:06:32.519535] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-09-18T17:06:33.319536] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-18T17:06:33.651347] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-18T17:06:33.838715] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-18T17:06:34.119555] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-18T17:06:34.593365] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-18T17:06:34.919587] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-18T17:06:35.719613] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-18T17:06:35.904805] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-18T17:06:36.519542] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-18T17:06:36.667323] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-18T17:06:36.901863] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-18T17:06:37.319562] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-18T17:06:37.827202] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-18T17:06:37.941348] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-18T17:06:38.119550] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-18T17:06:38.919548] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-18T17:06:39.719579] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-18T17:06:39.789536] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-18T17:06:40.328228] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-18T17:06:40.519535] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-18T17:06:41.319590] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-18T17:06:41.697737] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-18T17:06:42.125621] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-18T17:06:42.130226] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-18T17:06:42.138578] [INFO ] [REMOTE ] AFL: Full fetch complete (76766 records). [2025-09-18T17:06:42.138770] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-18T17:06:42.333406] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-18T17:06:42.564916] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-09-18T17:06:42.565037] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-09-18T17:06:42.566213] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-09-18T17:06:42.566297] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-09-18T17:06:42.567920] [DEBUG] [LOCAL ] AFL: Trimmed 76766 records to 53537 (keeping 200 days of data) [2025-09-18T17:06:42.906593] [DEBUG] [LOCAL ] AFL: Primary data saved (53537 records). [2025-09-18T17:06:42.906767] [INFO ] [MAIN ] AFL: Full history saved. [2025-09-18T17:06:42.906891] [INFO ] [MAIN ] Update Progress: 50/2372 symbols completed. AFL took 39.5s. Estimated remaining: 5h 9m 12s. Rate: 7.5 symbols/min [2025-09-18T17:06:42.928078] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-18T17:06:43.127312] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:06:43.186588] [DEBUG] [LOCAL ] AGI: Loaded 53412 existing records from primary storage. [2025-09-18T17:06:43.186778] [INFO ] [MAIN ] AGI: Loaded 53412 existing records. [2025-09-18T17:06:43.369263] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:06:43.369558] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-18T17:06:43.369608] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-18T17:06:43.371030] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-18T17:06:43.371095] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-18T17:06:43.730185] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:06:43.724314] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-18T17:06:43.744639] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-18T17:06:44.519521] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-18T17:06:44.559817] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-18T17:06:45.302683] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T17:06:45.319511] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-18T17:06:45.349199] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-18T17:06:46.119543] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-18T17:06:46.919520] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-18T17:06:47.045362] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-18T17:06:47.719542] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-18T17:06:47.913824] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-18T17:06:47.938639] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-18T17:06:48.519549] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-18T17:06:48.883328] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-18T17:06:49.319567] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-18T17:06:50.119556] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-11. [2025-09-18T17:06:50.373557] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-18T17:06:50.384584] [INFO ] [REMOTE ] AG: Full fetch complete (77442 records). [2025-09-18T17:06:50.384825] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-18T17:06:50.808199] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-09-18T17:06:50.808306] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-09-18T17:06:50.809059] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-09-18T17:06:50.809138] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-09-18T17:06:50.813430] [DEBUG] [LOCAL ] AG: Trimmed 77442 records to 54031 (keeping 200 days of data) [2025-09-18T17:06:50.928944] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-18T17:06:50.935272] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-18T17:06:51.182773] [DEBUG] [LOCAL ] AG: Primary data saved (54031 records). [2025-09-18T17:06:51.182930] [INFO ] [MAIN ] AG: Full history saved. [2025-09-18T17:06:51.183039] [INFO ] [MAIN ] Update Progress: 51/2372 symbols completed. AG took 42.5s. Estimated remaining: 5h 9m 17s. Rate: 7.5 symbols/min [2025-09-18T17:06:51.378872] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:06:51.436972] [DEBUG] [LOCAL ] AGL: Loaded 52408 existing records from primary storage. [2025-09-18T17:06:51.437192] [INFO ] [MAIN ] AGL: Loaded 52408 existing records. [2025-09-18T17:06:51.627325] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:06:51.627789] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-18T17:06:51.627899] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-18T17:06:51.629243] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-18T17:06:51.629332] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-18T17:06:51.720361] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-18T17:06:51.839028] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-18T17:06:51.913393] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-18T17:06:52.085832] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:06:52.519530] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-09-18T17:06:52.948597] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-18T17:06:52.954631] [INFO ] [REMOTE ] AGCO: Full fetch complete (62054 records). [2025-09-18T17:06:52.954812] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-18T17:06:53.324608] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-18T17:06:53.345745] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-18T17:06:53.345810] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-18T17:06:53.347556] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-18T17:06:53.347733] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-18T17:06:53.349062] [DEBUG] [LOCAL ] AGCO: Trimmed 62054 records to 43138 (keeping 200 days of data) [2025-09-18T17:06:53.634960] [DEBUG] [LOCAL ] AGCO: Primary data saved (43138 records). [2025-09-18T17:06:53.635106] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-18T17:06:53.635228] [INFO ] [MAIN ] Update Progress: 52/2372 symbols completed. AGCO took 33.0s. Estimated remaining: 5h 5m 2s. Rate: 7.6 symbols/min [2025-09-18T17:06:53.810852] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:06:53.824631] [DEBUG] [LOCAL ] AGM: Loaded 9839 existing records from primary storage. [2025-09-18T17:06:53.824776] [INFO ] [MAIN ] AGM: Loaded 9839 existing records. [2025-09-18T17:06:54.040210] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:06:54.040670] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-18T17:06:54.040765] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-18T17:06:54.041197] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-18T17:06:54.041258] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-18T17:06:54.124669] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-11. [2025-09-18T17:06:54.411925] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-18T17:06:54.443404] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:06:54.460341] [INFO ] [REMOTE ] AGD: Full fetch complete (25088 records). [2025-09-18T17:06:54.468505] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-18T17:06:54.472638] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-18T17:06:54.861986] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-18T17:06:54.862130] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-18T17:06:54.862505] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-18T17:06:54.862584] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-18T17:06:54.863789] [DEBUG] [LOCAL ] AGD: Trimmed 25088 records to 17701 (keeping 200 days of data) [2025-09-18T17:06:54.922638] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-11. [2025-09-18T17:06:54.996858] [DEBUG] [LOCAL ] AGD: Primary data saved (17701 records). [2025-09-18T17:06:54.997026] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-18T17:06:54.997196] [INFO ] [MAIN ] Update Progress: 53/2372 symbols completed. AGD took 31.3s. Estimated remaining: 5h 0m 8s. Rate: 7.7 symbols/min [2025-09-18T17:06:55.180834] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:06:55.223770] [DEBUG] [LOCAL ] AGO: Loaded 28188 existing records from primary storage. [2025-09-18T17:06:55.223913] [INFO ] [MAIN ] AGO: Loaded 28188 existing records. [2025-09-18T17:06:55.401816] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:06:55.402056] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-18T17:06:55.402105] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-18T17:06:55.402821] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-18T17:06:55.402902] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-18T17:06:55.728159] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-09-18T17:06:55.774945] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:06:55.806543] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-18T17:06:55.849156] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-18T17:06:56.519553] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-11. [2025-09-18T17:06:57.220169] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T17:06:57.319604] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-18T17:06:57.532387] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T17:06:58.119618] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-09-18T17:06:58.657800] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-18T17:06:58.919566] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-18T17:06:59.418298] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-18T17:06:59.719567] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-09-18T17:07:00.351943] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-18T17:07:00.519566] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-18T17:07:00.669985] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-18T17:07:01.319590] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-09-18T17:07:02.119629] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-09-18T17:07:02.254565] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-18T17:07:02.575315] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-18T17:07:02.682722] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-18T17:07:02.919681] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-09-18T17:07:03.595944] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-18T17:07:03.719688] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-18T17:07:04.519546] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-09-18T17:07:05.254939] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-18T17:07:05.319565] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-18T17:07:06.119606] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-18T17:07:06.491125] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-18T17:07:06.805510] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-18T17:07:06.919583] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-18T17:07:07.000539] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-18T17:07:07.719589] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-18T17:07:08.427944] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-18T17:07:08.519575] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-18T17:07:08.897947] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-18T17:07:09.319569] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-18T17:07:09.859055] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-18T17:07:10.119561] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-18T17:07:10.444571] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-18T17:07:10.919562] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-18T17:07:11.232439] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-18T17:07:11.719600] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-18T17:07:12.519712] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-18T17:07:12.587770] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T17:07:12.638567] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-18T17:07:13.319611] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-18T17:07:14.119557] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-18T17:07:14.280814] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-18T17:07:14.289163] [INFO ] [REMOTE ] AGI: Full fetch complete (76517 records). [2025-09-18T17:07:14.289373] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-18T17:07:14.709527] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-18T17:07:14.709816] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-18T17:07:14.710692] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-18T17:07:14.710834] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-18T17:07:14.731534] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-18T17:07:14.738929] [DEBUG] [LOCAL ] AGI: Trimmed 76517 records to 53802 (keeping 200 days of data) [2025-09-18T17:07:14.930450] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-18T17:07:15.093554] [DEBUG] [LOCAL ] AGI: Primary data saved (53802 records). [2025-09-18T17:07:15.093928] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-18T17:07:15.094067] [INFO ] [MAIN ] Update Progress: 54/2372 symbols completed. AGI took 32.2s. Estimated remaining: 5h 8m 50s. Rate: 7.5 symbols/min [2025-09-18T17:07:15.261747] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:07:15.295792] [DEBUG] [LOCAL ] AGRO: Loaded 34065 existing records from primary storage. [2025-09-18T17:07:15.295943] [INFO ] [MAIN ] AGRO: Loaded 34065 existing records. [2025-09-18T17:07:15.476711] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:07:15.477301] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-18T17:07:15.477413] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-18T17:07:15.478944] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-18T17:07:15.479035] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-18T17:07:15.619889] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-18T17:07:15.725237] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-18T17:07:15.898255] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:07:16.243876] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-18T17:07:16.302903] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-18T17:07:16.519555] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-11. [2025-09-18T17:07:17.319582] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-18T17:07:17.670200] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-18T17:07:18.119586] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-18T17:07:18.641833] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-18T17:07:18.816881] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-18T17:07:18.919584] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-18T17:07:19.719583] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-09-18T17:07:20.519579] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-18T17:07:20.713537] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-18T17:07:20.773040] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-18T17:07:21.319568] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-18T17:07:21.441815] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T17:07:22.119544] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-18T17:07:22.724221] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-18T17:07:22.919571] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-09-18T17:07:23.525497] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-18T17:07:23.719570] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-18T17:07:24.256216] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-18T17:07:24.519558] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-18T17:07:24.628718] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-18T17:07:25.319605] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-18T17:07:25.411400] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-18T17:07:25.967499] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-18T17:07:26.119595] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-18T17:07:26.919578] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-18T17:07:27.719618] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-18T17:07:27.924957] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-18T17:07:28.018522] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-18T17:07:28.289983] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-18T17:07:28.519583] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-18T17:07:29.319559] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-18T17:07:29.755433] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-18T17:07:30.119568] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-18T17:07:30.566586] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-18T17:07:30.570455] [INFO ] [REMOTE ] AGO: Full fetch complete (39153 records). [2025-09-18T17:07:30.570537] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-18T17:07:30.920854] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-18T17:07:30.959708] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-18T17:07:30.959794] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-18T17:07:30.960230] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-18T17:07:30.960272] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-18T17:07:30.961207] [DEBUG] [LOCAL ] AGO: Trimmed 39153 records to 28350 (keeping 200 days of data) [2025-09-18T17:07:31.133976] [DEBUG] [LOCAL ] AGO: Primary data saved (28350 records). [2025-09-18T17:07:31.134365] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-18T17:07:31.135669] [INFO ] [MAIN ] Update Progress: 55/2372 symbols completed. AGO took 36.1s. Estimated remaining: 5h 14m 21s. Rate: 7.4 symbols/min [2025-09-18T17:07:31.319994] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:07:31.360663] [DEBUG] [LOCAL ] AGX: Loaded 33538 existing records from primary storage. [2025-09-18T17:07:31.360858] [INFO ] [MAIN ] AGX: Loaded 33538 existing records. [2025-09-18T17:07:31.545124] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:07:31.545375] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-18T17:07:31.545423] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-18T17:07:31.546372] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-18T17:07:31.546434] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-18T17:07:31.698011] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-18T17:07:31.721874] [INFO ] [REMOTE ] AGM: Full fetch complete (12341 records). [2025-09-18T17:07:31.722016] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-18T17:07:31.721757] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-18T17:07:31.748598] [FATAL] [VALIDATOR ] AGM: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:07:31.780491] [FATAL] [MAIN ] AGM: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:07:31.793731] [WARN ] [MAIN ] AGM: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:07:31.852154] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-18T17:07:31.852530] [DEBUG] [LOCAL ] AGM: No primary data file found to delete. [2025-09-18T17:07:31.856377] [INFO ] [LOCAL ] AGM: Starting deletion of derivative data. [2025-09-18T17:07:31.883439] [DEBUG] [LOCAL ] AGM: Deleted derivative data file. [2025-09-18T17:07:31.896539] [INFO ] [MAIN ] Update Progress: 56/2372 symbols completed. AGM took 38.3s. Estimated remaining: 5h 9m 8s. Rate: 7.5 symbols/min [2025-09-18T17:07:31.962145] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:07:32.146110] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-18T17:07:32.149303] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:07:32.209041] [DEBUG] [LOCAL ] AHH: Loaded 41658 existing records from primary storage. [2025-09-18T17:07:32.209216] [INFO ] [MAIN ] AHH: Loaded 41658 existing records. [2025-09-18T17:07:32.388828] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:07:32.389096] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-18T17:07:32.389143] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-18T17:07:32.390212] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-18T17:07:32.390273] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-18T17:07:32.530719] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-18T17:07:32.769577] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:07:32.887630] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-18T17:07:33.319554] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-11. [2025-09-18T17:07:34.119638] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-18T17:07:34.440586] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-18T17:07:34.448242] [INFO ] [REMOTE ] AGL: Full fetch complete (75244 records). [2025-09-18T17:07:34.448431] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-18T17:07:34.878123] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-18T17:07:34.878333] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-18T17:07:34.879683] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-18T17:07:34.882381] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-18T17:07:34.882498] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-18T17:07:34.899420] [DEBUG] [LOCAL ] AGL: Trimmed 75244 records to 52793 (keeping 200 days of data) [2025-09-18T17:07:34.910547] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-18T17:07:34.960993] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-09-18T17:07:35.217694] [DEBUG] [LOCAL ] AGL: Primary data saved (52793 records). [2025-09-18T17:07:35.217886] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-18T17:07:35.218032] [INFO ] [MAIN ] Update Progress: 57/2372 symbols completed. AGL took 44.0s. Estimated remaining: 5h 5m 49s. Rate: 7.6 symbols/min [2025-09-18T17:07:35.432963] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:07:35.433182] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-18T17:07:35.433239] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-18T17:07:35.433387] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-18T17:07:35.433431] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-18T17:07:35.433493] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-18T17:07:35.433558] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-18T17:07:35.724737] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-11. [2025-09-18T17:07:35.806934] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:07:36.223899] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-18T17:07:36.519586] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-09-18T17:07:37.319590] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-18T17:07:37.363295] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-18T17:07:37.614509] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-18T17:07:38.119568] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-09-18T17:07:38.392843] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-18T17:07:38.919551] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-18T17:07:39.164326] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-18T17:07:39.719551] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-11. [2025-09-18T17:07:39.786673] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-18T17:07:39.941432] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:07:39.941849] [WARN ] [REMOTE ] AHL: No data returned for month 2024-11 [2025-09-18T17:07:40.519538] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-18T17:07:41.319565] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-18T17:07:41.536017] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:07:41.536327] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-18T17:07:41.928613] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-18T17:07:41.933009] [INFO ] [REMOTE ] AGRO: Full fetch complete (49924 records). [2025-09-18T17:07:41.933120] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-18T17:07:42.125483] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-09-18T17:07:42.322064] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-18T17:07:42.322146] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-18T17:07:42.322673] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-18T17:07:42.322736] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-18T17:07:42.323819] [DEBUG] [LOCAL ] AGRO: Trimmed 49924 records to 34245 (keeping 200 days of data) [2025-09-18T17:07:42.431867] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:07:42.432941] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-09-18T17:07:42.532708] [DEBUG] [LOCAL ] AGRO: Primary data saved (34245 records). [2025-09-18T17:07:42.532896] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-18T17:07:42.533008] [INFO ] [MAIN ] Update Progress: 58/2372 symbols completed. AGRO took 27.4s. Estimated remaining: 5h 5m 17s. Rate: 7.6 symbols/min [2025-09-18T17:07:42.707867] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:07:42.755076] [DEBUG] [LOCAL ] AHR: Loaded 49378 existing records from primary storage. [2025-09-18T17:07:42.755224] [INFO ] [MAIN ] AHR: Loaded 49378 existing records. [2025-09-18T17:07:42.930364] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-02. [2025-09-18T17:07:42.936048] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:07:42.936399] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-18T17:07:42.936469] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-18T17:07:42.937742] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-18T17:07:42.937807] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-18T17:07:43.301911] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:07:43.419489] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:07:43.419799] [WARN ] [REMOTE ] AHL: No data returned for month 2025-02 [2025-09-18T17:07:43.719525] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-09-18T17:07:44.519548] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-03. [2025-09-18T17:07:44.746864] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:07:44.747170] [WARN ] [REMOTE ] AHL: No data returned for month 2025-03 [2025-09-18T17:07:45.025209] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-18T17:07:45.319541] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-11. [2025-09-18T17:07:46.119580] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-18T17:07:46.664356] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-18T17:07:46.919577] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-18T17:07:47.665979] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-18T17:07:47.719514] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-18T17:07:48.163892] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-18T17:07:48.519546] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-18T17:07:49.175433] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T17:07:49.319623] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-18T17:07:49.761283] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T17:07:50.119590] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-18T17:07:50.485963] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-18T17:07:50.919569] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-04. [2025-09-18T17:07:51.113731] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:07:51.114093] [WARN ] [REMOTE ] AHL: No data returned for month 2025-04 [2025-09-18T17:07:51.724662] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-18T17:07:51.741403] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-18T17:07:52.519554] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-05. [2025-09-18T17:07:53.189977] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-18T17:07:53.319579] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-18T17:07:54.093027] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T17:07:54.119496] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-06. [2025-09-18T17:07:54.705760] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-18T17:07:54.853014] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-18T17:07:54.919521] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-07. [2025-09-18T17:07:55.560463] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-18T17:07:55.719596] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-18T17:07:56.519567] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-08. [2025-09-18T17:07:56.914679] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-18T17:07:57.319509] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-09-18T17:07:57.339417] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-18T17:07:58.119569] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-18T17:07:58.726567] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-18T17:07:58.919548] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-09. [2025-09-18T17:07:59.212338] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-18T17:07:59.719576] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-18T17:08:00.405960] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T17:08:00.411130] [INFO ] [REMOTE ] AHL: Full fetch complete (16502 records). [2025-09-18T17:08:00.411208] [DEBUG] [VALIDATOR ] AHL: Validating primary data. [2025-09-18T17:08:00.524612] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-09-18T17:08:00.596789] [WARN ] [VALIDATOR ] AHL: Validation failed - insufficient historical data. Have 92 unique days, need 200 days [2025-09-18T17:08:00.597080] [FATAL] [MAIN ] AHL: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:08:00.597151] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:08:00.597222] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-18T17:08:00.597287] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-18T17:08:00.597324] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-18T17:08:00.597408] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-18T17:08:00.597496] [INFO ] [MAIN ] Update Progress: 59/2372 symbols completed. AHL took 25.4s. Estimated remaining: 5h 11m 47s. Rate: 7.4 symbols/min [2025-09-18T17:08:00.772409] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:08:00.782105] [DEBUG] [LOCAL ] AHT: Loaded 5934 existing records from primary storage. [2025-09-18T17:08:00.782242] [INFO ] [MAIN ] AHT: Loaded 5934 existing records. [2025-09-18T17:08:00.964465] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:08:00.964800] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-18T17:08:00.964882] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-18T17:08:00.965232] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-18T17:08:00.965294] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-18T17:08:01.321579] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-18T17:08:01.345195] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:08:01.373150] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-18T17:08:01.827968] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-18T17:08:02.119566] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-18T17:08:02.539255] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-18T17:08:02.544300] [INFO ] [REMOTE ] AGX: Full fetch complete (48901 records). [2025-09-18T17:08:02.544428] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-18T17:08:02.926094] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-18T17:08:02.928992] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-18T17:08:02.929318] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-18T17:08:02.930683] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-18T17:08:02.930751] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-18T17:08:02.931979] [DEBUG] [LOCAL ] AGX: Trimmed 48901 records to 33860 (keeping 200 days of data) [2025-09-18T17:08:03.145783] [DEBUG] [LOCAL ] AGX: Primary data saved (33860 records). [2025-09-18T17:08:03.145929] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-18T17:08:03.146510] [INFO ] [MAIN ] Update Progress: 60/2372 symbols completed. AGX took 32.0s. Estimated remaining: 5h 8m 5s. Rate: 7.5 symbols/min [2025-09-18T17:08:03.319187] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:08:03.346223] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-18T17:08:03.412105] [DEBUG] [LOCAL ] AI: Loaded 53749 existing records from primary storage. [2025-09-18T17:08:03.412254] [INFO ] [MAIN ] AI: Loaded 53749 existing records. [2025-09-18T17:08:03.594209] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:08:03.594492] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-18T17:08:03.594541] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-18T17:08:03.596039] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-18T17:08:03.596119] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-18T17:08:03.734473] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-11. [2025-09-18T17:08:03.951544] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:08:04.229698] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-18T17:08:04.433825] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-18T17:08:04.519547] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-18T17:08:05.319548] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-11. [2025-09-18T17:08:06.066009] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-18T17:08:06.119503] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-18T17:08:06.919571] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-09-18T17:08:07.175531] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-18T17:08:07.517263] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-18T17:08:07.692961] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-11 (2.37 seconds). [2025-09-18T17:08:07.719497] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-09-18T17:08:08.519559] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-09-18T17:08:09.319566] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-18T17:08:09.413411] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-18T17:08:10.119586] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-18T17:08:10.360750] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-09-18T17:08:10.389781] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-18T17:08:10.395424] [INFO ] [REMOTE ] AHH: Full fetch complete (60370 records). [2025-09-18T17:08:10.395621] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-18T17:08:10.702618] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-18T17:08:10.824461] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-18T17:08:10.824556] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-18T17:08:10.825187] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-18T17:08:10.825257] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-18T17:08:10.826614] [DEBUG] [LOCAL ] AHH: Trimmed 60370 records to 41921 (keeping 200 days of data) [2025-09-18T17:08:10.919613] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-18T17:08:11.075798] [DEBUG] [LOCAL ] AHH: Primary data saved (41921 records). [2025-09-18T17:08:11.075979] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-18T17:08:11.076122] [INFO ] [MAIN ] Update Progress: 61/2372 symbols completed. AHH took 39.2s. Estimated remaining: 5h 7m 55s. Rate: 7.5 symbols/min [2025-09-18T17:08:11.260255] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:08:11.313575] [DEBUG] [LOCAL ] AIG: Loaded 53477 existing records from primary storage. [2025-09-18T17:08:11.313782] [INFO ] [MAIN ] AIG: Loaded 53477 existing records. [2025-09-18T17:08:11.427753] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-18T17:08:11.512963] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:08:11.513257] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-18T17:08:11.513324] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-18T17:08:11.514779] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-18T17:08:11.514842] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-18T17:08:11.727460] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-18T17:08:11.914548] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:08:12.519559] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-11. [2025-09-18T17:08:13.200027] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-18T17:08:13.319536] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-18T17:08:13.950010] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T17:08:14.119567] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-18T17:08:14.603029] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-18T17:08:14.625757] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-18T17:08:14.919570] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-09-18T17:08:15.719560] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-18T17:08:16.114156] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-18T17:08:16.519593] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-18T17:08:17.160446] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-18T17:08:17.319541] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-09-18T17:08:18.104196] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T17:08:18.119501] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-18T17:08:18.599346] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-18T17:08:18.691929] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-18T17:08:18.919564] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-09-18T17:08:19.719615] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-18T17:08:20.455418] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-18T17:08:20.519502] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-18T17:08:21.304435] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-18T17:08:21.319494] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-18T17:08:21.369534] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-18T17:08:22.119583] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-18T17:08:22.777865] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-18T17:08:22.779514] [INFO ] [REMOTE ] AHT: Full fetch complete (9534 records). [2025-09-18T17:08:22.779587] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-18T17:08:22.927401] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-18T17:08:23.167134] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-18T17:08:23.167269] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-18T17:08:23.167520] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-18T17:08:23.167564] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-18T17:08:23.168121] [DEBUG] [LOCAL ] AHT: Trimmed 9534 records to 5997 (keeping 200 days of data) [2025-09-18T17:08:23.204858] [DEBUG] [LOCAL ] AHT: Primary data saved (5997 records). [2025-09-18T17:08:23.205000] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-18T17:08:23.205086] [INFO ] [MAIN ] Update Progress: 62/2372 symbols completed. AHT took 22.6s. Estimated remaining: 5h 10m 21s. Rate: 7.4 symbols/min [2025-09-18T17:08:23.386409] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:08:23.386659] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-18T17:08:23.386722] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-18T17:08:23.386881] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-18T17:08:23.386975] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-18T17:08:23.387041] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-18T17:08:23.387077] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-18T17:08:23.729069] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-18T17:08:23.767926] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:08:23.800940] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-18T17:08:24.408839] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-18T17:08:24.519520] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-18T17:08:25.319567] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-18T17:08:25.621178] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-18T17:08:26.119609] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-18T17:08:26.417577] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-18T17:08:26.682601] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T17:08:26.919590] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-18T17:08:27.555736] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-18T17:08:27.719589] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-18T17:08:28.519598] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-11. [2025-09-18T17:08:28.567194] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-18T17:08:28.737406] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:08:28.738004] [WARN ] [REMOTE ] AII: No data returned for month 2024-11 [2025-09-18T17:08:29.319635] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-18T17:08:29.685837] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-18T17:08:30.119569] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-18T17:08:30.741981] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-18T17:08:30.751343] [INFO ] [REMOTE ] AHR: Full fetch complete (70928 records). [2025-09-18T17:08:30.751683] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-18T17:08:30.920273] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-18T17:08:31.172777] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-18T17:08:31.172910] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-18T17:08:31.173738] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-18T17:08:31.173812] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-18T17:08:31.175867] [DEBUG] [LOCAL ] AHR: Trimmed 70928 records to 49738 (keeping 200 days of data) [2025-09-18T17:08:31.496131] [DEBUG] [LOCAL ] AHR: Primary data saved (49738 records). [2025-09-18T17:08:31.496440] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-18T17:08:31.496682] [INFO ] [MAIN ] Update Progress: 63/2372 symbols completed. AHR took 49.0s. Estimated remaining: 5h 10m 21s. Rate: 7.4 symbols/min [2025-09-18T17:08:31.684620] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:08:31.713586] [DEBUG] [LOCAL ] AIN: Loaded 24588 existing records from primary storage. [2025-09-18T17:08:31.713798] [INFO ] [MAIN ] AIN: Loaded 24588 existing records. [2025-09-18T17:08:31.735376] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-18T17:08:31.851862] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-18T17:08:31.942523] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:08:31.942780] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-18T17:08:31.942847] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-18T17:08:31.943668] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-18T17:08:31.943731] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-18T17:08:32.050666] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:08:32.061957] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-18T17:08:32.306819] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:08:32.519539] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-11. [2025-09-18T17:08:33.319567] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-18T17:08:33.427346] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-18T17:08:33.577620] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-09-18T17:08:34.119550] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-18T17:08:34.850181] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T17:08:34.919532] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-09-18T17:08:35.710596] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-18T17:08:35.719491] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-09-18T17:08:36.483249] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-18T17:08:36.526411] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-18T17:08:36.529907] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-18T17:08:37.319547] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-18T17:08:38.119564] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-18T17:08:38.771685] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-18T17:08:38.814120] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-18T17:08:38.919632] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-09-18T17:08:39.151926] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:08:39.158110] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-09-18T17:08:39.162915] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-18T17:08:39.719569] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-18T17:08:40.519568] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-18T17:08:40.887390] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-18T17:08:41.319562] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-02. [2025-09-18T17:08:42.013238] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:08:42.013635] [WARN ] [REMOTE ] AII: No data returned for month 2025-02 [2025-09-18T17:08:42.119557] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-18T17:08:42.715071] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-18T17:08:42.919564] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-03. [2025-09-18T17:08:43.719637] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-18T17:08:44.457726] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:08:44.458076] [WARN ] [REMOTE ] AII: No data returned for month 2025-03 [2025-09-18T17:08:44.519537] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-04. [2025-09-18T17:08:44.764403] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-18T17:08:44.868728] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-18T17:08:45.293563] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:08:45.293979] [WARN ] [REMOTE ] AII: No data returned for month 2025-04 [2025-09-18T17:08:45.319542] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-05. [2025-09-18T17:08:46.119568] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-18T17:08:46.404632] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-18T17:08:46.919606] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-06. [2025-09-18T17:08:47.536685] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-18T17:08:47.719572] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-18T17:08:48.524678] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-18T17:08:48.536777] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-18T17:08:48.544627] [INFO ] [REMOTE ] AI: Full fetch complete (77885 records). [2025-09-18T17:08:48.544854] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-18T17:08:48.979978] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-18T17:08:48.980076] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-18T17:08:48.980873] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-18T17:08:48.980992] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-18T17:08:48.982698] [DEBUG] [LOCAL ] AI: Trimmed 77885 records to 54139 (keeping 200 days of data) [2025-09-18T17:08:49.313976] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-18T17:08:49.319524] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-07. [2025-09-18T17:08:49.337259] [DEBUG] [LOCAL ] AI: Primary data saved (54139 records). [2025-09-18T17:08:49.337353] [INFO ] [MAIN ] AI: Full history saved. [2025-09-18T17:08:49.339993] [INFO ] [MAIN ] Update Progress: 64/2372 symbols completed. AI took 46.2s. Estimated remaining: 5h 16m 6s. Rate: 7.3 symbols/min [2025-09-18T17:08:49.513023] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:08:49.529725] [DEBUG] [LOCAL ] AIO: Loaded 13406 existing records from primary storage. [2025-09-18T17:08:49.529863] [INFO ] [MAIN ] AIO: Loaded 13406 existing records. [2025-09-18T17:08:49.720484] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:08:49.720908] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-18T17:08:49.720987] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-18T17:08:49.736255] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-18T17:08:49.755073] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-18T17:08:49.762225] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-18T17:08:49.958193] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-18T17:08:50.122846] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-18T17:08:50.151010] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:08:50.919542] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-18T17:08:51.337457] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-18T17:08:51.719566] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-08. [2025-09-18T17:08:52.393626] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-18T17:08:52.404532] [INFO ] [REMOTE ] AIG: Full fetch complete (77213 records). [2025-09-18T17:08:52.404746] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-18T17:08:52.524701] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-11. [2025-09-18T17:08:52.814401] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-18T17:08:52.907576] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-18T17:08:52.907704] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-18T17:08:52.908534] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-18T17:08:52.908615] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-18T17:08:52.910342] [DEBUG] [LOCAL ] AIG: Trimmed 77213 records to 53867 (keeping 200 days of data) [2025-09-18T17:08:53.256511] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-18T17:08:53.267919] [DEBUG] [LOCAL ] AIG: Primary data saved (53867 records). [2025-09-18T17:08:53.268086] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-18T17:08:53.268207] [INFO ] [MAIN ] Update Progress: 65/2372 symbols completed. AIG took 42.2s. Estimated remaining: 5h 13m 26s. Rate: 7.4 symbols/min [2025-09-18T17:08:53.324777] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-18T17:08:53.445377] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:08:53.476716] [DEBUG] [LOCAL ] AIR: Loaded 26996 existing records from primary storage. [2025-09-18T17:08:53.476873] [INFO ] [MAIN ] AIR: Loaded 26996 existing records. [2025-09-18T17:08:53.668270] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:08:53.668691] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-18T17:08:53.668778] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-18T17:08:53.669593] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-09-18T17:08:53.669702] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-18T17:08:54.027603] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:08:54.119524] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-11. [2025-09-18T17:08:54.479595] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-18T17:08:54.919604] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-18T17:08:55.055322] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-18T17:08:55.719564] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-09-18T17:08:55.947435] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-18T17:08:56.402125] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-18T17:08:56.519503] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-09. [2025-09-18T17:08:57.319554] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-09-18T17:08:57.641559] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T17:08:57.645034] [INFO ] [REMOTE ] AII: Full fetch complete (9930 records). [2025-09-18T17:08:57.645159] [DEBUG] [VALIDATOR ] AII: Validating primary data. [2025-09-18T17:08:57.827342] [WARN ] [VALIDATOR ] AII: Validation failed - insufficient historical data. Have 92 unique days, need 200 days [2025-09-18T17:08:57.827587] [FATAL] [MAIN ] AII: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:08:57.827688] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:08:57.827763] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-18T17:08:57.827827] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-18T17:08:57.827863] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-18T17:08:57.827918] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-18T17:08:57.828019] [INFO ] [MAIN ] Update Progress: 66/2372 symbols completed. AII took 34.6s. Estimated remaining: 5h 11m 12s. Rate: 7.4 symbols/min [2025-09-18T17:08:57.998947] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:08:58.009855] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-18T17:08:58.047928] [DEBUG] [LOCAL ] AIT: Loaded 28515 existing records from primary storage. [2025-09-18T17:08:58.048078] [INFO ] [MAIN ] AIT: Loaded 28515 existing records. [2025-09-18T17:08:58.124734] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-09-18T17:08:58.232599] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:08:58.232866] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-18T17:08:58.232916] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-18T17:08:58.233776] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-09-18T17:08:58.233839] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-18T17:08:58.595812] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:08:58.904996] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-18T17:08:58.919505] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-09-18T17:08:59.719526] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-11. [2025-09-18T17:09:00.179521] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-18T17:09:00.519613] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-18T17:09:00.978079] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-18T17:09:01.319631] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-18T17:09:01.353711] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-18T17:09:02.119599] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-09-18T17:09:02.919579] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-18T17:09:03.217465] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-18T17:09:03.221246] [INFO ] [REMOTE ] AIN: Full fetch complete (33201 records). [2025-09-18T17:09:03.221352] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-18T17:09:03.621159] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-18T17:09:03.621257] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-18T17:09:03.621758] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-18T17:09:03.621835] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-18T17:09:03.623317] [DEBUG] [LOCAL ] AIN: Trimmed 33201 records to 24805 (keeping 200 days of data) [2025-09-18T17:09:03.720988] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-18T17:09:03.784108] [DEBUG] [LOCAL ] AIN: Primary data saved (24805 records). [2025-09-18T17:09:03.784245] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-18T17:09:03.784355] [INFO ] [MAIN ] Update Progress: 67/2372 symbols completed. AIN took 32.3s. Estimated remaining: 5h 9m 50s. Rate: 7.4 symbols/min [2025-09-18T17:09:03.960261] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:09:04.007375] [DEBUG] [LOCAL ] AIV: Loaded 40154 existing records from primary storage. [2025-09-18T17:09:04.007524] [INFO ] [MAIN ] AIV: Loaded 40154 existing records. [2025-09-18T17:09:04.186331] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:09:04.186616] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-18T17:09:04.186708] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-18T17:09:04.187724] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-18T17:09:04.187786] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-18T17:09:04.564379] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:09:04.564762] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-11. [2025-09-18T17:09:04.968610] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-18T17:09:05.068885] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T17:09:05.183639] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (3.06 seconds). [2025-09-18T17:09:05.319571] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-18T17:09:06.035179] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-18T17:09:06.119566] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-09-18T17:09:06.269350] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-18T17:09:06.919551] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-18T17:09:07.629510] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-18T17:09:07.719532] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-09-18T17:09:08.413504] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-18T17:09:08.519539] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-18T17:09:09.105945] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-18T17:09:09.319588] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-09-18T17:09:09.619499] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-18T17:09:10.119611] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-18T17:09:10.308129] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-18T17:09:10.759417] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-18T17:09:10.919576] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-18T17:09:11.719720] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-18T17:09:12.043553] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-18T17:09:12.519621] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-18T17:09:12.805024] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-18T17:09:13.319598] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-18T17:09:13.631170] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-18T17:09:14.119584] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-18T17:09:14.739260] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-18T17:09:14.919573] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-18T17:09:15.107589] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-18T17:09:15.719619] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-18T17:09:16.519597] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-18T17:09:16.807720] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-18T17:09:17.319553] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-18T17:09:17.754217] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-18T17:09:18.119604] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-18T17:09:18.499686] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-18T17:09:18.633217] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-18T17:09:18.919554] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-18T17:09:19.522020] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-18T17:09:19.537261] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-18T17:09:19.719550] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-18T17:09:20.519571] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-18T17:09:21.055102] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-18T17:09:21.059139] [INFO ] [REMOTE ] AIR: Full fetch complete (37159 records). [2025-09-18T17:09:21.059227] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-18T17:09:21.324739] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-18T17:09:21.448872] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-09-18T17:09:21.449069] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-09-18T17:09:21.449550] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-09-18T17:09:21.449707] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-09-18T17:09:21.451478] [DEBUG] [LOCAL ] AIR: Trimmed 37159 records to 27262 (keeping 200 days of data) [2025-09-18T17:09:21.616098] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-18T17:09:21.686873] [DEBUG] [LOCAL ] AIR: Primary data saved (27262 records). [2025-09-18T17:09:21.687331] [INFO ] [MAIN ] AIR: Full history saved. [2025-09-18T17:09:21.687453] [INFO ] [MAIN ] Update Progress: 68/2372 symbols completed. AIR took 28.4s. Estimated remaining: 5h 15m 15s. Rate: 7.3 symbols/min [2025-09-18T17:09:21.862706] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:09:21.906452] [DEBUG] [LOCAL ] AIZ: Loaded 30418 existing records from primary storage. [2025-09-18T17:09:21.906611] [INFO ] [MAIN ] AIZ: Loaded 30418 existing records. [2025-09-18T17:09:22.089052] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:09:22.089346] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-18T17:09:22.089396] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-18T17:09:22.091048] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-18T17:09:22.091120] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-18T17:09:22.124868] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-18T17:09:22.459853] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:09:22.481816] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-18T17:09:22.919559] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-11. [2025-09-18T17:09:23.429763] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T17:09:23.719573] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-18T17:09:23.989010] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-18T17:09:24.519555] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-18T17:09:24.759757] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-18T17:09:25.319580] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-18T17:09:25.398211] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-18T17:09:26.119563] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-18T17:09:26.919508] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-09-18T17:09:27.091251] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-18T17:09:27.261735] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T17:09:27.719567] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-18T17:09:27.947121] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-18T17:09:28.519537] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-09-18T17:09:28.657743] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-18T17:09:29.319556] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-18T17:09:29.856688] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-18T17:09:30.119603] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-18T17:09:30.371356] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-18T17:09:30.374604] [INFO ] [REMOTE ] AIT: Full fetch complete (39579 records). [2025-09-18T17:09:30.374798] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-18T17:09:30.764993] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-09-18T17:09:30.765073] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-09-18T17:09:30.765514] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-09-18T17:09:30.765554] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-09-18T17:09:30.767447] [DEBUG] [LOCAL ] AIT: Trimmed 39579 records to 28647 (keeping 200 days of data) [2025-09-18T17:09:30.935076] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-18T17:09:30.972049] [DEBUG] [LOCAL ] AIT: Primary data saved (28647 records). [2025-09-18T17:09:30.972238] [INFO ] [MAIN ] AIT: Full history saved. [2025-09-18T17:09:30.972345] [INFO ] [MAIN ] Update Progress: 69/2372 symbols completed. AIT took 33.1s. Estimated remaining: 5h 15m 43s. Rate: 7.3 symbols/min [2025-09-18T17:09:31.165203] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:09:31.172145] [DEBUG] [LOCAL ] AIZN: Loaded 3965 existing records from primary storage. [2025-09-18T17:09:31.172278] [INFO ] [MAIN ] AIZN: Loaded 3965 existing records. [2025-09-18T17:09:31.424474] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:09:31.427351] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-18T17:09:31.437746] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-18T17:09:31.438361] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-18T17:09:31.438719] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-18T17:09:31.438791] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-18T17:09:31.724911] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-18T17:09:32.042847] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:09:32.282750] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-18T17:09:32.407059] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-18T17:09:32.410604] [INFO ] [REMOTE ] AIO: Full fetch complete (20130 records). [2025-09-18T17:09:32.410827] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-18T17:09:32.524832] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-18T17:09:32.857392] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-18T17:09:32.857477] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-18T17:09:32.857799] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-18T17:09:32.857877] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-18T17:09:32.858490] [DEBUG] [LOCAL ] AIO: Trimmed 20130 records to 13488 (keeping 200 days of data) [2025-09-18T17:09:32.954608] [DEBUG] [LOCAL ] AIO: Primary data saved (13488 records). [2025-09-18T17:09:32.954800] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-18T17:09:32.954941] [INFO ] [MAIN ] Update Progress: 70/2372 symbols completed. AIO took 43.6s. Estimated remaining: 5h 12m 10s. Rate: 7.4 symbols/min [2025-09-18T17:09:33.143025] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:09:33.202060] [DEBUG] [LOCAL ] AJG: Loaded 47156 existing records from primary storage. [2025-09-18T17:09:33.202228] [INFO ] [MAIN ] AJG: Loaded 47156 existing records. [2025-09-18T17:09:33.324737] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-11. [2025-09-18T17:09:33.403816] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:09:33.404095] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-18T17:09:33.404200] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-18T17:09:33.405600] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-09-18T17:09:33.405697] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-18T17:09:33.815303] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:09:33.820188] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-18T17:09:33.879260] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-18T17:09:34.119595] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-11. [2025-09-18T17:09:34.919544] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-18T17:09:35.719560] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-09-18T17:09:35.799430] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-18T17:09:36.082153] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-18T17:09:36.087311] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-18T17:09:36.519573] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-09-18T17:09:37.125925] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-18T17:09:37.319535] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-18T17:09:37.829343] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-18T17:09:38.119552] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-18T17:09:38.490850] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-18T17:09:38.919581] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-18T17:09:39.493510] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-18T17:09:39.719545] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-18T17:09:40.519550] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-18T17:09:41.319527] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-18T17:09:41.705742] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-18T17:09:41.713300] [INFO ] [REMOTE ] AIV: Full fetch complete (58843 records). [2025-09-18T17:09:41.713443] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-18T17:09:41.983057] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-18T17:09:42.117744] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-18T17:09:42.117916] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-18T17:09:42.118618] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-18T17:09:42.118769] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-18T17:09:42.119704] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-18T17:09:42.121324] [DEBUG] [LOCAL ] AIV: Trimmed 58843 records to 40482 (keeping 200 days of data) [2025-09-18T17:09:42.223706] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-18T17:09:42.374460] [DEBUG] [LOCAL ] AIV: Primary data saved (40482 records). [2025-09-18T17:09:42.374599] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-18T17:09:42.374702] [INFO ] [MAIN ] Update Progress: 71/2372 symbols completed. AIV took 38.6s. Estimated remaining: 5h 12m 43s. Rate: 7.4 symbols/min [2025-09-18T17:09:42.547254] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:09:42.551456] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-18T17:09:42.551672] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-18T17:09:42.553598] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-18T17:09:42.553804] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-18T17:09:42.553872] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-18T17:09:42.553931] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-18T17:09:42.553966] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-18T17:09:42.914528] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:09:42.919492] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-11. [2025-09-18T17:09:43.353358] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-18T17:09:43.719546] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-18T17:09:44.159708] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-18T17:09:44.519563] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-09-18T17:09:45.319603] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-18T17:09:45.771777] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-18T17:09:46.119557] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-18T17:09:46.698114] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-18T17:09:46.775731] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-18T17:09:46.919525] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-09-18T17:09:47.719553] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-18T17:09:48.519564] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-18T17:09:48.704791] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-18T17:09:48.825306] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-18T17:09:49.299687] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-18T17:09:49.300725] [INFO ] [REMOTE ] AIZN: Full fetch complete (5697 records). [2025-09-18T17:09:49.300804] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-18T17:09:49.301237] [FATAL] [VALIDATOR ] AIZN: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:09:49.301342] [FATAL] [MAIN ] AIZN: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:09:49.301422] [WARN ] [MAIN ] AIZN: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:09:49.301524] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-18T17:09:49.301617] [DEBUG] [LOCAL ] AIZN: No primary data file found to delete. [2025-09-18T17:09:49.301719] [INFO ] [LOCAL ] AIZN: Starting deletion of derivative data. [2025-09-18T17:09:49.302203] [DEBUG] [LOCAL ] AIZN: Deleted derivative data file. [2025-09-18T17:09:49.302311] [INFO ] [MAIN ] Update Progress: 72/2372 symbols completed. AIZN took 18.3s. Estimated remaining: 5h 11m 56s. Rate: 7.4 symbols/min [2025-09-18T17:09:49.324620] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-18T17:09:49.481535] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:09:49.481721] [DEBUG] [LOCAL ] AKR: No existing data file found in primary storage. [2025-09-18T17:09:49.481773] [WARN ] [MAIN ] AKR: No existing data found, performing full refresh instead. [2025-09-18T17:09:49.481959] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-18T17:09:49.482014] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-18T17:09:49.482061] [DEBUG] [LOCAL ] AKR: No primary data file found to delete. [2025-09-18T17:09:49.482096] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-18T17:09:49.769954] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-18T17:09:49.849423] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:09:50.119553] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-11. [2025-09-18T17:09:50.919609] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-18T17:09:51.436105] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-18T17:09:51.719587] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-09-18T17:09:51.873347] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-18T17:09:52.519554] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-18T17:09:53.325396] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-18T17:09:53.330692] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-18T17:09:53.398047] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-18T17:09:54.023835] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-18T17:09:54.119532] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-09-18T17:09:54.919551] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-18T17:09:55.244698] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-18T17:09:55.662337] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-18T17:09:55.719502] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-18T17:09:56.519581] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-18T17:09:57.319527] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-18T17:09:57.387362] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T17:09:58.030828] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-18T17:09:58.119500] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-18T17:09:58.686176] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-18T17:09:58.919545] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-18T17:09:59.719593] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-18T17:09:59.982285] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-18T17:10:00.003549] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-18T17:10:00.007608] [INFO ] [REMOTE ] AIZ: Full fetch complete (43046 records). [2025-09-18T17:10:00.007732] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-18T17:10:00.325743] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-18T17:10:00.422988] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-18T17:10:00.423069] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-18T17:10:00.423535] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-18T17:10:00.423597] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-18T17:10:00.425774] [DEBUG] [LOCAL ] AIZ: Trimmed 43046 records to 30647 (keeping 200 days of data) [2025-09-18T17:10:00.524151] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-18T17:10:00.630314] [DEBUG] [LOCAL ] AIZ: Primary data saved (30647 records). [2025-09-18T17:10:00.630472] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-18T17:10:00.630561] [INFO ] [MAIN ] Update Progress: 73/2372 symbols completed. AIZ took 38.9s. Estimated remaining: 5h 13m 28s. Rate: 7.3 symbols/min [2025-09-18T17:10:00.808208] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:10:00.859517] [DEBUG] [LOCAL ] AL: Loaded 43915 existing records from primary storage. [2025-09-18T17:10:00.859703] [INFO ] [MAIN ] AL: Loaded 43915 existing records. [2025-09-18T17:10:01.035695] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:10:01.035966] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-18T17:10:01.036015] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-18T17:10:01.037277] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-18T17:10:01.037338] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-18T17:10:01.366160] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-18T17:10:01.451784] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:10:02.119618] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-11. [2025-09-18T17:10:02.375543] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-18T17:10:02.919592] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-18T17:10:02.954070] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-18T17:10:03.327993] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-18T17:10:03.411048] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-18T17:10:03.719614] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-18T17:10:04.315954] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-18T17:10:04.519590] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-18T17:10:04.801934] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-18T17:10:05.319595] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-18T17:10:06.119573] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-18T17:10:06.919580] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-09-18T17:10:07.041974] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-18T17:10:07.624488] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-18T17:10:07.719582] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-18T17:10:08.039704] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-18T17:10:08.519606] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-09-18T17:10:08.899172] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-18T17:10:09.319546] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-18T17:10:09.433824] [DEBUG] [REMOTE ] AKA: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-18T17:10:09.434152] [WARN ] [REMOTE ] AKA: No data returned for month 2025-08 [2025-09-18T17:10:09.716091] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T17:10:10.119552] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-18T17:10:10.919550] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-18T17:10:11.134605] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-18T17:10:11.719552] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-18T17:10:12.519547] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-18T17:10:12.561660] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-18T17:10:12.874625] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-18T17:10:12.875472] [INFO ] [REMOTE ] AKA: Full fetch complete (2324 records). [2025-09-18T17:10:12.875545] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-18T17:10:13.079206] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 177 unique days, need 200 days [2025-09-18T17:10:13.079513] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:10:13.079694] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:10:13.079783] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-18T17:10:13.079886] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-18T17:10:13.080021] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-18T17:10:13.080151] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-18T17:10:13.080297] [INFO ] [MAIN ] Update Progress: 74/2372 symbols completed. AKA took 30.7s. Estimated remaining: 5h 15m 32s. Rate: 7.3 symbols/min [2025-09-18T17:10:13.262122] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:10:13.290306] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-18T17:10:13.327964] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-18T17:10:13.349555] [DEBUG] [LOCAL ] ALB: Loaded 53252 existing records from primary storage. [2025-09-18T17:10:13.349750] [INFO ] [MAIN ] ALB: Loaded 53252 existing records. [2025-09-18T17:10:13.538743] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:10:13.539056] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-18T17:10:13.539115] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-18T17:10:13.540234] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-18T17:10:13.540320] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-18T17:10:13.908160] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:10:14.119562] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-11. [2025-09-18T17:10:14.919554] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-18T17:10:15.308603] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-18T17:10:15.719550] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-18T17:10:16.280216] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-11 (2.16 seconds). [2025-09-18T17:10:16.519600] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-18T17:10:17.319613] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-09-18T17:10:17.363844] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T17:10:17.841882] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T17:10:17.922810] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (3.00 seconds). [2025-09-18T17:10:18.119540] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-18T17:10:18.919567] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-18T17:10:18.982721] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-18T17:10:19.719561] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-18T17:10:19.762525] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T17:10:20.477998] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-18T17:10:20.519501] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-18T17:10:21.088461] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-18T17:10:21.094813] [INFO ] [REMOTE ] AJG: Full fetch complete (69202 records). [2025-09-18T17:10:21.094958] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-18T17:10:21.095941] [FATAL] [VALIDATOR ] AJG: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:10:21.096041] [FATAL] [MAIN ] AJG: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:10:21.096087] [WARN ] [MAIN ] AJG: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:10:21.096128] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-18T17:10:21.096189] [DEBUG] [LOCAL ] AJG: No primary data file found to delete. [2025-09-18T17:10:21.096228] [INFO ] [LOCAL ] AJG: Starting deletion of derivative data. [2025-09-18T17:10:21.096664] [DEBUG] [LOCAL ] AJG: Deleted derivative data file. [2025-09-18T17:10:21.097167] [INFO ] [MAIN ] Update Progress: 75/2372 symbols completed. AJG took 48.1s. Estimated remaining: 5h 15m 17s. Rate: 7.3 symbols/min [2025-09-18T17:10:21.283347] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:10:21.320493] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-09-18T17:10:21.340883] [DEBUG] [LOCAL ] ALC: Loaded 50811 existing records from primary storage. [2025-09-18T17:10:21.341048] [INFO ] [MAIN ] ALC: Loaded 50811 existing records. [2025-09-18T17:10:21.530895] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:10:21.531187] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-18T17:10:21.531239] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-18T17:10:21.532400] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-09-18T17:10:21.532463] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-18T17:10:21.924864] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:10:21.943244] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-18T17:10:21.949796] [INFO ] [REMOTE ] AKR: Full fetch complete (65152 records). [2025-09-18T17:10:21.949937] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-18T17:10:22.132074] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-18T17:10:22.368400] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-09-18T17:10:22.368507] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-09-18T17:10:22.369361] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-09-18T17:10:22.369435] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-09-18T17:10:22.370989] [DEBUG] [LOCAL ] AKR: Trimmed 65152 records to 46021 (keeping 200 days of data) [2025-09-18T17:10:22.650580] [DEBUG] [LOCAL ] AKR: Primary data saved (46021 records). [2025-09-18T17:10:22.650761] [INFO ] [MAIN ] AKR: Full history saved. [2025-09-18T17:10:22.650851] [INFO ] [MAIN ] Update Progress: 76/2372 symbols completed. AKR took 33.3s. Estimated remaining: 5h 11m 47s. Rate: 7.4 symbols/min [2025-09-18T17:10:22.826415] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:10:22.860165] [DEBUG] [LOCAL ] ALE: Loaded 30063 existing records from primary storage. [2025-09-18T17:10:22.860313] [INFO ] [MAIN ] ALE: Loaded 30063 existing records. [2025-09-18T17:10:22.929320] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-11. [2025-09-18T17:10:23.046775] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:10:23.047113] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-18T17:10:23.047169] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-18T17:10:23.047967] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-18T17:10:23.048027] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-18T17:10:23.408388] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:10:23.469402] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-18T17:10:23.552834] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-18T17:10:23.719639] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-18T17:10:24.519611] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-11. [2025-09-18T17:10:25.065025] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-11 (2.14 seconds). [2025-09-18T17:10:25.271622] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-18T17:10:25.286303] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-18T17:10:25.319623] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-18T17:10:26.119616] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-09-18T17:10:26.919572] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-09-18T17:10:27.407352] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-18T17:10:27.440497] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-18T17:10:27.719577] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-09-18T17:10:28.190781] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-18T17:10:28.519613] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-18T17:10:28.684910] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-18T17:10:29.319570] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-09-18T17:10:30.119553] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-18T17:10:30.230416] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-18T17:10:30.925351] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-18T17:10:30.948331] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-18T17:10:31.310579] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-18T17:10:31.719557] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-18T17:10:32.519583] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-18T17:10:32.639744] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-18T17:10:32.862272] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T17:10:33.319561] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-18T17:10:34.042552] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-18T17:10:34.119559] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-18T17:10:34.257064] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T17:10:34.919565] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-18T17:10:35.719518] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-18T17:10:35.803730] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-18T17:10:35.919289] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-18T17:10:36.519553] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-18T17:10:36.965689] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-18T17:10:37.319505] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-18T17:10:37.761699] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-18T17:10:38.119560] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-18T17:10:38.601460] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-18T17:10:38.608490] [INFO ] [REMOTE ] AL: Full fetch complete (61774 records). [2025-09-18T17:10:38.608613] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-18T17:10:38.924608] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-18T17:10:39.005929] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-18T17:10:39.006158] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-18T17:10:39.007023] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-18T17:10:39.007183] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-18T17:10:39.014077] [DEBUG] [LOCAL ] AL: Trimmed 61774 records to 44281 (keeping 200 days of data) [2025-09-18T17:10:39.023392] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-18T17:10:39.305267] [DEBUG] [LOCAL ] AL: Primary data saved (44281 records). [2025-09-18T17:10:39.305420] [INFO ] [MAIN ] AL: Full history saved. [2025-09-18T17:10:39.305514] [INFO ] [MAIN ] Update Progress: 77/2372 symbols completed. AL took 38.7s. Estimated remaining: 5h 15m 53s. Rate: 7.3 symbols/min [2025-09-18T17:10:39.719530] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-18T17:10:40.519542] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-18T17:10:40.706155] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-18T17:10:41.242759] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-18T17:10:41.319502] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-18T17:10:41.988963] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-18T17:10:42.119567] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-18T17:10:42.327938] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-18T17:10:42.919553] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-18T17:10:43.719586] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-18T17:10:44.051358] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-18T17:10:44.519594] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-18T17:10:44.715672] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-18T17:10:44.739150] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-18T17:10:44.744092] [INFO ] [REMOTE ] ALE: Full fetch complete (41847 records). [2025-09-18T17:10:44.744180] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-18T17:10:45.122012] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-09-18T17:10:45.122097] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-09-18T17:10:45.122590] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-09-18T17:10:45.122688] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-09-18T17:10:45.123586] [DEBUG] [LOCAL ] ALE: Trimmed 41847 records to 30334 (keeping 200 days of data) [2025-09-18T17:10:45.311348] [DEBUG] [LOCAL ] ALE: Primary data saved (30334 records). [2025-09-18T17:10:45.311495] [INFO ] [MAIN ] ALE: Full history saved. [2025-09-18T17:10:45.311583] [INFO ] [MAIN ] Update Progress: 78/2372 symbols completed. ALE took 22.7s. Estimated remaining: 5h 14m 38s. Rate: 7.3 symbols/min [2025-09-18T17:10:45.319559] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-18T17:10:46.360222] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-18T17:10:46.380357] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-18T17:10:46.890455] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T17:10:46.919499] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-18T17:10:48.580519] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-18T17:10:48.590954] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-18T17:10:48.664572] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-18T17:10:48.671912] [INFO ] [REMOTE ] ALB: Full fetch complete (76652 records). [2025-09-18T17:10:48.672045] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-18T17:10:49.066688] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-18T17:10:49.066808] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-18T17:10:49.067530] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-18T17:10:49.067582] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-18T17:10:49.069062] [DEBUG] [LOCAL ] ALB: Trimmed 76652 records to 53627 (keeping 200 days of data) [2025-09-18T17:10:49.400019] [DEBUG] [LOCAL ] ALB: Primary data saved (53627 records). [2025-09-18T17:10:49.400177] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-18T17:10:49.400285] [INFO ] [MAIN ] Update Progress: 79/2372 symbols completed. ALB took 36.3s. Estimated remaining: 5h 12m 30s. Rate: 7.3 symbols/min [2025-09-18T17:10:50.197567] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-18T17:10:50.208790] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-18T17:10:52.036583] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-18T17:10:52.048157] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-18T17:10:54.005685] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-18T17:10:54.013870] [INFO ] [REMOTE ] ALC: Full fetch complete (72297 records). [2025-09-18T17:10:54.014194] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-18T17:10:54.405232] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-09-18T17:10:54.405314] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-09-18T17:10:54.406049] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-09-18T17:10:54.406115] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-09-18T17:10:54.407574] [DEBUG] [LOCAL ] ALC: Trimmed 72297 records to 51186 (keeping 200 days of data) [2025-09-18T17:10:54.712069] [DEBUG] [LOCAL ] ALC: Primary data saved (51186 records). [2025-09-18T17:10:54.712243] [INFO ] [MAIN ] ALC: Full history saved. [2025-09-18T17:10:54.715128] [INFO ] [MAIN ] Update Progress: 80/2372 symbols completed. ALC took 33.6s. Estimated remaining: 5h 10m 60s. Rate: 7.4 symbols/min [2025-09-18T17:10:55.406982] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:10:55.409296] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:10:55.396916] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:10:55.426383] [DEBUG] [LOCAL ] ALEX: No existing data file found in primary storage. [2025-09-18T17:10:55.427815] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:10:55.426702] [WARN ] [MAIN ] ALEX: No existing data found, performing full refresh instead. [2025-09-18T17:10:55.428666] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-18T17:10:55.428778] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-18T17:10:55.430087] [DEBUG] [LOCAL ] ALEX: No primary data file found to delete. [2025-09-18T17:10:55.430192] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-18T17:10:55.551320] [DEBUG] [LOCAL ] ALG: Loaded 10693 existing records from primary storage. [2025-09-18T17:10:55.557463] [INFO ] [MAIN ] ALG: Loaded 10693 existing records. [2025-09-18T17:10:55.892348] [DEBUG] [LOCAL ] ALK: Loaded 53066 existing records from primary storage. [2025-09-18T17:10:55.963511] [INFO ] [MAIN ] ALK: Loaded 53066 existing records. [2025-09-18T17:10:55.996147] [DEBUG] [LOCAL ] ALIT: Loaded 52727 existing records from primary storage. [2025-09-18T17:10:56.033119] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:10:56.069691] [INFO ] [MAIN ] ALIT: Loaded 52727 existing records. [2025-09-18T17:10:56.114540] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-18T17:10:56.126258] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:10:56.173043] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-18T17:10:56.172963] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-11. [2025-09-18T17:10:56.242372] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-18T17:10:56.271094] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-18T17:10:56.538488] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:10:56.589847] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:10:56.632174] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-18T17:10:56.663163] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-18T17:10:56.663227] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-18T17:10:56.670128] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-18T17:10:56.679726] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-09-18T17:10:56.713605] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-18T17:10:56.713665] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-18T17:10:56.768231] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-18T17:10:57.019423] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:10:57.057306] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-11. [2025-09-18T17:10:57.522356] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:10:57.547462] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-11. [2025-09-18T17:10:57.619858] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:10:57.620374] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-11. [2025-09-18T17:10:57.717948] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-18T17:10:57.723928] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-09-18T17:10:57.851500] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-18T17:10:57.854704] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-09-18T17:10:58.429944] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-18T17:10:58.432935] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-09-18T17:10:58.704397] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-18T17:10:58.712800] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-09-18T17:10:59.034543] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-18T17:10:59.037617] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-18T17:10:59.101210] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-18T17:10:59.111251] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-09-18T17:10:59.436089] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-18T17:10:59.446411] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-09-18T17:10:59.617259] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-18T17:10:59.620111] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-18T17:10:59.662292] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T17:10:59.719636] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-18T17:11:00.355006] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-18T17:11:00.482346] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-18T17:11:00.519494] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-18T17:11:00.593788] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-18T17:11:01.286217] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-18T17:11:01.319550] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-09-18T17:11:01.509237] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-18T17:11:02.119580] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-18T17:11:02.727615] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-18T17:11:02.896843] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T17:11:02.919508] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-18T17:11:03.719555] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-18T17:11:04.519570] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-09-18T17:11:04.648163] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-18T17:11:05.319559] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-18T17:11:05.364356] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T17:11:05.853962] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-18T17:11:05.922235] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-18T17:11:06.119549] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-18T17:11:06.919555] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-18T17:11:06.982181] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-18T17:11:07.719581] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-18T17:11:07.903170] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-18T17:11:08.519556] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-18T17:11:08.627501] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-18T17:11:09.319546] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-18T17:11:10.119507] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-18T17:11:10.153392] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-18T17:11:10.250179] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T17:11:10.919616] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-18T17:11:11.515960] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T17:11:11.719579] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-18T17:11:12.457069] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T17:11:12.519569] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-18T17:11:13.094526] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-18T17:11:13.319636] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-18T17:11:13.913274] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-18T17:11:14.119569] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-18T17:11:14.807893] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T17:11:14.919605] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-18T17:11:15.597431] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-18T17:11:15.719623] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-18T17:11:15.797824] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-18T17:11:16.519599] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-18T17:11:17.319605] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-18T17:11:17.481008] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-18T17:11:17.483019] [INFO ] [REMOTE ] ALG: Full fetch complete (15797 records). [2025-09-18T17:11:17.483163] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-18T17:11:17.680284] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-18T17:11:18.127836] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-18T17:11:18.160752] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-18T17:11:18.160823] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-18T17:11:18.161140] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-18T17:11:18.161219] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-18T17:11:18.162469] [DEBUG] [LOCAL ] ALG: Trimmed 15797 records to 10773 (keeping 200 days of data) [2025-09-18T17:11:18.238869] [DEBUG] [LOCAL ] ALG: Primary data saved (10773 records). [2025-09-18T17:11:18.239052] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-18T17:11:18.239205] [INFO ] [MAIN ] Update Progress: 81/2372 symbols completed. ALG took 23.5s. Estimated remaining: 5h 18m 7s. Rate: 7.2 symbols/min [2025-09-18T17:11:18.437510] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:11:18.451761] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-18T17:11:18.456971] [INFO ] [REMOTE ] ALEX: Full fetch complete (44401 records). [2025-09-18T17:11:18.457106] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-18T17:11:18.820203] [DEBUG] [LOCAL ] ALL: Loaded 50203 existing records from primary storage. [2025-09-18T17:11:18.826164] [INFO ] [MAIN ] ALL: Loaded 50203 existing records. [2025-09-18T17:11:18.944637] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-18T17:11:19.058894] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-18T17:11:19.064120] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-18T17:11:19.092607] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-18T17:11:19.103251] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-18T17:11:19.127123] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:11:19.127727] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-18T17:11:19.127799] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-18T17:11:19.127949] [DEBUG] [LOCAL ] ALEX: Trimmed 44401 records to 31856 (keeping 200 days of data) [2025-09-18T17:11:19.129835] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-18T17:11:19.129947] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-18T17:11:19.499544] [DEBUG] [LOCAL ] ALEX: Primary data saved (31856 records). [2025-09-18T17:11:19.502551] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-18T17:11:19.503022] [INFO ] [MAIN ] Update Progress: 82/2372 symbols completed. ALEX took 24.8s. Estimated remaining: 5h 14m 41s. Rate: 7.3 symbols/min [2025-09-18T17:11:19.908955] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:11:19.915233] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:11:19.916375] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-11. [2025-09-18T17:11:20.009549] [DEBUG] [LOCAL ] ALLE: Loaded 45276 existing records from primary storage. [2025-09-18T17:11:20.009913] [INFO ] [MAIN ] ALLE: Loaded 45276 existing records. [2025-09-18T17:11:20.083590] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-18T17:11:20.209438] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:11:20.209715] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-18T17:11:20.209772] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-18T17:11:20.211668] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-18T17:11:20.211746] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-18T17:11:20.532841] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-18T17:11:20.575968] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:11:20.774746] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-18T17:11:21.319519] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-18T17:11:21.425092] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-18T17:11:22.119619] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-09-18T17:11:22.252827] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-18T17:11:22.919517] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-18T17:11:22.979030] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-18T17:11:23.669284] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-18T17:11:23.719582] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-09-18T17:11:24.330784] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-18T17:11:24.342320] [INFO ] [REMOTE ] ALK: Full fetch complete (76614 records). [2025-09-18T17:11:24.342537] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-18T17:11:24.524798] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-18T17:11:24.766663] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-09-18T17:11:24.766758] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-09-18T17:11:24.767475] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-09-18T17:11:24.767519] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-09-18T17:11:24.769041] [DEBUG] [LOCAL ] ALK: Trimmed 76614 records to 53456 (keeping 200 days of data) [2025-09-18T17:11:25.104945] [DEBUG] [LOCAL ] ALK: Primary data saved (53456 records). [2025-09-18T17:11:25.105258] [INFO ] [MAIN ] ALK: Full history saved. [2025-09-18T17:11:25.107240] [INFO ] [MAIN ] Update Progress: 83/2372 symbols completed. ALK took 30.4s. Estimated remaining: 5h 13m 20s. Rate: 7.3 symbols/min [2025-09-18T17:11:25.292306] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:11:25.320211] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-11. [2025-09-18T17:11:25.327267] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T17:11:25.405051] [DEBUG] [LOCAL ] ALLY: Loaded 53219 existing records from primary storage. [2025-09-18T17:11:25.405250] [INFO ] [MAIN ] ALLY: Loaded 53219 existing records. [2025-09-18T17:11:25.585843] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:11:25.586079] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-18T17:11:25.586138] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-18T17:11:25.587764] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-18T17:11:25.587837] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-18T17:11:25.957758] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:11:25.995272] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-18T17:11:26.119559] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-18T17:11:26.650135] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-18T17:11:26.919581] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-11. [2025-09-18T17:11:27.718329] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-18T17:11:27.730058] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-09-18T17:11:28.519619] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-18T17:11:28.686163] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-18T17:11:28.889120] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-18T17:11:29.319605] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-09-18T17:11:29.955999] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-18T17:11:30.119584] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-09-18T17:11:30.837814] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-18T17:11:30.919585] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-18T17:11:31.372009] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T17:11:31.719592] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-09-18T17:11:32.332572] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T17:11:32.519545] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-18T17:11:33.319577] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-18T17:11:33.744007] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-18T17:11:33.878820] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T17:11:34.119547] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-18T17:11:34.645277] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T17:11:34.919560] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-18T17:11:35.652189] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-18T17:11:35.659488] [INFO ] [REMOTE ] ALIT: Full fetch complete (76240 records). [2025-09-18T17:11:35.659619] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-18T17:11:35.727610] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-18T17:11:36.061373] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-18T17:11:36.061482] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-18T17:11:36.062244] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-18T17:11:36.062314] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-18T17:11:36.063913] [DEBUG] [LOCAL ] ALIT: Trimmed 76240 records to 53112 (keeping 200 days of data) [2025-09-18T17:11:36.388281] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-18T17:11:36.447511] [DEBUG] [LOCAL ] ALIT: Primary data saved (53112 records). [2025-09-18T17:11:36.447716] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-18T17:11:36.447861] [INFO ] [MAIN ] Update Progress: 84/2372 symbols completed. ALIT took 41.7s. Estimated remaining: 5h 14m 37s. Rate: 7.3 symbols/min [2025-09-18T17:11:36.524846] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-18T17:11:36.637986] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:11:36.679974] [DEBUG] [LOCAL ] ALSN: Loaded 43370 existing records from primary storage. [2025-09-18T17:11:36.680140] [INFO ] [MAIN ] ALSN: Loaded 43370 existing records. [2025-09-18T17:11:36.862145] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:11:36.862507] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-18T17:11:36.862566] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-18T17:11:36.864083] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-18T17:11:36.864148] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-18T17:11:37.257676] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:11:37.319540] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-11. [2025-09-18T17:11:37.761695] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-18T17:11:38.024531] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-18T17:11:38.119568] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-18T17:11:38.454835] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-18T17:11:38.919565] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-18T17:11:39.719558] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-09-18T17:11:39.900298] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-18T17:11:40.266824] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-18T17:11:40.519558] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-18T17:11:40.984949] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-18T17:11:41.319566] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-18T17:11:42.119625] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-18T17:11:42.477717] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-18T17:11:42.932766] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-09-18T17:11:42.935955] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-18T17:11:43.603082] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-18T17:11:43.719587] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-18T17:11:44.116434] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-18T17:11:44.519600] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-18T17:11:44.833708] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-18T17:11:45.319580] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-18T17:11:45.903470] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-18T17:11:46.119549] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-18T17:11:46.700995] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T17:11:46.919564] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-18T17:11:47.694829] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-18T17:11:47.719511] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-18T17:11:48.309053] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-18T17:11:48.519563] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-18T17:11:49.322639] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-18T17:11:49.328425] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T17:11:49.746779] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-18T17:11:50.119559] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-18T17:11:50.902077] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-18T17:11:50.919492] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-18T17:11:51.719561] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-18T17:11:51.859331] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-18T17:11:52.235314] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-18T17:11:52.519592] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-18T17:11:53.150736] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T17:11:53.319545] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-18T17:11:53.627770] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-18T17:11:54.119573] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-18T17:11:54.590298] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-18T17:11:54.596605] [INFO ] [REMOTE ] ALLE: Full fetch complete (64950 records). [2025-09-18T17:11:54.596807] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-18T17:11:54.922541] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-18T17:11:55.019335] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-18T17:11:55.019426] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-18T17:11:55.020175] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-18T17:11:55.020239] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-18T17:11:55.021754] [DEBUG] [LOCAL ] ALLE: Trimmed 64950 records to 45630 (keeping 200 days of data) [2025-09-18T17:11:55.332011] [DEBUG] [LOCAL ] ALLE: Primary data saved (45630 records). [2025-09-18T17:11:55.332317] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-18T17:11:55.332438] [INFO ] [MAIN ] Update Progress: 85/2372 symbols completed. ALLE took 35.8s. Estimated remaining: 5h 19m 15s. Rate: 7.2 symbols/min [2025-09-18T17:11:55.452416] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-18T17:11:55.544950] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:11:55.571438] [DEBUG] [LOCAL ] ALTG: Loaded 24306 existing records from primary storage. [2025-09-18T17:11:55.571561] [INFO ] [MAIN ] ALTG: Loaded 24306 existing records. [2025-09-18T17:11:55.724677] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-18T17:11:55.755943] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:11:55.756139] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-18T17:11:55.756189] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-18T17:11:55.756989] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-18T17:11:55.757061] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-18T17:11:56.117586] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:11:56.300613] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-18T17:11:56.308346] [INFO ] [REMOTE ] ALLY: Full fetch complete (76723 records). [2025-09-18T17:11:56.308458] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-18T17:11:56.531744] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-11. [2025-09-18T17:11:56.705158] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-18T17:11:56.705263] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-18T17:11:56.706126] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-18T17:11:56.706191] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-18T17:11:56.707723] [DEBUG] [LOCAL ] ALLY: Trimmed 76723 records to 53607 (keeping 200 days of data) [2025-09-18T17:11:57.040801] [DEBUG] [LOCAL ] ALLY: Primary data saved (53607 records). [2025-09-18T17:11:57.040964] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-18T17:11:57.041745] [INFO ] [MAIN ] Update Progress: 86/2372 symbols completed. ALLY took 31.9s. Estimated remaining: 5h 16m 9s. Rate: 7.2 symbols/min [2025-09-18T17:11:57.213585] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:11:57.213795] [DEBUG] [LOCAL ] ALUR: No existing data file found in primary storage. [2025-09-18T17:11:57.213856] [WARN ] [MAIN ] ALUR: No existing data found, performing full refresh instead. [2025-09-18T17:11:57.214038] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-18T17:11:57.214089] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-18T17:11:57.214133] [DEBUG] [LOCAL ] ALUR: No primary data file found to delete. [2025-09-18T17:11:57.214165] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-18T17:11:57.320976] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-18T17:11:57.584898] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:11:57.603327] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-18T17:11:57.664751] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-18T17:11:58.119614] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-11. [2025-09-18T17:11:58.587600] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-18T17:11:58.919619] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-18T17:11:59.433414] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-18T17:11:59.719556] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-09-18T17:12:00.220328] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T17:12:00.519505] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-09-18T17:12:00.899163] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-18T17:12:01.319560] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-18T17:12:01.547808] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-18T17:12:02.119557] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-09-18T17:12:02.828925] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-18T17:12:02.919587] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-18T17:12:03.605792] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T17:12:03.719565] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-18T17:12:04.316204] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-18T17:12:04.331345] [INFO ] [REMOTE ] ALL: Full fetch complete (72334 records). [2025-09-18T17:12:04.331590] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-18T17:12:04.520504] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-09-18T17:12:04.754439] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-18T17:12:04.754528] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-18T17:12:04.755253] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-18T17:12:04.755336] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-18T17:12:04.756872] [DEBUG] [LOCAL ] ALL: Trimmed 72334 records to 50589 (keeping 200 days of data) [2025-09-18T17:12:05.081771] [DEBUG] [LOCAL ] ALL: Primary data saved (50589 records). [2025-09-18T17:12:05.081925] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-18T17:12:05.083575] [INFO ] [MAIN ] Update Progress: 87/2372 symbols completed. ALL took 46.8s. Estimated remaining: 5h 15m 54s. Rate: 7.2 symbols/min [2025-09-18T17:12:05.259779] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:12:05.272681] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-18T17:12:05.319361] [DEBUG] [LOCAL ] ALV: Loaded 42962 existing records from primary storage. [2025-09-18T17:12:05.319503] [INFO ] [MAIN ] ALV: Loaded 42962 existing records. [2025-09-18T17:12:05.319583] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-18T17:12:05.469955] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-18T17:12:05.532944] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:12:05.533321] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-18T17:12:05.533390] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-18T17:12:05.533524] [INFO ] [REMOTE ] ALSN: Full fetch complete (61812 records). [2025-09-18T17:12:05.533683] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-18T17:12:05.569304] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-18T17:12:05.603868] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-18T17:12:06.124675] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-18T17:12:06.323770] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:12:06.323949] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-18T17:12:06.324301] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-18T17:12:06.324947] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-18T17:12:06.325016] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-18T17:12:06.326438] [DEBUG] [LOCAL ] ALSN: Trimmed 61812 records to 43709 (keeping 200 days of data) [2025-09-18T17:12:06.462138] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T17:12:06.617621] [DEBUG] [LOCAL ] ALSN: Primary data saved (43709 records). [2025-09-18T17:12:06.617786] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-18T17:12:06.617878] [INFO ] [MAIN ] Update Progress: 88/2372 symbols completed. ALSN took 30.2s. Estimated remaining: 5h 12m 50s. Rate: 7.3 symbols/min [2025-09-18T17:12:06.791986] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:12:06.799588] [DEBUG] [LOCAL ] ALX: Loaded 5780 existing records from primary storage. [2025-09-18T17:12:06.799749] [INFO ] [MAIN ] ALX: Loaded 5780 existing records. [2025-09-18T17:12:06.924627] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-11. [2025-09-18T17:12:06.994676] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:12:06.995017] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-18T17:12:06.995070] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-18T17:12:06.995388] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-18T17:12:06.995448] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-18T17:12:07.439987] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:12:07.452209] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T17:12:07.719587] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-18T17:12:08.250797] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-18T17:12:08.519569] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-18T17:12:08.597486] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-18T17:12:09.319564] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-09-18T17:12:09.458018] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T17:12:10.119561] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-18T17:12:10.818569] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T17:12:10.919544] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-09-18T17:12:11.006468] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-18T17:12:11.719539] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-18T17:12:12.519534] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-18T17:12:12.690679] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-18T17:12:12.852948] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-18T17:12:13.319510] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-18T17:12:13.396708] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-18T17:12:13.819810] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-18T17:12:14.119564] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-18T17:12:14.919557] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-18T17:12:15.596252] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-18T17:12:15.628257] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-18T17:12:15.719516] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-18T17:12:16.519548] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-18T17:12:17.050674] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-18T17:12:17.176632] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-18T17:12:17.319540] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-18T17:12:18.119529] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-18T17:12:18.382582] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-18T17:12:18.919509] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-18T17:12:19.195386] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-18T17:12:19.719558] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-18T17:12:20.381443] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T17:12:20.519514] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-18T17:12:20.651830] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-18T17:12:20.653232] [INFO ] [REMOTE ] ALUR: Full fetch complete (21666 records). [2025-09-18T17:12:20.653306] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-18T17:12:21.020046] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-09-18T17:12:21.020172] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-09-18T17:12:21.020501] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-09-18T17:12:21.020562] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-09-18T17:12:21.021183] [DEBUG] [LOCAL ] ALUR: Trimmed 21666 records to 11174 (keeping 200 days of data) [2025-09-18T17:12:21.082223] [DEBUG] [LOCAL ] ALUR: Primary data saved (11174 records). [2025-09-18T17:12:21.082361] [INFO ] [MAIN ] ALUR: Full history saved. [2025-09-18T17:12:21.082438] [INFO ] [MAIN ] Update Progress: 89/2372 symbols completed. ALUR took 24.0s. Estimated remaining: 5h 15m 22s. Rate: 7.2 symbols/min [2025-09-18T17:12:21.251571] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:12:21.308585] [DEBUG] [LOCAL ] AM: Loaded 52178 existing records from primary storage. [2025-09-18T17:12:21.308788] [INFO ] [MAIN ] AM: Loaded 52178 existing records. [2025-09-18T17:12:21.329709] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-18T17:12:21.492492] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:12:21.492850] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-18T17:12:21.492908] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-18T17:12:21.494400] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-18T17:12:21.494463] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-18T17:12:21.854241] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:12:22.095635] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T17:12:22.119489] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-18T17:12:22.515471] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-18T17:12:22.919551] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-11. [2025-09-18T17:12:23.282202] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-18T17:12:23.600631] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-18T17:12:23.719562] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-18T17:12:24.519563] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-18T17:12:24.936177] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-18T17:12:25.319552] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-11. [2025-09-18T17:12:25.822760] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-18T17:12:26.119549] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-18T17:12:26.919585] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-18T17:12:27.020214] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-18T17:12:27.024358] [INFO ] [REMOTE ] ALTG: Full fetch complete (33566 records). [2025-09-18T17:12:27.024476] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-18T17:12:27.347854] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-11 (2.03 seconds). [2025-09-18T17:12:27.452572] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-18T17:12:27.452715] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-18T17:12:27.453171] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-18T17:12:27.453235] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-18T17:12:27.455156] [DEBUG] [LOCAL ] ALTG: Trimmed 33566 records to 24477 (keeping 200 days of data) [2025-09-18T17:12:27.590682] [DEBUG] [LOCAL ] ALTG: Primary data saved (24477 records). [2025-09-18T17:12:27.590841] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-18T17:12:27.590937] [INFO ] [MAIN ] Update Progress: 90/2372 symbols completed. ALTG took 32.3s. Estimated remaining: 5h 14m 29s. Rate: 7.3 symbols/min [2025-09-18T17:12:27.731232] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-09-18T17:12:27.762762] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:12:27.801958] [DEBUG] [LOCAL ] AMBC: Loaded 37673 existing records from primary storage. [2025-09-18T17:12:27.802112] [INFO ] [MAIN ] AMBC: Loaded 37673 existing records. [2025-09-18T17:12:27.983513] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:12:27.983820] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-18T17:12:27.983870] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-18T17:12:27.984910] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-18T17:12:27.984988] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-18T17:12:28.157134] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-18T17:12:28.354121] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:12:28.524891] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-09-18T17:12:28.528162] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-18T17:12:29.319790] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-11. [2025-09-18T17:12:30.119583] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-18T17:12:30.349943] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-18T17:12:30.424824] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-18T17:12:30.919539] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-09-18T17:12:31.385957] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-18T17:12:31.391877] [INFO ] [REMOTE ] ALV: Full fetch complete (61858 records). [2025-09-18T17:12:31.392048] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-18T17:12:31.731015] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-09-18T17:12:31.793472] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-18T17:12:31.793576] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-18T17:12:31.794349] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-18T17:12:31.794429] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-18T17:12:31.796734] [DEBUG] [LOCAL ] ALV: Trimmed 61858 records to 43233 (keeping 200 days of data) [2025-09-18T17:12:32.083573] [DEBUG] [LOCAL ] ALV: Primary data saved (43233 records). [2025-09-18T17:12:32.083740] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-18T17:12:32.083833] [INFO ] [MAIN ] Update Progress: 91/2372 symbols completed. ALV took 27.0s. Estimated remaining: 5h 12m 46s. Rate: 7.3 symbols/min [2025-09-18T17:12:32.208119] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-18T17:12:32.273936] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:12:32.293218] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-18T17:12:32.340553] [DEBUG] [LOCAL ] AMBP: Loaded 45300 existing records from primary storage. [2025-09-18T17:12:32.340776] [INFO ] [MAIN ] AMBP: Loaded 45300 existing records. [2025-09-18T17:12:32.522627] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-09-18T17:12:32.526052] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:12:32.527339] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-18T17:12:32.527397] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-18T17:12:32.528614] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-18T17:12:32.528698] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-18T17:12:32.909494] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:12:33.319577] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-09-18T17:12:34.119567] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-18T17:12:34.533419] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-18T17:12:34.647118] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-18T17:12:34.649042] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-18T17:12:34.919548] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-11. [2025-09-18T17:12:35.719562] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-18T17:12:36.200760] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-18T17:12:36.519566] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-18T17:12:36.551753] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-18T17:12:37.319573] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-09-18T17:12:37.914383] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-18T17:12:38.119564] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-18T17:12:38.540704] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-18T17:12:38.919542] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-18T17:12:39.276877] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-18T17:12:39.322612] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-18T17:12:39.719549] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-18T17:12:40.167774] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-18T17:12:40.519539] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-18T17:12:41.319591] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-18T17:12:41.372298] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-18T17:12:42.119596] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-09-18T17:12:42.640581] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-18T17:12:42.919563] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-18T17:12:43.348003] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-18T17:12:43.676145] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-18T17:12:43.719592] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-18T17:12:44.519607] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-18T17:12:44.981937] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-18T17:12:45.319563] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-18T17:12:45.460816] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-18T17:12:46.119548] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-18T17:12:46.732134] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-18T17:12:46.741422] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T17:12:46.743128] [INFO ] [REMOTE ] ALX: Full fetch complete (6672 records). [2025-09-18T17:12:46.743200] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-18T17:12:46.921970] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-18T17:12:47.114142] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-18T17:12:47.114250] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-18T17:12:47.114460] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-18T17:12:47.114521] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-18T17:12:47.114999] [DEBUG] [LOCAL ] ALX: Trimmed 6672 records to 5828 (keeping 200 days of data) [2025-09-18T17:12:47.152455] [DEBUG] [LOCAL ] ALX: Primary data saved (5828 records). [2025-09-18T17:12:47.152576] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-18T17:12:47.152682] [INFO ] [MAIN ] Update Progress: 92/2372 symbols completed. ALX took 40.5s. Estimated remaining: 5h 15m 27s. Rate: 7.2 symbols/min [2025-09-18T17:12:47.321758] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:12:47.321946] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-18T17:12:47.322022] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-18T17:12:47.322173] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-18T17:12:47.322216] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-18T17:12:47.322257] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-18T17:12:47.322289] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-18T17:12:47.685918] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:12:47.719513] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-18T17:12:47.984060] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-18T17:12:48.519702] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-11. [2025-09-18T17:12:48.726475] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:12:48.726756] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-11 [2025-09-18T17:12:49.319615] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-18T17:12:49.371799] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-18T17:12:50.119593] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-18T17:12:50.770427] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-18T17:12:50.919636] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-18T17:12:51.123256] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:12:51.123738] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-18T17:12:51.719579] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-09-18T17:12:51.823020] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-18T17:12:51.950341] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:12:51.950841] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-09-18T17:12:52.519554] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-18T17:12:53.319566] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-18T17:12:54.119560] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-02. [2025-09-18T17:12:54.175166] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T17:12:54.353220] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:12:54.353594] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-02 [2025-09-18T17:12:54.852712] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-18T17:12:54.919500] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-18T17:12:55.719577] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-18T17:12:56.239375] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T17:12:56.519556] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-03. [2025-09-18T17:12:56.723227] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:12:56.723686] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-03 [2025-09-18T17:12:57.015519] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-18T17:12:57.319558] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-18T17:12:58.119558] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-18T17:12:58.700808] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T17:12:58.919587] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-18T17:12:59.719594] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-18T17:12:59.864995] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-18T17:12:59.948180] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-18T17:13:00.519567] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-18T17:13:01.143295] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-18T17:13:01.319613] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-18T17:13:01.540763] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-18T17:13:01.545385] [INFO ] [REMOTE ] AMBC: Full fetch complete (50994 records). [2025-09-18T17:13:01.545523] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-18T17:13:01.937494] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-18T17:13:01.937580] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-18T17:13:01.938171] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-18T17:13:01.938238] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-18T17:13:01.939467] [DEBUG] [LOCAL ] AMBC: Trimmed 50994 records to 37906 (keeping 200 days of data) [2025-09-18T17:13:02.125065] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-04. [2025-09-18T17:13:02.155801] [DEBUG] [LOCAL ] AMBC: Primary data saved (37906 records). [2025-09-18T17:13:02.155951] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-18T17:13:02.156034] [INFO ] [MAIN ] Update Progress: 93/2372 symbols completed. AMBC took 34.6s. Estimated remaining: 5h 18m 3s. Rate: 7.2 symbols/min [2025-09-18T17:13:02.332088] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:13:02.386807] [DEBUG] [LOCAL ] AMC: Loaded 53757 existing records from primary storage. [2025-09-18T17:13:02.387034] [INFO ] [MAIN ] AMC: Loaded 53757 existing records. [2025-09-18T17:13:02.418433] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:13:02.424114] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-04 [2025-09-18T17:13:02.579363] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-18T17:13:02.609215] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:13:02.609934] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-18T17:13:02.610005] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-18T17:13:02.611391] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-18T17:13:02.611461] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-18T17:13:02.932459] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-18T17:13:02.975356] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:13:03.719576] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-18T17:13:04.519610] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-11. [2025-09-18T17:13:04.740846] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-18T17:13:05.319612] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-18T17:13:05.455591] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-18T17:13:06.119547] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-18T17:13:06.662614] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-11 (2.14 seconds). [2025-09-18T17:13:06.796104] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-18T17:13:06.803134] [INFO ] [REMOTE ] AM: Full fetch complete (75457 records). [2025-09-18T17:13:06.803266] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-18T17:13:06.924625] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-05. [2025-09-18T17:13:07.158129] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:13:07.165755] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-05 [2025-09-18T17:13:07.206989] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-18T17:13:07.207081] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-18T17:13:07.207945] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-18T17:13:07.208015] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-18T17:13:07.209627] [DEBUG] [LOCAL ] AM: Trimmed 75457 records to 52557 (keeping 200 days of data) [2025-09-18T17:13:07.543671] [DEBUG] [LOCAL ] AM: Primary data saved (52557 records). [2025-09-18T17:13:07.543852] [INFO ] [MAIN ] AM: Full history saved. [2025-09-18T17:13:07.546233] [INFO ] [MAIN ] Update Progress: 94/2372 symbols completed. AM took 46.5s. Estimated remaining: 5h 16m 43s. Rate: 7.2 symbols/min [2025-09-18T17:13:07.722969] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-06. [2025-09-18T17:13:07.726548] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:13:07.755745] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T17:13:07.823806] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-09-18T17:13:07.824021] [INFO ] [MAIN ] AMCR: Loaded 53669 existing records. [2025-09-18T17:13:07.973476] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:13:08.012857] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-06 [2025-09-18T17:13:08.020117] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:13:08.020629] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-18T17:13:08.020746] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-18T17:13:08.022916] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-18T17:13:08.022983] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-18T17:13:08.375536] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:13:08.519514] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-11. [2025-09-18T17:13:09.319551] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-09-18T17:13:10.119591] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-18T17:13:10.507851] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-18T17:13:10.919565] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-07. [2025-09-18T17:13:11.411862] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-18T17:13:11.411708] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-18T17:13:11.507863] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-18T17:13:11.513924] [INFO ] [REMOTE ] AMBP: Full fetch complete (65919 records). [2025-09-18T17:13:11.514232] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-18T17:13:11.724620] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-09-18T17:13:11.912809] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-18T17:13:11.912901] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-18T17:13:11.913598] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-18T17:13:11.913665] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-18T17:13:11.915109] [DEBUG] [LOCAL ] AMBP: Trimmed 65919 records to 45660 (keeping 200 days of data) [2025-09-18T17:13:12.183458] [DEBUG] [LOCAL ] AMBP: Primary data saved (45660 records). [2025-09-18T17:13:12.183597] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-18T17:13:12.183721] [INFO ] [MAIN ] Update Progress: 95/2372 symbols completed. AMBP took 40.1s. Estimated remaining: 5h 15m 5s. Rate: 7.2 symbols/min [2025-09-18T17:13:12.363860] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:13:12.419597] [DEBUG] [LOCAL ] AME: Loaded 48614 existing records from primary storage. [2025-09-18T17:13:12.419766] [INFO ] [MAIN ] AME: Loaded 48614 existing records. [2025-09-18T17:13:12.523503] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-08. [2025-09-18T17:13:12.650786] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:13:12.651047] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-18T17:13:12.651097] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-18T17:13:12.652747] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-18T17:13:12.652809] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-18T17:13:13.014819] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:13:13.174134] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-18T17:13:13.319509] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-09-18T17:13:14.104804] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-18T17:13:14.119503] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-09. [2025-09-18T17:13:14.672130] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-18T17:13:14.919622] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-09-18T17:13:15.089233] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-18T17:13:15.093769] [INFO ] [REMOTE ] AMBQ: Full fetch complete (7318 records). [2025-09-18T17:13:15.093937] [DEBUG] [VALIDATOR ] AMBQ: Validating primary data. [2025-09-18T17:13:15.304877] [WARN ] [VALIDATOR ] AMBQ: Validation failed - insufficient historical data. Have 36 unique days, need 200 days [2025-09-18T17:13:15.305186] [FATAL] [MAIN ] AMBQ: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:13:15.305265] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:13:15.305348] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-18T17:13:15.305425] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-18T17:13:15.305466] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-18T17:13:15.305506] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-18T17:13:15.305576] [INFO ] [MAIN ] Update Progress: 96/2372 symbols completed. AMBQ took 28.2s. Estimated remaining: 5h 12m 54s. Rate: 7.3 symbols/min [2025-09-18T17:13:15.484505] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:13:15.507093] [DEBUG] [LOCAL ] AMG: Loaded 20838 existing records from primary storage. [2025-09-18T17:13:15.507233] [INFO ] [MAIN ] AMG: Loaded 20838 existing records. [2025-09-18T17:13:15.684341] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:13:15.684599] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-18T17:13:15.684671] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-18T17:13:15.685590] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-18T17:13:15.685695] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-18T17:13:15.728088] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-11. [2025-09-18T17:13:16.050169] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:13:16.519617] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-18T17:13:17.247197] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-18T17:13:17.319504] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-09-18T17:13:17.417285] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-09-18T17:13:17.897725] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T17:13:18.119605] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-18T17:13:18.610271] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-18T17:13:18.919607] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-11. [2025-09-18T17:13:19.722949] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-09-18T17:13:19.727564] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-18T17:13:20.150709] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-18T17:13:20.519577] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-18T17:13:20.993052] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-18T17:13:21.319560] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-18T17:13:22.119634] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-18T17:13:22.647381] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-18T17:13:22.919636] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-18T17:13:23.023569] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-18T17:13:23.719591] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-18T17:13:24.234322] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-18T17:13:24.519555] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-18T17:13:25.319598] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-09-18T17:13:25.508532] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-18T17:13:25.579116] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-18T17:13:26.015317] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-18T17:13:26.060492] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-18T17:13:26.119588] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-18T17:13:26.919547] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-18T17:13:27.518626] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-18T17:13:27.719509] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-18T17:13:28.519593] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-09-18T17:13:29.033734] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-18T17:13:29.319580] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-18T17:13:29.587365] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-18T17:13:29.612368] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-18T17:13:30.119606] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-18T17:13:30.799832] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T17:13:30.919573] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-18T17:13:31.719561] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-18T17:13:31.767161] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-18T17:13:32.519520] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-18T17:13:33.019754] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-18T17:13:33.046573] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T17:13:33.319632] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-18T17:13:34.119547] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-18T17:13:34.516063] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-18T17:13:34.919550] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-18T17:13:34.997734] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-18T17:13:35.488066] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-18T17:13:35.495602] [INFO ] [REMOTE ] AMCR: Full fetch complete (77513 records). [2025-09-18T17:13:35.495799] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-18T17:13:35.727561] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-18T17:13:35.916592] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-18T17:13:35.916711] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-18T17:13:35.917478] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-18T17:13:35.917563] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-18T17:13:35.920619] [DEBUG] [LOCAL ] AMCR: Trimmed 77513 records to 54059 (keeping 200 days of data) [2025-09-18T17:13:36.238824] [DEBUG] [LOCAL ] AMCR: Primary data saved (54059 records). [2025-09-18T17:13:36.238963] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-18T17:13:36.239769] [INFO ] [MAIN ] Update Progress: 97/2372 symbols completed. AMCR took 28.7s. Estimated remaining: 5h 17m 44s. Rate: 7.2 symbols/min [2025-09-18T17:13:36.414401] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:13:36.480306] [DEBUG] [LOCAL ] AMH: Loaded 51699 existing records from primary storage. [2025-09-18T17:13:36.480490] [INFO ] [MAIN ] AMH: Loaded 51699 existing records. [2025-09-18T17:13:36.544915] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-18T17:13:36.664957] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:13:36.665198] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-18T17:13:36.665246] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-18T17:13:36.667014] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-18T17:13:36.667092] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-18T17:13:36.973172] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-18T17:13:37.078480] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:13:37.144207] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-18T17:13:37.319553] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-18T17:13:37.962287] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-18T17:13:38.119577] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-18T17:13:38.919591] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-11. [2025-09-18T17:13:39.342397] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-18T17:13:39.470611] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-18T17:13:39.719533] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-18T17:13:40.519532] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-18T17:13:40.663501] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-18T17:13:40.737177] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-18T17:13:41.319583] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-18T17:13:42.124708] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-18T17:13:42.131384] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-18T17:13:42.682574] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-18T17:13:42.693080] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-09-18T17:13:42.693235] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-18T17:13:42.928138] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-09-18T17:13:43.096527] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-18T17:13:43.096606] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-18T17:13:43.097341] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-18T17:13:43.097414] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-18T17:13:43.098908] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 54147 (keeping 200 days of data) [2025-09-18T17:13:43.415639] [DEBUG] [LOCAL ] AMC: Primary data saved (54147 records). [2025-09-18T17:13:43.415820] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-18T17:13:43.415994] [INFO ] [MAIN ] Update Progress: 98/2372 symbols completed. AMC took 41.3s. Estimated remaining: 5h 17m 7s. Rate: 7.2 symbols/min [2025-09-18T17:13:43.587783] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:13:43.633190] [DEBUG] [LOCAL ] AMN: Loaded 42222 existing records from primary storage. [2025-09-18T17:13:43.633396] [INFO ] [MAIN ] AMN: Loaded 42222 existing records. [2025-09-18T17:13:43.726026] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-18T17:13:43.830340] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:13:43.830817] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-18T17:13:43.831020] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-18T17:13:43.840969] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-18T17:13:43.857978] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-18T17:13:43.916086] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-18T17:13:44.235195] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:13:44.519559] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-11. [2025-09-18T17:13:44.680520] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-18T17:13:44.787320] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-18T17:13:45.319600] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-09-18T17:13:46.119591] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-18T17:13:46.350919] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-18T17:13:46.874825] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-18T17:13:46.919604] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-18T17:13:47.023622] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-18T17:13:47.719544] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-18T17:13:47.741331] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-18T17:13:47.744749] [INFO ] [REMOTE ] AMG: Full fetch complete (29667 records). [2025-09-18T17:13:47.744858] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-18T17:13:48.121260] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-18T17:13:48.121336] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-18T17:13:48.121716] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-18T17:13:48.121780] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-18T17:13:48.122491] [DEBUG] [LOCAL ] AMG: Trimmed 29667 records to 21044 (keeping 200 days of data) [2025-09-18T17:13:48.269738] [DEBUG] [LOCAL ] AMG: Primary data saved (21044 records). [2025-09-18T17:13:48.270239] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-18T17:13:48.270472] [INFO ] [MAIN ] Update Progress: 99/2372 symbols completed. AMG took 33.0s. Estimated remaining: 5h 15m 38s. Rate: 7.2 symbols/min [2025-09-18T17:13:48.443773] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:13:48.492013] [DEBUG] [LOCAL ] AMP: Loaded 32920 existing records from primary storage. [2025-09-18T17:13:48.492153] [INFO ] [MAIN ] AMP: Loaded 32920 existing records. [2025-09-18T17:13:48.524680] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-18T17:13:48.674183] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:13:48.674446] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-18T17:13:48.674494] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-18T17:13:48.675634] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-18T17:13:48.675718] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-18T17:13:49.038794] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:13:49.137167] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-18T17:13:49.319562] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-11. [2025-09-18T17:13:50.119500] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-18T17:13:50.225407] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-18T17:13:50.517925] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-18T17:13:50.919578] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-09-18T17:13:51.475676] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-18T17:13:51.482394] [INFO ] [REMOTE ] AME: Full fetch complete (69498 records). [2025-09-18T17:13:51.482497] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-18T17:13:51.727137] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-18T17:13:51.926775] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-18T17:13:51.926877] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-18T17:13:51.927586] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-18T17:13:51.927632] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-18T17:13:51.929236] [DEBUG] [LOCAL ] AME: Trimmed 69498 records to 48968 (keeping 200 days of data) [2025-09-18T17:13:52.243097] [DEBUG] [LOCAL ] AME: Primary data saved (48968 records). [2025-09-18T17:13:52.243226] [INFO ] [MAIN ] AME: Full history saved. [2025-09-18T17:13:52.246774] [INFO ] [MAIN ] Update Progress: 100/2372 symbols completed. AME took 40.1s. Estimated remaining: 5h 13m 51s. Rate: 7.2 symbols/min [2025-09-18T17:13:52.420758] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:13:52.478701] [DEBUG] [LOCAL ] AMPX: Loaded 52068 existing records from primary storage. [2025-09-18T17:13:52.478845] [INFO ] [MAIN ] AMPX: Loaded 52068 existing records. [2025-09-18T17:13:52.524626] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-09-18T17:13:52.725096] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:13:52.725613] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-18T17:13:52.725712] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-18T17:13:52.727907] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-18T17:13:52.727970] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-18T17:13:52.877207] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-18T17:13:53.121308] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:13:53.319524] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-11. [2025-09-18T17:13:53.691235] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-18T17:13:53.759432] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T17:13:54.119541] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-09-18T17:13:54.745215] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T17:13:54.919555] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-09-18T17:13:55.242289] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-18T17:13:55.719573] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-09-18T17:13:56.170719] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T17:13:56.519554] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-18T17:13:57.319557] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-18T17:13:57.604667] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-18T17:13:58.119578] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-09-18T17:13:58.318803] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-18T17:13:58.573491] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T17:13:58.919562] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-18T17:13:59.719581] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-18T17:14:00.028157] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-18T17:14:00.125902] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-18T17:14:00.519585] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-18T17:14:01.244519] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-18T17:14:01.319539] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-18T17:14:01.978445] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-18T17:14:02.119576] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-18T17:14:02.919581] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-18T17:14:03.199045] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-18T17:14:03.240331] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-18T17:14:03.719550] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-18T17:14:04.459453] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-18T17:14:04.519504] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-18T17:14:05.193035] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-18T17:14:05.319592] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-18T17:14:06.119544] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-18T17:14:06.528400] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-18T17:14:06.560312] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T17:14:06.919609] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-18T17:14:07.524721] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-18T17:14:07.719582] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-18T17:14:08.401676] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-18T17:14:08.519592] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-18T17:14:08.939016] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-18T17:14:09.319560] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-18T17:14:10.119698] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-18T17:14:10.281597] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-18T17:14:10.899928] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-18T17:14:10.919499] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-18T17:14:11.505225] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-18T17:14:11.513110] [INFO ] [REMOTE ] AMH: Full fetch complete (74498 records). [2025-09-18T17:14:11.513278] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-18T17:14:11.728632] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-18T17:14:11.920840] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-18T17:14:11.920924] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-18T17:14:11.921632] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-18T17:14:11.921725] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-18T17:14:11.923234] [DEBUG] [LOCAL ] AMH: Trimmed 74498 records to 52077 (keeping 200 days of data) [2025-09-18T17:14:12.252744] [DEBUG] [LOCAL ] AMH: Primary data saved (52077 records). [2025-09-18T17:14:12.252934] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-18T17:14:12.253052] [INFO ] [MAIN ] Update Progress: 101/2372 symbols completed. AMH took 36.0s. Estimated remaining: 5h 18m 6s. Rate: 7.1 symbols/min [2025-09-18T17:14:12.429474] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:14:12.429691] [DEBUG] [LOCAL ] AMPY: No existing data file found in primary storage. [2025-09-18T17:14:12.429744] [WARN ] [MAIN ] AMPY: No existing data found, performing full refresh instead. [2025-09-18T17:14:12.429888] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-18T17:14:12.429950] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-18T17:14:12.429994] [DEBUG] [LOCAL ] AMPY: No primary data file found to delete. [2025-09-18T17:14:12.430026] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-18T17:14:12.526739] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-18T17:14:12.828596] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:14:12.925204] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-18T17:14:13.266495] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-18T17:14:13.319546] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-18T17:14:14.069982] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-18T17:14:14.119543] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-18T17:14:14.437369] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-18T17:14:14.919628] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-11. [2025-09-18T17:14:15.176015] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-18T17:14:15.719514] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-18T17:14:15.742708] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-18T17:14:16.519548] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-09-18T17:14:17.323580] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-18T17:14:17.327631] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-18T17:14:17.578528] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-18T17:14:18.119604] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-09-18T17:14:18.574134] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T17:14:18.919558] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-18T17:14:19.377032] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-18T17:14:19.719553] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-18T17:14:20.483514] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-18T17:14:20.519523] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-18T17:14:21.268247] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-18T17:14:21.275896] [INFO ] [REMOTE ] AMPX: Full fetch complete (74351 records). [2025-09-18T17:14:21.276073] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-18T17:14:21.331086] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-18T17:14:21.684176] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-18T17:14:21.684439] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-18T17:14:21.685247] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-18T17:14:21.685385] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-18T17:14:21.706330] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-18T17:14:21.706455] [DEBUG] [LOCAL ] AMPX: Trimmed 74351 records to 52458 (keeping 200 days of data) [2025-09-18T17:14:22.015824] [DEBUG] [LOCAL ] AMPX: Primary data saved (52458 records). [2025-09-18T17:14:22.015989] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-18T17:14:22.016080] [INFO ] [MAIN ] Update Progress: 102/2372 symbols completed. AMPX took 29.8s. Estimated remaining: 5h 18m 28s. Rate: 7.1 symbols/min [2025-09-18T17:14:22.119504] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-18T17:14:22.194926] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:14:22.229517] [DEBUG] [LOCAL ] AMR: Loaded 29290 existing records from primary storage. [2025-09-18T17:14:22.229695] [INFO ] [MAIN ] AMR: Loaded 29290 existing records. [2025-09-18T17:14:22.406703] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:14:22.406968] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-18T17:14:22.407016] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-18T17:14:22.408103] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-18T17:14:22.408165] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-18T17:14:22.815364] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:14:22.854512] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-18T17:14:22.919553] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-11. [2025-09-18T17:14:23.409568] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-18T17:14:23.719556] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-18T17:14:23.932886] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T17:14:24.519556] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-09-18T17:14:24.935337] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-18T17:14:24.941960] [INFO ] [REMOTE ] AMN: Full fetch complete (60438 records). [2025-09-18T17:14:24.942119] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-18T17:14:25.324607] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-18T17:14:25.378147] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-18T17:14:25.378257] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-18T17:14:25.379099] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-18T17:14:25.379172] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-18T17:14:25.380629] [DEBUG] [LOCAL ] AMN: Trimmed 60438 records to 42501 (keeping 200 days of data) [2025-09-18T17:14:25.641767] [DEBUG] [LOCAL ] AMN: Primary data saved (42501 records). [2025-09-18T17:14:25.641944] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-18T17:14:25.642057] [INFO ] [MAIN ] Update Progress: 103/2372 symbols completed. AMN took 42.2s. Estimated remaining: 5h 16m 34s. Rate: 7.2 symbols/min [2025-09-18T17:14:25.843531] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:14:25.863082] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T17:14:25.906060] [DEBUG] [LOCAL ] AMRC: Loaded 38695 existing records from primary storage. [2025-09-18T17:14:25.906242] [INFO ] [MAIN ] AMRC: Loaded 38695 existing records. [2025-09-18T17:14:26.094238] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:14:26.094592] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-18T17:14:26.094709] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-18T17:14:26.096586] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-18T17:14:26.096694] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-18T17:14:26.128145] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-09-18T17:14:26.503852] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:14:26.919552] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-11. [2025-09-18T17:14:26.998775] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-18T17:14:27.065049] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-18T17:14:27.719550] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-18T17:14:27.973434] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-18T17:14:28.519553] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-09-18T17:14:28.886248] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-18T17:14:29.319532] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-18T17:14:29.731189] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-18T17:14:30.119553] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-18T17:14:30.623241] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T17:14:30.919575] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-09-18T17:14:31.102489] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-18T17:14:31.719540] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-18T17:14:32.173448] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T17:14:32.519558] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-18T17:14:32.849816] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-18T17:14:32.854523] [INFO ] [REMOTE ] AMP: Full fetch complete (47552 records). [2025-09-18T17:14:32.854633] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-18T17:14:33.229786] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-18T17:14:33.229874] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-18T17:14:33.230388] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-18T17:14:33.230435] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-18T17:14:33.231474] [DEBUG] [LOCAL ] AMP: Trimmed 47552 records to 33159 (keeping 200 days of data) [2025-09-18T17:14:33.322844] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-18T17:14:33.448325] [DEBUG] [LOCAL ] AMP: Primary data saved (33159 records). [2025-09-18T17:14:33.448475] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-18T17:14:33.448561] [INFO ] [MAIN ] Update Progress: 104/2372 symbols completed. AMP took 45.2s. Estimated remaining: 5h 16m 13s. Rate: 7.2 symbols/min [2025-09-18T17:14:33.641707] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:14:33.642041] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-18T17:14:33.642261] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-18T17:14:33.642717] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-18T17:14:33.642834] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-18T17:14:33.642943] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-18T17:14:33.643031] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-18T17:14:33.807057] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-18T17:14:34.087533] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:14:34.119511] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-11. [2025-09-18T17:14:34.320693] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:14:34.321029] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-11 [2025-09-18T17:14:34.879379] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-18T17:14:34.919508] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-18T17:14:35.719545] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-18T17:14:36.320233] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:14:36.320616] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-18T17:14:36.346114] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-18T17:14:36.519585] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-18T17:14:37.319570] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-18T17:14:37.429896] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-18T17:14:37.434749] [INFO ] [REMOTE ] AMPY: Full fetch complete (49908 records). [2025-09-18T17:14:37.434875] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-18T17:14:37.831505] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-09-18T17:14:37.831601] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-09-18T17:14:37.832220] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-09-18T17:14:37.832286] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-09-18T17:14:37.833893] [DEBUG] [LOCAL ] AMPY: Trimmed 49908 records to 37679 (keeping 200 days of data) [2025-09-18T17:14:38.055979] [DEBUG] [LOCAL ] AMPY: Primary data saved (37679 records). [2025-09-18T17:14:38.056213] [INFO ] [MAIN ] AMPY: Full history saved. [2025-09-18T17:14:38.056364] [INFO ] [MAIN ] Update Progress: 105/2372 symbols completed. AMPY took 25.8s. Estimated remaining: 5h 14m 44s. Rate: 7.2 symbols/min [2025-09-18T17:14:38.124779] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-18T17:14:38.239176] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:14:38.299509] [DEBUG] [LOCAL ] AMT: Loaded 52461 existing records from primary storage. [2025-09-18T17:14:38.299693] [INFO ] [MAIN ] AMT: Loaded 52461 existing records. [2025-09-18T17:14:38.475169] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:14:38.475396] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-18T17:14:38.475445] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-18T17:14:38.477208] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-18T17:14:38.477269] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-18T17:14:38.842443] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:14:38.858755] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-18T17:14:38.919616] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-09-18T17:14:39.128570] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:14:39.128987] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-09-18T17:14:39.694442] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T17:14:39.719494] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-18T17:14:40.519559] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-18T17:14:40.852816] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-18T17:14:41.319559] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-11. [2025-09-18T17:14:41.479011] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-18T17:14:42.119549] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-18T17:14:42.919588] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-02. [2025-09-18T17:14:43.124507] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:14:43.124867] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-02 [2025-09-18T17:14:43.297356] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-11 (1.98 seconds). [2025-09-18T17:14:43.333088] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T17:14:43.719551] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-09-18T17:14:44.519585] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-18T17:14:45.211871] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T17:14:45.319584] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-03. [2025-09-18T17:14:45.464428] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-18T17:14:45.567013] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:14:45.567536] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-03 [2025-09-18T17:14:46.119595] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-04. [2025-09-18T17:14:46.318921] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:14:46.319248] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-04 [2025-09-18T17:14:46.919607] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-09-18T17:14:47.719579] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-18T17:14:48.519588] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-05. [2025-09-18T17:14:48.813759] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-18T17:14:48.855726] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-18T17:14:48.892582] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:14:48.892954] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-05 [2025-09-18T17:14:49.319562] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-18T17:14:50.119557] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-18T17:14:50.919567] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-06. [2025-09-18T17:14:51.078836] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-18T17:14:51.178155] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-18T17:14:51.634569] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T17:14:51.719503] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-18T17:14:52.519551] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-07. [2025-09-18T17:14:52.874215] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-18T17:14:52.880188] [INFO ] [REMOTE ] AMRC: Full fetch complete (52052 records). [2025-09-18T17:14:52.880330] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-18T17:14:53.328338] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-18T17:14:53.331218] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-18T17:14:53.332121] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-18T17:14:53.332719] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-18T17:14:53.332783] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-18T17:14:53.334061] [DEBUG] [LOCAL ] AMRC: Trimmed 52052 records to 39026 (keeping 200 days of data) [2025-09-18T17:14:53.560464] [DEBUG] [LOCAL ] AMRC: Primary data saved (39026 records). [2025-09-18T17:14:53.560717] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-18T17:14:53.560835] [INFO ] [MAIN ] Update Progress: 106/2372 symbols completed. AMRC took 27.9s. Estimated remaining: 5h 17m 9s. Rate: 7.1 symbols/min [2025-09-18T17:14:53.730279] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:14:53.751881] [DEBUG] [LOCAL ] AMTB: Loaded 20596 existing records from primary storage. [2025-09-18T17:14:53.752038] [INFO ] [MAIN ] AMTB: Loaded 20596 existing records. [2025-09-18T17:14:53.935318] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:14:53.935601] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-18T17:14:53.935685] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-18T17:14:53.936385] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-18T17:14:53.936448] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-18T17:14:54.129614] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-18T17:14:54.333930] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:14:54.410569] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-18T17:14:54.504000] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-18T17:14:54.919581] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-18T17:14:55.719516] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-11. [2025-09-18T17:14:55.795867] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T17:14:56.280392] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-18T17:14:56.519548] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-18T17:14:56.641044] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-18T17:14:57.319561] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-09-18T17:14:57.944967] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T17:14:58.016480] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-18T17:14:58.119543] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-18T17:14:58.919620] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-18T17:14:59.200872] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-18T17:14:59.719556] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-18T17:15:00.513320] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T17:15:00.523872] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-09-18T17:15:01.069607] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-18T17:15:01.074054] [INFO ] [REMOTE ] AMR: Full fetch complete (39292 records). [2025-09-18T17:15:01.074189] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-18T17:15:01.327492] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-18T17:15:01.483153] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-18T17:15:01.483288] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-18T17:15:01.483775] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-18T17:15:01.483892] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-18T17:15:01.506146] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-18T17:15:01.504907] [DEBUG] [LOCAL ] AMR: Trimmed 39292 records to 29544 (keeping 200 days of data) [2025-09-18T17:15:01.705338] [DEBUG] [LOCAL ] AMR: Primary data saved (29544 records). [2025-09-18T17:15:01.705510] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-18T17:15:01.705625] [INFO ] [MAIN ] Update Progress: 107/2372 symbols completed. AMR took 39.7s. Estimated remaining: 5h 16m 55s. Rate: 7.1 symbols/min [2025-09-18T17:15:01.896833] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:15:01.902673] [DEBUG] [LOCAL ] AMTD: Loaded 3497 existing records from primary storage. [2025-09-18T17:15:01.902813] [INFO ] [MAIN ] AMTD: Loaded 3497 existing records. [2025-09-18T17:15:02.089048] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:15:02.089342] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-18T17:15:02.089405] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-18T17:15:02.089698] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-18T17:15:02.089759] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-18T17:15:02.124696] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-08. [2025-09-18T17:15:02.456770] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:15:02.919568] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-18T17:15:03.383935] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-18T17:15:03.580758] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-18T17:15:03.728188] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-11. [2025-09-18T17:15:03.736177] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-18T17:15:04.310097] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-18T17:15:04.519603] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-09-18T17:15:05.186514] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-18T17:15:05.319568] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-18T17:15:05.995999] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-18T17:15:06.119549] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-18T17:15:06.919578] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-09. [2025-09-18T17:15:07.429030] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-18T17:15:07.719634] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-18T17:15:08.519618] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-09-18T17:15:08.855478] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-18T17:15:08.865934] [INFO ] [REMOTE ] AMRZ: Full fetch complete (23417 records). [2025-09-18T17:15:08.866111] [DEBUG] [VALIDATOR ] AMRZ: Validating primary data. [2025-09-18T17:15:09.066564] [WARN ] [VALIDATOR ] AMRZ: Validation failed - insufficient historical data. Have 62 unique days, need 200 days [2025-09-18T17:15:09.067073] [FATAL] [MAIN ] AMRZ: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:15:09.067155] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:15:09.067310] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-18T17:15:09.067417] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-18T17:15:09.067489] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-18T17:15:09.067595] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-18T17:15:09.067727] [INFO ] [MAIN ] Update Progress: 108/2372 symbols completed. AMRZ took 35.6s. Estimated remaining: 5h 16m 25s. Rate: 7.2 symbols/min [2025-09-18T17:15:09.228947] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-18T17:15:09.285795] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:15:09.323212] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-18T17:15:09.345717] [DEBUG] [LOCAL ] AMTM: Loaded 50741 existing records from primary storage. [2025-09-18T17:15:09.345904] [INFO ] [MAIN ] AMTM: Loaded 50741 existing records. [2025-09-18T17:15:09.538937] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:15:09.539596] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-18T17:15:09.539758] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-18T17:15:09.541481] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-09-18T17:15:09.541549] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-18T17:15:09.822297] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-18T17:15:09.820460] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-18T17:15:09.983182] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:15:10.119564] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-11. [2025-09-18T17:15:10.919572] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-18T17:15:11.385846] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-18T17:15:11.447815] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-18T17:15:11.719584] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-18T17:15:12.519558] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-18T17:15:12.835766] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-18T17:15:13.237183] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-18T17:15:13.319566] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-18T17:15:13.672760] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-18T17:15:14.119607] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-09-18T17:15:14.919612] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-18T17:15:15.719551] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-18T17:15:15.975800] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-18T17:15:15.998452] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-18T17:15:16.519581] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-09-18T17:15:17.135423] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-18T17:15:17.319592] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-18T17:15:18.007524] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T17:15:18.119498] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-18T17:15:18.768864] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T17:15:18.919565] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-18T17:15:19.480621] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-18T17:15:19.496747] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-18T17:15:19.719568] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-18T17:15:20.519560] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-18T17:15:21.178865] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T17:15:21.319553] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-18T17:15:22.119544] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-18T17:15:22.547119] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-18T17:15:22.591312] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-18T17:15:22.919568] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-18T17:15:22.991323] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-18T17:15:23.719572] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-18T17:15:24.519577] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-18T17:15:24.808098] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-18T17:15:24.816126] [INFO ] [REMOTE ] AMT: Full fetch complete (75849 records). [2025-09-18T17:15:24.816316] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-18T17:15:25.241708] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-18T17:15:25.241857] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-18T17:15:25.242823] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-18T17:15:25.242994] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-18T17:15:25.244870] [DEBUG] [LOCAL ] AMT: Trimmed 75849 records to 52847 (keeping 200 days of data) [2025-09-18T17:15:25.276581] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T17:15:25.332780] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-18T17:15:25.413619] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-18T17:15:25.694568] [DEBUG] [LOCAL ] AMT: Primary data saved (52847 records). [2025-09-18T17:15:25.694787] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-18T17:15:25.694922] [INFO ] [MAIN ] Update Progress: 109/2372 symbols completed. AMT took 47.6s. Estimated remaining: 5h 19m 8s. Rate: 7.1 symbols/min [2025-09-18T17:15:25.839824] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-18T17:15:25.904308] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:15:25.915018] [DEBUG] [LOCAL ] AMWL: Loaded 8625 existing records from primary storage. [2025-09-18T17:15:25.915163] [INFO ] [MAIN ] AMWL: Loaded 8625 existing records. [2025-09-18T17:15:26.099423] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:15:26.099780] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-18T17:15:26.099924] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-18T17:15:26.100473] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-18T17:15:26.100540] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-18T17:15:26.124735] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-18T17:15:26.472840] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:15:26.919602] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-18T17:15:26.977973] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-18T17:15:27.719566] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-18T17:15:27.743204] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-18T17:15:27.745011] [INFO ] [REMOTE ] AMTD: Full fetch complete (5582 records). [2025-09-18T17:15:27.745086] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-18T17:15:28.113264] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-18T17:15:28.113346] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-18T17:15:28.113521] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-18T17:15:28.113559] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-18T17:15:28.113980] [DEBUG] [LOCAL ] AMTD: Trimmed 5582 records to 3564 (keeping 200 days of data) [2025-09-18T17:15:28.134613] [DEBUG] [LOCAL ] AMTD: Primary data saved (3564 records). [2025-09-18T17:15:28.134725] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-18T17:15:28.134839] [INFO ] [MAIN ] Update Progress: 110/2372 symbols completed. AMTD took 26.4s. Estimated remaining: 5h 16m 56s. Rate: 7.1 symbols/min [2025-09-18T17:15:28.303025] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:15:28.357995] [DEBUG] [LOCAL ] AMX: Loaded 49066 existing records from primary storage. [2025-09-18T17:15:28.358155] [INFO ] [MAIN ] AMX: Loaded 49066 existing records. [2025-09-18T17:15:28.524848] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-11. [2025-09-18T17:15:28.572844] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:15:28.573203] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-18T17:15:28.573269] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-18T17:15:28.575063] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-18T17:15:28.575149] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-18T17:15:28.766045] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-18T17:15:28.847865] [INFO ] [REMOTE ] AMTB: Full fetch complete (30377 records). [2025-09-18T17:15:28.859724] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-18T17:15:29.105367] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:15:29.325526] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-11. [2025-09-18T17:15:29.342934] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-18T17:15:29.383782] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-18T17:15:29.383876] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-18T17:15:29.384303] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-18T17:15:29.384380] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-18T17:15:29.385597] [DEBUG] [LOCAL ] AMTB: Trimmed 30377 records to 20824 (keeping 200 days of data) [2025-09-18T17:15:29.533132] [DEBUG] [LOCAL ] AMTB: Primary data saved (20824 records). [2025-09-18T17:15:29.533302] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-18T17:15:29.533490] [INFO ] [MAIN ] Update Progress: 111/2372 symbols completed. AMTB took 36.0s. Estimated remaining: 5h 14m 24s. Rate: 7.2 symbols/min [2025-09-18T17:15:29.707391] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:15:29.707604] [DEBUG] [LOCAL ] AN: No existing data file found in primary storage. [2025-09-18T17:15:29.707685] [WARN ] [MAIN ] AN: No existing data found, performing full refresh instead. [2025-09-18T17:15:29.707840] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-18T17:15:29.707924] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-18T17:15:29.707990] [DEBUG] [LOCAL ] AN: No primary data file found to delete. [2025-09-18T17:15:29.708029] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-18T17:15:30.071929] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:15:30.119553] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-11. [2025-09-18T17:15:30.919570] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-09-18T17:15:31.005561] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-18T17:15:31.332801] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-18T17:15:31.719573] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-18T17:15:31.758790] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T17:15:32.519551] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-09-18T17:15:33.255786] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T17:15:33.319557] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-18T17:15:34.067816] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-18T17:15:34.119537] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-09-18T17:15:34.857606] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-18T17:15:34.919541] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-18T17:15:35.084844] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-18T17:15:35.719587] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-09-18T17:15:36.290274] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-18T17:15:36.518406] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-18T17:15:36.520900] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-09-18T17:15:37.319582] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-18T17:15:38.119563] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-18T17:15:38.240976] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-18T17:15:38.645859] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T17:15:38.654374] [INFO ] [REMOTE ] AMTM: Full fetch complete (73765 records). [2025-09-18T17:15:38.654783] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-18T17:15:38.927362] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-18T17:15:39.128617] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-09-18T17:15:39.128849] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-09-18T17:15:39.129905] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-09-18T17:15:39.129995] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-09-18T17:15:39.133485] [DEBUG] [LOCAL ] AMTM: Trimmed 73765 records to 51128 (keeping 200 days of data) [2025-09-18T17:15:39.216162] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-18T17:15:39.496349] [DEBUG] [LOCAL ] AMTM: Primary data saved (51128 records). [2025-09-18T17:15:39.496585] [INFO ] [MAIN ] AMTM: Full history saved. [2025-09-18T17:15:39.496728] [INFO ] [MAIN ] Update Progress: 112/2372 symbols completed. AMTM took 30.4s. Estimated remaining: 5h 14m 49s. Rate: 7.2 symbols/min [2025-09-18T17:15:39.697075] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:15:39.723777] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-18T17:15:39.722890] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-09-18T17:15:39.775563] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-09-18T17:15:39.775823] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-09-18T17:15:39.979967] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:15:39.980744] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-18T17:15:39.980808] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-18T17:15:39.982608] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-18T17:15:39.982701] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-18T17:15:40.377332] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:15:40.519692] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-18T17:15:41.289822] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-18T17:15:41.319534] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-18T17:15:41.837278] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T17:15:42.119557] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-18T17:15:42.561049] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-18T17:15:42.745801] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T17:15:42.919548] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-11. [2025-09-18T17:15:43.719590] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-18T17:15:44.286703] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-18T17:15:44.519525] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-18T17:15:44.676924] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-18T17:15:45.292957] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-18T17:15:45.319535] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-18T17:15:46.027918] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-18T17:15:46.119561] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-18T17:15:46.919546] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-09-18T17:15:47.719578] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-18T17:15:47.907283] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-18T17:15:48.519560] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-18T17:15:48.870856] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-18T17:15:49.018818] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-18T17:15:49.319517] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-18T17:15:49.386428] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-18T17:15:50.119604] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-09-18T17:15:50.787332] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-18T17:15:50.919608] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-18T17:15:51.719620] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-18T17:15:52.301058] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-18T17:15:52.346465] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T17:15:52.387418] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-18T17:15:52.519533] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-18T17:15:53.087878] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-18T17:15:53.090274] [INFO ] [REMOTE ] AMWL: Full fetch complete (13988 records). [2025-09-18T17:15:53.090347] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-18T17:15:53.327774] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-18T17:15:53.502634] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-18T17:15:53.502774] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-18T17:15:53.503059] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-18T17:15:53.503105] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-18T17:15:53.503787] [DEBUG] [LOCAL ] AMWL: Trimmed 13988 records to 8740 (keeping 200 days of data) [2025-09-18T17:15:53.562109] [DEBUG] [LOCAL ] AMWL: Primary data saved (8740 records). [2025-09-18T17:15:53.562266] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-18T17:15:53.562359] [INFO ] [MAIN ] Update Progress: 113/2372 symbols completed. AMWL took 27.9s. Estimated remaining: 5h 16m 34s. Rate: 7.1 symbols/min [2025-09-18T17:15:53.741034] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:15:53.813102] [DEBUG] [LOCAL ] ANF: Loaded 52287 existing records from primary storage. [2025-09-18T17:15:53.813270] [INFO ] [MAIN ] ANF: Loaded 52287 existing records. [2025-09-18T17:15:53.990760] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:15:53.991032] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-18T17:15:53.991080] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-18T17:15:53.993464] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-18T17:15:53.993526] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-18T17:15:54.124730] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-18T17:15:54.364669] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:15:54.768868] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-18T17:15:54.919570] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-11. [2025-09-18T17:15:55.719598] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-18T17:15:56.461092] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-18T17:15:56.519575] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-09-18T17:15:56.604611] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-18T17:15:57.015501] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T17:15:57.319585] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-18T17:15:58.119628] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-18T17:15:58.173444] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-18T17:15:58.555698] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-18T17:15:58.919584] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-18T17:15:59.141181] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-18T17:15:59.719673] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-09-18T17:16:00.519576] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-18T17:16:00.637840] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-18T17:16:01.259732] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-18T17:16:01.319580] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-18T17:16:02.119567] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-18T17:16:02.661814] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-18T17:16:02.672550] [INFO ] [REMOTE ] AMX: Full fetch complete (70660 records). [2025-09-18T17:16:02.672803] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-18T17:16:02.931521] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-18T17:16:03.111580] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-18T17:16:03.111867] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-18T17:16:03.112707] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-18T17:16:03.112810] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-18T17:16:03.114755] [DEBUG] [LOCAL ] AMX: Trimmed 70660 records to 49447 (keeping 200 days of data) [2025-09-18T17:16:03.150165] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-18T17:16:03.432535] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-18T17:16:03.507264] [DEBUG] [LOCAL ] AMX: Primary data saved (49447 records). [2025-09-18T17:16:03.507434] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-18T17:16:03.507543] [INFO ] [MAIN ] Update Progress: 114/2372 symbols completed. AMX took 35.4s. Estimated remaining: 5h 16m 56s. Rate: 7.1 symbols/min [2025-09-18T17:16:03.693318] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:16:03.693574] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-18T17:16:03.693634] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-18T17:16:03.693822] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-18T17:16:03.693867] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-18T17:16:03.693910] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-18T17:16:03.693944] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-18T17:16:03.729770] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-18T17:16:04.095936] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:16:04.384010] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T17:16:04.519586] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-18T17:16:05.319753] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-11. [2025-09-18T17:16:05.495505] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-18T17:16:05.521030] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:16:05.521419] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-11 [2025-09-18T17:16:05.730147] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-18T17:16:06.119591] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-18T17:16:06.340832] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:16:06.341229] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-18T17:16:06.919596] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-09-18T17:16:07.143395] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:16:07.143856] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-09-18T17:16:07.719586] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-18T17:16:08.519596] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-18T17:16:09.319588] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-02. [2025-09-18T17:16:09.529254] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:16:09.529559] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-02 [2025-09-18T17:16:09.755502] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-18T17:16:10.119590] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-03. [2025-09-18T17:16:10.332611] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:16:10.332993] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-03 [2025-09-18T17:16:10.493236] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-18T17:16:10.919555] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-18T17:16:11.719558] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-04. [2025-09-18T17:16:11.918208] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:16:11.918549] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-04 [2025-09-18T17:16:12.519559] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-18T17:16:13.319609] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-05. [2025-09-18T17:16:13.426816] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-18T17:16:13.506229] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:16:13.506626] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-05 [2025-09-18T17:16:14.119534] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-18T17:16:14.166095] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-18T17:16:14.919549] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-18T17:16:15.204002] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-18T17:16:15.208282] [INFO ] [REMOTE ] AN: Full fetch complete (47581 records). [2025-09-18T17:16:15.208407] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-18T17:16:15.209136] [FATAL] [VALIDATOR ] AN: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:16:15.209225] [FATAL] [MAIN ] AN: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:16:15.209294] [WARN ] [MAIN ] AN: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:16:15.209378] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-18T17:16:15.209495] [DEBUG] [LOCAL ] AN: No primary data file found to delete. [2025-09-18T17:16:15.209539] [INFO ] [LOCAL ] AN: Starting deletion of derivative data. [2025-09-18T17:16:15.209581] [DEBUG] [LOCAL ] AN: No derivative data file found to delete. [2025-09-18T17:16:15.209640] [INFO ] [MAIN ] Update Progress: 115/2372 symbols completed. AN took 45.7s. Estimated remaining: 5h 17m 52s. Rate: 7.1 symbols/min [2025-09-18T17:16:15.385278] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:16:15.407740] [DEBUG] [LOCAL ] ANRO: Loaded 20319 existing records from primary storage. [2025-09-18T17:16:15.407903] [INFO ] [MAIN ] ANRO: Loaded 20319 existing records. [2025-09-18T17:16:15.602158] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:16:15.602397] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-18T17:16:15.602447] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-18T17:16:15.603031] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-18T17:16:15.603100] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-18T17:16:15.724780] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-06. [2025-09-18T17:16:15.975507] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:16:15.979759] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-06 [2025-09-18T17:16:15.979611] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:16:16.519549] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-11. [2025-09-18T17:16:16.964960] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-18T17:16:17.319555] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-07. [2025-09-18T17:16:17.522378] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:16:17.522723] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-07 [2025-09-18T17:16:17.587800] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-18T17:16:18.119545] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-08. [2025-09-18T17:16:18.478937] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:16:18.479258] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-08 [2025-09-18T17:16:18.919577] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-09. [2025-09-18T17:16:19.719543] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-18T17:16:20.118013] [INFO ] [REMOTE ] ANGX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-18T17:16:20.123350] [INFO ] [REMOTE ] ANGX: Full fetch complete (2075 records). [2025-09-18T17:16:20.123527] [DEBUG] [VALIDATOR ] ANGX: Validating primary data. [2025-09-18T17:16:20.412904] [WARN ] [VALIDATOR ] ANGX: Validation failed - insufficient historical data. Have 6 unique days, need 200 days [2025-09-18T17:16:20.414215] [FATAL] [MAIN ] ANGX: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:16:20.414350] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:16:20.414449] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-18T17:16:20.414555] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-18T17:16:20.414623] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-18T17:16:20.414769] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-18T17:16:20.414903] [INFO ] [MAIN ] Update Progress: 116/2372 symbols completed. ANGX took 16.9s. Estimated remaining: 5h 16m 41s. Rate: 7.1 symbols/min [2025-09-18T17:16:20.524807] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-18T17:16:20.714518] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:16:20.748908] [DEBUG] [LOCAL ] ANVS: Loaded 23443 existing records from primary storage. [2025-09-18T17:16:20.749255] [INFO ] [MAIN ] ANVS: Loaded 23443 existing records. [2025-09-18T17:16:21.031288] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:16:21.031666] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-18T17:16:21.031749] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-18T17:16:21.032459] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-18T17:16:21.032522] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-18T17:16:21.325445] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-09-18T17:16:21.410155] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:16:21.563035] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-18T17:16:22.119579] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-18T17:16:22.260782] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-18T17:16:22.754016] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-18T17:16:22.919561] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-09-18T17:16:23.689902] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-18T17:16:23.717576] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-18T17:16:23.722154] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-11. [2025-09-18T17:16:24.519564] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-18T17:16:24.930451] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-18T17:16:25.292614] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-18T17:16:25.319566] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-18T17:16:26.119562] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-18T17:16:26.834871] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-18T17:16:26.919562] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-09-18T17:16:27.048828] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-18T17:16:27.719553] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-18T17:16:27.828972] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-18T17:16:28.519562] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-09-18T17:16:28.942949] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-18T17:16:29.319548] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-18T17:16:29.533772] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-18T17:16:30.060415] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-18T17:16:30.119592] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-18T17:16:30.919562] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-18T17:16:31.719578] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-18T17:16:32.267879] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-18T17:16:32.275402] [INFO ] [REMOTE ] ANF: Full fetch complete (75521 records). [2025-09-18T17:16:32.275564] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-18T17:16:32.543943] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-18T17:16:32.680559] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-18T17:16:32.680682] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-18T17:16:32.681491] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-18T17:16:32.681553] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-18T17:16:32.683164] [DEBUG] [LOCAL ] ANF: Trimmed 75521 records to 52666 (keeping 200 days of data) [2025-09-18T17:16:32.891338] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-18T17:16:32.981397] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-18T17:16:33.081775] [DEBUG] [LOCAL ] ANF: Primary data saved (52666 records). [2025-09-18T17:16:33.081915] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-18T17:16:33.081999] [INFO ] [MAIN ] Update Progress: 117/2372 symbols completed. ANF took 39.5s. Estimated remaining: 5h 17m 54s. Rate: 7.1 symbols/min [2025-09-18T17:16:33.319543] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-18T17:16:33.627455] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-18T17:16:34.119557] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-18T17:16:34.736375] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-18T17:16:34.919621] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-18T17:16:35.486942] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-18T17:16:35.719514] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-18T17:16:35.805906] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-18T17:16:35.813054] [INFO ] [REMOTE ] ANET: Full fetch complete (77313 records). [2025-09-18T17:16:35.813224] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-18T17:16:35.814161] [FATAL] [VALIDATOR ] ANET: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:16:35.814266] [FATAL] [MAIN ] ANET: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:16:35.814312] [WARN ] [MAIN ] ANET: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:16:35.814350] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-18T17:16:35.814409] [DEBUG] [LOCAL ] ANET: No primary data file found to delete. [2025-09-18T17:16:35.814447] [INFO ] [LOCAL ] ANET: Starting deletion of derivative data. [2025-09-18T17:16:35.815763] [DEBUG] [LOCAL ] ANET: Deleted derivative data file. [2025-09-18T17:16:35.815868] [INFO ] [MAIN ] Update Progress: 118/2372 symbols completed. ANET took 56.3s. Estimated remaining: 5h 15m 56s. Rate: 7.1 symbols/min [2025-09-18T17:16:36.519786] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-18T17:16:36.666587] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-18T17:16:37.155513] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-18T17:16:37.158120] [INFO ] [REMOTE ] ANRO: Full fetch complete (30912 records). [2025-09-18T17:16:37.158237] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-18T17:16:37.327928] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-18T17:16:37.622897] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-18T17:16:37.623024] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-18T17:16:37.623714] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-18T17:16:37.623795] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-18T17:16:37.625207] [DEBUG] [LOCAL ] ANRO: Trimmed 30912 records to 20424 (keeping 200 days of data) [2025-09-18T17:16:37.747147] [DEBUG] [LOCAL ] ANRO: Primary data saved (20424 records). [2025-09-18T17:16:37.747288] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-18T17:16:37.747375] [INFO ] [MAIN ] Update Progress: 119/2372 symbols completed. ANRO took 22.5s. Estimated remaining: 5h 13m 45s. Rate: 7.2 symbols/min [2025-09-18T17:16:38.478347] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-18T17:16:38.483685] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-18T17:16:39.818392] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T17:16:39.824581] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-18T17:16:40.745966] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T17:16:40.753177] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-18T17:16:42.060451] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-18T17:16:42.069333] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-18T17:16:43.164929] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-18T17:16:43.169963] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-18T17:16:44.229760] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-18T17:16:44.232798] [INFO ] [REMOTE ] ANVS: Full fetch complete (37003 records). [2025-09-18T17:16:44.232898] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-18T17:16:44.652729] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-18T17:16:44.652881] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-18T17:16:44.653376] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-18T17:16:44.653428] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-18T17:16:44.654640] [DEBUG] [LOCAL ] ANVS: Trimmed 37003 records to 23530 (keeping 200 days of data) [2025-09-18T17:16:44.789554] [DEBUG] [LOCAL ] ANVS: Primary data saved (23530 records). [2025-09-18T17:16:44.789732] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-18T17:16:44.789852] [INFO ] [MAIN ] Update Progress: 120/2372 symbols completed. ANVS took 24.4s. Estimated remaining: 5h 13m 12s. Rate: 7.2 symbols/min [2025-09-18T17:16:45.401032] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:16:45.459065] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:16:45.532336] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:16:45.532613] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-18T17:16:45.532854] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-18T17:16:45.532711] [DEBUG] [LOCAL ] AOD: No existing data file found in primary storage. [2025-09-18T17:16:45.532997] [WARN ] [MAIN ] AOD: No existing data found, performing full refresh instead. [2025-09-18T17:16:45.528793] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:16:45.533804] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-18T17:16:45.533542] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-18T17:16:45.533940] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-18T17:16:45.534448] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-18T17:16:45.534533] [DEBUG] [LOCAL ] AOD: No primary data file found to delete. [2025-09-18T17:16:45.534599] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-18T17:16:45.534386] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-18T17:16:45.534743] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-18T17:16:45.782389] [DEBUG] [LOCAL ] AOMR: Loaded 17076 existing records from primary storage. [2025-09-18T17:16:45.848633] [INFO ] [MAIN ] AOMR: Loaded 17076 existing records. [2025-09-18T17:16:46.255791] [DEBUG] [LOCAL ] AON: Loaded 45682 existing records from primary storage. [2025-09-18T17:16:46.316072] [INFO ] [MAIN ] AON: Loaded 45682 existing records. [2025-09-18T17:16:46.379438] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:16:46.470953] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-11. [2025-09-18T17:16:46.516185] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:16:46.577323] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-18T17:16:46.596799] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-18T17:16:46.650268] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:16:46.650821] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-11. [2025-09-18T17:16:46.662345] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-18T17:16:46.662437] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-18T17:16:46.815748] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:16:46.808740] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:16:46.833454] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-18T17:16:46.844970] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-11 [2025-09-18T17:16:46.845418] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-18T17:16:46.845531] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-18T17:16:46.854563] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-18T17:16:46.859852] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-18T17:16:47.112853] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:16:47.190773] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-18T17:16:47.278455] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-09-18T17:16:47.444355] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:16:47.458310] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-11. [2025-09-18T17:16:47.572098] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:16:47.572427] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-11. [2025-09-18T17:16:47.621276] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:16:47.621596] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-09-18T17:16:47.622100] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-02. [2025-09-18T17:16:47.806613] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:16:47.807013] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-02 [2025-09-18T17:16:47.807497] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-03. [2025-09-18T17:16:48.000094] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-18T17:16:48.006434] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:16:48.006720] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-03 [2025-09-18T17:16:48.191969] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-18T17:16:48.519699] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-04. [2025-09-18T17:16:48.716588] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:16:48.716999] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-04 [2025-09-18T17:16:49.319522] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-05. [2025-09-18T17:16:49.411259] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-18T17:16:49.688483] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-18T17:16:50.119583] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-06. [2025-09-18T17:16:50.441141] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-18T17:16:50.919602] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-07. [2025-09-18T17:16:51.356715] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-18T17:16:51.719586] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-09-18T17:16:52.519557] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-09-18T17:16:52.562089] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T17:16:53.319589] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-08. [2025-09-18T17:16:53.627305] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-18T17:16:54.079566] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-18T17:16:54.119566] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-09-18T17:16:54.919576] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-09-18T17:16:55.418381] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-18T17:16:55.492530] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-18T17:16:55.719584] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-09-18T17:16:56.519506] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-18T17:16:56.995013] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-18T17:16:57.151565] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-18T17:16:57.319584] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-09. [2025-09-18T17:16:57.723883] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-18T17:16:57.724934] [INFO ] [REMOTE ] AOMD: Full fetch complete (1718 records). [2025-09-18T17:16:57.725007] [DEBUG] [VALIDATOR ] AOMD: Validating primary data. [2025-09-18T17:16:57.922207] [WARN ] [VALIDATOR ] AOMD: Validation failed - insufficient historical data. Have 80 unique days, need 200 days [2025-09-18T17:16:57.922460] [FATAL] [MAIN ] AOMD: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:16:57.922535] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:16:57.922610] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-18T17:16:57.922720] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-18T17:16:57.922780] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-18T17:16:57.922847] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-18T17:16:57.922959] [INFO ] [MAIN ] Update Progress: 121/2372 symbols completed. AOMD took 13.1s. Estimated remaining: 5h 14m 33s. Rate: 7.2 symbols/min [2025-09-18T17:16:58.118195] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:16:58.119527] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-18T17:16:58.155238] [DEBUG] [LOCAL ] AORT: Loaded 29956 existing records from primary storage. [2025-09-18T17:16:58.155399] [INFO ] [MAIN ] AORT: Loaded 29956 existing records. [2025-09-18T17:16:58.373743] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:16:58.374019] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-18T17:16:58.374107] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-18T17:16:58.375552] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-09-18T17:16:58.375613] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-18T17:16:58.776186] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:16:58.919557] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-09-18T17:16:58.998940] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-18T17:16:59.719540] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-18T17:17:00.332214] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-18T17:17:00.397387] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-18T17:17:00.519549] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-11. [2025-09-18T17:17:01.319552] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-18T17:17:01.864768] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-18T17:17:02.107725] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-18T17:17:02.119515] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-18T17:17:02.919545] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-18T17:17:03.002212] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-18T17:17:03.719612] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-09-18T17:17:04.483706] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-18T17:17:04.519494] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-18T17:17:04.538512] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-18T17:17:05.319551] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-18T17:17:05.877615] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-18T17:17:05.969430] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-18T17:17:06.119529] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-18T17:17:06.919598] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-18T17:17:07.582664] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T17:17:07.719543] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-09-18T17:17:08.121994] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-18T17:17:08.519512] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-18T17:17:08.605498] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-18T17:17:09.319518] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-18T17:17:09.357215] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-18T17:17:10.119573] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-18T17:17:10.919574] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-18T17:17:10.976371] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-18T17:17:11.049378] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-18T17:17:11.719551] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-18T17:17:12.107979] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-18T17:17:12.519626] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-18T17:17:12.865368] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-18T17:17:13.319597] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-18T17:17:13.791364] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-18T17:17:14.119553] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-18T17:17:14.242375] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-18T17:17:14.919565] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-18T17:17:15.458489] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-18T17:17:15.719535] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-18T17:17:15.860504] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-18T17:17:16.519549] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-18T17:17:16.590154] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-18T17:17:17.319554] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-18T17:17:17.364857] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-18T17:17:17.367674] [INFO ] [REMOTE ] AOMR: Full fetch complete (22989 records). [2025-09-18T17:17:17.367800] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-18T17:17:17.368488] [FATAL] [VALIDATOR ] AOMR: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:17:17.368593] [FATAL] [MAIN ] AOMR: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:17:17.368637] [WARN ] [MAIN ] AOMR: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:17:17.368876] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-18T17:17:17.368942] [DEBUG] [LOCAL ] AOMR: No primary data file found to delete. [2025-09-18T17:17:17.368978] [INFO ] [LOCAL ] AOMR: Starting deletion of derivative data. [2025-09-18T17:17:17.369395] [DEBUG] [LOCAL ] AOMR: Deleted derivative data file. [2025-09-18T17:17:17.369494] [INFO ] [MAIN ] Update Progress: 122/2372 symbols completed. AOMR took 32.6s. Estimated remaining: 5h 17m 49s. Rate: 7.1 symbols/min [2025-09-18T17:17:17.565602] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:17:17.615620] [DEBUG] [LOCAL ] AOS: Loaded 49460 existing records from primary storage. [2025-09-18T17:17:17.615788] [INFO ] [MAIN ] AOS: Loaded 49460 existing records. [2025-09-18T17:17:17.815086] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:17:17.815417] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-18T17:17:17.815472] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-18T17:17:17.818372] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-18T17:17:17.818436] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-18T17:17:18.124612] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-18T17:17:18.189717] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:17:18.210670] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-18T17:17:18.919556] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-11. [2025-09-18T17:17:19.524999] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-18T17:17:19.719559] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-18T17:17:20.210036] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-18T17:17:20.519564] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-18T17:17:20.686294] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-18T17:17:21.319547] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-18T17:17:22.119521] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-18T17:17:22.249289] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-18T17:17:22.483074] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-18T17:17:22.919562] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-18T17:17:23.108878] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-18T17:17:23.115432] [INFO ] [REMOTE ] AOD: Full fetch complete (43775 records). [2025-09-18T17:17:23.115601] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-18T17:17:23.116582] [FATAL] [VALIDATOR ] AOD: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:17:23.116717] [FATAL] [MAIN ] AOD: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:17:23.116797] [WARN ] [MAIN ] AOD: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:17:23.116891] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-18T17:17:23.116999] [DEBUG] [LOCAL ] AOD: No primary data file found to delete. [2025-09-18T17:17:23.117068] [INFO ] [LOCAL ] AOD: Starting deletion of derivative data. [2025-09-18T17:17:23.117133] [DEBUG] [LOCAL ] AOD: No derivative data file found to delete. [2025-09-18T17:17:23.117211] [INFO ] [MAIN ] Update Progress: 123/2372 symbols completed. AOD took 38.3s. Estimated remaining: 5h 16m 50s. Rate: 7.1 symbols/min [2025-09-18T17:17:23.299136] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:17:23.308451] [DEBUG] [LOCAL ] AP: Loaded 6801 existing records from primary storage. [2025-09-18T17:17:23.308603] [INFO ] [MAIN ] AP: Loaded 6801 existing records. [2025-09-18T17:17:23.503594] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:17:23.503867] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-18T17:17:23.503918] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-18T17:17:23.504560] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-09-18T17:17:23.504623] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-18T17:17:23.724746] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-18T17:17:23.886762] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:17:23.920021] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-18T17:17:24.519553] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-18T17:17:25.120109] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-18T17:17:25.319551] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-11. [2025-09-18T17:17:25.640487] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-18T17:17:26.119543] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-18T17:17:26.134012] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-18T17:17:26.919546] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-09-18T17:17:27.307673] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-18T17:17:27.336425] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-18T17:17:27.342798] [INFO ] [REMOTE ] AORT: Full fetch complete (41284 records). [2025-09-18T17:17:27.342972] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-18T17:17:27.343759] [FATAL] [VALIDATOR ] AORT: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:17:27.343879] [FATAL] [MAIN ] AORT: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:17:27.343974] [WARN ] [MAIN ] AORT: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:17:27.344076] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-18T17:17:27.344178] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-09-18T17:17:27.344236] [INFO ] [LOCAL ] AORT: Starting deletion of derivative data. [2025-09-18T17:17:27.344812] [DEBUG] [LOCAL ] AORT: Deleted derivative data file. [2025-09-18T17:17:27.344943] [INFO ] [MAIN ] Update Progress: 124/2372 symbols completed. AORT took 29.4s. Estimated remaining: 5h 15m 25s. Rate: 7.1 symbols/min [2025-09-18T17:17:27.553819] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:17:27.554128] [DEBUG] [LOCAL ] APAM: No existing data file found in primary storage. [2025-09-18T17:17:27.554186] [WARN ] [MAIN ] APAM: No existing data found, performing full refresh instead. [2025-09-18T17:17:27.554346] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-18T17:17:27.554391] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-18T17:17:27.554434] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-09-18T17:17:27.554468] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-18T17:17:27.723830] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-09-18T17:17:27.944520] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:17:28.196135] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-18T17:17:28.519549] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-18T17:17:29.319556] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-18T17:17:29.732437] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-18T17:17:29.891201] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-18T17:17:29.900764] [INFO ] [REMOTE ] AON: Full fetch complete (64748 records). [2025-09-18T17:17:29.900923] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-18T17:17:30.124687] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-09-18T17:17:30.319896] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-18T17:17:30.320011] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-18T17:17:30.320790] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-18T17:17:30.320882] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-18T17:17:30.322562] [DEBUG] [LOCAL ] AON: Trimmed 64748 records to 46012 (keeping 200 days of data) [2025-09-18T17:17:30.624798] [DEBUG] [LOCAL ] AON: Primary data saved (46012 records). [2025-09-18T17:17:30.624944] [INFO ] [MAIN ] AON: Full history saved. [2025-09-18T17:17:30.625034] [INFO ] [MAIN ] Update Progress: 125/2372 symbols completed. AON took 45.8s. Estimated remaining: 5h 13m 45s. Rate: 7.2 symbols/min [2025-09-18T17:17:30.793470] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:17:30.846451] [DEBUG] [LOCAL ] APD: Loaded 45572 existing records from primary storage. [2025-09-18T17:17:30.846601] [INFO ] [MAIN ] APD: Loaded 45572 existing records. [2025-09-18T17:17:30.924828] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-11. [2025-09-18T17:17:31.037275] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:17:31.037611] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-18T17:17:31.037699] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-18T17:17:31.043322] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-09-18T17:17:31.043403] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-18T17:17:31.436139] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:17:31.590028] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-18T17:17:31.719546] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-09-18T17:17:32.045840] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T17:17:32.519585] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-18T17:17:32.988225] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-18T17:17:33.154125] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-18T17:17:33.319548] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-09-18T17:17:34.119552] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-18T17:17:34.288492] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-18T17:17:34.919552] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-18T17:17:35.362426] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-18T17:17:35.719526] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-18T17:17:35.752988] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-18T17:17:36.351718] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-18T17:17:36.519549] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-11. [2025-09-18T17:17:37.319590] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-09-18T17:17:37.836020] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-18T17:17:38.119566] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-18T17:17:38.658438] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-18T17:17:38.919564] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-09-18T17:17:39.454526] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-18T17:17:39.719583] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-18T17:17:40.495219] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-18T17:17:40.519561] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-18T17:17:41.120362] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T17:17:41.319546] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-18T17:17:41.469592] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-18T17:17:42.119550] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-18T17:17:42.919549] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-09-18T17:17:43.114503] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-18T17:17:43.150243] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-18T17:17:43.719590] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-18T17:17:44.364522] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-18T17:17:44.519560] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-18T17:17:44.979464] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-18T17:17:45.090135] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-18T17:17:45.319555] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-18T17:17:46.119556] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-18T17:17:46.919565] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-18T17:17:46.973353] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-18T17:17:47.265159] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-18T17:17:47.719553] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-18T17:17:48.519566] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-18T17:17:48.633423] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-18T17:17:49.233894] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T17:17:49.319554] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-18T17:17:49.648421] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-18T17:17:50.119588] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-18T17:17:50.732790] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-18T17:17:50.919575] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-18T17:17:51.439188] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-18T17:17:51.719544] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-18T17:17:52.215317] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-18T17:17:52.519539] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-18T17:17:52.677519] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-18T17:17:53.319581] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-18T17:17:53.808765] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-18T17:17:54.119553] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-18T17:17:54.827953] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T17:17:54.834845] [INFO ] [REMOTE ] AOS: Full fetch complete (70643 records). [2025-09-18T17:17:54.834995] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-18T17:17:54.927612] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-18T17:17:55.243770] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-18T17:17:55.243889] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-18T17:17:55.244811] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-18T17:17:55.244900] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-18T17:17:55.251623] [DEBUG] [LOCAL ] AOS: Trimmed 70643 records to 49823 (keeping 200 days of data) [2025-09-18T17:17:55.509182] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-18T17:17:55.532324] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-18T17:17:55.609589] [DEBUG] [LOCAL ] AOS: Primary data saved (49823 records). [2025-09-18T17:17:55.609764] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-18T17:17:55.609905] [INFO ] [MAIN ] Update Progress: 126/2372 symbols completed. AOS took 38.2s. Estimated remaining: 5h 18m 32s. Rate: 7.1 symbols/min [2025-09-18T17:17:55.724606] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-18T17:17:55.780948] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:17:55.828406] [DEBUG] [LOCAL ] APG: Loaded 50240 existing records from primary storage. [2025-09-18T17:17:55.828548] [INFO ] [MAIN ] APG: Loaded 50240 existing records. [2025-09-18T17:17:56.006682] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:17:56.006968] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-18T17:17:56.007023] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-18T17:17:56.009692] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-09-18T17:17:56.009797] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-18T17:17:56.371774] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:17:56.519585] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-11. [2025-09-18T17:17:56.896065] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T17:17:57.319572] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-18T17:17:57.762758] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-18T17:17:58.119590] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-18T17:17:58.370730] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-18T17:17:58.870326] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-18T17:17:58.872371] [INFO ] [REMOTE ] AP: Full fetch complete (8587 records). [2025-09-18T17:17:58.872454] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-18T17:17:58.873018] [FATAL] [VALIDATOR ] AP: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:17:58.873130] [FATAL] [MAIN ] AP: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:17:58.873234] [WARN ] [MAIN ] AP: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:17:58.873335] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-18T17:17:58.873420] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-09-18T17:17:58.873459] [INFO ] [LOCAL ] AP: Starting deletion of derivative data. [2025-09-18T17:17:58.873986] [DEBUG] [LOCAL ] AP: Deleted derivative data file. [2025-09-18T17:17:58.874135] [INFO ] [MAIN ] Update Progress: 127/2372 symbols completed. AP took 35.8s. Estimated remaining: 5h 16m 51s. Rate: 7.1 symbols/min [2025-09-18T17:17:58.929363] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-09-18T17:17:59.052141] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:17:59.052488] [DEBUG] [LOCAL ] APH: No existing data file found in primary storage. [2025-09-18T17:17:59.052553] [WARN ] [MAIN ] APH: No existing data found, performing full refresh instead. [2025-09-18T17:17:59.052768] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-18T17:17:59.052823] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-18T17:17:59.052868] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-09-18T17:17:59.052903] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-18T17:17:59.433236] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:17:59.719543] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-18T17:18:00.159863] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T17:18:00.519557] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-18T17:18:01.317454] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-18T17:18:01.328300] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-11. [2025-09-18T17:18:02.119579] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-18T17:18:02.866780] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-18T17:18:02.874813] [INFO ] [REMOTE ] APAM: Full fetch complete (51517 records). [2025-09-18T17:18:02.874973] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-18T17:18:02.921735] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-09-18T17:18:03.284010] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-09-18T17:18:03.284268] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-09-18T17:18:03.284871] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-09-18T17:18:03.285094] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-09-18T17:18:03.287198] [DEBUG] [LOCAL ] APAM: Trimmed 51517 records to 37094 (keeping 200 days of data) [2025-09-18T17:18:03.316552] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-18T17:18:03.556425] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-18T17:18:03.597301] [DEBUG] [LOCAL ] APAM: Primary data saved (37094 records). [2025-09-18T17:18:03.597453] [INFO ] [MAIN ] APAM: Full history saved. [2025-09-18T17:18:03.597546] [INFO ] [MAIN ] Update Progress: 128/2372 symbols completed. APAM took 36.3s. Estimated remaining: 5h 15m 37s. Rate: 7.1 symbols/min [2025-09-18T17:18:03.724744] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-18T17:18:03.768566] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:18:03.826894] [DEBUG] [LOCAL ] APLE: Loaded 52075 existing records from primary storage. [2025-09-18T17:18:03.827047] [INFO ] [MAIN ] APLE: Loaded 52075 existing records. [2025-09-18T17:18:04.014255] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:18:04.014733] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-18T17:18:04.014819] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-18T17:18:04.017780] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-18T17:18:04.017842] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-18T17:18:04.373348] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:18:04.519579] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-11. [2025-09-18T17:18:04.605703] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-18T17:18:05.247047] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T17:18:05.257571] [INFO ] [REMOTE ] APD: Full fetch complete (66495 records). [2025-09-18T17:18:05.257879] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-18T17:18:05.329460] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-09-18T17:18:05.853839] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-09-18T17:18:05.854044] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-09-18T17:18:05.855431] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-09-18T17:18:05.855560] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-09-18T17:18:05.859477] [DEBUG] [LOCAL ] APD: Trimmed 66495 records to 45876 (keeping 200 days of data) [2025-09-18T17:18:06.056636] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-18T17:18:06.151842] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-09-18T17:18:06.262573] [DEBUG] [LOCAL ] APD: Primary data saved (45876 records). [2025-09-18T17:18:06.262748] [INFO ] [MAIN ] APD: Full history saved. [2025-09-18T17:18:06.262882] [INFO ] [MAIN ] Update Progress: 129/2372 symbols completed. APD took 35.6s. Estimated remaining: 5h 13m 48s. Rate: 7.1 symbols/min [2025-09-18T17:18:06.431364] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:18:06.493674] [DEBUG] [LOCAL ] APO: Loaded 53385 existing records from primary storage. [2025-09-18T17:18:06.493855] [INFO ] [MAIN ] APO: Loaded 53385 existing records. [2025-09-18T17:18:06.674928] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:18:06.675192] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-18T17:18:06.675241] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-18T17:18:06.678180] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-18T17:18:06.678284] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-18T17:18:06.925855] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-18T17:18:07.101447] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:18:07.182051] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-18T17:18:07.719547] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-09-18T17:18:07.869748] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-18T17:18:08.366090] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-18T17:18:08.519561] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-18T17:18:09.299753] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T17:18:09.319510] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-18T17:18:10.119569] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-11. [2025-09-18T17:18:10.307515] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-18T17:18:10.888285] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-18T17:18:10.919565] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-18T17:18:11.719535] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-09-18T17:18:12.172872] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-18T17:18:12.519541] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-09-18T17:18:12.568945] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-18T17:18:13.031764] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-18T17:18:13.319552] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-18T17:18:14.119591] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-18T17:18:14.414408] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-18T17:18:14.919568] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-18T17:18:14.960922] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T17:18:15.559551] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-18T17:18:15.719548] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-18T17:18:16.519562] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-18T17:18:16.828681] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-18T17:18:17.319564] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-18T17:18:17.557741] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-18T17:18:18.058781] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-18T17:18:18.119530] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-18T17:18:18.919551] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-09-18T17:18:19.036434] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-18T17:18:19.591027] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-18T17:18:19.719561] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-18T17:18:20.385028] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-18T17:18:20.519528] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-18T17:18:21.281114] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-18T17:18:21.319527] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-18T17:18:22.119547] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-18T17:18:22.482536] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-18T17:18:22.675749] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-18T17:18:22.919551] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-18T17:18:23.666390] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-18T17:18:23.719513] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-18T17:18:24.279486] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T17:18:24.519536] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-18T17:18:25.319548] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-18T17:18:26.119568] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-18T17:18:27.653726] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (3.93 seconds). [2025-09-18T17:18:27.666008] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-18T17:18:28.441837] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (3.92 seconds). [2025-09-18T17:18:28.452989] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-18T17:18:28.940079] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (3.62 seconds). [2025-09-18T17:18:28.951167] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-18T17:18:29.348916] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (3.23 seconds). [2025-09-18T17:18:29.360372] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-18T17:18:29.665234] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-18T17:18:30.119564] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-18T17:18:30.377949] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-18T17:18:30.385585] [INFO ] [REMOTE ] APG: Full fetch complete (71242 records). [2025-09-18T17:18:30.385772] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-18T17:18:30.684007] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-18T17:18:30.835864] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-09-18T17:18:30.835957] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-09-18T17:18:30.836662] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-09-18T17:18:30.836728] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-09-18T17:18:30.838250] [DEBUG] [LOCAL ] APG: Trimmed 71242 records to 50625 (keeping 200 days of data) [2025-09-18T17:18:30.930038] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-18T17:18:31.166583] [DEBUG] [LOCAL ] APG: Primary data saved (50625 records). [2025-09-18T17:18:31.166954] [INFO ] [MAIN ] APG: Full history saved. [2025-09-18T17:18:31.167061] [INFO ] [MAIN ] Update Progress: 130/2372 symbols completed. APG took 35.6s. Estimated remaining: 5h 18m 24s. Rate: 7.0 symbols/min [2025-09-18T17:18:31.282873] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-18T17:18:31.393457] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:18:31.406837] [DEBUG] [LOCAL ] APOS: Loaded 7464 existing records from primary storage. [2025-09-18T17:18:31.406987] [INFO ] [MAIN ] APOS: Loaded 7464 existing records. [2025-09-18T17:18:31.591177] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:18:31.591447] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-18T17:18:31.591496] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-18T17:18:31.592339] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-18T17:18:31.592401] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-18T17:18:31.724751] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-18T17:18:31.970343] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:18:32.179437] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-18T17:18:32.186848] [INFO ] [REMOTE ] APH: Full fetch complete (77519 records). [2025-09-18T17:18:32.186969] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-18T17:18:32.532399] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-11. [2025-09-18T17:18:32.583921] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-09-18T17:18:32.584123] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-09-18T17:18:32.584936] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-09-18T17:18:32.585039] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-09-18T17:18:32.587524] [DEBUG] [LOCAL ] APH: Trimmed 77519 records to 54081 (keeping 200 days of data) [2025-09-18T17:18:32.715529] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-18T17:18:32.975234] [DEBUG] [LOCAL ] APH: Primary data saved (54081 records). [2025-09-18T17:18:32.975405] [INFO ] [MAIN ] APH: Full history saved. [2025-09-18T17:18:32.975500] [INFO ] [MAIN ] Update Progress: 131/2372 symbols completed. APH took 34.1s. Estimated remaining: 5h 16m 21s. Rate: 7.1 symbols/min [2025-09-18T17:18:33.152439] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:18:33.206995] [DEBUG] [LOCAL ] APTV: Loaded 52265 existing records from primary storage. [2025-09-18T17:18:33.207173] [INFO ] [MAIN ] APTV: Loaded 52265 existing records. [2025-09-18T17:18:33.322427] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-18T17:18:33.396391] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:18:33.396949] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-18T17:18:33.403708] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-18T17:18:33.397228] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-18T17:18:33.408387] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-09-18T17:18:33.408468] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-18T17:18:33.748336] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-18T17:18:33.828347] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:18:34.119555] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-11. [2025-09-18T17:18:34.919715] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-18T17:18:35.206116] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-18T17:18:35.214000] [INFO ] [REMOTE ] APLE: Full fetch complete (74091 records). [2025-09-18T17:18:35.214138] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-18T17:18:35.635981] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-09-18T17:18:35.636160] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-09-18T17:18:35.637074] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-09-18T17:18:35.637240] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-09-18T17:18:35.639191] [DEBUG] [LOCAL ] APLE: Trimmed 74091 records to 52448 (keeping 200 days of data) [2025-09-18T17:18:35.728894] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-09-18T17:18:35.769966] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T17:18:36.031693] [DEBUG] [LOCAL ] APLE: Primary data saved (52448 records). [2025-09-18T17:18:36.031854] [INFO ] [MAIN ] APLE: Full history saved. [2025-09-18T17:18:36.031959] [INFO ] [MAIN ] Update Progress: 132/2372 symbols completed. APLE took 32.4s. Estimated remaining: 5h 14m 41s. Rate: 7.1 symbols/min [2025-09-18T17:18:36.203099] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:18:36.256930] [DEBUG] [LOCAL ] AQN: Loaded 51981 existing records from primary storage. [2025-09-18T17:18:36.257093] [INFO ] [MAIN ] AQN: Loaded 51981 existing records. [2025-09-18T17:18:36.449369] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:18:36.449731] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-18T17:18:36.449846] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-18T17:18:36.452525] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-18T17:18:36.452592] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-18T17:18:36.523368] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-09-18T17:18:36.604432] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T17:18:36.779734] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-18T17:18:36.870197] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:18:37.319565] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-09-18T17:18:37.713110] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-18T17:18:38.080990] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-18T17:18:38.119490] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-09-18T17:18:38.919552] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-18T17:18:39.416632] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-18T17:18:39.719589] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-18T17:18:40.122030] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-18T17:18:40.525250] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-18T17:18:40.531974] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-18T17:18:41.258260] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-18T17:18:41.319590] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-18T17:18:42.087253] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-18T17:18:42.119506] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-18T17:18:42.861129] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-18T17:18:42.919559] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-18T17:18:43.360906] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-18T17:18:43.719560] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-11. [2025-09-18T17:18:44.519566] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-18T17:18:45.319578] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-18T17:18:45.720681] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-18T17:18:46.119550] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-09-18T17:18:46.275626] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-18T17:18:46.651195] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T17:18:46.919549] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-18T17:18:47.719601] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-18T17:18:47.915587] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-18T17:18:48.235739] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-18T17:18:48.369274] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T17:18:48.376701] [INFO ] [REMOTE ] APO: Full fetch complete (77119 records). [2025-09-18T17:18:48.376847] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-18T17:18:48.524711] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-09-18T17:18:48.828416] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-18T17:18:48.828505] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-18T17:18:48.829291] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-18T17:18:48.829357] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-18T17:18:48.834097] [DEBUG] [LOCAL ] APO: Trimmed 77119 records to 53772 (keeping 200 days of data) [2025-09-18T17:18:49.196390] [DEBUG] [LOCAL ] APO: Primary data saved (53772 records). [2025-09-18T17:18:49.196546] [INFO ] [MAIN ] APO: Full history saved. [2025-09-18T17:18:49.196672] [INFO ] [MAIN ] Update Progress: 133/2372 symbols completed. APO took 42.9s. Estimated remaining: 5h 15m 52s. Rate: 7.1 symbols/min [2025-09-18T17:18:49.324725] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-18T17:18:49.372382] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:18:49.380439] [DEBUG] [LOCAL ] AQNB: Loaded 4234 existing records from primary storage. [2025-09-18T17:18:49.380955] [INFO ] [MAIN ] AQNB: Loaded 4234 existing records. [2025-09-18T17:18:49.566950] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:18:49.567229] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-18T17:18:49.567278] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-18T17:18:49.567681] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-09-18T17:18:49.567744] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-18T17:18:49.944309] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:18:49.973104] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-18T17:18:50.119524] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-18T17:18:50.919577] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-18T17:18:51.440118] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-18T17:18:51.687012] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-18T17:18:51.719771] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-18T17:18:51.727608] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-18T17:18:52.519556] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-18T17:18:53.187779] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-18T17:18:53.319507] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-18T17:18:54.119599] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-11. [2025-09-18T17:18:54.295044] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-18T17:18:54.566047] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-18T17:18:54.696281] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-18T17:18:54.919718] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-09-18T17:18:55.614690] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-18T17:18:55.719571] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-09-18T17:18:56.047257] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-18T17:18:56.519542] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-18T17:18:57.319553] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-18T17:18:58.092080] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T17:18:58.119617] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-18T17:18:58.893205] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-18T17:18:58.895637] [INFO ] [REMOTE ] APOS: Full fetch complete (10415 records). [2025-09-18T17:18:58.895742] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-18T17:18:58.929572] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-18T17:18:59.283174] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-18T17:18:59.283317] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-18T17:18:59.283551] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-18T17:18:59.283620] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-18T17:18:59.284611] [DEBUG] [LOCAL ] APOS: Trimmed 10415 records to 7503 (keeping 200 days of data) [2025-09-18T17:18:59.332745] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-18T17:18:59.370564] [DEBUG] [LOCAL ] APOS: Primary data saved (7503 records). [2025-09-18T17:18:59.370710] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-18T17:18:59.370801] [INFO ] [MAIN ] Update Progress: 134/2372 symbols completed. APOS took 28.2s. Estimated remaining: 5h 16m 12s. Rate: 7.1 symbols/min [2025-09-18T17:18:59.474643] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-18T17:18:59.543402] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:18:59.598009] [DEBUG] [LOCAL ] AR: Loaded 53585 existing records from primary storage. [2025-09-18T17:18:59.598155] [INFO ] [MAIN ] AR: Loaded 53585 existing records. [2025-09-18T17:18:59.724719] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-18T17:18:59.777419] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:18:59.777744] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-18T17:18:59.777801] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-18T17:18:59.780381] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-09-18T17:18:59.780444] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-18T17:19:00.141151] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:19:00.519598] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-18T17:19:01.098371] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-18T17:19:01.319544] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-11. [2025-09-18T17:19:02.119584] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-18T17:19:02.560989] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-18T17:19:02.909771] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-18T17:19:02.920323] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-09-18T17:19:03.436879] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T17:19:03.719556] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-18T17:19:04.317768] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-18T17:19:04.519581] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-18T17:19:04.653455] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-18T17:19:05.319556] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-18T17:19:06.070245] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-18T17:19:06.119495] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-18T17:19:06.710467] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-18T17:19:06.919614] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-18T17:19:07.444529] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T17:19:07.451743] [INFO ] [REMOTE ] AQN: Full fetch complete (75108 records). [2025-09-18T17:19:07.451878] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-18T17:19:07.727036] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-18T17:19:07.852059] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-18T17:19:07.852149] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-18T17:19:07.852967] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-18T17:19:07.853034] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-18T17:19:07.854614] [DEBUG] [LOCAL ] AQN: Trimmed 75108 records to 52366 (keeping 200 days of data) [2025-09-18T17:19:08.156399] [DEBUG] [LOCAL ] AQN: Primary data saved (52366 records). [2025-09-18T17:19:08.156545] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-18T17:19:08.156632] [INFO ] [MAIN ] Update Progress: 135/2372 symbols completed. AQN took 32.1s. Estimated remaining: 5h 16m 9s. Rate: 7.1 symbols/min [2025-09-18T17:19:08.327152] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:19:08.368872] [DEBUG] [LOCAL ] ARCO: Loaded 44755 existing records from primary storage. [2025-09-18T17:19:08.369159] [INFO ] [MAIN ] ARCO: Loaded 44755 existing records. [2025-09-18T17:19:08.521767] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-09-18T17:19:08.596683] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:19:08.605023] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-18T17:19:08.605563] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-18T17:19:08.608102] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-18T17:19:08.609475] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-18T17:19:08.619783] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-18T17:19:08.620023] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-18T17:19:08.987838] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:19:09.319582] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-11. [2025-09-18T17:19:10.119567] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-18T17:19:10.368432] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-18T17:19:10.652044] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-18T17:19:10.919498] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-09-18T17:19:11.719577] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-18T17:19:11.960701] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-18T17:19:11.968517] [INFO ] [REMOTE ] APTV: Full fetch complete (75928 records). [2025-09-18T17:19:11.968670] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-18T17:19:12.369753] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-09-18T17:19:12.369981] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-09-18T17:19:12.370742] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-09-18T17:19:12.379542] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-09-18T17:19:12.397225] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-18T17:19:12.406691] [DEBUG] [LOCAL ] APTV: Trimmed 75928 records to 52636 (keeping 200 days of data) [2025-09-18T17:19:12.519768] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-09-18T17:19:12.726278] [DEBUG] [LOCAL ] APTV: Primary data saved (52636 records). [2025-09-18T17:19:12.726462] [INFO ] [MAIN ] APTV: Full history saved. [2025-09-18T17:19:12.726603] [INFO ] [MAIN ] Update Progress: 136/2372 symbols completed. APTV took 39.8s. Estimated remaining: 5h 14m 56s. Rate: 7.1 symbols/min [2025-09-18T17:19:12.900320] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:19:12.917326] [DEBUG] [LOCAL ] ARDC: Loaded 14669 existing records from primary storage. [2025-09-18T17:19:12.917468] [INFO ] [MAIN ] ARDC: Loaded 14669 existing records. [2025-09-18T17:19:13.098422] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:19:13.098865] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-18T17:19:13.098986] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-18T17:19:13.099714] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-18T17:19:13.099777] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-18T17:19:13.342329] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-18T17:19:13.446095] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-18T17:19:13.536317] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:19:13.777545] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-18T17:19:14.119530] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-18T17:19:14.219628] [DEBUG] [REMOTE ] AR: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-18T17:19:14.219927] [WARN ] [REMOTE ] AR: No data returned for month 2025-03 [2025-09-18T17:19:14.250539] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-18T17:19:14.919593] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-18T17:19:15.719631] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-11. [2025-09-18T17:19:16.435446] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-18T17:19:16.519550] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-18T17:19:16.737998] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-18T17:19:17.319602] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-18T17:19:17.772838] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T17:19:18.119597] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-18T17:19:18.812178] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T17:19:18.919514] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-18T17:19:19.346100] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T17:19:19.719540] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-18T17:19:20.318102] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-18T17:19:20.519511] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-18T17:19:20.695295] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-18T17:19:20.855353] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-18T17:19:21.319597] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-18T17:19:21.635759] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-18T17:19:22.119545] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-18T17:19:22.573201] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-18T17:19:22.574314] [INFO ] [REMOTE ] AQNB: Full fetch complete (5962 records). [2025-09-18T17:19:22.574383] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-18T17:19:22.928946] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-18T17:19:22.937285] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-09-18T17:19:22.937344] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-09-18T17:19:22.937507] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-09-18T17:19:22.937546] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-09-18T17:19:22.937966] [DEBUG] [LOCAL ] AQNB: Trimmed 5962 records to 4254 (keeping 200 days of data) [2025-09-18T17:19:22.964915] [DEBUG] [LOCAL ] AQNB: Primary data saved (4254 records). [2025-09-18T17:19:22.965003] [INFO ] [MAIN ] AQNB: Full history saved. [2025-09-18T17:19:22.965081] [INFO ] [MAIN ] Update Progress: 137/2372 symbols completed. AQNB took 33.8s. Estimated remaining: 5h 15m 17s. Rate: 7.1 symbols/min [2025-09-18T17:19:23.139714] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:19:23.168515] [DEBUG] [LOCAL ] ARDT: Loaded 28681 existing records from primary storage. [2025-09-18T17:19:23.168668] [INFO ] [MAIN ] ARDT: Loaded 28681 existing records. [2025-09-18T17:19:23.344957] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:19:23.345215] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-18T17:19:23.345263] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-18T17:19:23.345955] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-09-18T17:19:23.346025] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-18T17:19:23.696826] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:19:23.719492] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-11. [2025-09-18T17:19:24.306472] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-18T17:19:24.519516] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-18T17:19:25.222371] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-18T17:19:25.319604] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-09-18T17:19:25.748704] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-18T17:19:26.119608] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-18T17:19:26.139865] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-18T17:19:26.919554] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-18T17:19:27.683190] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-18T17:19:27.719503] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-18T17:19:28.519563] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-09-18T17:19:28.818374] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-18T17:19:29.055425] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-18T17:19:29.146150] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-18T17:19:29.319555] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-09-18T17:19:29.820859] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-18T17:19:30.119556] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-18T17:19:30.655732] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-18T17:19:30.919609] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-18T17:19:31.719534] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-18T17:19:31.940830] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-18T17:19:32.519578] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-09-18T17:19:33.165781] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T17:19:33.319561] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-18T17:19:33.443257] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-18T17:19:34.119562] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-18T17:19:34.556604] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-18T17:19:34.565425] [INFO ] [REMOTE ] ARCO: Full fetch complete (65710 records). [2025-09-18T17:19:34.565590] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-18T17:19:34.945565] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-18T17:19:34.968706] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-18T17:19:34.968798] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-18T17:19:34.969471] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-18T17:19:34.969547] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-18T17:19:34.972057] [DEBUG] [LOCAL ] ARCO: Trimmed 65710 records to 45022 (keeping 200 days of data) [2025-09-18T17:19:35.187912] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-18T17:19:35.248259] [DEBUG] [LOCAL ] ARCO: Primary data saved (45022 records). [2025-09-18T17:19:35.248409] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-18T17:19:35.248521] [INFO ] [MAIN ] Update Progress: 138/2372 symbols completed. ARCO took 27.1s. Estimated remaining: 5h 16m 10s. Rate: 7.1 symbols/min [2025-09-18T17:19:35.416231] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:19:35.467810] [DEBUG] [LOCAL ] ARE: Loaded 50585 existing records from primary storage. [2025-09-18T17:19:35.467977] [INFO ] [MAIN ] ARE: Loaded 50585 existing records. [2025-09-18T17:19:35.659889] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:19:35.660302] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-18T17:19:35.660375] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-18T17:19:35.662663] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-18T17:19:35.662727] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-18T17:19:35.727768] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-18T17:19:36.035780] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:19:36.079823] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-18T17:19:36.519563] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-18T17:19:37.319598] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-18T17:19:37.614593] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-18T17:19:37.647200] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-18T17:19:37.818539] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-18T17:19:38.119554] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-18T17:19:38.919506] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-18T17:19:38.938271] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-18T17:19:39.719598] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-18T17:19:40.462758] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-18T17:19:40.470299] [INFO ] [REMOTE ] AR: Full fetch complete (69173 records). [2025-09-18T17:19:40.470429] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-18T17:19:40.524708] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-18T17:19:40.669090] [WARN ] [VALIDATOR ] AR: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-18T17:19:40.669770] [FATAL] [MAIN ] AR: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:19:40.669843] [WARN ] [MAIN ] AR: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:19:40.669914] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-18T17:19:40.669979] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-09-18T17:19:40.670016] [INFO ] [LOCAL ] AR: Starting deletion of derivative data. [2025-09-18T17:19:40.670537] [DEBUG] [LOCAL ] AR: Deleted derivative data file. [2025-09-18T17:19:40.670634] [INFO ] [MAIN ] Update Progress: 139/2372 symbols completed. AR took 41.3s. Estimated remaining: 5h 15m 12s. Rate: 7.1 symbols/min [2025-09-18T17:19:40.838669] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:19:40.856747] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-18T17:19:40.912613] [DEBUG] [LOCAL ] ARES: Loaded 49745 existing records from primary storage. [2025-09-18T17:19:40.912788] [INFO ] [MAIN ] ARES: Loaded 49745 existing records. [2025-09-18T17:19:41.091755] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:19:41.092214] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-18T17:19:41.092271] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-18T17:19:41.099473] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-09-18T17:19:41.099539] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-18T17:19:41.330398] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-18T17:19:41.460775] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:19:41.471200] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-18T17:19:42.124610] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-11. [2025-09-18T17:19:42.132987] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-18T17:19:42.919596] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-18T17:19:43.632170] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-18T17:19:43.719558] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-18T17:19:43.929734] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-18T17:19:44.264740] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-18T17:19:44.519561] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-09-18T17:19:45.319562] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-18T17:19:45.926672] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-18T17:19:46.000010] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-18T17:19:46.002270] [INFO ] [REMOTE ] ARDC: Full fetch complete (20086 records). [2025-09-18T17:19:46.002347] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-18T17:19:46.002828] [FATAL] [VALIDATOR ] ARDC: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:19:46.002914] [FATAL] [MAIN ] ARDC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:19:46.002957] [WARN ] [MAIN ] ARDC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:19:46.002997] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-18T17:19:46.003053] [DEBUG] [LOCAL ] ARDC: No primary data file found to delete. [2025-09-18T17:19:46.003087] [INFO ] [LOCAL ] ARDC: Starting deletion of derivative data. [2025-09-18T17:19:46.003497] [DEBUG] [LOCAL ] ARDC: Deleted derivative data file. [2025-09-18T17:19:46.003608] [INFO ] [MAIN ] Update Progress: 140/2372 symbols completed. ARDC took 33.3s. Estimated remaining: 5h 14m 14s. Rate: 7.1 symbols/min [2025-09-18T17:19:46.124621] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-11. [2025-09-18T17:19:46.175686] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:19:46.220984] [DEBUG] [LOCAL ] ARI: Loaded 43285 existing records from primary storage. [2025-09-18T17:19:46.221122] [INFO ] [MAIN ] ARI: Loaded 43285 existing records. [2025-09-18T17:19:46.400712] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:19:46.400975] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-18T17:19:46.401022] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-18T17:19:46.403283] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-18T17:19:46.403344] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-18T17:19:46.756970] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:19:46.919491] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-11. [2025-09-18T17:19:47.674084] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-18T17:19:47.719489] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-09-18T17:19:48.526674] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-09-18T17:19:48.532515] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-18T17:19:48.971425] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-18T17:19:49.319559] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-18T17:19:50.119550] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-09-18T17:19:50.850719] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T17:19:50.919508] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-18T17:19:51.146279] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-18T17:19:51.719542] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-18T17:19:51.866777] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-18T17:19:52.230176] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-18T17:19:52.519578] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-09-18T17:19:53.319334] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-18T17:19:53.328088] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-18T17:19:53.600633] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-18T17:19:54.119543] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-18T17:19:54.170029] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-18T17:19:54.174366] [INFO ] [REMOTE ] ARDT: Full fetch complete (41099 records). [2025-09-18T17:19:54.174466] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-18T17:19:54.551070] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-09-18T17:19:54.551160] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-09-18T17:19:54.551670] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-09-18T17:19:54.551735] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-09-18T17:19:54.552719] [DEBUG] [LOCAL ] ARDT: Trimmed 41099 records to 28901 (keeping 200 days of data) [2025-09-18T17:19:54.717952] [DEBUG] [LOCAL ] ARDT: Primary data saved (28901 records). [2025-09-18T17:19:54.718105] [INFO ] [MAIN ] ARDT: Full history saved. [2025-09-18T17:19:54.718195] [INFO ] [MAIN ] Update Progress: 141/2372 symbols completed. ARDT took 31.8s. Estimated remaining: 5h 14m 10s. Rate: 7.1 symbols/min [2025-09-18T17:19:54.888847] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:19:54.928783] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-09-18T17:19:54.931756] [DEBUG] [LOCAL ] ARIS: Loaded 42025 existing records from primary storage. [2025-09-18T17:19:54.931987] [INFO ] [MAIN ] ARIS: Loaded 42025 existing records. [2025-09-18T17:19:55.119348] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:19:55.119740] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-18T17:19:55.119810] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-18T17:19:55.122207] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-09-18T17:19:55.122286] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-18T17:19:55.486505] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:19:55.691369] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T17:19:55.719498] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-18T17:19:56.519564] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-11. [2025-09-18T17:19:56.647993] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-18T17:19:57.183551] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T17:19:57.319546] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-18T17:19:57.684671] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-18T17:19:58.119567] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-18T17:19:58.796834] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-18T17:19:58.919496] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-18T17:19:59.544084] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T17:19:59.719608] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-09-18T17:20:00.288602] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-18T17:20:00.519544] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-18T17:20:01.127627] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-18T17:20:01.319558] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-18T17:20:01.779081] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-18T17:20:02.119593] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-09-18T17:20:02.872909] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-18T17:20:02.919579] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-18T17:20:03.301139] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-18T17:20:03.719604] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-18T17:20:04.395441] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T17:20:04.519573] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-18T17:20:04.877819] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-18T17:20:05.319590] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-18T17:20:05.657957] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-18T17:20:06.119547] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-18T17:20:06.919564] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-18T17:20:07.237235] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-18T17:20:07.448169] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-18T17:20:07.719550] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-18T17:20:08.314862] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-18T17:20:08.519604] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-18T17:20:09.319707] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-18T17:20:09.611297] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-18T17:20:09.841412] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T17:20:10.119564] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-18T17:20:10.533856] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T17:20:10.919579] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-18T17:20:11.719596] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-18T17:20:11.951686] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-18T17:20:12.096619] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-18T17:20:12.519551] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-18T17:20:13.319549] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-18T17:20:14.119569] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-18T17:20:14.465442] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (2.75 seconds). [2025-09-18T17:20:14.762987] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-18T17:20:14.770349] [INFO ] [REMOTE ] ARE: Full fetch complete (72554 records). [2025-09-18T17:20:14.770540] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-18T17:20:14.923361] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-18T17:20:14.934597] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-18T17:20:15.265389] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-18T17:20:15.265488] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-18T17:20:15.266254] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-18T17:20:15.266343] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-18T17:20:15.268377] [DEBUG] [LOCAL ] ARE: Trimmed 72554 records to 50937 (keeping 200 days of data) [2025-09-18T17:20:15.597423] [DEBUG] [LOCAL ] ARE: Primary data saved (50937 records). [2025-09-18T17:20:15.597665] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-18T17:20:15.597873] [INFO ] [MAIN ] Update Progress: 142/2372 symbols completed. ARE took 40.3s. Estimated remaining: 5h 17m 16s. Rate: 7.0 symbols/min [2025-09-18T17:20:15.724801] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-18T17:20:15.773248] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:20:15.816239] [DEBUG] [LOCAL ] ARLO: Loaded 44192 existing records from primary storage. [2025-09-18T17:20:15.816386] [INFO ] [MAIN ] ARLO: Loaded 44192 existing records. [2025-09-18T17:20:15.996951] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:20:15.997513] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-18T17:20:15.997627] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-18T17:20:15.999901] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-18T17:20:16.000061] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-18T17:20:16.285299] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-18T17:20:16.434710] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:20:16.519567] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-11. [2025-09-18T17:20:17.281452] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-18T17:20:17.319487] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-18T17:20:17.820369] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-18T17:20:18.001632] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-18T17:20:18.119566] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-18T17:20:18.435723] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-18T17:20:18.919557] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-18T17:20:19.437323] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-18T17:20:19.719547] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-18T17:20:20.478179] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-18T17:20:20.484005] [INFO ] [REMOTE ] ARI: Full fetch complete (62554 records). [2025-09-18T17:20:20.484119] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-18T17:20:20.529430] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-18T17:20:20.911697] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-18T17:20:20.911820] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-18T17:20:20.912498] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-18T17:20:20.912572] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-18T17:20:20.914503] [DEBUG] [LOCAL ] ARI: Trimmed 62554 records to 43621 (keeping 200 days of data) [2025-09-18T17:20:21.195920] [DEBUG] [LOCAL ] ARI: Primary data saved (43621 records). [2025-09-18T17:20:21.196067] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-18T17:20:21.196215] [INFO ] [MAIN ] Update Progress: 143/2372 symbols completed. ARI took 35.2s. Estimated remaining: 5h 16m 22s. Rate: 7.0 symbols/min [2025-09-18T17:20:21.322230] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-09-18T17:20:21.406009] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:20:21.434036] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-18T17:20:21.497807] [DEBUG] [LOCAL ] ARMK: Loaded 50320 existing records from primary storage. [2025-09-18T17:20:21.497972] [INFO ] [MAIN ] ARMK: Loaded 50320 existing records. [2025-09-18T17:20:21.680897] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:20:21.681134] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-18T17:20:21.681194] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-18T17:20:21.683267] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-09-18T17:20:21.683328] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-18T17:20:22.046380] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:20:22.109318] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-18T17:20:22.119145] [INFO ] [REMOTE ] ARES: Full fetch complete (70374 records). [2025-09-18T17:20:22.119270] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-18T17:20:22.119495] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-11. [2025-09-18T17:20:22.524032] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-18T17:20:22.524173] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-18T17:20:22.524921] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-18T17:20:22.524987] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-18T17:20:22.526491] [DEBUG] [LOCAL ] ARES: Trimmed 70374 records to 50098 (keeping 200 days of data) [2025-09-18T17:20:22.853080] [DEBUG] [LOCAL ] ARES: Primary data saved (50098 records). [2025-09-18T17:20:22.853231] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-18T17:20:22.855766] [INFO ] [MAIN ] Update Progress: 144/2372 symbols completed. ARES took 42.2s. Estimated remaining: 5h 14m 27s. Rate: 7.1 symbols/min [2025-09-18T17:20:22.923763] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-18T17:20:23.044578] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:20:23.071587] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-18T17:20:23.127199] [DEBUG] [LOCAL ] AROC: Loaded 49007 existing records from primary storage. [2025-09-18T17:20:23.127349] [INFO ] [MAIN ] AROC: Loaded 49007 existing records. [2025-09-18T17:20:23.317349] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:20:23.317883] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-18T17:20:23.317948] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-18T17:20:23.320001] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-09-18T17:20:23.320065] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-18T17:20:23.700007] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:20:23.719495] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-11. [2025-09-18T17:20:23.764200] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-18T17:20:24.519624] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-09-18T17:20:24.737257] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-18T17:20:25.056352] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-18T17:20:25.319578] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-09-18T17:20:25.704638] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-18T17:20:26.119592] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-09-18T17:20:26.541005] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-18T17:20:26.919576] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-09-18T17:20:27.313665] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-18T17:20:27.719557] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-18T17:20:28.519527] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-09-18T17:20:28.602811] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-18T17:20:28.913605] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-18T17:20:29.319553] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-18T17:20:29.778754] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-18T17:20:30.119557] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-18T17:20:30.605381] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-18T17:20:30.919564] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-18T17:20:31.388211] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-18T17:20:31.719679] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-18T17:20:32.519761] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-18T17:20:32.633808] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-18T17:20:33.167100] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T17:20:33.175457] [INFO ] [REMOTE ] ARIS: Full fetch complete (59482 records). [2025-09-18T17:20:33.175589] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-18T17:20:33.329127] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-18T17:20:33.574383] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-09-18T17:20:33.574511] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-09-18T17:20:33.575231] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-09-18T17:20:33.575305] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-09-18T17:20:33.576846] [DEBUG] [LOCAL ] ARIS: Trimmed 59482 records to 42356 (keeping 200 days of data) [2025-09-18T17:20:33.848835] [DEBUG] [LOCAL ] ARIS: Primary data saved (42356 records). [2025-09-18T17:20:33.849122] [INFO ] [MAIN ] ARIS: Full history saved. [2025-09-18T17:20:33.849295] [INFO ] [MAIN ] Update Progress: 145/2372 symbols completed. ARIS took 39.1s. Estimated remaining: 5h 14m 58s. Rate: 7.1 symbols/min [2025-09-18T17:20:34.047175] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:20:34.052465] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T17:20:34.116576] [DEBUG] [LOCAL ] ARR: Loaded 52032 existing records from primary storage. [2025-09-18T17:20:34.116755] [INFO ] [MAIN ] ARR: Loaded 52032 existing records. [2025-09-18T17:20:34.127963] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-18T17:20:34.297781] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:20:34.298073] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-18T17:20:34.298123] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-18T17:20:34.299776] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-09-18T17:20:34.299840] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-18T17:20:34.653093] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:20:34.866554] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T17:20:34.919549] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-18T17:20:35.520532] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-18T17:20:35.719596] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-11. [2025-09-18T17:20:36.519621] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-18T17:20:36.586885] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-18T17:20:37.310548] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-18T17:20:37.320614] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-09-18T17:20:37.850885] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-18T17:20:38.119585] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-18T17:20:38.782401] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-18T17:20:38.919592] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-18T17:20:39.724634] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-18T17:20:39.741390] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-18T17:20:40.087277] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-18T17:20:40.519548] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-09-18T17:20:41.319556] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-18T17:20:41.479748] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-18T17:20:42.063114] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-18T17:20:42.119507] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-18T17:20:42.919545] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-18T17:20:43.172561] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-18T17:20:43.498365] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T17:20:43.719574] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-18T17:20:44.150888] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-18T17:20:44.519554] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-18T17:20:44.889073] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-18T17:20:45.319601] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-18T17:20:46.119544] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-18T17:20:46.278272] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-18T17:20:46.835441] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-18T17:20:46.919585] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-18T17:20:47.642625] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T17:20:47.649485] [INFO ] [REMOTE ] AROC: Full fetch complete (70334 records). [2025-09-18T17:20:47.649602] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-18T17:20:47.727279] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-18T17:20:48.048608] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-09-18T17:20:48.048734] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-09-18T17:20:48.049427] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-09-18T17:20:48.049472] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-09-18T17:20:48.051017] [DEBUG] [LOCAL ] AROC: Trimmed 70334 records to 49382 (keeping 200 days of data) [2025-09-18T17:20:48.295282] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T17:20:48.389297] [DEBUG] [LOCAL ] AROC: Primary data saved (49382 records). [2025-09-18T17:20:48.389437] [INFO ] [MAIN ] AROC: Full history saved. [2025-09-18T17:20:48.389549] [INFO ] [MAIN ] Update Progress: 146/2372 symbols completed. AROC took 25.5s. Estimated remaining: 5h 16m 22s. Rate: 7.0 symbols/min [2025-09-18T17:20:48.531534] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-18T17:20:48.565711] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:20:48.600597] [DEBUG] [LOCAL ] ARW: Loaded 33210 existing records from primary storage. [2025-09-18T17:20:48.600778] [INFO ] [MAIN ] ARW: Loaded 33210 existing records. [2025-09-18T17:20:48.779107] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:20:48.779351] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-18T17:20:48.779398] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-18T17:20:48.780734] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-18T17:20:48.780794] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-18T17:20:49.145147] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:20:49.319540] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-18T17:20:50.120937] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-11. [2025-09-18T17:20:50.124560] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-18T17:20:50.202930] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-18T17:20:50.656413] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-18T17:20:50.919580] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-18T17:20:51.512977] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T17:20:51.719559] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-18T17:20:52.452907] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T17:20:52.519612] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-18T17:20:52.899133] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-18T17:20:53.319547] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-18T17:20:54.119517] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-18T17:20:54.192257] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-18T17:20:54.476803] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-18T17:20:54.483669] [INFO ] [REMOTE ] ARLO: Full fetch complete (62444 records). [2025-09-18T17:20:54.483806] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-18T17:20:54.876227] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-09-18T17:20:54.876323] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-09-18T17:20:54.877003] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-09-18T17:20:54.877071] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-09-18T17:20:54.878412] [DEBUG] [LOCAL ] ARLO: Trimmed 62444 records to 44533 (keeping 200 days of data) [2025-09-18T17:20:54.928434] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-18T17:20:55.153153] [DEBUG] [LOCAL ] ARLO: Primary data saved (44533 records). [2025-09-18T17:20:55.153336] [INFO ] [MAIN ] ARLO: Full history saved. [2025-09-18T17:20:55.153495] [INFO ] [MAIN ] Update Progress: 147/2372 symbols completed. ARLO took 39.6s. Estimated remaining: 5h 15m 46s. Rate: 7.0 symbols/min [2025-09-18T17:20:55.327625] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:20:55.327843] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-18T17:20:55.327886] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-18T17:20:55.328031] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-18T17:20:55.328075] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-18T17:20:55.328119] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-18T17:20:55.328154] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-18T17:20:55.711620] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:20:55.724668] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-11. [2025-09-18T17:20:55.742026] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-18T17:20:55.944245] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:20:55.944581] [WARN ] [REMOTE ] ARX: No data returned for month 2024-11 [2025-09-18T17:20:56.519548] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-18T17:20:56.747630] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-18T17:20:56.755619] [INFO ] [REMOTE ] ARMK: Full fetch complete (71969 records). [2025-09-18T17:20:56.755777] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-18T17:20:56.756697] [FATAL] [VALIDATOR ] ARMK: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:20:56.756789] [FATAL] [MAIN ] ARMK: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:20:56.756847] [WARN ] [MAIN ] ARMK: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:20:56.756915] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-18T17:20:56.757052] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-09-18T17:20:56.757124] [INFO ] [LOCAL ] ARMK: Starting deletion of derivative data. [2025-09-18T17:20:56.757802] [DEBUG] [LOCAL ] ARMK: Deleted derivative data file. [2025-09-18T17:20:56.757947] [INFO ] [MAIN ] Update Progress: 148/2372 symbols completed. ARMK took 35.6s. Estimated remaining: 5h 13m 54s. Rate: 7.1 symbols/min [2025-09-18T17:20:56.940694] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:20:57.001605] [DEBUG] [LOCAL ] AS: Loaded 53066 existing records from primary storage. [2025-09-18T17:20:57.001794] [INFO ] [MAIN ] AS: Loaded 53066 existing records. [2025-09-18T17:20:57.196938] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:20:57.197289] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-18T17:20:57.197347] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-18T17:20:57.200622] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-09-18T17:20:57.200712] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-18T17:20:57.324699] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-18T17:20:57.579496] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:20:57.625613] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:20:57.625965] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-18T17:20:58.119550] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-09-18T17:20:58.325397] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-18T17:20:58.919583] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-11. [2025-09-18T17:20:59.121208] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-18T17:20:59.719551] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-09-18T17:20:59.912612] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:20:59.912979] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-09-18T17:21:00.265277] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-18T17:21:00.519554] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-09-18T17:21:01.319574] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-18T17:21:01.648096] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-18T17:21:02.119587] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-02. [2025-09-18T17:21:02.335289] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:21:02.335746] [WARN ] [REMOTE ] ARX: No data returned for month 2025-02 [2025-09-18T17:21:02.919591] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-03. [2025-09-18T17:21:03.588865] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:21:03.600302] [WARN ] [REMOTE ] ARX: No data returned for month 2025-03 [2025-09-18T17:21:03.620531] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-18T17:21:03.719543] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-18T17:21:04.519555] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-18T17:21:05.304962] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-18T17:21:05.312304] [INFO ] [REMOTE ] ARR: Full fetch complete (74916 records). [2025-09-18T17:21:05.312446] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-18T17:21:05.324972] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-09-18T17:21:05.709390] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-18T17:21:05.709477] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-18T17:21:05.710233] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-18T17:21:05.710299] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-18T17:21:05.711773] [DEBUG] [LOCAL ] ARR: Trimmed 74916 records to 52416 (keeping 200 days of data) [2025-09-18T17:21:05.967898] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T17:21:06.073849] [DEBUG] [LOCAL ] ARR: Primary data saved (52416 records). [2025-09-18T17:21:06.074061] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-18T17:21:06.074167] [INFO ] [MAIN ] Update Progress: 149/2372 symbols completed. ARR took 32.2s. Estimated remaining: 5h 13m 58s. Rate: 7.1 symbols/min [2025-09-18T17:21:06.130700] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-04. [2025-09-18T17:21:06.258391] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:21:06.276201] [DEBUG] [LOCAL ] ASA: Loaded 13428 existing records from primary storage. [2025-09-18T17:21:06.276380] [INFO ] [MAIN ] ASA: Loaded 13428 existing records. [2025-09-18T17:21:06.382398] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:21:06.391359] [WARN ] [REMOTE ] ARX: No data returned for month 2025-04 [2025-09-18T17:21:06.470032] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:21:06.470345] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-18T17:21:06.470414] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-18T17:21:06.471082] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-18T17:21:06.471163] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-18T17:21:06.834800] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:21:06.919516] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-11. [2025-09-18T17:21:06.979201] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-18T17:21:07.637991] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-18T17:21:07.719585] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-18T17:21:08.519554] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-05. [2025-09-18T17:21:08.723543] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:21:08.724065] [WARN ] [REMOTE ] ARX: No data returned for month 2025-05 [2025-09-18T17:21:08.772208] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-18T17:21:09.319569] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-06. [2025-09-18T17:21:09.524600] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:21:09.524947] [WARN ] [REMOTE ] ARX: No data returned for month 2025-06 [2025-09-18T17:21:10.119605] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-18T17:21:10.919576] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-09-18T17:21:11.620323] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-18T17:21:11.663346] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-18T17:21:11.719570] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-18T17:21:12.519586] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-09-18T17:21:13.052483] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-18T17:21:13.253197] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T17:21:13.319572] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-18T17:21:14.119552] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-07. [2025-09-18T17:21:14.297711] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-18T17:21:14.769327] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-18T17:21:14.919561] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-09-18T17:21:15.719544] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-18T17:21:16.519556] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-08. [2025-09-18T17:21:16.726036] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-18T17:21:16.757783] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-18T17:21:17.319546] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-18T17:21:17.707687] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-18T17:21:18.119548] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-18T17:21:18.690212] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-18T17:21:18.919548] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-18T17:21:19.347565] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-18T17:21:19.719537] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-09. [2025-09-18T17:21:19.883706] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-18T17:21:19.888626] [INFO ] [REMOTE ] ARW: Full fetch complete (47594 records). [2025-09-18T17:21:19.888798] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-18T17:21:20.268751] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-18T17:21:20.268881] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-18T17:21:20.269441] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-18T17:21:20.269492] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-18T17:21:20.270881] [DEBUG] [LOCAL ] ARW: Trimmed 47594 records to 33464 (keeping 200 days of data) [2025-09-18T17:21:20.472225] [DEBUG] [LOCAL ] ARW: Primary data saved (33464 records). [2025-09-18T17:21:20.472369] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-18T17:21:20.472460] [INFO ] [MAIN ] Update Progress: 150/2372 symbols completed. ARW took 32.1s. Estimated remaining: 5h 15m 17s. Rate: 7.0 symbols/min [2025-09-18T17:21:20.528600] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-18T17:21:20.649363] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:21:20.704136] [DEBUG] [LOCAL ] ASAN: Loaded 52762 existing records from primary storage. [2025-09-18T17:21:20.704295] [INFO ] [MAIN ] ASAN: Loaded 52762 existing records. [2025-09-18T17:21:20.936428] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:21:20.936873] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-18T17:21:20.936931] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-18T17:21:20.938739] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-09-18T17:21:20.938803] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-18T17:21:21.293179] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-18T17:21:21.330933] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-18T17:21:21.337811] [INFO ] [REMOTE ] ARX: Full fetch complete (12696 records). [2025-09-18T17:21:21.337241] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:21:21.337935] [DEBUG] [VALIDATOR ] ARX: Validating primary data. [2025-09-18T17:21:21.521047] [WARN ] [VALIDATOR ] ARX: Validation failed - insufficient historical data. Have 40 unique days, need 200 days [2025-09-18T17:21:21.521303] [FATAL] [MAIN ] ARX: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:21:21.521371] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:21:21.521444] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-18T17:21:21.521508] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-18T17:21:21.521545] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-18T17:21:21.521586] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-18T17:21:21.521665] [INFO ] [MAIN ] Update Progress: 151/2372 symbols completed. ARX took 26.4s. Estimated remaining: 5h 13m 19s. Rate: 7.1 symbols/min [2025-09-18T17:21:21.701053] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-18T17:21:21.704615] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:21:21.756251] [DEBUG] [LOCAL ] ASB: Loaded 49645 existing records from primary storage. [2025-09-18T17:21:21.756396] [INFO ] [MAIN ] ASB: Loaded 49645 existing records. [2025-09-18T17:21:21.953569] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:21:21.953964] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-18T17:21:21.954030] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-18T17:21:21.955077] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-18T17:21:21.955140] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-18T17:21:22.133746] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-18T17:21:22.324502] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:21:22.814327] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T17:21:22.833531] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-18T17:21:22.919589] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-18T17:21:23.719617] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-18T17:21:24.406022] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-18T17:21:24.519616] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-11. [2025-09-18T17:21:24.641669] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-18T17:21:25.319560] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-18T17:21:25.842277] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-18T17:21:26.119556] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-18T17:21:26.671887] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-18T17:21:26.850452] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T17:21:26.919529] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-18T17:21:27.719590] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-11. [2025-09-18T17:21:28.519564] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-09-18T17:21:28.672830] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-18T17:21:29.135151] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T17:21:29.319598] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-09-18T17:21:29.780944] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-18T17:21:30.119584] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-09-18T17:21:30.919517] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-18T17:21:31.408990] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-18T17:21:31.473046] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-18T17:21:31.719584] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-18T17:21:32.287534] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-18T17:21:32.519593] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-09-18T17:21:32.636742] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T17:21:33.319612] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-18T17:21:34.119603] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-18T17:21:34.180720] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-18T17:21:34.379969] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-18T17:21:34.919546] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-18T17:21:35.478860] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-18T17:21:35.719588] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-18T17:21:35.755185] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T17:21:36.519599] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-18T17:21:37.319562] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-18T17:21:37.460292] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-18T17:21:37.504577] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-18T17:21:37.508504] [INFO ] [REMOTE ] ASA: Full fetch complete (18261 records). [2025-09-18T17:21:37.508619] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-18T17:21:37.942609] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-18T17:21:37.942729] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-18T17:21:37.943044] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-18T17:21:37.943087] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-18T17:21:37.943714] [DEBUG] [LOCAL ] ASA: Trimmed 18261 records to 13569 (keeping 200 days of data) [2025-09-18T17:21:38.030149] [DEBUG] [LOCAL ] ASA: Primary data saved (13569 records). [2025-09-18T17:21:38.030365] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-18T17:21:38.030515] [INFO ] [MAIN ] Update Progress: 152/2372 symbols completed. ASA took 32.0s. Estimated remaining: 5h 15m 8s. Rate: 7.0 symbols/min [2025-09-18T17:21:38.129204] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-18T17:21:38.205103] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:21:38.211060] [DEBUG] [LOCAL ] ASBA: Loaded 3435 existing records from primary storage. [2025-09-18T17:21:38.211179] [INFO ] [MAIN ] ASBA: Loaded 3435 existing records. [2025-09-18T17:21:38.388894] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:21:38.389190] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-18T17:21:38.389240] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-18T17:21:38.389496] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-18T17:21:38.389555] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-18T17:21:38.747328] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:21:38.919562] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-11. [2025-09-18T17:21:39.024329] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-18T17:21:39.031797] [INFO ] [REMOTE ] AS: Full fetch complete (76347 records). [2025-09-18T17:21:39.031925] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-18T17:21:39.459976] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-18T17:21:39.461992] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-09-18T17:21:39.462098] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-09-18T17:21:39.462956] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-09-18T17:21:39.463023] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-09-18T17:21:39.464619] [DEBUG] [LOCAL ] AS: Trimmed 76347 records to 53456 (keeping 200 days of data) [2025-09-18T17:21:39.741990] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-09-18T17:21:39.818361] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-18T17:21:39.836934] [DEBUG] [LOCAL ] AS: Primary data saved (53456 records). [2025-09-18T17:21:39.837100] [INFO ] [MAIN ] AS: Full history saved. [2025-09-18T17:21:39.837195] [INFO ] [MAIN ] Update Progress: 153/2372 symbols completed. AS took 43.1s. Estimated remaining: 5h 13m 22s. Rate: 7.1 symbols/min [2025-09-18T17:21:40.007494] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:21:40.048373] [DEBUG] [LOCAL ] ASC: Loaded 38150 existing records from primary storage. [2025-09-18T17:21:40.048511] [INFO ] [MAIN ] ASC: Loaded 38150 existing records. [2025-09-18T17:21:40.231984] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:21:40.232270] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-18T17:21:40.232324] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-18T17:21:40.233172] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-09-18T17:21:40.233233] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-18T17:21:40.416113] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-18T17:21:40.525709] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-18T17:21:40.614016] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:21:41.319555] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-18T17:21:42.119543] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-11. [2025-09-18T17:21:42.200964] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-18T17:21:42.820565] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-18T17:21:42.919576] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-18T17:21:43.433794] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-18T17:21:43.719579] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-09-18T17:21:44.519577] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-09-18T17:21:44.670599] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-18T17:21:44.916852] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-18T17:21:45.017261] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-18T17:21:45.319595] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-18T17:21:45.889588] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-18T17:21:46.119554] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-18T17:21:46.919610] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-18T17:21:47.478514] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-18T17:21:47.719606] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-18T17:21:48.086577] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-18T17:21:48.519603] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-18T17:21:48.854451] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-18T17:21:49.131453] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-18T17:21:49.319560] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-18T17:21:50.119588] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-18T17:21:50.528108] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T17:21:50.545127] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-18T17:21:50.919580] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-09-18T17:21:51.719571] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-18T17:21:52.469971] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T17:21:52.519668] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-18T17:21:53.050194] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-18T17:21:53.319578] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-18T17:21:53.718903] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-18T17:21:54.119580] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-18T17:21:54.444936] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-18T17:21:54.919605] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-18T17:21:55.078665] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-18T17:21:55.291122] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-18T17:21:55.719603] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-18T17:21:56.286744] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-18T17:21:56.519623] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-18T17:21:57.319567] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-18T17:21:57.882936] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-18T17:21:57.884418] [INFO ] [REMOTE ] ASBA: Full fetch complete (5296 records). [2025-09-18T17:21:57.884523] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-18T17:21:58.129398] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-18T17:21:58.294458] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-18T17:21:58.294672] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-18T17:21:58.294920] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-18T17:21:58.295017] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-18T17:21:58.295765] [DEBUG] [LOCAL ] ASBA: Trimmed 5296 records to 3449 (keeping 200 days of data) [2025-09-18T17:21:58.351681] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-18T17:21:58.349908] [DEBUG] [LOCAL ] ASBA: Primary data saved (3449 records). [2025-09-18T17:21:58.362413] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-18T17:21:58.362795] [INFO ] [MAIN ] Update Progress: 154/2372 symbols completed. ASBA took 20.3s. Estimated remaining: 5h 15m 39s. Rate: 7.0 symbols/min [2025-09-18T17:21:58.559944] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:21:58.583709] [DEBUG] [LOCAL ] ASG: Loaded 21091 existing records from primary storage. [2025-09-18T17:21:58.583863] [INFO ] [MAIN ] ASG: Loaded 21091 existing records. [2025-09-18T17:21:58.770703] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:21:58.771024] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-18T17:21:58.771095] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-18T17:21:58.771753] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-09-18T17:21:58.771815] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-18T17:21:58.927323] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-18T17:21:59.147578] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:21:59.719544] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-18T17:21:59.856941] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-18T17:22:00.055940] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-18T17:22:00.519568] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-11. [2025-09-18T17:22:01.319553] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-18T17:22:01.508261] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-18T17:22:01.554401] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-18T17:22:02.119556] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-18T17:22:02.475312] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-18T17:22:02.919549] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-18T17:22:03.595264] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-18T17:22:03.719548] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-18T17:22:04.105635] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-18T17:22:04.519567] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-09-18T17:22:05.284700] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-18T17:22:05.292072] [INFO ] [REMOTE ] ASAN: Full fetch complete (76383 records). [2025-09-18T17:22:05.292224] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-18T17:22:05.324686] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-18T17:22:05.715758] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-09-18T17:22:05.715879] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-09-18T17:22:05.716973] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-09-18T17:22:05.717170] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-09-18T17:22:05.733016] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-18T17:22:05.732383] [DEBUG] [LOCAL ] ASAN: Trimmed 76383 records to 53150 (keeping 200 days of data) [2025-09-18T17:22:06.055533] [DEBUG] [LOCAL ] ASAN: Primary data saved (53150 records). [2025-09-18T17:22:06.055732] [INFO ] [MAIN ] ASAN: Full history saved. [2025-09-18T17:22:06.055860] [INFO ] [MAIN ] Update Progress: 155/2372 symbols completed. ASAN took 45.6s. Estimated remaining: 5h 15m 18s. Rate: 7.0 symbols/min [2025-09-18T17:22:06.124675] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-18T17:22:06.233533] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:22:06.257367] [DEBUG] [LOCAL ] ASGI: Loaded 22162 existing records from primary storage. [2025-09-18T17:22:06.257503] [INFO ] [MAIN ] ASGI: Loaded 22162 existing records. [2025-09-18T17:22:06.446669] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:22:06.447011] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-18T17:22:06.447067] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-18T17:22:06.447828] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-18T17:22:06.447891] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-18T17:22:06.847635] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-18T17:22:06.881564] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:22:06.919498] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-18T17:22:07.534485] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-18T17:22:07.545454] [INFO ] [REMOTE ] ASB: Full fetch complete (71439 records). [2025-09-18T17:22:07.545710] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-18T17:22:07.727232] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-09-18T17:22:07.948249] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-09-18T17:22:07.948503] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-09-18T17:22:07.949366] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-09-18T17:22:07.949449] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-09-18T17:22:07.951367] [DEBUG] [LOCAL ] ASB: Trimmed 71439 records to 50015 (keeping 200 days of data) [2025-09-18T17:22:08.066249] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-18T17:22:08.301613] [DEBUG] [LOCAL ] ASB: Primary data saved (50015 records). [2025-09-18T17:22:08.301810] [INFO ] [MAIN ] ASB: Full history saved. [2025-09-18T17:22:08.301950] [INFO ] [MAIN ] Update Progress: 156/2372 symbols completed. ASB took 46.8s. Estimated remaining: 5h 13m 40s. Rate: 7.1 symbols/min [2025-09-18T17:22:08.474803] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:22:08.511842] [DEBUG] [LOCAL ] ASGN: Loaded 35955 existing records from primary storage. [2025-09-18T17:22:08.511986] [INFO ] [MAIN ] ASGN: Loaded 35955 existing records. [2025-09-18T17:22:08.525023] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-18T17:22:08.699261] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:22:08.699537] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-18T17:22:08.699587] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-18T17:22:08.700402] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-09-18T17:22:08.700463] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-18T17:22:09.072375] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:22:09.096706] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-18T17:22:09.319551] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-11. [2025-09-18T17:22:09.669233] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T17:22:10.122372] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-18T17:22:10.125702] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-18T17:22:10.919517] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-18T17:22:11.199065] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-18T17:22:11.719541] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-09-18T17:22:11.989329] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-18T17:22:11.995364] [INFO ] [REMOTE ] ASC: Full fetch complete (57388 records). [2025-09-18T17:22:11.995561] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-18T17:22:12.443118] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-09-18T17:22:12.443229] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-09-18T17:22:12.444174] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-09-18T17:22:12.444274] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-09-18T17:22:12.445864] [DEBUG] [LOCAL ] ASC: Trimmed 57388 records to 38414 (keeping 200 days of data) [2025-09-18T17:22:12.545071] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-18T17:22:12.571734] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-18T17:22:12.730105] [DEBUG] [LOCAL ] ASC: Primary data saved (38414 records). [2025-09-18T17:22:12.730428] [INFO ] [MAIN ] ASC: Full history saved. [2025-09-18T17:22:12.730704] [INFO ] [MAIN ] Update Progress: 157/2372 symbols completed. ASC took 32.9s. Estimated remaining: 5h 12m 34s. Rate: 7.1 symbols/min [2025-09-18T17:22:13.319595] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-11. [2025-09-18T17:22:13.938622] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-18T17:22:14.119545] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-09-18T17:22:14.426081] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-18T17:22:14.919545] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-09-18T17:22:14.938851] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T17:22:15.719558] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-18T17:22:16.327702] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-18T17:22:16.419296] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-18T17:22:16.519547] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-09-18T17:22:17.319563] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-18T17:22:17.921126] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-18T17:22:18.039757] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-18T17:22:18.119554] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-18T17:22:18.919553] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-18T17:22:19.568667] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-18T17:22:19.667842] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-18T17:22:19.719530] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-18T17:22:20.519552] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-18T17:22:20.834162] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-18T17:22:21.319506] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-18T17:22:21.343298] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-18T17:22:22.119544] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-18T17:22:22.538275] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-18T17:22:22.919541] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-18T17:22:23.202932] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-18T17:22:23.727824] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-18T17:22:23.732157] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-18T17:22:24.519611] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-18T17:22:25.205155] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-18T17:22:25.289615] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-18T17:22:25.319504] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-18T17:22:26.093188] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-18T17:22:26.119498] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-18T17:22:26.850971] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-18T17:22:26.919586] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-18T17:22:27.719537] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-18T17:22:27.788265] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-18T17:22:27.791958] [INFO ] [REMOTE ] ASGI: Full fetch complete (33124 records). [2025-09-18T17:22:27.792054] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-18T17:22:28.175419] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-18T17:22:28.175525] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-18T17:22:28.175938] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-18T17:22:28.176004] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-18T17:22:28.176804] [DEBUG] [LOCAL ] ASGI: Trimmed 33124 records to 22345 (keeping 200 days of data) [2025-09-18T17:22:28.316572] [DEBUG] [LOCAL ] ASGI: Primary data saved (22345 records). [2025-09-18T17:22:28.316731] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-18T17:22:28.316849] [INFO ] [MAIN ] Update Progress: 158/2372 symbols completed. ASGI took 22.3s. Estimated remaining: 5h 14m 6s. Rate: 7.0 symbols/min [2025-09-18T17:22:28.519618] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-18T17:22:28.862631] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-18T17:22:29.319568] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-18T17:22:29.394210] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-18T17:22:30.119528] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-18T17:22:30.380586] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-18T17:22:30.919598] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-18T17:22:31.286426] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T17:22:31.719597] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-18T17:22:31.995227] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-18T17:22:32.519562] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-18T17:22:32.963582] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T17:22:33.319616] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-18T17:22:33.455742] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-18T17:22:33.459040] [INFO ] [REMOTE ] ASG: Full fetch complete (31565 records). [2025-09-18T17:22:33.459189] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-18T17:22:33.886073] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-09-18T17:22:33.886202] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-09-18T17:22:33.886880] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-09-18T17:22:33.886947] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-09-18T17:22:33.887820] [DEBUG] [LOCAL ] ASG: Trimmed 31565 records to 21240 (keeping 200 days of data) [2025-09-18T17:22:34.027066] [DEBUG] [LOCAL ] ASG: Primary data saved (21240 records). [2025-09-18T17:22:34.027233] [INFO ] [MAIN ] ASG: Full history saved. [2025-09-18T17:22:34.027418] [INFO ] [MAIN ] Update Progress: 159/2372 symbols completed. ASG took 35.7s. Estimated remaining: 5h 13m 18s. Rate: 7.1 symbols/min [2025-09-18T17:22:34.788287] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-18T17:22:34.794002] [INFO ] [REMOTE ] ASGN: Full fetch complete (51332 records). [2025-09-18T17:22:34.794159] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-18T17:22:35.196870] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-09-18T17:22:35.196964] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-09-18T17:22:35.197563] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-09-18T17:22:35.197638] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-09-18T17:22:35.199319] [DEBUG] [LOCAL ] ASGN: Trimmed 51332 records to 36292 (keeping 200 days of data) [2025-09-18T17:22:35.433631] [DEBUG] [LOCAL ] ASGN: Primary data saved (36292 records). [2025-09-18T17:22:35.433825] [INFO ] [MAIN ] ASGN: Full history saved. [2025-09-18T17:22:35.433986] [INFO ] [MAIN ] Update Progress: 160/2372 symbols completed. ASGN took 27.1s. Estimated remaining: 5h 11m 32s. Rate: 7.1 symbols/min [2025-09-18T17:22:36.105570] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:22:36.229882] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:22:36.231096] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:22:36.233808] [DEBUG] [LOCAL ] ASR: No existing data file found in primary storage. [2025-09-18T17:22:36.258470] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:22:36.259821] [WARN ] [MAIN ] ASR: No existing data found, performing full refresh instead. [2025-09-18T17:22:36.260454] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-18T17:22:36.260535] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-18T17:22:36.263730] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-09-18T17:22:36.266754] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-18T17:22:36.432854] [DEBUG] [LOCAL ] ASIX: Loaded 22393 existing records from primary storage. [2025-09-18T17:22:36.438815] [INFO ] [MAIN ] ASIX: Loaded 22393 existing records. [2025-09-18T17:22:36.617898] [DEBUG] [LOCAL ] ASH: Loaded 38062 existing records from primary storage. [2025-09-18T17:22:36.618125] [INFO ] [MAIN ] ASH: Loaded 38062 existing records. [2025-09-18T17:22:36.649995] [DEBUG] [LOCAL ] ASPN: Loaded 49657 existing records from primary storage. [2025-09-18T17:22:36.721472] [INFO ] [MAIN ] ASPN: Loaded 49657 existing records. [2025-09-18T17:22:37.069390] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:22:37.140962] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-18T17:22:37.180257] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-18T17:22:37.282714] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-09-18T17:22:37.304286] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-18T17:22:37.301051] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:22:37.304592] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:22:37.356304] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:22:37.367197] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-11. [2025-09-18T17:22:37.368448] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-18T17:22:37.368716] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-18T17:22:37.368825] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-18T17:22:37.368663] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-18T17:22:37.412491] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-09-18T17:22:37.419307] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-09-18T17:22:37.437486] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-18T17:22:37.437377] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-18T17:22:38.264547] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-18T17:22:38.323600] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-09-18T17:22:38.518879] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:22:38.552757] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:22:38.558852] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-11. [2025-09-18T17:22:38.569407] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-11. [2025-09-18T17:22:38.592871] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:22:38.594191] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-11. [2025-09-18T17:22:39.293341] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-18T17:22:39.296356] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-09-18T17:22:39.316333] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-18T17:22:39.320062] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-09-18T17:22:39.627923] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-18T17:22:39.719559] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-09-18T17:22:39.901300] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-18T17:22:40.030199] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-18T17:22:40.252632] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-18T17:22:40.519558] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-18T17:22:40.628754] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-18T17:22:41.209502] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-18T17:22:41.319555] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-18T17:22:41.990152] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-18T17:22:42.119563] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-09-18T17:22:42.919581] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-09-18T17:22:43.237948] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-18T17:22:43.523898] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-18T17:22:43.719588] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-18T17:22:44.519561] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-18T17:22:44.704040] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-18T17:22:45.319568] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-18T17:22:45.653502] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-18T17:22:45.907974] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-18T17:22:46.119590] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-18T17:22:46.919553] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-18T17:22:46.931776] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-18T17:22:47.719619] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-18T17:22:48.230188] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-18T17:22:48.519574] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-09-18T17:22:48.639044] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T17:22:49.319790] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-18T17:22:49.952829] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-18T17:22:50.119548] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-09-18T17:22:50.907849] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-18T17:22:50.919495] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-18T17:22:51.571155] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-18T17:22:51.719538] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-18T17:22:52.397134] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-18T17:22:52.519561] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-18T17:22:53.167753] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T17:22:53.319496] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-18T17:22:54.007034] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-18T17:22:54.119595] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-18T17:22:54.757009] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-18T17:22:54.919539] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-18T17:22:54.955479] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-18T17:22:55.405125] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-18T17:22:55.719583] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-18T17:22:56.220635] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-18T17:22:56.519578] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-18T17:22:57.319579] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-18T17:22:57.615582] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-18T17:22:58.119581] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-18T17:22:58.491416] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T17:22:58.858220] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-18T17:22:58.919522] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-18T17:22:59.719563] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-18T17:23:00.519517] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-18T17:23:00.611180] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-18T17:23:01.319560] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-18T17:23:01.495361] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-18T17:23:02.119548] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-18T17:23:02.919528] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-18T17:23:03.209519] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-18T17:23:03.719579] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-18T17:23:04.796786] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-18T17:23:04.803313] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-18T17:23:04.810413] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-18T17:23:04.813010] [INFO ] [REMOTE ] ASR: Full fetch complete (12241 records). [2025-09-18T17:23:04.813115] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-18T17:23:05.199272] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-09-18T17:23:05.199887] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-09-18T17:23:05.200235] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-09-18T17:23:05.200380] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-09-18T17:23:05.201232] [DEBUG] [LOCAL ] ASR: Trimmed 12241 records to 9250 (keeping 200 days of data) [2025-09-18T17:23:05.292920] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-18T17:23:05.304714] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (5.59 seconds). [2025-09-18T17:23:05.319663] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-18T17:23:05.330900] [DEBUG] [LOCAL ] ASR: Primary data saved (9250 records). [2025-09-18T17:23:05.330988] [INFO ] [MAIN ] ASR: Full history saved. [2025-09-18T17:23:05.331060] [INFO ] [MAIN ] Update Progress: 161/2372 symbols completed. ASR took 29.9s. Estimated remaining: 5h 16m 18s. Rate: 7.0 symbols/min [2025-09-18T17:23:05.516454] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:23:05.571205] [DEBUG] [LOCAL ] ASX: Loaded 52930 existing records from primary storage. [2025-09-18T17:23:05.571359] [INFO ] [MAIN ] ASX: Loaded 52930 existing records. [2025-09-18T17:23:05.761670] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:23:05.761995] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-18T17:23:05.762048] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-18T17:23:05.764482] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-09-18T17:23:05.764549] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-18T17:23:06.133801] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-18T17:23:06.139703] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:23:06.157937] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-18T17:23:06.561912] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-18T17:23:06.567064] [INFO ] [REMOTE ] ASH: Full fetch complete (54275 records). [2025-09-18T17:23:06.567179] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-18T17:23:06.919847] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-11. [2025-09-18T17:23:06.965097] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-09-18T17:23:06.965211] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-09-18T17:23:06.965962] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-09-18T17:23:06.966034] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-09-18T17:23:06.967775] [DEBUG] [LOCAL ] ASH: Trimmed 54275 records to 38304 (keeping 200 days of data) [2025-09-18T17:23:07.228174] [DEBUG] [LOCAL ] ASH: Primary data saved (38304 records). [2025-09-18T17:23:07.228329] [INFO ] [MAIN ] ASH: Full history saved. [2025-09-18T17:23:07.228419] [INFO ] [MAIN ] Update Progress: 162/2372 symbols completed. ASH took 31.8s. Estimated remaining: 5h 14m 38s. Rate: 7.0 symbols/min [2025-09-18T17:23:07.443250] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:23:07.443455] [DEBUG] [LOCAL ] ATEN: No existing data file found in primary storage. [2025-09-18T17:23:07.443495] [WARN ] [MAIN ] ATEN: No existing data found, performing full refresh instead. [2025-09-18T17:23:07.443754] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-18T17:23:07.443828] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-18T17:23:07.443886] [DEBUG] [LOCAL ] ATEN: No primary data file found to delete. [2025-09-18T17:23:07.443952] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-18T17:23:07.721290] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-18T17:23:07.856325] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:23:07.893966] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-18T17:23:08.519513] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-18T17:23:08.615379] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-18T17:23:08.843442] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T17:23:08.846756] [INFO ] [REMOTE ] ASIX: Full fetch complete (29454 records). [2025-09-18T17:23:08.846849] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-18T17:23:08.847430] [FATAL] [VALIDATOR ] ASIX: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:23:08.847517] [FATAL] [MAIN ] ASIX: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:23:08.847562] [WARN ] [MAIN ] ASIX: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:23:08.847668] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-18T17:23:08.847761] [DEBUG] [LOCAL ] ASIX: No primary data file found to delete. [2025-09-18T17:23:08.847848] [INFO ] [LOCAL ] ASIX: Starting deletion of derivative data. [2025-09-18T17:23:08.848372] [DEBUG] [LOCAL ] ASIX: Deleted derivative data file. [2025-09-18T17:23:08.848477] [INFO ] [MAIN ] Update Progress: 163/2372 symbols completed. ASIX took 33.4s. Estimated remaining: 5h 12m 56s. Rate: 7.1 symbols/min [2025-09-18T17:23:09.035114] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:23:09.074919] [DEBUG] [LOCAL ] ATGE: Loaded 32168 existing records from primary storage. [2025-09-18T17:23:09.075062] [INFO ] [MAIN ] ATGE: Loaded 32168 existing records. [2025-09-18T17:23:09.264702] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:23:09.264961] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-18T17:23:09.265010] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-18T17:23:09.266418] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-18T17:23:09.266495] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-18T17:23:09.329572] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-09-18T17:23:09.628786] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:23:09.988426] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T17:23:10.119558] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-18T17:23:10.919562] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-11. [2025-09-18T17:23:11.153421] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-18T17:23:11.378730] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-18T17:23:11.388702] [INFO ] [REMOTE ] ASPN: Full fetch complete (71878 records). [2025-09-18T17:23:11.388869] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-18T17:23:11.389608] [FATAL] [VALIDATOR ] ASPN: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:23:11.389721] [FATAL] [MAIN ] ASPN: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:23:11.389766] [WARN ] [MAIN ] ASPN: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:23:11.389846] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-18T17:23:11.389931] [DEBUG] [LOCAL ] ASPN: No primary data file found to delete. [2025-09-18T17:23:11.389970] [INFO ] [LOCAL ] ASPN: Starting deletion of derivative data. [2025-09-18T17:23:11.390515] [DEBUG] [LOCAL ] ASPN: Deleted derivative data file. [2025-09-18T17:23:11.390618] [INFO ] [MAIN ] Update Progress: 164/2372 symbols completed. ASPN took 36.0s. Estimated remaining: 5h 11m 27s. Rate: 7.1 symbols/min [2025-09-18T17:23:11.573865] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:23:11.612037] [DEBUG] [LOCAL ] ATHM: Loaded 33171 existing records from primary storage. [2025-09-18T17:23:11.612202] [INFO ] [MAIN ] ATHM: Loaded 33171 existing records. [2025-09-18T17:23:11.724626] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-09-18T17:23:11.801523] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:23:11.801786] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-18T17:23:11.801842] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-18T17:23:11.802948] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-18T17:23:11.803015] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-18T17:23:12.174898] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:23:12.195037] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-18T17:23:12.519637] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-11. [2025-09-18T17:23:13.259885] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-18T17:23:13.319561] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-18T17:23:13.531486] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T17:23:14.119601] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-11. [2025-09-18T17:23:14.666723] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T17:23:14.919590] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-18T17:23:15.583632] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-18T17:23:15.719531] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-09-18T17:23:16.365726] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-18T17:23:16.519541] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-18T17:23:16.998867] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-18T17:23:17.319577] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-09-18T17:23:17.434558] [DEBUG] [REMOTE ] ATEN: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-18T17:23:17.434949] [WARN ] [REMOTE ] ATEN: No data returned for month 2024-12 [2025-09-18T17:23:18.082872] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-18T17:23:18.119505] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-18T17:23:18.919600] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-09-18T17:23:19.719536] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-09-18T17:23:20.026303] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-18T17:23:20.106692] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-18T17:23:20.519579] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-09-18T17:23:20.720976] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-18T17:23:21.319573] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-18T17:23:21.638045] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-18T17:23:22.119579] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-18T17:23:22.919565] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-18T17:23:23.102494] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-18T17:23:23.228605] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-18T17:23:23.719552] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-09-18T17:23:24.150958] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-18T17:23:24.519564] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-18T17:23:25.009866] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-18T17:23:25.319560] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-18T17:23:25.597475] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-18T17:23:26.119551] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-18T17:23:26.427358] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-18T17:23:26.919542] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-18T17:23:27.615978] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-18T17:23:27.719503] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-18T17:23:28.124801] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-18T17:23:28.519572] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-18T17:23:29.319618] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-18T17:23:29.495009] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-18T17:23:29.567957] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-18T17:23:30.119543] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-18T17:23:30.438797] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-18T17:23:30.919581] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-18T17:23:31.221979] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-18T17:23:31.719532] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-18T17:23:32.518097] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-18T17:23:32.527619] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-18T17:23:32.912301] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-18T17:23:33.319552] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-18T17:23:34.091381] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T17:23:34.119491] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-18T17:23:34.491615] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-18T17:23:34.919546] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-18T17:23:35.552927] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T17:23:35.719553] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-18T17:23:36.519571] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-18T17:23:36.844265] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-18T17:23:36.852500] [INFO ] [REMOTE ] ASX: Full fetch complete (76487 records). [2025-09-18T17:23:36.852636] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-18T17:23:37.240962] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-18T17:23:37.324674] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-18T17:23:37.348635] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-09-18T17:23:37.348768] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-09-18T17:23:37.349565] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-09-18T17:23:37.349783] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-09-18T17:23:37.351321] [DEBUG] [LOCAL ] ASX: Trimmed 76487 records to 53316 (keeping 200 days of data) [2025-09-18T17:23:37.690439] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T17:23:37.720545] [DEBUG] [LOCAL ] ASX: Primary data saved (53316 records). [2025-09-18T17:23:37.720733] [INFO ] [MAIN ] ASX: Full history saved. [2025-09-18T17:23:37.720836] [INFO ] [MAIN ] Update Progress: 165/2372 symbols completed. ASX took 32.4s. Estimated remaining: 5h 15m 17s. Rate: 7.0 symbols/min [2025-09-18T17:23:37.895363] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:23:37.905134] [DEBUG] [LOCAL ] ATHS: Loaded 7178 existing records from primary storage. [2025-09-18T17:23:37.905285] [INFO ] [MAIN ] ATHS: Loaded 7178 existing records. [2025-09-18T17:23:38.090490] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:23:38.090787] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-18T17:23:38.090843] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-18T17:23:38.091200] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-09-18T17:23:38.091261] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-18T17:23:38.124195] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-18T17:23:38.414215] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-18T17:23:38.502177] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:23:38.919578] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-11. [2025-09-18T17:23:39.588988] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T17:23:39.589726] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-18T17:23:39.719524] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-18T17:23:40.519544] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-18T17:23:40.629382] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-18T17:23:41.319554] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-18T17:23:41.610496] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-18T17:23:42.119562] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-09-18T17:23:42.296354] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-18T17:23:42.839289] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-18T17:23:42.919493] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-09-18T17:23:43.504963] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-18T17:23:43.719538] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-18T17:23:44.133826] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-18T17:23:44.519547] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-18T17:23:45.319622] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-18T17:23:45.431721] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-18T17:23:45.435620] [INFO ] [REMOTE ] ATGE: Full fetch complete (46205 records). [2025-09-18T17:23:45.435737] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-18T17:23:45.813715] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-18T17:23:45.813811] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-18T17:23:45.814333] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-18T17:23:45.814398] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-18T17:23:45.815522] [DEBUG] [LOCAL ] ATGE: Trimmed 46205 records to 32387 (keeping 200 days of data) [2025-09-18T17:23:46.008068] [DEBUG] [LOCAL ] ATGE: Primary data saved (32387 records). [2025-09-18T17:23:46.008207] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-18T17:23:46.008289] [INFO ] [MAIN ] Update Progress: 166/2372 symbols completed. ATGE took 37.2s. Estimated remaining: 5h 15m 5s. Rate: 7.0 symbols/min [2025-09-18T17:23:46.124738] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-18T17:23:46.187131] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:23:46.238695] [DEBUG] [LOCAL ] ATI: Loaded 51695 existing records from primary storage. [2025-09-18T17:23:46.238875] [INFO ] [MAIN ] ATI: Loaded 51695 existing records. [2025-09-18T17:23:46.418100] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:23:46.418361] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-18T17:23:46.418410] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-18T17:23:46.420732] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-18T17:23:46.420796] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-18T17:23:46.802513] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:23:46.810271] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-18T17:23:46.830613] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-18T17:23:46.919555] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-18T17:23:47.719514] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-18T17:23:48.117261] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-18T17:23:48.121010] [INFO ] [REMOTE ] ATHM: Full fetch complete (52339 records). [2025-09-18T17:23:48.121112] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-18T17:23:48.511174] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-09-18T17:23:48.511270] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-09-18T17:23:48.511878] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-09-18T17:23:48.511944] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-09-18T17:23:48.513130] [DEBUG] [LOCAL ] ATHM: Trimmed 52339 records to 33337 (keeping 200 days of data) [2025-09-18T17:23:48.563348] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-18T17:23:48.711336] [DEBUG] [LOCAL ] ATHM: Primary data saved (33337 records). [2025-09-18T17:23:48.711482] [INFO ] [MAIN ] ATHM: Full history saved. [2025-09-18T17:23:48.711567] [INFO ] [MAIN ] Update Progress: 167/2372 symbols completed. ATHM took 37.3s. Estimated remaining: 5h 13m 39s. Rate: 7.0 symbols/min [2025-09-18T17:23:48.881467] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:23:48.918840] [DEBUG] [LOCAL ] ATKR: Loaded 35859 existing records from primary storage. [2025-09-18T17:23:48.918990] [INFO ] [MAIN ] ATKR: Loaded 35859 existing records. [2025-09-18T17:23:49.107876] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:23:49.127922] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-18T17:23:49.127565] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-18T17:23:49.128143] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-18T17:23:49.132226] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-18T17:23:49.132276] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-09-18T17:23:49.134248] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-18T17:23:49.181448] [INFO ] [REMOTE ] ATEN: Full fetch complete (51768 records). [2025-09-18T17:23:49.208063] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-18T17:23:49.326072] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-18T17:23:49.643254] [WARN ] [VALIDATOR ] ATEN: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-18T17:23:49.668337] [FATAL] [MAIN ] ATEN: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:23:49.698593] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:23:49.693613] [WARN ] [MAIN ] ATEN: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:23:49.699034] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-18T17:23:49.699115] [DEBUG] [LOCAL ] ATEN: No primary data file found to delete. [2025-09-18T17:23:49.699154] [INFO ] [LOCAL ] ATEN: Starting deletion of derivative data. [2025-09-18T17:23:49.699194] [DEBUG] [LOCAL ] ATEN: No derivative data file found to delete. [2025-09-18T17:23:49.699255] [INFO ] [MAIN ] Update Progress: 168/2372 symbols completed. ATEN took 42.5s. Estimated remaining: 5h 11m 51s. Rate: 7.1 symbols/min [2025-09-18T17:23:49.866407] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:23:49.909930] [DEBUG] [LOCAL ] ATMU: Loaded 39701 existing records from primary storage. [2025-09-18T17:23:49.910092] [INFO ] [MAIN ] ATMU: Loaded 39701 existing records. [2025-09-18T17:23:50.085604] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:23:50.085890] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-18T17:23:50.085938] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-18T17:23:50.087169] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-09-18T17:23:50.087231] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-18T17:23:50.128985] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-11. [2025-09-18T17:23:50.387289] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-18T17:23:50.455130] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:23:50.919529] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-11. [2025-09-18T17:23:51.719575] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-18T17:23:51.799694] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-18T17:23:52.009569] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T17:23:52.149482] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-18T17:23:52.519580] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-09-18T17:23:53.319601] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-11. [2025-09-18T17:23:53.524933] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-18T17:23:54.119558] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-09-18T17:23:54.919540] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-18T17:23:54.971011] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T17:23:55.260537] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-18T17:23:55.393559] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-18T17:23:55.719547] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-09-18T17:23:56.519545] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-09-18T17:23:57.319550] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-09-18T17:23:57.352814] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-18T17:23:57.550062] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-18T17:23:58.119571] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-18T17:23:58.752763] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T17:23:58.919580] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-09-18T17:23:59.359833] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-18T17:23:59.719616] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-18T17:24:00.435780] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T17:24:00.519522] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-18T17:24:00.894735] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-18T17:24:01.319568] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-18T17:24:01.735052] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T17:24:02.080560] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-18T17:24:02.119551] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-18T17:24:02.851188] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-18T17:24:02.852606] [INFO ] [REMOTE ] ATHS: Full fetch complete (10039 records). [2025-09-18T17:24:02.852700] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-18T17:24:02.924760] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-18T17:24:03.234269] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-09-18T17:24:03.234360] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-09-18T17:24:03.234707] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-18T17:24:03.234771] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-09-18T17:24:03.235256] [DEBUG] [LOCAL ] ATHS: Trimmed 10039 records to 7270 (keeping 200 days of data) [2025-09-18T17:24:03.282053] [DEBUG] [LOCAL ] ATHS: Primary data saved (7270 records). [2025-09-18T17:24:03.282201] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-18T17:24:03.282292] [INFO ] [MAIN ] Update Progress: 169/2372 symbols completed. ATHS took 25.6s. Estimated remaining: 5h 12m 49s. Rate: 7.0 symbols/min [2025-09-18T17:24:03.455200] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:24:03.505118] [DEBUG] [LOCAL ] ATO: Loaded 42098 existing records from primary storage. [2025-09-18T17:24:03.505290] [INFO ] [MAIN ] ATO: Loaded 42098 existing records. [2025-09-18T17:24:03.688953] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:24:03.689329] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-18T17:24:03.689390] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-18T17:24:03.691955] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-18T17:24:03.692021] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-18T17:24:03.724666] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-18T17:24:04.071182] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:24:04.362466] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-18T17:24:04.519753] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-18T17:24:05.225369] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-18T17:24:05.319545] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-18T17:24:05.897038] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-18T17:24:06.119550] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-18T17:24:06.473060] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-18T17:24:06.919553] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-18T17:24:07.039238] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-18T17:24:07.719714] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-11. [2025-09-18T17:24:08.519543] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-18T17:24:08.808966] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-18T17:24:08.891488] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-18T17:24:09.319599] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-09-18T17:24:09.594911] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-18T17:24:10.119551] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-18T17:24:10.471965] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-18T17:24:10.919579] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-18T17:24:11.060031] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-18T17:24:11.719591] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-18T17:24:12.286938] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T17:24:12.519550] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-18T17:24:13.197575] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T17:24:13.319557] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-18T17:24:13.818610] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T17:24:14.119552] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-18T17:24:14.801945] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-18T17:24:14.919543] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-18T17:24:15.294301] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-18T17:24:15.719551] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-18T17:24:16.166085] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-18T17:24:16.519565] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-18T17:24:16.866938] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-18T17:24:16.871791] [INFO ] [REMOTE ] ATKR: Full fetch complete (53234 records). [2025-09-18T17:24:16.871880] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-18T17:24:16.872678] [FATAL] [VALIDATOR ] ATKR: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:24:16.872782] [FATAL] [MAIN ] ATKR: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:24:16.872862] [WARN ] [MAIN ] ATKR: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:24:16.872962] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-18T17:24:16.873055] [DEBUG] [LOCAL ] ATKR: No primary data file found to delete. [2025-09-18T17:24:16.873113] [INFO ] [LOCAL ] ATKR: Starting deletion of derivative data. [2025-09-18T17:24:16.873493] [DEBUG] [LOCAL ] ATKR: Deleted derivative data file. [2025-09-18T17:24:16.873587] [INFO ] [MAIN ] Update Progress: 170/2372 symbols completed. ATKR took 28.2s. Estimated remaining: 5h 13m 47s. Rate: 7.0 symbols/min [2025-09-18T17:24:17.044040] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:24:17.077239] [DEBUG] [LOCAL ] ATR: Loaded 30528 existing records from primary storage. [2025-09-18T17:24:17.077374] [INFO ] [MAIN ] ATR: Loaded 30528 existing records. [2025-09-18T17:24:17.255326] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:24:17.255593] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-18T17:24:17.255667] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-18T17:24:17.257685] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-18T17:24:17.257748] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-18T17:24:17.324692] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-18T17:24:17.616859] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:24:17.885311] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-18T17:24:18.119533] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-09-18T17:24:18.545477] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-18T17:24:18.919558] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-18T17:24:19.719557] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-11. [2025-09-18T17:24:19.787353] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-18T17:24:20.369745] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T17:24:20.519607] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-18T17:24:20.698469] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-18T17:24:21.319612] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-18T17:24:21.840189] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-18T17:24:21.847227] [INFO ] [REMOTE ] ATI: Full fetch complete (73603 records). [2025-09-18T17:24:21.847356] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-18T17:24:22.125505] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-18T17:24:22.249638] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-18T17:24:22.249755] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-18T17:24:22.250458] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-18T17:24:22.250514] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-18T17:24:22.252083] [DEBUG] [LOCAL ] ATI: Trimmed 73603 records to 52046 (keeping 200 days of data) [2025-09-18T17:24:22.569944] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T17:24:22.604705] [DEBUG] [LOCAL ] ATI: Primary data saved (52046 records). [2025-09-18T17:24:22.605216] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-18T17:24:22.605373] [INFO ] [MAIN ] Update Progress: 171/2372 symbols completed. ATI took 36.6s. Estimated remaining: 5h 13m 2s. Rate: 7.0 symbols/min [2025-09-18T17:24:22.779477] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:24:22.798563] [DEBUG] [LOCAL ] ATS: Loaded 18287 existing records from primary storage. [2025-09-18T17:24:22.798734] [INFO ] [MAIN ] ATS: Loaded 18287 existing records. [2025-09-18T17:24:22.924759] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-09-18T17:24:22.977628] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:24:22.977904] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-18T17:24:22.977965] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-18T17:24:22.978564] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-18T17:24:22.978624] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-18T17:24:23.348036] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:24:23.408693] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-18T17:24:23.719560] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-18T17:24:23.827836] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-18T17:24:24.519547] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-09-18T17:24:24.945278] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T17:24:25.319575] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-18T17:24:25.837567] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-18T17:24:26.119561] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-18T17:24:26.646178] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T17:24:26.652290] [INFO ] [REMOTE ] ATMU: Full fetch complete (56644 records). [2025-09-18T17:24:26.652397] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-18T17:24:26.924604] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-18T17:24:27.051981] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-09-18T17:24:27.052111] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-09-18T17:24:27.052827] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-09-18T17:24:27.052907] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-09-18T17:24:27.054720] [DEBUG] [LOCAL ] ATMU: Trimmed 56644 records to 40021 (keeping 200 days of data) [2025-09-18T17:24:27.169443] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-18T17:24:27.336632] [DEBUG] [LOCAL ] ATMU: Primary data saved (40021 records). [2025-09-18T17:24:27.336790] [INFO ] [MAIN ] ATMU: Full history saved. [2025-09-18T17:24:27.336872] [INFO ] [MAIN ] Update Progress: 172/2372 symbols completed. ATMU took 37.6s. Estimated remaining: 5h 12m 5s. Rate: 7.0 symbols/min [2025-09-18T17:24:27.561517] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:24:27.607492] [DEBUG] [LOCAL ] ATUS: Loaded 49186 existing records from primary storage. [2025-09-18T17:24:27.607634] [INFO ] [MAIN ] ATUS: Loaded 49186 existing records. [2025-09-18T17:24:27.724867] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-18T17:24:27.807345] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:24:27.807590] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-18T17:24:27.807663] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-18T17:24:27.809295] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-09-18T17:24:27.809360] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-18T17:24:28.177795] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:24:28.519815] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-11. [2025-09-18T17:24:28.719697] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-18T17:24:28.740525] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-18T17:24:29.222860] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-18T17:24:29.319569] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-18T17:24:30.119564] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-18T17:24:30.919546] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-09-18T17:24:31.087832] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-18T17:24:31.166880] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-18T17:24:31.543279] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-18T17:24:31.719578] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-11. [2025-09-18T17:24:32.519544] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-09-18T17:24:32.956145] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-18T17:24:33.229106] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-18T17:24:33.319513] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-18T17:24:34.119558] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-09-18T17:24:34.527874] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-18T17:24:34.919556] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-18T17:24:35.278386] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-18T17:24:35.719556] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-09-18T17:24:36.210682] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-18T17:24:36.519587] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-18T17:24:36.850566] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-18T17:24:37.319565] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-18T17:24:37.461007] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-18T17:24:38.119559] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-18T17:24:38.623979] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-18T17:24:38.919565] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-18T17:24:39.041211] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T17:24:39.670456] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-18T17:24:39.719507] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-18T17:24:40.416609] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-18T17:24:40.519512] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-18T17:24:41.319534] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-18T17:24:41.559849] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-18T17:24:42.119549] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-18T17:24:42.627351] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-18T17:24:42.919569] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-18T17:24:43.530998] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T17:24:43.719580] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-18T17:24:44.296389] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-18T17:24:44.338756] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-18T17:24:44.519583] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-18T17:24:45.282018] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-18T17:24:45.319559] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-18T17:24:46.119552] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-18T17:24:46.906880] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T17:24:46.919493] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-18T17:24:47.403870] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-18T17:24:47.410413] [INFO ] [REMOTE ] ATO: Full fetch complete (60261 records). [2025-09-18T17:24:47.410556] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-18T17:24:47.724678] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-18T17:24:47.825236] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-18T17:24:47.825325] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-18T17:24:47.826001] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-18T17:24:47.826085] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-18T17:24:47.827511] [DEBUG] [LOCAL ] ATO: Trimmed 60261 records to 42420 (keeping 200 days of data) [2025-09-18T17:24:48.099766] [DEBUG] [LOCAL ] ATO: Primary data saved (42420 records). [2025-09-18T17:24:48.099943] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-18T17:24:48.100105] [INFO ] [MAIN ] Update Progress: 173/2372 symbols completed. ATO took 44.8s. Estimated remaining: 5h 14m 32s. Rate: 7.0 symbols/min [2025-09-18T17:24:48.281250] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:24:48.346183] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T17:24:48.374239] [DEBUG] [LOCAL ] AU: Loaded 52903 existing records from primary storage. [2025-09-18T17:24:48.374395] [INFO ] [MAIN ] AU: Loaded 52903 existing records. [2025-09-18T17:24:48.522315] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-18T17:24:48.559485] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:24:48.559753] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-18T17:24:48.559811] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-18T17:24:48.561017] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-18T17:24:48.561077] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-18T17:24:48.932552] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:24:48.984343] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-18T17:24:49.319557] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-11. [2025-09-18T17:24:49.546679] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-18T17:24:50.119547] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-18T17:24:50.879797] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-18T17:24:50.919502] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-09-18T17:24:51.062276] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-18T17:24:51.066945] [INFO ] [REMOTE ] ATR: Full fetch complete (43111 records). [2025-09-18T17:24:51.067035] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-18T17:24:51.476550] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-18T17:24:51.476632] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-18T17:24:51.477170] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-18T17:24:51.477220] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-18T17:24:51.478176] [DEBUG] [LOCAL ] ATR: Trimmed 43111 records to 30720 (keeping 200 days of data) [2025-09-18T17:24:51.676426] [DEBUG] [LOCAL ] ATR: Primary data saved (30720 records). [2025-09-18T17:24:51.676571] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-18T17:24:51.676689] [INFO ] [MAIN ] Update Progress: 174/2372 symbols completed. ATR took 34.8s. Estimated remaining: 5h 13m 20s. Rate: 7.0 symbols/min [2025-09-18T17:24:51.724849] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-18T17:24:51.861439] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:24:51.914685] [DEBUG] [LOCAL ] AUB: Loaded 46522 existing records from primary storage. [2025-09-18T17:24:51.914849] [INFO ] [MAIN ] AUB: Loaded 46522 existing records. [2025-09-18T17:24:52.177711] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:24:52.178060] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-18T17:24:52.178122] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-18T17:24:52.181024] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-18T17:24:52.181135] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-18T17:24:52.527243] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-18T17:24:52.772796] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:24:52.811310] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-18T17:24:53.144242] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-18T17:24:53.305564] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-18T17:24:53.308628] [INFO ] [REMOTE ] ATS: Full fetch complete (25946 records). [2025-09-18T17:24:53.308843] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-18T17:24:53.324695] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-09-18T17:24:53.686982] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-18T17:24:53.687071] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-18T17:24:53.687468] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-18T17:24:53.687512] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-18T17:24:53.688315] [DEBUG] [LOCAL ] ATS: Trimmed 25946 records to 18391 (keeping 200 days of data) [2025-09-18T17:24:53.801200] [DEBUG] [LOCAL ] ATS: Primary data saved (18391 records). [2025-09-18T17:24:53.801359] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-18T17:24:53.801448] [INFO ] [MAIN ] Update Progress: 175/2372 symbols completed. ATS took 31.2s. Estimated remaining: 5h 11m 51s. Rate: 7.0 symbols/min [2025-09-18T17:24:53.979487] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:24:53.987106] [DEBUG] [LOCAL ] AUNA: Loaded 4613 existing records from primary storage. [2025-09-18T17:24:53.987223] [INFO ] [MAIN ] AUNA: Loaded 4613 existing records. [2025-09-18T17:24:54.128106] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-18T17:24:54.169525] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:24:54.169918] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-18T17:24:54.169975] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-18T17:24:54.170270] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-09-18T17:24:54.170332] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-18T17:24:54.554184] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:24:54.919583] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-11. [2025-09-18T17:24:55.305032] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-18T17:24:55.719567] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-11. [2025-09-18T17:24:55.757617] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-18T17:24:56.519516] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-18T17:24:56.703735] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-18T17:24:56.778887] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-18T17:24:57.319549] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-09-18T17:24:57.683631] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-18T17:24:57.875158] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T17:24:58.119558] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-09-18T17:24:58.538514] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-18T17:24:58.919573] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-18T17:24:59.719583] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-09-18T17:25:00.190957] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-18T17:25:00.519610] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-18T17:25:01.120162] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-18T17:25:01.147381] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-18T17:25:01.319570] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-18T17:25:02.119585] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-09-18T17:25:02.919558] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-18T17:25:03.255037] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-18T17:25:03.334222] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-18T17:25:03.719563] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-18T17:25:04.519550] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-18T17:25:04.741356] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-18T17:25:04.748771] [INFO ] [REMOTE ] ATUS: Full fetch complete (70738 records). [2025-09-18T17:25:04.748959] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-18T17:25:05.139537] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-18T17:25:05.183367] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-09-18T17:25:05.183460] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-09-18T17:25:05.184292] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-09-18T17:25:05.184391] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-09-18T17:25:05.185881] [DEBUG] [LOCAL ] ATUS: Trimmed 70738 records to 49567 (keeping 200 days of data) [2025-09-18T17:25:05.319546] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-18T17:25:05.510491] [DEBUG] [LOCAL ] ATUS: Primary data saved (49567 records). [2025-09-18T17:25:05.511225] [INFO ] [MAIN ] ATUS: Full history saved. [2025-09-18T17:25:05.511411] [INFO ] [MAIN ] Update Progress: 176/2372 symbols completed. ATUS took 38.2s. Estimated remaining: 5h 12m 22s. Rate: 7.0 symbols/min [2025-09-18T17:25:05.718565] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:25:05.720580] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-18T17:25:05.736458] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-18T17:25:05.777137] [DEBUG] [LOCAL ] AVA: Loaded 39697 existing records from primary storage. [2025-09-18T17:25:05.777279] [INFO ] [MAIN ] AVA: Loaded 39697 existing records. [2025-09-18T17:25:05.960112] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:25:05.960406] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-18T17:25:05.960486] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-18T17:25:05.961917] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-18T17:25:05.961989] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-18T17:25:06.119832] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-18T17:25:06.335766] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:25:06.619144] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-18T17:25:06.919568] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-18T17:25:07.719543] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-11. [2025-09-18T17:25:08.519551] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-18T17:25:08.999943] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-18T17:25:09.015916] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-18T17:25:09.319513] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-18T17:25:09.401600] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-18T17:25:09.687874] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-18T17:25:10.119560] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-09-18T17:25:10.919545] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-18T17:25:11.278007] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-18T17:25:11.519295] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-18T17:25:11.719549] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-09-18T17:25:12.519567] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-18T17:25:12.722268] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-18T17:25:13.319550] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-18T17:25:14.119580] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-18T17:25:14.248169] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-18T17:25:14.830436] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-18T17:25:14.831759] [INFO ] [REMOTE ] AUNA: Full fetch complete (7332 records). [2025-09-18T17:25:14.831866] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-18T17:25:14.832339] [FATAL] [VALIDATOR ] AUNA: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:25:14.832441] [FATAL] [MAIN ] AUNA: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:25:14.832742] [WARN ] [MAIN ] AUNA: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:25:14.832874] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-18T17:25:14.833081] [DEBUG] [LOCAL ] AUNA: No primary data file found to delete. [2025-09-18T17:25:14.833249] [INFO ] [LOCAL ] AUNA: Starting deletion of derivative data. [2025-09-18T17:25:14.834279] [DEBUG] [LOCAL ] AUNA: Deleted derivative data file. [2025-09-18T17:25:14.834583] [INFO ] [MAIN ] Update Progress: 177/2372 symbols completed. AUNA took 21.0s. Estimated remaining: 5h 12m 23s. Rate: 7.0 symbols/min [2025-09-18T17:25:14.924628] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-18T17:25:14.939478] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-18T17:25:15.057818] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:25:15.072187] [DEBUG] [LOCAL ] AVAL: Loaded 9561 existing records from primary storage. [2025-09-18T17:25:15.072309] [INFO ] [MAIN ] AVAL: Loaded 9561 existing records. [2025-09-18T17:25:15.261999] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:25:15.262593] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-18T17:25:15.262674] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-18T17:25:15.263291] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-18T17:25:15.263352] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-18T17:25:15.625056] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:25:15.719519] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-11. [2025-09-18T17:25:16.195902] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-18T17:25:16.519539] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-18T17:25:16.651000] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-18T17:25:17.319574] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-18T17:25:17.925481] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T17:25:18.119596] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-18T17:25:18.919509] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-18T17:25:19.198905] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-18T17:25:19.350598] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T17:25:19.720101] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-09-18T17:25:20.176101] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-18T17:25:20.496848] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-18T17:25:20.519504] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-09-18T17:25:21.319570] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-18T17:25:21.454508] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-18T17:25:22.119607] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-18T17:25:22.688147] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-18T17:25:22.919533] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-18T17:25:22.961249] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T17:25:23.719596] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-18T17:25:24.302386] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-18T17:25:24.391463] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-18T17:25:24.519567] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-18T17:25:25.319549] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-18T17:25:26.022850] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-18T17:25:26.119516] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-18T17:25:26.830394] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-18T17:25:26.919574] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-18T17:25:27.719628] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-18T17:25:27.940514] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-18T17:25:28.321967] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-18T17:25:28.329431] [INFO ] [REMOTE ] AU: Full fetch complete (76091 records). [2025-09-18T17:25:28.329555] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-18T17:25:28.504047] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-18T17:25:28.528993] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-18T17:25:28.755876] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-18T17:25:28.755970] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-18T17:25:28.756713] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-18T17:25:28.756778] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-18T17:25:28.758226] [DEBUG] [LOCAL ] AU: Trimmed 76091 records to 53292 (keeping 200 days of data) [2025-09-18T17:25:29.096238] [DEBUG] [LOCAL ] AU: Primary data saved (53292 records). [2025-09-18T17:25:29.096384] [INFO ] [MAIN ] AU: Full history saved. [2025-09-18T17:25:29.096513] [INFO ] [MAIN ] Update Progress: 178/2372 symbols completed. AU took 41.0s. Estimated remaining: 5h 13m 25s. Rate: 7.0 symbols/min [2025-09-18T17:25:29.268729] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:25:29.313362] [DEBUG] [LOCAL ] AVB: Loaded 41534 existing records from primary storage. [2025-09-18T17:25:29.313534] [INFO ] [MAIN ] AVB: Loaded 41534 existing records. [2025-09-18T17:25:29.324683] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-18T17:25:29.514809] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:25:29.515099] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-18T17:25:29.515160] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-18T17:25:29.516887] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-18T17:25:29.516950] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-18T17:25:29.896247] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:25:29.903016] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-18T17:25:29.962395] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T17:25:30.119563] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-18T17:25:30.574954] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-18T17:25:30.919583] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-11. [2025-09-18T17:25:31.719551] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-18T17:25:32.062311] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-18T17:25:32.272767] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-18T17:25:32.519613] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-09-18T17:25:33.319602] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-18T17:25:34.005901] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T17:25:34.119538] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-18T17:25:34.485308] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-18T17:25:34.919556] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-18T17:25:35.299888] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-18T17:25:35.719625] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-09-18T17:25:36.093211] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-18T17:25:36.519553] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-18T17:25:37.121405] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-18T17:25:37.319554] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-18T17:25:37.853007] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-18T17:25:38.119555] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-18T17:25:38.391692] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-18T17:25:38.919596] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-18T17:25:39.489320] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-18T17:25:39.719563] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-18T17:25:40.049738] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-18T17:25:40.059414] [INFO ] [REMOTE ] AVA: Full fetch complete (55405 records). [2025-09-18T17:25:40.059606] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-18T17:25:40.486689] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-18T17:25:40.486804] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-18T17:25:40.487468] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-18T17:25:40.487515] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-18T17:25:40.488779] [DEBUG] [LOCAL ] AVA: Trimmed 55405 records to 40043 (keeping 200 days of data) [2025-09-18T17:25:40.552707] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-18T17:25:40.759178] [DEBUG] [LOCAL ] AVA: Primary data saved (40043 records). [2025-09-18T17:25:40.759312] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-18T17:25:40.759397] [INFO ] [MAIN ] Update Progress: 179/2372 symbols completed. AVA took 35.2s. Estimated remaining: 5h 13m 55s. Rate: 7.0 symbols/min [2025-09-18T17:25:40.960580] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:25:40.960901] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-18T17:25:40.961023] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-18T17:25:40.961321] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-18T17:25:40.961474] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-18T17:25:40.961597] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-18T17:25:40.961755] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-18T17:25:41.321886] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-18T17:25:41.390976] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:25:41.366917] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-18T17:25:41.868484] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-18T17:25:42.045099] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T17:25:42.052386] [INFO ] [REMOTE ] AUB: Full fetch complete (65214 records). [2025-09-18T17:25:42.052532] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-18T17:25:42.124682] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-18T17:25:42.461705] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-18T17:25:42.461804] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-18T17:25:42.462463] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-18T17:25:42.462566] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-18T17:25:42.464070] [DEBUG] [LOCAL ] AUB: Trimmed 65214 records to 46863 (keeping 200 days of data) [2025-09-18T17:25:42.767659] [DEBUG] [LOCAL ] AUB: Primary data saved (46863 records). [2025-09-18T17:25:42.767808] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-18T17:25:42.767897] [INFO ] [MAIN ] Update Progress: 180/2372 symbols completed. AUB took 51.1s. Estimated remaining: 5h 12m 26s. Rate: 7.0 symbols/min [2025-09-18T17:25:42.921964] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-11. [2025-09-18T17:25:42.941371] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:25:42.967331] [DEBUG] [LOCAL ] AVD: Loaded 23294 existing records from primary storage. [2025-09-18T17:25:42.967488] [INFO ] [MAIN ] AVD: Loaded 23294 existing records. [2025-09-18T17:25:43.140945] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:25:43.144996] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:25:43.145257] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-11 [2025-09-18T17:25:43.145559] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-18T17:25:43.145913] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-18T17:25:43.147109] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-18T17:25:43.147170] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-18T17:25:43.560596] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:25:43.719554] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-18T17:25:44.109227] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-18T17:25:44.212715] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-18T17:25:44.214243] [INFO ] [REMOTE ] AVAL: Full fetch complete (14657 records). [2025-09-18T17:25:44.214319] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-18T17:25:44.523262] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-11. [2025-09-18T17:25:44.611346] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-18T17:25:44.611425] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-18T17:25:44.611763] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-18T17:25:44.611827] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-18T17:25:44.612351] [DEBUG] [LOCAL ] AVAL: Trimmed 14657 records to 9597 (keeping 200 days of data) [2025-09-18T17:25:44.678264] [DEBUG] [LOCAL ] AVAL: Primary data saved (9597 records). [2025-09-18T17:25:44.678463] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-18T17:25:44.678598] [INFO ] [MAIN ] Update Progress: 181/2372 symbols completed. AVAL took 29.8s. Estimated remaining: 5h 10m 57s. Rate: 7.0 symbols/min [2025-09-18T17:25:44.870550] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:25:44.892791] [DEBUG] [LOCAL ] AVK: Loaded 18237 existing records from primary storage. [2025-09-18T17:25:44.892941] [INFO ] [MAIN ] AVK: Loaded 18237 existing records. [2025-09-18T17:25:45.083840] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:25:45.084119] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-18T17:25:45.084167] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-18T17:25:45.085409] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-18T17:25:45.085470] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-18T17:25:45.326095] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-18T17:25:45.493089] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:25:45.960964] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:25:45.961472] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-18T17:25:45.995193] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-18T17:25:46.119619] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-11. [2025-09-18T17:25:46.919612] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-18T17:25:47.417347] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-18T17:25:47.719620] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-09-18T17:25:47.914963] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:25:47.915442] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-09-18T17:25:48.178168] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-18T17:25:48.519620] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-09-18T17:25:49.246942] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-18T17:25:49.319569] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-02. [2025-09-18T17:25:49.536278] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:25:49.536598] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-02 [2025-09-18T17:25:50.119580] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-03. [2025-09-18T17:25:50.309746] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:25:50.310258] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-03 [2025-09-18T17:25:50.919601] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-09-18T17:25:51.719581] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-18T17:25:52.017025] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-18T17:25:52.519575] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-04. [2025-09-18T17:25:52.864444] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:25:52.864982] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-04 [2025-09-18T17:25:52.909570] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-18T17:25:53.319549] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-09-18T17:25:54.124699] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-05. [2025-09-18T17:25:54.144252] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T17:25:54.336619] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:25:54.337004] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-05 [2025-09-18T17:25:54.919568] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-06. [2025-09-18T17:25:55.117755] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:25:55.118238] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-06 [2025-09-18T17:25:55.719576] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-18T17:25:56.519627] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-09-18T17:25:57.030702] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-18T17:25:57.319549] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-18T17:25:57.673820] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T17:25:58.119614] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-18T17:25:58.713669] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T17:25:58.911060] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-18T17:25:58.919489] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-18T17:25:59.719554] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-07. [2025-09-18T17:25:59.775821] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-18T17:25:59.931067] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:25:59.931396] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-07 [2025-09-18T17:26:00.519547] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-18T17:26:01.319602] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-08. [2025-09-18T17:26:01.473183] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-18T17:26:02.119560] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-18T17:26:02.219517] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-18T17:26:02.919547] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-09. [2025-09-18T17:26:03.591805] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-18T17:26:03.594494] [INFO ] [REMOTE ] AVBC: Full fetch complete (4193 records). [2025-09-18T17:26:03.594569] [DEBUG] [VALIDATOR ] AVBC: Validating primary data. [2025-09-18T17:26:03.724610] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-18T17:26:03.784139] [WARN ] [VALIDATOR ] AVBC: Validation failed - insufficient historical data. Have 34 unique days, need 200 days [2025-09-18T17:26:03.784353] [FATAL] [MAIN ] AVBC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:26:03.784441] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:26:03.784535] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-18T17:26:03.784616] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-18T17:26:03.784692] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-18T17:26:03.785050] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-18T17:26:03.785150] [INFO ] [MAIN ] Update Progress: 182/2372 symbols completed. AVBC took 23.0s. Estimated remaining: 5h 12m 56s. Rate: 7.0 symbols/min [2025-09-18T17:26:03.955477] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:26:03.995409] [DEBUG] [LOCAL ] AVNS: Loaded 33712 existing records from primary storage. [2025-09-18T17:26:03.995551] [INFO ] [MAIN ] AVNS: Loaded 33712 existing records. [2025-09-18T17:26:04.174824] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:26:04.175152] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-18T17:26:04.175319] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-18T17:26:04.182189] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-18T17:26:04.191805] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-18T17:26:04.262203] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-18T17:26:04.308443] [INFO ] [REMOTE ] AVB: Full fetch complete (57836 records). [2025-09-18T17:26:04.319199] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-18T17:26:04.531951] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-18T17:26:04.879243] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:26:04.930365] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-18T17:26:05.013229] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-09-18T17:26:05.013319] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-09-18T17:26:05.014088] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-09-18T17:26:05.014152] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-09-18T17:26:05.015377] [DEBUG] [LOCAL ] AVB: Trimmed 57836 records to 41875 (keeping 200 days of data) [2025-09-18T17:26:05.268312] [DEBUG] [LOCAL ] AVB: Primary data saved (41875 records). [2025-09-18T17:26:05.268445] [INFO ] [MAIN ] AVB: Full history saved. [2025-09-18T17:26:05.268549] [INFO ] [MAIN ] Update Progress: 183/2372 symbols completed. AVB took 36.2s. Estimated remaining: 5h 11m 22s. Rate: 7.0 symbols/min [2025-09-18T17:26:05.331583] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-11. [2025-09-18T17:26:05.447856] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:26:05.486947] [DEBUG] [LOCAL ] AVNT: Loaded 39593 existing records from primary storage. [2025-09-18T17:26:05.487106] [INFO ] [MAIN ] AVNT: Loaded 39593 existing records. [2025-09-18T17:26:05.666806] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:26:05.667074] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-18T17:26:05.667123] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-18T17:26:05.669097] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-09-18T17:26:05.669159] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-18T17:26:06.011538] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T17:26:06.046551] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:26:06.119513] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-11. [2025-09-18T17:26:06.777921] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-18T17:26:06.919552] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-18T17:26:07.251547] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-18T17:26:07.574912] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-18T17:26:07.719544] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-18T17:26:08.519302] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-18T17:26:08.521227] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-09-18T17:26:09.319541] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-18T17:26:09.510633] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-18T17:26:10.119516] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-09-18T17:26:10.504039] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-18T17:26:10.919560] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-18T17:26:11.023119] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-18T17:26:11.664690] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-18T17:26:11.719495] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-18T17:26:12.344615] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-18T17:26:12.519507] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-18T17:26:13.149196] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-18T17:26:13.319568] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-09-18T17:26:14.119557] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-09-18T17:26:14.354203] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-18T17:26:14.919531] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-18T17:26:15.084378] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-18T17:26:15.719559] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-18T17:26:15.754251] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-18T17:26:16.519560] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-18T17:26:16.766261] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-18T17:26:17.319604] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-18T17:26:17.351437] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-18T17:26:17.354837] [INFO ] [REMOTE ] AVD: Full fetch complete (33934 records). [2025-09-18T17:26:17.354920] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-18T17:26:17.725234] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-18T17:26:17.725310] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-18T17:26:17.725718] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-18T17:26:17.725779] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-18T17:26:17.726572] [DEBUG] [LOCAL ] AVD: Trimmed 33934 records to 23445 (keeping 200 days of data) [2025-09-18T17:26:17.850399] [DEBUG] [LOCAL ] AVD: Primary data saved (23445 records). [2025-09-18T17:26:17.850529] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-18T17:26:17.850609] [INFO ] [MAIN ] Update Progress: 184/2372 symbols completed. AVD took 35.1s. Estimated remaining: 5h 12m 2s. Rate: 7.0 symbols/min [2025-09-18T17:26:18.019722] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:26:18.076472] [DEBUG] [LOCAL ] AVTR: Loaded 53571 existing records from primary storage. [2025-09-18T17:26:18.076615] [INFO ] [MAIN ] AVTR: Loaded 53571 existing records. [2025-09-18T17:26:18.124713] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-18T17:26:18.264103] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:26:18.264337] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-18T17:26:18.264394] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-18T17:26:18.267200] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-09-18T17:26:18.267262] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-18T17:26:18.629978] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:26:18.649487] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T17:26:18.919569] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-18T17:26:19.615301] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-18T17:26:19.636204] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-18T17:26:19.719599] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-18T17:26:20.519625] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-11. [2025-09-18T17:26:20.816419] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-18T17:26:21.319514] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-18T17:26:21.892572] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-18T17:26:22.119568] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-09-18T17:26:22.853874] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-18T17:26:22.919578] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-18T17:26:23.496080] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-18T17:26:23.719592] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-18T17:26:24.346552] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-18T17:26:24.411860] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-18T17:26:24.519602] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-18T17:26:25.319584] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-09-18T17:26:25.903721] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T17:26:26.119575] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-18T17:26:26.640976] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-18T17:26:26.919557] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-18T17:26:27.358505] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-18T17:26:27.719600] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-18T17:26:27.926269] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T17:26:27.929291] [INFO ] [REMOTE ] AVK: Full fetch complete (26624 records). [2025-09-18T17:26:27.929376] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-18T17:26:28.305418] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-18T17:26:28.305510] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-18T17:26:28.305927] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-18T17:26:28.305991] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-18T17:26:28.306846] [DEBUG] [LOCAL ] AVK: Trimmed 26624 records to 18339 (keeping 200 days of data) [2025-09-18T17:26:28.423527] [DEBUG] [LOCAL ] AVK: Primary data saved (18339 records). [2025-09-18T17:26:28.423706] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-18T17:26:28.423803] [INFO ] [MAIN ] Update Progress: 185/2372 symbols completed. AVK took 43.7s. Estimated remaining: 5h 12m 17s. Rate: 7.0 symbols/min [2025-09-18T17:26:28.524701] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-18T17:26:28.599184] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:26:28.651272] [DEBUG] [LOCAL ] AVY: Loaded 37771 existing records from primary storage. [2025-09-18T17:26:28.651413] [INFO ] [MAIN ] AVY: Loaded 37771 existing records. [2025-09-18T17:26:28.834919] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:26:28.835196] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-18T17:26:28.835244] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-18T17:26:28.837536] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-09-18T17:26:28.837600] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-18T17:26:29.221307] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-18T17:26:29.237805] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:26:29.319509] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-18T17:26:30.074942] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-18T17:26:30.119521] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-18T17:26:30.364780] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-18T17:26:30.919599] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-11. [2025-09-18T17:26:31.175107] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-18T17:26:31.180291] [INFO ] [REMOTE ] AVNT: Full fetch complete (55851 records). [2025-09-18T17:26:31.180442] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-18T17:26:31.562022] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-09-18T17:26:31.562105] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-09-18T17:26:31.562698] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-09-18T17:26:31.562764] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-09-18T17:26:31.564010] [DEBUG] [LOCAL ] AVNT: Trimmed 55851 records to 39891 (keeping 200 days of data) [2025-09-18T17:26:31.740952] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-18T17:26:31.815684] [DEBUG] [LOCAL ] AVNT: Primary data saved (39891 records). [2025-09-18T17:26:31.815847] [INFO ] [MAIN ] AVNT: Full history saved. [2025-09-18T17:26:31.815945] [INFO ] [MAIN ] Update Progress: 186/2372 symbols completed. AVNT took 26.5s. Estimated remaining: 5h 11m 8s. Rate: 7.0 symbols/min [2025-09-18T17:26:31.991280] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:26:32.017317] [DEBUG] [LOCAL ] AWF: Loaded 24198 existing records from primary storage. [2025-09-18T17:26:32.017486] [INFO ] [MAIN ] AWF: Loaded 24198 existing records. [2025-09-18T17:26:32.219691] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-18T17:26:32.224608] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:26:32.233401] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-18T17:26:32.233456] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-18T17:26:32.234802] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-09-18T17:26:32.234864] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-18T17:26:32.524768] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-18T17:26:32.597458] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:26:33.319558] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-11. [2025-09-18T17:26:33.512814] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-18T17:26:33.594037] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-18T17:26:34.119579] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-18T17:26:34.221664] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-18T17:26:34.919570] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-09-18T17:26:35.440060] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T17:26:35.719615] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-18T17:26:35.769397] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-18T17:26:36.519559] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-18T17:26:36.647853] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T17:26:37.319550] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-18T17:26:37.894209] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-18T17:26:38.119637] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-18T17:26:38.877764] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-18T17:26:38.919605] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-09-18T17:26:39.709627] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-18T17:26:39.720583] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-18T17:26:40.063636] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-18T17:26:40.519609] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-09-18T17:26:41.035591] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-18T17:26:41.040480] [INFO ] [REMOTE ] AVNS: Full fetch complete (47612 records). [2025-09-18T17:26:41.040589] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-18T17:26:41.324732] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-09-18T17:26:41.438381] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-18T17:26:41.438517] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-18T17:26:41.439101] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-18T17:26:41.439172] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-18T17:26:41.440483] [DEBUG] [LOCAL ] AVNS: Trimmed 47612 records to 33953 (keeping 200 days of data) [2025-09-18T17:26:41.643092] [DEBUG] [LOCAL ] AVNS: Primary data saved (33953 records). [2025-09-18T17:26:41.643239] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-18T17:26:41.643327] [INFO ] [MAIN ] Update Progress: 187/2372 symbols completed. AVNS took 37.9s. Estimated remaining: 5h 11m 14s. Rate: 7.0 symbols/min [2025-09-18T17:26:41.825071] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:26:41.854949] [DEBUG] [LOCAL ] AWI: Loaded 26270 existing records from primary storage. [2025-09-18T17:26:41.855104] [INFO ] [MAIN ] AWI: Loaded 26270 existing records. [2025-09-18T17:26:42.048729] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:26:42.049215] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-18T17:26:42.073370] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-18T17:26:42.075693] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-18T17:26:42.075613] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-18T17:26:42.079239] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-18T17:26:42.125250] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-18T17:26:42.373240] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-18T17:26:42.486064] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:26:42.919564] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-18T17:26:43.719539] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-18T17:26:43.783486] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-18T17:26:44.392307] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-18T17:26:44.519516] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-18T17:26:44.633601] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-18T17:26:45.319564] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-18T17:26:46.119552] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-18T17:26:46.340563] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-18T17:26:46.542237] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-18T17:26:46.919562] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-11. [2025-09-18T17:26:47.006090] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-18T17:26:47.722723] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-18T17:26:47.732608] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-18T17:26:48.519624] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-18T17:26:49.028090] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-18T17:26:49.319562] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-18T17:26:49.935796] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T17:26:50.049560] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-18T17:26:50.119569] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-18T17:26:50.919570] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-09-18T17:26:51.490924] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-18T17:26:51.719505] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-18T17:26:52.075156] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-18T17:26:52.519556] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-09-18T17:26:52.845777] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-18T17:26:53.319568] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-18T17:26:53.575231] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-18T17:26:54.119596] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-18T17:26:54.919512] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-18T17:26:54.990411] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-18T17:26:54.994181] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-18T17:26:55.004461] [INFO ] [REMOTE ] AVTR: Full fetch complete (77268 records). [2025-09-18T17:26:55.004568] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-18T17:26:55.401754] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-09-18T17:26:55.401885] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-09-18T17:26:55.402847] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-09-18T17:26:55.402921] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-09-18T17:26:55.404435] [DEBUG] [LOCAL ] AVTR: Trimmed 77268 records to 53961 (keeping 200 days of data) [2025-09-18T17:26:55.719232] [DEBUG] [LOCAL ] AVTR: Primary data saved (53961 records). [2025-09-18T17:26:55.719480] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-18T17:26:55.719592] [INFO ] [MAIN ] AVTR: Full history saved. [2025-09-18T17:26:55.720870] [INFO ] [MAIN ] Update Progress: 188/2372 symbols completed. AVTR took 37.9s. Estimated remaining: 5h 12m 10s. Rate: 7.0 symbols/min [2025-09-18T17:26:55.891137] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:26:55.945466] [DEBUG] [LOCAL ] AWK: Loaded 48887 existing records from primary storage. [2025-09-18T17:26:55.945685] [INFO ] [MAIN ] AWK: Loaded 48887 existing records. [2025-09-18T17:26:56.142888] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:26:56.143986] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-18T17:26:56.144216] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-18T17:26:56.148919] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-18T17:26:56.155190] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-18T17:26:56.155270] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-18T17:26:56.507135] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:26:56.519489] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-11. [2025-09-18T17:26:56.999884] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-18T17:26:57.319583] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-18T17:26:57.861416] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-18T17:26:58.119526] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-09-18T17:26:58.449770] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-18T17:26:58.919625] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-18T17:26:59.508367] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T17:26:59.719561] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-18T17:27:00.199418] [DEBUG] [REMOTE ] AWF: Error fetching primary data for 2025-07: Server request status code is 503. [2025-09-18T17:27:00.199780] [WARN ] [REMOTE ] AWF: No data returned for month 2025-07 [2025-09-18T17:27:00.217791] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-18T17:27:00.519557] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-18T17:27:01.319550] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-18T17:27:01.691264] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T17:27:02.061777] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-18T17:27:02.119562] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-09-18T17:27:02.919577] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-18T17:27:03.401360] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-18T17:27:03.719550] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-18T17:27:04.151304] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-18T17:27:04.155200] [INFO ] [REMOTE ] AWF: Full fetch complete (32309 records). [2025-09-18T17:27:04.155278] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-18T17:27:04.341817] [WARN ] [VALIDATOR ] AWF: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-18T17:27:04.342237] [FATAL] [MAIN ] AWF: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:27:04.342306] [WARN ] [MAIN ] AWF: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:27:04.342354] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-18T17:27:04.342427] [DEBUG] [LOCAL ] AWF: No primary data file found to delete. [2025-09-18T17:27:04.342491] [INFO ] [LOCAL ] AWF: Starting deletion of derivative data. [2025-09-18T17:27:04.343180] [DEBUG] [LOCAL ] AWF: Deleted derivative data file. [2025-09-18T17:27:04.343274] [INFO ] [MAIN ] Update Progress: 189/2372 symbols completed. AWF took 32.5s. Estimated remaining: 5h 12m 2s. Rate: 7.0 symbols/min [2025-09-18T17:27:04.512174] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:27:04.519503] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-18T17:27:04.536516] [DEBUG] [LOCAL ] AWP: Loaded 22217 existing records from primary storage. [2025-09-18T17:27:04.536613] [INFO ] [MAIN ] AWP: Loaded 22217 existing records. [2025-09-18T17:27:04.719135] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:27:04.719699] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-18T17:27:04.719856] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-18T17:27:04.720537] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-18T17:27:04.720705] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-18T17:27:04.926452] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-18T17:27:05.120703] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:27:05.319511] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-11. [2025-09-18T17:27:05.781376] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-18T17:27:06.119508] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-18T17:27:06.508010] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-18T17:27:06.919546] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-18T17:27:07.596608] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T17:27:07.686113] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-18T17:27:07.719488] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-18T17:27:08.519599] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-18T17:27:09.034701] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-18T17:27:09.319555] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-18T17:27:09.810502] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-18T17:27:09.815935] [INFO ] [REMOTE ] AVY: Full fetch complete (55870 records). [2025-09-18T17:27:09.816047] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-18T17:27:10.124708] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-09-18T17:27:10.195321] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-09-18T17:27:10.195407] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-09-18T17:27:10.196025] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-09-18T17:27:10.196088] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-09-18T17:27:10.197287] [DEBUG] [LOCAL ] AVY: Trimmed 55870 records to 38091 (keeping 200 days of data) [2025-09-18T17:27:10.437638] [DEBUG] [LOCAL ] AVY: Primary data saved (38091 records). [2025-09-18T17:27:10.437849] [INFO ] [MAIN ] AVY: Full history saved. [2025-09-18T17:27:10.437942] [INFO ] [MAIN ] Update Progress: 190/2372 symbols completed. AVY took 42.0s. Estimated remaining: 5h 11m 25s. Rate: 7.0 symbols/min [2025-09-18T17:27:10.616033] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:27:10.639306] [DEBUG] [LOCAL ] AWR: Loaded 22425 existing records from primary storage. [2025-09-18T17:27:10.639461] [INFO ] [MAIN ] AWR: Loaded 22425 existing records. [2025-09-18T17:27:10.823266] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:27:10.823793] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-18T17:27:10.824049] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-18T17:27:10.824862] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-18T17:27:10.824932] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-18T17:27:10.924511] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-18T17:27:11.145165] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-18T17:27:11.235803] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:27:11.248892] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-18T17:27:11.719541] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-11. [2025-09-18T17:27:11.876551] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-18T17:27:12.519558] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-18T17:27:12.621086] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-18T17:27:13.319556] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-09-18T17:27:13.805820] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-18T17:27:14.097085] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-18T17:27:14.119497] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-18T17:27:14.919559] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-18T17:27:15.719590] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-09-18T17:27:15.995174] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-18T17:27:16.261750] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-18T17:27:16.265545] [INFO ] [REMOTE ] AWI: Full fetch complete (35364 records). [2025-09-18T17:27:16.265637] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-18T17:27:16.524523] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-09-18T17:27:16.669072] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-09-18T17:27:16.674354] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-09-18T17:27:16.681719] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-09-18T17:27:16.681856] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-09-18T17:27:16.683561] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-18T17:27:16.689199] [DEBUG] [LOCAL ] AWI: Trimmed 35364 records to 26410 (keeping 200 days of data) [2025-09-18T17:27:16.856038] [DEBUG] [LOCAL ] AWI: Primary data saved (26410 records). [2025-09-18T17:27:16.856179] [INFO ] [MAIN ] AWI: Full history saved. [2025-09-18T17:27:16.856278] [INFO ] [MAIN ] Update Progress: 191/2372 symbols completed. AWI took 35.2s. Estimated remaining: 5h 10m 52s. Rate: 7.0 symbols/min [2025-09-18T17:27:17.028913] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:27:17.058777] [DEBUG] [LOCAL ] AX: Loaded 28759 existing records from primary storage. [2025-09-18T17:27:17.058938] [INFO ] [MAIN ] AX: Loaded 28759 existing records. [2025-09-18T17:27:17.246371] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:27:17.246696] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-18T17:27:17.246758] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-18T17:27:17.247467] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-18T17:27:17.247532] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-18T17:27:17.324693] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-18T17:27:17.649313] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:27:17.957066] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T17:27:18.119582] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-18T17:27:18.716116] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-18T17:27:18.750229] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-18T17:27:18.919529] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-18T17:27:19.719589] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-11. [2025-09-18T17:27:20.519553] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-18T17:27:20.731081] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-18T17:27:20.861330] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-18T17:27:21.212945] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-18T17:27:21.319554] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-18T17:27:22.119550] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-18T17:27:22.449587] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-18T17:27:22.919551] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-18T17:27:23.059081] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T17:27:23.719558] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-18T17:27:24.318563] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-18T17:27:24.519520] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-18T17:27:24.569843] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-18T17:27:25.319562] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-18T17:27:26.119510] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-09-18T17:27:26.133210] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-18T17:27:26.237275] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-18T17:27:26.244137] [INFO ] [REMOTE ] AWK: Full fetch complete (70383 records). [2025-09-18T17:27:26.244262] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-18T17:27:26.642915] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-18T17:27:26.643023] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-18T17:27:26.644301] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-18T17:27:26.644389] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-18T17:27:26.649744] [DEBUG] [LOCAL ] AWK: Trimmed 70383 records to 49258 (keeping 200 days of data) [2025-09-18T17:27:26.936327] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-18T17:27:26.975884] [DEBUG] [LOCAL ] AWK: Primary data saved (49258 records). [2025-09-18T17:27:26.976030] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-18T17:27:26.976167] [INFO ] [MAIN ] Update Progress: 192/2372 symbols completed. AWK took 31.3s. Estimated remaining: 5h 11m 1s. Rate: 7.0 symbols/min [2025-09-18T17:27:27.149940] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:27:27.203011] [DEBUG] [LOCAL ] AXL: Loaded 50542 existing records from primary storage. [2025-09-18T17:27:27.203157] [INFO ] [MAIN ] AXL: Loaded 50542 existing records. [2025-09-18T17:27:27.390246] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:27:27.390545] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-18T17:27:27.390620] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-18T17:27:27.391768] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-18T17:27:27.391843] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-18T17:27:27.729254] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-18T17:27:27.753715] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:27:27.778178] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-18T17:27:28.011801] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-18T17:27:28.519625] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-11. [2025-09-18T17:27:28.563703] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-18T17:27:29.319564] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-18T17:27:30.119550] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-18T17:27:30.235411] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-18T17:27:30.286855] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-18T17:27:30.919589] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-18T17:27:30.982871] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-18T17:27:31.554554] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-18T17:27:31.719552] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-09-18T17:27:32.519608] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-09-18T17:27:33.224176] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-18T17:27:33.319513] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-18T17:27:33.742457] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-18T17:27:34.119521] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-18T17:27:34.519351] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-18T17:27:34.919544] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-18T17:27:35.006841] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-18T17:27:35.719571] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-09-18T17:27:35.867430] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-18T17:27:36.519569] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-18T17:27:37.319584] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-18T17:27:37.415629] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-18T17:27:37.469788] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-18T17:27:38.126731] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-18T17:27:38.131152] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-18T17:27:38.135436] [INFO ] [REMOTE ] AWR: Full fetch complete (31518 records). [2025-09-18T17:27:38.135527] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-18T17:27:38.531323] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-18T17:27:38.531532] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-18T17:27:38.532611] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-18T17:27:38.532832] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-18T17:27:38.536484] [DEBUG] [LOCAL ] AWR: Trimmed 31518 records to 22621 (keeping 200 days of data) [2025-09-18T17:27:38.708496] [DEBUG] [LOCAL ] AWR: Primary data saved (22621 records). [2025-09-18T17:27:38.708660] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-18T17:27:38.708837] [INFO ] [MAIN ] Update Progress: 193/2372 symbols completed. AWR took 28.3s. Estimated remaining: 5h 11m 28s. Rate: 7.0 symbols/min [2025-09-18T17:27:38.910039] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:27:38.919580] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-18T17:27:38.996573] [DEBUG] [LOCAL ] AXP: Loaded 53266 existing records from primary storage. [2025-09-18T17:27:38.996805] [INFO ] [MAIN ] AXP: Loaded 53266 existing records. [2025-09-18T17:27:39.209372] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:27:39.210557] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-18T17:27:39.210674] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-18T17:27:39.212064] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-09-18T17:27:39.212129] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-18T17:27:39.372231] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-18T17:27:39.645039] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:27:39.719565] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-11. [2025-09-18T17:27:40.043573] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T17:27:40.047287] [INFO ] [REMOTE ] AWP: Full fetch complete (32541 records). [2025-09-18T17:27:40.047477] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-18T17:27:40.427736] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-18T17:27:40.427873] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-18T17:27:40.428308] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-18T17:27:40.428354] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-18T17:27:40.429118] [DEBUG] [LOCAL ] AWP: Trimmed 32541 records to 22372 (keeping 200 days of data) [2025-09-18T17:27:40.523674] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-18T17:27:40.577464] [DEBUG] [LOCAL ] AWP: Primary data saved (22372 records). [2025-09-18T17:27:40.577610] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-18T17:27:40.577744] [INFO ] [MAIN ] Update Progress: 194/2372 symbols completed. AWP took 36.2s. Estimated remaining: 5h 10m 5s. Rate: 7.0 symbols/min [2025-09-18T17:27:40.748501] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:27:40.754444] [DEBUG] [LOCAL ] AXR: Loaded 3129 existing records from primary storage. [2025-09-18T17:27:40.754549] [INFO ] [MAIN ] AXR: Loaded 3129 existing records. [2025-09-18T17:27:40.934025] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:27:40.934362] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-18T17:27:40.934419] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-18T17:27:40.934787] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-18T17:27:40.934846] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-18T17:27:41.309231] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:27:41.319550] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-11. [2025-09-18T17:27:41.697263] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-11 (1.98 seconds). [2025-09-18T17:27:41.758195] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-18T17:27:41.860236] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-18T17:27:42.119570] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-18T17:27:42.919556] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-09-18T17:27:43.374240] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-18T17:27:43.719582] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-09-18T17:27:43.764384] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T17:27:44.519569] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-09-18T17:27:45.093989] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-18T17:27:45.319564] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-18T17:27:45.432355] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-18T17:27:46.119603] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-18T17:27:46.471857] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-18T17:27:46.919562] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-18T17:27:47.402188] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-18T17:27:47.719586] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-18T17:27:47.778768] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-18T17:27:48.478027] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-18T17:27:48.519599] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-18T17:27:49.087975] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-18T17:27:49.319618] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-18T17:27:50.119565] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-09-18T17:27:50.424139] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-18T17:27:50.919626] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-18T17:27:51.528452] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-18T17:27:51.719608] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-18T17:27:52.166470] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-18T17:27:52.519553] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-18T17:27:52.938060] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-18T17:27:53.174049] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T17:27:53.319631] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-18T17:27:54.119555] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-18T17:27:54.660278] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-18T17:27:54.919543] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-18T17:27:55.719514] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-18T17:27:55.755440] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-18T17:27:55.911631] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-18T17:27:56.519604] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-18T17:27:56.882912] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-18T17:27:57.319557] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-18T17:27:58.119557] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-18T17:27:58.403349] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-18T17:27:58.427218] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-18T17:27:58.433538] [INFO ] [REMOTE ] AX: Full fetch complete (42670 records). [2025-09-18T17:27:58.433629] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-18T17:27:58.553868] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-18T17:27:58.819918] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-18T17:27:58.820012] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-18T17:27:58.820529] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-18T17:27:58.820571] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-18T17:27:58.821545] [DEBUG] [LOCAL ] AX: Trimmed 42670 records to 29039 (keeping 200 days of data) [2025-09-18T17:27:58.923717] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-18T17:27:59.008705] [DEBUG] [LOCAL ] AX: Primary data saved (29039 records). [2025-09-18T17:27:59.009112] [INFO ] [MAIN ] AX: Full history saved. [2025-09-18T17:27:59.009223] [INFO ] [MAIN ] Update Progress: 195/2372 symbols completed. AX took 42.2s. Estimated remaining: 5h 11m 46s. Rate: 7.0 symbols/min [2025-09-18T17:27:59.182805] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:27:59.228417] [DEBUG] [LOCAL ] AXS: Loaded 38300 existing records from primary storage. [2025-09-18T17:27:59.228575] [INFO ] [MAIN ] AXS: Loaded 38300 existing records. [2025-09-18T17:27:59.406515] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:27:59.406891] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-18T17:27:59.406940] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-18T17:27:59.408282] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-18T17:27:59.408355] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-18T17:27:59.733346] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-18T17:27:59.778798] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:28:00.519563] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-18T17:28:00.891728] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-18T17:28:01.071205] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-18T17:28:01.319508] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-18T17:28:01.405266] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-18T17:28:01.616568] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-18T17:28:02.119554] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-18T17:28:02.567773] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-18T17:28:02.568955] [INFO ] [REMOTE ] AXR: Full fetch complete (4976 records). [2025-09-18T17:28:02.569025] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-18T17:28:02.925190] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-11. [2025-09-18T17:28:02.932478] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-18T17:28:02.932578] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-18T17:28:02.933002] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-18T17:28:02.933077] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-18T17:28:02.934246] [DEBUG] [LOCAL ] AXR: Trimmed 4976 records to 3173 (keeping 200 days of data) [2025-09-18T17:28:02.953583] [DEBUG] [LOCAL ] AXR: Primary data saved (3173 records). [2025-09-18T17:28:02.953696] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-18T17:28:02.953791] [INFO ] [MAIN ] Update Progress: 196/2372 symbols completed. AXR took 22.4s. Estimated remaining: 5h 10m 46s. Rate: 7.0 symbols/min [2025-09-18T17:28:03.123426] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:28:03.181305] [DEBUG] [LOCAL ] AXTA: Loaded 52041 existing records from primary storage. [2025-09-18T17:28:03.181479] [INFO ] [MAIN ] AXTA: Loaded 52041 existing records. [2025-09-18T17:28:03.362913] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:28:03.363179] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-18T17:28:03.363226] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-18T17:28:03.364340] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-18T17:28:03.364401] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-18T17:28:03.721164] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:28:03.721249] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-18T17:28:04.102832] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-18T17:28:04.519612] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-18T17:28:05.119204] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-18T17:28:05.319552] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-09-18T17:28:06.119545] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-18T17:28:06.341223] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-18T17:28:06.383777] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-18T17:28:06.919544] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-11. [2025-09-18T17:28:07.719556] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-09-18T17:28:07.804001] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-18T17:28:07.811077] [INFO ] [REMOTE ] AXL: Full fetch complete (72201 records). [2025-09-18T17:28:07.811225] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-18T17:28:08.218376] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-18T17:28:08.218533] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-18T17:28:08.219288] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-18T17:28:08.219381] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-18T17:28:08.224086] [DEBUG] [LOCAL ] AXL: Trimmed 72201 records to 50932 (keeping 200 days of data) [2025-09-18T17:28:08.349362] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T17:28:08.542483] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-18T17:28:08.589282] [DEBUG] [LOCAL ] AXL: Primary data saved (50932 records). [2025-09-18T17:28:08.589448] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-18T17:28:08.589575] [INFO ] [MAIN ] Update Progress: 197/2372 symbols completed. AXL took 41.6s. Estimated remaining: 5h 10m 5s. Rate: 7.0 symbols/min [2025-09-18T17:28:08.947353] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-18T17:28:09.319547] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-09-18T17:28:10.119540] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-18T17:28:10.395008] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-18T17:28:10.919541] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-18T17:28:10.976023] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-18T17:28:11.620947] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-18T17:28:11.719493] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-18T17:28:12.519603] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-09-18T17:28:12.823606] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-18T17:28:12.873811] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-18T17:28:13.319564] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-18T17:28:13.774087] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T17:28:14.119617] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-18T17:28:14.919607] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-18T17:28:15.080681] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-18T17:28:15.556214] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-18T17:28:15.719539] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-18T17:28:16.251050] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-18T17:28:16.519713] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-18T17:28:16.931326] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-18T17:28:17.319703] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-18T17:28:18.119565] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-18T17:28:18.189202] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-18T17:28:18.196475] [INFO ] [REMOTE ] AXP: Full fetch complete (76813 records). [2025-09-18T17:28:18.196621] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-18T17:28:18.593919] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-09-18T17:28:18.594011] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-09-18T17:28:18.594818] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-09-18T17:28:18.594881] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-09-18T17:28:18.596419] [DEBUG] [LOCAL ] AXP: Trimmed 76813 records to 53656 (keeping 200 days of data) [2025-09-18T17:28:18.856747] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T17:28:18.936556] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-18T17:28:18.988488] [DEBUG] [LOCAL ] AXP: Primary data saved (53656 records). [2025-09-18T17:28:18.988618] [INFO ] [MAIN ] AXP: Full history saved. [2025-09-18T17:28:18.989955] [INFO ] [MAIN ] Update Progress: 198/2372 symbols completed. AXP took 40.3s. Estimated remaining: 5h 10m 17s. Rate: 7.0 symbols/min [2025-09-18T17:28:19.637236] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-18T17:28:19.719586] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-18T17:28:20.299137] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-18T17:28:20.519500] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-18T17:28:20.804507] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-18T17:28:21.319606] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-18T17:28:22.168289] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-18T17:28:22.179228] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-18T17:28:22.463779] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-18T17:28:22.919592] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-18T17:28:23.517839] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-18T17:28:23.719613] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-18T17:28:24.101340] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-18T17:28:24.519608] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-18T17:28:25.373290] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-18T17:28:25.388315] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-18T17:28:25.664054] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-18T17:28:25.669628] [INFO ] [REMOTE ] AXS: Full fetch complete (55171 records). [2025-09-18T17:28:25.669768] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-18T17:28:26.051779] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-18T17:28:26.051858] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-18T17:28:26.052425] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-18T17:28:26.052465] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-18T17:28:26.053621] [DEBUG] [LOCAL ] AXS: Trimmed 55171 records to 38587 (keeping 200 days of data) [2025-09-18T17:28:26.288503] [DEBUG] [LOCAL ] AXS: Primary data saved (38587 records). [2025-09-18T17:28:26.288661] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-18T17:28:26.288764] [INFO ] [MAIN ] Update Progress: 199/2372 symbols completed. AXS took 27.3s. Estimated remaining: 5h 9m 55s. Rate: 7.0 symbols/min [2025-09-18T17:28:26.730055] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-18T17:28:26.737310] [INFO ] [REMOTE ] AXTA: Full fetch complete (74510 records). [2025-09-18T17:28:26.737455] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-18T17:28:27.129139] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-09-18T17:28:27.129219] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-09-18T17:28:27.129998] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-09-18T17:28:27.130063] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-09-18T17:28:27.131509] [DEBUG] [LOCAL ] AXTA: Trimmed 74510 records to 52428 (keeping 200 days of data) [2025-09-18T17:28:27.432102] [DEBUG] [LOCAL ] AXTA: Primary data saved (52428 records). [2025-09-18T17:28:27.432235] [INFO ] [MAIN ] AXTA: Full history saved. [2025-09-18T17:28:27.432321] [INFO ] [MAIN ] Update Progress: 200/2372 symbols completed. AXTA took 24.5s. Estimated remaining: 5h 8m 26s. Rate: 7.0 symbols/min [2025-09-18T17:28:28.062028] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:28:28.210378] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:28:28.172564] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:28:28.214288] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:28:28.214875] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-18T17:28:28.215195] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-18T17:28:28.215927] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-18T17:28:28.216039] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-18T17:28:28.216105] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-18T17:28:28.216148] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-18T17:28:28.390393] [DEBUG] [LOCAL ] AZO: Loaded 11607 existing records from primary storage. [2025-09-18T17:28:28.442253] [DEBUG] [LOCAL ] AZZ: Loaded 22182 existing records from primary storage. [2025-09-18T17:28:28.423980] [INFO ] [MAIN ] AZO: Loaded 11607 existing records. [2025-09-18T17:28:28.389983] [DEBUG] [LOCAL ] AYI: Loaded 25640 existing records from primary storage. [2025-09-18T17:28:28.445356] [INFO ] [MAIN ] AYI: Loaded 25640 existing records. [2025-09-18T17:28:28.442434] [INFO ] [MAIN ] AZZ: Loaded 22182 existing records. [2025-09-18T17:28:29.081519] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:28:29.195265] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-18T17:28:29.201524] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:28:29.192775] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:28:29.201709] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-18T17:28:29.202329] [INFO ] [REMOTE ] B: Fetching primary data for 2024-11. [2025-09-18T17:28:29.201831] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:28:29.203280] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-18T17:28:29.203406] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-18T17:28:29.203669] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-18T17:28:29.208844] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-18T17:28:29.225211] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-18T17:28:29.240242] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-09-18T17:28:29.234945] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-18T17:28:29.272801] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-18T17:28:29.272743] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-09-18T17:28:29.316873] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-18T17:28:30.231076] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:28:30.310414] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:28:30.304822] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-11. [2025-09-18T17:28:30.350283] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-11. [2025-09-18T17:28:30.357742] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:28:30.358132] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-11. [2025-09-18T17:28:30.748145] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-18T17:28:30.755144] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-18T17:28:31.068797] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-18T17:28:31.071988] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-09-18T17:28:31.192424] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-18T17:28:31.196803] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-09-18T17:28:31.275829] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-18T17:28:31.684542] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-18T17:28:31.719498] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-18T17:28:32.072542] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-18T17:28:32.152379] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-18T17:28:32.519517] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-09-18T17:28:32.597125] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-18T17:28:33.319541] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-09-18T17:28:33.322750] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-18T17:28:34.119555] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-18T17:28:34.150315] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-18T17:28:34.919578] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-18T17:28:35.059140] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-18T17:28:35.137065] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:28:35.137378] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-18T17:28:35.719548] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-18T17:28:36.519552] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-18T17:28:36.531246] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-18T17:28:37.301370] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-18T17:28:37.319501] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-18T17:28:38.119559] [INFO ] [REMOTE ] B: Fetching primary data for 2025-03. [2025-09-18T17:28:38.334684] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:28:38.335022] [WARN ] [REMOTE ] B: No data returned for month 2025-03 [2025-09-18T17:28:38.562251] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-18T17:28:38.919697] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-09-18T17:28:39.719613] [INFO ] [REMOTE ] B: Fetching primary data for 2025-04. [2025-09-18T17:28:39.876560] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-18T17:28:39.912860] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:28:39.913089] [WARN ] [REMOTE ] B: No data returned for month 2025-04 [2025-09-18T17:28:40.519598] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-18T17:28:41.319557] [INFO ] [REMOTE ] B: Fetching primary data for 2025-05. [2025-09-18T17:28:41.616912] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-18T17:28:42.119610] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-18T17:28:42.922398] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-18T17:28:42.927445] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-18T17:28:43.283024] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-18T17:28:43.652696] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-18T17:28:43.719576] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-18T17:28:44.434630] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T17:28:44.519588] [INFO ] [REMOTE ] B: Fetching primary data for 2025-06. [2025-09-18T17:28:45.319580] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-18T17:28:46.119542] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-18T17:28:46.257601] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-18T17:28:46.636098] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T17:28:46.789707] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-18T17:28:46.919559] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-09-18T17:28:47.719566] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-18T17:28:47.923555] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-18T17:28:48.378845] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-18T17:28:48.519621] [INFO ] [REMOTE ] B: Fetching primary data for 2025-07. [2025-09-18T17:28:49.319603] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-18T17:28:50.119543] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-18T17:28:50.250962] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-18T17:28:50.375038] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-18T17:28:50.919535] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-18T17:28:51.188334] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-18T17:28:51.686028] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-18T17:28:51.719495] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-18T17:28:52.329433] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-18T17:28:52.519544] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-18T17:28:53.319569] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-18T17:28:53.501291] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-18T17:28:54.119553] [INFO ] [REMOTE ] B: Fetching primary data for 2025-08. [2025-09-18T17:28:54.454284] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-18T17:28:54.457395] [INFO ] [REMOTE ] AZZ: Full fetch complete (30808 records). [2025-09-18T17:28:54.457470] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-18T17:28:54.834388] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-09-18T17:28:54.834491] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-09-18T17:28:54.834945] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-09-18T17:28:54.835010] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-09-18T17:28:54.835943] [DEBUG] [LOCAL ] AZZ: Trimmed 30808 records to 22399 (keeping 200 days of data) [2025-09-18T17:28:54.924732] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-18T17:28:54.980232] [DEBUG] [LOCAL ] AZZ: Primary data saved (22399 records). [2025-09-18T17:28:54.980379] [INFO ] [MAIN ] AZZ: Full history saved. [2025-09-18T17:28:54.980485] [INFO ] [MAIN ] Update Progress: 201/2372 symbols completed. AZZ took 27.5s. Estimated remaining: 5h 11m 43s. Rate: 7.0 symbols/min [2025-09-18T17:28:55.149569] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:28:55.209496] [DEBUG] [LOCAL ] BA: Loaded 53791 existing records from primary storage. [2025-09-18T17:28:55.209700] [INFO ] [MAIN ] BA: Loaded 53791 existing records. [2025-09-18T17:28:55.394047] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:28:55.394362] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-18T17:28:55.394413] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-18T17:28:55.396550] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-18T17:28:55.396620] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-18T17:28:55.723045] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-18T17:28:55.758681] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:28:56.031597] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-18T17:28:56.461839] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T17:28:56.474317] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-18T17:28:56.476111] [INFO ] [REMOTE ] AZO: Full fetch complete (16384 records). [2025-09-18T17:28:56.476196] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-18T17:28:56.528478] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-18T17:28:56.838117] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-18T17:28:56.838207] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-18T17:28:56.838532] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-18T17:28:56.838573] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-18T17:28:56.839202] [DEBUG] [LOCAL ] AZO: Trimmed 16384 records to 11696 (keeping 200 days of data) [2025-09-18T17:28:56.912825] [DEBUG] [LOCAL ] AZO: Primary data saved (11696 records). [2025-09-18T17:28:56.912967] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-18T17:28:56.913056] [INFO ] [MAIN ] Update Progress: 202/2372 symbols completed. AZO took 29.5s. Estimated remaining: 5h 10m 22s. Rate: 7.0 symbols/min [2025-09-18T17:28:57.082784] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:28:57.145604] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-09-18T17:28:57.145835] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-09-18T17:28:57.320722] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-11. [2025-09-18T17:28:57.324743] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:28:57.325969] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-18T17:28:57.326023] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-18T17:28:57.328204] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-18T17:28:57.328266] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-18T17:28:57.657307] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-18T17:28:57.739749] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:28:58.119608] [INFO ] [REMOTE ] B: Fetching primary data for 2025-09. [2025-09-18T17:28:58.919555] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-18T17:28:59.479414] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-11 (2.16 seconds). [2025-09-18T17:28:59.719504] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-11. [2025-09-18T17:28:59.790103] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-18T17:29:00.399446] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-18T17:29:00.407940] [INFO ] [REMOTE ] B: Full fetch complete (44374 records). [2025-09-18T17:29:00.408138] [DEBUG] [VALIDATOR ] B: Validating primary data. [2025-09-18T17:29:00.524711] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-18T17:29:00.616490] [WARN ] [VALIDATOR ] B: Validation failed - insufficient historical data. Have 128 unique days, need 200 days [2025-09-18T17:29:00.617591] [FATAL] [MAIN ] B: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:29:00.617689] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:29:00.617779] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-18T17:29:00.617860] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-18T17:29:00.617901] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-18T17:29:00.617970] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-18T17:29:00.618072] [INFO ] [MAIN ] Update Progress: 203/2372 symbols completed. B took 33.2s. Estimated remaining: 5h 9m 21s. Rate: 7.0 symbols/min [2025-09-18T17:29:00.794939] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:29:00.853818] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-09-18T17:29:00.854016] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-09-18T17:29:01.041155] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:29:01.041432] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-18T17:29:01.041496] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-18T17:29:01.043632] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-18T17:29:01.043716] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-18T17:29:01.324733] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-09-18T17:29:01.426239] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:29:01.473362] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-18T17:29:02.119581] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-11. [2025-09-18T17:29:02.338246] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-11 (2.62 seconds). [2025-09-18T17:29:02.919559] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-18T17:29:03.493211] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-18T17:29:03.719530] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-09-18T17:29:03.822628] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-18T17:29:04.146510] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-11 (2.03 seconds). [2025-09-18T17:29:04.519547] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-09-18T17:29:05.319582] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-18T17:29:06.119587] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-09-18T17:29:06.250992] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-18T17:29:06.254350] [INFO ] [REMOTE ] AYI: Full fetch complete (36779 records). [2025-09-18T17:29:06.254453] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-18T17:29:06.413385] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-09-18T17:29:06.703303] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-09-18T17:29:06.703391] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-09-18T17:29:06.703861] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-18T17:29:06.703951] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-09-18T17:29:06.704947] [DEBUG] [LOCAL ] AYI: Trimmed 36779 records to 25741 (keeping 200 days of data) [2025-09-18T17:29:06.871854] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-18T17:29:06.919626] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-09-18T17:29:06.930463] [DEBUG] [LOCAL ] AYI: Primary data saved (25741 records). [2025-09-18T17:29:06.930864] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-18T17:29:06.930971] [INFO ] [MAIN ] Update Progress: 204/2372 symbols completed. AYI took 39.5s. Estimated remaining: 5h 8m 49s. Rate: 7.0 symbols/min [2025-09-18T17:29:07.106370] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:29:07.163772] [DEBUG] [LOCAL ] BAH: Loaded 51794 existing records from primary storage. [2025-09-18T17:29:07.163950] [INFO ] [MAIN ] BAH: Loaded 51794 existing records. [2025-09-18T17:29:07.359340] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:29:07.359604] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-18T17:29:07.359677] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-18T17:29:07.362498] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-09-18T17:29:07.362560] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-18T17:29:07.729222] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-09-18T17:29:07.751035] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:29:08.038105] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-18T17:29:08.519616] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-18T17:29:09.319518] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-11. [2025-09-18T17:29:09.370935] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-09-18T17:29:09.844124] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-18T17:29:10.119554] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-18T17:29:10.344312] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-18T17:29:10.882245] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-18T17:29:10.919507] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-09-18T17:29:11.719600] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-18T17:29:12.262706] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T17:29:12.519513] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-09-18T17:29:12.550118] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-18T17:29:13.319616] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-18T17:29:13.764973] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-18T17:29:14.119581] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-18T17:29:14.623547] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-18T17:29:14.919562] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-18T17:29:15.667694] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-18T17:29:15.719490] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-18T17:29:16.519523] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-18T17:29:16.635101] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-18T17:29:16.696406] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-18T17:29:17.319551] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-18T17:29:17.892715] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-18T17:29:18.119549] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-18T17:29:18.784890] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-18T17:29:18.919501] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-18T17:29:19.191241] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-09-18T17:29:19.719597] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-18T17:29:20.362520] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-18T17:29:20.432046] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-18T17:29:20.519493] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-18T17:29:21.319620] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-18T17:29:21.824741] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-18T17:29:22.101937] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T17:29:22.119496] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-18T17:29:22.919590] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-18T17:29:23.298164] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-18T17:29:23.719581] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-18T17:29:24.443011] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-18T17:29:24.519533] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-18T17:29:25.319591] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-18T17:29:25.508255] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-18T17:29:25.565728] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-18T17:29:26.119590] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-18T17:29:26.646921] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-18T17:29:26.721053] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-18T17:29:26.919537] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-18T17:29:27.719631] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-18T17:29:28.416738] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-18T17:29:28.519517] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-18T17:29:28.818865] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-18T17:29:29.319563] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-18T17:29:29.718466] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-18T17:29:29.978764] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-18T17:29:30.119566] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-18T17:29:30.919679] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-18T17:29:31.527854] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-18T17:29:31.719577] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-18T17:29:32.113877] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-18T17:29:32.122150] [INFO ] [REMOTE ] BA: Full fetch complete (77904 records). [2025-09-18T17:29:32.122328] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-18T17:29:32.531362] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-18T17:29:32.559107] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-18T17:29:32.559202] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-18T17:29:32.560071] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-18T17:29:32.560161] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-18T17:29:32.562148] [DEBUG] [LOCAL ] BA: Trimmed 77904 records to 54181 (keeping 200 days of data) [2025-09-18T17:29:32.953059] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-18T17:29:32.977845] [INFO ] [REMOTE ] BAH: Full fetch complete (74290 records). [2025-09-18T17:29:32.978670] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-18T17:29:32.981210] [FATAL] [VALIDATOR ] BAH: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:29:32.983264] [FATAL] [MAIN ] BAH: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:29:32.983371] [DEBUG] [LOCAL ] BA: Primary data saved (54181 records). [2025-09-18T17:29:32.983510] [WARN ] [MAIN ] BAH: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:29:32.983706] [INFO ] [MAIN ] BA: Full history saved. [2025-09-18T17:29:32.983872] [INFO ] [MAIN ] Update Progress: 205/2372 symbols completed. BA took 38.0s. Estimated remaining: 5h 11m 46s. Rate: 7.0 symbols/min [2025-09-18T17:29:32.983995] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-18T17:29:32.984147] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-09-18T17:29:32.984228] [INFO ] [LOCAL ] BAH: Starting deletion of derivative data. [2025-09-18T17:29:33.060401] [DEBUG] [LOCAL ] BAH: Deleted derivative data file. [2025-09-18T17:29:33.078518] [INFO ] [MAIN ] Update Progress: 206/2372 symbols completed. BAH took 26.1s. Estimated remaining: 5h 10m 7s. Rate: 7.0 symbols/min [2025-09-18T17:29:33.263551] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:29:33.354353] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:29:33.382207] [DEBUG] [LOCAL ] BAK: Loaded 38862 existing records from primary storage. [2025-09-18T17:29:33.382372] [INFO ] [MAIN ] BAK: Loaded 38862 existing records. [2025-09-18T17:29:33.591792] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:29:33.612810] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-18T17:29:33.613076] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-18T17:29:33.614390] [DEBUG] [LOCAL ] BALL: Loaded 51854 existing records from primary storage. [2025-09-18T17:29:33.614561] [INFO ] [MAIN ] BALL: Loaded 51854 existing records. [2025-09-18T17:29:33.648506] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-18T17:29:33.682295] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-18T17:29:33.934738] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:29:33.970218] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-18T17:29:33.970314] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-18T17:29:33.983679] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-18T17:29:33.994172] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-18T17:29:34.374510] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:29:34.413005] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-11. [2025-09-18T17:29:34.581012] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:29:34.581471] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-11. [2025-09-18T17:29:34.649702] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.93 seconds). [2025-09-18T17:29:34.922348] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-18T17:29:34.925732] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-18T17:29:35.645761] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-18T17:29:35.719625] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-09-18T17:29:36.130121] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-18T17:29:36.519556] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-09-18T17:29:36.938237] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-18T17:29:37.218873] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-18T17:29:37.319505] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-18T17:29:37.859567] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T17:29:38.119627] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-09-18T17:29:38.919574] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-09-18T17:29:39.287474] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T17:29:39.719508] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-18T17:29:39.781182] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-18T17:29:39.789217] [INFO ] [REMOTE ] BABA: Full fetch complete (77980 records). [2025-09-18T17:29:39.789379] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-18T17:29:40.192365] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-18T17:29:40.192450] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-18T17:29:40.193240] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-18T17:29:40.193330] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-18T17:29:40.200589] [DEBUG] [LOCAL ] BABA: Trimmed 77980 records to 54210 (keeping 200 days of data) [2025-09-18T17:29:40.340596] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-18T17:29:40.539953] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-18T17:29:40.593131] [DEBUG] [LOCAL ] BABA: Primary data saved (54210 records). [2025-09-18T17:29:40.593304] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-18T17:29:40.595584] [INFO ] [MAIN ] Update Progress: 207/2372 symbols completed. BABA took 43.7s. Estimated remaining: 5h 9m 47s. Rate: 7.0 symbols/min [2025-09-18T17:29:40.780908] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:29:40.781191] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-18T17:29:40.781262] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-18T17:29:40.781513] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-18T17:29:40.781584] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-18T17:29:40.781677] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-18T17:29:40.781766] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-18T17:29:41.137064] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:29:41.319512] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-11. [2025-09-18T17:29:41.705280] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-18T17:29:41.903224] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-18T17:29:42.119576] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-18T17:29:42.310313] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-18T17:29:42.919583] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-18T17:29:43.683515] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-18T17:29:43.719535] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-18T17:29:44.519557] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-18T17:29:44.651158] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-18T17:29:44.658980] [INFO ] [REMOTE ] BAC: Full fetch complete (77933 records). [2025-09-18T17:29:44.659119] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-18T17:29:45.061223] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-18T17:29:45.061392] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-18T17:29:45.062344] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-18T17:29:45.062495] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-18T17:29:45.066416] [DEBUG] [LOCAL ] BAC: Trimmed 77933 records to 54198 (keeping 200 days of data) [2025-09-18T17:29:45.241726] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-18T17:29:45.322142] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-18T17:29:45.478360] [DEBUG] [LOCAL ] BAC: Primary data saved (54198 records). [2025-09-18T17:29:45.478532] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-18T17:29:45.478702] [INFO ] [MAIN ] Update Progress: 208/2372 symbols completed. BAC took 44.9s. Estimated remaining: 5h 9m 0s. Rate: 7.0 symbols/min [2025-09-18T17:29:45.660341] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:29:45.687941] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-18T17:29:45.744079] [DEBUG] [LOCAL ] BAM: Loaded 52019 existing records from primary storage. [2025-09-18T17:29:45.744240] [INFO ] [MAIN ] BAM: Loaded 52019 existing records. [2025-09-18T17:29:45.924372] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:29:45.924720] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-18T17:29:45.924778] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-18T17:29:45.927341] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-18T17:29:45.927403] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-18T17:29:46.122703] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-18T17:29:46.348173] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-18T17:29:46.353719] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:29:46.919545] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-11. [2025-09-18T17:29:47.719558] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-18T17:29:48.122163] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-18T17:29:48.319305] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-18T17:29:48.389579] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-18T17:29:48.519527] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-18T17:29:49.022171] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-18T17:29:49.319565] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-09-18T17:29:50.119561] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-18T17:29:50.560569] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-18T17:29:50.575969] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-18T17:29:50.919547] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-18T17:29:51.719565] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-09-18T17:29:52.519565] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-18T17:29:52.761910] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-18T17:29:52.959855] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-18T17:29:53.197751] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-18T17:29:53.319551] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-18T17:29:54.119547] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-18T17:29:54.619332] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-18T17:29:54.919548] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-18T17:29:55.719527] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-18T17:29:55.837755] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-18T17:29:56.291555] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-18T17:29:56.519577] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-18T17:29:56.878180] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-18T17:29:57.319566] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-18T17:29:57.385762] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-18T17:29:58.119562] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-18T17:29:58.684982] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-18T17:29:58.919578] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-18T17:29:59.126512] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-18T17:29:59.301270] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-18T17:29:59.719557] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-18T17:30:00.248831] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-18T17:30:00.250770] [INFO ] [REMOTE ] BALY: Full fetch complete (17676 records). [2025-09-18T17:30:00.250856] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-18T17:30:00.467078] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-18T17:30:00.467428] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:30:00.467491] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:30:00.467568] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-18T17:30:00.467676] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-18T17:30:00.467747] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-18T17:30:00.467830] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-18T17:30:00.467934] [INFO ] [MAIN ] Update Progress: 209/2372 symbols completed. BALY took 19.9s. Estimated remaining: 5h 9m 58s. Rate: 7.0 symbols/min [2025-09-18T17:30:00.528289] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-18T17:30:00.656718] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:30:00.731449] [DEBUG] [LOCAL ] BANC: Loaded 51275 existing records from primary storage. [2025-09-18T17:30:00.731608] [INFO ] [MAIN ] BANC: Loaded 51275 existing records. [2025-09-18T17:30:00.914027] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:30:00.914283] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-18T17:30:00.914333] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-18T17:30:00.916416] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-18T17:30:00.916480] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-18T17:30:01.278504] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:30:01.319539] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-11. [2025-09-18T17:30:02.119621] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-18T17:30:02.234713] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-18T17:30:02.842243] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-18T17:30:02.919489] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-09-18T17:30:03.637034] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T17:30:03.719526] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-18T17:30:04.278706] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T17:30:04.519553] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-18T17:30:04.862413] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-18T17:30:05.319561] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-18T17:30:06.056381] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-18T17:30:06.119551] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-18T17:30:06.919624] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-18T17:30:07.136230] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-18T17:30:07.656970] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T17:30:07.719503] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-18T17:30:08.278062] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-18T17:30:08.519723] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-18T17:30:09.180189] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-18T17:30:09.319585] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-09-18T17:30:09.729923] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-18T17:30:10.119559] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-18T17:30:10.919579] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-18T17:30:11.484698] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-18T17:30:11.719579] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-18T17:30:11.971531] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-18T17:30:12.519715] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-18T17:30:12.836834] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-18T17:30:13.069885] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T17:30:13.319550] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-18T17:30:14.119554] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-18T17:30:14.492577] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-18T17:30:14.498191] [INFO ] [REMOTE ] BAK: Full fetch complete (57052 records). [2025-09-18T17:30:14.498307] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-18T17:30:14.892391] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-09-18T17:30:14.892506] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-09-18T17:30:14.893180] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-09-18T17:30:14.893246] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-09-18T17:30:14.894575] [DEBUG] [LOCAL ] BAK: Trimmed 57052 records to 39196 (keeping 200 days of data) [2025-09-18T17:30:14.953763] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-18T17:30:15.133472] [DEBUG] [LOCAL ] BAK: Primary data saved (39196 records). [2025-09-18T17:30:15.133637] [INFO ] [MAIN ] BAK: Full history saved. [2025-09-18T17:30:15.133782] [INFO ] [MAIN ] Update Progress: 210/2372 symbols completed. BAK took 42.1s. Estimated remaining: 5h 10m 52s. Rate: 7.0 symbols/min [2025-09-18T17:30:15.304151] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:30:15.335503] [DEBUG] [LOCAL ] BAP: Loaded 26470 existing records from primary storage. [2025-09-18T17:30:15.335674] [INFO ] [MAIN ] BAP: Loaded 26470 existing records. [2025-09-18T17:30:15.519475] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:30:15.519798] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-18T17:30:15.519865] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-18T17:30:15.521330] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-18T17:30:15.521395] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-18T17:30:15.934864] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:30:15.954333] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-11. [2025-09-18T17:30:15.957790] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-18T17:30:15.965843] [INFO ] [REMOTE ] BALL: Full fetch complete (75152 records). [2025-09-18T17:30:15.966031] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-18T17:30:16.090189] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (3.57 seconds). [2025-09-18T17:30:16.161444] [INFO ] [REMOTE ] BAM: Full fetch complete (73339 records). [2025-09-18T17:30:16.181492] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-18T17:30:16.272813] [FATAL] [VALIDATOR ] BAM: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:30:16.295251] [FATAL] [MAIN ] BAM: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:30:16.306519] [WARN ] [MAIN ] BAM: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:30:16.312327] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-18T17:30:16.322742] [DEBUG] [LOCAL ] BAM: No primary data file found to delete. [2025-09-18T17:30:16.333056] [INFO ] [LOCAL ] BAM: Starting deletion of derivative data. [2025-09-18T17:30:16.367014] [DEBUG] [LOCAL ] BAM: Deleted derivative data file. [2025-09-18T17:30:16.402902] [INFO ] [MAIN ] Update Progress: 211/2372 symbols completed. BAM took 30.9s. Estimated remaining: 5h 9m 28s. Rate: 7.0 symbols/min [2025-09-18T17:30:16.407026] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-18T17:30:16.407125] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-18T17:30:16.413269] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-18T17:30:16.420162] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-18T17:30:16.520408] [DEBUG] [LOCAL ] BALL: Trimmed 75152 records to 52223 (keeping 200 days of data) [2025-09-18T17:30:16.588131] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:30:16.588799] [DEBUG] [LOCAL ] BARK: No existing data file found in primary storage. [2025-09-18T17:30:16.589218] [WARN ] [MAIN ] BARK: No existing data found, performing full refresh instead. [2025-09-18T17:30:16.589461] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-18T17:30:16.589626] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-18T17:30:16.589851] [DEBUG] [LOCAL ] BARK: No primary data file found to delete. [2025-09-18T17:30:16.589925] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-18T17:30:17.077137] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-18T17:30:17.090189] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-18T17:30:17.161562] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-09-18T17:30:17.167893] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:30:17.337373] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-18T17:30:17.379029] [DEBUG] [LOCAL ] BALL: Primary data saved (52223 records). [2025-09-18T17:30:17.379149] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-18T17:30:17.379261] [INFO ] [MAIN ] Update Progress: 212/2372 symbols completed. BALL took 44.3s. Estimated remaining: 5h 8m 2s. Rate: 7.0 symbols/min [2025-09-18T17:30:17.549338] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:30:17.604365] [DEBUG] [LOCAL ] BAX: Loaded 53489 existing records from primary storage. [2025-09-18T17:30:17.604535] [INFO ] [MAIN ] BAX: Loaded 53489 existing records. [2025-09-18T17:30:17.781262] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:30:17.781520] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-18T17:30:17.781575] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-18T17:30:17.783572] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-09-18T17:30:17.783635] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-18T17:30:18.125065] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-11. [2025-09-18T17:30:18.152071] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:30:18.170916] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-18T17:30:18.825212] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-18T17:30:18.919537] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-18T17:30:19.316398] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-18T17:30:19.719558] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-09-18T17:30:19.842843] [DEBUG] [REMOTE ] BAP: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-18T17:30:19.843172] [WARN ] [REMOTE ] BAP: No data returned for month 2025-01 [2025-09-18T17:30:20.519565] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-11. [2025-09-18T17:30:20.571816] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-18T17:30:21.319553] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-18T17:30:21.815092] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-18T17:30:22.158849] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-09-18T17:30:22.175327] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-18T17:30:22.919586] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-18T17:30:23.719598] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-18T17:30:24.087691] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-18T17:30:24.349382] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T17:30:24.519583] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-09-18T17:30:24.677482] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-18T17:30:25.319563] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-18T17:30:26.123638] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-18T17:30:26.128905] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-18T17:30:26.192746] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-18T17:30:26.919567] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-18T17:30:27.442109] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T17:30:27.719558] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-09-18T17:30:28.379773] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-18T17:30:28.519607] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-18T17:30:29.207187] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T17:30:29.308097] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-18T17:30:29.319518] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-18T17:30:30.119597] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-18T17:30:30.259395] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-18T17:30:30.919570] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-18T17:30:31.565940] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T17:30:31.719543] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-18T17:30:31.787072] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-18T17:30:32.519583] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-18T17:30:33.319562] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-18T17:30:33.564316] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-18T17:30:33.571514] [INFO ] [REMOTE ] BANC: Full fetch complete (73875 records). [2025-09-18T17:30:33.571693] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-18T17:30:33.964230] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-18T17:30:33.964421] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-18T17:30:33.965266] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-18T17:30:33.965397] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-18T17:30:33.967255] [DEBUG] [LOCAL ] BANC: Trimmed 73875 records to 51659 (keeping 200 days of data) [2025-09-18T17:30:34.088198] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-18T17:30:34.119587] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-18T17:30:34.335465] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-18T17:30:34.341508] [INFO ] [REMOTE ] BAP: Full fetch complete (34716 records). [2025-09-18T17:30:34.342353] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-18T17:30:34.477294] [DEBUG] [LOCAL ] BANC: Primary data saved (51659 records). [2025-09-18T17:30:34.496142] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-18T17:30:34.501982] [INFO ] [MAIN ] Update Progress: 213/2372 symbols completed. BANC took 34.0s. Estimated remaining: 5h 9m 20s. Rate: 7.0 symbols/min [2025-09-18T17:30:34.612132] [WARN ] [VALIDATOR ] BAP: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-18T17:30:34.623904] [FATAL] [MAIN ] BAP: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:30:34.640109] [WARN ] [MAIN ] BAP: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:30:34.650942] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-18T17:30:34.651032] [DEBUG] [LOCAL ] BAP: No primary data file found to delete. [2025-09-18T17:30:34.651103] [INFO ] [LOCAL ] BAP: Starting deletion of derivative data. [2025-09-18T17:30:34.656943] [DEBUG] [LOCAL ] BAP: Deleted derivative data file. [2025-09-18T17:30:34.677621] [INFO ] [MAIN ] Update Progress: 214/2372 symbols completed. BAP took 19.5s. Estimated remaining: 5h 7m 47s. Rate: 7.0 symbols/min [2025-09-18T17:30:34.801821] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:30:34.905923] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:30:34.930537] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-09-18T17:30:34.951947] [DEBUG] [LOCAL ] BB: Loaded 52925 existing records from primary storage. [2025-09-18T17:30:34.965054] [INFO ] [MAIN ] BB: Loaded 52925 existing records. [2025-09-18T17:30:35.109783] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-09-18T17:30:35.120255] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-09-18T17:30:35.284785] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:30:35.288575] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-18T17:30:35.294037] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-18T17:30:35.305452] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-18T17:30:35.310628] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-18T17:30:35.486391] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:30:35.490227] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-18T17:30:35.490352] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-18T17:30:35.507813] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-18T17:30:35.532299] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-18T17:30:36.005563] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:30:36.049592] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-11. [2025-09-18T17:30:36.153361] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:30:36.183355] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T17:30:36.223534] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-18T17:30:36.519562] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-18T17:30:37.319558] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-11. [2025-09-18T17:30:37.782677] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-18T17:30:38.119594] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-09-18T17:30:38.416534] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-18T17:30:38.919591] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-18T17:30:39.292235] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-18T17:30:39.719569] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-09-18T17:30:39.905293] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-18T17:30:40.349696] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-18T17:30:40.519593] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-18T17:30:41.319563] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-09-18T17:30:41.982737] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T17:30:42.027456] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-18T17:30:42.119554] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-18T17:30:42.915425] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-18T17:30:42.925204] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-18T17:30:43.719624] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-18T17:30:44.011360] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-18T17:30:44.045217] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-18T17:30:44.519552] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-18T17:30:45.319562] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-18T17:30:45.461095] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-18T17:30:46.004424] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T17:30:46.119516] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-18T17:30:46.927885] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-18T17:30:46.933799] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-18T17:30:47.171254] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-18T17:30:47.719569] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-18T17:30:48.519600] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-09-18T17:30:49.038737] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-18T17:30:49.139049] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-18T17:30:49.146707] [INFO ] [REMOTE ] BAX: Full fetch complete (77273 records). [2025-09-18T17:30:49.146903] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-18T17:30:49.332691] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-18T17:30:49.560131] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-09-18T17:30:49.560223] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-09-18T17:30:49.560986] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-09-18T17:30:49.561052] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-09-18T17:30:49.562552] [DEBUG] [LOCAL ] BAX: Trimmed 77273 records to 53879 (keeping 200 days of data) [2025-09-18T17:30:49.891677] [DEBUG] [LOCAL ] BAX: Primary data saved (53879 records). [2025-09-18T17:30:49.891841] [INFO ] [MAIN ] BAX: Full history saved. [2025-09-18T17:30:49.891931] [INFO ] [MAIN ] Update Progress: 215/2372 symbols completed. BAX took 32.5s. Estimated remaining: 5h 8m 45s. Rate: 7.0 symbols/min [2025-09-18T17:30:50.066005] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:30:50.107320] [DEBUG] [LOCAL ] BBAR: Loaded 40968 existing records from primary storage. [2025-09-18T17:30:50.107481] [INFO ] [MAIN ] BBAR: Loaded 40968 existing records. [2025-09-18T17:30:50.139149] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-18T17:30:50.298586] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:30:50.298900] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-18T17:30:50.298975] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-18T17:30:50.300775] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-18T17:30:50.300840] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-18T17:30:50.670022] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:30:50.919610] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-11. [2025-09-18T17:30:51.326272] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-09-18T17:30:51.385261] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-18T17:30:51.500458] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-18T17:30:51.719543] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-18T17:30:52.377482] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-18T17:30:52.519506] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-09-18T17:30:53.275507] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T17:30:53.319500] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-18T17:30:54.022244] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T17:30:54.119524] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-09-18T17:30:54.919507] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-18T17:30:54.987765] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-18T17:30:55.430458] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-18T17:30:55.719570] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-18T17:30:56.519552] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-18T17:30:56.668126] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-18T17:30:57.319561] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-18T17:30:58.026096] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-18T17:30:58.119589] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-18T17:30:58.206225] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-18T17:30:58.471733] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-18T17:30:58.919555] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-18T17:30:59.291368] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T17:30:59.719692] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-18T17:30:59.989972] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-18T17:31:00.519613] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-18T17:31:01.322351] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-18T17:31:01.328715] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-18T17:31:01.765502] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-18T17:31:02.119556] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-18T17:31:02.919547] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-18T17:31:03.691040] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-18T17:31:03.719532] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-18T17:31:03.765296] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-18T17:31:03.775587] [INFO ] [REMOTE ] BB: Full fetch complete (76853 records). [2025-09-18T17:31:03.775808] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-18T17:31:04.232394] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-18T17:31:04.232516] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-18T17:31:04.233356] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-18T17:31:04.233427] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-18T17:31:04.235355] [DEBUG] [LOCAL ] BB: Trimmed 76853 records to 53314 (keeping 200 days of data) [2025-09-18T17:31:04.487221] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-18T17:31:04.519701] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-18T17:31:04.618757] [DEBUG] [LOCAL ] BB: Primary data saved (53314 records). [2025-09-18T17:31:04.619000] [INFO ] [MAIN ] BB: Full history saved. [2025-09-18T17:31:04.619723] [INFO ] [MAIN ] Update Progress: 216/2372 symbols completed. BB took 30.1s. Estimated remaining: 5h 9m 38s. Rate: 7.0 symbols/min [2025-09-18T17:31:04.792164] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:31:04.792363] [DEBUG] [LOCAL ] BBD: No existing data file found in primary storage. [2025-09-18T17:31:04.792402] [WARN ] [MAIN ] BBD: No existing data found, performing full refresh instead. [2025-09-18T17:31:04.792559] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-18T17:31:04.792602] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-18T17:31:04.792812] [DEBUG] [LOCAL ] BBD: No primary data file found to delete. [2025-09-18T17:31:04.792870] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-18T17:31:05.143826] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:31:05.319545] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-11. [2025-09-18T17:31:05.668956] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-18T17:31:05.674343] [INFO ] [REMOTE ] BARK: Full fetch complete (57220 records). [2025-09-18T17:31:05.674525] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-18T17:31:06.077711] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-09-18T17:31:06.077913] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-09-18T17:31:06.078768] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-09-18T17:31:06.078891] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-09-18T17:31:06.081609] [DEBUG] [LOCAL ] BARK: Trimmed 57220 records to 38908 (keeping 200 days of data) [2025-09-18T17:31:06.126885] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-18T17:31:06.209185] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-18T17:31:06.343035] [DEBUG] [LOCAL ] BARK: Primary data saved (38908 records). [2025-09-18T17:31:06.343173] [INFO ] [MAIN ] BARK: Full history saved. [2025-09-18T17:31:06.343252] [INFO ] [MAIN ] Update Progress: 217/2372 symbols completed. BARK took 49.9s. Estimated remaining: 5h 8m 20s. Rate: 7.0 symbols/min [2025-09-18T17:31:06.525402] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:31:06.561232] [DEBUG] [LOCAL ] BBDC: Loaded 33531 existing records from primary storage. [2025-09-18T17:31:06.561370] [INFO ] [MAIN ] BBDC: Loaded 33531 existing records. [2025-09-18T17:31:06.748060] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:31:06.748468] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-18T17:31:06.748597] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-18T17:31:06.749864] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-18T17:31:06.749926] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-18T17:31:06.927385] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-18T17:31:06.925626] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-18T17:31:07.160553] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:31:07.719561] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-11. [2025-09-18T17:31:07.838112] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-18T17:31:08.519564] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-09-18T17:31:08.836971] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T17:31:09.319558] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-09-18T17:31:09.428877] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-18T17:31:09.892617] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-18T17:31:10.119613] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-09-18T17:31:10.841236] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-18T17:31:10.919576] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-09-18T17:31:11.689232] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-18T17:31:11.719493] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-18T17:31:11.777254] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-18T17:31:12.519584] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-18T17:31:13.319563] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-18T17:31:13.391244] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T17:31:13.600217] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-18T17:31:14.119612] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-18T17:31:14.919539] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-18T17:31:15.516244] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-18T17:31:15.719574] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-18T17:31:15.940208] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-09-18T17:31:16.008457] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-18T17:31:16.519579] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-18T17:31:17.319563] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-18T17:31:17.431962] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-18T17:31:17.688809] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-18T17:31:18.119563] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-18T17:31:18.532861] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-18T17:31:18.919615] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-18T17:31:19.474091] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-18T17:31:19.719603] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-18T17:31:20.364115] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-18T17:31:20.519578] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-18T17:31:21.319597] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-18T17:31:21.567102] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-18T17:31:22.119617] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-18T17:31:22.433689] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-18T17:31:22.480720] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-09-18T17:31:22.919600] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-18T17:31:22.979103] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-18T17:31:23.719555] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-18T17:31:24.258902] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T17:31:24.519544] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-18T17:31:24.560174] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-18T17:31:25.319591] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-18T17:31:26.119578] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-18T17:31:26.408435] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-18T17:31:26.456042] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-18T17:31:26.461152] [INFO ] [REMOTE ] BBDC: Full fetch complete (49033 records). [2025-09-18T17:31:26.461253] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-18T17:31:26.842911] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-18T17:31:26.842997] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-18T17:31:26.843526] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-18T17:31:26.843581] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-18T17:31:26.844719] [DEBUG] [LOCAL ] BBDC: Trimmed 49033 records to 33755 (keeping 200 days of data) [2025-09-18T17:31:26.928465] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-18T17:31:27.050890] [DEBUG] [LOCAL ] BBDC: Primary data saved (33755 records). [2025-09-18T17:31:27.051172] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-18T17:31:27.051313] [INFO ] [MAIN ] Update Progress: 218/2372 symbols completed. BBDC took 20.7s. Estimated remaining: 5h 10m 12s. Rate: 6.9 symbols/min [2025-09-18T17:31:27.223811] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:31:27.230443] [DEBUG] [LOCAL ] BBDO: Loaded 5073 existing records from primary storage. [2025-09-18T17:31:27.230534] [INFO ] [MAIN ] BBDO: Loaded 5073 existing records. [2025-09-18T17:31:27.412194] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:31:27.412584] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-18T17:31:27.412745] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-18T17:31:27.413100] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-18T17:31:27.413225] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-18T17:31:27.600584] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-18T17:31:27.722325] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-18T17:31:27.818401] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:31:28.519568] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-11. [2025-09-18T17:31:28.558540] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-18T17:31:29.009878] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-18T17:31:29.176613] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T17:31:29.182999] [INFO ] [REMOTE ] BBAR: Full fetch complete (60276 records). [2025-09-18T17:31:29.183112] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-18T17:31:29.324686] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-18T17:31:29.572263] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-18T17:31:29.572348] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-18T17:31:29.572978] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-18T17:31:29.573041] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-18T17:31:29.574247] [DEBUG] [LOCAL ] BBAR: Trimmed 60276 records to 41348 (keeping 200 days of data) [2025-09-18T17:31:29.823602] [DEBUG] [LOCAL ] BBAR: Primary data saved (41348 records). [2025-09-18T17:31:29.823757] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-18T17:31:29.823843] [INFO ] [MAIN ] Update Progress: 219/2372 symbols completed. BBAR took 39.9s. Estimated remaining: 5h 9m 5s. Rate: 7.0 symbols/min [2025-09-18T17:31:29.993374] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:31:30.012302] [DEBUG] [LOCAL ] BBN: Loaded 18050 existing records from primary storage. [2025-09-18T17:31:30.012422] [INFO ] [MAIN ] BBN: Loaded 18050 existing records. [2025-09-18T17:31:30.124689] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-18T17:31:30.193588] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:31:30.193838] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-18T17:31:30.193941] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-18T17:31:30.194518] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-18T17:31:30.194582] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-18T17:31:30.552705] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:31:30.919627] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-09-18T17:31:31.457019] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-18T17:31:31.719693] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-11. [2025-09-18T17:31:31.831753] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-18T17:31:31.930052] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-18T17:31:31.937517] [INFO ] [REMOTE ] BBD: Full fetch complete (77008 records). [2025-09-18T17:31:31.937727] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-18T17:31:32.327727] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-18T17:31:32.327818] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-18T17:31:32.328601] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-18T17:31:32.328679] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-18T17:31:32.330433] [DEBUG] [LOCAL ] BBD: Trimmed 77008 records to 53566 (keeping 200 days of data) [2025-09-18T17:31:32.536582] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-09-18T17:31:32.560980] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-18T17:31:32.674096] [DEBUG] [LOCAL ] BBD: Primary data saved (53566 records). [2025-09-18T17:31:32.674237] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-18T17:31:32.674316] [INFO ] [MAIN ] Update Progress: 220/2372 symbols completed. BBD took 28.1s. Estimated remaining: 5h 8m 0s. Rate: 7.0 symbols/min [2025-09-18T17:31:32.841481] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:31:32.841715] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-18T17:31:32.841770] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-18T17:31:32.841911] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-18T17:31:32.841954] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-18T17:31:32.841996] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-18T17:31:32.842028] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-18T17:31:33.135906] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-18T17:31:33.218567] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:31:33.319559] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-09-18T17:31:34.119557] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-18T17:31:34.435116] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-18T17:31:34.559368] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-18T17:31:34.919560] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-18T17:31:35.719591] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-09-18T17:31:36.519592] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-18T17:31:36.713343] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-18T17:31:36.962158] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-18T17:31:37.270085] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-18T17:31:37.277838] [INFO ] [REMOTE ] BBAI: Full fetch complete (77584 records). [2025-09-18T17:31:37.277977] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-18T17:31:37.278883] [FATAL] [VALIDATOR ] BBAI: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:31:37.278977] [FATAL] [MAIN ] BBAI: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:31:37.279024] [WARN ] [MAIN ] BBAI: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:31:37.279066] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-18T17:31:37.279128] [DEBUG] [LOCAL ] BBAI: No primary data file found to delete. [2025-09-18T17:31:37.279166] [INFO ] [LOCAL ] BBAI: Starting deletion of derivative data. [2025-09-18T17:31:37.279626] [DEBUG] [LOCAL ] BBAI: Deleted derivative data file. [2025-09-18T17:31:37.279765] [INFO ] [MAIN ] Update Progress: 221/2372 symbols completed. BBAI took 1m 3s. Estimated remaining: 5h 7m 13s. Rate: 7.0 symbols/min [2025-09-18T17:31:37.324690] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-11. [2025-09-18T17:31:37.472214] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:31:37.472449] [DEBUG] [LOCAL ] BBU: No existing data file found in primary storage. [2025-09-18T17:31:37.472507] [WARN ] [MAIN ] BBU: No existing data found, performing full refresh instead. [2025-09-18T17:31:37.472739] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-18T17:31:37.472793] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-18T17:31:37.472840] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-09-18T17:31:37.472874] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-18T17:31:37.601802] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:31:37.628445] [WARN ] [REMOTE ] BBT: No data returned for month 2024-11 [2025-09-18T17:31:37.853219] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:31:38.119562] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-18T17:31:38.681485] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-18T17:31:38.919555] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-18T17:31:39.719574] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-18T17:31:39.866032] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-18T17:31:40.319151] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-18T17:31:40.519624] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-18T17:31:41.141463] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-18T17:31:41.319545] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-11. [2025-09-18T17:31:42.045310] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-18T17:31:42.119537] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-09-18T17:31:42.715374] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-18T17:31:42.919587] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-18T17:31:43.339327] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-18T17:31:43.719599] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-18T17:31:44.519563] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-18T17:31:44.879373] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-18T17:31:44.889779] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-18T17:31:45.319589] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-09-18T17:31:45.716710] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-18T17:31:46.119554] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-18T17:31:46.545332] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-18T17:31:46.919582] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-18T17:31:47.129446] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:31:47.129824] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-18T17:31:47.719555] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-18T17:31:48.049759] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-18T17:31:48.519554] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-18T17:31:48.988546] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-18T17:31:49.319544] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-09-18T17:31:49.534427] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:31:49.534787] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-09-18T17:31:50.119562] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-18T17:31:50.813967] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-18T17:31:50.919551] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-18T17:31:51.409405] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-18T17:31:51.410529] [INFO ] [REMOTE ] BBDO: Full fetch complete (7891 records). [2025-09-18T17:31:51.410606] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-18T17:31:51.733786] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-18T17:31:51.777910] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-18T17:31:51.777991] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-18T17:31:51.778192] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-18T17:31:51.778233] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-18T17:31:51.778889] [DEBUG] [LOCAL ] BBDO: Trimmed 7891 records to 5090 (keeping 200 days of data) [2025-09-18T17:31:51.810136] [DEBUG] [LOCAL ] BBDO: Primary data saved (5090 records). [2025-09-18T17:31:51.810254] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-18T17:31:51.810516] [INFO ] [MAIN ] Update Progress: 222/2372 symbols completed. BBDO took 24.8s. Estimated remaining: 5h 8m 2s. Rate: 7.0 symbols/min [2025-09-18T17:31:51.986147] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:31:52.001499] [DEBUG] [LOCAL ] BBUC: Loaded 13228 existing records from primary storage. [2025-09-18T17:31:52.001675] [INFO ] [MAIN ] BBUC: Loaded 13228 existing records. [2025-09-18T17:31:52.235167] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:31:52.235445] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-18T17:31:52.235497] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-18T17:31:52.237616] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-18T17:31:52.237706] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-18T17:31:52.357344] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-18T17:31:52.525778] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-02. [2025-09-18T17:31:52.664449] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:31:52.830230] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:31:52.830560] [WARN ] [REMOTE ] BBT: No data returned for month 2025-02 [2025-09-18T17:31:53.319552] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-03. [2025-09-18T17:31:53.516822] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:31:53.517185] [WARN ] [REMOTE ] BBT: No data returned for month 2025-03 [2025-09-18T17:31:54.119565] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-04. [2025-09-18T17:31:54.321014] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:31:54.321334] [WARN ] [REMOTE ] BBT: No data returned for month 2025-04 [2025-09-18T17:31:54.919556] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-18T17:31:55.236322] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-18T17:31:55.719549] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-18T17:31:56.157089] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-18T17:31:56.519562] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-11. [2025-09-18T17:31:57.061823] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-18T17:31:57.319572] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-18T17:31:58.028365] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-18T17:31:58.119553] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-05. [2025-09-18T17:31:58.336177] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:31:58.336535] [WARN ] [REMOTE ] BBT: No data returned for month 2025-05 [2025-09-18T17:31:58.919572] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-18T17:31:59.482614] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-18T17:31:59.719575] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-18T17:32:00.235934] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-18T17:32:00.237351] [INFO ] [REMOTE ] BBU: Full fetch complete (6050 records). [2025-09-18T17:32:00.237451] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-18T17:32:00.524701] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-06. [2025-09-18T17:32:00.629026] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-09-18T17:32:00.629117] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-09-18T17:32:00.629316] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-09-18T17:32:00.629372] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-09-18T17:32:00.629834] [DEBUG] [LOCAL ] BBU: Trimmed 6050 records to 4094 (keeping 200 days of data) [2025-09-18T17:32:00.655289] [DEBUG] [LOCAL ] BBU: Primary data saved (4094 records). [2025-09-18T17:32:00.655378] [INFO ] [MAIN ] BBU: Full history saved. [2025-09-18T17:32:00.655477] [INFO ] [MAIN ] Update Progress: 223/2372 symbols completed. BBU took 23.4s. Estimated remaining: 5h 7m 56s. Rate: 7.0 symbols/min [2025-09-18T17:32:00.795730] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:32:00.824585] [WARN ] [REMOTE ] BBT: No data returned for month 2025-06 [2025-09-18T17:32:00.827084] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:32:00.878236] [DEBUG] [LOCAL ] BBVA: Loaded 49617 existing records from primary storage. [2025-09-18T17:32:00.878436] [INFO ] [MAIN ] BBVA: Loaded 49617 existing records. [2025-09-18T17:32:01.077612] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:32:01.077978] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-18T17:32:01.078035] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-18T17:32:01.083513] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-18T17:32:01.083661] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-18T17:32:01.324693] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-09-18T17:32:01.506090] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:32:02.119539] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-11. [2025-09-18T17:32:02.150111] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-18T17:32:02.919537] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-09-18T17:32:03.504136] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-18T17:32:03.719571] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-18T17:32:03.733555] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-18T17:32:04.380226] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-18T17:32:04.519584] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-18T17:32:05.267566] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-18T17:32:05.319562] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-18T17:32:05.962636] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-18T17:32:06.119617] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-09-18T17:32:06.919570] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-18T17:32:07.677405] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-18T17:32:07.719551] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-18T17:32:07.799243] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-18T17:32:08.519591] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-07. [2025-09-18T17:32:08.638876] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-18T17:32:08.728506] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:32:08.728912] [WARN ] [REMOTE ] BBT: No data returned for month 2025-07 [2025-09-18T17:32:09.319597] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-18T17:32:10.119557] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-18T17:32:10.185440] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-18T17:32:10.919589] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-08. [2025-09-18T17:32:10.965635] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-18T17:32:11.141917] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:32:11.142244] [WARN ] [REMOTE ] BBT: No data returned for month 2025-08 [2025-09-18T17:32:11.719581] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-18T17:32:12.456298] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T17:32:12.459877] [INFO ] [REMOTE ] BBN: Full fetch complete (26991 records). [2025-09-18T17:32:12.460042] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-18T17:32:12.524770] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-09. [2025-09-18T17:32:12.839935] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-18T17:32:12.840041] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-18T17:32:12.840412] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-18T17:32:12.840452] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-18T17:32:12.841277] [DEBUG] [LOCAL ] BBN: Trimmed 26991 records to 18195 (keeping 200 days of data) [2025-09-18T17:32:12.957104] [DEBUG] [LOCAL ] BBN: Primary data saved (18195 records). [2025-09-18T17:32:12.957258] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-18T17:32:12.957361] [INFO ] [MAIN ] Update Progress: 224/2372 symbols completed. BBN took 43.1s. Estimated remaining: 5h 8m 23s. Rate: 7.0 symbols/min [2025-09-18T17:32:13.136416] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:32:13.168577] [DEBUG] [LOCAL ] BBW: Loaded 26466 existing records from primary storage. [2025-09-18T17:32:13.168767] [INFO ] [MAIN ] BBW: Loaded 26466 existing records. [2025-09-18T17:32:13.324759] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-18T17:32:13.356576] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:32:13.356966] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-18T17:32:13.357057] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-18T17:32:13.359346] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-18T17:32:13.359425] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-18T17:32:13.732514] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:32:13.947251] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-18T17:32:14.042233] [INFO ] [REMOTE ] BBT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T17:32:14.047985] [INFO ] [REMOTE ] BBT: Full fetch complete (4003 records). [2025-09-18T17:32:14.048067] [DEBUG] [VALIDATOR ] BBT: Validating primary data. [2025-09-18T17:32:14.124743] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-09-18T17:32:14.245322] [WARN ] [VALIDATOR ] BBT: Validation failed - insufficient historical data. Have 13 unique days, need 200 days [2025-09-18T17:32:14.245768] [FATAL] [MAIN ] BBT: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:32:14.245879] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:32:14.245979] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-18T17:32:14.246100] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-18T17:32:14.246180] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-18T17:32:14.246271] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-18T17:32:14.246392] [INFO ] [MAIN ] Update Progress: 225/2372 symbols completed. BBT took 41.6s. Estimated remaining: 5h 7m 4s. Rate: 7.0 symbols/min [2025-09-18T17:32:14.428934] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:32:14.496872] [DEBUG] [LOCAL ] BBWI: Loaded 53574 existing records from primary storage. [2025-09-18T17:32:14.497062] [INFO ] [MAIN ] BBWI: Loaded 53574 existing records. [2025-09-18T17:32:14.686069] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:32:14.686314] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-18T17:32:14.686363] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-18T17:32:14.689884] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-18T17:32:14.689947] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-18T17:32:14.924790] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-18T17:32:15.071763] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:32:15.579594] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-18T17:32:15.669375] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-18T17:32:15.719574] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-18T17:32:16.519601] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-18T17:32:17.056219] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-18T17:32:17.319623] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-18T17:32:17.372897] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-18T17:32:18.119577] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-11. [2025-09-18T17:32:18.185764] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-18T17:32:18.188681] [INFO ] [REMOTE ] BBUC: Full fetch complete (17182 records). [2025-09-18T17:32:18.188833] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-18T17:32:18.593276] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-18T17:32:18.593517] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-18T17:32:18.594094] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-18T17:32:18.594182] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-18T17:32:18.595457] [DEBUG] [LOCAL ] BBUC: Trimmed 17182 records to 13344 (keeping 200 days of data) [2025-09-18T17:32:18.694945] [DEBUG] [LOCAL ] BBUC: Primary data saved (13344 records). [2025-09-18T17:32:18.695105] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-18T17:32:18.695350] [INFO ] [MAIN ] Update Progress: 226/2372 symbols completed. BBUC took 26.9s. Estimated remaining: 5h 6m 17s. Rate: 7.0 symbols/min [2025-09-18T17:32:18.887455] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:32:18.931249] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-11. [2025-09-18T17:32:18.955223] [DEBUG] [LOCAL ] BBY: Loaded 53487 existing records from primary storage. [2025-09-18T17:32:18.955379] [INFO ] [MAIN ] BBY: Loaded 53487 existing records. [2025-09-18T17:32:19.165998] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:32:19.166815] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-18T17:32:19.166911] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-18T17:32:19.181620] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-18T17:32:19.181811] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-18T17:32:19.188212] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-18T17:32:19.568829] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:32:19.719563] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-11. [2025-09-18T17:32:20.519579] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-09-18T17:32:20.860265] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-18T17:32:21.254529] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-18T17:32:21.319535] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-09-18T17:32:21.531207] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-18T17:32:22.119580] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-09-18T17:32:22.919582] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-09-18T17:32:22.999613] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-18T17:32:23.501602] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-18T17:32:23.719608] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-09-18T17:32:24.431252] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T17:32:24.519539] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-18T17:32:25.319609] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-18T17:32:25.482868] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-18T17:32:25.657569] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-18T17:32:26.119566] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-09-18T17:32:26.815888] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-18T17:32:26.919591] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-18T17:32:27.529051] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-18T17:32:27.719574] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-18T17:32:27.813616] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-18T17:32:28.519599] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-18T17:32:29.035733] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-18T17:32:29.319555] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-18T17:32:30.119589] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-18T17:32:30.178544] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-18T17:32:30.867701] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-18T17:32:30.919537] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-18T17:32:31.565799] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T17:32:31.719588] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-18T17:32:32.425702] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-18T17:32:32.519696] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-18T17:32:32.543945] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-18T17:32:33.319686] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-18T17:32:34.089440] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T17:32:34.119542] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-18T17:32:34.461505] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-18T17:32:34.919542] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-18T17:32:35.719564] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-18T17:32:35.752065] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-18T17:32:36.519552] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-18T17:32:36.638562] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-18T17:32:37.227574] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-18T17:32:37.319569] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-18T17:32:38.119563] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-18T17:32:38.433872] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-18T17:32:38.836422] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-18T17:32:38.876803] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-18T17:32:38.919579] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-18T17:32:39.719583] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-18T17:32:40.303818] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T17:32:40.519543] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-18T17:32:40.915554] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-18T17:32:41.319561] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-18T17:32:42.121126] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-18T17:32:42.127978] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-18T17:32:42.923493] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-18T17:32:42.920968] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-18T17:32:42.933190] [INFO ] [REMOTE ] BBW: Full fetch complete (39025 records). [2025-09-18T17:32:42.933497] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-18T17:32:43.338454] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-18T17:32:43.338545] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-18T17:32:43.339041] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-18T17:32:43.339105] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-18T17:32:43.340010] [DEBUG] [LOCAL ] BBW: Trimmed 39025 records to 26696 (keeping 200 days of data) [2025-09-18T17:32:43.490839] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-18T17:32:43.558144] [DEBUG] [LOCAL ] BBW: Primary data saved (26696 records). [2025-09-18T17:32:43.558289] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-18T17:32:43.558390] [INFO ] [MAIN ] Update Progress: 227/2372 symbols completed. BBW took 30.6s. Estimated remaining: 5h 8m 42s. Rate: 6.9 symbols/min [2025-09-18T17:32:43.724888] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-18T17:32:43.726931] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:32:43.774757] [DEBUG] [LOCAL ] BC: Loaded 44725 existing records from primary storage. [2025-09-18T17:32:43.774911] [INFO ] [MAIN ] BC: Loaded 44725 existing records. [2025-09-18T17:32:43.951283] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:32:43.951597] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-18T17:32:43.951667] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-18T17:32:43.953935] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-18T17:32:43.953997] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-18T17:32:44.311162] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:32:44.471669] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-18T17:32:44.519506] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-18T17:32:45.145979] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-18T17:32:45.319541] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-18T17:32:46.119571] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-11. [2025-09-18T17:32:46.410691] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-18T17:32:46.419879] [INFO ] [REMOTE ] BBWI: Full fetch complete (77249 records). [2025-09-18T17:32:46.420022] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-18T17:32:46.836297] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-18T17:32:46.836428] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-18T17:32:46.837318] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-18T17:32:46.837390] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-18T17:32:46.839304] [DEBUG] [LOCAL ] BBWI: Trimmed 77249 records to 53964 (keeping 200 days of data) [2025-09-18T17:32:46.936318] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-18T17:32:47.106486] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-18T17:32:47.234444] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-18T17:32:47.270008] [DEBUG] [LOCAL ] BBWI: Primary data saved (53964 records). [2025-09-18T17:32:47.270183] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-18T17:32:47.271435] [INFO ] [MAIN ] Update Progress: 228/2372 symbols completed. BBWI took 33.0s. Estimated remaining: 5h 7m 47s. Rate: 7.0 symbols/min [2025-09-18T17:32:47.449074] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:32:47.492587] [DEBUG] [LOCAL ] BCAT: Loaded 34660 existing records from primary storage. [2025-09-18T17:32:47.492805] [INFO ] [MAIN ] BCAT: Loaded 34660 existing records. [2025-09-18T17:32:47.684142] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:32:47.684496] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-18T17:32:47.684569] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-18T17:32:47.686696] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-09-18T17:32:47.686773] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-18T17:32:47.724719] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-09-18T17:32:48.066574] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:32:48.495331] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-18T17:32:48.519552] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-11. [2025-09-18T17:32:49.317917] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-18T17:32:49.326285] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-18T17:32:49.545482] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-18T17:32:50.119552] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-09-18T17:32:50.732437] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-18T17:32:50.919588] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-18T17:32:51.361118] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-18T17:32:51.719542] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-09-18T17:32:52.519545] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-18T17:32:52.732329] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-18T17:32:52.739110] [INFO ] [REMOTE ] BBVA: Full fetch complete (71452 records). [2025-09-18T17:32:52.739275] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-18T17:32:53.187769] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-18T17:32:53.189703] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-18T17:32:53.192272] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-18T17:32:53.198310] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-18T17:32:53.198394] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-18T17:32:53.199933] [DEBUG] [LOCAL ] BBVA: Trimmed 71452 records to 49977 (keeping 200 days of data) [2025-09-18T17:32:53.320499] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-09-18T17:32:53.518735] [DEBUG] [LOCAL ] BBVA: Primary data saved (49977 records). [2025-09-18T17:32:53.518879] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-18T17:32:53.518965] [INFO ] [MAIN ] Update Progress: 229/2372 symbols completed. BBVA took 52.9s. Estimated remaining: 5h 7m 16s. Rate: 7.0 symbols/min [2025-09-18T17:32:53.700801] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:32:53.725705] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-18T17:32:53.767983] [DEBUG] [LOCAL ] BCC: Loaded 28375 existing records from primary storage. [2025-09-18T17:32:53.768127] [INFO ] [MAIN ] BCC: Loaded 28375 existing records. [2025-09-18T17:32:53.945759] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:32:53.946026] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-18T17:32:53.946074] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-18T17:32:53.947077] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-09-18T17:32:53.947137] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-18T17:32:54.124793] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-18T17:32:54.323004] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:32:54.497552] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-18T17:32:54.919569] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-11. [2025-09-18T17:32:55.627440] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-18T17:32:55.719543] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-18T17:32:56.186135] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T17:32:56.519545] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-18T17:32:57.012292] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-18T17:32:57.319550] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-18T17:32:58.119555] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-18T17:32:58.478295] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-18T17:32:58.489626] [INFO ] [REMOTE ] BBY: Full fetch complete (77119 records). [2025-09-18T17:32:58.489866] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-18T17:32:58.906858] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-09-18T17:32:58.907143] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-09-18T17:32:58.908064] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-09-18T17:32:58.908143] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-09-18T17:32:58.909976] [DEBUG] [LOCAL ] BBY: Trimmed 77119 records to 53876 (keeping 200 days of data) [2025-09-18T17:32:58.919511] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-09-18T17:32:59.079234] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-18T17:32:59.227607] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-18T17:32:59.325710] [DEBUG] [LOCAL ] BBY: Primary data saved (53876 records). [2025-09-18T17:32:59.325911] [INFO ] [MAIN ] BBY: Full history saved. [2025-09-18T17:32:59.326030] [INFO ] [MAIN ] Update Progress: 230/2372 symbols completed. BBY took 40.6s. Estimated remaining: 5h 6m 42s. Rate: 7.0 symbols/min [2025-09-18T17:32:59.496290] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:32:59.546724] [DEBUG] [LOCAL ] BCE: Loaded 52372 existing records from primary storage. [2025-09-18T17:32:59.546913] [INFO ] [MAIN ] BCE: Loaded 52372 existing records. [2025-09-18T17:32:59.722541] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-18T17:32:59.722783] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:32:59.724233] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-18T17:32:59.724291] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-18T17:32:59.725585] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-09-18T17:32:59.725673] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-18T17:33:00.081345] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:33:00.266281] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-18T17:33:00.519570] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-18T17:33:01.238095] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-18T17:33:01.319569] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-18T17:33:02.003161] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T17:33:02.119584] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-18T17:33:02.575802] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-18T17:33:02.919615] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-09-18T17:33:03.522907] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T17:33:03.719516] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-18T17:33:03.755118] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T17:33:04.519579] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-18T17:33:04.780716] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-18T17:33:05.319570] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-18T17:33:05.775914] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-18T17:33:06.119553] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-18T17:33:06.367380] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-18T17:33:06.919547] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-18T17:33:07.175484] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-18T17:33:07.719683] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-18T17:33:08.053913] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-18T17:33:08.519554] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-11. [2025-09-18T17:33:09.063632] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-18T17:33:09.319581] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-18T17:33:10.004848] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-18T17:33:10.119544] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-09-18T17:33:10.538136] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-18T17:33:10.919614] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-18T17:33:11.629847] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-18T17:33:11.719569] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-18T17:33:11.900621] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-18T17:33:12.519610] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-18T17:33:13.316078] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-18T17:33:13.322864] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-09-18T17:33:14.017482] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-18T17:33:14.026000] [INFO ] [REMOTE ] BC: Full fetch complete (63472 records). [2025-09-18T17:33:14.026114] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-18T17:33:14.127936] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-18T17:33:14.417149] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-09-18T17:33:14.417228] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-09-18T17:33:14.417883] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-09-18T17:33:14.417946] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-09-18T17:33:14.419179] [DEBUG] [LOCAL ] BC: Trimmed 63472 records to 45007 (keeping 200 days of data) [2025-09-18T17:33:14.691809] [DEBUG] [LOCAL ] BC: Primary data saved (45007 records). [2025-09-18T17:33:14.692149] [INFO ] [MAIN ] BC: Full history saved. [2025-09-18T17:33:14.692285] [INFO ] [MAIN ] Update Progress: 231/2372 symbols completed. BC took 31.1s. Estimated remaining: 5h 7m 36s. Rate: 7.0 symbols/min [2025-09-18T17:33:14.875294] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:33:14.875607] [DEBUG] [LOCAL ] BCH: No existing data file found in primary storage. [2025-09-18T17:33:14.875703] [WARN ] [MAIN ] BCH: No existing data found, performing full refresh instead. [2025-09-18T17:33:14.875914] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-18T17:33:14.875985] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-18T17:33:14.876133] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-09-18T17:33:14.876229] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-18T17:33:14.921301] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-18T17:33:15.008779] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-18T17:33:15.300752] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:33:15.311123] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-18T17:33:15.719544] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-11. [2025-09-18T17:33:16.219074] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-18T17:33:16.224042] [INFO ] [REMOTE ] BCAT: Full fetch complete (49534 records). [2025-09-18T17:33:16.224163] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-18T17:33:16.225057] [FATAL] [VALIDATOR ] BCAT: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:33:16.225153] [FATAL] [MAIN ] BCAT: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:33:16.225197] [WARN ] [MAIN ] BCAT: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:33:16.225236] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-18T17:33:16.225296] [DEBUG] [LOCAL ] BCAT: No primary data file found to delete. [2025-09-18T17:33:16.225347] [INFO ] [LOCAL ] BCAT: Starting deletion of derivative data. [2025-09-18T17:33:16.225843] [DEBUG] [LOCAL ] BCAT: Deleted derivative data file. [2025-09-18T17:33:16.225959] [INFO ] [MAIN ] Update Progress: 232/2372 symbols completed. BCAT took 29.0s. Estimated remaining: 5h 6m 22s. Rate: 7.0 symbols/min [2025-09-18T17:33:16.399182] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:33:16.426498] [DEBUG] [LOCAL ] BCO: Loaded 26474 existing records from primary storage. [2025-09-18T17:33:16.426630] [INFO ] [MAIN ] BCO: Loaded 26474 existing records. [2025-09-18T17:33:16.524733] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-18T17:33:16.606500] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:33:16.606784] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-18T17:33:16.606840] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-18T17:33:16.607571] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-09-18T17:33:16.607630] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-18T17:33:16.977494] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:33:16.991976] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T17:33:17.319562] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-18T17:33:17.930563] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-18T17:33:18.119596] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-18T17:33:18.594880] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-18T17:33:18.919557] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-18T17:33:19.005715] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-18T17:33:19.719564] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-11. [2025-09-18T17:33:20.519621] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-18T17:33:20.785318] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-18T17:33:20.841294] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T17:33:21.319548] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-18T17:33:21.501932] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-18T17:33:22.119585] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-18T17:33:22.684350] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-18T17:33:22.919549] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-18T17:33:23.635553] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T17:33:23.639799] [INFO ] [REMOTE ] BCC: Full fetch complete (39871 records). [2025-09-18T17:33:23.639887] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-18T17:33:23.724629] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-09-18T17:33:24.039468] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-18T17:33:24.039557] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-18T17:33:24.040039] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-18T17:33:24.040103] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-18T17:33:24.041049] [DEBUG] [LOCAL ] BCC: Trimmed 39871 records to 28653 (keeping 200 days of data) [2025-09-18T17:33:24.221595] [DEBUG] [LOCAL ] BCC: Primary data saved (28653 records). [2025-09-18T17:33:24.221799] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-18T17:33:24.221906] [INFO ] [MAIN ] Update Progress: 233/2372 symbols completed. BCC took 30.7s. Estimated remaining: 5h 6m 8s. Rate: 7.0 symbols/min [2025-09-18T17:33:24.408728] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:33:24.469578] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-18T17:33:24.503066] [DEBUG] [LOCAL ] BCS: Loaded 53479 existing records from primary storage. [2025-09-18T17:33:24.503272] [INFO ] [MAIN ] BCS: Loaded 53479 existing records. [2025-09-18T17:33:24.528199] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-18T17:33:24.707531] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:33:24.708131] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-18T17:33:24.708214] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-18T17:33:24.716155] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-09-18T17:33:24.728186] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-18T17:33:24.735585] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-18T17:33:25.112211] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:33:25.319576] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-09-18T17:33:25.904208] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T17:33:26.119625] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-11. [2025-09-18T17:33:26.529093] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-18T17:33:26.919593] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-09-18T17:33:27.721271] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-09-18T17:33:27.727982] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-18T17:33:27.828909] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-18T17:33:28.522512] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-18T17:33:28.527420] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-18T17:33:29.319632] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-18T17:33:29.950946] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T17:33:30.113407] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-18T17:33:30.119481] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-18T17:33:30.919608] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-09-18T17:33:31.445059] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-18T17:33:31.719583] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-18T17:33:32.487814] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-18T17:33:32.519503] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-09-18T17:33:33.303728] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-18T17:33:33.319515] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-18T17:33:34.094039] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-18T17:33:34.119493] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-18T17:33:34.257535] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-18T17:33:34.919590] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-18T17:33:35.719539] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-18T17:33:35.980663] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-18T17:33:36.040800] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-18T17:33:36.519560] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-18T17:33:36.694378] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-18T17:33:37.319587] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-18T17:33:37.931069] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-18T17:33:38.119718] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-18T17:33:38.919600] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-18T17:33:39.144920] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-18T17:33:39.499978] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-18T17:33:39.507612] [INFO ] [REMOTE ] BCE: Full fetch complete (76052 records). [2025-09-18T17:33:39.507822] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-18T17:33:39.742918] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-18T17:33:39.977974] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-18T17:33:39.978082] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-18T17:33:39.978980] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-18T17:33:39.979065] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-18T17:33:39.996797] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-18T17:33:40.003174] [DEBUG] [LOCAL ] BCE: Trimmed 76052 records to 52752 (keeping 200 days of data) [2025-09-18T17:33:40.333265] [DEBUG] [LOCAL ] BCE: Primary data saved (52752 records). [2025-09-18T17:33:40.333466] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-18T17:33:40.333585] [INFO ] [MAIN ] Update Progress: 234/2372 symbols completed. BCE took 41.0s. Estimated remaining: 5h 7m 8s. Rate: 7.0 symbols/min [2025-09-18T17:33:40.514202] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:33:40.519515] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-18T17:33:40.545959] [DEBUG] [LOCAL ] BCSF: Loaded 27950 existing records from primary storage. [2025-09-18T17:33:40.546093] [INFO ] [MAIN ] BCSF: Loaded 27950 existing records. [2025-09-18T17:33:40.727785] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:33:40.728063] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-18T17:33:40.728112] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-18T17:33:40.728790] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-18T17:33:40.728850] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-18T17:33:41.094376] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:33:41.319518] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-11. [2025-09-18T17:33:41.796094] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-18T17:33:41.823630] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T17:33:41.971363] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-18T17:33:42.119551] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-09-18T17:33:42.919566] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-18T17:33:43.201307] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-18T17:33:43.719583] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-09-18T17:33:43.947637] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-18T17:33:44.489699] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-18T17:33:44.519536] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-18T17:33:45.319519] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-18T17:33:45.342488] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-18T17:33:46.119563] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-18T17:33:46.846971] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T17:33:46.919571] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-18T17:33:47.198917] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-18T17:33:47.719548] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-18T17:33:48.510981] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-18T17:33:48.519484] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-18T17:33:48.703987] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-18T17:33:49.319543] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-18T17:33:49.495956] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-18T17:33:50.119555] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-18T17:33:50.343806] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-18T17:33:50.348008] [INFO ] [REMOTE ] BCH: Full fetch complete (40432 records). [2025-09-18T17:33:50.348091] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-18T17:33:50.349143] [FATAL] [VALIDATOR ] BCH: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:33:50.349231] [FATAL] [MAIN ] BCH: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:33:50.349275] [WARN ] [MAIN ] BCH: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:33:50.349326] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-18T17:33:50.349429] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-09-18T17:33:50.349485] [INFO ] [LOCAL ] BCH: Starting deletion of derivative data. [2025-09-18T17:33:50.349530] [DEBUG] [LOCAL ] BCH: No derivative data file found to delete. [2025-09-18T17:33:50.349587] [INFO ] [MAIN ] Update Progress: 235/2372 symbols completed. BCH took 35.7s. Estimated remaining: 5h 7m 12s. Rate: 7.0 symbols/min [2025-09-18T17:33:50.520664] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:33:50.541575] [DEBUG] [LOCAL ] BCX: Loaded 22046 existing records from primary storage. [2025-09-18T17:33:50.541734] [INFO ] [MAIN ] BCX: Loaded 22046 existing records. [2025-09-18T17:33:50.720073] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:33:50.720347] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-18T17:33:50.720398] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-18T17:33:50.720998] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-09-18T17:33:50.721062] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-18T17:33:50.924716] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-18T17:33:51.111838] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:33:51.719508] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-18T17:33:52.070994] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-18T17:33:52.129422] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-18T17:33:52.519560] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-11. [2025-09-18T17:33:52.627974] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-18T17:33:53.319557] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-18T17:33:53.391211] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-18T17:33:54.119569] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-18T17:33:54.915196] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-18T17:33:54.920481] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-18T17:33:55.214280] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-18T17:33:55.682460] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-18T17:33:55.719535] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-18T17:33:56.524014] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-09-18T17:33:56.525541] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-18T17:33:57.319543] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-18T17:33:57.412821] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-18T17:33:58.119515] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-18T17:33:58.325770] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T17:33:58.329260] [INFO ] [REMOTE ] BCO: Full fetch complete (36738 records). [2025-09-18T17:33:58.329353] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-18T17:33:58.708750] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-09-18T17:33:58.708844] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-09-18T17:33:58.709288] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-09-18T17:33:58.709342] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-09-18T17:33:58.710388] [DEBUG] [LOCAL ] BCO: Trimmed 36738 records to 26698 (keeping 200 days of data) [2025-09-18T17:33:58.890983] [DEBUG] [LOCAL ] BCO: Primary data saved (26698 records). [2025-09-18T17:33:58.891248] [INFO ] [MAIN ] BCO: Full history saved. [2025-09-18T17:33:58.891389] [INFO ] [MAIN ] Update Progress: 236/2372 symbols completed. BCO took 42.7s. Estimated remaining: 5h 7m 3s. Rate: 7.0 symbols/min [2025-09-18T17:33:58.927491] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-09-18T17:33:59.117528] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:33:59.150344] [DEBUG] [LOCAL ] BDC: Loaded 25058 existing records from primary storage. [2025-09-18T17:33:59.150500] [INFO ] [MAIN ] BDC: Loaded 25058 existing records. [2025-09-18T17:33:59.373629] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:33:59.373967] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-18T17:33:59.374024] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-18T17:33:59.374739] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-09-18T17:33:59.374801] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-18T17:33:59.723060] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-18T17:33:59.748086] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:33:59.866857] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-18T17:33:59.990601] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-18T17:33:59.998151] [INFO ] [REMOTE ] BCS: Full fetch complete (77096 records). [2025-09-18T17:33:59.998284] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-18T17:34:00.393626] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-09-18T17:34:00.393739] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-09-18T17:34:00.394497] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-09-18T17:34:00.394610] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-09-18T17:34:00.396135] [DEBUG] [LOCAL ] BCS: Trimmed 77096 records to 53865 (keeping 200 days of data) [2025-09-18T17:34:00.519765] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-11. [2025-09-18T17:34:00.734044] [DEBUG] [LOCAL ] BCS: Primary data saved (53865 records). [2025-09-18T17:34:00.734196] [INFO ] [MAIN ] BCS: Full history saved. [2025-09-18T17:34:00.734332] [INFO ] [MAIN ] Update Progress: 237/2372 symbols completed. BCS took 36.5s. Estimated remaining: 5h 5m 53s. Rate: 7.0 symbols/min [2025-09-18T17:34:00.773029] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-18T17:34:01.319550] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-18T17:34:01.868546] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-18T17:34:02.079594] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-18T17:34:02.119514] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-18T17:34:02.919602] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-09-18T17:34:03.441159] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T17:34:03.669815] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-18T17:34:03.719511] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-09-18T17:34:04.519518] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-18T17:34:04.909509] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-18T17:34:05.319525] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-18T17:34:05.349119] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-18T17:34:06.119602] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-18T17:34:06.168490] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-18T17:34:06.919548] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-18T17:34:07.416919] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-18T17:34:07.719680] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-18T17:34:07.831467] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-18T17:34:08.519566] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-18T17:34:08.565183] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-18T17:34:09.319578] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-18T17:34:09.448402] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-18T17:34:09.452426] [INFO ] [REMOTE ] BCSF: Full fetch complete (37572 records). [2025-09-18T17:34:09.452512] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-18T17:34:09.844288] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-18T17:34:09.844398] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-18T17:34:09.844911] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-18T17:34:09.844989] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-18T17:34:09.845881] [DEBUG] [LOCAL ] BCSF: Trimmed 37572 records to 28159 (keeping 200 days of data) [2025-09-18T17:34:10.014370] [DEBUG] [LOCAL ] BCSF: Primary data saved (28159 records). [2025-09-18T17:34:10.014529] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-18T17:34:10.014680] [INFO ] [MAIN ] Update Progress: 238/2372 symbols completed. BCSF took 29.7s. Estimated remaining: 5h 5m 51s. Rate: 7.0 symbols/min [2025-09-18T17:34:10.119595] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-18T17:34:10.323690] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-18T17:34:10.919580] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-18T17:34:11.089890] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-18T17:34:11.719582] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-18T17:34:12.055536] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-18T17:34:12.519613] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-18T17:34:12.641424] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-18T17:34:13.319556] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-18T17:34:13.620810] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-18T17:34:14.105161] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-18T17:34:14.119496] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-18T17:34:14.919518] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-18T17:34:15.292457] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T17:34:15.565605] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-18T17:34:15.719548] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-18T17:34:16.498463] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-18T17:34:16.501531] [INFO ] [REMOTE ] BCX: Full fetch complete (34105 records). [2025-09-18T17:34:16.501684] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-18T17:34:16.534968] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-18T17:34:16.890150] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-18T17:34:16.890236] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-18T17:34:16.890743] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-18T17:34:16.890808] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-18T17:34:16.891755] [DEBUG] [LOCAL ] BCX: Trimmed 34105 records to 22175 (keeping 200 days of data) [2025-09-18T17:34:17.027232] [DEBUG] [LOCAL ] BCX: Primary data saved (22175 records). [2025-09-18T17:34:17.027369] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-18T17:34:17.027456] [INFO ] [MAIN ] Update Progress: 239/2372 symbols completed. BCX took 26.7s. Estimated remaining: 5h 5m 28s. Rate: 7.0 symbols/min [2025-09-18T17:34:17.454602] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-18T17:34:17.460458] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-18T17:34:18.331994] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-18T17:34:18.337888] [INFO ] [REMOTE ] BDC: Full fetch complete (35563 records). [2025-09-18T17:34:18.338117] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-18T17:34:18.898589] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-18T17:34:18.898749] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-18T17:34:18.899546] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-18T17:34:18.899635] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-18T17:34:18.901171] [DEBUG] [LOCAL ] BDC: Trimmed 35563 records to 25249 (keeping 200 days of data) [2025-09-18T17:34:19.101699] [DEBUG] [LOCAL ] BDC: Primary data saved (25249 records). [2025-09-18T17:34:19.101897] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-18T17:34:19.102048] [INFO ] [MAIN ] Update Progress: 240/2372 symbols completed. BDC took 20.2s. Estimated remaining: 5h 4m 21s. Rate: 7.0 symbols/min [2025-09-18T17:34:19.776607] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:34:19.784456] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:34:19.814782] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:34:19.834798] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:34:19.814929] [DEBUG] [LOCAL ] BE: No existing data file found in primary storage. [2025-09-18T17:34:19.836430] [WARN ] [MAIN ] BE: No existing data found, performing full refresh instead. [2025-09-18T17:34:19.838602] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-18T17:34:19.838703] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-18T17:34:19.838820] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-09-18T17:34:19.839047] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-18T17:34:20.052404] [DEBUG] [LOCAL ] BDJ: Loaded 29274 existing records from primary storage. [2025-09-18T17:34:20.115575] [INFO ] [MAIN ] BDJ: Loaded 29274 existing records. [2025-09-18T17:34:20.395832] [DEBUG] [LOCAL ] BDN: Loaded 47693 existing records from primary storage. [2025-09-18T17:34:20.399869] [DEBUG] [LOCAL ] BDX: Loaded 52531 existing records from primary storage. [2025-09-18T17:34:20.433382] [INFO ] [MAIN ] BDN: Loaded 47693 existing records. [2025-09-18T17:34:20.450207] [INFO ] [MAIN ] BDX: Loaded 52531 existing records. [2025-09-18T17:34:20.463592] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:34:20.532444] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-11. [2025-09-18T17:34:20.553835] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:34:20.612802] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-18T17:34:20.635121] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-18T17:34:20.673109] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-09-18T17:34:20.714215] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-18T17:34:20.981442] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:34:20.981241] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:34:20.997672] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-18T17:34:20.997784] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-18T17:34:21.027365] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-18T17:34:21.041491] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-18T17:34:21.057901] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-09-18T17:34:21.067298] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-18T17:34:21.057858] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-09-18T17:34:21.132232] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-18T17:34:21.733324] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:34:21.760536] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-11. [2025-09-18T17:34:21.937528] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:34:21.937916] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-11. [2025-09-18T17:34:22.017716] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:34:22.018013] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-11. [2025-09-18T17:34:22.365026] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-18T17:34:22.375211] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-09-18T17:34:22.851830] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T17:34:22.858584] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-09-18T17:34:23.402631] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-18T17:34:23.412564] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-09-18T17:34:23.902203] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-18T17:34:23.913617] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-09-18T17:34:23.946608] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-18T17:34:23.982292] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-18T17:34:24.519575] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-09-18T17:34:24.918982] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-18T17:34:25.319553] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-09-18T17:34:25.416413] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-18T17:34:25.564910] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-18T17:34:26.119592] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-18T17:34:26.693979] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-18T17:34:26.919540] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-18T17:34:27.719583] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-09-18T17:34:27.938127] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-18T17:34:28.283697] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-18T17:34:28.519561] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-18T17:34:29.033457] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T17:34:29.327290] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-18T17:34:29.332313] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-18T17:34:30.119586] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-18T17:34:30.919513] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-18T17:34:30.982864] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-18T17:34:31.514700] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-18T17:34:31.719588] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-09-18T17:34:32.382013] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T17:34:32.519554] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-18T17:34:32.968577] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T17:34:33.319588] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-18T17:34:34.119519] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-18T17:34:34.168105] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-18T17:34:34.620871] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-18T17:34:34.919542] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-18T17:34:35.719543] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-18T17:34:35.789580] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-18T17:34:36.254321] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-18T17:34:36.519584] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-18T17:34:37.324632] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-18T17:34:37.363217] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-18T17:34:37.676317] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-18T17:34:38.119606] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-18T17:34:38.875043] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-18T17:34:38.919503] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-18T17:34:39.457105] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-18T17:34:39.719539] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-18T17:34:40.519545] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-18T17:34:41.319583] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-18T17:34:41.413476] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-18T17:34:41.673823] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-18T17:34:41.992743] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (3.07 seconds). [2025-09-18T17:34:42.119558] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-18T17:34:42.862774] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-18T17:34:42.919541] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-18T17:34:43.719560] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-18T17:34:44.025451] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-18T17:34:44.519558] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-18T17:34:44.751631] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-18T17:34:45.180665] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T17:34:45.319555] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-18T17:34:46.119619] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-18T17:34:46.478267] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-18T17:34:46.919552] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-18T17:34:47.326342] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-18T17:34:47.414135] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-18T17:34:47.719583] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-18T17:34:48.519546] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-18T17:34:48.938854] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-18T17:34:48.973044] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-18T17:34:48.988757] [INFO ] [REMOTE ] BE: Full fetch complete (77544 records). [2025-09-18T17:34:48.989148] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-18T17:34:49.324737] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-18T17:34:49.403533] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-09-18T17:34:49.403616] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-09-18T17:34:49.404558] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-09-18T17:34:49.404680] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-09-18T17:34:49.406316] [DEBUG] [LOCAL ] BE: Trimmed 77544 records to 54043 (keeping 200 days of data) [2025-09-18T17:34:49.743001] [DEBUG] [LOCAL ] BE: Primary data saved (54043 records). [2025-09-18T17:34:49.744095] [INFO ] [MAIN ] BE: Full history saved. [2025-09-18T17:34:49.744256] [INFO ] [MAIN ] Update Progress: 241/2372 symbols completed. BE took 30.6s. Estimated remaining: 5h 7m 28s. Rate: 6.9 symbols/min [2025-09-18T17:34:49.919842] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:34:49.920034] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-18T17:34:49.920120] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-18T17:34:49.920267] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-18T17:34:49.920321] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-18T17:34:49.920389] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-18T17:34:49.920437] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-18T17:34:50.128039] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-18T17:34:50.276620] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:34:50.776140] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-18T17:34:50.784230] [INFO ] [REMOTE ] BDX: Full fetch complete (75780 records). [2025-09-18T17:34:50.784368] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-18T17:34:50.924827] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-11. [2025-09-18T17:34:51.178078] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-09-18T17:34:51.178165] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-09-18T17:34:51.178971] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-18T17:34:51.179038] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-09-18T17:34:51.181797] [DEBUG] [LOCAL ] BDX: Trimmed 75780 records to 52896 (keeping 200 days of data) [2025-09-18T17:34:51.539539] [DEBUG] [LOCAL ] BDX: Primary data saved (52896 records). [2025-09-18T17:34:51.540218] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-18T17:34:51.540769] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-18T17:34:51.540933] [INFO ] [MAIN ] Update Progress: 242/2372 symbols completed. BDX took 32.4s. Estimated remaining: 5h 6m 19s. Rate: 7.0 symbols/min [2025-09-18T17:34:51.715006] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:34:51.719569] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-18T17:34:51.771089] [DEBUG] [LOCAL ] BEKE: Loaded 53267 existing records from primary storage. [2025-09-18T17:34:51.771267] [INFO ] [MAIN ] BEKE: Loaded 53267 existing records. [2025-09-18T17:34:51.949072] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:34:51.949339] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-18T17:34:51.949388] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-18T17:34:51.951033] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-18T17:34:51.951095] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-18T17:34:52.247830] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-18T17:34:52.312373] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:34:52.329600] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-18T17:34:52.337035] [INFO ] [REMOTE ] BDN: Full fetch complete (69157 records). [2025-09-18T17:34:52.337166] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-18T17:34:52.529325] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-11. [2025-09-18T17:34:52.740667] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-09-18T17:34:52.740897] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-09-18T17:34:52.741616] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-09-18T17:34:52.741701] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-09-18T17:34:52.743679] [DEBUG] [LOCAL ] BDN: Trimmed 69157 records to 48037 (keeping 200 days of data) [2025-09-18T17:34:53.041134] [DEBUG] [LOCAL ] BDN: Primary data saved (48037 records). [2025-09-18T17:34:53.041306] [INFO ] [MAIN ] BDN: Full history saved. [2025-09-18T17:34:53.041448] [INFO ] [MAIN ] Update Progress: 243/2372 symbols completed. BDN took 33.9s. Estimated remaining: 5h 5m 8s. Rate: 7.0 symbols/min [2025-09-18T17:34:53.211444] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:34:53.264657] [DEBUG] [LOCAL ] BEN: Loaded 53082 existing records from primary storage. [2025-09-18T17:34:53.264806] [INFO ] [MAIN ] BEN: Loaded 53082 existing records. [2025-09-18T17:34:53.327905] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-18T17:34:53.444530] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:34:53.444831] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-18T17:34:53.444883] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-18T17:34:53.446546] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-18T17:34:53.446607] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-18T17:34:53.812230] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-18T17:34:53.818539] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:34:53.843534] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-18T17:34:54.119566] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-18T17:34:54.919570] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-11. [2025-09-18T17:34:55.278422] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-18T17:34:55.309452] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-11 (2.78 seconds). [2025-09-18T17:34:55.719571] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-18T17:34:55.968877] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-09-18T17:34:56.519537] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-18T17:34:56.810191] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-18T17:34:57.282595] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-11 (2.36 seconds). [2025-09-18T17:34:57.319582] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-18T17:34:58.119879] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-18T17:34:58.166670] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-18T17:34:58.562415] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-18T17:34:58.919560] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-09-18T17:34:59.719610] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-18T17:35:00.519519] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-09-18T17:35:00.938333] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-18T17:35:00.978950] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-18T17:35:00.983606] [INFO ] [REMOTE ] BDJ: Full fetch complete (42587 records). [2025-09-18T17:35:00.983737] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-18T17:35:00.984418] [FATAL] [VALIDATOR ] BDJ: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:35:00.984682] [FATAL] [MAIN ] BDJ: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:35:00.984783] [WARN ] [MAIN ] BDJ: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:35:00.984859] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-18T17:35:00.984935] [DEBUG] [LOCAL ] BDJ: No primary data file found to delete. [2025-09-18T17:35:00.985002] [INFO ] [LOCAL ] BDJ: Starting deletion of derivative data. [2025-09-18T17:35:00.985850] [DEBUG] [LOCAL ] BDJ: Deleted derivative data file. [2025-09-18T17:35:00.985947] [INFO ] [MAIN ] Update Progress: 244/2372 symbols completed. BDJ took 41.9s. Estimated remaining: 5h 4m 54s. Rate: 7.0 symbols/min [2025-09-18T17:35:01.169519] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:35:01.230100] [DEBUG] [LOCAL ] BEP: Loaded 38801 existing records from primary storage. [2025-09-18T17:35:01.230279] [INFO ] [MAIN ] BEP: Loaded 38801 existing records. [2025-09-18T17:35:01.326312] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-18T17:35:01.416866] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:35:01.417128] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-18T17:35:01.417177] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-18T17:35:01.419504] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-09-18T17:35:01.419565] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-18T17:35:01.781085] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:35:01.929070] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-18T17:35:02.087798] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-18T17:35:02.119531] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-09-18T17:35:02.919603] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-09-18T17:35:03.719574] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-18T17:35:03.925870] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-18T17:35:04.002116] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-18T17:35:04.374934] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-18T17:35:04.519578] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-11. [2025-09-18T17:35:05.319549] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-18T17:35:05.578540] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-18T17:35:05.872385] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-18T17:35:06.119570] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-18T17:35:06.919551] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-18T17:35:07.724722] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-09-18T17:35:07.747600] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-18T17:35:08.519616] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-18T17:35:08.622577] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-18T17:35:08.859661] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-18T17:35:09.319560] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-18T17:35:09.994913] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T17:35:10.119550] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-18T17:35:10.919616] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-09-18T17:35:11.719616] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-18T17:35:12.004037] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-09-18T17:35:12.065450] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-18T17:35:12.519573] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-18T17:35:12.780783] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-18T17:35:13.322703] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-18T17:35:13.325900] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-18T17:35:13.738020] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-18T17:35:13.739045] [INFO ] [REMOTE ] BEDU: Full fetch complete (1386 records). [2025-09-18T17:35:13.739155] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-18T17:35:13.942951] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-18T17:35:13.943176] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:35:13.943248] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:35:13.943348] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-18T17:35:13.943439] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-18T17:35:13.943481] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-18T17:35:13.943524] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-18T17:35:13.943602] [INFO ] [MAIN ] Update Progress: 245/2372 symbols completed. BEDU took 24.2s. Estimated remaining: 5h 5m 23s. Rate: 7.0 symbols/min [2025-09-18T17:35:14.117356] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:35:14.119511] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-18T17:35:14.166380] [DEBUG] [LOCAL ] BEPC: Loaded 46641 existing records from primary storage. [2025-09-18T17:35:14.166545] [INFO ] [MAIN ] BEPC: Loaded 46641 existing records. [2025-09-18T17:35:14.377116] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:35:14.377610] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-18T17:35:14.377808] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-18T17:35:14.379237] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-09-18T17:35:14.379300] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-18T17:35:14.596894] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-18T17:35:14.796926] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:35:14.919527] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-11. [2025-09-18T17:35:15.574842] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-18T17:35:15.719541] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-18T17:35:16.519579] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-18T17:35:16.669410] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-18T17:35:17.139579] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-18T17:35:17.319558] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-09-18T17:35:17.968927] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T17:35:18.119506] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-18T17:35:18.516542] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-18T17:35:18.919559] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-09-18T17:35:19.680716] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-18T17:35:19.719566] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-18T17:35:20.211952] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-18T17:35:20.519598] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-18T17:35:21.248855] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T17:35:21.319504] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-18T17:35:21.662528] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T17:35:22.119557] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-18T17:35:22.812918] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T17:35:22.919615] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-18T17:35:23.243189] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-18T17:35:23.719590] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-18T17:35:24.101012] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-18T17:35:24.519556] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-18T17:35:25.319542] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-18T17:35:25.503154] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-18T17:35:25.761821] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T17:35:26.119564] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-18T17:35:26.916408] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-18T17:35:26.923537] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-18T17:35:26.925178] [INFO ] [REMOTE ] BEN: Full fetch complete (76741 records). [2025-09-18T17:35:26.925343] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-18T17:35:27.402687] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-09-18T17:35:27.402853] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-09-18T17:35:27.404075] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-09-18T17:35:27.404194] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-09-18T17:35:27.406399] [DEBUG] [LOCAL ] BEN: Trimmed 76741 records to 53466 (keeping 200 days of data) [2025-09-18T17:35:27.727155] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-18T17:35:27.772945] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-18T17:35:27.794631] [DEBUG] [LOCAL ] BEN: Primary data saved (53466 records). [2025-09-18T17:35:27.794880] [INFO ] [MAIN ] BEN: Full history saved. [2025-09-18T17:35:27.795004] [INFO ] [MAIN ] Update Progress: 246/2372 symbols completed. BEN took 34.8s. Estimated remaining: 5h 5m 59s. Rate: 6.9 symbols/min [2025-09-18T17:35:28.026424] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:35:28.034492] [DEBUG] [LOCAL ] BEPH: Loaded 5228 existing records from primary storage. [2025-09-18T17:35:28.034688] [INFO ] [MAIN ] BEPH: Loaded 5228 existing records. [2025-09-18T17:35:28.214363] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:35:28.214739] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-18T17:35:28.215014] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-18T17:35:28.215432] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-09-18T17:35:28.215544] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-18T17:35:28.408019] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-18T17:35:28.529405] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-18T17:35:28.619489] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:35:29.221450] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T17:35:29.319620] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-18T17:35:29.716901] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-18T17:35:30.119550] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-18T17:35:30.919598] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-11. [2025-09-18T17:35:31.182632] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-18T17:35:31.190244] [INFO ] [REMOTE ] BEKE: Full fetch complete (77048 records). [2025-09-18T17:35:31.190429] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-18T17:35:31.623896] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-18T17:35:31.724387] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-18T17:35:31.904146] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-18T17:35:31.957953] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-09-18T17:35:31.958076] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-09-18T17:35:31.959275] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-09-18T17:35:31.959373] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-09-18T17:35:31.961610] [DEBUG] [LOCAL ] BEKE: Trimmed 77048 records to 53656 (keeping 200 days of data) [2025-09-18T17:35:32.379034] [DEBUG] [LOCAL ] BEKE: Primary data saved (53656 records). [2025-09-18T17:35:32.379191] [INFO ] [MAIN ] BEKE: Full history saved. [2025-09-18T17:35:32.379283] [INFO ] [MAIN ] Update Progress: 247/2372 symbols completed. BEKE took 40.8s. Estimated remaining: 5h 5m 16s. Rate: 7.0 symbols/min [2025-09-18T17:35:32.528672] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-18T17:35:32.565028] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:35:32.570764] [DEBUG] [LOCAL ] BEPI: Loaded 3429 existing records from primary storage. [2025-09-18T17:35:32.570852] [INFO ] [MAIN ] BEPI: Loaded 3429 existing records. [2025-09-18T17:35:32.750176] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:35:32.750435] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-18T17:35:32.750484] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-18T17:35:32.750775] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-18T17:35:32.750834] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-18T17:35:33.154090] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:35:33.319531] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-11. [2025-09-18T17:35:33.405245] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-18T17:35:33.933497] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-18T17:35:33.962872] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T17:35:34.119599] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-18T17:35:34.919567] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-09-18T17:35:35.342714] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-18T17:35:35.380313] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-18T17:35:35.719577] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-09-18T17:35:36.312181] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-18T17:35:36.519567] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-18T17:35:37.319604] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-18T17:35:37.698460] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-18T17:35:37.856877] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-18T17:35:38.119612] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-18T17:35:38.536348] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-18T17:35:38.919603] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-09-18T17:35:39.300372] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-18T17:35:39.719591] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-18T17:35:40.099586] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-18T17:35:40.519570] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-09-18T17:35:40.847905] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-18T17:35:41.319562] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-18T17:35:42.119545] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-18T17:35:42.565689] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-18T17:35:42.893615] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-18T17:35:42.919504] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-18T17:35:43.719553] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-18T17:35:44.522076] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-18T17:35:44.526050] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-18T17:35:44.532833] [INFO ] [REMOTE ] BEPC: Full fetch complete (68287 records). [2025-09-18T17:35:44.532962] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-18T17:35:44.650415] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-18T17:35:44.939787] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-09-18T17:35:44.939892] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-09-18T17:35:44.940582] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-09-18T17:35:44.940627] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-09-18T17:35:44.942123] [DEBUG] [LOCAL ] BEPC: Trimmed 68287 records to 46987 (keeping 200 days of data) [2025-09-18T17:35:45.234536] [DEBUG] [LOCAL ] BEPC: Primary data saved (46987 records). [2025-09-18T17:35:45.234726] [INFO ] [MAIN ] BEPC: Full history saved. [2025-09-18T17:35:45.236205] [INFO ] [MAIN ] Update Progress: 248/2372 symbols completed. BEPC took 31.3s. Estimated remaining: 5h 5m 44s. Rate: 6.9 symbols/min [2025-09-18T17:35:45.324720] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-18T17:35:45.420397] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:35:45.427245] [DEBUG] [LOCAL ] BEPJ: Loaded 3292 existing records from primary storage. [2025-09-18T17:35:45.427394] [INFO ] [MAIN ] BEPJ: Loaded 3292 existing records. [2025-09-18T17:35:45.615732] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:35:45.616121] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-18T17:35:45.616221] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-18T17:35:45.616610] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-09-18T17:35:45.616814] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-18T17:35:45.994998] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T17:35:46.056351] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:35:46.062959] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-18T17:35:46.119497] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-18T17:35:46.468334] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-18T17:35:46.919540] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-18T17:35:47.338439] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-18T17:35:47.719551] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-11. [2025-09-18T17:35:48.318608] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-18T17:35:48.519546] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-09-18T17:35:49.037147] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-18T17:35:49.319604] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-09-18T17:35:49.899313] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-18T17:35:50.119596] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-18T17:35:50.487780] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-18T17:35:50.919545] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-18T17:35:51.368791] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-18T17:35:51.719552] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-18T17:35:52.039788] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-18T17:35:52.519561] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-18T17:35:52.828368] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-18T17:35:53.319565] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-18T17:35:54.119551] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-18T17:35:54.381005] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-18T17:35:54.386464] [INFO ] [REMOTE ] BEP: Full fetch complete (58170 records). [2025-09-18T17:35:54.386599] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-18T17:35:54.505280] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-18T17:35:54.820611] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-09-18T17:35:54.820747] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-09-18T17:35:54.821487] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-09-18T17:35:54.821555] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-09-18T17:35:54.822992] [DEBUG] [LOCAL ] BEP: Trimmed 58170 records to 39066 (keeping 200 days of data) [2025-09-18T17:35:54.921346] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-18T17:35:55.096981] [DEBUG] [LOCAL ] BEP: Primary data saved (39066 records). [2025-09-18T17:35:55.097172] [INFO ] [MAIN ] BEP: Full history saved. [2025-09-18T17:35:55.097320] [INFO ] [MAIN ] Update Progress: 249/2372 symbols completed. BEP took 54.1s. Estimated remaining: 5h 5m 45s. Rate: 6.9 symbols/min [2025-09-18T17:35:55.292432] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:35:55.295823] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-18T17:35:55.330621] [DEBUG] [LOCAL ] BFAM: Loaded 32892 existing records from primary storage. [2025-09-18T17:35:55.330811] [INFO ] [MAIN ] BFAM: Loaded 32892 existing records. [2025-09-18T17:35:55.516923] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:35:55.517221] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-18T17:35:55.517270] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-18T17:35:55.518133] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-09-18T17:35:55.518193] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-18T17:35:55.726341] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-18T17:35:55.895305] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:35:56.165812] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-18T17:35:56.519599] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-18T17:35:56.920432] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-18T17:35:57.319593] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-18T17:35:57.994256] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-18T17:35:58.119559] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-18T17:35:58.662092] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-18T17:35:58.919629] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-18T17:35:59.486446] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-18T17:35:59.487692] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4574 records). [2025-09-18T17:35:59.487771] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-18T17:35:59.724831] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-18T17:35:59.881941] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-18T17:35:59.882028] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-18T17:35:59.882400] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-18T17:35:59.882441] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-18T17:35:59.882901] [DEBUG] [LOCAL ] BEPJ: Trimmed 4574 records to 3312 (keeping 200 days of data) [2025-09-18T17:35:59.905343] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3312 records). [2025-09-18T17:35:59.905472] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-18T17:35:59.905577] [INFO ] [MAIN ] Update Progress: 250/2372 symbols completed. BEPJ took 14.7s. Estimated remaining: 5h 5m 4s. Rate: 7.0 symbols/min [2025-09-18T17:36:00.085008] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:36:00.130546] [DEBUG] [LOCAL ] BFH: Loaded 42029 existing records from primary storage. [2025-09-18T17:36:00.130728] [INFO ] [MAIN ] BFH: Loaded 42029 existing records. [2025-09-18T17:36:00.332868] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:36:00.333141] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-18T17:36:00.333192] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-18T17:36:00.334699] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-09-18T17:36:00.334806] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-18T17:36:00.519809] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-11. [2025-09-18T17:36:00.528001] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-18T17:36:00.734851] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:36:01.319555] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-18T17:36:01.838605] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-18T17:36:01.839847] [INFO ] [REMOTE ] BEPH: Full fetch complete (7542 records). [2025-09-18T17:36:01.839930] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-18T17:36:02.124625] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-11. [2025-09-18T17:36:02.261422] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-09-18T17:36:02.261590] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-09-18T17:36:02.261888] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-09-18T17:36:02.261971] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-09-18T17:36:02.262790] [DEBUG] [LOCAL ] BEPH: Trimmed 7542 records to 5249 (keeping 200 days of data) [2025-09-18T17:36:02.320336] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-18T17:36:02.319380] [DEBUG] [LOCAL ] BEPH: Primary data saved (5249 records). [2025-09-18T17:36:02.320530] [INFO ] [MAIN ] BEPH: Full history saved. [2025-09-18T17:36:02.329190] [INFO ] [MAIN ] Update Progress: 251/2372 symbols completed. BEPH took 34.5s. Estimated remaining: 5h 4m 3s. Rate: 7.0 symbols/min [2025-09-18T17:36:02.507828] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:36:02.525558] [DEBUG] [LOCAL ] BFK: Loaded 13965 existing records from primary storage. [2025-09-18T17:36:02.525711] [INFO ] [MAIN ] BFK: Loaded 13965 existing records. [2025-09-18T17:36:02.733405] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:36:02.733773] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-18T17:36:02.733845] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-18T17:36:02.734605] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-18T17:36:02.734783] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-18T17:36:02.926457] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-09-18T17:36:03.132940] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:36:03.719267] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-18T17:36:03.729369] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-11. [2025-09-18T17:36:04.356725] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-18T17:36:04.519582] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-18T17:36:04.708681] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-18T17:36:04.975155] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-18T17:36:05.319589] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-09-18T17:36:06.119576] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-09-18T17:36:06.241233] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-18T17:36:06.919557] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-09-18T17:36:07.357892] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-18T17:36:07.719568] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-09-18T17:36:07.742974] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T17:36:08.519593] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-18T17:36:08.668930] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T17:36:09.046112] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-18T17:36:09.319570] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-18T17:36:10.119556] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-09-18T17:36:10.615563] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-18T17:36:10.919540] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-18T17:36:11.233486] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-18T17:36:11.719550] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-18T17:36:11.905459] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-18T17:36:12.519558] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-18T17:36:13.231179] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-18T17:36:13.319593] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-18T17:36:13.602057] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-18T17:36:13.783405] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-18T17:36:14.119551] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-18T17:36:14.919598] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-18T17:36:15.242431] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-18T17:36:15.719556] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-18T17:36:15.914328] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-18T17:36:16.519596] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-18T17:36:16.768340] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-18T17:36:17.319716] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-18T17:36:17.822341] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-18T17:36:18.047908] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T17:36:18.119501] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-18T17:36:18.919597] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-18T17:36:19.435579] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-18T17:36:19.719556] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-18T17:36:20.292813] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-18T17:36:20.519566] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-18T17:36:20.857967] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-18T17:36:21.118699] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-18T17:36:21.319603] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-18T17:36:22.119609] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-18T17:36:22.838008] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-18T17:36:22.919515] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-18T17:36:23.229362] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-18T17:36:23.719548] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-18T17:36:23.962370] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-18T17:36:24.212510] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-18T17:36:24.519608] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-18T17:36:24.997131] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-18T17:36:24.998872] [INFO ] [REMOTE ] BEPI: Full fetch complete (4987 records). [2025-09-18T17:36:24.998986] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-18T17:36:25.324748] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-18T17:36:25.517398] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-09-18T17:36:25.517489] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-09-18T17:36:25.517710] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-18T17:36:25.517777] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-09-18T17:36:25.518217] [DEBUG] [LOCAL ] BEPI: Trimmed 4987 records to 3451 (keeping 200 days of data) [2025-09-18T17:36:25.542986] [DEBUG] [LOCAL ] BEPI: Primary data saved (3451 records). [2025-09-18T17:36:25.543136] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-18T17:36:25.543227] [INFO ] [MAIN ] Update Progress: 252/2372 symbols completed. BEPI took 53.2s. Estimated remaining: 5h 5m 58s. Rate: 6.9 symbols/min [2025-09-18T17:36:25.731160] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:36:25.795263] [DEBUG] [LOCAL ] BFLY: Loaded 51833 existing records from primary storage. [2025-09-18T17:36:25.795459] [INFO ] [MAIN ] BFLY: Loaded 51833 existing records. [2025-09-18T17:36:25.992536] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:36:25.992836] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-18T17:36:25.992903] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-18T17:36:25.994615] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-09-18T17:36:25.994701] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-18T17:36:26.124701] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-18T17:36:26.367168] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:36:26.839126] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T17:36:26.844432] [INFO ] [REMOTE ] BFAM: Full fetch complete (46873 records). [2025-09-18T17:36:26.844592] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-18T17:36:26.925820] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-18T17:36:27.237383] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-09-18T17:36:27.237487] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-09-18T17:36:27.238118] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-09-18T17:36:27.238195] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-09-18T17:36:27.239334] [DEBUG] [LOCAL ] BFAM: Trimmed 46873 records to 33173 (keeping 200 days of data) [2025-09-18T17:36:27.450050] [DEBUG] [LOCAL ] BFAM: Primary data saved (33173 records). [2025-09-18T17:36:27.450317] [INFO ] [MAIN ] BFAM: Full history saved. [2025-09-18T17:36:27.450498] [INFO ] [MAIN ] Update Progress: 253/2372 symbols completed. BFAM took 32.4s. Estimated remaining: 5h 4m 52s. Rate: 7.0 symbols/min [2025-09-18T17:36:27.663124] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:36:27.666251] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-18T17:36:27.692552] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-18T17:36:27.692849] [DEBUG] [LOCAL ] BFS: Loaded 9033 existing records from primary storage. [2025-09-18T17:36:27.696361] [INFO ] [MAIN ] BFS: Loaded 9033 existing records. [2025-09-18T17:36:27.725397] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-11. [2025-09-18T17:36:27.885254] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:36:27.885605] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-18T17:36:27.885715] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-18T17:36:27.886274] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-09-18T17:36:27.886361] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-18T17:36:28.249807] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:36:28.519528] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-11. [2025-09-18T17:36:29.152764] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-18T17:36:29.319532] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-18T17:36:29.429575] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-18T17:36:30.119580] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-18T17:36:30.198846] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-18T17:36:30.202048] [INFO ] [REMOTE ] BFK: Full fetch complete (19270 records). [2025-09-18T17:36:30.202135] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-18T17:36:30.600883] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-09-18T17:36:30.600993] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-09-18T17:36:30.601565] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-09-18T17:36:30.601609] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-09-18T17:36:30.602574] [DEBUG] [LOCAL ] BFK: Trimmed 19270 records to 14147 (keeping 200 days of data) [2025-09-18T17:36:30.692119] [DEBUG] [LOCAL ] BFK: Primary data saved (14147 records). [2025-09-18T17:36:30.692319] [INFO ] [MAIN ] BFK: Full history saved. [2025-09-18T17:36:30.692425] [INFO ] [MAIN ] Update Progress: 254/2372 symbols completed. BFK took 28.4s. Estimated remaining: 5h 3m 59s. Rate: 7.0 symbols/min [2025-09-18T17:36:30.883120] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:36:30.896551] [DEBUG] [LOCAL ] BFZ: Loaded 11444 existing records from primary storage. [2025-09-18T17:36:30.896775] [INFO ] [MAIN ] BFZ: Loaded 11444 existing records. [2025-09-18T17:36:30.928545] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-09-18T17:36:31.101282] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:36:31.101541] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-18T17:36:31.101590] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-18T17:36:31.102244] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-09-18T17:36:31.102305] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-18T17:36:31.487042] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:36:31.609332] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T17:36:31.719559] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-18T17:36:32.462513] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-18T17:36:32.519558] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-09-18T17:36:32.770751] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-18T17:36:32.776677] [INFO ] [REMOTE ] BFH: Full fetch complete (59501 records). [2025-09-18T17:36:32.776831] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-18T17:36:33.182445] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-18T17:36:33.206679] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-18T17:36:33.206779] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-18T17:36:33.207459] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-18T17:36:33.207505] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-18T17:36:33.208842] [DEBUG] [LOCAL ] BFH: Trimmed 59501 records to 42319 (keeping 200 days of data) [2025-09-18T17:36:33.319696] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-11. [2025-09-18T17:36:33.479189] [DEBUG] [LOCAL ] BFH: Primary data saved (42319 records). [2025-09-18T17:36:33.479333] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-18T17:36:33.480624] [INFO ] [MAIN ] Update Progress: 255/2372 symbols completed. BFH took 33.6s. Estimated remaining: 5h 3m 2s. Rate: 7.0 symbols/min [2025-09-18T17:36:33.650529] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:36:33.650711] [DEBUG] [LOCAL ] BG: No existing data file found in primary storage. [2025-09-18T17:36:33.650764] [WARN ] [MAIN ] BG: No existing data found, performing full refresh instead. [2025-09-18T17:36:33.650951] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-18T17:36:33.651005] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-18T17:36:33.651048] [DEBUG] [LOCAL ] BG: No primary data file found to delete. [2025-09-18T17:36:33.651081] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-18T17:36:34.019908] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:36:34.119564] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-09-18T17:36:34.153484] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-18T17:36:34.919549] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-09-18T17:36:35.591626] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-18T17:36:35.719547] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-09-18T17:36:36.069368] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-18T17:36:36.182326] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-18T17:36:36.519559] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-18T17:36:37.319555] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-18T17:36:37.497223] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-18T17:36:38.119552] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-11. [2025-09-18T17:36:38.919538] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-18T17:36:39.192044] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-18T17:36:39.512353] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T17:36:39.513279] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-18T17:36:39.719548] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-09-18T17:36:40.519565] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-09-18T17:36:41.141482] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-18T17:36:41.319546] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-18T17:36:41.430974] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-18T17:36:42.119547] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-09-18T17:36:42.685501] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-18T17:36:42.919603] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-18T17:36:43.486383] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-18T17:36:43.719574] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-18T17:36:43.920059] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-18T17:36:44.188806] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-18T17:36:44.519545] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-09-18T17:36:45.319542] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-18T17:36:45.333146] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-18T17:36:45.897829] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-18T17:36:46.119558] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-18T17:36:46.919578] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-09-18T17:36:47.579222] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T17:36:47.669478] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-18T17:36:47.719552] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-18T17:36:48.519559] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-18T17:36:49.289510] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T17:36:49.319493] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-18T17:36:49.852175] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T17:36:50.119567] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-18T17:36:50.919558] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-18T17:36:51.122754] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-18T17:36:51.649689] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-18T17:36:51.719535] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-09-18T17:36:51.931352] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-18T17:36:52.372098] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-18T17:36:52.519568] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-18T17:36:53.319541] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-18T17:36:54.027196] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-18T17:36:54.119556] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-18T17:36:54.919532] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-09-18T17:36:55.259076] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-18T17:36:55.496417] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-18T17:36:55.529533] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-18T17:36:55.719537] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-18T17:36:56.519590] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-18T17:36:57.016316] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T17:36:57.277985] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-18T17:36:57.319517] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-18T17:36:57.852155] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-18T17:36:58.119612] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-18T17:36:58.919594] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-09-18T17:36:59.719617] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-18T17:36:59.735039] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-18T17:36:59.985718] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-18T17:37:00.519700] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-18T17:37:01.310683] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-18T17:37:01.321389] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-18T17:37:01.348874] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-18T17:37:02.119551] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-18T17:37:02.919540] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-18T17:37:02.974832] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-18T17:37:02.981624] [INFO ] [REMOTE ] BFLY: Full fetch complete (75051 records). [2025-09-18T17:37:02.981828] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-18T17:37:03.384066] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-18T17:37:03.384162] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-18T17:37:03.385100] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-18T17:37:03.385203] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-18T17:37:03.389688] [DEBUG] [LOCAL ] BFLY: Trimmed 75051 records to 52218 (keeping 200 days of data) [2025-09-18T17:37:03.637306] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-18T17:37:03.725596] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-18T17:37:03.727349] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-18T17:37:03.731980] [INFO ] [REMOTE ] BFZ: Full fetch complete (17795 records). [2025-09-18T17:37:03.732076] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-09-18T17:37:04.058360] [DEBUG] [LOCAL ] BFLY: Primary data saved (52218 records). [2025-09-18T17:37:04.068735] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-18T17:37:04.068925] [INFO ] [MAIN ] Update Progress: 256/2372 symbols completed. BFLY took 38.5s. Estimated remaining: 5h 5m 55s. Rate: 6.9 symbols/min [2025-09-18T17:37:04.240994] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-09-18T17:37:04.246873] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-09-18T17:37:04.258022] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-09-18T17:37:04.263218] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-09-18T17:37:04.317339] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:37:04.317991] [DEBUG] [LOCAL ] BFZ: Trimmed 17795 records to 11514 (keeping 200 days of data) [2025-09-18T17:37:04.402692] [DEBUG] [LOCAL ] BFZ: Primary data saved (11514 records). [2025-09-18T17:37:04.403534] [DEBUG] [LOCAL ] BGB: Loaded 17659 existing records from primary storage. [2025-09-18T17:37:04.403232] [INFO ] [MAIN ] BFZ: Full history saved. [2025-09-18T17:37:04.403681] [INFO ] [MAIN ] BGB: Loaded 17659 existing records. [2025-09-18T17:37:04.403825] [INFO ] [MAIN ] Update Progress: 257/2372 symbols completed. BFZ took 33.7s. Estimated remaining: 5h 4m 38s. Rate: 6.9 symbols/min [2025-09-18T17:37:04.523093] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-18T17:37:04.781375] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:37:04.775639] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:37:04.782009] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-18T17:37:04.782100] [DEBUG] [LOCAL ] BGH: No existing data file found in primary storage. [2025-09-18T17:37:04.782896] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-18T17:37:04.783076] [WARN ] [MAIN ] BGH: No existing data found, performing full refresh instead. [2025-09-18T17:37:04.787595] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-18T17:37:04.789951] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-18T17:37:04.789702] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-18T17:37:04.790090] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-18T17:37:04.835768] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-18T17:37:04.883255] [DEBUG] [LOCAL ] BGH: No primary data file found to delete. [2025-09-18T17:37:04.891859] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-18T17:37:04.891800] [INFO ] [REMOTE ] BFS: Full fetch complete (12370 records). [2025-09-18T17:37:04.903560] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-18T17:37:05.629746] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:37:05.660519] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-11. [2025-09-18T17:37:05.921690] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-09-18T17:37:05.931037] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-09-18T17:37:05.932616] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-09-18T17:37:05.948539] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-09-18T17:37:05.955628] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:37:05.957318] [DEBUG] [LOCAL ] BFS: Trimmed 12370 records to 9113 (keeping 200 days of data) [2025-09-18T17:37:06.018386] [DEBUG] [LOCAL ] BFS: Primary data saved (9113 records). [2025-09-18T17:37:06.018510] [INFO ] [MAIN ] BFS: Full history saved. [2025-09-18T17:37:06.018665] [INFO ] [MAIN ] Update Progress: 258/2372 symbols completed. BFS took 38.6s. Estimated remaining: 5h 3m 32s. Rate: 7.0 symbols/min [2025-09-18T17:37:06.124048] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-11. [2025-09-18T17:37:06.248115] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:37:06.268127] [DEBUG] [LOCAL ] BGR: Loaded 13572 existing records from primary storage. [2025-09-18T17:37:06.268232] [INFO ] [MAIN ] BGR: Loaded 13572 existing records. [2025-09-18T17:37:06.456389] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:37:06.457452] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-18T17:37:06.457628] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-18T17:37:06.458340] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-18T17:37:06.458905] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-18T17:37:06.560554] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-18T17:37:06.616866] [INFO ] [REMOTE ] BG: Full fetch complete (72579 records). [2025-09-18T17:37:06.635175] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-18T17:37:06.966511] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-18T17:37:07.007368] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-09-18T17:37:07.046548] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-18T17:37:07.052913] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:37:07.327977] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-09-18T17:37:07.328081] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-09-18T17:37:07.328954] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-09-18T17:37:07.329022] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-09-18T17:37:07.331299] [DEBUG] [LOCAL ] BG: Trimmed 72579 records to 50741 (keeping 200 days of data) [2025-09-18T17:37:07.675992] [DEBUG] [LOCAL ] BG: Primary data saved (50741 records). [2025-09-18T17:37:07.676140] [INFO ] [MAIN ] BG: Full history saved. [2025-09-18T17:37:07.676219] [INFO ] [MAIN ] Update Progress: 259/2372 symbols completed. BG took 34.2s. Estimated remaining: 5h 2m 26s. Rate: 7.0 symbols/min [2025-09-18T17:37:07.730966] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-09-18T17:37:07.857961] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:37:07.872235] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-18T17:37:07.926016] [DEBUG] [LOCAL ] BGS: Loaded 50410 existing records from primary storage. [2025-09-18T17:37:07.926172] [INFO ] [MAIN ] BGS: Loaded 50410 existing records. [2025-09-18T17:37:08.107082] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:37:08.107342] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-18T17:37:08.107390] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-18T17:37:08.108829] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-18T17:37:08.108890] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-18T17:37:08.466636] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-18T17:37:08.513353] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:37:08.519502] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-11. [2025-09-18T17:37:09.319560] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-11. [2025-09-18T17:37:10.119613] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-09-18T17:37:10.393077] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-18T17:37:10.430901] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-18T17:37:10.919545] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-09-18T17:37:11.032189] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-18T17:37:11.719569] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-09-18T17:37:12.151597] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T17:37:12.247154] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-18T17:37:12.519606] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-18T17:37:13.319595] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-09-18T17:37:13.599505] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-18T17:37:14.119551] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-18T17:37:14.782586] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-18T17:37:14.802267] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-18T17:37:14.919590] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-09-18T17:37:15.719550] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-18T17:37:15.911287] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-18T17:37:16.519566] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-18T17:37:16.725151] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-18T17:37:17.319619] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-18T17:37:18.119556] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-09-18T17:37:18.183214] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-18T17:37:18.233580] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-18T17:37:18.648542] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-18T17:37:18.919570] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-18T17:37:19.719619] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-18T17:37:19.742901] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-18T17:37:20.502446] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-18T17:37:20.519492] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-18T17:37:21.319603] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-18T17:37:21.481161] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-18T17:37:22.119572] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-18T17:37:22.913409] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-18T17:37:22.919483] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-18T17:37:23.037597] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-18T17:37:23.497583] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-18T17:37:23.719545] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-18T17:37:24.519562] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-18T17:37:24.718082] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-18T17:37:25.113675] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-18T17:37:25.319552] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-18T17:37:26.119547] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-18T17:37:26.317054] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-18T17:37:26.919574] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-18T17:37:27.110592] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-18T17:37:27.719576] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-18T17:37:27.783432] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-18T17:37:27.786094] [INFO ] [REMOTE ] BGB: Full fetch complete (26931 records). [2025-09-18T17:37:27.786197] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-18T17:37:28.165295] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-09-18T17:37:28.165389] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-09-18T17:37:28.165850] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-09-18T17:37:28.165915] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-09-18T17:37:28.166597] [DEBUG] [LOCAL ] BGB: Trimmed 26931 records to 17754 (keeping 200 days of data) [2025-09-18T17:37:28.280074] [DEBUG] [LOCAL ] BGB: Primary data saved (17754 records). [2025-09-18T17:37:28.280225] [INFO ] [MAIN ] BGB: Full history saved. [2025-09-18T17:37:28.280313] [INFO ] [MAIN ] Update Progress: 260/2372 symbols completed. BGB took 24.2s. Estimated remaining: 5h 3m 55s. Rate: 6.9 symbols/min [2025-09-18T17:37:28.462861] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:37:28.473682] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-18T17:37:28.483797] [DEBUG] [LOCAL ] BGSF: Loaded 5983 existing records from primary storage. [2025-09-18T17:37:28.483971] [INFO ] [MAIN ] BGSF: Loaded 5983 existing records. [2025-09-18T17:37:28.524752] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-18T17:37:28.676950] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:37:28.677228] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-18T17:37:28.677276] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-18T17:37:28.677712] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-09-18T17:37:28.677783] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-18T17:37:29.029534] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:37:29.319603] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-11. [2025-09-18T17:37:29.682882] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-11 (0.36 seconds). [2025-09-18T17:37:30.119564] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-09-18T17:37:30.152630] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-18T17:37:30.719808] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-18T17:37:30.919524] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-18T17:37:31.719530] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-18T17:37:31.817349] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-18T17:37:32.348212] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-18T17:37:32.519570] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-18T17:37:33.319559] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-09-18T17:37:34.119566] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-18T17:37:34.141028] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T17:37:34.458355] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-18T17:37:34.741744] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T17:37:34.744835] [INFO ] [REMOTE ] BGR: Full fetch complete (20327 records). [2025-09-18T17:37:34.744912] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-18T17:37:34.931580] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-18T17:37:35.125456] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-09-18T17:37:35.125542] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-09-18T17:37:35.125919] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-09-18T17:37:35.125981] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-09-18T17:37:35.126545] [DEBUG] [LOCAL ] BGR: Trimmed 20327 records to 13714 (keeping 200 days of data) [2025-09-18T17:37:35.217260] [DEBUG] [LOCAL ] BGR: Primary data saved (13714 records). [2025-09-18T17:37:35.217410] [INFO ] [MAIN ] BGR: Full history saved. [2025-09-18T17:37:35.217522] [INFO ] [MAIN ] Update Progress: 261/2372 symbols completed. BGR took 29.2s. Estimated remaining: 5h 3m 33s. Rate: 7.0 symbols/min [2025-09-18T17:37:35.322358] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-18T17:37:35.391893] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:37:35.409734] [DEBUG] [LOCAL ] BGT: Loaded 16731 existing records from primary storage. [2025-09-18T17:37:35.409916] [INFO ] [MAIN ] BGT: Loaded 16731 existing records. [2025-09-18T17:37:35.602549] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:37:35.602895] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-18T17:37:35.602945] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-18T17:37:35.603816] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-09-18T17:37:35.603911] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-18T17:37:35.724730] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-18T17:37:35.978900] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:37:36.273592] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-18T17:37:36.519541] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-11. [2025-09-18T17:37:37.319560] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-18T17:37:37.431691] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-18T17:37:38.119529] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-18T17:37:38.270991] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-18T17:37:38.919541] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-18T17:37:39.687223] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-18T17:37:39.719506] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-18T17:37:40.108913] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-18T17:37:40.263077] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-18T17:37:40.519544] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-18T17:37:41.045417] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-18T17:37:41.319540] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-09-18T17:37:41.964000] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-18T17:37:42.119588] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-18T17:37:42.578330] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-18T17:37:42.919554] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-18T17:37:43.719556] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-09-18T17:37:43.749168] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-18T17:37:44.519556] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-18T17:37:44.632292] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-18T17:37:45.271781] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-18T17:37:45.319563] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-18T17:37:45.911757] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-18T17:37:46.119546] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-18T17:37:46.703455] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-18T17:37:46.919560] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-18T17:37:47.719544] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-18T17:37:47.873514] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-18T17:37:48.519553] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-18T17:37:49.300144] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-18T17:37:49.325425] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-18T17:37:49.340986] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-18T17:37:50.119564] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-18T17:37:50.314545] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-18T17:37:50.317452] [INFO ] [REMOTE ] BGH: Full fetch complete (21735 records). [2025-09-18T17:37:50.317535] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-18T17:37:50.725307] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-18T17:37:50.725399] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-18T17:37:50.725798] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-18T17:37:50.725863] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-18T17:37:50.726719] [DEBUG] [LOCAL ] BGH: Trimmed 21735 records to 16601 (keeping 200 days of data) [2025-09-18T17:37:50.837978] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-18T17:37:50.853124] [DEBUG] [LOCAL ] BGH: Primary data saved (16601 records). [2025-09-18T17:37:50.853230] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-18T17:37:50.853300] [INFO ] [MAIN ] Update Progress: 262/2372 symbols completed. BGH took 46.4s. Estimated remaining: 5h 4m 21s. Rate: 6.9 symbols/min [2025-09-18T17:37:50.924622] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-18T17:37:51.036404] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:37:51.050259] [DEBUG] [LOCAL ] BGX: Loaded 10883 existing records from primary storage. [2025-09-18T17:37:51.050383] [INFO ] [MAIN ] BGX: Loaded 10883 existing records. [2025-09-18T17:37:51.236590] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:37:51.236975] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-18T17:37:51.237033] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-18T17:37:51.237503] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-18T17:37:51.237573] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-18T17:37:51.594089] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:37:51.719505] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-11. [2025-09-18T17:37:52.394471] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T17:37:52.519494] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-18T17:37:52.557140] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-18T17:37:53.319557] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-18T17:37:54.048787] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-18T17:37:54.110140] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-18T17:37:54.117137] [INFO ] [REMOTE ] BGS: Full fetch complete (72273 records). [2025-09-18T17:37:54.117261] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-18T17:37:54.128942] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-09-18T17:37:54.508480] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-18T17:37:54.508562] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-18T17:37:54.509298] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-18T17:37:54.509364] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-18T17:37:54.510798] [DEBUG] [LOCAL ] BGS: Trimmed 72273 records to 50790 (keeping 200 days of data) [2025-09-18T17:37:54.802812] [DEBUG] [LOCAL ] BGS: Primary data saved (50790 records). [2025-09-18T17:37:54.802989] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-18T17:37:54.803769] [INFO ] [MAIN ] Update Progress: 263/2372 symbols completed. BGS took 47.1s. Estimated remaining: 5h 3m 34s. Rate: 6.9 symbols/min [2025-09-18T17:37:54.924699] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-18T17:37:54.977569] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:37:55.002454] [DEBUG] [LOCAL ] BGY: Loaded 23166 existing records from primary storage. [2025-09-18T17:37:55.002625] [INFO ] [MAIN ] BGY: Loaded 23166 existing records. [2025-09-18T17:37:55.122445] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-18T17:37:55.191929] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:37:55.192163] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-18T17:37:55.192209] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-18T17:37:55.193034] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-18T17:37:55.193096] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-18T17:37:55.551375] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:37:55.719488] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-11. [2025-09-18T17:37:56.016463] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-18T17:37:56.519567] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-18T17:37:57.125395] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-18T17:37:57.319609] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-09-18T17:37:57.575877] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-18T17:37:58.119601] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-18T17:37:58.147589] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-18T17:37:58.777759] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-18T17:37:58.919583] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-18T17:37:59.719638] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-18T17:38:00.141000] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-18T17:38:00.144168] [INFO ] [REMOTE ] BGSF: Full fetch complete (7544 records). [2025-09-18T17:38:00.144310] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-18T17:38:00.434214] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-18T17:38:00.522334] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-18T17:38:00.563755] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-09-18T17:38:00.563915] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-09-18T17:38:00.564255] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-09-18T17:38:00.564308] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-09-18T17:38:00.565434] [DEBUG] [LOCAL ] BGSF: Trimmed 7544 records to 6142 (keeping 200 days of data) [2025-09-18T17:38:00.608881] [DEBUG] [LOCAL ] BGSF: Primary data saved (6142 records). [2025-09-18T17:38:00.609108] [INFO ] [MAIN ] BGSF: Full history saved. [2025-09-18T17:38:00.609234] [INFO ] [MAIN ] Update Progress: 264/2372 symbols completed. BGSF took 32.3s. Estimated remaining: 5h 3m 3s. Rate: 7.0 symbols/min [2025-09-18T17:38:00.796775] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:38:00.816928] [DEBUG] [LOCAL ] BH: Loaded 15256 existing records from primary storage. [2025-09-18T17:38:00.817197] [INFO ] [MAIN ] BH: Loaded 15256 existing records. [2025-09-18T17:38:01.002119] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:38:01.002478] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-18T17:38:01.002536] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-18T17:38:01.003170] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-09-18T17:38:01.003233] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-18T17:38:01.323515] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-18T17:38:01.382026] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-18T17:38:01.423396] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:38:02.062946] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-18T17:38:02.119560] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-18T17:38:02.919592] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-18T17:38:03.038253] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-18T17:38:03.040936] [INFO ] [REMOTE ] BGT: Full fetch complete (24428 records). [2025-09-18T17:38:03.041014] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-18T17:38:03.441724] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-18T17:38:03.441846] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-18T17:38:03.442240] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-18T17:38:03.442283] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-18T17:38:03.443016] [DEBUG] [LOCAL ] BGT: Trimmed 24428 records to 16821 (keeping 200 days of data) [2025-09-18T17:38:03.562896] [DEBUG] [LOCAL ] BGT: Primary data saved (16821 records). [2025-09-18T17:38:03.563064] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-18T17:38:03.563153] [INFO ] [MAIN ] Update Progress: 265/2372 symbols completed. BGT took 28.3s. Estimated remaining: 5h 2m 9s. Rate: 7.0 symbols/min [2025-09-18T17:38:03.721023] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-11. [2025-09-18T17:38:03.774548] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:38:03.785333] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-18T17:38:03.837705] [DEBUG] [LOCAL ] BHC: Loaded 46813 existing records from primary storage. [2025-09-18T17:38:03.837880] [INFO ] [MAIN ] BHC: Loaded 46813 existing records. [2025-09-18T17:38:04.018313] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:38:04.018618] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-18T17:38:04.018700] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-18T17:38:04.020103] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-09-18T17:38:04.020164] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-18T17:38:04.375200] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:38:04.397435] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-18T17:38:04.519586] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-11. [2025-09-18T17:38:05.319616] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-09-18T17:38:06.119579] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-18T17:38:06.243205] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-18T17:38:06.297103] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-18T17:38:06.585134] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-18T17:38:06.919583] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-09-18T17:38:07.719531] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-09-18T17:38:07.776215] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-18T17:38:08.519614] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-09-18T17:38:09.006908] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-18T17:38:09.313248] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-18T17:38:09.319506] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-18T17:38:09.708506] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-18T17:38:10.119631] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-09-18T17:38:10.919523] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-18T17:38:10.936127] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T17:38:11.559797] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-18T17:38:11.719572] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-09-18T17:38:12.519594] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-18T17:38:12.892251] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T17:38:13.021969] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-18T17:38:13.319581] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-18T17:38:14.119554] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-18T17:38:14.702917] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T17:38:14.919546] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-18T17:38:15.192791] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-18T17:38:15.532773] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-18T17:38:15.719551] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-18T17:38:16.519549] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-18T17:38:16.570631] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-18T17:38:17.082299] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-18T17:38:17.319565] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-18T17:38:18.076543] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-18T17:38:18.119495] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-18T17:38:18.919542] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-18T17:38:19.155763] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-18T17:38:19.719602] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-18T17:38:19.925484] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-18T17:38:20.475732] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-18T17:38:20.519490] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-18T17:38:21.319507] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-18T17:38:21.369208] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-18T17:38:22.119573] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-18T17:38:22.683628] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T17:38:22.919549] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-18T17:38:23.067813] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-18T17:38:23.560480] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-18T17:38:23.563161] [INFO ] [REMOTE ] BGX: Full fetch complete (15730 records). [2025-09-18T17:38:23.563260] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-18T17:38:23.727279] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-18T17:38:23.962477] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-18T17:38:23.962569] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-18T17:38:23.962894] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-18T17:38:23.962957] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-18T17:38:23.963510] [DEBUG] [LOCAL ] BGX: Trimmed 15730 records to 10952 (keeping 200 days of data) [2025-09-18T17:38:24.032203] [DEBUG] [LOCAL ] BGX: Primary data saved (10952 records). [2025-09-18T17:38:24.032352] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-18T17:38:24.032442] [INFO ] [MAIN ] Update Progress: 266/2372 symbols completed. BGX took 33.2s. Estimated remaining: 5h 3m 35s. Rate: 6.9 symbols/min [2025-09-18T17:38:24.212328] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:38:24.245477] [DEBUG] [LOCAL ] BHE: Loaded 25395 existing records from primary storage. [2025-09-18T17:38:24.245697] [INFO ] [MAIN ] BHE: Loaded 25395 existing records. [2025-09-18T17:38:24.444169] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:38:24.444499] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-18T17:38:24.444559] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-18T17:38:24.445361] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-09-18T17:38:24.445423] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-18T17:38:24.524623] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-18T17:38:24.826440] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:38:24.907892] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-18T17:38:25.319558] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-11. [2025-09-18T17:38:25.642462] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T17:38:25.645548] [INFO ] [REMOTE ] BH: Full fetch complete (19064 records). [2025-09-18T17:38:25.645625] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-18T17:38:26.017765] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-09-18T17:38:26.017847] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-09-18T17:38:26.018190] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-09-18T17:38:26.018232] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-09-18T17:38:26.018854] [DEBUG] [LOCAL ] BH: Trimmed 19064 records to 15344 (keeping 200 days of data) [2025-09-18T17:38:26.110305] [DEBUG] [LOCAL ] BH: Primary data saved (15344 records). [2025-09-18T17:38:26.110466] [INFO ] [MAIN ] BH: Full history saved. [2025-09-18T17:38:26.110556] [INFO ] [MAIN ] Update Progress: 267/2372 symbols completed. BH took 25.5s. Estimated remaining: 5h 2m 34s. Rate: 7.0 symbols/min [2025-09-18T17:38:26.124705] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-18T17:38:26.301864] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:38:26.319430] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-18T17:38:26.344474] [DEBUG] [LOCAL ] BHK: Loaded 22454 existing records from primary storage. [2025-09-18T17:38:26.344688] [INFO ] [MAIN ] BHK: Loaded 22454 existing records. [2025-09-18T17:38:26.537836] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:38:26.538164] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-18T17:38:26.538224] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-18T17:38:26.539083] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-18T17:38:26.539149] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-18T17:38:26.910619] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:38:26.919488] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-11. [2025-09-18T17:38:27.017423] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T17:38:27.671517] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-18T17:38:27.719569] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-18T17:38:28.519547] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-09-18T17:38:29.319557] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-09-18T17:38:29.426671] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-18T17:38:29.467824] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-18T17:38:30.044281] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-18T17:38:30.119513] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-09-18T17:38:30.919509] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-18T17:38:31.244663] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-18T17:38:31.719587] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-09-18T17:38:32.279776] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-18T17:38:32.298903] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-18T17:38:32.519578] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-18T17:38:33.319598] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-18T17:38:33.505188] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-18T17:38:34.119546] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-18T17:38:34.355343] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-18T17:38:34.919574] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-18T17:38:35.719556] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-18T17:38:35.817851] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-18T17:38:35.906397] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-18T17:38:36.447012] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-18T17:38:36.519571] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-18T17:38:37.319562] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-18T17:38:37.613401] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-18T17:38:38.119604] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-18T17:38:38.821752] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-18T17:38:38.919549] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-18T17:38:39.135426] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-18T17:38:39.719559] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-18T17:38:40.383084] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T17:38:40.519511] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-18T17:38:41.087382] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-18T17:38:41.291486] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-18T17:38:41.319497] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-18T17:38:42.119520] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-18T17:38:42.425686] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-18T17:38:42.919538] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-18T17:38:43.401878] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-18T17:38:43.411513] [INFO ] [REMOTE ] BHC: Full fetch complete (66538 records). [2025-09-18T17:38:43.411782] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-18T17:38:43.719874] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-18T17:38:43.831085] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-09-18T17:38:43.831259] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-09-18T17:38:43.832183] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-09-18T17:38:43.832358] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-09-18T17:38:43.840162] [DEBUG] [LOCAL ] BHC: Trimmed 66538 records to 47122 (keeping 200 days of data) [2025-09-18T17:38:43.850742] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T17:38:44.143493] [DEBUG] [LOCAL ] BHC: Primary data saved (47122 records). [2025-09-18T17:38:44.143694] [INFO ] [MAIN ] BHC: Full history saved. [2025-09-18T17:38:44.143804] [INFO ] [MAIN ] Update Progress: 268/2372 symbols completed. BHC took 40.6s. Estimated remaining: 5h 3m 39s. Rate: 6.9 symbols/min [2025-09-18T17:38:44.333447] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:38:44.388400] [DEBUG] [LOCAL ] BHP: Loaded 53391 existing records from primary storage. [2025-09-18T17:38:44.388584] [INFO ] [MAIN ] BHP: Loaded 53391 existing records. [2025-09-18T17:38:44.525164] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-18T17:38:44.594853] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:38:44.595334] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-18T17:38:44.607897] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-18T17:38:44.609226] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-18T17:38:44.613768] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-18T17:38:44.614396] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-18T17:38:44.981440] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:38:45.319586] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-18T17:38:45.632344] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-18T17:38:46.119615] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-11. [2025-09-18T17:38:46.287623] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-18T17:38:46.291987] [INFO ] [REMOTE ] BGY: Full fetch complete (33586 records). [2025-09-18T17:38:46.292212] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-18T17:38:46.704010] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-18T17:38:46.704105] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-18T17:38:46.704567] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-18T17:38:46.704627] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-18T17:38:46.705522] [DEBUG] [LOCAL ] BGY: Trimmed 33586 records to 23265 (keeping 200 days of data) [2025-09-18T17:38:46.842181] [DEBUG] [LOCAL ] BGY: Primary data saved (23265 records). [2025-09-18T17:38:46.842360] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-18T17:38:46.842455] [INFO ] [MAIN ] Update Progress: 269/2372 symbols completed. BGY took 52.0s. Estimated remaining: 5h 2m 44s. Rate: 6.9 symbols/min [2025-09-18T17:38:46.924743] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-18T17:38:47.017665] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:38:47.037506] [DEBUG] [LOCAL ] BHR: Loaded 21399 existing records from primary storage. [2025-09-18T17:38:47.037666] [INFO ] [MAIN ] BHR: Loaded 21399 existing records. [2025-09-18T17:38:47.220346] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:38:47.220711] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-18T17:38:47.220781] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-18T17:38:47.221449] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-18T17:38:47.221508] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-18T17:38:47.572869] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:38:47.719540] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-11. [2025-09-18T17:38:47.846255] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-18T17:38:48.256081] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-18T17:38:48.519559] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-09-18T17:38:48.650622] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-18T17:38:49.319555] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-09-18T17:38:50.056171] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-18T17:38:50.119505] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-09-18T17:38:50.417207] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-18T17:38:50.919558] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-18T17:38:51.719539] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-18T17:38:51.839934] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-18T17:38:51.858482] [INFO ] [REMOTE ] BHE: Full fetch complete (36466 records). [2025-09-18T17:38:51.871309] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-18T17:38:51.919382] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-18T17:38:52.271474] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-09-18T17:38:52.271576] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-09-18T17:38:52.272090] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-09-18T17:38:52.272167] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-09-18T17:38:52.273073] [DEBUG] [LOCAL ] BHE: Trimmed 36466 records to 25630 (keeping 200 days of data) [2025-09-18T17:38:52.432270] [DEBUG] [LOCAL ] BHE: Primary data saved (25630 records). [2025-09-18T17:38:52.432408] [INFO ] [MAIN ] BHE: Full history saved. [2025-09-18T17:38:52.432509] [INFO ] [MAIN ] Update Progress: 270/2372 symbols completed. BHE took 28.4s. Estimated remaining: 5h 2m 12s. Rate: 7.0 symbols/min [2025-09-18T17:38:52.525471] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-18T17:38:52.609286] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:38:52.609488] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-18T17:38:52.609544] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-18T17:38:52.609722] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-18T17:38:52.609781] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-18T17:38:52.609825] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-18T17:38:52.609859] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-18T17:38:52.995468] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-18T17:38:53.003804] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:38:53.319595] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-18T17:38:54.028385] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-18T17:38:54.119543] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-18T17:38:54.795486] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T17:38:54.919570] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-11. [2025-09-18T17:38:55.494312] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-18T17:38:55.719524] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-18T17:38:55.754814] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T17:38:56.109397] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-18T17:38:56.519571] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-09-18T17:38:57.320535] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-18T17:38:57.321771] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-18T17:38:58.119545] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-18T17:38:58.919511] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-18T17:38:58.994625] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-18T17:38:59.044352] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-18T17:38:59.250274] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-18T17:38:59.719554] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-18T17:39:00.052547] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-18T17:39:00.519544] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-18T17:39:00.901701] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-18T17:39:01.319554] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-18T17:39:01.676849] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-18T17:39:02.119589] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-18T17:39:02.493787] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-18T17:39:02.919596] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-18T17:39:03.719581] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-18T17:39:04.035363] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-18T17:39:04.132770] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-18T17:39:04.519555] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-18T17:39:05.319558] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-18T17:39:05.341838] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-18T17:39:06.119561] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-18T17:39:06.640861] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-18T17:39:06.653207] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T17:39:06.657716] [INFO ] [REMOTE ] BHK: Full fetch complete (29524 records). [2025-09-18T17:39:06.657807] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-18T17:39:06.924791] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-18T17:39:07.083087] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-18T17:39:07.083195] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-18T17:39:07.083674] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-18T17:39:07.083741] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-18T17:39:07.085260] [DEBUG] [LOCAL ] BHK: Trimmed 29524 records to 22566 (keeping 200 days of data) [2025-09-18T17:39:07.236513] [DEBUG] [LOCAL ] BHK: Primary data saved (22566 records). [2025-09-18T17:39:07.236724] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-18T17:39:07.236865] [INFO ] [MAIN ] Update Progress: 271/2372 symbols completed. BHK took 41.1s. Estimated remaining: 5h 2m 51s. Rate: 6.9 symbols/min [2025-09-18T17:39:07.422216] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:39:07.474733] [DEBUG] [LOCAL ] BHVN: Loaded 49553 existing records from primary storage. [2025-09-18T17:39:07.474912] [INFO ] [MAIN ] BHVN: Loaded 49553 existing records. [2025-09-18T17:39:07.669092] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:39:07.669362] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-18T17:39:07.669412] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-18T17:39:07.670457] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-18T17:39:07.670531] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-18T17:39:07.727554] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-18T17:39:08.042334] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:39:08.519584] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-18T17:39:08.575517] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-18T17:39:08.914085] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-18T17:39:08.942498] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-18T17:39:09.319581] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-18T17:39:10.119600] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-11. [2025-09-18T17:39:10.919550] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-18T17:39:11.071368] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-18T17:39:11.358895] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-18T17:39:11.359898] [INFO ] [REMOTE ] BHV: Full fetch complete (1385 records). [2025-09-18T17:39:11.359971] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-18T17:39:11.561531] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-18T17:39:11.561764] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:39:11.562002] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:39:11.562169] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-18T17:39:11.562347] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-18T17:39:11.562428] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-18T17:39:11.562614] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-18T17:39:11.562735] [INFO ] [MAIN ] Update Progress: 272/2372 symbols completed. BHV took 19.1s. Estimated remaining: 5h 2m 9s. Rate: 7.0 symbols/min [2025-09-18T17:39:11.719989] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-18T17:39:11.738169] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:39:11.766225] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T17:39:11.828629] [DEBUG] [LOCAL ] BILL: Loaded 52319 existing records from primary storage. [2025-09-18T17:39:11.829201] [INFO ] [MAIN ] BILL: Loaded 52319 existing records. [2025-09-18T17:39:12.024839] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:39:12.025112] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-18T17:39:12.025163] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-18T17:39:12.026789] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-09-18T17:39:12.026854] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-18T17:39:12.424200] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:39:12.519512] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-11. [2025-09-18T17:39:13.319524] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-18T17:39:13.393573] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-18T17:39:14.119547] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-18T17:39:14.351465] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-18T17:39:14.644365] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T17:39:14.919573] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-09-18T17:39:15.674055] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-18T17:39:15.719503] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-18T17:39:16.281585] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T17:39:16.519547] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-09-18T17:39:17.306832] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-18T17:39:17.314942] [INFO ] [REMOTE ] BHP: Full fetch complete (77082 records). [2025-09-18T17:39:17.315149] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-18T17:39:17.328251] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-09-18T17:39:17.742574] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-18T17:39:17.742705] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-18T17:39:17.743517] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-18T17:39:17.743569] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-18T17:39:17.745248] [DEBUG] [LOCAL ] BHP: Trimmed 77082 records to 53780 (keeping 200 days of data) [2025-09-18T17:39:18.082099] [DEBUG] [LOCAL ] BHP: Primary data saved (53780 records). [2025-09-18T17:39:18.082244] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-18T17:39:18.082365] [INFO ] [MAIN ] Update Progress: 273/2372 symbols completed. BHP took 33.9s. Estimated remaining: 5h 1m 44s. Rate: 7.0 symbols/min [2025-09-18T17:39:18.124678] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-18T17:39:18.256314] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:39:18.289965] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-18T17:39:18.322797] [DEBUG] [LOCAL ] BIO: Loaded 25809 existing records from primary storage. [2025-09-18T17:39:18.322941] [INFO ] [MAIN ] BIO: Loaded 25809 existing records. [2025-09-18T17:39:18.498923] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:39:18.499351] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-18T17:39:18.499478] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-18T17:39:18.500358] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-18T17:39:18.500423] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-18T17:39:18.813736] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T17:39:18.902374] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:39:18.919492] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-09-18T17:39:19.043124] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T17:39:19.719572] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-18T17:39:20.265234] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-18T17:39:20.519607] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-18T17:39:21.319621] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-18T17:39:21.528628] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-18T17:39:21.653884] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-18T17:39:21.994354] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-18T17:39:22.119572] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-18T17:39:22.919538] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-18T17:39:23.698995] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-18T17:39:23.719507] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-18T17:39:24.519520] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-18T17:39:24.621844] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-18T17:39:25.144138] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T17:39:25.319576] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-18T17:39:25.432603] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-18T17:39:26.119581] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-18T17:39:26.919544] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-18T17:39:27.163060] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-18T17:39:27.520575] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-18T17:39:27.719545] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-18T17:39:28.027762] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-18T17:39:28.032006] [INFO ] [REMOTE ] BHR: Full fetch complete (30424 records). [2025-09-18T17:39:28.032109] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-18T17:39:28.423126] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-18T17:39:28.423208] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-18T17:39:28.423710] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-18T17:39:28.423796] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-18T17:39:28.424579] [DEBUG] [LOCAL ] BHR: Trimmed 30424 records to 21610 (keeping 200 days of data) [2025-09-18T17:39:28.526398] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-18T17:39:28.569839] [DEBUG] [LOCAL ] BHR: Primary data saved (21610 records). [2025-09-18T17:39:28.569989] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-18T17:39:28.570159] [INFO ] [MAIN ] Update Progress: 274/2372 symbols completed. BHR took 41.7s. Estimated remaining: 5h 1m 50s. Rate: 7.0 symbols/min [2025-09-18T17:39:28.738346] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:39:28.786789] [DEBUG] [LOCAL ] BIP: Loaded 39777 existing records from primary storage. [2025-09-18T17:39:28.786955] [INFO ] [MAIN ] BIP: Loaded 39777 existing records. [2025-09-18T17:39:28.964377] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:39:28.964679] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-18T17:39:28.964738] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-18T17:39:28.965991] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-09-18T17:39:28.966063] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-18T17:39:29.334840] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:39:29.328347] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-11. [2025-09-18T17:39:29.511574] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-18T17:39:29.761113] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-18T17:39:30.119560] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-11. [2025-09-18T17:39:30.186789] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-18T17:39:30.919597] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-18T17:39:31.622699] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-18T17:39:31.719552] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-18T17:39:32.519597] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-09-18T17:39:32.907309] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-18T17:39:33.028260] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-18T17:39:33.319541] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-18T17:39:33.643436] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-18T17:39:34.119548] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-09-18T17:39:34.639150] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-18T17:39:34.919571] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-09-18T17:39:35.468022] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-18T17:39:35.671431] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-18T17:39:35.719575] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-18T17:39:36.519546] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-09-18T17:39:37.252780] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-18T17:39:37.259816] [INFO ] [REMOTE ] BHVN: Full fetch complete (68966 records). [2025-09-18T17:39:37.259961] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-18T17:39:37.324729] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-18T17:39:37.723580] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-18T17:39:37.724683] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-18T17:39:37.724570] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-18T17:39:37.725724] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-18T17:39:37.729680] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-18T17:39:37.731858] [DEBUG] [LOCAL ] BHVN: Trimmed 68966 records to 49937 (keeping 200 days of data) [2025-09-18T17:39:38.053493] [DEBUG] [LOCAL ] BHVN: Primary data saved (49937 records). [2025-09-18T17:39:38.053693] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-18T17:39:38.053877] [INFO ] [MAIN ] Update Progress: 275/2372 symbols completed. BHVN took 30.8s. Estimated remaining: 5h 1m 48s. Rate: 6.9 symbols/min [2025-09-18T17:39:38.128790] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-18T17:39:38.229014] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:39:38.272422] [DEBUG] [LOCAL ] BIPC: Loaded 41820 existing records from primary storage. [2025-09-18T17:39:38.272601] [INFO ] [MAIN ] BIPC: Loaded 41820 existing records. [2025-09-18T17:39:38.449855] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:39:38.450083] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-18T17:39:38.450130] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-18T17:39:38.451041] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-09-18T17:39:38.451110] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-18T17:39:38.817269] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:39:38.838252] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-18T17:39:38.919513] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-18T17:39:39.370141] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-18T17:39:39.719537] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-11. [2025-09-18T17:39:40.259462] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-18T17:39:40.519557] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-18T17:39:41.022595] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-18T17:39:41.319543] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-09-18T17:39:42.038512] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-18T17:39:42.119499] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-18T17:39:42.453999] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-18T17:39:42.919723] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-09-18T17:39:43.719622] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-18T17:39:43.932757] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-18T17:39:44.000860] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-18T17:39:44.519555] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-18T17:39:45.164816] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T17:39:45.319532] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-18T17:39:46.077311] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-18T17:39:46.084779] [INFO ] [REMOTE ] BILL: Full fetch complete (75393 records). [2025-09-18T17:39:46.084931] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-18T17:39:46.128710] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-18T17:39:46.483151] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-09-18T17:39:46.483332] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-09-18T17:39:46.484246] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-09-18T17:39:46.484335] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-09-18T17:39:46.487592] [DEBUG] [LOCAL ] BILL: Trimmed 75393 records to 52709 (keeping 200 days of data) [2025-09-18T17:39:46.644017] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T17:39:46.855178] [DEBUG] [LOCAL ] BILL: Primary data saved (52709 records). [2025-09-18T17:39:46.855339] [INFO ] [MAIN ] BILL: Full history saved. [2025-09-18T17:39:46.855441] [INFO ] [MAIN ] Update Progress: 276/2372 symbols completed. BILL took 35.3s. Estimated remaining: 5h 1m 40s. Rate: 6.9 symbols/min [2025-09-18T17:39:46.924757] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-18T17:39:47.058938] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:39:47.059115] [DEBUG] [LOCAL ] BIPH: No existing data file found in primary storage. [2025-09-18T17:39:47.059154] [WARN ] [MAIN ] BIPH: No existing data found, performing full refresh instead. [2025-09-18T17:39:47.059356] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-18T17:39:47.059408] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-18T17:39:47.059466] [DEBUG] [LOCAL ] BIPH: No primary data file found to delete. [2025-09-18T17:39:47.059502] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-18T17:39:47.464735] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:39:47.488357] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T17:39:47.719570] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-18T17:39:48.160212] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-18T17:39:48.519555] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-18T17:39:48.679592] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-18T17:39:49.319572] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-11. [2025-09-18T17:39:49.413886] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-18T17:39:49.861773] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-18T17:39:50.119537] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-09-18T17:39:50.495574] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-18T17:39:50.919532] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-09-18T17:39:51.498161] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-18T17:39:51.719536] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-18T17:39:52.519555] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-18T17:39:52.906762] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-18T17:39:53.319518] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-18T17:39:53.424724] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-18T17:39:53.722850] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-18T17:39:54.119548] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-18T17:39:54.919547] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-18T17:39:55.719561] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-18T17:39:55.744619] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-18T17:39:56.138984] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-18T17:39:56.519555] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-18T17:39:56.892474] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-18T17:39:57.124327] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-18T17:39:57.319602] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-18T17:39:58.119545] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-18T17:39:58.715726] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-18T17:39:58.919575] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-18T17:39:59.270926] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-18T17:39:59.719582] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-18T17:39:59.971292] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-18T17:40:00.519555] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-18T17:40:00.959335] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T17:40:01.319581] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-18T17:40:01.768874] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-18T17:40:01.823503] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T17:40:02.119564] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-18T17:40:02.919539] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-18T17:40:03.286573] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-18T17:40:03.605893] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T17:40:03.719541] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-18T17:40:04.519569] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-18T17:40:04.829493] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-18T17:40:05.213949] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T17:40:05.219597] [INFO ] [REMOTE ] BIP: Full fetch complete (56085 records). [2025-09-18T17:40:05.219740] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-18T17:40:05.320121] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-18T17:40:05.601033] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-09-18T17:40:05.601119] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-09-18T17:40:05.601731] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-09-18T17:40:05.601796] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-09-18T17:40:05.603010] [DEBUG] [LOCAL ] BIP: Trimmed 56085 records to 40063 (keeping 200 days of data) [2025-09-18T17:40:05.826030] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-18T17:40:05.863556] [DEBUG] [LOCAL ] BIP: Primary data saved (40063 records). [2025-09-18T17:40:05.863729] [INFO ] [MAIN ] BIP: Full history saved. [2025-09-18T17:40:05.864949] [INFO ] [MAIN ] Update Progress: 277/2372 symbols completed. BIP took 37.3s. Estimated remaining: 5h 2m 50s. Rate: 6.9 symbols/min [2025-09-18T17:40:06.119617] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-18T17:40:06.542340] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-18T17:40:06.543339] [INFO ] [REMOTE ] BIPH: Full fetch complete (4350 records). [2025-09-18T17:40:06.543411] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-18T17:40:06.924775] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-18T17:40:06.932079] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-09-18T17:40:06.933294] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-09-18T17:40:06.933499] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-09-18T17:40:06.933547] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-09-18T17:40:06.934066] [DEBUG] [LOCAL ] BIPH: Trimmed 4350 records to 2641 (keeping 200 days of data) [2025-09-18T17:40:06.952821] [DEBUG] [LOCAL ] BIPH: Primary data saved (2641 records). [2025-09-18T17:40:06.952991] [INFO ] [MAIN ] BIPH: Full history saved. [2025-09-18T17:40:06.953078] [INFO ] [MAIN ] Update Progress: 278/2372 symbols completed. BIPH took 20.1s. Estimated remaining: 5h 1m 44s. Rate: 6.9 symbols/min [2025-09-18T17:40:07.719592] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-18T17:40:08.299797] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-18T17:40:08.519618] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-18T17:40:08.661149] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-18T17:40:08.665126] [INFO ] [REMOTE ] BIO: Full fetch complete (34128 records). [2025-09-18T17:40:08.665316] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-18T17:40:09.046165] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-18T17:40:09.046246] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-18T17:40:09.046700] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-18T17:40:09.046762] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-18T17:40:09.047568] [DEBUG] [LOCAL ] BIO: Trimmed 34128 records to 25946 (keeping 200 days of data) [2025-09-18T17:40:09.211982] [DEBUG] [LOCAL ] BIO: Primary data saved (25946 records). [2025-09-18T17:40:09.212115] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-18T17:40:09.212211] [INFO ] [MAIN ] Update Progress: 279/2372 symbols completed. BIO took 51.1s. Estimated remaining: 5h 0m 48s. Rate: 7.0 symbols/min [2025-09-18T17:40:09.905725] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T17:40:09.914313] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-18T17:40:13.437693] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (3.52 seconds). [2025-09-18T17:40:13.446338] [INFO ] [REMOTE ] BIPC: Full fetch complete (59348 records). [2025-09-18T17:40:13.446535] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-18T17:40:14.067634] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-09-18T17:40:14.067798] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-09-18T17:40:14.068822] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-09-18T17:40:14.068917] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-09-18T17:40:14.070916] [DEBUG] [LOCAL ] BIPC: Trimmed 59348 records to 42113 (keeping 200 days of data) [2025-09-18T17:40:14.473082] [DEBUG] [LOCAL ] BIPC: Primary data saved (42113 records). [2025-09-18T17:40:14.473294] [INFO ] [MAIN ] BIPC: Full history saved. [2025-09-18T17:40:14.473439] [INFO ] [MAIN ] Update Progress: 280/2372 symbols completed. BIPC took 36.4s. Estimated remaining: 5h 0m 14s. Rate: 7.0 symbols/min [2025-09-18T17:40:15.123029] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:40:15.153830] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:40:15.247481] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:40:15.266253] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:40:15.269540] [DEBUG] [LOCAL ] BIPJ: Loaded 2883 existing records from primary storage. [2025-09-18T17:40:15.269775] [INFO ] [MAIN ] BIPJ: Loaded 2883 existing records. [2025-09-18T17:40:15.340961] [DEBUG] [LOCAL ] BIPI: Loaded 3432 existing records from primary storage. [2025-09-18T17:40:15.374172] [INFO ] [MAIN ] BIPI: Loaded 3432 existing records. [2025-09-18T17:40:15.579286] [DEBUG] [LOCAL ] BIT: Loaded 21819 existing records from primary storage. [2025-09-18T17:40:15.597898] [INFO ] [MAIN ] BIT: Loaded 21819 existing records. [2025-09-18T17:40:15.601440] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:40:15.612518] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-18T17:40:15.631444] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-18T17:40:15.664771] [DEBUG] [LOCAL ] BIRK: Loaded 50805 existing records from primary storage. [2025-09-18T17:40:15.676069] [INFO ] [MAIN ] BIRK: Loaded 50805 existing records. [2025-09-18T17:40:15.730983] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-18T17:40:15.767333] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:40:15.818554] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-18T17:40:15.863921] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-18T17:40:15.939111] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-18T17:40:15.978365] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-18T17:40:16.049121] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-18T17:40:16.254900] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:40:16.308776] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:40:16.313976] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-18T17:40:16.332855] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-18T17:40:16.346301] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-18T17:40:16.346486] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-18T17:40:16.389460] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-09-18T17:40:16.394922] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-18T17:40:16.420778] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-18T17:40:16.420724] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-18T17:40:17.080747] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:40:17.179631] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-11. [2025-09-18T17:40:17.392309] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:40:17.483293] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-11. [2025-09-18T17:40:17.544948] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:40:17.557577] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-11. [2025-09-18T17:40:17.639190] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:40:17.639538] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-11. [2025-09-18T17:40:17.917160] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-18T17:40:17.919282] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-09-18T17:40:18.192222] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-18T17:40:18.193638] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-09-18T17:40:18.363301] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-18T17:40:18.365014] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-09-18T17:40:18.389594] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-18T17:40:18.395516] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-09-18T17:40:18.683493] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-18T17:40:18.685748] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-09-18T17:40:18.715792] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-18T17:40:18.717122] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-18T17:40:18.946759] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-18T17:40:18.956494] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-09-18T17:40:19.246049] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-18T17:40:19.247667] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-18T17:40:19.321127] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-18T17:40:19.488753] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-18T17:40:19.535554] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-18T17:40:19.719567] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-09-18T17:40:20.209616] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-18T17:40:20.519552] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-09-18T17:40:20.698553] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-18T17:40:21.319551] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-18T17:40:21.881059] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-18T17:40:22.119554] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-18T17:40:22.364460] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-18T17:40:22.426133] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-18T17:40:22.919540] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-18T17:40:23.719573] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-18T17:40:24.310614] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-18T17:40:24.519563] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-18T17:40:24.647613] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-18T17:40:25.138618] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-18T17:40:25.319537] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-18T17:40:25.968432] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-18T17:40:26.119542] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-18T17:40:26.575753] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-18T17:40:26.919543] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-18T17:40:27.400091] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-18T17:40:27.719542] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-18T17:40:28.152491] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-18T17:40:28.519567] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-18T17:40:29.319570] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-18T17:40:29.883565] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T17:40:30.119552] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-18T17:40:30.187830] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-18T17:40:30.919506] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-18T17:40:31.297001] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-18T17:40:31.311520] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-18T17:40:31.719557] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-18T17:40:32.519545] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-18T17:40:32.821622] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-18T17:40:33.319561] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-18T17:40:33.505617] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-18T17:40:33.929277] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-18T17:40:34.119543] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-18T17:40:34.919548] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-18T17:40:35.719547] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-18T17:40:35.930191] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-18T17:40:35.955460] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-18T17:40:36.112137] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-18T17:40:36.519547] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-18T17:40:37.058514] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-18T17:40:37.059597] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4261 records). [2025-09-18T17:40:37.059701] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-18T17:40:37.324666] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-18T17:40:37.437277] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-09-18T17:40:37.437366] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-09-18T17:40:37.437516] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-09-18T17:40:37.437557] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-09-18T17:40:37.437964] [DEBUG] [LOCAL ] BIPJ: Trimmed 4261 records to 2902 (keeping 200 days of data) [2025-09-18T17:40:37.456594] [DEBUG] [LOCAL ] BIPJ: Primary data saved (2902 records). [2025-09-18T17:40:37.456720] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-09-18T17:40:37.456813] [INFO ] [MAIN ] Update Progress: 281/2372 symbols completed. BIPJ took 23.0s. Estimated remaining: 5h 1m 52s. Rate: 6.9 symbols/min [2025-09-18T17:40:37.626380] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:40:37.679362] [DEBUG] [LOCAL ] BJ: Loaded 51438 existing records from primary storage. [2025-09-18T17:40:37.679535] [INFO ] [MAIN ] BJ: Loaded 51438 existing records. [2025-09-18T17:40:37.783875] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-18T17:40:37.862482] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:40:37.862855] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-18T17:40:37.862915] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-18T17:40:37.864374] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-09-18T17:40:37.864461] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-18T17:40:38.124717] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-18T17:40:38.233875] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:40:38.919540] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-11. [2025-09-18T17:40:39.398152] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-18T17:40:39.719542] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-18T17:40:40.272567] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-18T17:40:40.519546] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-09-18T17:40:40.732088] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-18T17:40:41.319554] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-18T17:40:41.999059] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-18T17:40:42.119546] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-09-18T17:40:42.820749] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-18T17:40:42.826182] [INFO ] [REMOTE ] BIT: Full fetch complete (30821 records). [2025-09-18T17:40:42.826281] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-18T17:40:42.927944] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-18T17:40:43.203189] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-09-18T17:40:43.203272] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-09-18T17:40:43.203703] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-09-18T17:40:43.203766] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-09-18T17:40:43.204725] [DEBUG] [LOCAL ] BIT: Trimmed 30821 records to 22188 (keeping 200 days of data) [2025-09-18T17:40:43.342668] [DEBUG] [LOCAL ] BIT: Primary data saved (22188 records). [2025-09-18T17:40:43.342881] [INFO ] [MAIN ] BIT: Full history saved. [2025-09-18T17:40:43.343107] [INFO ] [MAIN ] Update Progress: 282/2372 symbols completed. BIT took 28.9s. Estimated remaining: 5h 1m 23s. Rate: 6.9 symbols/min [2025-09-18T17:40:43.545784] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T17:40:43.549129] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:40:43.614440] [DEBUG] [LOCAL ] BK: Loaded 53566 existing records from primary storage. [2025-09-18T17:40:43.614703] [INFO ] [MAIN ] BK: Loaded 53566 existing records. [2025-09-18T17:40:43.724749] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-18T17:40:43.798763] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:40:43.799015] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-18T17:40:43.799064] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-18T17:40:43.801399] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-09-18T17:40:43.801463] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-18T17:40:44.155848] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:40:44.282087] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-18T17:40:44.317540] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-18T17:40:44.519539] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-18T17:40:45.319546] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-18T17:40:45.805227] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-18T17:40:46.119546] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-11. [2025-09-18T17:40:46.919556] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-18T17:40:46.975771] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-18T17:40:47.446869] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-18T17:40:47.666431] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-18T17:40:47.667900] [INFO ] [REMOTE ] BIPI: Full fetch complete (5309 records). [2025-09-18T17:40:47.667975] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-18T17:40:47.724784] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-18T17:40:48.048949] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-18T17:40:48.049050] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-18T17:40:48.049296] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-18T17:40:48.049365] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-18T17:40:48.050181] [DEBUG] [LOCAL ] BIPI: Trimmed 5309 records to 3452 (keeping 200 days of data) [2025-09-18T17:40:48.071814] [DEBUG] [LOCAL ] BIPI: Primary data saved (3452 records). [2025-09-18T17:40:48.071890] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-18T17:40:48.071968] [INFO ] [MAIN ] Update Progress: 283/2372 symbols completed. BIPI took 33.6s. Estimated remaining: 5h 0m 46s. Rate: 6.9 symbols/min [2025-09-18T17:40:48.250682] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:40:48.298865] [DEBUG] [LOCAL ] BKD: Loaded 50107 existing records from primary storage. [2025-09-18T17:40:48.299012] [INFO ] [MAIN ] BKD: Loaded 50107 existing records. [2025-09-18T17:40:48.480585] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:40:48.480892] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-18T17:40:48.480942] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-18T17:40:48.482766] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-09-18T17:40:48.482835] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-18T17:40:48.525455] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-18T17:40:48.852753] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:40:49.319547] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-11. [2025-09-18T17:40:49.517524] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-18T17:40:49.915864] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T17:40:50.119549] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-18T17:40:50.545778] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-18T17:40:50.919556] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-09-18T17:40:51.719514] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-09-18T17:40:51.808887] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-18T17:40:51.816564] [INFO ] [REMOTE ] BIRK: Full fetch complete (72496 records). [2025-09-18T17:40:51.816761] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-18T17:40:52.243888] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-18T17:40:52.244108] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-18T17:40:52.245138] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-18T17:40:52.245264] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-18T17:40:52.256967] [DEBUG] [LOCAL ] BIRK: Trimmed 72496 records to 51180 (keeping 200 days of data) [2025-09-18T17:40:52.277859] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T17:40:52.519729] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-09-18T17:40:52.594099] [DEBUG] [LOCAL ] BIRK: Primary data saved (51180 records). [2025-09-18T17:40:52.594311] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-18T17:40:52.594404] [INFO ] [MAIN ] Update Progress: 284/2372 symbols completed. BIRK took 38.1s. Estimated remaining: 5h 0m 7s. Rate: 7.0 symbols/min [2025-09-18T17:40:52.763510] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:40:52.797502] [DEBUG] [LOCAL ] BKE: Loaded 34983 existing records from primary storage. [2025-09-18T17:40:52.797678] [INFO ] [MAIN ] BKE: Loaded 34983 existing records. [2025-09-18T17:40:53.026168] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:40:53.026436] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-18T17:40:53.026483] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-18T17:40:53.027551] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-09-18T17:40:53.027612] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-18T17:40:53.327637] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-18T17:40:53.391838] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:40:53.424453] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-18T17:40:53.681106] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-18T17:40:54.119566] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-18T17:40:54.919568] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-09-18T17:40:55.214207] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-18T17:40:55.320815] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-18T17:40:55.719632] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-18T17:40:56.358808] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-18T17:40:56.519562] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-18T17:40:57.319625] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-11. [2025-09-18T17:40:57.455260] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-18T17:40:57.837813] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T17:40:58.119588] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-18T17:40:58.407553] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T17:40:58.919588] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-18T17:40:59.452139] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-18T17:40:59.719583] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-18T17:41:00.290211] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-18T17:41:00.519712] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-18T17:41:01.158030] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-18T17:41:01.319569] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-09-18T17:41:02.089055] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T17:41:02.119513] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-18T17:41:02.228103] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-18T17:41:02.919595] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-09-18T17:41:03.719581] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-18T17:41:03.990257] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-18T17:41:04.053336] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-18T17:41:04.519585] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-18T17:41:04.891484] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-18T17:41:05.319696] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-18T17:41:06.017838] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T17:41:06.119511] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-18T17:41:06.770257] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T17:41:06.919617] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-18T17:41:07.719610] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-09-18T17:41:08.061400] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-18T17:41:08.198124] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-18T17:41:08.519565] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-18T17:41:08.842511] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-18T17:41:09.319566] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-09-18T17:41:10.119601] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-18T17:41:10.261894] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-18T17:41:10.269524] [INFO ] [REMOTE ] BKD: Full fetch complete (71177 records). [2025-09-18T17:41:10.269718] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-18T17:41:10.682802] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-09-18T17:41:10.682942] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-09-18T17:41:10.683722] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-09-18T17:41:10.683805] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-09-18T17:41:10.685472] [DEBUG] [LOCAL ] BKD: Trimmed 71177 records to 50478 (keeping 200 days of data) [2025-09-18T17:41:10.800672] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T17:41:10.920550] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-18T17:41:11.004857] [DEBUG] [LOCAL ] BKD: Primary data saved (50478 records). [2025-09-18T17:41:11.005006] [INFO ] [MAIN ] BKD: Full history saved. [2025-09-18T17:41:11.005631] [INFO ] [MAIN ] Update Progress: 285/2372 symbols completed. BKD took 22.9s. Estimated remaining: 5h 1m 10s. Rate: 6.9 symbols/min [2025-09-18T17:41:11.203472] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:41:11.241473] [DEBUG] [LOCAL ] BKH: Loaded 36722 existing records from primary storage. [2025-09-18T17:41:11.241660] [INFO ] [MAIN ] BKH: Loaded 36722 existing records. [2025-09-18T17:41:11.429102] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:41:11.429376] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-18T17:41:11.429427] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-18T17:41:11.430690] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-18T17:41:11.430753] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-18T17:41:11.724627] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-09-18T17:41:11.818638] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:41:11.945428] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-18T17:41:12.473384] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-18T17:41:12.519493] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-18T17:41:13.284127] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-18T17:41:13.319488] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-09-18T17:41:14.037895] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T17:41:14.045193] [INFO ] [REMOTE ] BJ: Full fetch complete (73539 records). [2025-09-18T17:41:14.045307] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-18T17:41:14.124678] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-11. [2025-09-18T17:41:14.455096] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-09-18T17:41:14.455212] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-09-18T17:41:14.456173] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-09-18T17:41:14.456286] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-09-18T17:41:14.478487] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-18T17:41:14.486808] [DEBUG] [LOCAL ] BJ: Trimmed 73539 records to 51813 (keeping 200 days of data) [2025-09-18T17:41:14.802150] [DEBUG] [LOCAL ] BJ: Primary data saved (51813 records). [2025-09-18T17:41:14.802317] [INFO ] [MAIN ] BJ: Full history saved. [2025-09-18T17:41:14.802409] [INFO ] [MAIN ] Update Progress: 286/2372 symbols completed. BJ took 37.3s. Estimated remaining: 5h 0m 26s. Rate: 6.9 symbols/min [2025-09-18T17:41:14.924684] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-18T17:41:14.977440] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:41:15.016734] [DEBUG] [LOCAL ] BKKT: Loaded 33950 existing records from primary storage. [2025-09-18T17:41:15.016895] [INFO ] [MAIN ] BKKT: Loaded 33950 existing records. [2025-09-18T17:41:15.199322] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:41:15.199594] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-18T17:41:15.199672] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-18T17:41:15.200556] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-18T17:41:15.200618] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-18T17:41:15.599165] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:41:15.652456] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-18T17:41:15.719504] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-09-18T17:41:16.476415] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-18T17:41:16.519553] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-11. [2025-09-18T17:41:16.702504] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-18T17:41:17.319563] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-09-18T17:41:18.086413] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-18T17:41:18.119559] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-09-18T17:41:18.709266] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-18T17:41:18.919558] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-18T17:41:19.068220] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-18T17:41:19.719574] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-09-18T17:41:20.405541] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-18T17:41:20.519560] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-18T17:41:20.892895] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T17:41:21.319559] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-09-18T17:41:21.548589] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-18T17:41:22.119563] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-18T17:41:22.919710] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-09-18T17:41:23.260113] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-18T17:41:23.594972] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-18T17:41:23.719525] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-09-18T17:41:23.929802] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-18T17:41:24.519603] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-18T17:41:25.319607] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-18T17:41:25.343717] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-18T17:41:25.764859] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-18T17:41:26.119578] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-18T17:41:26.782635] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T17:41:26.790516] [INFO ] [REMOTE ] BK: Full fetch complete (77330 records). [2025-09-18T17:41:26.790702] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-18T17:41:26.924634] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-18T17:41:27.211568] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-09-18T17:41:27.211680] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-09-18T17:41:27.212446] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-18T17:41:27.212493] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-09-18T17:41:27.213992] [DEBUG] [LOCAL ] BK: Trimmed 77330 records to 53955 (keeping 200 days of data) [2025-09-18T17:41:27.570267] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T17:41:27.591952] [DEBUG] [LOCAL ] BK: Primary data saved (53955 records). [2025-09-18T17:41:27.592111] [INFO ] [MAIN ] BK: Full history saved. [2025-09-18T17:41:27.592215] [INFO ] [MAIN ] Update Progress: 287/2372 symbols completed. BK took 44.2s. Estimated remaining: 5h 0m 47s. Rate: 6.9 symbols/min [2025-09-18T17:41:27.731995] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-18T17:41:27.764041] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:41:27.774335] [DEBUG] [LOCAL ] BKN: Loaded 7692 existing records from primary storage. [2025-09-18T17:41:27.774448] [INFO ] [MAIN ] BKN: Loaded 7692 existing records. [2025-09-18T17:41:27.953316] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:41:27.953556] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-18T17:41:27.953604] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-18T17:41:27.954157] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-09-18T17:41:27.954219] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-18T17:41:28.323459] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:41:28.341209] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T17:41:28.519601] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-18T17:41:28.778758] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-18T17:41:29.319565] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-18T17:41:29.713261] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-18T17:41:30.119570] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-09-18T17:41:30.536743] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-18T17:41:30.919582] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-18T17:41:31.724721] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-18T17:41:31.732276] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-18T17:41:31.737238] [INFO ] [REMOTE ] BKE: Full fetch complete (49994 records). [2025-09-18T17:41:31.737347] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-09-18T17:41:31.738033] [FATAL] [VALIDATOR ] BKE: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:41:31.738120] [FATAL] [MAIN ] BKE: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:41:31.738165] [WARN ] [MAIN ] BKE: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:41:31.738393] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-18T17:41:31.738501] [DEBUG] [LOCAL ] BKE: No primary data file found to delete. [2025-09-18T17:41:31.738561] [INFO ] [LOCAL ] BKE: Starting deletion of derivative data. [2025-09-18T17:41:31.739119] [DEBUG] [LOCAL ] BKE: Deleted derivative data file. [2025-09-18T17:41:31.739252] [INFO ] [MAIN ] Update Progress: 288/2372 symbols completed. BKE took 39.1s. Estimated remaining: 5h 0m 6s. Rate: 6.9 symbols/min [2025-09-18T17:41:31.913675] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:41:31.960692] [DEBUG] [LOCAL ] BKSY: Loaded 48297 existing records from primary storage. [2025-09-18T17:41:31.960908] [INFO ] [MAIN ] BKSY: Loaded 48297 existing records. [2025-09-18T17:41:32.147020] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:41:32.147302] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-18T17:41:32.147351] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-18T17:41:32.148957] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-18T17:41:32.149023] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-18T17:41:32.529133] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-11. [2025-09-18T17:41:32.565209] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:41:32.606366] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-18T17:41:32.635959] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-18T17:41:33.301954] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-18T17:41:33.319495] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-09-18T17:41:34.119541] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-18T17:41:34.142509] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-18T17:41:34.919555] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-18T17:41:35.613364] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T17:41:35.719553] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-18T17:41:36.320162] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-18T17:41:36.519533] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-11. [2025-09-18T17:41:36.753403] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-18T17:41:37.319615] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-09-18T17:41:38.119520] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-18T17:41:38.289238] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-18T17:41:38.378099] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-18T17:41:38.919548] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-18T17:41:39.602054] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-18T17:41:39.719567] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-18T17:41:40.113071] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-18T17:41:40.519555] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-09-18T17:41:41.233366] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T17:41:41.240209] [INFO ] [REMOTE ] BKH: Full fetch complete (51914 records). [2025-09-18T17:41:41.240366] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-18T17:41:41.324766] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-18T17:41:41.634550] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-18T17:41:41.634674] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-18T17:41:41.635451] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-18T17:41:41.635525] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-18T17:41:41.640064] [DEBUG] [LOCAL ] BKH: Trimmed 51914 records to 37008 (keeping 200 days of data) [2025-09-18T17:41:41.868141] [DEBUG] [LOCAL ] BKH: Primary data saved (37008 records). [2025-09-18T17:41:41.868299] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-18T17:41:41.868436] [INFO ] [MAIN ] Update Progress: 289/2372 symbols completed. BKH took 30.9s. Estimated remaining: 5h 0m 8s. Rate: 6.9 symbols/min [2025-09-18T17:41:42.044425] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:41:42.058101] [DEBUG] [LOCAL ] BKT: Loaded 10553 existing records from primary storage. [2025-09-18T17:41:42.058236] [INFO ] [MAIN ] BKT: Loaded 10553 existing records. [2025-09-18T17:41:42.123136] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-18T17:41:42.215974] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-18T17:41:42.280791] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:41:42.281076] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-18T17:41:42.281136] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-18T17:41:42.281639] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-09-18T17:41:42.281749] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-18T17:41:42.654495] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:41:42.911954] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T17:41:42.921187] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-11. [2025-09-18T17:41:42.961386] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-18T17:41:43.521865] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-18T17:41:43.719573] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-18T17:41:44.519539] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-09-18T17:41:44.562612] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-18T17:41:45.319543] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-18T17:41:46.119535] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-09-18T17:41:46.155356] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-18T17:41:46.184148] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-18T17:41:46.599736] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-18T17:41:46.919561] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-18T17:41:47.719550] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-09-18T17:41:48.332423] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-18T17:41:48.519555] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-18T17:41:48.747120] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-18T17:41:48.757502] [INFO ] [REMOTE ] BKKT: Full fetch complete (49394 records). [2025-09-18T17:41:48.757704] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-18T17:41:49.147484] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-18T17:41:49.147597] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-18T17:41:49.148213] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-18T17:41:49.148302] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-18T17:41:49.149969] [DEBUG] [LOCAL ] BKKT: Trimmed 49394 records to 34296 (keeping 200 days of data) [2025-09-18T17:41:49.335166] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-18T17:41:49.362544] [DEBUG] [LOCAL ] BKKT: Primary data saved (34296 records). [2025-09-18T17:41:49.362808] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-18T17:41:49.362959] [INFO ] [MAIN ] Update Progress: 290/2372 symbols completed. BKKT took 34.6s. Estimated remaining: 4h 59m 51s. Rate: 6.9 symbols/min [2025-09-18T17:41:49.547295] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:41:49.618777] [DEBUG] [LOCAL ] BKU: Loaded 42104 existing records from primary storage. [2025-09-18T17:41:49.619096] [INFO ] [MAIN ] BKU: Loaded 42104 existing records. [2025-09-18T17:41:49.817342] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:41:49.817758] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-18T17:41:49.817852] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-18T17:41:49.819015] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-18T17:41:49.819080] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-18T17:41:50.122972] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-18T17:41:50.207852] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:41:50.215552] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-18T17:41:50.364618] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-18T17:41:50.772872] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-18T17:41:50.919547] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-11. [2025-09-18T17:41:51.719553] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-18T17:41:52.495234] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-18T17:41:52.519488] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-09-18T17:41:53.244589] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T17:41:53.319522] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-18T17:41:53.491621] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-18T17:41:54.119823] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-09-18T17:41:54.675222] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-18T17:41:54.919539] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-18T17:41:55.650044] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-18T17:41:55.719593] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-18T17:41:56.254052] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T17:41:56.519606] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-18T17:41:56.857918] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T17:41:57.319594] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-18T17:41:58.123918] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-18T17:41:58.130049] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-18T17:41:58.659792] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-18T17:41:58.919573] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-18T17:41:58.982352] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-18T17:41:59.719635] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-18T17:42:00.519560] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-18T17:42:01.319586] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-18T17:42:01.426681] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-18T17:42:01.459938] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-18T17:42:01.515707] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-18T17:42:01.983184] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-18T17:42:02.119555] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-18T17:42:02.820898] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-18T17:42:02.919580] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-18T17:42:03.719581] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-18T17:42:04.189878] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-18T17:42:04.519587] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-18T17:42:04.643421] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-18T17:42:05.045116] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-18T17:42:05.046957] [INFO ] [REMOTE ] BKN: Full fetch complete (12025 records). [2025-09-18T17:42:05.047031] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-18T17:42:05.324728] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-18T17:42:05.423880] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-09-18T17:42:05.423987] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-09-18T17:42:05.424350] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-09-18T17:42:05.424415] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-09-18T17:42:05.424916] [DEBUG] [LOCAL ] BKN: Trimmed 12025 records to 7722 (keeping 200 days of data) [2025-09-18T17:42:05.475332] [DEBUG] [LOCAL ] BKN: Primary data saved (7722 records). [2025-09-18T17:42:05.475470] [INFO ] [MAIN ] BKN: Full history saved. [2025-09-18T17:42:05.475675] [INFO ] [MAIN ] Update Progress: 291/2372 symbols completed. BKN took 37.9s. Estimated remaining: 5h 0m 36s. Rate: 6.9 symbols/min [2025-09-18T17:42:05.648906] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:42:05.682984] [DEBUG] [LOCAL ] BKV: Loaded 30233 existing records from primary storage. [2025-09-18T17:42:05.683125] [INFO ] [MAIN ] BKV: Loaded 30233 existing records. [2025-09-18T17:42:05.860882] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:42:05.861160] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-18T17:42:05.861209] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-18T17:42:05.861891] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-18T17:42:05.861954] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-18T17:42:06.129734] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-18T17:42:06.282511] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:42:06.916224] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T17:42:06.924536] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-11. [2025-09-18T17:42:07.725385] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-18T17:42:07.731016] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-18T17:42:08.192810] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T17:42:08.282096] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-18T17:42:08.519552] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-18T17:42:09.319578] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-18T17:42:09.426708] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-18T17:42:10.119566] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-18T17:42:10.865954] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-18T17:42:10.874602] [INFO ] [REMOTE ] BKSY: Full fetch complete (69131 records). [2025-09-18T17:42:10.874810] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-18T17:42:10.929628] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-09-18T17:42:11.296322] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-18T17:42:11.296422] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-18T17:42:11.297200] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-18T17:42:11.297266] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-18T17:42:11.298730] [DEBUG] [LOCAL ] BKSY: Trimmed 69131 records to 48677 (keeping 200 days of data) [2025-09-18T17:42:11.623959] [DEBUG] [LOCAL ] BKSY: Primary data saved (48677 records). [2025-09-18T17:42:11.624119] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-18T17:42:11.624250] [INFO ] [MAIN ] Update Progress: 292/2372 symbols completed. BKSY took 39.9s. Estimated remaining: 5h 0m 9s. Rate: 6.9 symbols/min [2025-09-18T17:42:11.724733] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-18T17:42:11.808492] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:42:11.840320] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-18T17:42:11.883337] [DEBUG] [LOCAL ] BLCO: Loaded 36348 existing records from primary storage. [2025-09-18T17:42:11.883496] [INFO ] [MAIN ] BLCO: Loaded 36348 existing records. [2025-09-18T17:42:12.064762] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:42:12.065385] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-18T17:42:12.065571] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-18T17:42:12.066608] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-09-18T17:42:12.066727] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-18T17:42:12.210320] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-18T17:42:12.471395] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:42:12.482427] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-18T17:42:12.519553] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-11. [2025-09-18T17:42:13.319603] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-09-18T17:42:13.652281] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-18T17:42:14.119581] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-09-18T17:42:14.278179] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-18T17:42:14.919613] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-18T17:42:15.455095] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T17:42:15.660391] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T17:42:15.663473] [INFO ] [REMOTE ] BKT: Full fetch complete (14594 records). [2025-09-18T17:42:15.663552] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-18T17:42:15.664157] [FATAL] [VALIDATOR ] BKT: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:42:15.664286] [FATAL] [MAIN ] BKT: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:42:15.664330] [WARN ] [MAIN ] BKT: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:42:15.664368] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-18T17:42:15.664438] [DEBUG] [LOCAL ] BKT: No primary data file found to delete. [2025-09-18T17:42:15.664493] [INFO ] [LOCAL ] BKT: Starting deletion of derivative data. [2025-09-18T17:42:15.665233] [DEBUG] [LOCAL ] BKT: Deleted derivative data file. [2025-09-18T17:42:15.665330] [INFO ] [MAIN ] Update Progress: 293/2372 symbols completed. BKT took 33.8s. Estimated remaining: 4h 59m 28s. Rate: 6.9 symbols/min [2025-09-18T17:42:15.727763] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-09-18T17:42:15.844547] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:42:15.844807] [DEBUG] [LOCAL ] BLD: No existing data file found in primary storage. [2025-09-18T17:42:15.844867] [WARN ] [MAIN ] BLD: No existing data found, performing full refresh instead. [2025-09-18T17:42:15.845027] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-18T17:42:15.845072] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-18T17:42:15.845115] [DEBUG] [LOCAL ] BLD: No primary data file found to delete. [2025-09-18T17:42:15.845148] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-18T17:42:16.206489] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:42:16.519583] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-18T17:42:16.779511] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-18T17:42:17.319568] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-18T17:42:17.452027] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-18T17:42:18.119596] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-18T17:42:18.766801] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T17:42:18.919539] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-18T17:42:19.244000] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-18T17:42:19.719557] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-18T17:42:20.009991] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-18T17:42:20.519581] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-18T17:42:20.681294] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-18T17:42:21.319562] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-18T17:42:21.769966] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-18T17:42:22.119560] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-11. [2025-09-18T17:42:22.554764] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T17:42:22.919545] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-18T17:42:23.146522] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-18T17:42:23.719554] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-18T17:42:24.233865] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-18T17:42:24.239476] [INFO ] [REMOTE ] BKU: Full fetch complete (59600 records). [2025-09-18T17:42:24.239583] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-18T17:42:24.524632] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-18T17:42:24.640929] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-18T17:42:24.641009] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-18T17:42:24.641740] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-18T17:42:24.641919] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-18T17:42:24.643268] [DEBUG] [LOCAL ] BKU: Trimmed 59600 records to 42458 (keeping 200 days of data) [2025-09-18T17:42:24.885143] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-18T17:42:24.926731] [DEBUG] [LOCAL ] BKU: Primary data saved (42458 records). [2025-09-18T17:42:24.926866] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-18T17:42:24.926950] [INFO ] [MAIN ] Update Progress: 294/2372 symbols completed. BKU took 35.6s. Estimated remaining: 4h 59m 23s. Rate: 6.9 symbols/min [2025-09-18T17:42:25.101472] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:42:25.159205] [DEBUG] [LOCAL ] BLDR: Loaded 51629 existing records from primary storage. [2025-09-18T17:42:25.159393] [INFO ] [MAIN ] BLDR: Loaded 51629 existing records. [2025-09-18T17:42:25.321020] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-18T17:42:25.343805] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:42:25.344848] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-18T17:42:25.344905] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-18T17:42:25.346127] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-09-18T17:42:25.346189] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-18T17:42:25.702955] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:42:26.119540] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-11. [2025-09-18T17:42:26.266505] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-18T17:42:26.431980] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-18T17:42:26.919559] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-18T17:42:27.719556] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-09-18T17:42:27.861429] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-18T17:42:28.308416] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-11 (2.19 seconds). [2025-09-18T17:42:28.519550] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-18T17:42:28.597041] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T17:42:29.319695] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-18T17:42:29.533198] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-18T17:42:30.119563] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-18T17:42:30.462419] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T17:42:30.919564] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-09-18T17:42:31.263145] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-18T17:42:31.719562] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-09-18T17:42:32.030409] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-18T17:42:32.519552] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-18T17:42:33.319507] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-18T17:42:33.332533] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-18T17:42:33.339536] [INFO ] [REMOTE ] BKV: Full fetch complete (44977 records). [2025-09-18T17:42:33.339684] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-18T17:42:33.681964] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-18T17:42:33.770778] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-18T17:42:33.770870] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-18T17:42:33.771389] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-18T17:42:33.771432] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-18T17:42:33.772693] [DEBUG] [LOCAL ] BKV: Trimmed 44977 records to 30424 (keeping 200 days of data) [2025-09-18T17:42:33.956767] [DEBUG] [LOCAL ] BKV: Primary data saved (30424 records). [2025-09-18T17:42:33.956910] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-18T17:42:33.956998] [INFO ] [MAIN ] Update Progress: 295/2372 symbols completed. BKV took 28.5s. Estimated remaining: 4h 59m 18s. Rate: 6.9 symbols/min [2025-09-18T17:42:34.127624] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:42:34.124672] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-09-18T17:42:34.144990] [DEBUG] [LOCAL ] BLE: Loaded 14756 existing records from primary storage. [2025-09-18T17:42:34.145119] [INFO ] [MAIN ] BLE: Loaded 14756 existing records. [2025-09-18T17:42:34.332732] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:42:34.333053] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-18T17:42:34.333110] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-18T17:42:34.333589] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-09-18T17:42:34.333682] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-18T17:42:34.684674] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:42:34.750806] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T17:42:34.919547] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-11. [2025-09-18T17:42:35.627993] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-18T17:42:35.723151] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-18T17:42:35.731764] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T17:42:36.519572] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-09-18T17:42:37.208838] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T17:42:37.228737] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-18T17:42:37.319519] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-09-18T17:42:38.119565] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-18T17:42:38.151967] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-18T17:42:38.919565] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-18T17:42:39.311360] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-18T17:42:39.719600] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-18T17:42:39.756751] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-18T17:42:40.519558] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-18T17:42:40.824475] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-18T17:42:41.238699] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-18T17:42:41.319567] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-18T17:42:42.119586] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-18T17:42:42.344874] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-18T17:42:42.919576] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-18T17:42:43.719568] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-18T17:42:43.756848] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-18T17:42:43.809688] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-18T17:42:43.814301] [INFO ] [REMOTE ] BLCO: Full fetch complete (52535 records). [2025-09-18T17:42:43.814428] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-18T17:42:44.212759] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-09-18T17:42:44.212886] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-09-18T17:42:44.213616] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-09-18T17:42:44.213714] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-09-18T17:42:44.215516] [DEBUG] [LOCAL ] BLCO: Trimmed 52535 records to 36511 (keeping 200 days of data) [2025-09-18T17:42:44.440436] [DEBUG] [LOCAL ] BLCO: Primary data saved (36511 records). [2025-09-18T17:42:44.440590] [INFO ] [MAIN ] BLCO: Full history saved. [2025-09-18T17:42:44.440705] [INFO ] [MAIN ] Update Progress: 296/2372 symbols completed. BLCO took 32.8s. Estimated remaining: 4h 59m 22s. Rate: 6.9 symbols/min [2025-09-18T17:42:44.524627] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-18T17:42:44.616968] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:42:44.657024] [DEBUG] [LOCAL ] BLK: Loaded 35384 existing records from primary storage. [2025-09-18T17:42:44.657170] [INFO ] [MAIN ] BLK: Loaded 35384 existing records. [2025-09-18T17:42:44.835292] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:42:44.835564] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-18T17:42:44.835664] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-18T17:42:44.836696] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-09-18T17:42:44.836756] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-18T17:42:45.202071] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:42:45.217937] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-18T17:42:45.319556] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-18T17:42:46.119634] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-18T17:42:46.233870] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-18T17:42:46.272174] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-18T17:42:46.837452] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-18T17:42:46.919541] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-18T17:42:47.719555] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-18T17:42:47.955235] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-18T17:42:48.519571] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-18T17:42:49.056790] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-18T17:42:49.238055] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T17:42:49.319531] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-18T17:42:49.824192] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-18T17:42:50.119594] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-18T17:42:50.919590] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-11. [2025-09-18T17:42:51.069719] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-18T17:42:51.072285] [INFO ] [REMOTE ] BLE: Full fetch complete (20612 records). [2025-09-18T17:42:51.072380] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-18T17:42:51.459617] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-09-18T17:42:51.459761] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-09-18T17:42:51.460154] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-09-18T17:42:51.460198] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-09-18T17:42:51.460968] [DEBUG] [LOCAL ] BLE: Trimmed 20612 records to 14919 (keeping 200 days of data) [2025-09-18T17:42:51.554559] [DEBUG] [LOCAL ] BLE: Primary data saved (14919 records). [2025-09-18T17:42:51.554750] [INFO ] [MAIN ] BLE: Full history saved. [2025-09-18T17:42:51.554852] [INFO ] [MAIN ] Update Progress: 297/2372 symbols completed. BLE took 17.6s. Estimated remaining: 4h 59m 2s. Rate: 6.9 symbols/min [2025-09-18T17:42:51.725462] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-18T17:42:51.725356] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:42:51.783433] [DEBUG] [LOCAL ] BLND: Loaded 49533 existing records from primary storage. [2025-09-18T17:42:51.783591] [INFO ] [MAIN ] BLND: Loaded 49533 existing records. [2025-09-18T17:42:51.973932] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:42:51.974218] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-18T17:42:51.974268] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-18T17:42:51.975636] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-09-18T17:42:51.975743] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-18T17:42:52.339986] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:42:52.521068] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-18T17:42:52.523886] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-18T17:42:52.680362] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-18T17:42:53.319566] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-11. [2025-09-18T17:42:54.119515] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-18T17:42:54.206934] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-18T17:42:54.663883] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-18T17:42:54.919555] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-18T17:42:55.092221] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-18T17:42:55.719578] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-18T17:42:56.519526] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-09-18T17:42:56.611204] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-18T17:42:56.655960] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-18T17:42:56.661156] [INFO ] [REMOTE ] BLD: Full fetch complete (40307 records). [2025-09-18T17:42:56.661272] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-18T17:42:57.038512] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-09-18T17:42:57.038597] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-09-18T17:42:57.039087] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-09-18T17:42:57.039149] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-09-18T17:42:57.040064] [DEBUG] [LOCAL ] BLD: Trimmed 40307 records to 28388 (keeping 200 days of data) [2025-09-18T17:42:57.219870] [DEBUG] [LOCAL ] BLD: Primary data saved (28388 records). [2025-09-18T17:42:57.220013] [INFO ] [MAIN ] BLD: Full history saved. [2025-09-18T17:42:57.220091] [INFO ] [MAIN ] Update Progress: 298/2372 symbols completed. BLD took 41.6s. Estimated remaining: 4h 58m 33s. Rate: 6.9 symbols/min [2025-09-18T17:42:57.325502] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-09-18T17:42:57.396635] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:42:57.396825] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-18T17:42:57.396863] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-18T17:42:57.397033] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-18T17:42:57.397084] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-18T17:42:57.397128] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-18T17:42:57.397161] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-18T17:42:57.753262] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:42:57.890280] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-18T17:42:58.119548] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-18T17:42:58.708307] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-18T17:42:58.919591] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-09-18T17:42:59.719552] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-09-18T17:43:00.210288] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-18T17:43:00.487302] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-18T17:43:00.519490] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-18T17:43:01.091381] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-18T17:43:01.319589] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-18T17:43:01.995598] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-18T17:43:02.119601] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-11. [2025-09-18T17:43:02.331705] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:43:02.332116] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-11 [2025-09-18T17:43:02.919546] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-18T17:43:03.244586] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-18T17:43:03.719564] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-09-18T17:43:03.934503] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:43:03.935045] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-09-18T17:43:04.519546] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-09-18T17:43:04.674948] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-18T17:43:04.719900] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:43:04.720247] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-09-18T17:43:05.319551] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-02. [2025-09-18T17:43:05.517824] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:43:05.518160] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-02 [2025-09-18T17:43:06.119555] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-03. [2025-09-18T17:43:06.307608] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:43:06.308040] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-03 [2025-09-18T17:43:06.919548] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-18T17:43:07.719548] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-04. [2025-09-18T17:43:07.931138] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:43:07.931462] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-04 [2025-09-18T17:43:08.515519] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-18T17:43:08.522180] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-05. [2025-09-18T17:43:08.524209] [INFO ] [REMOTE ] BLDR: Full fetch complete (73928 records). [2025-09-18T17:43:08.524322] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-18T17:43:08.848462] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:43:08.881604] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-05 [2025-09-18T17:43:08.953207] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-09-18T17:43:08.953315] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-09-18T17:43:08.954081] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-09-18T17:43:08.954149] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-09-18T17:43:08.955621] [DEBUG] [LOCAL ] BLDR: Trimmed 73928 records to 52011 (keeping 200 days of data) [2025-09-18T17:43:09.274027] [DEBUG] [LOCAL ] BLDR: Primary data saved (52011 records). [2025-09-18T17:43:09.274232] [INFO ] [MAIN ] BLDR: Full history saved. [2025-09-18T17:43:09.274379] [INFO ] [MAIN ] Update Progress: 299/2372 symbols completed. BLDR took 44.3s. Estimated remaining: 4h 58m 48s. Rate: 6.9 symbols/min [2025-09-18T17:43:09.328623] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-18T17:43:09.449353] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:43:09.465897] [DEBUG] [LOCAL ] BLW: Loaded 12955 existing records from primary storage. [2025-09-18T17:43:09.466022] [INFO ] [MAIN ] BLW: Loaded 12955 existing records. [2025-09-18T17:43:09.640933] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:43:09.641168] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-18T17:43:09.641221] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-18T17:43:09.641573] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-18T17:43:09.641631] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-18T17:43:09.997600] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:43:10.119491] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-11. [2025-09-18T17:43:10.853585] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-18T17:43:10.919596] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-06. [2025-09-18T17:43:11.140989] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:43:11.141534] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-06 [2025-09-18T17:43:11.152442] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-18T17:43:11.719614] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-18T17:43:12.519566] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-07. [2025-09-18T17:43:12.753343] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:43:12.753684] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-07 [2025-09-18T17:43:13.319594] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-09-18T17:43:13.422818] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-18T17:43:13.995313] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-18T17:43:14.119563] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-18T17:43:14.919565] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-08. [2025-09-18T17:43:15.719566] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-09-18T17:43:15.870429] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-18T17:43:16.359936] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-18T17:43:16.519556] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-18T17:43:16.574192] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-18T17:43:17.319567] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-18T17:43:17.432800] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-18T17:43:18.119559] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-09. [2025-09-18T17:43:18.919616] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-18T17:43:19.066073] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-18T17:43:19.503759] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-18T17:43:19.719586] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-18T17:43:20.519575] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-18T17:43:20.640435] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-18T17:43:20.647485] [INFO ] [REMOTE ] BLSH: Full fetch complete (9882 records). [2025-09-18T17:43:20.647562] [DEBUG] [VALIDATOR ] BLSH: Validating primary data. [2025-09-18T17:43:20.832735] [WARN ] [VALIDATOR ] BLSH: Validation failed - insufficient historical data. Have 26 unique days, need 200 days [2025-09-18T17:43:20.833002] [FATAL] [MAIN ] BLSH: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:43:20.833072] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:43:20.833143] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-18T17:43:20.833207] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-18T17:43:20.833244] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-18T17:43:20.833299] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-18T17:43:20.833381] [INFO ] [MAIN ] Update Progress: 300/2372 symbols completed. BLSH took 23.6s. Estimated remaining: 4h 58m 59s. Rate: 6.9 symbols/min [2025-09-18T17:43:21.006331] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:43:21.023590] [DEBUG] [LOCAL ] BLX: Loaded 16000 existing records from primary storage. [2025-09-18T17:43:21.023760] [INFO ] [MAIN ] BLX: Loaded 16000 existing records. [2025-09-18T17:43:21.191329] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-18T17:43:21.242432] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:43:21.242738] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-18T17:43:21.242796] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-18T17:43:21.243361] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-09-18T17:43:21.243420] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-18T17:43:21.324736] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-18T17:43:21.602257] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:43:21.989165] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-18T17:43:22.119520] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-18T17:43:22.919560] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-11. [2025-09-18T17:43:23.231561] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-18T17:43:23.450822] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T17:43:23.719575] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-18T17:43:24.099196] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-18T17:43:24.520780] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-18T17:43:24.522875] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-18T17:43:25.319545] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-18T17:43:26.110567] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T17:43:26.120033] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-09-18T17:43:26.566961] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-18T17:43:26.915447] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-18T17:43:26.919482] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-09-18T17:43:27.719545] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-18T17:43:27.960442] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-18T17:43:28.519561] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-18T17:43:29.103831] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-18T17:43:29.173793] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T17:43:29.179755] [INFO ] [REMOTE ] BLK: Full fetch complete (53272 records). [2025-09-18T17:43:29.179937] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-18T17:43:29.331863] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-18T17:43:29.604284] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-09-18T17:43:29.604387] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-09-18T17:43:29.605035] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-09-18T17:43:29.605109] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-09-18T17:43:29.606434] [DEBUG] [LOCAL ] BLK: Trimmed 53272 records to 35664 (keeping 200 days of data) [2025-09-18T17:43:29.841969] [DEBUG] [LOCAL ] BLK: Primary data saved (35664 records). [2025-09-18T17:43:29.842121] [INFO ] [MAIN ] BLK: Full history saved. [2025-09-18T17:43:29.842264] [INFO ] [MAIN ] Update Progress: 301/2372 symbols completed. BLK took 45.4s. Estimated remaining: 4h 58m 53s. Rate: 6.9 symbols/min [2025-09-18T17:43:30.030257] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:43:30.067577] [DEBUG] [LOCAL ] BMA: Loaded 34425 existing records from primary storage. [2025-09-18T17:43:30.067829] [INFO ] [MAIN ] BMA: Loaded 34425 existing records. [2025-09-18T17:43:30.129161] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-18T17:43:30.265089] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:43:30.265453] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-18T17:43:30.265521] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-18T17:43:30.266585] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-18T17:43:30.266682] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-18T17:43:30.632883] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-18T17:43:30.637546] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:43:30.919611] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-18T17:43:31.420917] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-18T17:43:31.719563] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-11. [2025-09-18T17:43:32.014527] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-18T17:43:32.519554] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-18T17:43:33.209967] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-18T17:43:33.235803] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-18T17:43:33.319500] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-09-18T17:43:34.119549] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-18T17:43:34.765979] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-18T17:43:34.909117] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-18T17:43:34.919486] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-18T17:43:35.719552] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-18T17:43:35.937866] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-18T17:43:36.334516] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-18T17:43:36.519548] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-18T17:43:37.271008] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-18T17:43:37.319507] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-18T17:43:38.119541] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-18T17:43:38.769550] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-18T17:43:38.772285] [INFO ] [REMOTE ] BLW: Full fetch complete (18852 records). [2025-09-18T17:43:38.772380] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-18T17:43:38.924744] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-09-18T17:43:39.215482] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-18T17:43:39.215685] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-18T17:43:39.216080] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-18T17:43:39.216189] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-18T17:43:39.217129] [DEBUG] [LOCAL ] BLW: Trimmed 18852 records to 13018 (keeping 200 days of data) [2025-09-18T17:43:39.305704] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-18T17:43:39.339430] [DEBUG] [LOCAL ] BLW: Primary data saved (13018 records). [2025-09-18T17:43:39.339584] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-18T17:43:39.339704] [INFO ] [MAIN ] Update Progress: 302/2372 symbols completed. BLW took 30.1s. Estimated remaining: 4h 58m 50s. Rate: 6.9 symbols/min [2025-09-18T17:43:39.512030] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:43:39.524711] [DEBUG] [LOCAL ] BME: Loaded 10845 existing records from primary storage. [2025-09-18T17:43:39.524829] [INFO ] [MAIN ] BME: Loaded 10845 existing records. [2025-09-18T17:43:39.700437] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:43:39.700778] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-18T17:43:39.700833] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-18T17:43:39.701516] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-09-18T17:43:39.701578] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-18T17:43:39.724691] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-18T17:43:40.061303] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:43:40.116136] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-18T17:43:40.519539] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-18T17:43:40.777414] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-18T17:43:41.319547] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-18T17:43:41.608990] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-18T17:43:42.119539] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-18T17:43:42.687849] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-18T17:43:42.694970] [INFO ] [REMOTE ] BLND: Full fetch complete (72168 records). [2025-09-18T17:43:42.695095] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-18T17:43:42.924752] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-18T17:43:43.046987] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T17:43:43.107878] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-09-18T17:43:43.107975] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-09-18T17:43:43.108704] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-09-18T17:43:43.108768] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-09-18T17:43:43.110097] [DEBUG] [LOCAL ] BLND: Trimmed 72168 records to 49897 (keeping 200 days of data) [2025-09-18T17:43:43.397004] [DEBUG] [LOCAL ] BLND: Primary data saved (49897 records). [2025-09-18T17:43:43.397151] [INFO ] [MAIN ] BLND: Full history saved. [2025-09-18T17:43:43.397251] [INFO ] [MAIN ] Update Progress: 303/2372 symbols completed. BLND took 51.8s. Estimated remaining: 4h 58m 10s. Rate: 6.9 symbols/min [2025-09-18T17:43:43.565431] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:43:43.593177] [DEBUG] [LOCAL ] BMEZ: Loaded 26163 existing records from primary storage. [2025-09-18T17:43:43.593347] [INFO ] [MAIN ] BMEZ: Loaded 26163 existing records. [2025-09-18T17:43:43.733228] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-18T17:43:43.773820] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:43:43.774015] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-18T17:43:43.774063] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-18T17:43:43.774867] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-18T17:43:43.774927] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-18T17:43:44.130679] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:43:44.181037] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-18T17:43:44.519552] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-18T17:43:44.599367] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-18T17:43:45.319554] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-11. [2025-09-18T17:43:45.914141] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-18T17:43:46.040766] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T17:43:46.119488] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-09-18T17:43:46.919564] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-11. [2025-09-18T17:43:47.007272] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-18T17:43:47.719564] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-18T17:43:47.803802] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-18T17:43:48.519597] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-18T17:43:48.756187] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-18T17:43:49.319524] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-18T17:43:49.388812] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-18T17:43:49.392097] [INFO ] [REMOTE ] BLX: Full fetch complete (22737 records). [2025-09-18T17:43:49.392236] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-18T17:43:49.765382] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-09-18T17:43:49.765462] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-09-18T17:43:49.765837] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-09-18T17:43:49.765899] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-09-18T17:43:49.766558] [DEBUG] [LOCAL ] BLX: Trimmed 22737 records to 16165 (keeping 200 days of data) [2025-09-18T17:43:49.864326] [DEBUG] [LOCAL ] BLX: Primary data saved (16165 records). [2025-09-18T17:43:49.864491] [INFO ] [MAIN ] BLX: Full history saved. [2025-09-18T17:43:49.864585] [INFO ] [MAIN ] Update Progress: 304/2372 symbols completed. BLX took 29.0s. Estimated remaining: 4h 57m 47s. Rate: 6.9 symbols/min [2025-09-18T17:43:50.039987] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:43:50.067939] [DEBUG] [LOCAL ] BMI: Loaded 23942 existing records from primary storage. [2025-09-18T17:43:50.068162] [INFO ] [MAIN ] BMI: Loaded 23942 existing records. [2025-09-18T17:43:50.131779] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-09-18T17:43:50.248823] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:43:50.249097] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-18T17:43:50.249153] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-18T17:43:50.249861] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-09-18T17:43:50.249922] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-18T17:43:50.608874] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:43:50.630157] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-18T17:43:50.771059] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-18T17:43:50.919615] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-18T17:43:51.485539] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-18T17:43:51.719578] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-11. [2025-09-18T17:43:52.519505] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-09-18T17:43:52.686145] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-18T17:43:53.319576] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-18T17:43:53.850144] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T17:43:54.119516] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-09-18T17:43:54.623151] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-18T17:43:54.919583] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-18T17:43:55.048705] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-18T17:43:55.719544] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-18T17:43:55.854480] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-18T17:43:56.519568] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-18T17:43:56.944195] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T17:43:57.110470] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-18T17:43:57.319637] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-18T17:43:58.119614] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-09-18T17:43:58.679843] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-18T17:43:58.685873] [INFO ] [REMOTE ] BMA: Full fetch complete (50711 records). [2025-09-18T17:43:58.685986] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-18T17:43:58.924837] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-18T17:43:59.080159] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-18T17:43:59.080252] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-18T17:43:59.080907] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-18T17:43:59.081000] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-18T17:43:59.082175] [DEBUG] [LOCAL ] BMA: Trimmed 50711 records to 34794 (keeping 200 days of data) [2025-09-18T17:43:59.299984] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-18T17:43:59.316866] [DEBUG] [LOCAL ] BMA: Primary data saved (34794 records). [2025-09-18T17:43:59.317019] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-18T17:43:59.317123] [INFO ] [MAIN ] Update Progress: 305/2372 symbols completed. BMA took 29.5s. Estimated remaining: 4h 57m 44s. Rate: 6.9 symbols/min [2025-09-18T17:43:59.491461] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:43:59.496602] [DEBUG] [LOCAL ] BMN: Loaded 2576 existing records from primary storage. [2025-09-18T17:43:59.496856] [INFO ] [MAIN ] BMN: Loaded 2576 existing records. [2025-09-18T17:43:59.680964] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:43:59.681233] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-18T17:43:59.681283] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-18T17:43:59.681544] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-09-18T17:43:59.681603] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-18T17:43:59.724717] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-09-18T17:44:00.043424] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:44:00.068370] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-18T17:44:00.519521] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-18T17:44:00.575486] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-18T17:44:01.319565] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-11. [2025-09-18T17:44:01.496235] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-18T17:44:01.737766] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-18T17:44:02.119553] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-18T17:44:02.919562] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-18T17:44:02.994951] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-18T17:44:03.719582] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-18T17:44:03.824298] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-18T17:44:04.519596] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-18T17:44:04.548017] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-18T17:44:05.319515] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-18T17:44:05.634275] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-18T17:44:06.119518] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-18T17:44:06.205217] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-18T17:44:06.600143] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-18T17:44:06.919542] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-09-18T17:44:07.299472] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-18T17:44:07.719562] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-18T17:44:08.519541] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-09-18T17:44:08.856929] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-18T17:44:09.046265] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-18T17:44:09.319574] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-18T17:44:10.008764] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-18T17:44:10.119533] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-18T17:44:10.580339] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-18T17:44:10.919552] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-18T17:44:11.507401] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-18T17:44:11.510226] [INFO ] [REMOTE ] BME: Full fetch complete (16191 records). [2025-09-18T17:44:11.510299] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-18T17:44:11.724617] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-18T17:44:11.942353] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-09-18T17:44:11.942440] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-09-18T17:44:11.942809] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-09-18T17:44:11.942876] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-09-18T17:44:11.943547] [DEBUG] [LOCAL ] BME: Trimmed 16191 records to 10989 (keeping 200 days of data) [2025-09-18T17:44:12.020294] [DEBUG] [LOCAL ] BME: Primary data saved (10989 records). [2025-09-18T17:44:12.020551] [INFO ] [MAIN ] BME: Full history saved. [2025-09-18T17:44:12.020761] [INFO ] [MAIN ] Update Progress: 306/2372 symbols completed. BME took 32.7s. Estimated remaining: 4h 58m 2s. Rate: 6.9 symbols/min [2025-09-18T17:44:12.199950] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:44:12.249877] [DEBUG] [LOCAL ] BMO: Loaded 41463 existing records from primary storage. [2025-09-18T17:44:12.250025] [INFO ] [MAIN ] BMO: Loaded 41463 existing records. [2025-09-18T17:44:12.428589] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:44:12.428875] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-18T17:44:12.428938] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-18T17:44:12.430298] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-09-18T17:44:12.430377] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-18T17:44:12.528741] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-18T17:44:12.807117] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:44:12.822580] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-18T17:44:13.114044] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-18T17:44:13.319570] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-11. [2025-09-18T17:44:14.119601] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-18T17:44:14.919521] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-18T17:44:14.973810] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T17:44:15.127902] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-18T17:44:15.282618] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-18T17:44:15.719566] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-09-18T17:44:16.519562] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-18T17:44:17.052866] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T17:44:17.319508] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-18T17:44:17.793519] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-18T17:44:18.119544] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-18T17:44:18.615302] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-18T17:44:18.919628] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-18T17:44:19.206100] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-18T17:44:19.714958] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-18T17:44:19.719714] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-18T17:44:20.519565] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-09-18T17:44:20.667060] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-18T17:44:21.319567] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-18T17:44:21.695179] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-18T17:44:21.821947] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-18T17:44:22.119557] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-18T17:44:22.919564] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-18T17:44:23.014344] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-18T17:44:23.719592] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-18T17:44:24.338525] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-18T17:44:24.365776] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T17:44:24.519538] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-18T17:44:24.948740] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-18T17:44:25.319553] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-18T17:44:25.705322] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-18T17:44:26.119555] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-18T17:44:26.819423] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-18T17:44:26.820525] [INFO ] [REMOTE ] BMN: Full fetch complete (3727 records). [2025-09-18T17:44:26.820620] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-18T17:44:26.927707] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-18T17:44:27.226310] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-09-18T17:44:27.226402] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-09-18T17:44:27.226542] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-09-18T17:44:27.226606] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-09-18T17:44:27.227234] [DEBUG] [LOCAL ] BMN: Trimmed 3727 records to 2590 (keeping 200 days of data) [2025-09-18T17:44:27.244749] [DEBUG] [LOCAL ] BMN: Primary data saved (2590 records). [2025-09-18T17:44:27.244848] [INFO ] [MAIN ] BMN: Full history saved. [2025-09-18T17:44:27.245016] [INFO ] [MAIN ] Update Progress: 307/2372 symbols completed. BMN took 27.9s. Estimated remaining: 4h 58m 38s. Rate: 6.9 symbols/min [2025-09-18T17:44:27.429621] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:44:27.514075] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-09-18T17:44:27.514254] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-09-18T17:44:27.690962] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:44:27.691220] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-18T17:44:27.691281] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-18T17:44:27.693705] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-09-18T17:44:27.693777] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-18T17:44:27.724851] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-18T17:44:28.055485] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:44:28.519517] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-11. [2025-09-18T17:44:28.625218] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-18T17:44:28.974612] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-18T17:44:28.981218] [INFO ] [REMOTE ] BMI: Full fetch complete (32417 records). [2025-09-18T17:44:28.981465] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-18T17:44:29.325606] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-18T17:44:29.446178] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-09-18T17:44:29.446365] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-09-18T17:44:29.447000] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-09-18T17:44:29.447068] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-09-18T17:44:29.448325] [DEBUG] [LOCAL ] BMI: Trimmed 32417 records to 24204 (keeping 200 days of data) [2025-09-18T17:44:29.648703] [DEBUG] [LOCAL ] BMI: Primary data saved (24204 records). [2025-09-18T17:44:29.648909] [INFO ] [MAIN ] BMI: Full history saved. [2025-09-18T17:44:29.649028] [INFO ] [MAIN ] Update Progress: 308/2372 symbols completed. BMI took 39.8s. Estimated remaining: 4h 57m 47s. Rate: 6.9 symbols/min [2025-09-18T17:44:29.839386] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:44:29.913368] [DEBUG] [LOCAL ] BN: Loaded 53015 existing records from primary storage. [2025-09-18T17:44:29.913613] [INFO ] [MAIN ] BN: Loaded 53015 existing records. [2025-09-18T17:44:30.122625] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-18T17:44:30.123076] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:44:30.125596] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-18T17:44:30.125690] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-18T17:44:30.127153] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-18T17:44:30.127220] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-18T17:44:30.517879] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:44:30.551188] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-11 (2.03 seconds). [2025-09-18T17:44:30.640935] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-18T17:44:30.919556] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-09-18T17:44:31.345229] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-18T17:44:31.350869] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40965 records). [2025-09-18T17:44:31.350968] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-18T17:44:31.724580] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-11. [2025-09-18T17:44:31.740732] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-18T17:44:31.740933] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-18T17:44:31.741678] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-18T17:44:31.741750] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-18T17:44:31.744576] [DEBUG] [LOCAL ] BMEZ: Trimmed 40965 records to 26386 (keeping 200 days of data) [2025-09-18T17:44:31.927212] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26386 records). [2025-09-18T17:44:31.927398] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-18T17:44:31.927519] [INFO ] [MAIN ] Update Progress: 309/2372 symbols completed. BMEZ took 48.5s. Estimated remaining: 4h 56m 56s. Rate: 6.9 symbols/min [2025-09-18T17:44:32.096826] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:44:32.128615] [DEBUG] [LOCAL ] BNED: Loaded 30101 existing records from primary storage. [2025-09-18T17:44:32.128831] [INFO ] [MAIN ] BNED: Loaded 30101 existing records. [2025-09-18T17:44:32.311544] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:44:32.313314] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-18T17:44:32.313390] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-18T17:44:32.315053] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-09-18T17:44:32.315114] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-18T17:44:32.525040] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-18T17:44:32.677435] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:44:32.774055] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-18T17:44:33.319694] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-09-18T17:44:33.651394] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-18T17:44:33.730609] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T17:44:34.119553] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-09-18T17:44:34.851887] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-18T17:44:34.919570] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-11. [2025-09-18T17:44:35.719562] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-18T17:44:36.021012] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-18T17:44:36.050536] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-18T17:44:36.519547] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-09-18T17:44:36.777586] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-18T17:44:37.319551] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-09-18T17:44:38.046333] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-18T17:44:38.119553] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-18T17:44:38.430156] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T17:44:38.919542] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-09-18T17:44:39.552221] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T17:44:39.719574] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-18T17:44:40.309013] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-18T17:44:40.519547] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-18T17:44:41.312756] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-18T17:44:41.319485] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-18T17:44:41.362488] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T17:44:42.119545] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-18T17:44:42.259763] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T17:44:42.919546] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-18T17:44:43.407522] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-18T17:44:43.719554] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-18T17:44:44.323338] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T17:44:44.519612] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-18T17:44:45.329981] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-18T17:44:45.354721] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T17:44:45.713514] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-18T17:44:46.119580] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-18T17:44:46.919582] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-18T17:44:47.038797] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-18T17:44:47.174333] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-18T17:44:47.719606] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-18T17:44:48.253755] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T17:44:48.519569] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-18T17:44:49.319581] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-18T17:44:49.531073] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-18T17:44:49.954490] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T17:44:50.119555] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-18T17:44:50.674938] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-18T17:44:50.919592] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-18T17:44:51.719539] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-18T17:44:51.796253] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-18T17:44:52.331239] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-18T17:44:52.519705] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-18T17:44:53.082262] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T17:44:53.319691] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-18T17:44:54.030237] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T17:44:54.036465] [INFO ] [REMOTE ] BMO: Full fetch complete (59920 records). [2025-09-18T17:44:54.036576] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-18T17:44:54.124679] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-18T17:44:54.469752] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-09-18T17:44:54.476982] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-09-18T17:44:54.477995] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-09-18T17:44:54.478177] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-09-18T17:44:54.480003] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-18T17:44:54.488034] [DEBUG] [LOCAL ] BMO: Trimmed 59920 records to 41787 (keeping 200 days of data) [2025-09-18T17:44:54.759416] [DEBUG] [LOCAL ] BMO: Primary data saved (41787 records). [2025-09-18T17:44:54.759593] [INFO ] [MAIN ] BMO: Full history saved. [2025-09-18T17:44:54.759726] [INFO ] [MAIN ] Update Progress: 310/2372 symbols completed. BMO took 42.7s. Estimated remaining: 4h 58m 22s. Rate: 6.9 symbols/min [2025-09-18T17:44:54.926608] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-18T17:44:54.930120] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:44:54.938552] [DEBUG] [LOCAL ] BNH: Loaded 4836 existing records from primary storage. [2025-09-18T17:44:54.938685] [INFO ] [MAIN ] BNH: Loaded 4836 existing records. [2025-09-18T17:44:55.116523] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:44:55.116806] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-18T17:44:55.116864] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-18T17:44:55.117209] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-09-18T17:44:55.117268] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-18T17:44:55.480524] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:44:55.719530] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-11. [2025-09-18T17:44:56.307221] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-18T17:44:56.328195] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-18T17:44:56.436507] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-18T17:44:56.519559] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-18T17:44:57.319605] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-09-18T17:44:57.939571] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-18T17:44:58.119764] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-18T17:44:58.307628] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-18T17:44:58.919618] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-18T17:44:59.607976] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T17:44:59.615252] [INFO ] [REMOTE ] BN: Full fetch complete (76469 records). [2025-09-18T17:44:59.615419] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-18T17:44:59.722894] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-18T17:45:00.061528] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-18T17:45:00.062167] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-18T17:45:00.063057] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-18T17:45:00.064061] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-18T17:45:00.063949] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-18T17:45:00.069982] [DEBUG] [LOCAL ] BN: Trimmed 76469 records to 53396 (keeping 200 days of data) [2025-09-18T17:45:00.069827] [INFO ] [REMOTE ] BNED: Full fetch complete (44265 records). [2025-09-18T17:45:00.070758] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-18T17:45:00.529044] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-09-18T17:45:00.686557] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-09-18T17:45:00.687022] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-09-18T17:45:00.687819] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-09-18T17:45:00.687909] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-09-18T17:45:00.691578] [DEBUG] [LOCAL ] BNED: Trimmed 44265 records to 30247 (keeping 200 days of data) [2025-09-18T17:45:00.988827] [DEBUG] [LOCAL ] BNED: Primary data saved (30247 records). [2025-09-18T17:45:00.990957] [INFO ] [MAIN ] BNED: Full history saved. [2025-09-18T17:45:00.991366] [INFO ] [MAIN ] Update Progress: 311/2372 symbols completed. BNED took 29.1s. Estimated remaining: 4h 57m 57s. Rate: 6.9 symbols/min [2025-09-18T17:45:01.133466] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-18T17:45:01.197908] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:45:01.206182] [DEBUG] [LOCAL ] BN: Primary data saved (53396 records). [2025-09-18T17:45:01.206383] [INFO ] [MAIN ] BN: Full history saved. [2025-09-18T17:45:01.208947] [INFO ] [MAIN ] Update Progress: 312/2372 symbols completed. BN took 31.6s. Estimated remaining: 4h 56m 52s. Rate: 6.9 symbols/min [2025-09-18T17:45:01.217449] [DEBUG] [LOCAL ] BNJ: Loaded 2629 existing records from primary storage. [2025-09-18T17:45:01.257220] [INFO ] [MAIN ] BNJ: Loaded 2629 existing records. [2025-09-18T17:45:01.336888] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-18T17:45:01.554083] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:45:01.625400] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:45:01.626439] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-18T17:45:01.626810] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-18T17:45:01.627405] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-18T17:45:01.627630] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-18T17:45:01.979699] [DEBUG] [LOCAL ] BNL: Loaded 46963 existing records from primary storage. [2025-09-18T17:45:01.985114] [INFO ] [MAIN ] BNL: Loaded 46963 existing records. [2025-09-18T17:45:02.138305] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-18T17:45:02.163496] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-18T17:45:02.212517] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:45:02.318051] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-18T17:45:02.322784] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:45:02.334518] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-18T17:45:02.334578] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-18T17:45:02.335664] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-18T17:45:02.335730] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-18T17:45:02.689749] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:45:02.815340] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-18T17:45:02.919511] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-18T17:45:03.507400] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-18T17:45:03.719596] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-18T17:45:04.519561] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-11. [2025-09-18T17:45:05.319604] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-11. [2025-09-18T17:45:05.721596] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-18T17:45:05.794588] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-18T17:45:06.095224] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-18T17:45:06.119570] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-09-18T17:45:06.919600] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-18T17:45:07.615661] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-18T17:45:07.653256] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-18T17:45:07.719558] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-09-18T17:45:08.519592] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-18T17:45:08.785605] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-18T17:45:09.319578] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-09-18T17:45:09.366350] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-18T17:45:09.374167] [INFO ] [REMOTE ] BMY: Full fetch complete (77648 records). [2025-09-18T17:45:09.374321] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-18T17:45:09.785831] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-09-18T17:45:09.785926] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-09-18T17:45:09.786739] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-09-18T17:45:09.786815] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-09-18T17:45:09.788803] [DEBUG] [LOCAL ] BMY: Trimmed 77648 records to 54147 (keeping 200 days of data) [2025-09-18T17:45:10.118914] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-18T17:45:10.119610] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-18T17:45:10.149912] [DEBUG] [LOCAL ] BMY: Primary data saved (54147 records). [2025-09-18T17:45:10.150053] [INFO ] [MAIN ] BMY: Full history saved. [2025-09-18T17:45:10.150144] [INFO ] [MAIN ] Update Progress: 313/2372 symbols completed. BMY took 42.9s. Estimated remaining: 4h 56m 46s. Rate: 6.9 symbols/min [2025-09-18T17:45:10.341686] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:45:10.394604] [DEBUG] [LOCAL ] BNS: Loaded 51515 existing records from primary storage. [2025-09-18T17:45:10.394788] [INFO ] [MAIN ] BNS: Loaded 51515 existing records. [2025-09-18T17:45:10.590843] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:45:10.591125] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-18T17:45:10.591178] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-18T17:45:10.592327] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-09-18T17:45:10.592393] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-18T17:45:10.924779] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-09-18T17:45:10.990768] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:45:11.706620] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-18T17:45:11.724620] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-11. [2025-09-18T17:45:11.739595] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-18T17:45:12.519602] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-18T17:45:12.929370] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-18T17:45:13.319543] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-18T17:45:13.520622] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-18T17:45:13.658906] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-18T17:45:14.119529] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-09-18T17:45:14.919553] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-18T17:45:15.719597] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-18T17:45:15.876687] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-18T17:45:16.222386] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-18T17:45:16.471960] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-18T17:45:16.519508] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-18T17:45:17.319571] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-09-18T17:45:18.119555] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-18T17:45:18.246120] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-18T17:45:18.558177] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-18T17:45:18.706130] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-18T17:45:18.919591] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-18T17:45:19.719604] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-18T17:45:20.246390] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T17:45:20.519549] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-18T17:45:20.854762] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-18T17:45:21.319561] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-18T17:45:21.350824] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-18T17:45:21.911537] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-18T17:45:22.119535] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-18T17:45:22.608109] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-18T17:45:22.609351] [INFO ] [REMOTE ] BNH: Full fetch complete (6787 records). [2025-09-18T17:45:22.609426] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-18T17:45:22.924670] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-18T17:45:22.981424] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-09-18T17:45:22.981508] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-09-18T17:45:22.981727] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-09-18T17:45:22.981804] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-09-18T17:45:22.982343] [DEBUG] [LOCAL ] BNH: Trimmed 6787 records to 4853 (keeping 200 days of data) [2025-09-18T17:45:23.012683] [DEBUG] [LOCAL ] BNH: Primary data saved (4853 records). [2025-09-18T17:45:23.012831] [INFO ] [MAIN ] BNH: Full history saved. [2025-09-18T17:45:23.012919] [INFO ] [MAIN ] Update Progress: 314/2372 symbols completed. BNH took 28.3s. Estimated remaining: 4h 57m 5s. Rate: 6.9 symbols/min [2025-09-18T17:45:23.197803] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:45:23.202858] [DEBUG] [LOCAL ] BNT: Loaded 3356 existing records from primary storage. [2025-09-18T17:45:23.202959] [INFO ] [MAIN ] BNT: Loaded 3356 existing records. [2025-09-18T17:45:23.310859] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-18T17:45:23.391208] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:45:23.391482] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-18T17:45:23.391531] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-18T17:45:23.391787] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-18T17:45:23.391862] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-18T17:45:23.724718] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-18T17:45:23.770740] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:45:24.519571] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-18T17:45:25.319571] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-18T17:45:25.460268] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-18T17:45:25.652232] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-18T17:45:25.883348] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-18T17:45:26.119506] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-18T17:45:26.919546] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-18T17:45:27.315430] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-18T17:45:27.479586] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T17:45:27.719589] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-18T17:45:28.519540] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-09-18T17:45:29.319606] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-11. [2025-09-18T17:45:29.547084] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-18T17:45:29.659700] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T17:45:29.756690] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-18T17:45:30.119561] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-18T17:45:30.919575] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-18T17:45:31.365008] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-18T17:45:31.711435] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-18T17:45:31.721831] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-18T17:45:32.274851] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-18T17:45:32.276321] [INFO ] [REMOTE ] BNJ: Full fetch complete (4432 records). [2025-09-18T17:45:32.276406] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-18T17:45:32.525276] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-09-18T17:45:32.644237] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-18T17:45:32.644321] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-18T17:45:32.644469] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-18T17:45:32.644506] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-18T17:45:32.644901] [DEBUG] [LOCAL ] BNJ: Trimmed 4432 records to 2643 (keeping 200 days of data) [2025-09-18T17:45:32.662138] [DEBUG] [LOCAL ] BNJ: Primary data saved (2643 records). [2025-09-18T17:45:32.662254] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-18T17:45:32.662342] [INFO ] [MAIN ] Update Progress: 315/2372 symbols completed. BNJ took 31.7s. Estimated remaining: 4h 57m 2s. Rate: 6.9 symbols/min [2025-09-18T17:45:32.829743] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:45:32.838928] [DEBUG] [LOCAL ] BNY: Loaded 7432 existing records from primary storage. [2025-09-18T17:45:32.839044] [INFO ] [MAIN ] BNY: Loaded 7432 existing records. [2025-09-18T17:45:33.024935] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:45:33.025249] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-18T17:45:33.025329] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-18T17:45:33.025636] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-18T17:45:33.025733] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-18T17:45:33.122010] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-18T17:45:33.324702] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-09-18T17:45:33.389558] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:45:33.845330] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-18T17:45:34.119563] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-18T17:45:34.596396] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-18T17:45:34.919565] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-09-18T17:45:35.719546] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-18T17:45:36.512906] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-18T17:45:36.519519] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-18T17:45:36.520855] [INFO ] [REMOTE ] BNL: Full fetch complete (66461 records). [2025-09-18T17:45:36.520944] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-09-18T17:45:36.920955] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-09-18T17:45:36.921088] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-09-18T17:45:36.921829] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-09-18T17:45:36.921894] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-09-18T17:45:36.923499] [DEBUG] [LOCAL ] BNL: Trimmed 66461 records to 47287 (keeping 200 days of data) [2025-09-18T17:45:37.211989] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-18T17:45:37.226120] [DEBUG] [LOCAL ] BNL: Primary data saved (47287 records). [2025-09-18T17:45:37.226320] [INFO ] [MAIN ] BNL: Full history saved. [2025-09-18T17:45:37.227197] [INFO ] [MAIN ] Update Progress: 316/2372 symbols completed. BNL took 36.0s. Estimated remaining: 4h 56m 27s. Rate: 6.9 symbols/min [2025-09-18T17:45:37.322828] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-11. [2025-09-18T17:45:37.467900] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:45:37.471471] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-18T17:45:37.499385] [DEBUG] [LOCAL ] BOC: Loaded 18429 existing records from primary storage. [2025-09-18T17:45:37.499527] [INFO ] [MAIN ] BOC: Loaded 18429 existing records. [2025-09-18T17:45:37.675330] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:45:37.675598] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-18T17:45:37.675670] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-18T17:45:37.676159] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-09-18T17:45:37.676218] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-18T17:45:38.059297] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:45:38.119510] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-18T17:45:38.289081] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-18T17:45:38.520468] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-18T17:45:38.919573] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-11. [2025-09-18T17:45:39.719521] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-18T17:45:40.022435] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-18T17:45:40.519549] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-09-18T17:45:41.010178] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-18T17:45:41.237362] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-18T17:45:41.319530] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-18T17:45:41.830012] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-18T17:45:42.119541] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-09-18T17:45:42.530976] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-18T17:45:42.919586] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-18T17:45:43.540082] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-18T17:45:43.719599] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-18T17:45:44.473782] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-18T17:45:44.519528] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-18T17:45:44.966943] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-18T17:45:45.319576] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-09-18T17:45:46.119524] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-18T17:45:46.357635] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-18T17:45:46.538940] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-18T17:45:46.919561] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-18T17:45:47.358814] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-18T17:45:47.719563] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-18T17:45:48.143379] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-18T17:45:48.519566] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-09-18T17:45:49.274959] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-18T17:45:49.319513] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-18T17:45:50.119506] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-18T17:45:50.173751] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-18T17:45:50.820638] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-18T17:45:50.919552] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-18T17:45:51.354280] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-18T17:45:51.719540] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-18T17:45:52.281339] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-18T17:45:52.282637] [INFO ] [REMOTE ] BNT: Full fetch complete (4434 records). [2025-09-18T17:45:52.282735] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-18T17:45:52.524760] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-18T17:45:52.672283] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-18T17:45:52.672381] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-18T17:45:52.672550] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-18T17:45:52.672605] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-18T17:45:52.673089] [DEBUG] [LOCAL ] BNT: Trimmed 4434 records to 3411 (keeping 200 days of data) [2025-09-18T17:45:52.695304] [DEBUG] [LOCAL ] BNT: Primary data saved (3411 records). [2025-09-18T17:45:52.695403] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-18T17:45:52.695508] [INFO ] [MAIN ] Update Progress: 317/2372 symbols completed. BNT took 29.7s. Estimated remaining: 4h 57m 3s. Rate: 6.9 symbols/min [2025-09-18T17:45:53.100498] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-18T17:45:53.319584] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-18T17:45:54.120234] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-18T17:45:54.126714] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-18T17:45:54.919620] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-18T17:45:55.719602] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-18T17:45:55.963455] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-18T17:45:56.021190] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-18T17:45:56.228299] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-18T17:45:56.519584] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-18T17:45:57.319592] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-18T17:45:58.119595] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-18T17:45:58.303357] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-18T17:45:58.305499] [INFO ] [REMOTE ] BNY: Full fetch complete (10604 records). [2025-09-18T17:45:58.305688] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-18T17:45:58.440789] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-18T17:45:58.459149] [INFO ] [REMOTE ] BNS: Full fetch complete (74071 records). [2025-09-18T17:45:58.469584] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-18T17:45:58.995999] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-18T17:45:58.998933] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-18T17:45:58.999308] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-18T17:45:59.012037] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-18T17:45:59.077967] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-18T17:45:59.059868] [DEBUG] [LOCAL ] BNY: Trimmed 10604 records to 7463 (keeping 200 days of data) [2025-09-18T17:45:59.093170] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-18T17:45:59.200948] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-09-18T17:45:59.203725] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-09-18T17:45:59.204485] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-09-18T17:45:59.204907] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-09-18T17:45:59.213968] [DEBUG] [LOCAL ] BNY: Primary data saved (7463 records). [2025-09-18T17:45:59.214202] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-18T17:45:59.214453] [INFO ] [MAIN ] Update Progress: 318/2372 symbols completed. BNY took 26.6s. Estimated remaining: 4h 56m 40s. Rate: 6.9 symbols/min [2025-09-18T17:45:59.215209] [DEBUG] [LOCAL ] BNS: Trimmed 74071 records to 51882 (keeping 200 days of data) [2025-09-18T17:45:59.542045] [DEBUG] [LOCAL ] BNS: Primary data saved (51882 records). [2025-09-18T17:45:59.542205] [INFO ] [MAIN ] BNS: Full history saved. [2025-09-18T17:45:59.543024] [INFO ] [MAIN ] Update Progress: 319/2372 symbols completed. BNS took 49.4s. Estimated remaining: 4h 55m 38s. Rate: 6.9 symbols/min [2025-09-18T17:45:59.794121] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-18T17:45:59.798107] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-18T17:46:00.656444] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-18T17:46:00.661052] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-18T17:46:01.387425] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-18T17:46:01.392460] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-18T17:46:02.408496] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-18T17:46:02.412203] [INFO ] [REMOTE ] BOC: Full fetch complete (25764 records). [2025-09-18T17:46:02.412369] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-18T17:46:02.810535] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-09-18T17:46:02.810621] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-09-18T17:46:02.811114] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-09-18T17:46:02.811175] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-09-18T17:46:02.812032] [DEBUG] [LOCAL ] BOC: Trimmed 25764 records to 18551 (keeping 200 days of data) [2025-09-18T17:46:02.933004] [DEBUG] [LOCAL ] BOC: Primary data saved (18551 records). [2025-09-18T17:46:02.933173] [INFO ] [MAIN ] BOC: Full history saved. [2025-09-18T17:46:02.933313] [INFO ] [MAIN ] Update Progress: 320/2372 symbols completed. BOC took 25.7s. Estimated remaining: 4h 54m 55s. Rate: 7.0 symbols/min [2025-09-18T17:46:03.601750] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:46:03.607818] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:46:03.703771] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:46:03.751600] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:46:03.767799] [DEBUG] [LOCAL ] BOE: Loaded 17634 existing records from primary storage. [2025-09-18T17:46:03.767965] [INFO ] [MAIN ] BOE: Loaded 17634 existing records. [2025-09-18T17:46:04.022972] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:46:04.036022] [DEBUG] [LOCAL ] BOH: Loaded 31444 existing records from primary storage. [2025-09-18T17:46:04.037509] [INFO ] [MAIN ] BOH: Loaded 31444 existing records. [2025-09-18T17:46:04.038317] [DEBUG] [LOCAL ] BOOT: Loaded 41430 existing records from primary storage. [2025-09-18T17:46:04.037190] [DEBUG] [LOCAL ] BOND: Loaded 32173 existing records from primary storage. [2025-09-18T17:46:04.065627] [INFO ] [MAIN ] BOOT: Loaded 41430 existing records. [2025-09-18T17:46:04.076590] [INFO ] [MAIN ] BOND: Loaded 32173 existing records. [2025-09-18T17:46:04.081893] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-18T17:46:04.176063] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-18T17:46:04.268871] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-09-18T17:46:04.303486] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-18T17:46:04.536553] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:46:04.630329] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-18T17:46:04.740622] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-18T17:46:04.757474] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:46:04.780180] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:46:04.791005] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-18T17:46:04.801636] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-18T17:46:04.827058] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-18T17:46:04.832348] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-18T17:46:04.838534] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-18T17:46:04.827165] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-18T17:46:04.925537] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-18T17:46:04.925465] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-18T17:46:05.009146] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-18T17:46:05.025987] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-18T17:46:05.575097] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:46:05.625079] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-11. [2025-09-18T17:46:06.115279] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:46:06.138242] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-11. [2025-09-18T17:46:06.320603] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:46:06.341549] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-11. [2025-09-18T17:46:06.341303] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:46:06.342601] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-11. [2025-09-18T17:46:06.999344] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-18T17:46:07.004487] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-09-18T17:46:07.177391] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-18T17:46:07.184151] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-09-18T17:46:07.317191] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-18T17:46:07.324290] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-09-18T17:46:07.696374] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-18T17:46:07.719525] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-09-18T17:46:07.875096] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-18T17:46:08.035379] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-18T17:46:08.210602] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-18T17:46:08.457069] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-18T17:46:08.519540] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-09-18T17:46:09.319573] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-09-18T17:46:10.024550] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-18T17:46:10.119547] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-18T17:46:10.408670] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-18T17:46:10.919591] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-18T17:46:11.095758] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-18T17:46:11.719587] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-09-18T17:46:11.927325] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T17:46:12.519629] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-18T17:46:12.751221] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-18T17:46:13.190009] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-18T17:46:13.319624] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-18T17:46:14.119616] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-09-18T17:46:14.649278] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-18T17:46:14.919633] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-18T17:46:15.469571] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-18T17:46:15.719551] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-18T17:46:15.963816] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-18T17:46:16.519559] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-18T17:46:17.156752] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-18T17:46:17.319636] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-18T17:46:17.821130] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-18T17:46:18.119594] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-18T17:46:18.804878] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-18T17:46:18.919577] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-18T17:46:19.269296] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-18T17:46:19.719602] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-18T17:46:20.251587] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-18T17:46:20.519578] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-18T17:46:21.104682] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T17:46:21.319543] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-18T17:46:21.815032] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-18T17:46:22.119603] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-18T17:46:22.280890] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-18T17:46:22.919549] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-18T17:46:22.960891] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-18T17:46:23.719618] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-18T17:46:23.971104] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-18T17:46:24.519609] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-18T17:46:24.853415] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-18T17:46:25.324665] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-18T17:46:25.332627] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-18T17:46:26.119601] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-18T17:46:26.829945] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T17:46:26.835498] [INFO ] [REMOTE ] BOND: Full fetch complete (46159 records). [2025-09-18T17:46:26.835662] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-18T17:46:26.924791] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-18T17:46:27.275024] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-18T17:46:27.275217] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-18T17:46:27.276883] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-18T17:46:27.277003] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-18T17:46:27.282736] [DEBUG] [LOCAL ] BOND: Trimmed 46159 records to 32453 (keeping 200 days of data) [2025-09-18T17:46:27.502231] [DEBUG] [LOCAL ] BOND: Primary data saved (32453 records). [2025-09-18T17:46:27.502374] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-18T17:46:27.502629] [INFO ] [MAIN ] Update Progress: 321/2372 symbols completed. BOND took 24.6s. Estimated remaining: 4h 56m 29s. Rate: 6.9 symbols/min [2025-09-18T17:46:27.691664] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:46:27.703802] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-18T17:46:27.719501] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-18T17:46:27.768104] [DEBUG] [LOCAL ] BORR: Loaded 51196 existing records from primary storage. [2025-09-18T17:46:27.768248] [INFO ] [MAIN ] BORR: Loaded 51196 existing records. [2025-09-18T17:46:27.963289] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:46:27.963919] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-18T17:46:27.964166] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-18T17:46:27.987434] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-09-18T17:46:27.990334] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-18T17:46:27.999826] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-18T17:46:28.388930] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:46:28.441833] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-18T17:46:28.519521] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-11. [2025-09-18T17:46:29.319561] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-18T17:46:30.119707] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-18T17:46:30.286442] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-18T17:46:30.612526] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-18T17:46:30.919557] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-18T17:46:31.240844] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T17:46:31.244240] [INFO ] [REMOTE ] BOE: Full fetch complete (26795 records). [2025-09-18T17:46:31.244314] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-18T17:46:31.612618] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-09-18T17:46:31.612726] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-09-18T17:46:31.613138] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-09-18T17:46:31.613181] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-09-18T17:46:31.613894] [DEBUG] [LOCAL ] BOE: Trimmed 26795 records to 17840 (keeping 200 days of data) [2025-09-18T17:46:31.719693] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-09-18T17:46:31.740356] [DEBUG] [LOCAL ] BOE: Primary data saved (17840 records). [2025-09-18T17:46:31.740463] [INFO ] [MAIN ] BOE: Full history saved. [2025-09-18T17:46:31.740588] [INFO ] [MAIN ] Update Progress: 322/2372 symbols completed. BOE took 28.8s. Estimated remaining: 4h 55m 52s. Rate: 6.9 symbols/min [2025-09-18T17:46:31.916923] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:46:31.943544] [DEBUG] [LOCAL ] BOW: Loaded 23746 existing records from primary storage. [2025-09-18T17:46:31.943695] [INFO ] [MAIN ] BOW: Loaded 23746 existing records. [2025-09-18T17:46:32.125031] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:46:32.125279] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-18T17:46:32.125378] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-18T17:46:32.126189] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-09-18T17:46:32.126249] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-18T17:46:32.494162] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:46:32.520582] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-11. [2025-09-18T17:46:32.524247] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-18T17:46:33.256371] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-18T17:46:33.319583] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-18T17:46:33.377620] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-18T17:46:34.119562] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-09-18T17:46:34.444137] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-18T17:46:34.911243] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-18T17:46:34.919479] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-09-18T17:46:35.719538] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-18T17:46:35.867394] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T17:46:36.519517] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-18T17:46:36.698273] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-18T17:46:37.092959] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-18T17:46:37.319573] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-18T17:46:38.119601] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-18T17:46:38.665472] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-18T17:46:38.919530] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-18T17:46:39.427978] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-18T17:46:39.719531] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-09-18T17:46:40.018871] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-18T17:46:40.519556] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-18T17:46:41.199392] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-18T17:46:41.319587] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-18T17:46:41.659012] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T17:46:42.119554] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-18T17:46:42.919567] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-18T17:46:43.044325] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-18T17:46:43.219681] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-18T17:46:43.719549] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-18T17:46:43.823243] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-18T17:46:43.827938] [INFO ] [REMOTE ] BOH: Full fetch complete (44591 records). [2025-09-18T17:46:43.828086] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-18T17:46:44.218478] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-09-18T17:46:44.218578] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-09-18T17:46:44.219168] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-09-18T17:46:44.219235] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-09-18T17:46:44.220531] [DEBUG] [LOCAL ] BOH: Trimmed 44591 records to 31739 (keeping 200 days of data) [2025-09-18T17:46:44.431745] [DEBUG] [LOCAL ] BOH: Primary data saved (31739 records). [2025-09-18T17:46:44.431892] [INFO ] [MAIN ] BOH: Full history saved. [2025-09-18T17:46:44.432020] [INFO ] [MAIN ] Update Progress: 323/2372 symbols completed. BOH took 41.5s. Estimated remaining: 4h 56m 9s. Rate: 6.9 symbols/min [2025-09-18T17:46:44.529355] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-18T17:46:44.609762] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:46:44.664338] [DEBUG] [LOCAL ] BOX: Loaded 50373 existing records from primary storage. [2025-09-18T17:46:44.664802] [INFO ] [MAIN ] BOX: Loaded 50373 existing records. [2025-09-18T17:46:44.842383] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:46:44.842862] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-18T17:46:44.842923] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-18T17:46:44.844707] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-18T17:46:44.844769] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-18T17:46:45.201254] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:46:45.215183] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-18T17:46:45.220462] [INFO ] [REMOTE ] BOOT: Full fetch complete (60357 records). [2025-09-18T17:46:45.220582] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-18T17:46:45.323732] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-18T17:46:45.612514] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-18T17:46:45.612614] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-18T17:46:45.613277] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-18T17:46:45.613340] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-18T17:46:45.614596] [DEBUG] [LOCAL ] BOOT: Trimmed 60357 records to 41664 (keeping 200 days of data) [2025-09-18T17:46:45.758601] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-18T17:46:45.902538] [DEBUG] [LOCAL ] BOOT: Primary data saved (41664 records). [2025-09-18T17:46:45.902699] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-18T17:46:45.902808] [INFO ] [MAIN ] Update Progress: 324/2372 symbols completed. BOOT took 43.0s. Estimated remaining: 4h 55m 14s. Rate: 6.9 symbols/min [2025-09-18T17:46:46.078636] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:46:46.078864] [DEBUG] [LOCAL ] BP: No existing data file found in primary storage. [2025-09-18T17:46:46.078919] [WARN ] [MAIN ] BP: No existing data found, performing full refresh instead. [2025-09-18T17:46:46.079083] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-18T17:46:46.079147] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-18T17:46:46.079208] [DEBUG] [LOCAL ] BP: No primary data file found to delete. [2025-09-18T17:46:46.079283] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-18T17:46:46.124695] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-18T17:46:46.445815] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:46:46.919561] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-11. [2025-09-18T17:46:47.318403] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-18T17:46:47.430320] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-18T17:46:47.719613] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-18T17:46:48.378902] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-18T17:46:48.519527] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-18T17:46:48.572016] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T17:46:49.173804] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-18T17:46:49.319566] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-18T17:46:50.119554] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-11. [2025-09-18T17:46:50.360285] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-18T17:46:50.919553] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-09-18T17:46:51.719594] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-18T17:46:52.114590] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-18T17:46:52.519556] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-09-18T17:46:52.685861] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-18T17:46:53.183246] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T17:46:53.319549] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-09-18T17:46:54.119607] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-18T17:46:54.324018] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-18T17:46:54.530870] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-18T17:46:54.919550] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-09-18T17:46:55.719612] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-18T17:46:55.916897] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-18T17:46:56.519511] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-18T17:46:56.606109] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-18T17:46:56.960562] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-18T17:46:57.319574] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-18T17:46:57.962450] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-18T17:46:57.966169] [INFO ] [REMOTE ] BOW: Full fetch complete (31070 records). [2025-09-18T17:46:57.966254] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-18T17:46:58.123003] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-18T17:46:58.352075] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-09-18T17:46:58.352171] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-09-18T17:46:58.352633] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-09-18T17:46:58.352743] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-09-18T17:46:58.353923] [DEBUG] [LOCAL ] BOW: Trimmed 31070 records to 23934 (keeping 200 days of data) [2025-09-18T17:46:58.499405] [DEBUG] [LOCAL ] BOW: Primary data saved (23934 records). [2025-09-18T17:46:58.499562] [INFO ] [MAIN ] BOW: Full history saved. [2025-09-18T17:46:58.499675] [INFO ] [MAIN ] Update Progress: 325/2372 symbols completed. BOW took 26.8s. Estimated remaining: 4h 55m 31s. Rate: 6.9 symbols/min [2025-09-18T17:46:58.689142] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:46:58.728544] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-18T17:46:58.762512] [DEBUG] [LOCAL ] BR: Loaded 34774 existing records from primary storage. [2025-09-18T17:46:58.762680] [INFO ] [MAIN ] BR: Loaded 34774 existing records. [2025-09-18T17:46:58.924676] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-18T17:46:58.960913] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:46:58.961198] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-18T17:46:58.961267] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-18T17:46:58.962362] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-09-18T17:46:58.962440] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-18T17:46:59.364126] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:46:59.566939] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-18T17:46:59.719560] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-11. [2025-09-18T17:47:00.519601] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-18T17:47:00.759033] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-18T17:47:00.862062] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-18T17:47:01.319559] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-09-18T17:47:02.119562] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-18T17:47:02.372308] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T17:47:02.545253] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-18T17:47:02.919580] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-18T17:47:03.714044] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T17:47:03.725638] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-09-18T17:47:04.519590] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-18T17:47:04.800980] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-18T17:47:05.151373] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-18T17:47:05.319615] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-18T17:47:06.019545] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-18T17:47:06.032041] [INFO ] [REMOTE ] BORR: Full fetch complete (74676 records). [2025-09-18T17:47:06.032324] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-18T17:47:06.124940] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-18T17:47:06.516622] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-09-18T17:47:06.516748] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-09-18T17:47:06.517522] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-09-18T17:47:06.517569] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-09-18T17:47:06.519219] [DEBUG] [LOCAL ] BORR: Trimmed 74676 records to 51586 (keeping 200 days of data) [2025-09-18T17:47:06.823189] [DEBUG] [LOCAL ] BORR: Primary data saved (51586 records). [2025-09-18T17:47:06.823373] [INFO ] [MAIN ] BORR: Full history saved. [2025-09-18T17:47:06.823488] [INFO ] [MAIN ] Update Progress: 326/2372 symbols completed. BORR took 39.3s. Estimated remaining: 4h 55m 20s. Rate: 6.9 symbols/min [2025-09-18T17:47:06.925368] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-18T17:47:06.998299] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:47:07.049406] [DEBUG] [LOCAL ] BRBR: Loaded 51205 existing records from primary storage. [2025-09-18T17:47:07.049600] [INFO ] [MAIN ] BRBR: Loaded 51205 existing records. [2025-09-18T17:47:07.229495] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:47:07.229830] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-18T17:47:07.229882] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-18T17:47:07.231180] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-18T17:47:07.231242] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-18T17:47:07.632961] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:47:07.681619] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-18T17:47:07.682604] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-18T17:47:07.719490] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-18T17:47:08.240728] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-18T17:47:08.519568] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-18T17:47:09.319554] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-18T17:47:09.641542] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-18T17:47:09.722301] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-18T17:47:10.119551] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-18T17:47:10.804853] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T17:47:10.919501] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-18T17:47:11.719532] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-11. [2025-09-18T17:47:11.800444] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-18T17:47:12.335500] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-18T17:47:12.519547] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-18T17:47:13.172680] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-18T17:47:13.319622] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-18T17:47:14.119587] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-18T17:47:14.737917] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-18T17:47:14.818391] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-18T17:47:14.919548] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-18T17:47:15.468679] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-18T17:47:15.719550] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-18T17:47:16.002841] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-18T17:47:16.519614] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-18T17:47:17.293541] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-18T17:47:17.319495] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-18T17:47:17.952606] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T17:47:18.119561] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-18T17:47:18.812460] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T17:47:18.819773] [INFO ] [REMOTE ] BOX: Full fetch complete (72018 records). [2025-09-18T17:47:18.819904] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-18T17:47:18.922749] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-18T17:47:19.232995] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-18T17:47:19.233251] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-18T17:47:19.234362] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-18T17:47:19.234587] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-18T17:47:19.236828] [DEBUG] [LOCAL ] BOX: Trimmed 72018 records to 50755 (keeping 200 days of data) [2025-09-18T17:47:19.361063] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T17:47:19.591562] [DEBUG] [LOCAL ] BOX: Primary data saved (50755 records). [2025-09-18T17:47:19.591782] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-18T17:47:19.591918] [INFO ] [MAIN ] Update Progress: 327/2372 symbols completed. BOX took 35.2s. Estimated remaining: 4h 55m 37s. Rate: 6.9 symbols/min [2025-09-18T17:47:19.724710] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-18T17:47:19.784088] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:47:19.784312] [DEBUG] [LOCAL ] BRC: No existing data file found in primary storage. [2025-09-18T17:47:19.784364] [WARN ] [MAIN ] BRC: No existing data found, performing full refresh instead. [2025-09-18T17:47:19.784593] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-18T17:47:19.784689] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-18T17:47:19.784777] [DEBUG] [LOCAL ] BRC: No primary data file found to delete. [2025-09-18T17:47:19.784833] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-18T17:47:20.160840] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:47:20.519543] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-11. [2025-09-18T17:47:20.962525] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-18T17:47:21.006264] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-18T17:47:21.011114] [INFO ] [REMOTE ] BR: Full fetch complete (48374 records). [2025-09-18T17:47:21.011219] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-18T17:47:21.011826] [FATAL] [VALIDATOR ] BR: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:47:21.011915] [FATAL] [MAIN ] BR: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:47:21.011977] [WARN ] [MAIN ] BR: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:47:21.012056] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-18T17:47:21.012175] [DEBUG] [LOCAL ] BR: No primary data file found to delete. [2025-09-18T17:47:21.012235] [INFO ] [LOCAL ] BR: Starting deletion of derivative data. [2025-09-18T17:47:21.012737] [DEBUG] [LOCAL ] BR: Deleted derivative data file. [2025-09-18T17:47:21.012837] [INFO ] [MAIN ] Update Progress: 328/2372 symbols completed. BR took 22.5s. Estimated remaining: 4h 54m 43s. Rate: 6.9 symbols/min [2025-09-18T17:47:21.191983] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:47:21.234315] [DEBUG] [LOCAL ] BRCC: Loaded 40428 existing records from primary storage. [2025-09-18T17:47:21.234465] [INFO ] [MAIN ] BRCC: Loaded 40428 existing records. [2025-09-18T17:47:21.327142] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-18T17:47:21.421906] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:47:21.422135] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-18T17:47:21.422182] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-18T17:47:21.423463] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-09-18T17:47:21.423523] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-18T17:47:21.775807] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:47:21.801322] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-18T17:47:22.119542] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-11. [2025-09-18T17:47:22.919608] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-09-18T17:47:23.215069] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-18T17:47:23.720687] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-18T17:47:23.731485] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-18T17:47:23.789200] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-18T17:47:24.519605] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-09-18T17:47:25.319556] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-09-18T17:47:25.845960] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T17:47:26.024883] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-18T17:47:26.117929] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-18T17:47:26.124921] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-09-18T17:47:26.126719] [INFO ] [REMOTE ] BP: Full fetch complete (77650 records). [2025-09-18T17:47:26.126825] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-18T17:47:26.572624] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-09-18T17:47:26.572746] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-09-18T17:47:26.573539] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-09-18T17:47:26.573617] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-09-18T17:47:26.575663] [DEBUG] [LOCAL ] BP: Trimmed 77650 records to 54101 (keeping 200 days of data) [2025-09-18T17:47:26.910076] [DEBUG] [LOCAL ] BP: Primary data saved (54101 records). [2025-09-18T17:47:26.910236] [INFO ] [MAIN ] BP: Full history saved. [2025-09-18T17:47:26.910319] [INFO ] [MAIN ] Update Progress: 329/2372 symbols completed. BP took 41.0s. Estimated remaining: 4h 54m 17s. Rate: 6.9 symbols/min [2025-09-18T17:47:26.924748] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-09-18T17:47:27.097824] [INFO ] [MAIN ] BRFS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:47:27.098039] [DEBUG] [LOCAL ] BRFS: No existing data file found in primary storage. [2025-09-18T17:47:27.098095] [WARN ] [MAIN ] BRFS: No existing data found, performing full refresh instead. [2025-09-18T17:47:27.098249] [INFO ] [MAIN ] BRFS: Wiping existing primary data before full refresh. [2025-09-18T17:47:27.098291] [INFO ] [LOCAL ] BRFS: Starting deletion of primary data. [2025-09-18T17:47:27.098333] [DEBUG] [LOCAL ] BRFS: No primary data file found to delete. [2025-09-18T17:47:27.098366] [INFO ] [MAIN ] BRFS: Starting full primary refresh. [2025-09-18T17:47:27.504197] [INFO ] [REMOTE ] BRFS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:47:27.561970] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-18T17:47:27.719498] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-09-18T17:47:28.209048] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-18T17:47:28.519540] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-18T17:47:29.310697] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-18T17:47:29.320108] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2024-11. [2025-09-18T17:47:29.494585] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-18T17:47:30.119547] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-18T17:47:30.891036] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-18T17:47:30.919499] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2024-12. [2025-09-18T17:47:31.406294] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-18T17:47:31.719545] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-18T17:47:32.094446] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-18T17:47:32.519570] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-18T17:47:32.898619] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-18T17:47:33.319552] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-01. [2025-09-18T17:47:33.767679] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T17:47:34.119583] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-18T17:47:34.388791] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-18T17:47:34.919549] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-18T17:47:35.339390] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-18T17:47:35.719546] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-02. [2025-09-18T17:47:36.036750] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-18T17:47:36.519544] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-18T17:47:36.728245] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T17:47:37.319549] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-18T17:47:37.877375] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-18T17:47:38.119544] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-18T17:47:38.442510] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-18T17:47:38.919604] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-03. [2025-09-18T17:47:39.719573] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-18T17:47:39.749056] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-18T17:47:40.428981] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T17:47:40.519517] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-04. [2025-09-18T17:47:40.591969] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-18T17:47:41.319566] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-18T17:47:41.999280] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-18T17:47:42.119584] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-18T17:47:42.882792] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-18T17:47:42.919532] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-18T17:47:43.011751] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T17:47:43.719557] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-05. [2025-09-18T17:47:44.129004] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-18T17:47:44.519548] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-18T17:47:45.319568] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-18T17:47:45.352808] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-18T17:47:45.404732] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-18T17:47:46.119545] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-18T17:47:46.830034] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T17:47:46.868424] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-18T17:47:46.919516] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-18T17:47:47.719561] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-18T17:47:48.025237] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-18T17:47:48.028728] [INFO ] [REMOTE ] BRC: Full fetch complete (29171 records). [2025-09-18T17:47:48.028815] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-18T17:47:48.420750] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-09-18T17:47:48.420880] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-09-18T17:47:48.421288] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-09-18T17:47:48.421329] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-09-18T17:47:48.422394] [DEBUG] [LOCAL ] BRC: Trimmed 29171 records to 19955 (keeping 200 days of data) [2025-09-18T17:47:48.519711] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-18T17:47:48.549485] [DEBUG] [LOCAL ] BRC: Primary data saved (19955 records). [2025-09-18T17:47:48.549697] [INFO ] [MAIN ] BRC: Full history saved. [2025-09-18T17:47:48.549800] [INFO ] [MAIN ] Update Progress: 330/2372 symbols completed. BRC took 29.0s. Estimated remaining: 4h 55m 29s. Rate: 6.9 symbols/min [2025-09-18T17:47:48.719926] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:47:48.776612] [DEBUG] [LOCAL ] BRO: Loaded 51917 existing records from primary storage. [2025-09-18T17:47:48.776788] [INFO ] [MAIN ] BRO: Loaded 51917 existing records. [2025-09-18T17:47:48.960361] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:47:48.960715] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-18T17:47:48.960775] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-18T17:47:48.963052] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-09-18T17:47:48.963115] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-18T17:47:49.327467] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-06. [2025-09-18T17:47:49.333562] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:47:49.368363] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-18T17:47:49.922084] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-18T17:47:49.929498] [INFO ] [REMOTE ] BRCC: Full fetch complete (57853 records). [2025-09-18T17:47:49.929682] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-18T17:47:50.125145] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-11. [2025-09-18T17:47:50.324058] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-09-18T17:47:50.324143] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-09-18T17:47:50.324838] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-09-18T17:47:50.324903] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-09-18T17:47:50.326182] [DEBUG] [LOCAL ] BRCC: Trimmed 57853 records to 40797 (keeping 200 days of data) [2025-09-18T17:47:50.563360] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T17:47:50.596625] [DEBUG] [LOCAL ] BRCC: Primary data saved (40797 records). [2025-09-18T17:47:50.596829] [INFO ] [MAIN ] BRCC: Full history saved. [2025-09-18T17:47:50.596934] [INFO ] [MAIN ] Update Progress: 331/2372 symbols completed. BRCC took 29.6s. Estimated remaining: 4h 54m 39s. Rate: 6.9 symbols/min [2025-09-18T17:47:50.788906] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:47:50.842970] [DEBUG] [LOCAL ] BROS: Loaded 53282 existing records from primary storage. [2025-09-18T17:47:50.843147] [INFO ] [MAIN ] BROS: Loaded 53282 existing records. [2025-09-18T17:47:50.928941] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-18T17:47:51.044426] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:47:51.044734] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-18T17:47:51.044805] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-18T17:47:51.046159] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-09-18T17:47:51.046235] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-18T17:47:51.430959] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:47:51.680300] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-18T17:47:51.719520] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-09-18T17:47:52.453136] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-18T17:47:52.519607] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-18T17:47:53.014430] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-18T17:47:53.319583] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-07. [2025-09-18T17:47:53.783456] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-18T17:47:54.119549] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-18T17:47:54.735931] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-18T17:47:54.919542] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-09-18T17:47:55.500357] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-18T17:47:55.719573] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-11. [2025-09-18T17:47:56.365805] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-18T17:47:56.519567] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-08. [2025-09-18T17:47:57.319532] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-18T17:47:57.746433] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-11 (2.03 seconds). [2025-09-18T17:47:57.777154] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-18T17:47:58.119544] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-09-18T17:47:58.766733] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T17:47:58.919635] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-18T17:47:59.719569] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-09. [2025-09-18T17:47:59.989345] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-18T17:48:00.519629] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-09-18T17:48:00.622830] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-18T17:48:00.745503] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-18T17:48:00.750563] [INFO ] [REMOTE ] BRFS: Full fetch complete (60458 records). [2025-09-18T17:48:00.750706] [DEBUG] [VALIDATOR ] BRFS: Validating primary data. [2025-09-18T17:48:00.751688] [FATAL] [VALIDATOR ] BRFS: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:48:00.751779] [FATAL] [MAIN ] BRFS: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:48:00.751860] [WARN ] [MAIN ] BRFS: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:48:00.751925] [INFO ] [LOCAL ] BRFS: Starting deletion of primary data. [2025-09-18T17:48:00.752005] [DEBUG] [LOCAL ] BRFS: No primary data file found to delete. [2025-09-18T17:48:00.752063] [INFO ] [LOCAL ] BRFS: Starting deletion of derivative data. [2025-09-18T17:48:00.752122] [DEBUG] [LOCAL ] BRFS: No derivative data file found to delete. [2025-09-18T17:48:00.752217] [INFO ] [MAIN ] Update Progress: 332/2372 symbols completed. BRFS took 33.8s. Estimated remaining: 4h 54m 40s. Rate: 6.9 symbols/min [2025-09-18T17:48:00.924843] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:48:00.925058] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-18T17:48:00.925101] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-18T17:48:00.925245] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-18T17:48:00.925287] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-18T17:48:00.925328] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-18T17:48:00.925361] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-18T17:48:01.279467] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:48:01.319492] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-11. [2025-09-18T17:48:01.515525] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:48:01.515873] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-11 [2025-09-18T17:48:02.073881] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T17:48:02.119566] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-09-18T17:48:02.339067] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:48:02.339382] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-09-18T17:48:02.919561] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-18T17:48:03.719559] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-18T17:48:04.519577] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-09-18T17:48:04.647416] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-18T17:48:04.734838] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:48:04.735159] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-09-18T17:48:05.319635] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-18T17:48:05.431618] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-18T17:48:06.119596] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-02. [2025-09-18T17:48:06.349336] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:48:06.349824] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-02 [2025-09-18T17:48:06.919585] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-18T17:48:07.288759] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-18T17:48:07.719618] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-03. [2025-09-18T17:48:07.922507] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:48:07.922896] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-03 [2025-09-18T17:48:08.519545] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-18T17:48:08.946450] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-18T17:48:09.319561] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-18T17:48:10.007012] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T17:48:10.014513] [INFO ] [REMOTE ] BRBR: Full fetch complete (71431 records). [2025-09-18T17:48:10.014752] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-18T17:48:10.119879] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-04. [2025-09-18T17:48:10.343843] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:48:10.359834] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-04 [2025-09-18T17:48:10.464614] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-18T17:48:10.464814] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-18T17:48:10.466370] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-18T17:48:10.466676] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-18T17:48:10.469787] [DEBUG] [LOCAL ] BRBR: Trimmed 71431 records to 51577 (keeping 200 days of data) [2025-09-18T17:48:10.785574] [DEBUG] [LOCAL ] BRBR: Primary data saved (51577 records). [2025-09-18T17:48:10.785768] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-18T17:48:10.785897] [INFO ] [MAIN ] Update Progress: 333/2372 symbols completed. BRBR took 1m 4s. Estimated remaining: 4h 54m 40s. Rate: 6.9 symbols/min [2025-09-18T17:48:10.924638] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-05. [2025-09-18T17:48:10.971174] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:48:11.008971] [DEBUG] [LOCAL ] BRSP: Loaded 36975 existing records from primary storage. [2025-09-18T17:48:11.009138] [INFO ] [MAIN ] BRSP: Loaded 36975 existing records. [2025-09-18T17:48:11.196075] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:48:11.202820] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:48:11.203389] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-05 [2025-09-18T17:48:11.204618] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-18T17:48:11.204883] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-18T17:48:11.206265] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-09-18T17:48:11.206330] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-18T17:48:11.531090] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-18T17:48:11.630023] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:48:11.719553] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-11. [2025-09-18T17:48:12.519589] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-18T17:48:12.829772] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-18T17:48:13.319633] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-06. [2025-09-18T17:48:13.541240] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:48:13.541770] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-06 [2025-09-18T17:48:14.119586] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-09-18T17:48:14.356829] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-18T17:48:14.919567] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-18T17:48:15.497014] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-18T17:48:15.719559] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-09-18T17:48:16.298687] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T17:48:16.519545] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-07. [2025-09-18T17:48:16.633885] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-18T17:48:17.319551] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-18T17:48:18.092343] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-18T17:48:18.119503] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-08. [2025-09-18T17:48:18.919554] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-18T17:48:19.306814] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-18T17:48:19.719552] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-18T17:48:19.822602] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-18T17:48:20.519562] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-09. [2025-09-18T17:48:20.630753] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-18T17:48:20.878329] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-18T17:48:21.319564] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-18T17:48:21.783083] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-18T17:48:21.790136] [INFO ] [REMOTE ] BRSL: Full fetch complete (20147 records). [2025-09-18T17:48:21.790330] [DEBUG] [VALIDATOR ] BRSL: Validating primary data. [2025-09-18T17:48:21.990229] [WARN ] [VALIDATOR ] BRSL: Validation failed - insufficient historical data. Have 55 unique days, need 200 days [2025-09-18T17:48:21.990566] [FATAL] [MAIN ] BRSL: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:48:21.990637] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:48:21.990746] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-18T17:48:21.990864] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-18T17:48:21.990923] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-18T17:48:21.990972] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-18T17:48:21.991063] [INFO ] [MAIN ] Update Progress: 334/2372 symbols completed. BRSL took 21.2s. Estimated remaining: 4h 54m 46s. Rate: 6.9 symbols/min [2025-09-18T17:48:22.130625] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-18T17:48:22.162911] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:48:22.172010] [DEBUG] [LOCAL ] BRT: Loaded 4809 existing records from primary storage. [2025-09-18T17:48:22.172121] [INFO ] [MAIN ] BRT: Loaded 4809 existing records. [2025-09-18T17:48:22.352050] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:48:22.352314] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-18T17:48:22.352362] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-18T17:48:22.352792] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-09-18T17:48:22.352853] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-18T17:48:22.720627] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:48:22.919615] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-11. [2025-09-18T17:48:23.225470] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-18T17:48:23.417406] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-18T17:48:23.543320] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-18T17:48:23.719554] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-09-18T17:48:24.334368] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-18T17:48:24.519553] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-18T17:48:25.319553] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-18T17:48:26.114093] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T17:48:26.124569] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-09-18T17:48:26.728762] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-18T17:48:26.919572] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-18T17:48:26.983060] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-18T17:48:26.990723] [INFO ] [REMOTE ] BRO: Full fetch complete (73924 records). [2025-09-18T17:48:26.990898] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-18T17:48:27.320874] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-18T17:48:27.420083] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-09-18T17:48:27.420171] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-09-18T17:48:27.422408] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-09-18T17:48:27.422499] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-09-18T17:48:27.430314] [DEBUG] [LOCAL ] BRO: Trimmed 73924 records to 52306 (keeping 200 days of data) [2025-09-18T17:48:27.733220] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-18T17:48:27.779374] [DEBUG] [LOCAL ] BRO: Primary data saved (52306 records). [2025-09-18T17:48:27.779483] [INFO ] [MAIN ] BRO: Full history saved. [2025-09-18T17:48:27.779593] [INFO ] [MAIN ] Update Progress: 335/2372 symbols completed. BRO took 39.2s. Estimated remaining: 4h 54m 20s. Rate: 6.9 symbols/min [2025-09-18T17:48:27.963384] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:48:27.986490] [DEBUG] [LOCAL ] BRW: Loaded 19085 existing records from primary storage. [2025-09-18T17:48:27.986637] [INFO ] [MAIN ] BRW: Loaded 19085 existing records. [2025-09-18T17:48:28.170923] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:48:28.171253] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-18T17:48:28.171332] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-18T17:48:28.171963] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-18T17:48:28.172022] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-18T17:48:28.456065] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-18T17:48:28.535975] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:48:28.530410] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-18T17:48:29.319530] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-18T17:48:29.923811] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T17:48:30.119533] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-18T17:48:30.919506] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-18T17:48:31.180456] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-18T17:48:31.484989] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T17:48:31.498612] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-18T17:48:31.719561] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-18T17:48:32.519557] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-18T17:48:33.050201] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-18T17:48:33.073264] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-18T17:48:33.319549] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-18T17:48:34.119539] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-11. [2025-09-18T17:48:34.919514] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-18T17:48:35.044478] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-18T17:48:35.219161] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-18T17:48:35.719542] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-09-18T17:48:36.144268] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-18T17:48:36.519520] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-18T17:48:36.847102] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-18T17:48:37.319549] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-18T17:48:37.929919] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-18T17:48:38.119510] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-09-18T17:48:38.442692] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-18T17:48:38.450741] [INFO ] [REMOTE ] BROS: Full fetch complete (76436 records). [2025-09-18T17:48:38.450910] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-18T17:48:38.451895] [FATAL] [VALIDATOR ] BROS: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:48:38.451997] [FATAL] [MAIN ] BROS: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:48:38.452042] [WARN ] [MAIN ] BROS: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:48:38.452096] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-18T17:48:38.452181] [DEBUG] [LOCAL ] BROS: No primary data file found to delete. [2025-09-18T17:48:38.452235] [INFO ] [LOCAL ] BROS: Starting deletion of derivative data. [2025-09-18T17:48:38.452689] [DEBUG] [LOCAL ] BROS: Deleted derivative data file. [2025-09-18T17:48:38.452809] [INFO ] [MAIN ] Update Progress: 336/2372 symbols completed. BROS took 47.9s. Estimated remaining: 4h 54m 24s. Rate: 6.9 symbols/min [2025-09-18T17:48:38.632281] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:48:38.632768] [DEBUG] [LOCAL ] BRX: No existing data file found in primary storage. [2025-09-18T17:48:38.632839] [WARN ] [MAIN ] BRX: No existing data found, performing full refresh instead. [2025-09-18T17:48:38.633034] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-18T17:48:38.633078] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-18T17:48:38.633194] [DEBUG] [LOCAL ] BRX: No primary data file found to delete. [2025-09-18T17:48:38.633246] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-18T17:48:38.920156] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-18T17:48:39.011176] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:48:39.031774] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-18T17:48:39.719555] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-18T17:48:39.972802] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-18T17:48:40.341323] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-18T17:48:40.519567] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-18T17:48:41.134387] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-18T17:48:41.319590] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-18T17:48:42.119624] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-18T17:48:42.128135] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-18T17:48:42.919604] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-11. [2025-09-18T17:48:43.577317] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T17:48:43.582124] [INFO ] [REMOTE ] BRSP: Full fetch complete (53517 records). [2025-09-18T17:48:43.582250] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-18T17:48:43.583002] [FATAL] [VALIDATOR ] BRSP: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:48:43.583100] [FATAL] [MAIN ] BRSP: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:48:43.583174] [WARN ] [MAIN ] BRSP: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:48:43.583253] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-18T17:48:43.583323] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-09-18T17:48:43.583364] [INFO ] [LOCAL ] BRSP: Starting deletion of derivative data. [2025-09-18T17:48:43.583886] [DEBUG] [LOCAL ] BRSP: Deleted derivative data file. [2025-09-18T17:48:43.584014] [INFO ] [MAIN ] Update Progress: 337/2372 symbols completed. BRSP took 32.8s. Estimated remaining: 4h 53m 54s. Rate: 6.9 symbols/min [2025-09-18T17:48:43.734879] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-18T17:48:43.774074] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:48:43.822887] [DEBUG] [LOCAL ] BSAC: Loaded 33099 existing records from primary storage. [2025-09-18T17:48:43.823027] [INFO ] [MAIN ] BSAC: Loaded 33099 existing records. [2025-09-18T17:48:44.003148] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:48:44.003476] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-18T17:48:44.003537] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-18T17:48:44.005412] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-09-18T17:48:44.005505] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-18T17:48:44.329163] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-18T17:48:44.375864] [INFO ] [REMOTE ] BRT: Full fetch complete (6736 records). [2025-09-18T17:48:44.422526] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:48:44.422854] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-18T17:48:44.524677] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-18T17:48:44.782756] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-18T17:48:44.851940] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-09-18T17:48:44.852033] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-09-18T17:48:44.852228] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-09-18T17:48:44.852268] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-09-18T17:48:44.852697] [DEBUG] [LOCAL ] BRT: Trimmed 6736 records to 4864 (keeping 200 days of data) [2025-09-18T17:48:44.887359] [DEBUG] [LOCAL ] BRT: Primary data saved (4864 records). [2025-09-18T17:48:44.887497] [INFO ] [MAIN ] BRT: Full history saved. [2025-09-18T17:48:44.887601] [INFO ] [MAIN ] Update Progress: 338/2372 symbols completed. BRT took 22.9s. Estimated remaining: 4h 53m 1s. Rate: 6.9 symbols/min [2025-09-18T17:48:45.060053] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:48:45.060229] [DEBUG] [LOCAL ] BSBR: No existing data file found in primary storage. [2025-09-18T17:48:45.060268] [WARN ] [MAIN ] BSBR: No existing data found, performing full refresh instead. [2025-09-18T17:48:45.060440] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-18T17:48:45.060484] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-18T17:48:45.060527] [DEBUG] [LOCAL ] BSBR: No primary data file found to delete. [2025-09-18T17:48:45.060562] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-18T17:48:45.328579] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-09-18T17:48:45.439895] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:48:45.450695] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-18T17:48:46.119594] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-11. [2025-09-18T17:48:46.847909] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-18T17:48:46.919502] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-09-18T17:48:47.183139] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-18T17:48:47.719595] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-18T17:48:48.110627] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-18T17:48:48.519559] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-09-18T17:48:48.607512] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-18T17:48:49.319555] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-18T17:48:49.598895] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-18T17:48:50.119568] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-09-18T17:48:50.919599] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-18T17:48:50.984580] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T17:48:51.092549] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-18T17:48:51.483130] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-18T17:48:51.719626] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-11. [2025-09-18T17:48:52.519728] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-18T17:48:53.288177] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-18T17:48:53.319573] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-09-18T17:48:53.564583] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-18T17:48:54.119567] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-18T17:48:54.386917] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-18T17:48:54.868054] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-18T17:48:54.919500] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-18T17:48:55.719567] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-18T17:48:55.853901] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T17:48:56.519584] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-09-18T17:48:57.299343] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-18T17:48:57.319584] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-18T17:48:57.550140] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-18T17:48:58.119571] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-18T17:48:58.451691] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-18T17:48:58.777795] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-18T17:48:58.919550] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-18T17:48:59.719563] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-18T17:48:59.940153] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-18T17:49:00.519559] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-18T17:49:01.105026] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-18T17:49:01.109553] [INFO ] [REMOTE ] BRW: Full fetch complete (29487 records). [2025-09-18T17:49:01.109670] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-18T17:49:01.324684] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-18T17:49:01.523746] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-18T17:49:01.524011] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-18T17:49:01.524828] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-18T17:49:01.524915] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-18T17:49:01.526320] [DEBUG] [LOCAL ] BRW: Trimmed 29487 records to 19407 (keeping 200 days of data) [2025-09-18T17:49:01.548408] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-18T17:49:01.677352] [DEBUG] [LOCAL ] BRW: Primary data saved (19407 records). [2025-09-18T17:49:01.677514] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-18T17:49:01.677617] [INFO ] [MAIN ] Update Progress: 339/2372 symbols completed. BRW took 33.9s. Estimated remaining: 4h 53m 41s. Rate: 6.9 symbols/min [2025-09-18T17:49:01.867448] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:49:01.878873] [DEBUG] [LOCAL ] BSL: Loaded 7950 existing records from primary storage. [2025-09-18T17:49:01.878998] [INFO ] [MAIN ] BSL: Loaded 7950 existing records. [2025-09-18T17:49:02.058436] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:49:02.058735] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-18T17:49:02.058791] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-18T17:49:02.059182] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-09-18T17:49:02.059241] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-18T17:49:02.124835] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-18T17:49:02.455447] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:49:02.752212] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T17:49:02.919561] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-11. [2025-09-18T17:49:03.493157] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T17:49:03.549853] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-18T17:49:03.719596] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-18T17:49:04.519584] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-18T17:49:05.001763] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-18T17:49:05.319554] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-18T17:49:05.633190] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-18T17:49:06.119548] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-18T17:49:06.453252] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T17:49:06.919624] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-18T17:49:07.251512] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-18T17:49:07.719557] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-18T17:49:08.519566] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-09-18T17:49:08.797069] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-18T17:49:09.117153] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-18T17:49:09.326152] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-18T17:49:09.348684] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-18T17:49:10.119562] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-09-18T17:49:10.576167] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-18T17:49:10.696217] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-18T17:49:10.701630] [INFO ] [REMOTE ] BSBR: Full fetch complete (50448 records). [2025-09-18T17:49:10.701749] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-18T17:49:10.922920] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-18T17:49:11.137471] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-09-18T17:49:11.137551] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-09-18T17:49:11.138317] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-09-18T17:49:11.138430] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-09-18T17:49:11.139703] [DEBUG] [LOCAL ] BSBR: Trimmed 50448 records to 35306 (keeping 200 days of data) [2025-09-18T17:49:11.355882] [DEBUG] [LOCAL ] BSBR: Primary data saved (35306 records). [2025-09-18T17:49:11.356027] [INFO ] [MAIN ] BSBR: Full history saved. [2025-09-18T17:49:11.356105] [INFO ] [MAIN ] Update Progress: 340/2372 symbols completed. BSBR took 26.5s. Estimated remaining: 4h 53m 38s. Rate: 6.9 symbols/min [2025-09-18T17:49:11.533958] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:49:11.578167] [DEBUG] [LOCAL ] BSM: Loaded 32599 existing records from primary storage. [2025-09-18T17:49:11.578306] [INFO ] [MAIN ] BSM: Loaded 32599 existing records. [2025-09-18T17:49:11.726550] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-18T17:49:11.758552] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:49:11.758830] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-18T17:49:11.758884] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-18T17:49:11.759821] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-18T17:49:11.759895] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-18T17:49:11.938439] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-18T17:49:12.135848] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:49:12.519602] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-18T17:49:13.011445] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-18T17:49:13.083432] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-18T17:49:13.319584] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-18T17:49:14.119557] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-18T17:49:14.293556] [DEBUG] [REMOTE ] BSAC: Error fetching primary data for 2025-05: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-18T17:49:14.293759] [WARN ] [REMOTE ] BSAC: No data returned for month 2025-05 [2025-09-18T17:49:14.919547] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-18T17:49:15.719563] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-11. [2025-09-18T17:49:15.940866] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-18T17:49:15.977933] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-18T17:49:16.519552] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-18T17:49:16.893143] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-18T17:49:17.319553] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-09-18T17:49:17.575148] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-18T17:49:18.119562] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-18T17:49:18.408355] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-18T17:49:18.852019] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-18T17:49:18.919507] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-18T17:49:19.617341] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-18T17:49:19.719550] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-18T17:49:20.315560] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-18T17:49:20.519556] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-18T17:49:21.319590] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-18T17:49:22.131589] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-09-18T17:49:22.137970] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-18T17:49:22.171609] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-18T17:49:22.919592] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-18T17:49:23.064058] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-18T17:49:23.719610] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-18T17:49:23.932234] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T17:49:23.937023] [INFO ] [REMOTE ] BSAC: Full fetch complete (38142 records). [2025-09-18T17:49:23.937155] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-18T17:49:23.937883] [FATAL] [VALIDATOR ] BSAC: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:49:23.937998] [FATAL] [MAIN ] BSAC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:49:23.938096] [WARN ] [MAIN ] BSAC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:49:23.938200] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-18T17:49:23.938286] [DEBUG] [LOCAL ] BSAC: No primary data file found to delete. [2025-09-18T17:49:23.938328] [INFO ] [LOCAL ] BSAC: Starting deletion of derivative data. [2025-09-18T17:49:23.938882] [DEBUG] [LOCAL ] BSAC: Deleted derivative data file. [2025-09-18T17:49:23.939000] [INFO ] [MAIN ] Update Progress: 341/2372 symbols completed. BSAC took 40.4s. Estimated remaining: 4h 53m 53s. Rate: 6.9 symbols/min [2025-09-18T17:49:24.117803] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:49:24.139545] [DEBUG] [LOCAL ] BST: Loaded 19479 existing records from primary storage. [2025-09-18T17:49:24.139700] [INFO ] [MAIN ] BST: Loaded 19479 existing records. [2025-09-18T17:49:24.347879] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:49:24.348163] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-18T17:49:24.348215] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-18T17:49:24.348978] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-09-18T17:49:24.349047] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-18T17:49:24.531124] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-18T17:49:24.736057] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:49:25.125452] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T17:49:25.319558] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-18T17:49:25.845035] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-18T17:49:26.037721] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T17:49:26.044975] [INFO ] [REMOTE ] BRX: Full fetch complete (74792 records). [2025-09-18T17:49:26.045135] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-18T17:49:26.124790] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-18T17:49:26.454277] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-09-18T17:49:26.454368] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-09-18T17:49:26.455184] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-09-18T17:49:26.455251] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-09-18T17:49:26.456752] [DEBUG] [LOCAL ] BRX: Trimmed 74792 records to 52216 (keeping 200 days of data) [2025-09-18T17:49:26.790606] [DEBUG] [LOCAL ] BRX: Primary data saved (52216 records). [2025-09-18T17:49:26.790800] [INFO ] [MAIN ] BRX: Full history saved. [2025-09-18T17:49:26.790950] [INFO ] [MAIN ] Update Progress: 342/2372 symbols completed. BRX took 48.3s. Estimated remaining: 4h 53m 10s. Rate: 6.9 symbols/min [2025-09-18T17:49:26.924744] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-11. [2025-09-18T17:49:26.971739] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:49:26.996834] [DEBUG] [LOCAL ] BSTZ: Loaded 25095 existing records from primary storage. [2025-09-18T17:49:26.996991] [INFO ] [MAIN ] BSTZ: Loaded 25095 existing records. [2025-09-18T17:49:27.179113] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:49:27.179336] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-18T17:49:27.179384] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-18T17:49:27.180327] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-09-18T17:49:27.180420] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-18T17:49:27.557946] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:49:27.576540] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-18T17:49:27.719494] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-11. [2025-09-18T17:49:28.215574] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-18T17:49:28.519510] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-18T17:49:28.671910] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-18T17:49:29.319581] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-09-18T17:49:29.976896] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T17:49:30.119494] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-18T17:49:30.527710] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-18T17:49:30.919554] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-09-18T17:49:31.598404] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-18T17:49:31.719539] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-18T17:49:32.070480] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T17:49:32.519543] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-09-18T17:49:33.068357] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-18T17:49:33.319508] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-18T17:49:33.578125] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-18T17:49:33.896871] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-18T17:49:34.119623] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-09-18T17:49:34.920810] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-18T17:49:34.922002] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-18T17:49:35.610216] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-18T17:49:35.611872] [INFO ] [REMOTE ] BSL: Full fetch complete (12511 records). [2025-09-18T17:49:35.611944] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-18T17:49:35.724678] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-18T17:49:35.990529] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-09-18T17:49:35.990629] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-09-18T17:49:35.991001] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-09-18T17:49:35.991129] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-09-18T17:49:35.991694] [DEBUG] [LOCAL ] BSL: Trimmed 12511 records to 8070 (keeping 200 days of data) [2025-09-18T17:49:36.042535] [DEBUG] [LOCAL ] BSL: Primary data saved (8070 records). [2025-09-18T17:49:36.042687] [INFO ] [MAIN ] BSL: Full history saved. [2025-09-18T17:49:36.042791] [INFO ] [MAIN ] Update Progress: 343/2372 symbols completed. BSL took 34.4s. Estimated remaining: 4h 53m 4s. Rate: 6.9 symbols/min [2025-09-18T17:49:36.213271] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:49:36.274003] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-09-18T17:49:36.274168] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-09-18T17:49:36.454665] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:49:36.454914] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-18T17:49:36.454983] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-18T17:49:36.456598] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-18T17:49:36.456731] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-18T17:49:36.526235] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-18T17:49:36.824154] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:49:36.904056] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-18T17:49:37.319557] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-11. [2025-09-18T17:49:37.952206] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T17:49:38.119550] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-18T17:49:38.924753] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-18T17:49:38.941190] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-18T17:49:39.118002] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-18T17:49:39.719576] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-18T17:49:39.941997] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-18T17:49:40.519554] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-18T17:49:40.757468] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-18T17:49:41.319557] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-18T17:49:41.931583] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-18T17:49:41.937067] [INFO ] [REMOTE ] BSM: Full fetch complete (47596 records). [2025-09-18T17:49:41.937186] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-18T17:49:42.133317] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-18T17:49:42.337121] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-09-18T17:49:42.345405] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-09-18T17:49:42.346099] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-09-18T17:49:42.346692] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-09-18T17:49:42.347431] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-18T17:49:42.353772] [DEBUG] [LOCAL ] BSM: Trimmed 47596 records to 32852 (keeping 200 days of data) [2025-09-18T17:49:42.558304] [DEBUG] [LOCAL ] BSM: Primary data saved (32852 records). [2025-09-18T17:49:42.558465] [INFO ] [MAIN ] BSM: Full history saved. [2025-09-18T17:49:42.560153] [INFO ] [MAIN ] Update Progress: 344/2372 symbols completed. BSM took 31.2s. Estimated remaining: 4h 52m 43s. Rate: 6.9 symbols/min [2025-09-18T17:49:42.736109] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:49:42.744570] [DEBUG] [LOCAL ] BTA: Loaded 5311 existing records from primary storage. [2025-09-18T17:49:42.744731] [INFO ] [MAIN ] BTA: Loaded 5311 existing records. [2025-09-18T17:49:42.920679] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-09-18T17:49:42.927362] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:49:42.928503] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-18T17:49:42.928553] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-18T17:49:42.928842] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-09-18T17:49:42.928903] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-18T17:49:43.307023] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:49:43.323041] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-18T17:49:43.719557] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-11. [2025-09-18T17:49:44.269384] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-18T17:49:44.519600] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-09-18T17:49:44.590461] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-18T17:49:45.249713] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-18T17:49:45.319618] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-09-18T17:49:46.119547] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-18T17:49:46.919591] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-18T17:49:47.143797] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-18T17:49:47.330575] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-18T17:49:47.719622] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-09-18T17:49:47.914314] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-18T17:49:48.362524] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-18T17:49:48.519548] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-18T17:49:49.055142] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-18T17:49:49.319575] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-18T17:49:50.119514] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-18T17:49:50.283083] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-18T17:49:50.482952] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-18T17:49:50.919563] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-18T17:49:51.719600] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-18T17:49:52.266110] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-18T17:49:52.446189] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-18T17:49:52.519551] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-18T17:49:53.319615] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-18T17:49:53.612988] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-18T17:49:54.119565] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-18T17:49:54.743049] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-18T17:49:54.919623] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-18T17:49:55.328722] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-18T17:49:55.597403] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-18T17:49:55.719494] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-18T17:49:56.519548] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-18T17:49:57.319566] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-18T17:49:57.677799] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-18T17:49:57.698787] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-18T17:49:57.715746] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-18T17:49:58.119636] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-18T17:49:58.919580] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-18T17:49:59.143148] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-18T17:49:59.719560] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-18T17:50:00.519548] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-18T17:50:00.620674] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-18T17:50:00.674922] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-18T17:50:01.319551] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-18T17:50:01.823070] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-18T17:50:01.826310] [INFO ] [REMOTE ] BST: Full fetch complete (28561 records). [2025-09-18T17:50:01.826410] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-18T17:50:01.828122] [FATAL] [VALIDATOR ] BST: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:50:01.828407] [FATAL] [MAIN ] BST: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:50:01.828484] [WARN ] [MAIN ] BST: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:50:01.828572] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-18T17:50:01.828715] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-09-18T17:50:01.828783] [INFO ] [LOCAL ] BST: Starting deletion of derivative data. [2025-09-18T17:50:01.829577] [DEBUG] [LOCAL ] BST: Deleted derivative data file. [2025-09-18T17:50:01.829800] [INFO ] [MAIN ] Update Progress: 345/2372 symbols completed. BST took 37.9s. Estimated remaining: 4h 53m 37s. Rate: 6.9 symbols/min [2025-09-18T17:50:02.070812] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:50:02.087191] [DEBUG] [LOCAL ] BTCM: Loaded 14125 existing records from primary storage. [2025-09-18T17:50:02.087340] [INFO ] [MAIN ] BTCM: Loaded 14125 existing records. [2025-09-18T17:50:02.124906] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-18T17:50:02.290012] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:50:02.290352] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-18T17:50:02.290408] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-18T17:50:02.290871] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-09-18T17:50:02.290932] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-18T17:50:02.665935] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:50:02.684809] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-18T17:50:02.839758] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T17:50:02.843857] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36684 records). [2025-09-18T17:50:02.843942] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-18T17:50:02.924631] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-18T17:50:03.220618] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-09-18T17:50:03.220727] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-09-18T17:50:03.221195] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-09-18T17:50:03.221258] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-09-18T17:50:03.222149] [DEBUG] [LOCAL ] BSTZ: Trimmed 36684 records to 25254 (keeping 200 days of data) [2025-09-18T17:50:03.376112] [DEBUG] [LOCAL ] BSTZ: Primary data saved (25254 records). [2025-09-18T17:50:03.376234] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-09-18T17:50:03.376310] [INFO ] [MAIN ] Update Progress: 346/2372 symbols completed. BSTZ took 36.6s. Estimated remaining: 4h 52m 46s. Rate: 6.9 symbols/min [2025-09-18T17:50:03.545327] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:50:03.600023] [DEBUG] [LOCAL ] BTE: Loaded 52762 existing records from primary storage. [2025-09-18T17:50:03.602846] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-18T17:50:03.602676] [INFO ] [MAIN ] BTE: Loaded 52762 existing records. [2025-09-18T17:50:03.724770] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-18T17:50:03.791762] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:50:03.792027] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-18T17:50:03.792094] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-18T17:50:03.793544] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-09-18T17:50:03.793606] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-18T17:50:04.148636] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:50:04.519499] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-18T17:50:04.527298] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-18T17:50:04.528814] [INFO ] [REMOTE ] BTA: Full fetch complete (9479 records). [2025-09-18T17:50:04.528889] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-18T17:50:04.906912] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-09-18T17:50:04.907046] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-09-18T17:50:04.907307] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-09-18T17:50:04.907381] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-09-18T17:50:04.907905] [DEBUG] [LOCAL ] BTA: Trimmed 9479 records to 5346 (keeping 200 days of data) [2025-09-18T17:50:04.940085] [DEBUG] [LOCAL ] BTA: Primary data saved (5346 records). [2025-09-18T17:50:04.940166] [INFO ] [MAIN ] BTA: Full history saved. [2025-09-18T17:50:04.940243] [INFO ] [MAIN ] Update Progress: 347/2372 symbols completed. BTA took 22.4s. Estimated remaining: 4h 51m 56s. Rate: 6.9 symbols/min [2025-09-18T17:50:05.116182] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:50:05.178142] [DEBUG] [LOCAL ] BTI: Loaded 53553 existing records from primary storage. [2025-09-18T17:50:05.178331] [INFO ] [MAIN ] BTI: Loaded 53553 existing records. [2025-09-18T17:50:05.324760] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-11. [2025-09-18T17:50:05.364771] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:50:05.364956] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-18T17:50:05.365003] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-18T17:50:05.366330] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-09-18T17:50:05.366391] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-18T17:50:05.726181] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:50:06.119567] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-11. [2025-09-18T17:50:06.411301] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T17:50:06.538811] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-18T17:50:06.919545] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-11. [2025-09-18T17:50:07.719571] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-09-18T17:50:08.261821] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-11 (2.14 seconds). [2025-09-18T17:50:08.491399] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-18T17:50:08.519518] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-09-18T17:50:08.860806] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-18T17:50:09.319554] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-09-18T17:50:09.809426] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-18T17:50:10.080363] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-18T17:50:10.119565] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-18T17:50:10.609589] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-18T17:50:10.919564] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-18T17:50:11.528181] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-18T17:50:11.719553] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-18T17:50:12.519550] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-09-18T17:50:13.227331] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-18T17:50:13.319546] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-09-18T17:50:14.119533] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-18T17:50:14.385754] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-18T17:50:14.918892] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-18T17:50:14.922840] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-18T17:50:15.577050] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-18T17:50:15.719521] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-09-18T17:50:15.851142] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-18T17:50:16.519548] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-18T17:50:17.318220] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-18T17:50:17.328204] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-18T17:50:18.119610] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-18T17:50:18.919612] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-18T17:50:19.069118] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-18T17:50:19.467129] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (2.95 seconds). [2025-09-18T17:50:19.719552] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-18T17:50:19.863499] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-18T17:50:20.241550] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-18T17:50:20.519564] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-18T17:50:20.801488] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-18T17:50:21.319589] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-18T17:50:21.861261] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-18T17:50:22.119542] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-18T17:50:22.919530] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-18T17:50:23.400895] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-18T17:50:23.511736] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T17:50:23.719560] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-18T17:50:24.298391] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-18T17:50:24.519547] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-18T17:50:25.319515] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-18T17:50:26.119575] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-18T17:50:26.209348] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-18T17:50:26.658376] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-18T17:50:26.668862] [INFO ] [REMOTE ] BSX: Full fetch complete (77525 records). [2025-09-18T17:50:26.669074] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-18T17:50:26.935842] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-18T17:50:27.088180] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-18T17:50:27.088352] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-18T17:50:27.089185] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-18T17:50:27.089269] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-18T17:50:27.091902] [DEBUG] [LOCAL ] BSX: Trimmed 77525 records to 54078 (keeping 200 days of data) [2025-09-18T17:50:27.352768] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-18T17:50:27.482663] [DEBUG] [LOCAL ] BSX: Primary data saved (54078 records). [2025-09-18T17:50:27.482871] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-18T17:50:27.483034] [INFO ] [MAIN ] Update Progress: 348/2372 symbols completed. BSX took 51.4s. Estimated remaining: 4h 53m 8s. Rate: 6.9 symbols/min [2025-09-18T17:50:27.584917] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T17:50:27.680430] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:50:27.692143] [DEBUG] [LOCAL ] BTO: Loaded 9038 existing records from primary storage. [2025-09-18T17:50:27.692278] [INFO ] [MAIN ] BTO: Loaded 9038 existing records. [2025-09-18T17:50:27.724612] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-18T17:50:27.879020] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:50:27.879278] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-18T17:50:27.879369] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-18T17:50:27.879873] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-09-18T17:50:27.879935] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-18T17:50:28.240120] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:50:28.519560] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-11. [2025-09-18T17:50:29.288994] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-18T17:50:29.307982] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-18T17:50:29.324595] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-09-18T17:50:29.346530] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-18T17:50:30.089077] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-18T17:50:30.119504] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-09-18T17:50:30.913465] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-18T17:50:30.919488] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-18T17:50:31.689567] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-18T17:50:31.719586] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-18T17:50:32.519551] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-18T17:50:33.324677] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-18T17:50:33.327510] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-18T17:50:33.501331] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-18T17:50:34.119574] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-18T17:50:34.704875] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-18T17:50:34.708323] [INFO ] [REMOTE ] BTCM: Full fetch complete (19341 records). [2025-09-18T17:50:34.708406] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-18T17:50:34.924681] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-18T17:50:35.093551] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-09-18T17:50:35.093638] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-09-18T17:50:35.094392] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-09-18T17:50:35.094478] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-09-18T17:50:35.095583] [DEBUG] [LOCAL ] BTCM: Trimmed 19341 records to 14279 (keeping 200 days of data) [2025-09-18T17:50:35.181799] [DEBUG] [LOCAL ] BTCM: Primary data saved (14279 records). [2025-09-18T17:50:35.181951] [INFO ] [MAIN ] BTCM: Full history saved. [2025-09-18T17:50:35.182138] [INFO ] [MAIN ] Update Progress: 349/2372 symbols completed. BTCM took 33.4s. Estimated remaining: 4h 52m 54s. Rate: 6.9 symbols/min [2025-09-18T17:50:35.366119] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:50:35.384118] [DEBUG] [LOCAL ] BTT: Loaded 16123 existing records from primary storage. [2025-09-18T17:50:35.384316] [INFO ] [MAIN ] BTT: Loaded 16123 existing records. [2025-09-18T17:50:35.569868] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:50:35.570117] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-18T17:50:35.570185] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-18T17:50:35.570806] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-09-18T17:50:35.570881] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-18T17:50:35.723218] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-18T17:50:35.953859] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:50:35.984817] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-18T17:50:36.374801] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-18T17:50:36.519572] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-11. [2025-09-18T17:50:36.814905] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-18T17:50:37.319564] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-18T17:50:37.394214] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-18T17:50:38.119560] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-18T17:50:38.919568] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-18T17:50:39.136558] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-18T17:50:39.145056] [INFO ] [REMOTE ] BTE: Full fetch complete (75819 records). [2025-09-18T17:50:39.145245] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-18T17:50:39.574760] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-09-18T17:50:39.574900] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-09-18T17:50:39.576439] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-09-18T17:50:39.576576] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-09-18T17:50:39.584136] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-18T17:50:39.588202] [DEBUG] [LOCAL ] BTE: Trimmed 75819 records to 53147 (keeping 200 days of data) [2025-09-18T17:50:39.719699] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-18T17:50:39.951500] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-18T17:50:39.973057] [DEBUG] [LOCAL ] BTE: Primary data saved (53147 records). [2025-09-18T17:50:39.973226] [INFO ] [MAIN ] BTE: Full history saved. [2025-09-18T17:50:39.973367] [INFO ] [MAIN ] Update Progress: 350/2372 symbols completed. BTE took 36.6s. Estimated remaining: 4h 52m 23s. Rate: 6.9 symbols/min [2025-09-18T17:50:40.149014] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:50:40.203203] [DEBUG] [LOCAL ] BTU: Loaded 53302 existing records from primary storage. [2025-09-18T17:50:40.203360] [INFO ] [MAIN ] BTU: Loaded 53302 existing records. [2025-09-18T17:50:40.400156] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:50:40.407946] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-18T17:50:40.408358] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-18T17:50:40.408208] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-18T17:50:40.412535] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-18T17:50:40.412612] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-18T17:50:40.524627] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-09-18T17:50:40.779968] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:50:41.319571] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-18T17:50:41.782590] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-18T17:50:41.846390] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-18T17:50:42.119555] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-09-18T17:50:42.919547] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-18T17:50:43.065188] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T17:50:43.395636] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-18T17:50:43.719562] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-18T17:50:44.450310] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-18T17:50:44.452023] [INFO ] [REMOTE ] BTO: Full fetch complete (13352 records). [2025-09-18T17:50:44.452104] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-18T17:50:44.524754] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-18T17:50:44.821935] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-09-18T17:50:44.822018] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-09-18T17:50:44.822333] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-09-18T17:50:44.822373] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-09-18T17:50:44.822904] [DEBUG] [LOCAL ] BTO: Trimmed 13352 records to 9115 (keeping 200 days of data) [2025-09-18T17:50:44.886292] [DEBUG] [LOCAL ] BTO: Primary data saved (9115 records). [2025-09-18T17:50:44.886442] [INFO ] [MAIN ] BTO: Full history saved. [2025-09-18T17:50:44.886528] [INFO ] [MAIN ] Update Progress: 351/2372 symbols completed. BTO took 17.4s. Estimated remaining: 4h 51m 52s. Rate: 6.9 symbols/min [2025-09-18T17:50:45.070563] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:50:45.070991] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-18T17:50:45.071051] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-18T17:50:45.071317] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-18T17:50:45.071401] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-18T17:50:45.071504] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-18T17:50:45.071584] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-18T17:50:45.324701] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-18T17:50:45.440120] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:50:46.006350] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-18T17:50:46.119575] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-18T17:50:46.278574] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-18T17:50:46.731586] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-18T17:50:46.919585] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-18T17:50:47.719553] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-11. [2025-09-18T17:50:48.075950] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-18T17:50:48.519602] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-11. [2025-09-18T17:50:48.715692] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:50:48.716076] [WARN ] [REMOTE ] BTX: No data returned for month 2024-11 [2025-09-18T17:50:49.328904] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-18T17:50:49.334198] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-18T17:50:50.119532] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-09-18T17:50:50.919584] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-09-18T17:50:51.138833] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:50:51.139151] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-09-18T17:50:51.376012] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-18T17:50:51.387616] [INFO ] [REMOTE ] BTI: Full fetch complete (77280 records). [2025-09-18T17:50:51.387809] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-18T17:50:51.724936] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-09-18T17:50:51.815302] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-09-18T17:50:51.815421] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-09-18T17:50:51.816469] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-09-18T17:50:51.816606] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-09-18T17:50:51.818974] [DEBUG] [LOCAL ] BTI: Trimmed 77280 records to 53942 (keeping 200 days of data) [2025-09-18T17:50:52.046452] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-18T17:50:52.047422] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:50:52.067915] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-09-18T17:50:52.219758] [DEBUG] [LOCAL ] BTI: Primary data saved (53942 records). [2025-09-18T17:50:52.219977] [INFO ] [MAIN ] BTI: Full history saved. [2025-09-18T17:50:52.222364] [INFO ] [MAIN ] Update Progress: 352/2372 symbols completed. BTI took 47.3s. Estimated remaining: 4h 51m 36s. Rate: 6.9 symbols/min [2025-09-18T17:50:52.397316] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:50:52.421377] [DEBUG] [LOCAL ] BTZ: Loaded 23132 existing records from primary storage. [2025-09-18T17:50:52.421520] [INFO ] [MAIN ] BTZ: Loaded 23132 existing records. [2025-09-18T17:50:52.524626] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-18T17:50:52.614111] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:50:52.614376] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-18T17:50:52.614426] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-18T17:50:52.615111] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-09-18T17:50:52.615181] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-18T17:50:52.993867] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:50:53.319526] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-09-18T17:50:53.683500] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-18T17:50:54.119613] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-02. [2025-09-18T17:50:54.872370] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T17:50:54.919511] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-18T17:50:54.999884] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-18T17:50:55.719625] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-11. [2025-09-18T17:50:56.429841] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-18T17:50:56.519620] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-18T17:50:56.911994] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-18T17:50:57.319607] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-18T17:50:58.010583] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-18T17:50:58.119492] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-18T17:50:58.374197] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-18T17:50:58.731692] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-18T17:50:58.919597] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-03. [2025-09-18T17:50:59.719598] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-18T17:51:00.252355] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-18T17:51:00.466155] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-18T17:51:00.519518] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-18T17:51:01.319540] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-09-18T17:51:01.574792] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-18T17:51:01.577694] [INFO ] [REMOTE ] BTT: Full fetch complete (24444 records). [2025-09-18T17:51:01.577778] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-18T17:51:01.985289] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-09-18T17:51:01.985402] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-09-18T17:51:01.985934] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-09-18T17:51:01.986019] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-09-18T17:51:01.987171] [DEBUG] [LOCAL ] BTT: Trimmed 24444 records to 16236 (keeping 200 days of data) [2025-09-18T17:51:02.096665] [DEBUG] [LOCAL ] BTT: Primary data saved (16236 records). [2025-09-18T17:51:02.096826] [INFO ] [MAIN ] BTT: Full history saved. [2025-09-18T17:51:02.096941] [INFO ] [MAIN ] Update Progress: 353/2372 symbols completed. BTT took 26.9s. Estimated remaining: 4h 51m 34s. Rate: 6.9 symbols/min [2025-09-18T17:51:02.126860] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-18T17:51:02.281699] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:51:02.326036] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-18T17:51:02.366787] [DEBUG] [LOCAL ] BUD: Loaded 52766 existing records from primary storage. [2025-09-18T17:51:02.366957] [INFO ] [MAIN ] BUD: Loaded 52766 existing records. [2025-09-18T17:51:02.547742] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:51:02.548125] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-18T17:51:02.548188] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-18T17:51:02.549369] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-09-18T17:51:02.549430] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-18T17:51:02.920606] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-09-18T17:51:02.924891] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:51:03.719543] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-11. [2025-09-18T17:51:04.043086] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-18T17:51:04.154755] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-18T17:51:04.519574] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-18T17:51:05.319680] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-18T17:51:05.629743] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-18T17:51:05.656463] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T17:51:06.119614] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-04. [2025-09-18T17:51:06.919567] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-09-18T17:51:07.060346] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-18T17:51:07.162782] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-18T17:51:07.719584] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-18T17:51:08.519561] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-18T17:51:08.612832] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-18T17:51:09.220155] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T17:51:09.319606] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-05. [2025-09-18T17:51:09.560990] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-18T17:51:10.119552] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-18T17:51:10.678419] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-18T17:51:10.919559] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-06. [2025-09-18T17:51:11.719552] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-18T17:51:11.881790] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-18T17:51:11.989227] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-18T17:51:12.519549] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-07. [2025-09-18T17:51:12.645987] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-18T17:51:13.319548] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-18T17:51:13.524527] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-18T17:51:14.119538] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-18T17:51:14.919533] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-09-18T17:51:14.939876] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-18T17:51:15.118053] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-18T17:51:15.719557] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-18T17:51:16.519594] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-08. [2025-09-18T17:51:16.950836] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-18T17:51:17.319528] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-18T17:51:17.497151] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-18T17:51:17.518274] [INFO ] [REMOTE ] BTU: Full fetch complete (76667 records). [2025-09-18T17:51:17.529586] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-18T17:51:17.530981] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-18T17:51:17.954748] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-18T17:51:17.954844] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-18T17:51:17.955624] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-18T17:51:17.955775] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-18T17:51:17.957382] [DEBUG] [LOCAL ] BTU: Trimmed 76667 records to 53692 (keeping 200 days of data) [2025-09-18T17:51:18.135154] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-18T17:51:18.301186] [DEBUG] [LOCAL ] BTU: Primary data saved (53692 records). [2025-09-18T17:51:18.307456] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-18T17:51:18.306971] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-18T17:51:18.307694] [INFO ] [MAIN ] Update Progress: 354/2372 symbols completed. BTU took 38.3s. Estimated remaining: 4h 52m 9s. Rate: 6.9 symbols/min [2025-09-18T17:51:18.496408] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:51:18.508636] [DEBUG] [LOCAL ] BUI: Loaded 11484 existing records from primary storage. [2025-09-18T17:51:18.508775] [INFO ] [MAIN ] BUI: Loaded 11484 existing records. [2025-09-18T17:51:18.702272] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:51:18.702575] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-18T17:51:18.702671] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-18T17:51:18.703089] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-09-18T17:51:18.703151] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-18T17:51:18.927567] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-18T17:51:19.091058] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:51:19.719545] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-11. [2025-09-18T17:51:19.794390] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-18T17:51:19.947946] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-18T17:51:20.519607] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-09. [2025-09-18T17:51:20.578734] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-18T17:51:21.319551] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-09-18T17:51:21.570461] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-18T17:51:21.575256] [INFO ] [REMOTE ] BTX: Full fetch complete (34889 records). [2025-09-18T17:51:21.575378] [DEBUG] [VALIDATOR ] BTX: Validating primary data. [2025-09-18T17:51:21.802304] [WARN ] [VALIDATOR ] BTX: Validation failed - insufficient historical data. Have 146 unique days, need 200 days [2025-09-18T17:51:21.803192] [FATAL] [MAIN ] BTX: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:51:21.803353] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:51:21.803633] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-18T17:51:21.804064] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-18T17:51:21.804149] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-18T17:51:21.809507] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-18T17:51:21.814170] [INFO ] [MAIN ] Update Progress: 355/2372 symbols completed. BTX took 36.9s. Estimated remaining: 4h 51m 30s. Rate: 6.9 symbols/min [2025-09-18T17:51:21.815992] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-18T17:51:21.999948] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:51:22.053756] [DEBUG] [LOCAL ] BUR: Loaded 45131 existing records from primary storage. [2025-09-18T17:51:22.053960] [INFO ] [MAIN ] BUR: Loaded 45131 existing records. [2025-09-18T17:51:22.124744] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-09-18T17:51:22.238102] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:51:22.238417] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-18T17:51:22.238482] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-18T17:51:22.239753] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-09-18T17:51:22.239816] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-18T17:51:22.598840] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:51:22.919600] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-11. [2025-09-18T17:51:22.967125] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T17:51:23.719568] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-18T17:51:24.396004] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-18T17:51:24.454199] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-18T17:51:24.519542] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-18T17:51:25.319556] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-09-18T17:51:25.698741] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-18T17:51:25.704723] [INFO ] [REMOTE ] BTZ: Full fetch complete (34006 records). [2025-09-18T17:51:25.704895] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-18T17:51:26.129695] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-18T17:51:26.154275] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-09-18T17:51:26.154389] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-09-18T17:51:26.154888] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-09-18T17:51:26.154962] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-09-18T17:51:26.156108] [DEBUG] [LOCAL ] BTZ: Trimmed 34006 records to 23255 (keeping 200 days of data) [2025-09-18T17:51:26.302884] [DEBUG] [LOCAL ] BTZ: Primary data saved (23255 records). [2025-09-18T17:51:26.303046] [INFO ] [MAIN ] BTZ: Full history saved. [2025-09-18T17:51:26.303141] [INFO ] [MAIN ] Update Progress: 356/2372 symbols completed. BTZ took 34.1s. Estimated remaining: 4h 50m 58s. Rate: 6.9 symbols/min [2025-09-18T17:51:26.488994] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:51:26.544487] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-18T17:51:26.567851] [DEBUG] [LOCAL ] BURL: Loaded 46560 existing records from primary storage. [2025-09-18T17:51:26.568005] [INFO ] [MAIN ] BURL: Loaded 46560 existing records. [2025-09-18T17:51:26.754886] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:51:26.755241] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-18T17:51:26.755300] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-18T17:51:26.756295] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-18T17:51:26.756358] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-18T17:51:26.924321] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-18T17:51:27.139310] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:51:27.598566] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-18T17:51:27.719596] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-18T17:51:28.213682] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-18T17:51:28.350000] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-18T17:51:28.519581] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-11. [2025-09-18T17:51:29.319589] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-09-18T17:51:30.067829] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-18T17:51:30.119586] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-18T17:51:30.762316] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-18T17:51:30.919700] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-09-18T17:51:31.719579] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-18T17:51:31.902422] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-18T17:51:32.243326] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-18T17:51:32.519559] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-09-18T17:51:32.656544] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-18T17:51:33.319593] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-18T17:51:33.866807] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-18T17:51:33.909403] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-18T17:51:34.119529] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-18T17:51:34.722806] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-18T17:51:34.919509] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-18T17:51:35.719627] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-18T17:51:36.328844] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T17:51:36.519568] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-18T17:51:37.284367] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-18T17:51:37.319497] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-18T17:51:38.120216] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-18T17:51:38.132532] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T17:51:38.643384] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T17:51:38.725939] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-18T17:51:38.919525] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-18T17:51:39.719548] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-18T17:51:40.519570] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-18T17:51:40.535127] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-18T17:51:40.792002] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-18T17:51:41.319610] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-18T17:51:42.001441] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-18T17:51:42.004000] [INFO ] [REMOTE ] BUI: Full fetch complete (16108 records). [2025-09-18T17:51:42.004081] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-18T17:51:42.121474] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-18T17:51:42.401393] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-09-18T17:51:42.401499] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-09-18T17:51:42.401944] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-09-18T17:51:42.402060] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-09-18T17:51:42.403283] [DEBUG] [LOCAL ] BUI: Trimmed 16108 records to 11572 (keeping 200 days of data) [2025-09-18T17:51:42.464877] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-18T17:51:42.519250] [DEBUG] [LOCAL ] BUI: Primary data saved (11572 records). [2025-09-18T17:51:42.519400] [INFO ] [MAIN ] BUI: Full history saved. [2025-09-18T17:51:42.519491] [INFO ] [MAIN ] Update Progress: 357/2372 symbols completed. BUI took 24.2s. Estimated remaining: 4h 51m 32s. Rate: 6.9 symbols/min [2025-09-18T17:51:42.919603] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-18T17:51:43.593316] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-18T17:51:43.719522] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-18T17:51:44.519603] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-18T17:51:44.729435] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-18T17:51:44.990143] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-18T17:51:45.319555] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-18T17:51:45.980143] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-18T17:51:46.119524] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-18T17:51:46.919551] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-18T17:51:47.314351] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-18T17:51:47.354437] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-18T17:51:47.719559] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-18T17:51:48.358429] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T17:51:48.519540] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-18T17:51:49.319696] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-18T17:51:49.461108] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-18T17:51:49.821690] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-18T17:51:50.119613] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-18T17:51:50.919543] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-18T17:51:51.014166] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-18T17:51:51.324877] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-18T17:51:51.719589] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-18T17:51:52.458531] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-18T17:51:52.519608] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-18T17:51:53.173108] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T17:51:53.179446] [INFO ] [REMOTE ] BUR: Full fetch complete (63030 records). [2025-09-18T17:51:53.179574] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-18T17:51:53.324759] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-18T17:51:53.577532] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-09-18T17:51:53.577625] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-09-18T17:51:53.578404] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-09-18T17:51:53.578560] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-09-18T17:51:53.580032] [DEBUG] [LOCAL ] BUR: Trimmed 63030 records to 45435 (keeping 200 days of data) [2025-09-18T17:51:53.857144] [DEBUG] [LOCAL ] BUR: Primary data saved (45435 records). [2025-09-18T17:51:53.857288] [INFO ] [MAIN ] BUR: Full history saved. [2025-09-18T17:51:53.857377] [INFO ] [MAIN ] Update Progress: 358/2372 symbols completed. BUR took 32.0s. Estimated remaining: 4h 51m 38s. Rate: 6.9 symbols/min [2025-09-18T17:51:54.183244] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-18T17:51:54.189820] [INFO ] [REMOTE ] BURL: Full fetch complete (65626 records). [2025-09-18T17:51:54.189941] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-18T17:51:54.596050] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-18T17:51:54.596151] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-18T17:51:54.596886] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-18T17:51:54.596952] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-18T17:51:54.598306] [DEBUG] [LOCAL ] BURL: Trimmed 65626 records to 46881 (keeping 200 days of data) [2025-09-18T17:51:54.886636] [DEBUG] [LOCAL ] BURL: Primary data saved (46881 records). [2025-09-18T17:51:54.886819] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-18T17:51:54.887608] [INFO ] [MAIN ] Update Progress: 359/2372 symbols completed. BURL took 28.6s. Estimated remaining: 4h 50m 47s. Rate: 6.9 symbols/min [2025-09-18T17:51:55.304169] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-18T17:51:55.312311] [INFO ] [REMOTE ] BUD: Full fetch complete (76355 records). [2025-09-18T17:51:55.312502] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-18T17:51:55.731502] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-09-18T17:51:55.731612] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-09-18T17:51:55.732569] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-09-18T17:51:55.732636] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-09-18T17:51:55.734829] [DEBUG] [LOCAL ] BUD: Trimmed 76355 records to 53148 (keeping 200 days of data) [2025-09-18T17:51:56.091442] [DEBUG] [LOCAL ] BUD: Primary data saved (53148 records). [2025-09-18T17:51:56.091724] [INFO ] [MAIN ] BUD: Full history saved. [2025-09-18T17:51:56.091879] [INFO ] [MAIN ] Update Progress: 360/2372 symbols completed. BUD took 54.0s. Estimated remaining: 4h 49m 56s. Rate: 6.9 symbols/min [2025-09-18T17:51:56.734899] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:51:56.773759] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:51:56.807459] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:51:56.862412] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:51:56.896789] [DEBUG] [LOCAL ] BUXX: Loaded 15219 existing records from primary storage. [2025-09-18T17:51:56.897065] [INFO ] [MAIN ] BUXX: Loaded 15219 existing records. [2025-09-18T17:51:57.076536] [DEBUG] [LOCAL ] BW: Loaded 39420 existing records from primary storage. [2025-09-18T17:51:57.077716] [DEBUG] [LOCAL ] BV: Loaded 38644 existing records from primary storage. [2025-09-18T17:51:57.094062] [INFO ] [MAIN ] BW: Loaded 39420 existing records. [2025-09-18T17:51:57.100235] [INFO ] [MAIN ] BV: Loaded 38644 existing records. [2025-09-18T17:51:57.100132] [DEBUG] [LOCAL ] BVN: Loaded 43498 existing records from primary storage. [2025-09-18T17:51:57.222833] [INFO ] [MAIN ] BVN: Loaded 43498 existing records. [2025-09-18T17:51:57.346427] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:51:57.412550] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-18T17:51:57.413478] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-18T17:51:57.489490] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-09-18T17:51:57.529518] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-18T17:51:57.673877] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:51:57.738402] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:51:57.759569] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-18T17:51:57.776566] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-18T17:51:57.776728] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-18T17:51:57.776917] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-18T17:51:57.829891] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-09-18T17:51:57.829828] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-18T17:51:57.833255] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-18T17:51:57.856421] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-18T17:51:57.947056] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:51:58.072713] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-18T17:51:58.104455] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-18T17:51:58.218559] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-09-18T17:51:58.260005] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-18T17:51:58.729779] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:51:58.802887] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-11. [2025-09-18T17:51:59.022807] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:51:59.051214] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-11. [2025-09-18T17:51:59.101488] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:51:59.105387] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-11. [2025-09-18T17:51:59.319538] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:51:59.319939] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-11. [2025-09-18T17:51:59.604849] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-18T17:51:59.607799] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-09-18T17:52:00.172595] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-18T17:52:00.175772] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-09-18T17:52:00.621074] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-18T17:52:00.628150] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-09-18T17:52:00.709962] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-18T17:52:00.718327] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-09-18T17:52:00.734142] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-18T17:52:00.736959] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-18T17:52:01.202760] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-18T17:52:01.217965] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-18T17:52:01.319529] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-09-18T17:52:01.657384] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-18T17:52:02.008986] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-18T17:52:02.119543] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-09-18T17:52:02.595251] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-18T17:52:02.919546] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-09-18T17:52:03.368255] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T17:52:03.719559] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-09-18T17:52:04.380144] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-18T17:52:04.519574] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-18T17:52:05.215489] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-18T17:52:05.263998] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-18T17:52:05.319536] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-18T17:52:06.119552] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-18T17:52:06.367280] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-18T17:52:06.919550] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-18T17:52:07.239960] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-18T17:52:07.719551] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-18T17:52:08.336041] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T17:52:08.519560] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-18T17:52:08.867808] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-18T17:52:09.319559] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-18T17:52:10.036504] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-18T17:52:10.119549] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-18T17:52:10.315847] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-18T17:52:10.919549] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-18T17:52:11.611356] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-18T17:52:11.719523] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-18T17:52:12.306291] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-18T17:52:12.519544] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-18T17:52:13.236387] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-18T17:52:13.319497] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-18T17:52:13.764127] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-18T17:52:14.119524] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-18T17:52:14.555482] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T17:52:14.919556] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-18T17:52:15.316337] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-18T17:52:15.719559] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-18T17:52:16.163500] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-18T17:52:16.519566] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-18T17:52:16.870255] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-18T17:52:17.319588] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-18T17:52:17.676444] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-18T17:52:18.119539] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-18T17:52:18.502093] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-18T17:52:18.919552] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-18T17:52:19.654358] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T17:52:19.719564] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-18T17:52:20.012457] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-18T17:52:20.394801] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-18T17:52:20.519544] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-18T17:52:21.319545] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-18T17:52:21.580174] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-18T17:52:22.119543] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-18T17:52:22.909122] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T17:52:22.919632] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-18T17:52:23.414941] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T17:52:23.440055] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-18T17:52:23.719549] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-18T17:52:24.519541] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-18T17:52:25.292826] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-18T17:52:25.299819] [INFO ] [REMOTE ] BW: Full fetch complete (58515 records). [2025-09-18T17:52:25.299940] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-18T17:52:25.324639] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-18T17:52:25.630064] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-18T17:52:25.648524] [INFO ] [REMOTE ] BUXX: Full fetch complete (20223 records). [2025-09-18T17:52:25.671571] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-18T17:52:25.786256] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-18T17:52:25.801345] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-18T17:52:25.813603] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-18T17:52:25.833754] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-18T17:52:25.895598] [DEBUG] [LOCAL ] BW: Trimmed 58515 records to 39797 (keeping 200 days of data) [2025-09-18T17:52:26.120769] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-18T17:52:26.205745] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-09-18T17:52:26.206619] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-09-18T17:52:26.207282] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-18T17:52:26.207901] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-09-18T17:52:26.211289] [DEBUG] [LOCAL ] BUXX: Trimmed 20223 records to 15320 (keeping 200 days of data) [2025-09-18T17:52:26.321629] [DEBUG] [LOCAL ] BUXX: Primary data saved (15320 records). [2025-09-18T17:52:26.322633] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-18T17:52:26.323015] [INFO ] [MAIN ] Update Progress: 361/2372 symbols completed. BUXX took 30.2s. Estimated remaining: 4h 51m 48s. Rate: 6.9 symbols/min [2025-09-18T17:52:26.584952] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:52:26.635938] [DEBUG] [LOCAL ] BW: Primary data saved (39797 records). [2025-09-18T17:52:26.636268] [INFO ] [MAIN ] BW: Full history saved. [2025-09-18T17:52:26.636396] [INFO ] [MAIN ] Update Progress: 362/2372 symbols completed. BW took 30.5s. Estimated remaining: 4h 50m 53s. Rate: 6.9 symbols/min [2025-09-18T17:52:26.779287] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T17:52:26.863551] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:52:26.864970] [DEBUG] [LOCAL ] BWA: Loaded 52274 existing records from primary storage. [2025-09-18T17:52:26.865762] [INFO ] [MAIN ] BWA: Loaded 52274 existing records. [2025-09-18T17:52:26.929709] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-18T17:52:27.017032] [DEBUG] [LOCAL ] BWG: Loaded 12306 existing records from primary storage. [2025-09-18T17:52:27.027713] [INFO ] [MAIN ] BWG: Loaded 12306 existing records. [2025-09-18T17:52:27.134635] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:52:27.162856] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-18T17:52:27.163236] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-18T17:52:27.185571] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-18T17:52:27.203361] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-18T17:52:27.290208] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:52:27.323990] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-18T17:52:27.340549] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-18T17:52:27.356846] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-18T17:52:27.362028] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-18T17:52:27.872482] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:52:27.881693] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-11. [2025-09-18T17:52:28.002241] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:52:28.029134] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-18T17:52:28.190559] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-18T17:52:28.196360] [INFO ] [REMOTE ] BV: Full fetch complete (53581 records). [2025-09-18T17:52:28.196457] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-18T17:52:28.524705] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-11. [2025-09-18T17:52:28.577335] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-09-18T17:52:28.577410] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-09-18T17:52:28.578007] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-09-18T17:52:28.578071] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-09-18T17:52:28.579161] [DEBUG] [LOCAL ] BV: Trimmed 53581 records to 38955 (keeping 200 days of data) [2025-09-18T17:52:28.801262] [DEBUG] [LOCAL ] BV: Primary data saved (38955 records). [2025-09-18T17:52:28.801401] [INFO ] [MAIN ] BV: Full history saved. [2025-09-18T17:52:28.801488] [INFO ] [MAIN ] Update Progress: 363/2372 symbols completed. BV took 32.7s. Estimated remaining: 4h 50m 8s. Rate: 6.9 symbols/min [2025-09-18T17:52:28.973213] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:52:29.007492] [DEBUG] [LOCAL ] BWLP: Loaded 33011 existing records from primary storage. [2025-09-18T17:52:29.007673] [INFO ] [MAIN ] BWLP: Loaded 33011 existing records. [2025-09-18T17:52:29.187418] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:52:29.187735] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-18T17:52:29.187813] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-18T17:52:29.188903] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-09-18T17:52:29.188967] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-18T17:52:29.324681] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-18T17:52:29.503172] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-18T17:52:29.581419] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:52:29.647457] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-18T17:52:30.119533] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-09-18T17:52:30.694870] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-18T17:52:30.865694] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-18T17:52:30.919597] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-11. [2025-09-18T17:52:31.719545] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-18T17:52:32.036213] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T17:52:32.519584] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-09-18T17:52:33.319620] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-09-18T17:52:33.372580] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-18T17:52:33.395023] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-18T17:52:33.399841] [INFO ] [REMOTE ] BVN: Full fetch complete (62390 records). [2025-09-18T17:52:33.399989] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-18T17:52:33.793274] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-09-18T17:52:33.793365] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-09-18T17:52:33.794108] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-09-18T17:52:33.794174] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-09-18T17:52:33.796255] [DEBUG] [LOCAL ] BVN: Trimmed 62390 records to 43859 (keeping 200 days of data) [2025-09-18T17:52:34.056124] [DEBUG] [LOCAL ] BVN: Primary data saved (43859 records). [2025-09-18T17:52:34.056271] [INFO ] [MAIN ] BVN: Full history saved. [2025-09-18T17:52:34.056361] [INFO ] [MAIN ] Update Progress: 364/2372 symbols completed. BVN took 38.0s. Estimated remaining: 4h 49m 40s. Rate: 6.9 symbols/min [2025-09-18T17:52:34.124796] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-18T17:52:34.237379] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:52:34.247802] [DEBUG] [LOCAL ] BWMX: Loaded 7579 existing records from primary storage. [2025-09-18T17:52:34.247925] [INFO ] [MAIN ] BWMX: Loaded 7579 existing records. [2025-09-18T17:52:34.435623] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:52:34.435933] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-18T17:52:34.436014] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-18T17:52:34.436400] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-09-18T17:52:34.436460] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-18T17:52:34.807858] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:52:34.887446] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-18T17:52:34.919496] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-09-18T17:52:35.004081] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-18T17:52:35.719546] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-11. [2025-09-18T17:52:36.403486] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-18T17:52:36.425541] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-18T17:52:36.519568] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-18T17:52:37.319573] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-09-18T17:52:38.124677] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-18T17:52:38.144831] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-18T17:52:38.566862] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-18T17:52:38.688304] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-18T17:52:38.919685] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-18T17:52:39.719605] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-09-18T17:52:39.937489] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-18T17:52:40.235049] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-18T17:52:40.519567] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-18T17:52:41.319549] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-18T17:52:41.428773] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-18T17:52:42.119629] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-09-18T17:52:42.730538] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-18T17:52:42.926718] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-09-18T17:52:42.963163] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T17:52:43.719579] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-18T17:52:44.258760] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-18T17:52:44.325194] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-18T17:52:44.519591] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-18T17:52:44.925238] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-18T17:52:45.319587] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-18T17:52:46.036357] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-18T17:52:46.119510] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-18T17:52:46.866812] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-18T17:52:46.919550] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-18T17:52:47.719559] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-18T17:52:47.857204] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-18T17:52:47.859895] [INFO ] [REMOTE ] BWG: Full fetch complete (17568 records). [2025-09-18T17:52:47.859979] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-18T17:52:48.256903] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-09-18T17:52:48.257005] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-09-18T17:52:48.257725] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-09-18T17:52:48.257812] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-09-18T17:52:48.258791] [DEBUG] [LOCAL ] BWG: Trimmed 17568 records to 12419 (keeping 200 days of data) [2025-09-18T17:52:48.331558] [DEBUG] [LOCAL ] BWG: Primary data saved (12419 records). [2025-09-18T17:52:48.331737] [INFO ] [MAIN ] BWG: Full history saved. [2025-09-18T17:52:48.331898] [INFO ] [MAIN ] Update Progress: 365/2372 symbols completed. BWG took 21.7s. Estimated remaining: 4h 50m 3s. Rate: 6.9 symbols/min [2025-09-18T17:52:48.502810] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:52:48.509890] [DEBUG] [LOCAL ] BWNB: Loaded 4492 existing records from primary storage. [2025-09-18T17:52:48.509992] [INFO ] [MAIN ] BWNB: Loaded 4492 existing records. [2025-09-18T17:52:48.524718] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-18T17:52:48.690874] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:52:48.691137] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-18T17:52:48.691186] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-18T17:52:48.691438] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-09-18T17:52:48.691514] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-18T17:52:49.049685] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:52:49.232831] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-18T17:52:49.315141] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-18T17:52:49.319496] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-18T17:52:49.787141] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-18T17:52:50.119553] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-18T17:52:50.739142] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-18T17:52:50.919591] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-18T17:52:51.719602] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-11. [2025-09-18T17:52:52.519575] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-18T17:52:52.617548] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-18T17:52:52.647232] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-18T17:52:53.016475] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-18T17:52:53.319561] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-09-18T17:52:53.881477] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-18T17:52:54.119559] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-18T17:52:54.919543] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-18T17:52:55.606911] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T17:52:55.622361] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-18T17:52:55.719535] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-09-18T17:52:56.173893] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-18T17:52:56.519552] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-18T17:52:57.091760] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-18T17:52:57.319547] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-18T17:52:58.119587] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-18T17:52:58.149738] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-18T17:52:58.458929] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-18T17:52:58.919551] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-18T17:52:59.719544] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-18T17:53:00.182310] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-18T17:53:00.519554] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-18T17:53:01.115228] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-18T17:53:01.319534] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-18T17:53:01.512099] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-18T17:53:02.119546] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-18T17:53:02.502032] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-18T17:53:02.919555] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-18T17:53:03.719507] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-18T17:53:03.877241] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-18T17:53:03.900976] [INFO ] [REMOTE ] BWMX: Full fetch complete (10044 records). [2025-09-18T17:53:03.903212] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-18T17:53:03.903461] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-18T17:53:04.284277] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-09-18T17:53:04.284388] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-09-18T17:53:04.284711] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-09-18T17:53:04.284776] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-09-18T17:53:04.285415] [DEBUG] [LOCAL ] BWMX: Trimmed 10044 records to 7627 (keeping 200 days of data) [2025-09-18T17:53:04.338203] [DEBUG] [LOCAL ] BWMX: Primary data saved (7627 records). [2025-09-18T17:53:04.338357] [INFO ] [MAIN ] BWMX: Full history saved. [2025-09-18T17:53:04.338506] [INFO ] [MAIN ] Update Progress: 366/2372 symbols completed. BWMX took 30.3s. Estimated remaining: 4h 50m 34s. Rate: 6.9 symbols/min [2025-09-18T17:53:04.509435] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:53:04.509666] [DEBUG] [LOCAL ] BWSN: No existing data file found in primary storage. [2025-09-18T17:53:04.509763] [WARN ] [MAIN ] BWSN: No existing data found, performing full refresh instead. [2025-09-18T17:53:04.509916] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-18T17:53:04.509973] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-18T17:53:04.510042] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-09-18T17:53:04.510078] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-18T17:53:04.524799] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-18T17:53:04.896017] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:53:04.921915] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-18T17:53:05.259294] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-18T17:53:05.319508] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-18T17:53:05.792493] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-18T17:53:06.119558] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-18T17:53:06.919562] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-11. [2025-09-18T17:53:07.610521] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-18T17:53:07.710577] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T17:53:07.721329] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-18T17:53:08.519546] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-18T17:53:09.101695] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T17:53:09.319607] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-18T17:53:09.629941] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-18T17:53:10.119528] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-18T17:53:10.312336] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-18T17:53:10.323632] [INFO ] [REMOTE ] BWA: Full fetch complete (75591 records). [2025-09-18T17:53:10.323800] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-18T17:53:10.648390] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-18T17:53:10.752764] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-09-18T17:53:10.752941] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-09-18T17:53:10.753828] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-09-18T17:53:10.753896] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-09-18T17:53:10.756033] [DEBUG] [LOCAL ] BWA: Trimmed 75591 records to 52658 (keeping 200 days of data) [2025-09-18T17:53:10.948553] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-18T17:53:11.099963] [DEBUG] [LOCAL ] BWA: Primary data saved (52658 records). [2025-09-18T17:53:11.100122] [INFO ] [MAIN ] BWA: Full history saved. [2025-09-18T17:53:11.100252] [INFO ] [MAIN ] Update Progress: 367/2372 symbols completed. BWA took 44.8s. Estimated remaining: 4h 50m 15s. Rate: 6.9 symbols/min [2025-09-18T17:53:11.275226] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:53:11.324956] [DEBUG] [LOCAL ] BWXT: Loaded 46675 existing records from primary storage. [2025-09-18T17:53:11.325134] [INFO ] [MAIN ] BWXT: Loaded 46675 existing records. [2025-09-18T17:53:11.516878] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:53:11.517452] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-18T17:53:11.517554] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-18T17:53:11.519132] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-09-18T17:53:11.519219] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-18T17:53:11.730633] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-09-18T17:53:11.890429] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:53:12.231943] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-18T17:53:12.253226] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-18T17:53:12.519577] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-18T17:53:13.025532] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-18T17:53:13.026790] [INFO ] [REMOTE ] BWNB: Full fetch complete (5741 records). [2025-09-18T17:53:13.026865] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-18T17:53:13.324617] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-18T17:53:13.397163] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-09-18T17:53:13.397249] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-09-18T17:53:13.397416] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-09-18T17:53:13.397455] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-09-18T17:53:13.397881] [DEBUG] [LOCAL ] BWNB: Trimmed 5741 records to 4527 (keeping 200 days of data) [2025-09-18T17:53:13.428725] [DEBUG] [LOCAL ] BWNB: Primary data saved (4527 records). [2025-09-18T17:53:13.428812] [INFO ] [MAIN ] BWNB: Full history saved. [2025-09-18T17:53:13.428925] [INFO ] [MAIN ] Update Progress: 368/2372 symbols completed. BWNB took 25.1s. Estimated remaining: 4h 49m 32s. Rate: 6.9 symbols/min [2025-09-18T17:53:13.598765] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:53:13.673773] [DEBUG] [LOCAL ] BX: Loaded 53505 existing records from primary storage. [2025-09-18T17:53:13.673983] [INFO ] [MAIN ] BX: Loaded 53505 existing records. [2025-09-18T17:53:13.852704] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:53:13.852976] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-18T17:53:13.853024] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-18T17:53:13.854747] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-09-18T17:53:13.854810] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-18T17:53:14.124665] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-11. [2025-09-18T17:53:14.221294] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:53:14.919514] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-09-18T17:53:14.982150] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-18T17:53:15.312531] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-18T17:53:15.598292] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-18T17:53:15.719544] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-18T17:53:16.519565] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-11. [2025-09-18T17:53:16.949443] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-18T17:53:16.954767] [INFO ] [REMOTE ] BWLP: Full fetch complete (48747 records). [2025-09-18T17:53:16.954947] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-18T17:53:17.329726] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-18T17:53:17.348157] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-09-18T17:53:17.348269] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-09-18T17:53:17.348907] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-09-18T17:53:17.348972] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-09-18T17:53:17.350269] [DEBUG] [LOCAL ] BWLP: Trimmed 48747 records to 33217 (keeping 200 days of data) [2025-09-18T17:53:17.571891] [DEBUG] [LOCAL ] BWLP: Primary data saved (33217 records). [2025-09-18T17:53:17.572065] [INFO ] [MAIN ] BWLP: Full history saved. [2025-09-18T17:53:17.572199] [INFO ] [MAIN ] Update Progress: 369/2372 symbols completed. BWLP took 48.8s. Estimated remaining: 4h 48m 58s. Rate: 6.9 symbols/min [2025-09-18T17:53:17.762343] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:53:17.782212] [DEBUG] [LOCAL ] BXC: Loaded 13601 existing records from primary storage. [2025-09-18T17:53:17.782407] [INFO ] [MAIN ] BXC: Loaded 13601 existing records. [2025-09-18T17:53:17.972278] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:53:17.972583] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-18T17:53:17.972684] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-18T17:53:17.973482] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-09-18T17:53:17.973566] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-18T17:53:18.126592] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-09-18T17:53:18.155818] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-18T17:53:18.353758] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:53:18.503551] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-11 (1.98 seconds). [2025-09-18T17:53:18.919560] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-11. [2025-09-18T17:53:19.657041] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-18T17:53:19.692667] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-18T17:53:19.719509] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-09-18T17:53:20.519578] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-09-18T17:53:21.067340] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-18T17:53:21.199054] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-18T17:53:21.319548] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-18T17:53:21.869764] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-18T17:53:22.119549] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-18T17:53:22.560785] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-18T17:53:22.919545] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-09-18T17:53:23.719549] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-09-18T17:53:24.514237] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-18T17:53:24.519488] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-18T17:53:24.765617] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-18T17:53:25.142570] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-18T17:53:25.319555] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-18T17:53:26.124206] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-09-18T17:53:26.126134] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-18T17:53:26.919574] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-18T17:53:27.484911] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-18T17:53:27.719534] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-18T17:53:27.849877] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-18T17:53:28.345403] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-18T17:53:28.519624] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-18T17:53:28.923701] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-18T17:53:29.319629] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-18T17:53:29.964008] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-18T17:53:30.119632] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-18T17:53:30.919622] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-18T17:53:31.472077] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-18T17:53:31.473137] [INFO ] [REMOTE ] BWSN: Full fetch complete (6199 records). [2025-09-18T17:53:31.473206] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-18T17:53:31.724693] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-18T17:53:31.856552] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-09-18T17:53:31.856687] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-09-18T17:53:31.856954] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-09-18T17:53:31.857098] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-09-18T17:53:31.857832] [DEBUG] [LOCAL ] BWSN: Trimmed 6199 records to 5136 (keeping 200 days of data) [2025-09-18T17:53:31.888270] [DEBUG] [LOCAL ] BWSN: Primary data saved (5136 records). [2025-09-18T17:53:31.888358] [INFO ] [MAIN ] BWSN: Full history saved. [2025-09-18T17:53:31.888429] [INFO ] [MAIN ] Update Progress: 370/2372 symbols completed. BWSN took 27.5s. Estimated remaining: 4h 49m 20s. Rate: 6.9 symbols/min [2025-09-18T17:53:32.063637] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-18T17:53:32.101802] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:53:32.172358] [DEBUG] [LOCAL ] BXMT: Loaded 47253 existing records from primary storage. [2025-09-18T17:53:32.172524] [INFO ] [MAIN ] BXMT: Loaded 47253 existing records. [2025-09-18T17:53:32.395550] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:53:32.395838] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-18T17:53:32.395888] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-18T17:53:32.397182] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-18T17:53:32.397243] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-18T17:53:32.524728] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-18T17:53:32.759527] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:53:33.319586] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-18T17:53:33.564609] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-18T17:53:33.717481] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-18T17:53:34.119540] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-18T17:53:34.837198] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-18T17:53:34.863218] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-18T17:53:34.919757] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-18T17:53:35.649077] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-18T17:53:35.719596] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-11. [2025-09-18T17:53:36.519563] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-18T17:53:37.319532] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-18T17:53:37.408631] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-18T17:53:37.930461] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-18T17:53:38.119624] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-09-18T17:53:38.919538] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-18T17:53:39.098752] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-18T17:53:39.466276] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-18T17:53:39.719603] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-18T17:53:40.495757] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T17:53:40.519551] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-18T17:53:40.541509] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-18T17:53:41.319582] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-18T17:53:42.119571] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-09-18T17:53:42.294987] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-18T17:53:42.315202] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-18T17:53:42.919558] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-18T17:53:43.600795] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-18T17:53:43.719582] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-18T17:53:44.519563] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-18T17:53:44.677487] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-18T17:53:45.319561] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-18T17:53:45.366081] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-18T17:53:46.119561] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-18T17:53:46.213040] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-18T17:53:46.215299] [INFO ] [REMOTE ] BXC: Full fetch complete (17479 records). [2025-09-18T17:53:46.215373] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-18T17:53:46.613244] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-18T17:53:46.656608] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-09-18T17:53:46.657027] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-09-18T17:53:46.657509] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-09-18T17:53:46.657604] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-09-18T17:53:46.658601] [DEBUG] [LOCAL ] BXC: Trimmed 17479 records to 13710 (keeping 200 days of data) [2025-09-18T17:53:46.741086] [DEBUG] [LOCAL ] BXC: Primary data saved (13710 records). [2025-09-18T17:53:46.741291] [INFO ] [MAIN ] BXC: Full history saved. [2025-09-18T17:53:46.741385] [INFO ] [MAIN ] Update Progress: 371/2372 symbols completed. BXC took 29.2s. Estimated remaining: 4h 49m 45s. Rate: 6.9 symbols/min [2025-09-18T17:53:46.916566] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:53:46.919540] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-18T17:53:46.939911] [DEBUG] [LOCAL ] BXMX: Loaded 19632 existing records from primary storage. [2025-09-18T17:53:46.940069] [INFO ] [MAIN ] BXMX: Loaded 19632 existing records. [2025-09-18T17:53:47.133937] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:53:47.134244] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-18T17:53:47.134301] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-18T17:53:47.134799] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-09-18T17:53:47.134858] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-18T17:53:47.539357] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:53:47.724304] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-18T17:53:47.731796] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T17:53:48.481057] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-18T17:53:48.519568] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-18T17:53:49.319574] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-11. [2025-09-18T17:53:49.440696] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-18T17:53:50.119605] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-18T17:53:50.287622] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-18T17:53:50.335681] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-18T17:53:50.919599] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-09-18T17:53:51.727428] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-18T17:53:51.728870] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-18T17:53:51.767082] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-18T17:53:52.519597] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-09-18T17:53:53.292181] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T17:53:53.319520] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-18T17:53:53.344268] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T17:53:54.119541] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-18T17:53:54.919551] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-18T17:53:55.072764] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-18T17:53:55.079340] [INFO ] [REMOTE ] BWXT: Full fetch complete (66891 records). [2025-09-18T17:53:55.079460] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-18T17:53:55.492119] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-09-18T17:53:55.492369] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-09-18T17:53:55.493342] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-09-18T17:53:55.493424] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-09-18T17:53:55.495634] [DEBUG] [LOCAL ] BWXT: Trimmed 66891 records to 47026 (keeping 200 days of data) [2025-09-18T17:53:55.621735] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T17:53:55.723391] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-18T17:53:55.833803] [DEBUG] [LOCAL ] BWXT: Primary data saved (47026 records). [2025-09-18T17:53:55.833991] [INFO ] [MAIN ] BWXT: Full history saved. [2025-09-18T17:53:55.834093] [INFO ] [MAIN ] Update Progress: 372/2372 symbols completed. BWXT took 44.7s. Estimated remaining: 4h 49m 39s. Rate: 6.9 symbols/min [2025-09-18T17:53:56.009738] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:53:56.024262] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-18T17:53:56.068877] [DEBUG] [LOCAL ] BXP: Loaded 49903 existing records from primary storage. [2025-09-18T17:53:56.069045] [INFO ] [MAIN ] BXP: Loaded 49903 existing records. [2025-09-18T17:53:56.245479] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:53:56.245804] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-18T17:53:56.245872] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-18T17:53:56.247302] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-09-18T17:53:56.247367] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-18T17:53:56.527373] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-18T17:53:56.620935] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:53:57.319562] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-18T17:53:57.466949] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T17:53:57.714221] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-18T17:53:58.119541] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-11. [2025-09-18T17:53:58.919559] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-18T17:53:59.135576] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-18T17:53:59.416259] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-18T17:53:59.719579] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-18T17:54:00.519555] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-18T17:54:00.774060] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-18T17:54:01.228806] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-18T17:54:01.319542] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-09-18T17:54:01.514847] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-18T17:54:02.119542] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-18T17:54:02.603771] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-18T17:54:02.835814] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-18T17:54:02.919502] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-18T17:54:03.627329] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-18T17:54:03.719547] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-18T17:54:04.519563] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-18T17:54:04.867717] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-18T17:54:05.319633] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-09-18T17:54:06.119510] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-18T17:54:06.326122] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-18T17:54:06.333919] [INFO ] [REMOTE ] BX: Full fetch complete (77261 records). [2025-09-18T17:54:06.334083] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-18T17:54:06.754984] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-09-18T17:54:06.755097] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-09-18T17:54:06.756006] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-09-18T17:54:06.756129] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-09-18T17:54:06.757824] [DEBUG] [LOCAL ] BX: Trimmed 77261 records to 53891 (keeping 200 days of data) [2025-09-18T17:54:06.949261] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-18T17:54:07.138927] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-18T17:54:07.161324] [DEBUG] [LOCAL ] BX: Primary data saved (53891 records). [2025-09-18T17:54:07.161463] [INFO ] [MAIN ] BX: Full history saved. [2025-09-18T17:54:07.161548] [INFO ] [MAIN ] Update Progress: 373/2372 symbols completed. BX took 53.7s. Estimated remaining: 4h 49m 44s. Rate: 6.9 symbols/min [2025-09-18T17:54:07.354158] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:54:07.404240] [DEBUG] [LOCAL ] BXSL: Loaded 47370 existing records from primary storage. [2025-09-18T17:54:07.404414] [INFO ] [MAIN ] BXSL: Loaded 47370 existing records. [2025-09-18T17:54:07.601900] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:54:07.603053] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-18T17:54:07.608447] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-18T17:54:07.613552] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-18T17:54:07.627981] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-09-18T17:54:07.634782] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-18T17:54:07.641192] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T17:54:07.713360] [INFO ] [REMOTE ] BXMT: Full fetch complete (69207 records). [2025-09-18T17:54:07.724581] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-18T17:54:07.724719] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-18T17:54:08.387574] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:54:08.435587] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-09-18T17:54:08.435695] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-09-18T17:54:08.436462] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-09-18T17:54:08.436527] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-09-18T17:54:08.438016] [DEBUG] [LOCAL ] BXMT: Trimmed 69207 records to 47617 (keeping 200 days of data) [2025-09-18T17:54:08.531439] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-18T17:54:08.749075] [DEBUG] [LOCAL ] BXMT: Primary data saved (47617 records). [2025-09-18T17:54:08.749229] [INFO ] [MAIN ] BXMT: Full history saved. [2025-09-18T17:54:08.750630] [INFO ] [MAIN ] Update Progress: 374/2372 symbols completed. BXMT took 36.9s. Estimated remaining: 4h 48m 57s. Rate: 6.9 symbols/min [2025-09-18T17:54:08.928949] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:54:08.952399] [DEBUG] [LOCAL ] BY: Loaded 21446 existing records from primary storage. [2025-09-18T17:54:08.952566] [INFO ] [MAIN ] BY: Loaded 21446 existing records. [2025-09-18T17:54:09.134669] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:54:09.135088] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-18T17:54:09.135228] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-18T17:54:09.135922] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-09-18T17:54:09.136059] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-18T17:54:09.331395] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-11. [2025-09-18T17:54:09.474371] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-18T17:54:09.597032] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:54:09.619682] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-18T17:54:09.622840] [INFO ] [REMOTE ] BXMX: Full fetch complete (28594 records). [2025-09-18T17:54:09.622962] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-18T17:54:10.010175] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-09-18T17:54:10.010258] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-09-18T17:54:10.010677] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-09-18T17:54:10.010739] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-09-18T17:54:10.011672] [DEBUG] [LOCAL ] BXMX: Trimmed 28594 records to 19877 (keeping 200 days of data) [2025-09-18T17:54:10.127078] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-18T17:54:10.135012] [DEBUG] [LOCAL ] BXMX: Primary data saved (19877 records). [2025-09-18T17:54:10.135154] [INFO ] [MAIN ] BXMX: Full history saved. [2025-09-18T17:54:10.135242] [INFO ] [MAIN ] Update Progress: 375/2372 symbols completed. BXMX took 23.4s. Estimated remaining: 4h 48m 10s. Rate: 6.9 symbols/min [2025-09-18T17:54:10.320765] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:54:10.367500] [DEBUG] [LOCAL ] BYD: Loaded 45423 existing records from primary storage. [2025-09-18T17:54:10.367678] [INFO ] [MAIN ] BYD: Loaded 45423 existing records. [2025-09-18T17:54:10.547222] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:54:10.547488] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-18T17:54:10.547536] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-18T17:54:10.548816] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-09-18T17:54:10.548877] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-18T17:54:10.915815] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:54:10.919495] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-11. [2025-09-18T17:54:10.968301] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-18T17:54:11.727259] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-11. [2025-09-18T17:54:11.765778] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T17:54:12.519529] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-09-18T17:54:12.661202] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-18T17:54:12.692193] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-18T17:54:13.319553] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-09-18T17:54:13.913115] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T17:54:14.080698] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-18T17:54:14.119520] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-18T17:54:14.919554] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-09-18T17:54:15.652578] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-18T17:54:15.719494] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-18T17:54:15.938553] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-18T17:54:16.519542] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-09-18T17:54:17.192772] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-18T17:54:17.319543] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-09-18T17:54:17.844697] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T17:54:18.119542] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-09-18T17:54:18.919807] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-18T17:54:18.923180] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-18T17:54:19.479101] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-18T17:54:19.719561] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-18T17:54:19.771258] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-18T17:54:20.519603] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-18T17:54:21.197622] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-18T17:54:21.319561] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-18T17:54:22.095422] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-18T17:54:22.119483] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-18T17:54:22.557161] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T17:54:22.919548] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-18T17:54:23.709245] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-18T17:54:23.719540] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-18T17:54:24.519624] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-18T17:54:24.656003] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-18T17:54:25.283500] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-18T17:54:25.306633] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-18T17:54:25.319493] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-18T17:54:26.119550] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-18T17:54:26.532612] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-18T17:54:26.919561] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-18T17:54:27.599101] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T17:54:27.719600] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-18T17:54:27.911690] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-18T17:54:28.519618] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-18T17:54:29.190327] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T17:54:29.319585] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-18T17:54:29.936587] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T17:54:30.085005] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-18T17:54:30.119498] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-18T17:54:30.919533] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-18T17:54:31.305157] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-18T17:54:31.719551] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-18T17:54:32.267994] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-18T17:54:32.374346] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-18T17:54:32.519621] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-18T17:54:33.319629] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-18T17:54:33.417221] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-18T17:54:33.421620] [INFO ] [REMOTE ] BY: Full fetch complete (28778 records). [2025-09-18T17:54:33.421872] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-18T17:54:33.805029] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-09-18T17:54:33.805176] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-09-18T17:54:33.805637] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-09-18T17:54:33.805735] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-09-18T17:54:33.806599] [DEBUG] [LOCAL ] BY: Trimmed 28778 records to 21642 (keeping 200 days of data) [2025-09-18T17:54:33.936155] [DEBUG] [LOCAL ] BY: Primary data saved (21642 records). [2025-09-18T17:54:33.936300] [INFO ] [MAIN ] BY: Full history saved. [2025-09-18T17:54:33.936382] [INFO ] [MAIN ] Update Progress: 376/2372 symbols completed. BY took 25.2s. Estimated remaining: 4h 49m 22s. Rate: 6.9 symbols/min [2025-09-18T17:54:34.104448] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:54:34.117946] [DEBUG] [LOCAL ] BYM: Loaded 12343 existing records from primary storage. [2025-09-18T17:54:34.118066] [INFO ] [MAIN ] BYM: Loaded 12343 existing records. [2025-09-18T17:54:34.129288] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-18T17:54:34.329120] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:54:34.329515] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-18T17:54:34.329587] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-18T17:54:34.330216] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-09-18T17:54:34.330279] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-18T17:54:34.707286] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:54:34.759520] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-18T17:54:34.919557] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-11. [2025-09-18T17:54:35.719579] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-18T17:54:35.929015] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-18T17:54:35.930309] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T17:54:35.941133] [INFO ] [REMOTE ] BXP: Full fetch complete (71023 records). [2025-09-18T17:54:35.941370] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-18T17:54:36.330720] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-09-18T17:54:36.330813] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-09-18T17:54:36.331559] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-09-18T17:54:36.331604] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-09-18T17:54:36.333062] [DEBUG] [LOCAL ] BXP: Trimmed 71023 records to 50269 (keeping 200 days of data) [2025-09-18T17:54:36.542855] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-09-18T17:54:36.639377] [DEBUG] [LOCAL ] BXP: Primary data saved (50269 records). [2025-09-18T17:54:36.639521] [INFO ] [MAIN ] BXP: Full history saved. [2025-09-18T17:54:36.639621] [INFO ] [MAIN ] Update Progress: 377/2372 symbols completed. BXP took 40.8s. Estimated remaining: 4h 48m 41s. Rate: 6.9 symbols/min [2025-09-18T17:54:36.812159] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:54:36.849414] [DEBUG] [LOCAL ] BZH: Loaded 32957 existing records from primary storage. [2025-09-18T17:54:36.849561] [INFO ] [MAIN ] BZH: Loaded 32957 existing records. [2025-09-18T17:54:37.038301] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:54:37.038694] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-18T17:54:37.038860] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-18T17:54:37.039889] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-09-18T17:54:37.039954] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-18T17:54:37.312796] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T17:54:37.323744] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-18T17:54:37.463247] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-18T17:54:37.506401] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:54:38.119538] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-09-18T17:54:38.682082] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-18T17:54:38.681719] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-18T17:54:38.919576] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-18T17:54:39.691139] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-18T17:54:39.719504] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-18T17:54:40.519577] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-11. [2025-09-18T17:54:40.659484] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T17:54:41.319569] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-18T17:54:41.612252] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T17:54:42.057711] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-18T17:54:42.119573] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-18T17:54:42.919606] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-18T17:54:43.309263] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-18T17:54:43.719559] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-09-18T17:54:44.519595] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-18T17:54:44.678215] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-18T17:54:44.736908] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-18T17:54:45.074044] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-18T17:54:45.319596] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-09-18T17:54:46.119518] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-18T17:54:46.288978] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-18T17:54:46.919556] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-18T17:54:47.719631] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-18T17:54:47.857269] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-18T17:54:47.888609] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-18T17:54:48.519587] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-18T17:54:49.127592] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-18T17:54:49.157497] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-18T17:54:49.319578] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-18T17:54:50.119554] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-18T17:54:50.656634] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-18T17:54:50.662709] [INFO ] [REMOTE ] BYD: Full fetch complete (64905 records). [2025-09-18T17:54:50.662815] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-18T17:54:50.926158] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-18T17:54:51.061282] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-09-18T17:54:51.061364] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-09-18T17:54:51.062060] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-09-18T17:54:51.062144] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-09-18T17:54:51.063491] [DEBUG] [LOCAL ] BYD: Trimmed 64905 records to 45747 (keeping 200 days of data) [2025-09-18T17:54:51.369383] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T17:54:51.387409] [DEBUG] [LOCAL ] BYD: Primary data saved (45747 records). [2025-09-18T17:54:51.387510] [INFO ] [MAIN ] BYD: Full history saved. [2025-09-18T17:54:51.387612] [INFO ] [MAIN ] Update Progress: 378/2372 symbols completed. BYD took 41.3s. Estimated remaining: 4h 49m 4s. Rate: 6.9 symbols/min [2025-09-18T17:54:51.565484] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:54:51.619137] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-09-18T17:54:51.619302] [INFO ] [MAIN ] C: Loaded 53741 existing records. [2025-09-18T17:54:51.722374] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-18T17:54:51.803672] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:54:51.803917] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-18T17:54:51.803973] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-18T17:54:51.805439] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-09-18T17:54:51.805501] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-18T17:54:52.161533] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:54:52.408431] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-18T17:54:52.415944] [INFO ] [REMOTE ] BXSL: Full fetch complete (68965 records). [2025-09-18T17:54:52.416136] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-18T17:54:52.524710] [INFO ] [REMOTE ] C: Fetching primary data for 2024-11. [2025-09-18T17:54:52.808377] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-09-18T17:54:52.808484] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-09-18T17:54:52.809506] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-09-18T17:54:52.809589] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-09-18T17:54:52.811290] [DEBUG] [LOCAL ] BXSL: Trimmed 68965 records to 47757 (keeping 200 days of data) [2025-09-18T17:54:53.066127] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-18T17:54:53.151767] [DEBUG] [LOCAL ] BXSL: Primary data saved (47757 records). [2025-09-18T17:54:53.151921] [INFO ] [MAIN ] BXSL: Full history saved. [2025-09-18T17:54:53.152034] [INFO ] [MAIN ] Update Progress: 379/2372 symbols completed. BXSL took 46.0s. Estimated remaining: 4h 48m 19s. Rate: 6.9 symbols/min [2025-09-18T17:54:53.322282] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:54:53.322362] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-18T17:54:53.344188] [DEBUG] [LOCAL ] CAAP: Loaded 19057 existing records from primary storage. [2025-09-18T17:54:53.344318] [INFO ] [MAIN ] CAAP: Loaded 19057 existing records. [2025-09-18T17:54:53.569587] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:54:53.569843] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-18T17:54:53.569896] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-18T17:54:53.570411] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-09-18T17:54:53.570470] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-18T17:54:53.924680] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:54:54.119516] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-11. [2025-09-18T17:54:54.446484] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-18T17:54:54.549586] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-18T17:54:54.919566] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-18T17:54:55.298891] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-18T17:54:55.412250] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-18T17:54:55.719588] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-18T17:54:56.519554] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-09-18T17:54:57.119798] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-18T17:54:57.319584] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-18T17:54:58.119522] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-09-18T17:54:58.174713] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-18T17:54:58.177231] [INFO ] [REMOTE ] BYM: Full fetch complete (17973 records). [2025-09-18T17:54:58.177305] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-18T17:54:58.563982] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-09-18T17:54:58.564165] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-09-18T17:54:58.564688] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-09-18T17:54:58.564772] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-09-18T17:54:58.577487] [DEBUG] [LOCAL ] BYM: Trimmed 17973 records to 12392 (keeping 200 days of data) [2025-09-18T17:54:58.597691] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-18T17:54:58.686191] [DEBUG] [LOCAL ] BYM: Primary data saved (12392 records). [2025-09-18T17:54:58.686369] [INFO ] [MAIN ] BYM: Full history saved. [2025-09-18T17:54:58.686497] [INFO ] [MAIN ] Update Progress: 380/2372 symbols completed. BYM took 24.7s. Estimated remaining: 4h 47m 54s. Rate: 6.9 symbols/min [2025-09-18T17:54:58.861124] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:54:58.884222] [DEBUG] [LOCAL ] CABO: Loaded 17771 existing records from primary storage. [2025-09-18T17:54:58.884374] [INFO ] [MAIN ] CABO: Loaded 17771 existing records. [2025-09-18T17:54:58.926754] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-09-18T17:54:59.069786] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:54:59.070152] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-18T17:54:59.070303] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-18T17:54:59.071036] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-09-18T17:54:59.076244] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-18T17:54:59.162202] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-18T17:54:59.462818] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:54:59.719609] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-11. [2025-09-18T17:55:00.519571] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-18T17:55:00.776094] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-18T17:55:00.892182] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-18T17:55:01.319572] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-09-18T17:55:01.841422] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-18T17:55:01.875619] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-18T17:55:02.119550] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-18T17:55:02.919570] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-09-18T17:55:03.630323] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-18T17:55:03.719537] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-18T17:55:03.733445] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-18T17:55:04.519561] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-18T17:55:04.752449] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-18T17:55:05.311446] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-18T17:55:05.319490] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-18T17:55:06.119559] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-18T17:55:06.145857] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-18T17:55:06.919581] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-09-18T17:55:07.656601] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-18T17:55:07.663002] [INFO ] [REMOTE ] BZH: Full fetch complete (46972 records). [2025-09-18T17:55:07.663130] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-18T17:55:07.727198] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-18T17:55:07.867727] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T17:55:08.066220] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-09-18T17:55:08.066301] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-09-18T17:55:08.066864] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-09-18T17:55:08.066958] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-09-18T17:55:08.068039] [DEBUG] [LOCAL ] BZH: Trimmed 46972 records to 33190 (keeping 200 days of data) [2025-09-18T17:55:08.273135] [DEBUG] [LOCAL ] BZH: Primary data saved (33190 records). [2025-09-18T17:55:08.273304] [INFO ] [MAIN ] BZH: Full history saved. [2025-09-18T17:55:08.273426] [INFO ] [MAIN ] Update Progress: 381/2372 symbols completed. BZH took 31.6s. Estimated remaining: 4h 47m 50s. Rate: 6.9 symbols/min [2025-09-18T17:55:08.446913] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:55:08.479899] [DEBUG] [LOCAL ] CACI: Loaded 26038 existing records from primary storage. [2025-09-18T17:55:08.480051] [INFO ] [MAIN ] CACI: Loaded 26038 existing records. [2025-09-18T17:55:08.524693] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-18T17:55:08.737390] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:55:08.737759] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-18T17:55:08.737845] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-18T17:55:08.738805] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-09-18T17:55:08.738874] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-18T17:55:09.109662] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:55:09.319527] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-11. [2025-09-18T17:55:09.577106] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-18T17:55:09.757160] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-18T17:55:10.119539] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-18T17:55:10.331228] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T17:55:10.919566] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-09-18T17:55:11.325277] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-18T17:55:11.719565] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-18T17:55:11.836846] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-18T17:55:12.519547] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-18T17:55:12.696313] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-18T17:55:13.319516] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-18T17:55:13.410035] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-18T17:55:14.119507] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-09-18T17:55:14.519694] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-18T17:55:14.919539] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-18T17:55:15.315353] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T17:55:15.719540] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-18T17:55:15.782460] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-18T17:55:16.519559] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-18T17:55:17.137018] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T17:55:17.319558] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-18T17:55:18.119540] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-18T17:55:18.321059] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-18T17:55:18.458770] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-18T17:55:18.908703] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-18T17:55:18.919493] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-18T17:55:19.719543] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-18T17:55:20.041908] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-18T17:55:20.503991] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-18T17:55:20.519494] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-18T17:55:21.319548] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-18T17:55:21.779282] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-18T17:55:21.781735] [INFO ] [REMOTE ] CABO: Full fetch complete (22904 records). [2025-09-18T17:55:21.781868] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-18T17:55:22.128497] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-18T17:55:22.169637] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-09-18T17:55:22.169762] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-09-18T17:55:22.170200] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-09-18T17:55:22.170266] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-09-18T17:55:22.171255] [DEBUG] [LOCAL ] CABO: Trimmed 22904 records to 17861 (keeping 200 days of data) [2025-09-18T17:55:22.284572] [DEBUG] [LOCAL ] CABO: Primary data saved (17861 records). [2025-09-18T17:55:22.284752] [INFO ] [MAIN ] CABO: Full history saved. [2025-09-18T17:55:22.284918] [INFO ] [MAIN ] Update Progress: 382/2372 symbols completed. CABO took 23.6s. Estimated remaining: 4h 48m 9s. Rate: 6.9 symbols/min [2025-09-18T17:55:22.451564] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:55:22.451775] [DEBUG] [LOCAL ] CADE: No existing data file found in primary storage. [2025-09-18T17:55:22.451819] [WARN ] [MAIN ] CADE: No existing data found, performing full refresh instead. [2025-09-18T17:55:22.451982] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-18T17:55:22.452035] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-18T17:55:22.452103] [DEBUG] [LOCAL ] CADE: No primary data file found to delete. [2025-09-18T17:55:22.452149] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-18T17:55:22.841216] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:55:22.919568] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-18T17:55:23.034021] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-18T17:55:23.359490] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-18T17:55:23.719554] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-18T17:55:24.252765] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-18T17:55:24.376331] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-18T17:55:24.519594] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-11. [2025-09-18T17:55:25.319586] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-18T17:55:26.119505] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-18T17:55:26.162242] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-18T17:55:26.205373] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-18T17:55:26.919550] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-18T17:55:27.719602] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-18T17:55:28.087241] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-18T17:55:28.113494] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-18T17:55:28.118579] [INFO ] [REMOTE ] CAAP: Full fetch complete (27408 records). [2025-09-18T17:55:28.118773] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-18T17:55:28.521690] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-18T17:55:28.532180] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-09-18T17:55:28.533702] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-09-18T17:55:28.534218] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-09-18T17:55:28.534283] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-09-18T17:55:28.535352] [DEBUG] [LOCAL ] CAAP: Trimmed 27408 records to 19312 (keeping 200 days of data) [2025-09-18T17:55:28.659253] [DEBUG] [LOCAL ] CAAP: Primary data saved (19312 records). [2025-09-18T17:55:28.659468] [INFO ] [MAIN ] CAAP: Full history saved. [2025-09-18T17:55:28.659710] [INFO ] [MAIN ] Update Progress: 383/2372 symbols completed. CAAP took 35.5s. Estimated remaining: 4h 47m 49s. Rate: 6.9 symbols/min [2025-09-18T17:55:28.824135] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-18T17:55:28.861962] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:55:28.911612] [DEBUG] [LOCAL ] CAE: Loaded 38927 existing records from primary storage. [2025-09-18T17:55:28.911784] [INFO ] [MAIN ] CAE: Loaded 38927 existing records. [2025-09-18T17:55:29.101353] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:55:29.102798] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-18T17:55:29.102857] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-18T17:55:29.104516] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-18T17:55:29.104597] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-18T17:55:29.324700] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-09-18T17:55:29.500767] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:55:30.119625] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-18T17:55:30.546576] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-18T17:55:30.627188] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-18T17:55:30.875998] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-18T17:55:30.919556] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-09-18T17:55:31.719565] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-18T17:55:32.503140] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T17:55:32.519485] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-18T17:55:33.319571] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-18T17:55:33.853250] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-18T17:55:33.893092] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-18T17:55:34.119533] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-18T17:55:34.448043] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T17:55:34.919547] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-18T17:55:35.719571] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-11. [2025-09-18T17:55:35.932442] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-18T17:55:36.519556] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-18T17:55:36.601217] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-18T17:55:36.998042] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-18T17:55:37.303057] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-18T17:55:37.319512] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-18T17:55:38.119536] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-18T17:55:38.235027] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-18T17:55:38.239312] [INFO ] [REMOTE ] CACI: Full fetch complete (39172 records). [2025-09-18T17:55:38.239461] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-18T17:55:38.641295] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-09-18T17:55:38.641382] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-09-18T17:55:38.641910] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-09-18T17:55:38.641974] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-09-18T17:55:38.642881] [DEBUG] [LOCAL ] CACI: Trimmed 39172 records to 26140 (keeping 200 days of data) [2025-09-18T17:55:38.799206] [DEBUG] [LOCAL ] CACI: Primary data saved (26140 records). [2025-09-18T17:55:38.799342] [INFO ] [MAIN ] CACI: Full history saved. [2025-09-18T17:55:38.799442] [INFO ] [MAIN ] Update Progress: 384/2372 symbols completed. CACI took 30.5s. Estimated remaining: 4h 47m 48s. Rate: 6.9 symbols/min [2025-09-18T17:55:38.924688] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-18T17:55:38.985862] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:55:38.991239] [DEBUG] [LOCAL ] CAF: Loaded 3421 existing records from primary storage. [2025-09-18T17:55:38.991407] [INFO ] [MAIN ] CAF: Loaded 3421 existing records. [2025-09-18T17:55:39.168578] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:55:39.168874] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-18T17:55:39.168923] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-18T17:55:39.169176] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-09-18T17:55:39.169234] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-18T17:55:39.588719] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:55:39.719599] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-11. [2025-09-18T17:55:40.138420] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-18T17:55:40.240451] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-18T17:55:40.519613] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-09-18T17:55:40.738118] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-18T17:55:40.751961] [INFO ] [REMOTE ] C: Full fetch complete (77676 records). [2025-09-18T17:55:40.752303] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-18T17:55:41.313338] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-09-18T17:55:41.313514] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-09-18T17:55:41.314558] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-09-18T17:55:41.314678] [DEBUG] [LOCAL ] C: Saving primary data. [2025-09-18T17:55:41.319557] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-18T17:55:41.321236] [DEBUG] [LOCAL ] C: Trimmed 77676 records to 54131 (keeping 200 days of data) [2025-09-18T17:55:41.607991] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-18T17:55:41.715335] [DEBUG] [LOCAL ] C: Primary data saved (54131 records). [2025-09-18T17:55:41.715510] [INFO ] [MAIN ] C: Full history saved. [2025-09-18T17:55:41.715602] [INFO ] [MAIN ] Update Progress: 385/2372 symbols completed. C took 50.3s. Estimated remaining: 4h 47m 9s. Rate: 6.9 symbols/min [2025-09-18T17:55:41.903925] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:55:41.959497] [DEBUG] [LOCAL ] CAG: Loaded 53658 existing records from primary storage. [2025-09-18T17:55:41.959700] [INFO ] [MAIN ] CAG: Loaded 53658 existing records. [2025-09-18T17:55:42.124789] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-09-18T17:55:42.158992] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:55:42.159259] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-18T17:55:42.159314] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-18T17:55:42.160911] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-18T17:55:42.160991] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-18T17:55:42.545357] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:55:42.586705] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-18T17:55:42.919544] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-09-18T17:55:43.379033] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T17:55:43.552168] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-18T17:55:43.719520] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-11. [2025-09-18T17:55:44.519553] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-09-18T17:55:45.011005] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-18T17:55:45.266394] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-18T17:55:45.319565] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-09-18T17:55:46.119539] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-18T17:55:46.919564] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-18T17:55:47.089763] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-18T17:55:47.622481] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-18T17:55:47.623252] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-18T17:55:47.719569] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-18T17:55:48.160880] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-18T17:55:48.519584] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-18T17:55:48.974955] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-18T17:55:49.319559] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-18T17:55:49.897125] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-18T17:55:50.119600] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-18T17:55:50.669585] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-18T17:55:50.919533] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-18T17:55:51.317067] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-18T17:55:51.719586] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-18T17:55:52.519559] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-18T17:55:53.059268] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-18T17:55:53.319624] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-18T17:55:53.798251] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-18T17:55:54.000352] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-18T17:55:54.119541] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-18T17:55:54.919544] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-09-18T17:55:55.719557] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-18T17:55:55.827761] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-18T17:55:56.437383] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T17:55:56.519557] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-18T17:55:56.816591] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-18T17:55:57.319604] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-18T17:55:57.844691] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-18T17:55:57.858706] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-18T17:55:57.859862] [INFO ] [REMOTE ] CAF: Full fetch complete (5913 records). [2025-09-18T17:55:57.859931] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-18T17:55:58.127433] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-18T17:55:58.231810] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-09-18T17:55:58.231900] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-09-18T17:55:58.232078] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-09-18T17:55:58.232119] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-09-18T17:55:58.232534] [DEBUG] [LOCAL ] CAF: Trimmed 5913 records to 3464 (keeping 200 days of data) [2025-09-18T17:55:58.253835] [DEBUG] [LOCAL ] CAF: Primary data saved (3464 records). [2025-09-18T17:55:58.254003] [INFO ] [MAIN ] CAF: Full history saved. [2025-09-18T17:55:58.254101] [INFO ] [MAIN ] Update Progress: 386/2372 symbols completed. CAF took 19.5s. Estimated remaining: 4h 47m 41s. Rate: 6.9 symbols/min [2025-09-18T17:55:58.423097] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:55:58.483441] [DEBUG] [LOCAL ] CAH: Loaded 51548 existing records from primary storage. [2025-09-18T17:55:58.483618] [INFO ] [MAIN ] CAH: Loaded 51548 existing records. [2025-09-18T17:55:58.664750] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:55:58.665048] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-18T17:55:58.665098] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-18T17:55:58.667157] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-09-18T17:55:58.667220] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-18T17:55:58.924730] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-18T17:55:59.031505] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:55:59.690502] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T17:55:59.719546] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-18T17:56:00.520266] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-11. [2025-09-18T17:56:00.520108] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-18T17:56:00.532815] [INFO ] [REMOTE ] CADE: Full fetch complete (69469 records). [2025-09-18T17:56:00.532986] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-18T17:56:00.921520] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-09-18T17:56:00.921608] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-09-18T17:56:00.922360] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-09-18T17:56:00.922427] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-09-18T17:56:00.923949] [DEBUG] [LOCAL ] CADE: Trimmed 69469 records to 49099 (keeping 200 days of data) [2025-09-18T17:56:01.253208] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-18T17:56:01.275973] [DEBUG] [LOCAL ] CADE: Primary data saved (49099 records). [2025-09-18T17:56:01.276129] [INFO ] [MAIN ] CADE: Full history saved. [2025-09-18T17:56:01.276224] [INFO ] [MAIN ] Update Progress: 387/2372 symbols completed. CADE took 39.0s. Estimated remaining: 4h 47m 3s. Rate: 6.9 symbols/min [2025-09-18T17:56:01.331711] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-18T17:56:01.451055] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:56:01.500774] [DEBUG] [LOCAL ] CAL: Loaded 43368 existing records from primary storage. [2025-09-18T17:56:01.501006] [INFO ] [MAIN ] CAL: Loaded 43368 existing records. [2025-09-18T17:56:01.677429] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:56:01.677738] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-18T17:56:01.677797] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-18T17:56:01.678980] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-09-18T17:56:01.679042] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-18T17:56:02.043339] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:56:02.119553] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-11. [2025-09-18T17:56:02.166854] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T17:56:02.683393] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T17:56:02.919558] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-18T17:56:03.454591] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-18T17:56:03.719593] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-09-18T17:56:04.205635] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-18T17:56:04.519572] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-09-18T17:56:05.234759] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-18T17:56:05.319496] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-09-18T17:56:05.969472] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-18T17:56:06.119597] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-18T17:56:06.864116] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-18T17:56:06.919506] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-18T17:56:07.719552] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-18T17:56:07.851485] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-18T17:56:08.519554] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-18T17:56:08.684701] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-18T17:56:09.017387] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T17:56:09.319612] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-18T17:56:10.119556] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-09-18T17:56:10.313543] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-18T17:56:10.597801] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-18T17:56:10.602907] [INFO ] [REMOTE ] CAE: Full fetch complete (55397 records). [2025-09-18T17:56:10.603018] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-18T17:56:10.931480] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-18T17:56:11.037089] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-18T17:56:11.037176] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-18T17:56:11.037919] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-18T17:56:11.037985] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-18T17:56:11.039175] [DEBUG] [LOCAL ] CAE: Trimmed 55397 records to 39162 (keeping 200 days of data) [2025-09-18T17:56:11.266862] [DEBUG] [LOCAL ] CAE: Primary data saved (39162 records). [2025-09-18T17:56:11.267018] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-18T17:56:11.267107] [INFO ] [MAIN ] Update Progress: 388/2372 symbols completed. CAE took 42.6s. Estimated remaining: 4h 47m 1s. Rate: 6.9 symbols/min [2025-09-18T17:56:11.440355] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:56:11.467314] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-18T17:56:11.509526] [DEBUG] [LOCAL ] CALX: Loaded 38843 existing records from primary storage. [2025-09-18T17:56:11.509704] [INFO ] [MAIN ] CALX: Loaded 38843 existing records. [2025-09-18T17:56:11.707336] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:56:11.707683] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-18T17:56:11.707752] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-18T17:56:11.708822] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-09-18T17:56:11.708896] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-18T17:56:11.724739] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-18T17:56:12.113383] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:56:12.533986] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-11. [2025-09-18T17:56:12.568917] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-18T17:56:12.803540] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-18T17:56:13.319547] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-18T17:56:14.119548] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-18T17:56:14.322164] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-18T17:56:14.919548] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-09-18T17:56:15.044520] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-18T17:56:15.719568] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-18T17:56:15.827792] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-18T17:56:15.900864] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-18T17:56:16.519593] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-18T17:56:17.319590] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-09-18T17:56:17.520071] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-18T17:56:18.097069] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T17:56:18.119523] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-18T17:56:18.460803] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-18T17:56:18.919557] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-18T17:56:19.667460] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-18T17:56:19.719504] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-18T17:56:19.916805] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-18T17:56:20.519560] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-18T17:56:20.975968] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-18T17:56:21.319612] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-18T17:56:22.119534] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-18T17:56:22.919565] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-18T17:56:23.020773] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-18T17:56:23.098509] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-18T17:56:23.416591] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-18T17:56:23.719600] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-18T17:56:24.156323] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-18T17:56:24.519537] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-18T17:56:25.319580] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-18T17:56:25.666906] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-18T17:56:25.938621] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T17:56:26.119541] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-18T17:56:26.919567] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-18T17:56:27.218597] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-18T17:56:27.374383] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-18T17:56:27.719575] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-18T17:56:28.502604] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-18T17:56:28.509945] [INFO ] [REMOTE ] CAG: Full fetch complete (77491 records). [2025-09-18T17:56:28.510086] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-18T17:56:28.524769] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-18T17:56:28.920845] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-18T17:56:28.920945] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-18T17:56:28.921882] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-18T17:56:28.921952] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-18T17:56:28.923441] [DEBUG] [LOCAL ] CAG: Trimmed 77491 records to 54048 (keeping 200 days of data) [2025-09-18T17:56:29.268159] [DEBUG] [LOCAL ] CAG: Primary data saved (54048 records). [2025-09-18T17:56:29.268301] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-18T17:56:29.268402] [INFO ] [MAIN ] Update Progress: 389/2372 symbols completed. CAG took 47.6s. Estimated remaining: 4h 47m 40s. Rate: 6.9 symbols/min [2025-09-18T17:56:29.329253] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-18T17:56:29.470337] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-18T17:56:29.479941] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:56:29.508674] [DEBUG] [LOCAL ] CANG: Loaded 26652 existing records from primary storage. [2025-09-18T17:56:29.508813] [INFO ] [MAIN ] CANG: Loaded 26652 existing records. [2025-09-18T17:56:29.684282] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:56:29.684526] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-18T17:56:29.684573] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-18T17:56:29.685249] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-18T17:56:29.685311] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-18T17:56:30.039989] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:56:30.069134] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T17:56:30.119497] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-11. [2025-09-18T17:56:30.751844] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-18T17:56:30.919560] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-18T17:56:31.071731] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-18T17:56:31.719629] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-09-18T17:56:32.521623] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-18T17:56:32.531388] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-18T17:56:32.931388] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-18T17:56:33.319609] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-18T17:56:34.119542] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-18T17:56:34.154289] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-18T17:56:34.650160] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T17:56:34.656940] [INFO ] [REMOTE ] CAL: Full fetch complete (61696 records). [2025-09-18T17:56:34.657105] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-18T17:56:34.926772] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-09-18T17:56:35.064291] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-09-18T17:56:35.064377] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-09-18T17:56:35.065128] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-09-18T17:56:35.065193] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-09-18T17:56:35.066537] [DEBUG] [LOCAL ] CAL: Trimmed 61696 records to 43648 (keeping 200 days of data) [2025-09-18T17:56:35.331628] [DEBUG] [LOCAL ] CAL: Primary data saved (43648 records). [2025-09-18T17:56:35.331777] [INFO ] [MAIN ] CAL: Full history saved. [2025-09-18T17:56:35.332735] [INFO ] [MAIN ] Update Progress: 390/2372 symbols completed. CAL took 34.1s. Estimated remaining: 4h 47m 18s. Rate: 6.9 symbols/min [2025-09-18T17:56:35.517077] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:56:35.526305] [DEBUG] [LOCAL ] CAPL: Loaded 5944 existing records from primary storage. [2025-09-18T17:56:35.526426] [INFO ] [MAIN ] CAPL: Loaded 5944 existing records. [2025-09-18T17:56:35.712299] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:56:35.712589] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-18T17:56:35.712673] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-18T17:56:35.713012] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-09-18T17:56:35.713073] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-18T17:56:35.724687] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-18T17:56:36.096679] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:56:36.151001] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-18T17:56:36.160162] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-18T17:56:36.519549] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-11. [2025-09-18T17:56:37.173471] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T17:56:37.188325] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-18T17:56:37.319525] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-09-18T17:56:37.845311] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-18T17:56:38.119550] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-09-18T17:56:38.820449] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-18T17:56:38.919515] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-18T17:56:39.719607] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-18T17:56:40.528931] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-18T17:56:40.533147] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-18T17:56:40.540386] [INFO ] [REMOTE ] CAH: Full fetch complete (74436 records). [2025-09-18T17:56:40.540493] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-18T17:56:40.937585] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-09-18T17:56:40.937695] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-09-18T17:56:40.938463] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-09-18T17:56:40.938509] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-09-18T17:56:40.940026] [DEBUG] [LOCAL ] CAH: Trimmed 74436 records to 51889 (keeping 200 days of data) [2025-09-18T17:56:41.051244] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-18T17:56:41.195467] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-18T17:56:41.201864] [INFO ] [REMOTE ] CALX: Full fetch complete (54117 records). [2025-09-18T17:56:41.202190] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-18T17:56:41.323439] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-18T17:56:41.636519] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-09-18T17:56:41.637188] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-09-18T17:56:41.638198] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-09-18T17:56:41.638537] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-09-18T17:56:41.644366] [DEBUG] [LOCAL ] CALX: Trimmed 54117 records to 39114 (keeping 200 days of data) [2025-09-18T17:56:41.912376] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-18T17:56:41.927465] [DEBUG] [LOCAL ] CAH: Primary data saved (51889 records). [2025-09-18T17:56:41.928382] [INFO ] [MAIN ] CAH: Full history saved. [2025-09-18T17:56:41.928757] [INFO ] [MAIN ] Update Progress: 391/2372 symbols completed. CAH took 43.7s. Estimated remaining: 4h 46m 59s. Rate: 6.9 symbols/min [2025-09-18T17:56:42.118972] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:56:42.120345] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-18T17:56:42.135331] [DEBUG] [LOCAL ] CALX: Primary data saved (39114 records). [2025-09-18T17:56:42.135581] [INFO ] [MAIN ] CALX: Full history saved. [2025-09-18T17:56:42.135723] [INFO ] [MAIN ] Update Progress: 392/2372 symbols completed. CALX took 30.9s. Estimated remaining: 4h 46m 7s. Rate: 6.9 symbols/min [2025-09-18T17:56:42.340052] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:56:42.368117] [DEBUG] [LOCAL ] CARR: Loaded 53598 existing records from primary storage. [2025-09-18T17:56:42.368289] [INFO ] [MAIN ] CARR: Loaded 53598 existing records. [2025-09-18T17:56:42.591417] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:56:42.591862] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-18T17:56:42.591933] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-18T17:56:42.593452] [DEBUG] [LOCAL ] CARS: Loaded 40470 existing records from primary storage. [2025-09-18T17:56:42.593502] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-18T17:56:42.593774] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-18T17:56:42.593711] [INFO ] [MAIN ] CARS: Loaded 40470 existing records. [2025-09-18T17:56:42.932373] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-18T17:56:43.019077] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:56:43.095091] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-18T17:56:43.114465] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-18T17:56:43.125308] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-18T17:56:43.135961] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-18T17:56:43.251888] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:56:43.345729] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-18T17:56:43.611474] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-18T17:56:43.668190] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:56:43.719507] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-18T17:56:44.519595] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-11. [2025-09-18T17:56:44.885265] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-18T17:56:45.319591] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-11. [2025-09-18T17:56:46.119562] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-18T17:56:46.178014] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-18T17:56:46.475503] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-18T17:56:46.750058] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-18T17:56:46.919571] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-09-18T17:56:47.719605] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-09-18T17:56:48.089368] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-18T17:56:48.519551] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-18T17:56:49.278075] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-18T17:56:49.319509] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-09-18T17:56:49.538915] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-18T17:56:50.119576] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-18T17:56:50.826172] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-18T17:56:50.827736] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T17:56:50.919510] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-18T17:56:51.514382] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-18T17:56:51.719606] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-18T17:56:52.519580] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-18T17:56:53.101946] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T17:56:53.150347] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T17:56:53.319591] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-18T17:56:54.119579] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-18T17:56:54.198543] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-18T17:56:54.200725] [INFO ] [REMOTE ] CAPL: Full fetch complete (8991 records). [2025-09-18T17:56:54.200862] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-18T17:56:54.593724] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-09-18T17:56:54.593837] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-09-18T17:56:54.594094] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-09-18T17:56:54.594155] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-09-18T17:56:54.594598] [DEBUG] [LOCAL ] CAPL: Trimmed 8991 records to 5996 (keeping 200 days of data) [2025-09-18T17:56:54.632794] [DEBUG] [LOCAL ] CAPL: Primary data saved (5996 records). [2025-09-18T17:56:54.632882] [INFO ] [MAIN ] CAPL: Full history saved. [2025-09-18T17:56:54.632979] [INFO ] [MAIN ] Update Progress: 393/2372 symbols completed. CAPL took 19.3s. Estimated remaining: 4h 46m 18s. Rate: 6.9 symbols/min [2025-09-18T17:56:54.800748] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:56:54.857536] [DEBUG] [LOCAL ] CAT: Loaded 52932 existing records from primary storage. [2025-09-18T17:56:54.857731] [INFO ] [MAIN ] CAT: Loaded 52932 existing records. [2025-09-18T17:56:54.924730] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-18T17:56:55.046246] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:56:55.046508] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-18T17:56:55.046562] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-18T17:56:55.047828] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-18T17:56:55.047901] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-18T17:56:55.406747] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:56:55.714846] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-18T17:56:55.724942] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-11. [2025-09-18T17:56:55.921522] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-18T17:56:56.519563] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-18T17:56:57.319526] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-09-18T17:56:57.794418] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-11 (2.07 seconds). [2025-09-18T17:56:57.841822] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-18T17:56:58.119539] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-18T17:56:58.418572] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-18T17:56:58.919588] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-09-18T17:56:59.273894] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-18T17:56:59.719581] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-18T17:57:00.519578] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-18T17:57:01.065992] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-18T17:57:01.319605] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-18T17:57:01.442134] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-18T17:57:01.507174] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-18T17:57:02.119543] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-18T17:57:02.172442] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-18T17:57:02.919552] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-18T17:57:03.709212] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-18T17:57:03.720735] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-09-18T17:57:04.369995] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T17:57:04.375599] [INFO ] [REMOTE ] CANG: Full fetch complete (40408 records). [2025-09-18T17:57:04.375802] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-18T17:57:04.524677] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-18T17:57:04.806287] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-18T17:57:04.806397] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-18T17:57:04.807147] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-18T17:57:04.807216] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-18T17:57:04.813549] [DEBUG] [LOCAL ] CANG: Trimmed 40408 records to 26838 (keeping 200 days of data) [2025-09-18T17:57:04.982780] [DEBUG] [LOCAL ] CANG: Primary data saved (26838 records). [2025-09-18T17:57:04.983023] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-18T17:57:04.983214] [INFO ] [MAIN ] Update Progress: 394/2372 symbols completed. CANG took 35.7s. Estimated remaining: 4h 46m 17s. Rate: 6.9 symbols/min [2025-09-18T17:57:05.161477] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:57:05.172190] [DEBUG] [LOCAL ] CATO: Loaded 7429 existing records from primary storage. [2025-09-18T17:57:05.172391] [INFO ] [MAIN ] CATO: Loaded 7429 existing records. [2025-09-18T17:57:05.329491] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-18T17:57:05.362261] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:57:05.363869] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-18T17:57:05.363931] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-18T17:57:05.364421] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-18T17:57:05.364489] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-18T17:57:05.773375] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:57:05.821911] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-18T17:57:06.119559] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-18T17:57:06.183584] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-18T17:57:06.919542] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-11. [2025-09-18T17:57:06.958950] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-18T17:57:07.719550] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-18T17:57:07.746578] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-18T17:57:08.202287] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-18T17:57:08.519563] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-18T17:57:09.130927] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-18T17:57:09.319553] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-18T17:57:10.119517] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-18T17:57:10.340442] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-18T17:57:10.434141] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-18T17:57:10.919599] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-18T17:57:11.719604] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-09-18T17:57:11.848117] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-18T17:57:12.400237] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-18T17:57:12.519509] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-09-18T17:57:12.986807] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-18T17:57:13.044461] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-18T17:57:13.319505] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-18T17:57:14.119519] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-18T17:57:14.678733] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-18T17:57:14.919569] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-18T17:57:15.622263] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-18T17:57:15.719590] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-18T17:57:15.958442] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-18T17:57:16.347586] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-18T17:57:16.519540] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-18T17:57:17.287438] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-18T17:57:17.319521] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-18T17:57:18.119528] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-18T17:57:18.919518] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-18T17:57:19.373483] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-18T17:57:19.412178] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-18T17:57:19.442042] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T17:57:19.719590] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-18T17:57:20.519552] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-18T17:57:20.894953] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-18T17:57:21.319543] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-18T17:57:22.119562] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-18T17:57:22.288866] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-18T17:57:22.296334] [INFO ] [REMOTE ] CARR: Full fetch complete (77435 records). [2025-09-18T17:57:22.296503] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-18T17:57:22.726553] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-18T17:57:22.726785] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-18T17:57:22.728237] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-18T17:57:22.728457] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-18T17:57:22.736239] [DEBUG] [LOCAL ] CARR: Trimmed 77435 records to 53988 (keeping 200 days of data) [2025-09-18T17:57:22.746596] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-18T17:57:22.754490] [INFO ] [REMOTE ] CARS: Full fetch complete (55237 records). [2025-09-18T17:57:22.754638] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-18T17:57:22.931090] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-18T17:57:23.273276] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-18T17:57:23.274064] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-18T17:57:23.274837] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-18T17:57:23.274918] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-18T17:57:23.340498] [DEBUG] [LOCAL ] CARS: Trimmed 55237 records to 40751 (keeping 200 days of data) [2025-09-18T17:57:23.481757] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-18T17:57:23.720333] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-18T17:57:23.719758] [DEBUG] [LOCAL ] CARS: Primary data saved (40751 records). [2025-09-18T17:57:23.720623] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-18T17:57:23.722917] [INFO ] [MAIN ] Update Progress: 395/2372 symbols completed. CARS took 41.6s. Estimated remaining: 4h 46m 59s. Rate: 6.9 symbols/min [2025-09-18T17:57:23.921256] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:57:23.935260] [DEBUG] [LOCAL ] CARR: Primary data saved (53988 records). [2025-09-18T17:57:23.935638] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-18T17:57:23.936088] [INFO ] [MAIN ] Update Progress: 396/2372 symbols completed. CARR took 42.0s. Estimated remaining: 4h 46m 8s. Rate: 6.9 symbols/min [2025-09-18T17:57:24.125780] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:57:24.173010] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-18T17:57:24.202625] [DEBUG] [LOCAL ] CAVA: Loaded 53553 existing records from primary storage. [2025-09-18T17:57:24.202790] [INFO ] [MAIN ] CAVA: Loaded 53553 existing records. [2025-09-18T17:57:24.397678] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:57:24.412747] [DEBUG] [LOCAL ] CB: Loaded 50120 existing records from primary storage. [2025-09-18T17:57:24.412937] [INFO ] [MAIN ] CB: Loaded 50120 existing records. [2025-09-18T17:57:24.424393] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-18T17:57:24.462894] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-18T17:57:24.462711] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-18T17:57:24.500069] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-09-18T17:57:24.528716] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-18T17:57:24.516965] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-18T17:57:24.733843] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:57:24.768196] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-18T17:57:24.774941] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-18T17:57:24.803244] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-09-18T17:57:24.814859] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-18T17:57:25.203971] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:57:25.320636] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-11. [2025-09-18T17:57:25.317329] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T17:57:25.438283] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:57:26.119734] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-11. [2025-09-18T17:57:26.919865] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-18T17:57:27.285052] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-11 (1.96 seconds). [2025-09-18T17:57:27.720494] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-18T17:57:27.720314] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-18T17:57:28.519728] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-09-18T17:57:28.583325] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-18T17:57:28.585851] [INFO ] [REMOTE ] CATO: Full fetch complete (12423 records). [2025-09-18T17:57:28.585929] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-18T17:57:28.966690] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-18T17:57:28.966827] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-18T17:57:28.967176] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-18T17:57:28.967253] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-18T17:57:28.968154] [DEBUG] [LOCAL ] CATO: Trimmed 12423 records to 7490 (keeping 200 days of data) [2025-09-18T17:57:29.037182] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-18T17:57:29.061873] [DEBUG] [LOCAL ] CATO: Primary data saved (7490 records). [2025-09-18T17:57:29.062018] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-18T17:57:29.062125] [INFO ] [MAIN ] Update Progress: 397/2372 symbols completed. CATO took 24.1s. Estimated remaining: 4h 45m 41s. Rate: 6.9 symbols/min [2025-09-18T17:57:29.319594] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-18T17:57:30.119583] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-09-18T17:57:30.396011] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-18T17:57:30.919612] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-09-18T17:57:31.173830] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-18T17:57:31.596522] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-18T17:57:31.719596] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-09-18T17:57:32.519604] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-18T17:57:32.770376] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-18T17:57:33.266518] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T17:57:33.319586] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-18T17:57:34.119596] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-18T17:57:34.578316] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-18T17:57:34.589870] [INFO ] [REMOTE ] CAT: Full fetch complete (76425 records). [2025-09-18T17:57:34.590017] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-18T17:57:35.009883] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-18T17:57:35.010048] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-18T17:57:35.010892] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-18T17:57:35.011003] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-18T17:57:35.036639] [DEBUG] [LOCAL ] CAT: Trimmed 76425 records to 53322 (keeping 200 days of data) [2025-09-18T17:57:35.038041] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-18T17:57:35.048854] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-18T17:57:35.403511] [DEBUG] [LOCAL ] CAT: Primary data saved (53322 records). [2025-09-18T17:57:35.403673] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-18T17:57:35.403792] [INFO ] [MAIN ] Update Progress: 398/2372 symbols completed. CAT took 40.8s. Estimated remaining: 4h 45m 21s. Rate: 6.9 symbols/min [2025-09-18T17:57:35.846597] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-18T17:57:35.856737] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-18T17:57:36.795067] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-18T17:57:36.805736] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-18T17:57:38.004701] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-18T17:57:38.016265] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-18T17:57:38.655314] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-18T17:57:38.666201] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-18T17:57:40.061282] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-18T17:57:40.072741] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-18T17:57:40.115825] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T17:57:40.126251] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-18T17:57:41.520200] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-18T17:57:41.530446] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-18T17:57:42.205921] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-18T17:57:42.217582] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-18T17:57:43.139364] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-18T17:57:43.151109] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-18T17:57:44.214855] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-18T17:57:44.226091] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-18T17:57:44.633372] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-18T17:57:44.644191] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-18T17:57:46.236579] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-18T17:57:46.244770] [INFO ] [REMOTE ] CB: Full fetch complete (72527 records). [2025-09-18T17:57:46.244973] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-18T17:57:46.718268] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-18T17:57:46.722349] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-09-18T17:57:46.736839] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-09-18T17:57:46.737765] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-09-18T17:57:46.738211] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-09-18T17:57:46.739096] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-18T17:57:46.741301] [DEBUG] [LOCAL ] CB: Trimmed 72527 records to 50493 (keeping 200 days of data) [2025-09-18T17:57:47.056749] [DEBUG] [LOCAL ] CB: Primary data saved (50493 records). [2025-09-18T17:57:47.056902] [INFO ] [MAIN ] CB: Full history saved. [2025-09-18T17:57:47.056986] [INFO ] [MAIN ] Update Progress: 399/2372 symbols completed. CB took 23.1s. Estimated remaining: 4h 45m 27s. Rate: 6.9 symbols/min [2025-09-18T17:57:48.760992] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-18T17:57:48.772620] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-18T17:57:50.878559] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-18T17:57:50.886366] [INFO ] [REMOTE ] CAVA: Full fetch complete (77182 records). [2025-09-18T17:57:50.886557] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-18T17:57:51.300264] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-09-18T17:57:51.300401] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-09-18T17:57:51.301288] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-09-18T17:57:51.301371] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-09-18T17:57:51.303144] [DEBUG] [LOCAL ] CAVA: Trimmed 77182 records to 53942 (keeping 200 days of data) [2025-09-18T17:57:51.630770] [DEBUG] [LOCAL ] CAVA: Primary data saved (53942 records). [2025-09-18T17:57:51.630924] [INFO ] [MAIN ] CAVA: Full history saved. [2025-09-18T17:57:51.631035] [INFO ] [MAIN ] Update Progress: 400/2372 symbols completed. CAVA took 27.9s. Estimated remaining: 4h 44m 58s. Rate: 6.9 symbols/min [2025-09-18T17:57:52.293973] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:57:52.354610] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:57:52.396920] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:57:52.429357] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-18T17:57:52.429438] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-18T17:57:52.429905] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-18T17:57:52.431139] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:57:52.431225] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-18T17:57:52.435122] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-18T17:57:52.435723] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-18T17:57:52.517842] [DEBUG] [LOCAL ] CBNA: Loaded 2963 existing records from primary storage. [2025-09-18T17:57:52.547604] [INFO ] [MAIN ] CBNA: Loaded 2963 existing records. [2025-09-18T17:57:52.568355] [DEBUG] [LOCAL ] CBL: Loaded 16876 existing records from primary storage. [2025-09-18T17:57:52.676941] [DEBUG] [LOCAL ] CBAN: Loaded 11202 existing records from primary storage. [2025-09-18T17:57:52.677064] [INFO ] [MAIN ] CBL: Loaded 16876 existing records. [2025-09-18T17:57:52.687691] [INFO ] [MAIN ] CBAN: Loaded 11202 existing records. [2025-09-18T17:57:53.159177] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:57:53.249374] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-18T17:57:53.374808] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-18T17:57:53.448891] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:57:53.463470] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:57:53.475180] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-18T17:57:53.469838] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-18T17:57:53.486464] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-18T17:57:53.486770] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-18T17:57:53.487512] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-18T17:57:53.486961] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-18T17:57:53.503377] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-09-18T17:57:53.503606] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-18T17:57:53.519099] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-18T17:57:53.565029] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-18T17:57:53.668028] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:57:53.733183] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-11. [2025-09-18T17:57:54.243974] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-18T17:57:54.285052] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-09-18T17:57:54.697534] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:57:54.749486] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:57:54.804335] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:57:54.759862] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-09-18T17:57:54.834440] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-11. [2025-09-18T17:57:54.835199] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-11. [2025-09-18T17:57:54.871204] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:57:54.874315] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-09-18T17:57:54.875981] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-11. [2025-09-18T17:57:55.099870] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:57:55.100331] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-09-18T17:57:55.100969] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-02. [2025-09-18T17:57:55.284067] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:57:55.284587] [WARN ] [REMOTE ] CBO: No data returned for month 2025-02 [2025-09-18T17:57:55.285234] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-03. [2025-09-18T17:57:55.403155] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-18T17:57:55.405159] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-09-18T17:57:55.525172] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-18T17:57:55.526437] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-04. [2025-09-18T17:57:55.536848] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-18T17:57:55.540146] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-09-18T17:57:56.005631] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-18T17:57:56.006875] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-05. [2025-09-18T17:57:56.026724] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-18T17:57:56.028277] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-18T17:57:56.033244] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-09-18T17:57:56.085425] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-18T17:57:56.523374] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-09-18T17:57:56.526369] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-18T17:57:56.797384] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-18T17:57:56.979032] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-18T17:57:57.319623] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-06. [2025-09-18T17:57:57.580775] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-18T17:57:58.119599] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-18T17:57:58.494303] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-18T17:57:58.919591] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-09-18T17:57:59.719584] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-07. [2025-09-18T17:57:59.935801] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-18T17:57:59.945538] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-18T17:58:00.519571] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-09-18T17:58:01.285760] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-18T17:58:01.319554] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-18T17:58:02.119600] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-08. [2025-09-18T17:58:02.192728] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-18T17:58:02.401215] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:58:02.401769] [WARN ] [REMOTE ] CBO: No data returned for month 2025-08 [2025-09-18T17:58:02.919582] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-18T17:58:03.719587] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-18T17:58:03.997868] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-18T17:58:04.010483] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-18T17:58:04.519585] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-09. [2025-09-18T17:58:04.802775] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:58:04.803312] [WARN ] [REMOTE ] CBO: No data returned for month 2025-09 [2025-09-18T17:58:04.803466] [INFO ] [REMOTE ] CBO: Full fetch complete (1016 records). [2025-09-18T17:58:04.803578] [DEBUG] [VALIDATOR ] CBO: Validating primary data. [2025-09-18T17:58:04.804563] [FATAL] [VALIDATOR ] CBO: Data is stale - most recent date (2025-07-10) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:58:04.804675] [FATAL] [MAIN ] CBO: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:58:04.804739] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:58:04.804827] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-18T17:58:04.804911] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-18T17:58:04.804952] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-18T17:58:04.805025] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-18T17:58:04.805118] [INFO ] [MAIN ] Update Progress: 401/2372 symbols completed. CBO took 13.2s. Estimated remaining: 4h 45m 12s. Rate: 6.9 symbols/min [2025-09-18T17:58:05.013201] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:58:05.079347] [DEBUG] [LOCAL ] CBRE: Loaded 50749 existing records from primary storage. [2025-09-18T17:58:05.079568] [INFO ] [MAIN ] CBRE: Loaded 50749 existing records. [2025-09-18T17:58:05.273848] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:58:05.274245] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-18T17:58:05.274312] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-18T17:58:05.276094] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-18T17:58:05.276163] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-18T17:58:05.324679] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-18T17:58:05.668080] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:58:06.119585] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-11. [2025-09-18T17:58:06.454107] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-18T17:58:06.919572] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-18T17:58:07.719557] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-18T17:58:07.848841] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-18T17:58:07.924634] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-18T17:58:08.435501] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-18T17:58:08.519580] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-09-18T17:58:09.319620] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-18T17:58:10.041706] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-18T17:58:10.067838] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-18T17:58:10.119613] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-18T17:58:10.719093] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-18T17:58:10.919633] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-09-18T17:58:11.719636] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-18T17:58:12.268499] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-18T17:58:12.430420] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T17:58:12.519553] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-18T17:58:13.317144] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-18T17:58:13.320687] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-18T17:58:13.711365] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-18T17:58:14.119724] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-18T17:58:14.562876] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-18T17:58:14.919616] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-18T17:58:15.719631] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-18T17:58:15.767264] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-18T17:58:16.519714] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-18T17:58:17.319520] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-18T17:58:17.321589] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-18T17:58:17.358028] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-18T17:58:18.119600] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-18T17:58:18.155795] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-18T17:58:18.592949] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-18T17:58:18.919595] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-18T17:58:19.675597] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-18T17:58:19.719678] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-18T17:58:20.207676] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-18T17:58:20.209098] [INFO ] [REMOTE ] CBNA: Full fetch complete (4801 records). [2025-09-18T17:58:20.209205] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-18T17:58:20.524850] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-18T17:58:20.595460] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-09-18T17:58:20.595625] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-09-18T17:58:20.595862] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-09-18T17:58:20.595915] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-09-18T17:58:20.596345] [DEBUG] [LOCAL ] CBNA: Trimmed 4801 records to 2970 (keeping 200 days of data) [2025-09-18T17:58:20.615127] [DEBUG] [LOCAL ] CBNA: Primary data saved (2970 records). [2025-09-18T17:58:20.615254] [INFO ] [MAIN ] CBNA: Full history saved. [2025-09-18T17:58:20.615352] [INFO ] [MAIN ] Update Progress: 402/2372 symbols completed. CBNA took 29.0s. Estimated remaining: 4h 45m 38s. Rate: 6.9 symbols/min [2025-09-18T17:58:20.792765] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:58:20.825150] [DEBUG] [LOCAL ] CBT: Loaded 31409 existing records from primary storage. [2025-09-18T17:58:20.825295] [INFO ] [MAIN ] CBT: Loaded 31409 existing records. [2025-09-18T17:58:21.003017] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:58:21.003275] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-18T17:58:21.003324] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-18T17:58:21.004353] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-18T17:58:21.004420] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-18T17:58:21.324785] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-18T17:58:21.363838] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:58:21.714697] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-18T17:58:21.718090] [INFO ] [REMOTE ] CBL: Full fetch complete (25813 records). [2025-09-18T17:58:21.718205] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-18T17:58:22.108714] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-18T17:58:22.108835] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-18T17:58:22.109411] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-18T17:58:22.109456] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-18T17:58:22.110332] [DEBUG] [LOCAL ] CBL: Trimmed 25813 records to 16995 (keeping 200 days of data) [2025-09-18T17:58:22.160366] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-18T17:58:22.212533] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T17:58:22.245306] [DEBUG] [LOCAL ] CBL: Primary data saved (16995 records). [2025-09-18T17:58:22.245536] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-18T17:58:22.245699] [INFO ] [MAIN ] Update Progress: 403/2372 symbols completed. CBL took 30.6s. Estimated remaining: 4h 44m 55s. Rate: 6.9 symbols/min [2025-09-18T17:58:22.435610] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:58:22.462982] [DEBUG] [LOCAL ] CBU: Loaded 22866 existing records from primary storage. [2025-09-18T17:58:22.463238] [INFO ] [MAIN ] CBU: Loaded 22866 existing records. [2025-09-18T17:58:22.685462] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:58:22.685834] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-18T17:58:22.685892] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-18T17:58:22.686915] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-18T17:58:22.687011] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-18T17:58:22.932367] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-11. [2025-09-18T17:58:23.063781] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:58:23.719723] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-11. [2025-09-18T17:58:23.844121] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-18T17:58:24.376709] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-18T17:58:24.519727] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-18T17:58:24.611112] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-18T17:58:25.319603] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-18T17:58:26.033771] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-18T17:58:26.119594] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-09-18T17:58:26.297215] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-18T17:58:26.919637] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-18T17:58:26.959304] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T17:58:27.719617] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-18T17:58:28.519598] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-09-18T17:58:28.646779] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-18T17:58:28.676101] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-18T17:58:29.319597] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-18T17:58:29.561514] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-18T17:58:29.985613] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-18T17:58:29.987777] [INFO ] [REMOTE ] CBAN: Full fetch complete (15923 records). [2025-09-18T17:58:29.987869] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-18T17:58:30.124683] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-09-18T17:58:30.406942] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-09-18T17:58:30.407074] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-09-18T17:58:30.407586] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-09-18T17:58:30.407634] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-09-18T17:58:30.409521] [DEBUG] [LOCAL ] CBAN: Trimmed 15923 records to 11306 (keeping 200 days of data) [2025-09-18T17:58:30.488340] [DEBUG] [LOCAL ] CBAN: Primary data saved (11306 records). [2025-09-18T17:58:30.488570] [INFO ] [MAIN ] CBAN: Full history saved. [2025-09-18T17:58:30.488909] [INFO ] [MAIN ] Update Progress: 404/2372 symbols completed. CBAN took 38.9s. Estimated remaining: 4h 44m 44s. Rate: 6.9 symbols/min [2025-09-18T17:58:30.679112] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:58:30.679420] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-18T17:58:30.679479] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-18T17:58:30.679697] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-18T17:58:30.679754] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-18T17:58:30.679800] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-18T17:58:30.679836] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-18T17:58:30.924885] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-09-18T17:58:31.079679] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:58:31.372424] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T17:58:31.719720] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-11. [2025-09-18T17:58:31.910828] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-18T17:58:31.917910] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:58:31.918330] [WARN ] [REMOTE ] CBX: No data returned for month 2024-11 [2025-09-18T17:58:32.519638] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-18T17:58:33.319583] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-18T17:58:33.849459] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T17:58:34.119584] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-18T17:58:34.737871] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-18T17:58:34.919611] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-18T17:58:35.348561] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T17:58:35.719587] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-09-18T17:58:35.803309] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-18T17:58:35.927256] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:58:35.927732] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-09-18T17:58:36.519605] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-09-18T17:58:36.728420] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:58:36.729048] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-09-18T17:58:37.319696] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-18T17:58:38.119704] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-02. [2025-09-18T17:58:38.446952] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:58:38.447411] [WARN ] [REMOTE ] CBX: No data returned for month 2025-02 [2025-09-18T17:58:38.497861] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-18T17:58:38.919579] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-18T17:58:39.719575] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-18T17:58:40.071985] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-18T17:58:40.519572] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-18T17:58:41.324706] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-03. [2025-09-18T17:58:41.342827] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-18T17:58:41.498637] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-18T17:58:41.555863] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:58:41.556348] [WARN ] [REMOTE ] CBX: No data returned for month 2025-03 [2025-09-18T17:58:42.119597] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-18T17:58:42.919604] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-18T17:58:43.719553] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-18T17:58:43.904486] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-18T17:58:43.950115] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-18T17:58:44.519533] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-18T17:58:44.611338] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T17:58:45.319603] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-18T17:58:45.412420] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-18T17:58:46.119555] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-18T17:58:46.699751] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-18T17:58:46.919619] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-04. [2025-09-18T17:58:47.105719] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:58:47.106094] [WARN ] [REMOTE ] CBX: No data returned for month 2025-04 [2025-09-18T17:58:47.121930] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-18T17:58:47.719609] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-18T17:58:48.519553] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-18T17:58:48.927990] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-18T17:58:49.319611] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-18T17:58:49.996817] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-18T17:58:50.003851] [INFO ] [REMOTE ] CBRE: Full fetch complete (73829 records). [2025-09-18T17:58:50.003999] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-18T17:58:50.124718] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-18T17:58:50.407936] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-18T17:58:50.408064] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-18T17:58:50.408861] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-18T17:58:50.408967] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-18T17:58:50.425572] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-18T17:58:50.431093] [DEBUG] [LOCAL ] CBRE: Trimmed 73829 records to 51090 (keeping 200 days of data) [2025-09-18T17:58:50.745925] [DEBUG] [LOCAL ] CBRE: Primary data saved (51090 records). [2025-09-18T17:58:50.746133] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-18T17:58:50.746254] [INFO ] [MAIN ] Update Progress: 405/2372 symbols completed. CBRE took 45.9s. Estimated remaining: 4h 45m 31s. Rate: 6.9 symbols/min [2025-09-18T17:58:50.918255] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:58:50.919540] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-18T17:58:50.953949] [DEBUG] [LOCAL ] CBZ: Loaded 33282 existing records from primary storage. [2025-09-18T17:58:50.954090] [INFO ] [MAIN ] CBZ: Loaded 33282 existing records. [2025-09-18T17:58:51.132385] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:58:51.132615] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-18T17:58:51.132697] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-18T17:58:51.133593] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-18T17:58:51.133696] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-18T17:58:51.500675] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:58:51.543921] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-18T17:58:51.719503] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-05. [2025-09-18T17:58:52.108761] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-18T17:58:52.112296] [INFO ] [REMOTE ] CBU: Full fetch complete (31922 records). [2025-09-18T17:58:52.112394] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-18T17:58:52.459604] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-18T17:58:52.509764] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-18T17:58:52.509838] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-18T17:58:52.510274] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-18T17:58:52.510325] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-18T17:58:52.511238] [DEBUG] [LOCAL ] CBU: Trimmed 31922 records to 23167 (keeping 200 days of data) [2025-09-18T17:58:52.563827] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-06. [2025-09-18T17:58:52.652445] [DEBUG] [LOCAL ] CBU: Primary data saved (23167 records). [2025-09-18T17:58:52.652577] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-18T17:58:52.652691] [INFO ] [MAIN ] Update Progress: 406/2372 symbols completed. CBU took 30.4s. Estimated remaining: 4h 44m 50s. Rate: 6.9 symbols/min [2025-09-18T17:58:52.821591] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:58:52.837297] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-18T17:58:52.881997] [DEBUG] [LOCAL ] CC: Loaded 53037 existing records from primary storage. [2025-09-18T17:58:52.882166] [INFO ] [MAIN ] CC: Loaded 53037 existing records. [2025-09-18T17:58:53.065424] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:58:53.065916] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-18T17:58:53.065985] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-18T17:58:53.067545] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-18T17:58:53.067607] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-18T17:58:53.324690] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-07. [2025-09-18T17:58:53.422057] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:58:53.572175] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-18T17:58:54.119541] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-11. [2025-09-18T17:58:54.919600] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-18T17:58:55.666995] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-18T17:58:55.719506] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-09-18T17:58:55.869133] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-18T17:58:55.873460] [INFO ] [REMOTE ] CBT: Full fetch complete (45835 records). [2025-09-18T17:58:55.873572] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-18T17:58:56.265949] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-18T17:58:56.266030] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-18T17:58:56.266575] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-18T17:58:56.266617] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-18T17:58:56.267615] [DEBUG] [LOCAL ] CBT: Trimmed 45835 records to 31624 (keeping 200 days of data) [2025-09-18T17:58:56.465868] [DEBUG] [LOCAL ] CBT: Primary data saved (31624 records). [2025-09-18T17:58:56.466006] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-18T17:58:56.466106] [INFO ] [MAIN ] Update Progress: 407/2372 symbols completed. CBT took 35.9s. Estimated remaining: 4h 44m 18s. Rate: 6.9 symbols/min [2025-09-18T17:58:56.524620] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-11. [2025-09-18T17:58:56.643682] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:58:56.699970] [DEBUG] [LOCAL ] CCI: Loaded 53166 existing records from primary storage. [2025-09-18T17:58:56.700120] [INFO ] [MAIN ] CCI: Loaded 53166 existing records. [2025-09-18T17:58:56.879588] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:58:56.879828] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-18T17:58:56.879882] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-18T17:58:56.881390] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-18T17:58:56.881451] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-18T17:58:57.250908] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:58:57.305138] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-18T17:58:57.319495] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-08. [2025-09-18T17:58:57.529608] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:58:57.529963] [WARN ] [REMOTE ] CBX: No data returned for month 2025-08 [2025-09-18T17:58:57.968616] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-18T17:58:58.119537] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-09-18T17:58:58.919504] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-11. [2025-09-18T17:58:59.129925] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-18T17:58:59.719615] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-09-18T17:59:00.519512] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-09. [2025-09-18T17:59:00.630584] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-18T17:59:00.746217] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-18T17:59:00.886391] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T17:59:00.886753] [WARN ] [REMOTE ] CBX: No data returned for month 2025-09 [2025-09-18T17:59:00.886855] [INFO ] [REMOTE ] CBX: Full fetch complete (1040 records). [2025-09-18T17:59:00.886958] [DEBUG] [VALIDATOR ] CBX: Validating primary data. [2025-09-18T17:59:00.887597] [FATAL] [VALIDATOR ] CBX: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T17:59:00.887700] [FATAL] [MAIN ] CBX: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:59:00.887768] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:59:00.887869] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-18T17:59:00.887977] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-18T17:59:00.888050] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-18T17:59:00.888133] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-18T17:59:00.888231] [INFO ] [MAIN ] Update Progress: 408/2372 symbols completed. CBX took 30.4s. Estimated remaining: 4h 43m 48s. Rate: 6.9 symbols/min [2025-09-18T17:59:01.061109] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:59:01.061335] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-18T17:59:01.061393] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-18T17:59:01.061540] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-18T17:59:01.061625] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-18T17:59:01.061719] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-18T17:59:01.061763] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-18T17:59:01.320685] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-09-18T17:59:01.445726] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:59:02.119534] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-18T17:59:02.919544] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-11. [2025-09-18T17:59:03.285396] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-18T17:59:03.321084] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-11 (0.40 seconds). [2025-09-18T17:59:03.343855] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T17:59:03.719582] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-09-18T17:59:04.519557] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-09-18T17:59:05.319598] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-09-18T17:59:05.369751] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-18T17:59:05.608973] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-09-18T17:59:06.009317] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T17:59:06.119539] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-18T17:59:06.919604] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-18T17:59:07.511759] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-18T17:59:07.719721] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-09-18T17:59:08.161010] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-18T17:59:08.244779] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T17:59:08.519610] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-18T17:59:08.864758] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-18T17:59:09.319561] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-18T17:59:09.706546] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-18T17:59:10.119565] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-18T17:59:10.466061] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-18T17:59:10.919553] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-18T17:59:11.719568] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-18T17:59:12.325110] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-18T17:59:12.519702] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-18T17:59:12.896391] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-18T17:59:13.154617] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-18T17:59:13.319497] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-18T17:59:14.119566] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-18T17:59:14.560571] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-18T17:59:14.919573] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-18T17:59:15.141435] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-18T17:59:15.185379] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-18T17:59:15.719547] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-18T17:59:16.519555] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-18T17:59:16.896045] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-18T17:59:17.319564] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-18T17:59:18.119707] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-18T17:59:18.304413] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-18T17:59:18.419577] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-18T17:59:18.919501] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-18T17:59:19.443218] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-18T17:59:19.719597] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-18T17:59:20.519551] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-18T17:59:20.727127] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-18T17:59:21.119104] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-18T17:59:21.319569] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-18T17:59:21.502410] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-18T17:59:21.742345] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-18T17:59:21.743270] [INFO ] [REMOTE ] CCIA: Full fetch complete (2024 records). [2025-09-18T17:59:21.743342] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-18T17:59:21.930855] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-18T17:59:21.931083] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-18T17:59:21.931151] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-18T17:59:21.931223] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-18T17:59:21.931304] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-18T17:59:21.931361] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-18T17:59:21.931421] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-18T17:59:21.931504] [INFO ] [MAIN ] Update Progress: 409/2372 symbols completed. CCIA took 21.0s. Estimated remaining: 4h 44m 39s. Rate: 6.9 symbols/min [2025-09-18T17:59:22.111349] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:59:22.119591] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-18T17:59:22.132723] [DEBUG] [LOCAL ] CCIF: Loaded 15299 existing records from primary storage. [2025-09-18T17:59:22.132864] [INFO ] [MAIN ] CCIF: Loaded 15299 existing records. [2025-09-18T17:59:22.314311] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:59:22.314581] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-18T17:59:22.314640] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-18T17:59:22.315312] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-18T17:59:22.315374] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-18T17:59:22.682050] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:59:22.919537] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-11. [2025-09-18T17:59:23.719693] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-18T17:59:24.043317] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-18T17:59:24.123534] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-18T17:59:24.519603] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-18T17:59:24.837038] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-18T17:59:25.319586] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-09-18T17:59:25.986509] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-18T17:59:26.081429] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T17:59:26.119559] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-18T17:59:26.919580] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-09-18T17:59:27.532591] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-18T17:59:27.564669] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-18T17:59:27.719518] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-18T17:59:28.519612] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-18T17:59:29.319547] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-18T17:59:29.349373] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-18T17:59:29.622072] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-18T17:59:30.119590] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-18T17:59:30.470192] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-18T17:59:30.919614] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-18T17:59:31.719582] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-18T17:59:31.784304] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-18T17:59:31.903528] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-18T17:59:32.519558] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-18T17:59:33.309152] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T17:59:33.319890] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-18T17:59:34.119603] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-18T17:59:34.174315] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-18T17:59:34.181747] [INFO ] [REMOTE ] CCI: Full fetch complete (76841 records). [2025-09-18T17:59:34.181891] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-18T17:59:34.381195] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-18T17:59:34.610905] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-18T17:59:34.611017] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-18T17:59:34.611905] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-18T17:59:34.611977] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-18T17:59:34.619938] [DEBUG] [LOCAL ] CCI: Trimmed 76841 records to 53549 (keeping 200 days of data) [2025-09-18T17:59:34.931167] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-18T17:59:34.982403] [DEBUG] [LOCAL ] CCI: Primary data saved (53549 records). [2025-09-18T17:59:34.982627] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-18T17:59:34.982801] [INFO ] [MAIN ] Update Progress: 410/2372 symbols completed. CCI took 38.5s. Estimated remaining: 4h 44m 51s. Rate: 6.9 symbols/min [2025-09-18T17:59:35.158880] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:59:35.211553] [DEBUG] [LOCAL ] CCJ: Loaded 53675 existing records from primary storage. [2025-09-18T17:59:35.211794] [INFO ] [MAIN ] CCJ: Loaded 53675 existing records. [2025-09-18T17:59:35.394785] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:59:35.395136] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-18T17:59:35.395247] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-18T17:59:35.397016] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-18T17:59:35.397098] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-18T17:59:35.724497] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-18T17:59:35.854967] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:59:35.872627] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-18T17:59:35.878378] [INFO ] [REMOTE ] CBZ: Full fetch complete (44289 records). [2025-09-18T17:59:35.878492] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-18T17:59:36.282607] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-18T17:59:36.282725] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-18T17:59:36.283386] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-18T17:59:36.283453] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-18T17:59:36.284640] [DEBUG] [LOCAL ] CBZ: Trimmed 44289 records to 33568 (keeping 200 days of data) [2025-09-18T17:59:36.495876] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-18T17:59:36.517588] [INFO ] [REMOTE ] CC: Full fetch complete (75230 records). [2025-09-18T17:59:36.519713] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-18T17:59:36.520266] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-11. [2025-09-18T17:59:36.521879] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-18T17:59:36.837928] [DEBUG] [LOCAL ] CBZ: Primary data saved (33568 records). [2025-09-18T17:59:36.857561] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-18T17:59:36.860242] [INFO ] [MAIN ] Update Progress: 411/2372 symbols completed. CBZ took 46.1s. Estimated remaining: 4h 44m 10s. Rate: 6.9 symbols/min [2025-09-18T17:59:37.111949] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-18T17:59:37.118769] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-18T17:59:37.127624] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-18T17:59:37.127824] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-18T17:59:37.147312] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:59:37.149024] [DEBUG] [LOCAL ] CC: Trimmed 75230 records to 53424 (keeping 200 days of data) [2025-09-18T17:59:37.354288] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-18T17:59:37.407960] [DEBUG] [LOCAL ] CCK: Loaded 46609 existing records from primary storage. [2025-09-18T17:59:37.412180] [INFO ] [MAIN ] CCK: Loaded 46609 existing records. [2025-09-18T17:59:37.617217] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:59:37.619775] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-18T17:59:37.620431] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-18T17:59:37.622363] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-09-18T17:59:37.623050] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-18T17:59:38.108426] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:59:38.112245] [DEBUG] [LOCAL ] CC: Primary data saved (53424 records). [2025-09-18T17:59:38.112721] [INFO ] [MAIN ] CC: Full history saved. [2025-09-18T17:59:38.114109] [INFO ] [MAIN ] Update Progress: 412/2372 symbols completed. CC took 45.5s. Estimated remaining: 4h 43m 26s. Rate: 6.9 symbols/min [2025-09-18T17:59:38.135160] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-11. [2025-09-18T17:59:38.292834] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-18T17:59:38.313246] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:59:38.397584] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-18T17:59:38.429474] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-09-18T17:59:38.429697] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-09-18T17:59:38.609834] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:59:38.610122] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-18T17:59:38.610188] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-18T17:59:38.611524] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-09-18T17:59:38.611585] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-18T17:59:38.922448] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-09-18T17:59:39.003890] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:59:39.719629] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-18T17:59:39.753131] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-18T17:59:40.465219] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-18T17:59:40.519526] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-09-18T17:59:40.983712] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-18T17:59:41.319556] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-18T17:59:42.011181] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T17:59:42.119551] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-11. [2025-09-18T17:59:42.280826] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-18T17:59:42.919593] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-09-18T17:59:43.719576] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-18T17:59:44.310941] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-18T17:59:44.452042] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-18T17:59:44.519614] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-18T17:59:44.648679] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-11 (2.53 seconds). [2025-09-18T17:59:45.197676] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-18T17:59:45.200432] [INFO ] [REMOTE ] CCIF: Full fetch complete (21403 records). [2025-09-18T17:59:45.200513] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-18T17:59:45.324750] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-09-18T17:59:45.599508] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-18T17:59:45.599595] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-18T17:59:45.600011] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-18T17:59:45.600073] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-18T17:59:45.600759] [DEBUG] [LOCAL ] CCIF: Trimmed 21403 records to 15358 (keeping 200 days of data) [2025-09-18T17:59:45.700907] [DEBUG] [LOCAL ] CCIF: Primary data saved (15358 records). [2025-09-18T17:59:45.701058] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-18T17:59:45.701252] [INFO ] [MAIN ] Update Progress: 413/2372 symbols completed. CCIF took 23.8s. Estimated remaining: 4h 43m 12s. Rate: 6.9 symbols/min [2025-09-18T17:59:45.875025] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T17:59:45.934136] [DEBUG] [LOCAL ] CCO: Loaded 47506 existing records from primary storage. [2025-09-18T17:59:45.934308] [INFO ] [MAIN ] CCO: Loaded 47506 existing records. [2025-09-18T17:59:46.109276] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T17:59:46.109583] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-18T17:59:46.109630] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-18T17:59:46.111026] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-18T17:59:46.111097] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-18T17:59:46.124748] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-18T17:59:46.470964] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T17:59:46.919568] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-09-18T17:59:47.346531] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-18T17:59:47.719565] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-11. [2025-09-18T17:59:47.890764] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-18T17:59:48.519578] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-18T17:59:49.024699] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-18T17:59:49.062368] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-18T17:59:49.319553] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-18T17:59:49.892859] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-18T17:59:50.119559] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-09-18T17:59:50.919544] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-09-18T17:59:50.966300] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-18T17:59:51.112809] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-18T17:59:51.719553] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-18T17:59:52.519567] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-18T17:59:53.075624] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-18T17:59:53.324672] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-09-18T17:59:53.348404] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-18T17:59:54.119550] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-18T17:59:54.301419] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-18T17:59:54.571381] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T17:59:54.919535] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-18T17:59:55.719576] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-18T17:59:55.945003] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-18T17:59:55.977119] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-18T17:59:56.519555] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-18T17:59:57.319546] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-18T17:59:57.771449] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-18T17:59:57.839814] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T17:59:58.119585] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-18T17:59:58.694710] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-18T17:59:58.919531] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-18T17:59:59.719619] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-18T18:00:00.422851] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-18T18:00:00.519531] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-18T18:00:01.180082] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-18T18:00:01.305032] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T18:00:01.319537] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-18T18:00:02.119592] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-18T18:00:02.793251] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-18T18:00:02.919576] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-18T18:00:02.973976] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-18T18:00:03.719601] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-18T18:00:04.062335] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-18T18:00:04.384354] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-18T18:00:04.519563] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-18T18:00:05.319531] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-18T18:00:05.361439] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T18:00:06.119607] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-18T18:00:06.372238] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-18T18:00:06.378638] [INFO ] [REMOTE ] CCK: Full fetch complete (67306 records). [2025-09-18T18:00:06.378786] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-18T18:00:06.380014] [FATAL] [VALIDATOR ] CCK: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:00:06.380141] [FATAL] [MAIN ] CCK: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:00:06.380225] [WARN ] [MAIN ] CCK: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:00:06.380313] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-18T18:00:06.380409] [DEBUG] [LOCAL ] CCK: No primary data file found to delete. [2025-09-18T18:00:06.380481] [INFO ] [LOCAL ] CCK: Starting deletion of derivative data. [2025-09-18T18:00:06.381063] [DEBUG] [LOCAL ] CCK: Deleted derivative data file. [2025-09-18T18:00:06.381177] [INFO ] [MAIN ] Update Progress: 414/2372 symbols completed. CCK took 29.5s. Estimated remaining: 4h 44m 0s. Rate: 6.9 symbols/min [2025-09-18T18:00:06.562920] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:00:06.576240] [DEBUG] [LOCAL ] CCRD: Loaded 8924 existing records from primary storage. [2025-09-18T18:00:06.576348] [INFO ] [MAIN ] CCRD: Loaded 8924 existing records. [2025-09-18T18:00:06.755156] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:00:06.755715] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-18T18:00:06.755786] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-18T18:00:06.756493] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-18T18:00:06.756633] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-18T18:00:06.929813] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-18T18:00:07.118005] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:00:07.605499] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T18:00:07.672087] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-18T18:00:07.719492] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-18T18:00:08.519556] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-11. [2025-09-18T18:00:09.093638] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-18T18:00:09.319602] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-18T18:00:09.370480] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-18T18:00:09.771634] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-18T18:00:10.119569] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-09-18T18:00:10.801690] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-18T18:00:10.819788] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-18T18:00:10.919510] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-18T18:00:11.719584] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-18T18:00:12.504232] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-18T18:00:12.519493] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-18T18:00:13.319633] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-18T18:00:13.849127] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-18T18:00:13.913835] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T18:00:14.119560] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-18T18:00:14.919637] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-09-18T18:00:15.518054] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-18T18:00:15.602083] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-18T18:00:15.719515] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-18T18:00:16.054905] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-18T18:00:16.519550] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-18T18:00:17.319587] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-18T18:00:17.611066] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-18T18:00:17.618442] [INFO ] [REMOTE ] CCJ: Full fetch complete (77576 records). [2025-09-18T18:00:17.618570] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-18T18:00:18.026047] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-18T18:00:18.026214] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-18T18:00:18.028476] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-18T18:00:18.035533] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-18T18:00:18.046169] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-18T18:00:18.047792] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-18T18:00:18.055378] [INFO ] [REMOTE ] CCO: Full fetch complete (65773 records). [2025-09-18T18:00:18.055611] [DEBUG] [LOCAL ] CCJ: Trimmed 77576 records to 54065 (keeping 200 days of data) [2025-09-18T18:00:18.055516] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-18T18:00:18.136677] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-18T18:00:18.700911] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-18T18:00:18.703156] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-18T18:00:18.704570] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-18T18:00:18.705744] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-18T18:00:18.712703] [DEBUG] [LOCAL ] CCO: Trimmed 65773 records to 47879 (keeping 200 days of data) [2025-09-18T18:00:18.909861] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-18T18:00:18.923549] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-18T18:00:19.013785] [DEBUG] [LOCAL ] CCJ: Primary data saved (54065 records). [2025-09-18T18:00:19.016841] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-18T18:00:19.017266] [INFO ] [MAIN ] Update Progress: 415/2372 symbols completed. CCJ took 44.0s. Estimated remaining: 4h 44m 10s. Rate: 6.9 symbols/min [2025-09-18T18:00:19.219501] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:00:19.293263] [DEBUG] [LOCAL ] CCO: Primary data saved (47879 records). [2025-09-18T18:00:19.294387] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-18T18:00:19.294822] [DEBUG] [LOCAL ] CCS: Loaded 30629 existing records from primary storage. [2025-09-18T18:00:19.294969] [INFO ] [MAIN ] Update Progress: 416/2372 symbols completed. CCO took 33.6s. Estimated remaining: 4h 43m 22s. Rate: 6.9 symbols/min [2025-09-18T18:00:19.295051] [INFO ] [MAIN ] CCS: Loaded 30629 existing records. [2025-09-18T18:00:19.627142] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:00:19.645695] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:00:19.645915] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-18T18:00:19.646224] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-18T18:00:19.647083] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-09-18T18:00:19.647157] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-18T18:00:19.724900] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-18T18:00:19.924469] [DEBUG] [LOCAL ] CCU: Loaded 24062 existing records from primary storage. [2025-09-18T18:00:19.935579] [INFO ] [MAIN ] CCU: Loaded 24062 existing records. [2025-09-18T18:00:20.182335] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:00:20.274747] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:00:20.275074] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-18T18:00:20.275133] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-18T18:00:20.275824] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-18T18:00:20.275885] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-18T18:00:20.524621] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-11. [2025-09-18T18:00:20.596918] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-18T18:00:20.642627] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:00:21.319623] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-11. [2025-09-18T18:00:21.348062] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-18T18:00:21.355879] [INFO ] [REMOTE ] CCL: Full fetch complete (77867 records). [2025-09-18T18:00:21.356057] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-18T18:00:21.757477] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-09-18T18:00:21.757589] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-09-18T18:00:21.758497] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-09-18T18:00:21.758579] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-09-18T18:00:21.765730] [DEBUG] [LOCAL ] CCL: Trimmed 77867 records to 54190 (keeping 200 days of data) [2025-09-18T18:00:21.778135] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-18T18:00:22.104012] [DEBUG] [LOCAL ] CCL: Primary data saved (54190 records). [2025-09-18T18:00:22.104164] [INFO ] [MAIN ] CCL: Full history saved. [2025-09-18T18:00:22.104952] [INFO ] [MAIN ] Update Progress: 417/2372 symbols completed. CCL took 44.0s. Estimated remaining: 4h 42m 45s. Rate: 6.9 symbols/min [2025-09-18T18:00:22.125670] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-09-18T18:00:22.279800] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:00:22.279970] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-18T18:00:22.280007] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-18T18:00:22.280154] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-18T18:00:22.280197] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-18T18:00:22.280238] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-18T18:00:22.280271] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-18T18:00:22.654155] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:00:22.655476] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-18T18:00:22.919590] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-18T18:00:23.152313] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-18T18:00:23.395750] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-18T18:00:23.719623] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-18T18:00:24.455392] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-18T18:00:24.519599] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-18T18:00:25.319557] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-09-18T18:00:25.417069] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-18T18:00:26.119564] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-11. [2025-09-18T18:00:26.378553] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-18T18:00:26.565525] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-18T18:00:26.919578] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-09-18T18:00:27.719530] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-09-18T18:00:28.008736] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-09-18T18:00:28.023457] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-18T18:00:28.519724] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-18T18:00:29.319581] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-18T18:00:29.369375] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-18T18:00:30.119550] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-09-18T18:00:30.449999] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-18T18:00:30.919578] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-09-18T18:00:31.008119] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-18T18:00:31.154091] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-09-18T18:00:31.719596] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-18T18:00:31.970343] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-09-18T18:00:32.519581] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-18T18:00:33.319620] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-18T18:00:33.672083] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-18T18:00:34.004511] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-18T18:00:34.006410] [INFO ] [REMOTE ] CCRD: Full fetch complete (12033 records). [2025-09-18T18:00:34.006482] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-18T18:00:34.124663] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-18T18:00:34.378401] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-09-18T18:00:34.378481] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-09-18T18:00:34.378809] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-09-18T18:00:34.378877] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-09-18T18:00:34.379387] [DEBUG] [LOCAL ] CCRD: Trimmed 12033 records to 9003 (keeping 200 days of data) [2025-09-18T18:00:34.434878] [DEBUG] [LOCAL ] CCRD: Primary data saved (9003 records). [2025-09-18T18:00:34.435024] [INFO ] [MAIN ] CCRD: Full history saved. [2025-09-18T18:00:34.435129] [INFO ] [MAIN ] Update Progress: 418/2372 symbols completed. CCRD took 28.1s. Estimated remaining: 4h 42m 54s. Rate: 6.9 symbols/min [2025-09-18T18:00:34.600695] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-18T18:00:34.620454] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:00:34.623226] [DEBUG] [LOCAL ] CDE: No existing data file found in primary storage. [2025-09-18T18:00:34.623275] [WARN ] [MAIN ] CDE: No existing data found, performing full refresh instead. [2025-09-18T18:00:34.623461] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-18T18:00:34.623507] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-18T18:00:34.623553] [DEBUG] [LOCAL ] CDE: No primary data file found to delete. [2025-09-18T18:00:34.623587] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-18T18:00:34.924674] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-18T18:00:34.990853] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:00:35.719563] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-18T18:00:36.298634] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-18T18:00:36.519551] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-18T18:00:36.836456] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-18T18:00:37.319588] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-18T18:00:37.512037] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-18T18:00:38.119566] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-18T18:00:38.462144] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-18T18:00:38.919552] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-18T18:00:39.322121] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-18T18:00:39.343753] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-18T18:00:39.719558] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-18T18:00:39.962992] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-09-18T18:00:40.519562] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-11. [2025-09-18T18:00:41.319587] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-18T18:00:42.119553] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-18T18:00:42.330117] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-18T18:00:42.356303] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:00:42.356698] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-18T18:00:42.659708] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-18T18:00:42.919582] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-18T18:00:43.719596] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-18T18:00:44.219762] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T18:00:44.495210] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-18T18:00:44.519584] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-09-18T18:00:45.319567] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-18T18:00:46.119553] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-07. [2025-09-18T18:00:46.257962] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-18T18:00:46.418760] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-18T18:00:46.445171] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-18T18:00:46.919548] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-18T18:00:47.719523] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-08. [2025-09-18T18:00:47.798287] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-18T18:00:47.963106] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-18T18:00:48.519549] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-09. [2025-09-18T18:00:48.831497] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-18T18:00:48.832223] [INFO ] [REMOTE ] CCZ: Full fetch complete (142 records). [2025-09-18T18:00:48.832315] [DEBUG] [VALIDATOR ] CCZ: Validating primary data. [2025-09-18T18:00:48.832764] [FATAL] [VALIDATOR ] CCZ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:00:48.832848] [FATAL] [MAIN ] CCZ: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:00:48.832892] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:00:48.832931] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-18T18:00:48.833003] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-18T18:00:48.833061] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-18T18:00:48.833119] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-18T18:00:48.833200] [INFO ] [MAIN ] Update Progress: 419/2372 symbols completed. CCZ took 26.7s. Estimated remaining: 4h 43m 12s. Rate: 6.9 symbols/min [2025-09-18T18:00:49.003555] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:00:49.016357] [DEBUG] [LOCAL ] CDLR: Loaded 10281 existing records from primary storage. [2025-09-18T18:00:49.016486] [INFO ] [MAIN ] CDLR: Loaded 10281 existing records. [2025-09-18T18:00:49.231780] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:00:49.232066] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-18T18:00:49.232122] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-18T18:00:49.232478] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-09-18T18:00:49.232538] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-18T18:00:49.324680] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-09-18T18:00:49.596943] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:00:50.119597] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-18T18:00:50.919505] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-18T18:00:51.004662] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-18T18:00:51.140754] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-18T18:00:51.143856] [INFO ] [REMOTE ] CCU: Full fetch complete (33222 records). [2025-09-18T18:00:51.143952] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-18T18:00:51.517259] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-18T18:00:51.517348] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-18T18:00:51.517860] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-18T18:00:51.517924] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-18T18:00:51.518853] [DEBUG] [LOCAL ] CCU: Trimmed 33222 records to 24155 (keeping 200 days of data) [2025-09-18T18:00:51.659332] [DEBUG] [LOCAL ] CCU: Primary data saved (24155 records). [2025-09-18T18:00:51.659471] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-18T18:00:51.659577] [INFO ] [MAIN ] Update Progress: 420/2372 symbols completed. CCU took 32.3s. Estimated remaining: 4h 42m 36s. Rate: 6.9 symbols/min [2025-09-18T18:00:51.724726] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-18T18:00:51.845976] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:00:51.846410] [DEBUG] [LOCAL ] CDP: No existing data file found in primary storage. [2025-09-18T18:00:51.846469] [WARN ] [MAIN ] CDP: No existing data found, performing full refresh instead. [2025-09-18T18:00:51.846623] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-18T18:00:51.846697] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-18T18:00:51.846753] [DEBUG] [LOCAL ] CDP: No primary data file found to delete. [2025-09-18T18:00:51.846791] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-18T18:00:52.253247] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:00:52.274062] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-18T18:00:52.519564] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-18T18:00:53.319557] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-11. [2025-09-18T18:00:53.489979] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-18T18:00:53.709836] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-18T18:00:54.119549] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-11. [2025-09-18T18:00:54.671054] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-18T18:00:54.709026] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-18T18:00:54.919545] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-18T18:00:55.719544] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-09-18T18:00:56.314104] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-18T18:00:56.318602] [INFO ] [REMOTE ] CCS: Full fetch complete (44446 records). [2025-09-18T18:00:56.318759] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-18T18:00:56.524702] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-09-18T18:00:56.730799] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-09-18T18:00:56.730890] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-09-18T18:00:56.731502] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-09-18T18:00:56.731566] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-09-18T18:00:56.732609] [DEBUG] [LOCAL ] CCS: Trimmed 44446 records to 30923 (keeping 200 days of data) [2025-09-18T18:00:56.922140] [DEBUG] [LOCAL ] CCS: Primary data saved (30923 records). [2025-09-18T18:00:56.922284] [INFO ] [MAIN ] CCS: Full history saved. [2025-09-18T18:00:56.922393] [INFO ] [MAIN ] Update Progress: 421/2372 symbols completed. CCS took 37.9s. Estimated remaining: 4h 42m 11s. Rate: 6.9 symbols/min [2025-09-18T18:00:57.098127] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:00:57.106833] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-18T18:00:57.132033] [DEBUG] [LOCAL ] CDRE: Loaded 25156 existing records from primary storage. [2025-09-18T18:00:57.132203] [INFO ] [MAIN ] CDRE: Loaded 25156 existing records. [2025-09-18T18:00:57.272734] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-18T18:00:57.324906] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-18T18:00:57.398900] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:00:57.399151] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-18T18:00:57.399200] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-18T18:00:57.400007] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-09-18T18:00:57.400070] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-18T18:00:57.757815] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:00:58.119544] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-09-18T18:00:58.635860] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-18T18:00:58.919536] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-18T18:00:59.407464] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-18T18:00:59.407276] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-18T18:00:59.719558] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-18T18:01:00.519555] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-11. [2025-09-18T18:01:01.319566] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-18T18:01:01.690093] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-18T18:01:01.944764] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-18T18:01:01.994929] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-18T18:01:02.119522] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-09-18T18:01:02.919588] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-18T18:01:03.351367] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T18:01:03.719569] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-09-18T18:01:04.519533] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-09-18T18:01:04.599958] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-18T18:01:04.926454] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-18T18:01:05.319595] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-18T18:01:06.026414] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T18:01:06.064441] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-18T18:01:06.119561] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-18T18:01:06.912349] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-18T18:01:06.919486] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-18T18:01:07.659190] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-18T18:01:07.719614] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-18T18:01:08.519808] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-18T18:01:09.319595] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-18T18:01:09.350905] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-18T18:01:09.812144] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-18T18:01:09.891238] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-18T18:01:10.119542] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-18T18:01:10.919579] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-18T18:01:11.124609] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-18T18:01:11.719631] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-18T18:01:12.519584] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-18T18:01:12.736757] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-18T18:01:13.282151] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-18T18:01:13.319524] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-18T18:01:13.702944] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-18T18:01:14.119591] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-18T18:01:14.892206] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-18T18:01:14.919492] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-18T18:01:15.398353] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-18T18:01:15.511413] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-18T18:01:15.514721] [INFO ] [REMOTE ] CDLR: Full fetch complete (13151 records). [2025-09-18T18:01:15.514831] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-18T18:01:15.515698] [FATAL] [VALIDATOR ] CDLR: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:01:15.515819] [FATAL] [MAIN ] CDLR: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:01:15.515883] [WARN ] [MAIN ] CDLR: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:01:15.515952] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-18T18:01:15.516040] [DEBUG] [LOCAL ] CDLR: No primary data file found to delete. [2025-09-18T18:01:15.516107] [INFO ] [LOCAL ] CDLR: Starting deletion of derivative data. [2025-09-18T18:01:15.516583] [DEBUG] [LOCAL ] CDLR: Deleted derivative data file. [2025-09-18T18:01:15.516772] [INFO ] [MAIN ] Update Progress: 422/2372 symbols completed. CDLR took 26.7s. Estimated remaining: 4h 42m 48s. Rate: 6.9 symbols/min [2025-09-18T18:01:15.721243] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-18T18:01:15.741859] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:01:15.743116] [DEBUG] [LOCAL ] CE: No existing data file found in primary storage. [2025-09-18T18:01:15.743168] [WARN ] [MAIN ] CE: No existing data found, performing full refresh instead. [2025-09-18T18:01:15.743328] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-18T18:01:15.743372] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-18T18:01:15.743414] [DEBUG] [LOCAL ] CE: No primary data file found to delete. [2025-09-18T18:01:15.743446] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-18T18:01:16.114741] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:01:16.519622] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-18T18:01:17.319626] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-18T18:01:17.537487] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-18T18:01:18.089253] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-18T18:01:18.097256] [INFO ] [REMOTE ] CDE: Full fetch complete (77425 records). [2025-09-18T18:01:18.097453] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-18T18:01:18.130414] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-11. [2025-09-18T18:01:18.502518] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-09-18T18:01:18.502620] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-09-18T18:01:18.503562] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-09-18T18:01:18.503624] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-09-18T18:01:18.505400] [DEBUG] [LOCAL ] CDE: Trimmed 77425 records to 54031 (keeping 200 days of data) [2025-09-18T18:01:18.845763] [DEBUG] [LOCAL ] CDE: Primary data saved (54031 records). [2025-09-18T18:01:18.845994] [INFO ] [MAIN ] CDE: Full history saved. [2025-09-18T18:01:18.846110] [INFO ] [MAIN ] Update Progress: 423/2372 symbols completed. CDE took 44.4s. Estimated remaining: 4h 42m 15s. Rate: 6.9 symbols/min [2025-09-18T18:01:18.924720] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-18T18:01:19.059377] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:01:19.062288] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-18T18:01:19.081132] [DEBUG] [LOCAL ] CEE: Loaded 7025 existing records from primary storage. [2025-09-18T18:01:19.081276] [INFO ] [MAIN ] CEE: Loaded 7025 existing records. [2025-09-18T18:01:19.267763] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:01:19.268042] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-18T18:01:19.268091] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-18T18:01:19.268432] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-18T18:01:19.268492] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-18T18:01:19.645948] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:01:19.719571] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-18T18:01:20.205105] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-11 (2.07 seconds). [2025-09-18T18:01:20.259810] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T18:01:20.519547] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-18T18:01:21.082706] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-18T18:01:21.264202] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-18T18:01:21.319600] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-18T18:01:22.119551] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-09-18T18:01:22.493813] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-18T18:01:22.919607] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-18T18:01:23.643328] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-18T18:01:23.719602] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-09-18T18:01:24.446475] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T18:01:24.519611] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-18T18:01:25.192738] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-18T18:01:25.319559] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-18T18:01:25.982780] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T18:01:26.119578] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-11. [2025-09-18T18:01:26.818967] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-18T18:01:26.850256] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-18T18:01:26.919550] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-09-18T18:01:27.610456] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-18T18:01:27.719596] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-18T18:01:28.519571] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-09-18T18:01:29.129089] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-18T18:01:29.319583] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-18T18:01:29.355766] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T18:01:30.119561] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-18T18:01:30.245013] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-18T18:01:30.919572] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-18T18:01:31.442753] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T18:01:31.719558] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-18T18:01:32.519595] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-18T18:01:32.700897] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-18T18:01:32.881626] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-18T18:01:32.885340] [INFO ] [REMOTE ] CDRE: Full fetch complete (35548 records). [2025-09-18T18:01:32.885439] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-18T18:01:33.305713] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-18T18:01:33.305942] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-09-18T18:01:33.309464] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-09-18T18:01:33.310711] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-09-18T18:01:33.310825] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-09-18T18:01:33.311732] [DEBUG] [LOCAL ] CDRE: Trimmed 35548 records to 25336 (keeping 200 days of data) [2025-09-18T18:01:33.365913] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-18T18:01:33.476296] [DEBUG] [LOCAL ] CDRE: Primary data saved (25336 records). [2025-09-18T18:01:33.476453] [INFO ] [MAIN ] CDRE: Full history saved. [2025-09-18T18:01:33.476547] [INFO ] [MAIN ] Update Progress: 424/2372 symbols completed. CDRE took 36.6s. Estimated remaining: 4h 42m 33s. Rate: 6.9 symbols/min [2025-09-18T18:01:33.668958] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:01:33.700680] [DEBUG] [LOCAL ] CEPU: Loaded 25568 existing records from primary storage. [2025-09-18T18:01:33.700838] [INFO ] [MAIN ] CEPU: Loaded 25568 existing records. [2025-09-18T18:01:33.907358] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:01:33.907614] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-18T18:01:33.907706] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-18T18:01:33.908306] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-18T18:01:33.908365] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-18T18:01:34.124751] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-18T18:01:34.273945] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:01:34.919574] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-11. [2025-09-18T18:01:35.097029] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-18T18:01:35.121847] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-18T18:01:35.719577] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-18T18:01:36.034609] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T18:01:36.519559] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-18T18:01:36.966411] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-18T18:01:37.319560] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-18T18:01:37.866834] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-18T18:01:38.119584] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-18T18:01:38.714746] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-18T18:01:38.721129] [INFO ] [REMOTE ] CDP: Full fetch complete (61720 records). [2025-09-18T18:01:38.721297] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-18T18:01:38.928081] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-09-18T18:01:39.042742] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-18T18:01:39.138764] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-09-18T18:01:39.138853] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-09-18T18:01:39.139548] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-09-18T18:01:39.139591] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-09-18T18:01:39.140953] [DEBUG] [LOCAL ] CDP: Trimmed 61720 records to 43105 (keeping 200 days of data) [2025-09-18T18:01:39.404107] [DEBUG] [LOCAL ] CDP: Primary data saved (43105 records). [2025-09-18T18:01:39.404250] [INFO ] [MAIN ] CDP: Full history saved. [2025-09-18T18:01:39.404328] [INFO ] [MAIN ] Update Progress: 425/2372 symbols completed. CDP took 47.7s. Estimated remaining: 4h 42m 12s. Rate: 6.9 symbols/min [2025-09-18T18:01:39.573208] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:01:39.625448] [DEBUG] [LOCAL ] CF: Loaded 52258 existing records from primary storage. [2025-09-18T18:01:39.625676] [INFO ] [MAIN ] CF: Loaded 52258 existing records. [2025-09-18T18:01:39.724834] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-18T18:01:39.807834] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:01:39.808129] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-18T18:01:39.808186] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-18T18:01:39.809746] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-18T18:01:39.809810] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-18T18:01:40.206032] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:01:40.228363] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-18T18:01:40.519554] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-18T18:01:41.020368] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-18T18:01:41.319577] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-18T18:01:41.622692] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-18T18:01:41.686338] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-18T18:01:42.119591] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-18T18:01:42.731884] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-18T18:01:42.919544] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-18T18:01:43.719547] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-11. [2025-09-18T18:01:44.519554] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-09-18T18:01:44.555109] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T18:01:45.152861] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T18:01:45.319560] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-09-18T18:01:45.626563] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-18T18:01:46.119586] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-18T18:01:46.704443] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-18T18:01:46.705701] [INFO ] [REMOTE ] CEE: Full fetch complete (10164 records). [2025-09-18T18:01:46.705799] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-18T18:01:46.929265] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-18T18:01:47.091119] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-18T18:01:47.091294] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-18T18:01:47.091636] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-18T18:01:47.091792] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-18T18:01:47.092356] [DEBUG] [LOCAL ] CEE: Trimmed 10164 records to 7051 (keeping 200 days of data) [2025-09-18T18:01:47.154679] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-18T18:01:47.175958] [DEBUG] [LOCAL ] CEE: Primary data saved (7051 records). [2025-09-18T18:01:47.176143] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-18T18:01:47.176262] [INFO ] [MAIN ] Update Progress: 426/2372 symbols completed. CEE took 28.3s. Estimated remaining: 4h 41m 59s. Rate: 6.9 symbols/min [2025-09-18T18:01:47.350588] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:01:47.350845] [DEBUG] [LOCAL ] CFG: No existing data file found in primary storage. [2025-09-18T18:01:47.350904] [WARN ] [MAIN ] CFG: No existing data found, performing full refresh instead. [2025-09-18T18:01:47.351060] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-18T18:01:47.351104] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-18T18:01:47.351149] [DEBUG] [LOCAL ] CFG: No primary data file found to delete. [2025-09-18T18:01:47.351185] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-18T18:01:47.709876] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:01:47.719690] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-11. [2025-09-18T18:01:48.046843] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-18T18:01:48.519554] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-18T18:01:49.319550] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-18T18:01:49.528351] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-18T18:01:49.588903] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-18T18:01:50.119698] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-09-18T18:01:50.858976] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-18T18:01:50.866191] [INFO ] [REMOTE ] CE: Full fetch complete (74741 records). [2025-09-18T18:01:50.866355] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-18T18:01:50.930312] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-18T18:01:51.264409] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-09-18T18:01:51.264496] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-09-18T18:01:51.265358] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-09-18T18:01:51.265427] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-09-18T18:01:51.267012] [DEBUG] [LOCAL ] CE: Trimmed 74741 records to 51968 (keeping 200 days of data) [2025-09-18T18:01:51.591842] [DEBUG] [LOCAL ] CE: Primary data saved (51968 records). [2025-09-18T18:01:51.591997] [INFO ] [MAIN ] CE: Full history saved. [2025-09-18T18:01:51.592091] [INFO ] [MAIN ] Update Progress: 427/2372 symbols completed. CE took 36.1s. Estimated remaining: 4h 41m 31s. Rate: 6.9 symbols/min [2025-09-18T18:01:51.729722] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-09-18T18:01:51.784629] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:01:51.784943] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-18T18:01:51.785087] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-18T18:01:51.785463] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-18T18:01:51.785557] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-18T18:01:51.785679] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-18T18:01:51.785784] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-18T18:01:52.070554] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-18T18:01:52.181497] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-18T18:01:52.262434] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:01:52.519570] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-11. [2025-09-18T18:01:52.729466] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:01:52.729847] [WARN ] [REMOTE ] CFND: No data returned for month 2024-11 [2025-09-18T18:01:53.319521] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-09-18T18:01:53.372097] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-18T18:01:53.532917] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:01:53.533305] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-09-18T18:01:54.119548] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-09-18T18:01:54.317127] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:01:54.317524] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-09-18T18:01:54.919545] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-18T18:01:55.719520] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-09-18T18:01:56.176508] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-18T18:01:56.519617] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-18T18:01:57.117184] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-18T18:01:57.319591] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-18T18:01:58.119547] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-18T18:01:58.413154] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-18T18:01:58.794364] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-18T18:01:58.919572] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-18T18:01:59.010161] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T18:01:59.719551] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-18T18:02:00.519551] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-18T18:02:00.774152] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-18T18:02:00.801572] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-18T18:02:01.319594] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-18T18:02:01.946800] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-18T18:02:02.119582] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-18T18:02:02.771936] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T18:02:02.919570] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-18T18:02:03.289362] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-18T18:02:03.719559] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-02. [2025-09-18T18:02:03.920979] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:02:03.921311] [WARN ] [REMOTE ] CFND: No data returned for month 2025-02 [2025-09-18T18:02:04.519577] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-18T18:02:04.589452] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-18T18:02:05.319547] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-03. [2025-09-18T18:02:05.573280] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:02:05.573716] [WARN ] [REMOTE ] CFND: No data returned for month 2025-03 [2025-09-18T18:02:06.119590] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-18T18:02:06.159035] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T18:02:06.919556] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-04. [2025-09-18T18:02:07.128191] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:02:07.128585] [WARN ] [REMOTE ] CFND: No data returned for month 2025-04 [2025-09-18T18:02:07.542158] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-18T18:02:07.549237] [INFO ] [REMOTE ] CEPU: Full fetch complete (39497 records). [2025-09-18T18:02:07.549345] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-18T18:02:07.727740] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-18T18:02:07.958763] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-18T18:02:07.958847] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-18T18:02:07.959392] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-18T18:02:07.959436] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-18T18:02:07.961132] [DEBUG] [LOCAL ] CEPU: Trimmed 39497 records to 25891 (keeping 200 days of data) [2025-09-18T18:02:08.132621] [DEBUG] [LOCAL ] CEPU: Primary data saved (25891 records). [2025-09-18T18:02:08.132881] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-18T18:02:08.133091] [INFO ] [MAIN ] Update Progress: 428/2372 symbols completed. CEPU took 34.7s. Estimated remaining: 4h 41m 58s. Rate: 6.9 symbols/min [2025-09-18T18:02:08.309706] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:02:08.348882] [DEBUG] [LOCAL ] CFR: Loaded 33711 existing records from primary storage. [2025-09-18T18:02:08.349031] [INFO ] [MAIN ] CFR: Loaded 33711 existing records. [2025-09-18T18:02:08.520635] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-18T18:02:08.536019] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:02:08.536311] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-18T18:02:08.536362] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-18T18:02:08.537336] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-09-18T18:02:08.537415] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-18T18:02:08.912963] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:02:09.262001] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-18T18:02:09.319576] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-05. [2025-09-18T18:02:09.536896] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:02:09.537456] [WARN ] [REMOTE ] CFND: No data returned for month 2025-05 [2025-09-18T18:02:10.119565] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-18T18:02:10.640868] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-18T18:02:10.919563] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-18T18:02:11.719585] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-11. [2025-09-18T18:02:12.019723] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-18T18:02:12.519614] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-18T18:02:12.695281] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-18T18:02:12.842747] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T18:02:13.319570] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-06. [2025-09-18T18:02:13.534140] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:02:13.534460] [WARN ] [REMOTE ] CFND: No data returned for month 2025-06 [2025-09-18T18:02:14.081964] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-18T18:02:14.119513] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-18T18:02:14.919556] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-18T18:02:15.719566] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-07. [2025-09-18T18:02:16.009703] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:02:16.010031] [WARN ] [REMOTE ] CFND: No data returned for month 2025-07 [2025-09-18T18:02:16.031994] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-18T18:02:16.039218] [INFO ] [REMOTE ] CFG: Full fetch complete (77019 records). [2025-09-18T18:02:16.039392] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-18T18:02:16.040192] [FATAL] [VALIDATOR ] CFG: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:02:16.040309] [FATAL] [MAIN ] CFG: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:02:16.040421] [WARN ] [MAIN ] CFG: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:02:16.040516] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-18T18:02:16.040601] [DEBUG] [LOCAL ] CFG: No primary data file found to delete. [2025-09-18T18:02:16.040638] [INFO ] [LOCAL ] CFG: Starting deletion of derivative data. [2025-09-18T18:02:16.040742] [DEBUG] [LOCAL ] CFG: No derivative data file found to delete. [2025-09-18T18:02:16.040828] [INFO ] [MAIN ] Update Progress: 429/2372 symbols completed. CFG took 28.9s. Estimated remaining: 4h 41m 46s. Rate: 6.9 symbols/min [2025-09-18T18:02:16.212356] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:02:16.267141] [DEBUG] [LOCAL ] CGAU: Loaded 42449 existing records from primary storage. [2025-09-18T18:02:16.267380] [INFO ] [MAIN ] CGAU: Loaded 42449 existing records. [2025-09-18T18:02:16.455589] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:02:16.456101] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-18T18:02:16.456192] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-18T18:02:16.457369] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-18T18:02:16.457452] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-18T18:02:16.529045] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-08. [2025-09-18T18:02:16.799347] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-18T18:02:16.881853] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:02:17.319552] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-18T18:02:17.342300] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-18T18:02:18.119600] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-09. [2025-09-18T18:02:18.690713] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-18T18:02:18.692253] [INFO ] [REMOTE ] CFND: Full fetch complete (2399 records). [2025-09-18T18:02:18.692327] [DEBUG] [VALIDATOR ] CFND: Validating primary data. [2025-09-18T18:02:18.876823] [WARN ] [VALIDATOR ] CFND: Validation failed - insufficient historical data. Have 30 unique days, need 200 days [2025-09-18T18:02:18.877189] [FATAL] [MAIN ] CFND: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:02:18.877339] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:02:18.877588] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-18T18:02:18.877912] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-18T18:02:18.877996] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-18T18:02:18.878095] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-18T18:02:18.878458] [INFO ] [MAIN ] Update Progress: 430/2372 symbols completed. CFND took 27.3s. Estimated remaining: 4h 41m 10s. Rate: 6.9 symbols/min [2025-09-18T18:02:18.924739] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-09-18T18:02:19.084762] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:02:19.119427] [DEBUG] [LOCAL ] CGV: Loaded 1429 existing records from primary storage. [2025-09-18T18:02:19.122405] [INFO ] [MAIN ] CGV: Loaded 1429 existing records. [2025-09-18T18:02:19.196944] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-18T18:02:19.333082] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:02:19.333346] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-18T18:02:19.333396] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-18T18:02:19.333600] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-09-18T18:02:19.333700] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-18T18:02:19.724673] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-18T18:02:19.724592] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:02:20.043267] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-18T18:02:20.519582] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-11. [2025-09-18T18:02:21.319617] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-09-18T18:02:21.611137] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-18T18:02:21.620271] [INFO ] [REMOTE ] CF: Full fetch complete (74942 records). [2025-09-18T18:02:21.620447] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-18T18:02:22.082479] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-18T18:02:22.082806] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-18T18:02:22.083780] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-18T18:02:22.083911] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-18T18:02:22.097049] [DEBUG] [LOCAL ] CF: Trimmed 74942 records to 52631 (keeping 200 days of data) [2025-09-18T18:02:22.113764] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-18T18:02:22.129910] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-09-18T18:02:22.464992] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T18:02:22.496443] [DEBUG] [LOCAL ] CF: Primary data saved (52631 records). [2025-09-18T18:02:22.496610] [INFO ] [MAIN ] CF: Full history saved. [2025-09-18T18:02:22.496773] [INFO ] [MAIN ] Update Progress: 431/2372 symbols completed. CF took 43.1s. Estimated remaining: 4h 40m 39s. Rate: 6.9 symbols/min [2025-09-18T18:02:22.667861] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:02:22.693954] [DEBUG] [LOCAL ] CHCT: Loaded 24105 existing records from primary storage. [2025-09-18T18:02:22.694104] [INFO ] [MAIN ] CHCT: Loaded 24105 existing records. [2025-09-18T18:02:22.889076] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:02:22.889718] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-18T18:02:22.889827] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-18T18:02:22.890756] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-18T18:02:22.890836] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-18T18:02:22.924605] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-18T18:02:23.333572] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:02:23.474853] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T18:02:23.719572] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-09-18T18:02:24.262583] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-18T18:02:24.519565] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-18T18:02:24.741986] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-18T18:02:25.319623] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-18T18:02:25.947607] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-18T18:02:26.119550] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-18T18:02:26.514349] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-18T18:02:26.919566] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-11. [2025-09-18T18:02:27.689500] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-18T18:02:27.719610] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-18T18:02:27.946699] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-18T18:02:28.519628] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-09-18T18:02:28.777435] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-18T18:02:29.319508] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-18T18:02:29.350886] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-18T18:02:30.119515] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-09-18T18:02:30.504857] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-18T18:02:30.919510] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-18T18:02:31.073333] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T18:02:31.719591] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-11. [2025-09-18T18:02:32.161280] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-18T18:02:32.307445] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-18T18:02:32.519541] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-09-18T18:02:32.964950] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-18T18:02:33.319594] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-18T18:02:34.119577] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-09-18T18:02:34.423180] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-18T18:02:34.435542] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-18T18:02:34.919553] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-18T18:02:35.719552] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-18T18:02:36.519594] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-18T18:02:36.670320] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-18T18:02:36.727152] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-18T18:02:37.319560] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-18T18:02:37.925535] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-18T18:02:38.119577] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-18T18:02:38.267709] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-18T18:02:38.411848] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-18T18:02:38.919564] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-18T18:02:39.327847] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-18T18:02:39.719561] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-18T18:02:40.519564] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-18T18:02:41.255938] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-18T18:02:41.261685] [INFO ] [REMOTE ] CFR: Full fetch complete (48370 records). [2025-09-18T18:02:41.261839] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-18T18:02:41.325070] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-18T18:02:41.714539] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-09-18T18:02:41.715429] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-09-18T18:02:41.716093] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-09-18T18:02:41.718190] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-09-18T18:02:41.718081] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-18T18:02:41.726080] [DEBUG] [LOCAL ] CFR: Trimmed 48370 records to 33951 (keeping 200 days of data) [2025-09-18T18:02:41.956246] [DEBUG] [LOCAL ] CFR: Primary data saved (33951 records). [2025-09-18T18:02:41.956410] [INFO ] [MAIN ] CFR: Full history saved. [2025-09-18T18:02:41.956526] [INFO ] [MAIN ] Update Progress: 432/2372 symbols completed. CFR took 33.8s. Estimated remaining: 4h 41m 19s. Rate: 6.9 symbols/min [2025-09-18T18:02:42.144451] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-18T18:02:42.149622] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:02:42.150885] [DEBUG] [LOCAL ] CHD: No existing data file found in primary storage. [2025-09-18T18:02:42.150953] [WARN ] [MAIN ] CHD: No existing data found, performing full refresh instead. [2025-09-18T18:02:42.151170] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-18T18:02:42.151215] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-18T18:02:42.151258] [DEBUG] [LOCAL ] CHD: No primary data file found to delete. [2025-09-18T18:02:42.151293] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-18T18:02:42.530527] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:02:42.743088] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-18T18:02:42.772747] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T18:02:42.919570] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-18T18:02:43.719553] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-11. [2025-09-18T18:02:44.212574] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-18T18:02:44.519549] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-18T18:02:45.319553] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-18T18:02:45.624336] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-18T18:02:45.709019] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-18T18:02:45.970347] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-18T18:02:46.119551] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-18T18:02:46.919567] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-18T18:02:47.188456] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-18T18:02:47.448839] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-18T18:02:47.719545] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-18T18:02:48.519546] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-18T18:02:49.319530] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-09-18T18:02:49.350362] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-18T18:02:49.445810] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T18:02:50.119555] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-18T18:02:50.822295] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T18:02:50.919543] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-09-18T18:02:51.260148] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T18:02:51.719549] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-18T18:02:52.145106] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-18T18:02:52.408603] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T18:02:52.519551] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-18T18:02:53.319549] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-18T18:02:53.874330] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T18:02:54.119568] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-18T18:02:54.157367] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-18T18:02:54.919594] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-18T18:02:55.705776] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T18:02:55.719493] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-18T18:02:56.519605] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-18T18:02:56.736318] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-18T18:02:56.743985] [INFO ] [REMOTE ] CGAU: Full fetch complete (60130 records). [2025-09-18T18:02:56.744151] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-18T18:02:57.184310] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-18T18:02:57.184439] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-18T18:02:57.185409] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-18T18:02:57.185529] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-18T18:02:57.188013] [DEBUG] [LOCAL ] CGAU: Trimmed 60130 records to 42806 (keeping 200 days of data) [2025-09-18T18:02:57.315615] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-18T18:02:57.327878] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-18T18:02:57.351920] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-18T18:02:57.358451] [INFO ] [REMOTE ] CHCT: Full fetch complete (35045 records). [2025-09-18T18:02:57.361317] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-18T18:02:57.828459] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-18T18:02:57.924098] [DEBUG] [LOCAL ] CGAU: Primary data saved (42806 records). [2025-09-18T18:02:57.942157] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-18T18:02:57.948605] [INFO ] [MAIN ] Update Progress: 433/2372 symbols completed. CGAU took 41.9s. Estimated remaining: 4h 41m 43s. Rate: 6.9 symbols/min [2025-09-18T18:02:57.963351] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-18T18:02:58.010841] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-18T18:02:58.044790] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-18T18:02:58.062740] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-18T18:02:58.096863] [DEBUG] [LOCAL ] CHCT: Trimmed 35045 records to 24304 (keeping 200 days of data) [2025-09-18T18:02:58.124612] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-18T18:02:58.264450] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:02:58.291495] [DEBUG] [LOCAL ] CHE: Loaded 14583 existing records from primary storage. [2025-09-18T18:02:58.296518] [INFO ] [MAIN ] CHE: Loaded 14583 existing records. [2025-09-18T18:02:58.509851] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:02:58.511467] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-18T18:02:58.511854] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-18T18:02:58.513453] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-18T18:02:58.513779] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-18T18:02:58.932588] [DEBUG] [LOCAL ] CHCT: Primary data saved (24304 records). [2025-09-18T18:02:58.925800] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-18T18:02:58.932481] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:02:58.933673] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-18T18:02:58.934095] [INFO ] [MAIN ] Update Progress: 434/2372 symbols completed. CHCT took 36.4s. Estimated remaining: 4h 40m 59s. Rate: 6.9 symbols/min [2025-09-18T18:02:59.116925] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:02:59.117154] [DEBUG] [LOCAL ] CHGG: No existing data file found in primary storage. [2025-09-18T18:02:59.117210] [WARN ] [MAIN ] CHGG: No existing data found, performing full refresh instead. [2025-09-18T18:02:59.117377] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-18T18:02:59.117429] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-18T18:02:59.117473] [DEBUG] [LOCAL ] CHGG: No primary data file found to delete. [2025-09-18T18:02:59.117506] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-18T18:02:59.433007] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-18T18:02:59.456946] [INFO ] [REMOTE ] CGV: Full fetch complete (2270 records). [2025-09-18T18:02:59.462758] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-18T18:02:59.549880] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:02:59.729407] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-11. [2025-09-18T18:02:59.913295] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-09-18T18:02:59.913389] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-09-18T18:02:59.913497] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-09-18T18:02:59.913539] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-09-18T18:02:59.913973] [DEBUG] [LOCAL ] CGV: Trimmed 2270 records to 1446 (keeping 200 days of data) [2025-09-18T18:02:59.923856] [DEBUG] [LOCAL ] CGV: Primary data saved (1446 records). [2025-09-18T18:02:59.923972] [INFO ] [MAIN ] CGV: Full history saved. [2025-09-18T18:02:59.924059] [INFO ] [MAIN ] Update Progress: 435/2372 symbols completed. CGV took 41.0s. Estimated remaining: 4h 40m 16s. Rate: 6.9 symbols/min [2025-09-18T18:03:00.112537] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:03:00.174307] [DEBUG] [LOCAL ] CHH: Loaded 32453 existing records from primary storage. [2025-09-18T18:03:00.174469] [INFO ] [MAIN ] CHH: Loaded 32453 existing records. [2025-09-18T18:03:00.388725] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:03:00.389115] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-18T18:03:00.389171] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-18T18:03:00.390259] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-09-18T18:03:00.390321] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-18T18:03:00.529099] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-11. [2025-09-18T18:03:00.635424] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-18T18:03:00.798420] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-18T18:03:00.860606] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:03:01.319560] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-18T18:03:02.119518] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-11. [2025-09-18T18:03:02.546397] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-18T18:03:02.655966] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T18:03:02.919561] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-18T18:03:03.351820] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-18T18:03:03.719553] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-09-18T18:03:04.509440] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-18T18:03:04.520908] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-09-18T18:03:04.773127] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T18:03:05.149857] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-18T18:03:05.319567] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-18T18:03:06.119545] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-09-18T18:03:06.874904] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-18T18:03:06.919503] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-18T18:03:07.697781] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T18:03:07.719492] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-18T18:03:08.229076] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-18T18:03:08.236554] [INFO ] [REMOTE ] CHD: Full fetch complete (74190 records). [2025-09-18T18:03:08.236732] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-18T18:03:08.524715] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-09-18T18:03:08.633965] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-09-18T18:03:08.634063] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-09-18T18:03:08.634911] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-09-18T18:03:08.634982] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-09-18T18:03:08.637161] [DEBUG] [LOCAL ] CHD: Trimmed 74190 records to 52379 (keeping 200 days of data) [2025-09-18T18:03:08.973614] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T18:03:09.005953] [DEBUG] [LOCAL ] CHD: Primary data saved (52379 records). [2025-09-18T18:03:09.006116] [INFO ] [MAIN ] CHD: Full history saved. [2025-09-18T18:03:09.006201] [INFO ] [MAIN ] Update Progress: 436/2372 symbols completed. CHD took 27.0s. Estimated remaining: 4h 40m 9s. Rate: 6.9 symbols/min [2025-09-18T18:03:09.177889] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:03:09.187021] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-18T18:03:09.209957] [DEBUG] [LOCAL ] CHMI: Loaded 22064 existing records from primary storage. [2025-09-18T18:03:09.210085] [INFO ] [MAIN ] CHMI: Loaded 22064 existing records. [2025-09-18T18:03:09.324749] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-18T18:03:09.395295] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:03:09.395563] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-18T18:03:09.395612] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-18T18:03:09.396262] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-09-18T18:03:09.396322] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-18T18:03:09.759767] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:03:10.119556] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-11. [2025-09-18T18:03:10.539381] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-18T18:03:10.919539] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-18T18:03:11.003064] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-18T18:03:11.719561] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-18T18:03:11.854348] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-18T18:03:12.519573] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-09-18T18:03:13.078874] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-18T18:03:13.319568] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-18T18:03:14.045812] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-18T18:03:14.119559] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-09-18T18:03:14.493545] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-18T18:03:14.919522] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-18T18:03:15.054692] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-18T18:03:15.719562] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-09-18T18:03:15.912621] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-18T18:03:16.519608] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-18T18:03:17.273443] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-18T18:03:17.305979] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-18T18:03:17.319495] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-18T18:03:18.119599] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-18T18:03:18.845509] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-18T18:03:18.919542] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-18T18:03:19.030165] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-18T18:03:19.726546] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-18T18:03:19.727720] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-18T18:03:20.519627] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-09-18T18:03:21.327269] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-18T18:03:21.336887] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-18T18:03:21.521712] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-18T18:03:22.119618] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-18T18:03:22.919710] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-18T18:03:23.052726] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-18T18:03:23.096487] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-18T18:03:23.719560] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-18T18:03:23.849055] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-18T18:03:24.519548] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-18T18:03:24.668224] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-18T18:03:25.319575] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-18T18:03:25.619447] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-18T18:03:26.119588] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-18T18:03:26.641715] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-18T18:03:26.919549] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-18T18:03:27.106523] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-18T18:03:27.719564] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-18T18:03:27.801675] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-18T18:03:28.453718] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-18T18:03:28.519531] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-18T18:03:29.319518] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-18T18:03:29.411064] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T18:03:30.119534] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-18T18:03:30.372702] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-18T18:03:30.379200] [INFO ] [REMOTE ] CHE: Full fetch complete (19351 records). [2025-09-18T18:03:30.379402] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-18T18:03:30.753709] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-18T18:03:30.753816] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-18T18:03:30.754171] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-18T18:03:30.754214] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-18T18:03:30.754795] [DEBUG] [LOCAL ] CHE: Trimmed 19351 records to 14730 (keeping 200 days of data) [2025-09-18T18:03:30.847462] [DEBUG] [LOCAL ] CHE: Primary data saved (14730 records). [2025-09-18T18:03:30.847593] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-18T18:03:30.847697] [INFO ] [MAIN ] Update Progress: 437/2372 symbols completed. CHE took 32.9s. Estimated remaining: 4h 40m 59s. Rate: 6.9 symbols/min [2025-09-18T18:03:30.919558] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-18T18:03:30.975862] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-18T18:03:31.719610] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-18T18:03:32.521745] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-18T18:03:32.527597] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-18T18:03:32.571096] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-18T18:03:32.575272] [INFO ] [REMOTE ] CHH: Full fetch complete (45875 records). [2025-09-18T18:03:32.575373] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-18T18:03:32.576023] [FATAL] [VALIDATOR ] CHH: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:03:32.576110] [FATAL] [MAIN ] CHH: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:03:32.576154] [WARN ] [MAIN ] CHH: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:03:32.576218] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-18T18:03:32.576284] [DEBUG] [LOCAL ] CHH: No primary data file found to delete. [2025-09-18T18:03:32.576322] [INFO ] [LOCAL ] CHH: Starting deletion of derivative data. [2025-09-18T18:03:32.576871] [DEBUG] [LOCAL ] CHH: Deleted derivative data file. [2025-09-18T18:03:32.577801] [INFO ] [MAIN ] Update Progress: 438/2372 symbols completed. CHH took 32.7s. Estimated remaining: 4h 40m 19s. Rate: 6.9 symbols/min [2025-09-18T18:03:33.319609] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-18T18:03:34.136783] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-18T18:03:34.146888] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-18T18:03:34.234601] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-18T18:03:34.238215] [INFO ] [REMOTE ] CHMI: Full fetch complete (31593 records). [2025-09-18T18:03:34.238326] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-18T18:03:34.614952] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-09-18T18:03:34.615031] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-09-18T18:03:34.615466] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-09-18T18:03:34.615507] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-09-18T18:03:34.616262] [DEBUG] [LOCAL ] CHMI: Trimmed 31593 records to 22199 (keeping 200 days of data) [2025-09-18T18:03:34.740165] [DEBUG] [LOCAL ] CHMI: Primary data saved (22199 records). [2025-09-18T18:03:34.740298] [INFO ] [MAIN ] CHMI: Full history saved. [2025-09-18T18:03:34.740380] [INFO ] [MAIN ] Update Progress: 439/2372 symbols completed. CHMI took 25.7s. Estimated remaining: 4h 39m 42s. Rate: 6.9 symbols/min [2025-09-18T18:03:35.865822] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-18T18:03:35.875878] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-18T18:03:37.614265] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-18T18:03:37.624671] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-18T18:03:39.519804] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-18T18:03:39.530562] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-18T18:03:40.981455] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T18:03:40.991726] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-18T18:03:42.861153] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-18T18:03:42.869951] [INFO ] [REMOTE ] CHGG: Full fetch complete (70687 records). [2025-09-18T18:03:42.870159] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-18T18:03:43.280565] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-09-18T18:03:43.280678] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-09-18T18:03:43.281470] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-09-18T18:03:43.281516] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-09-18T18:03:43.283055] [DEBUG] [LOCAL ] CHGG: Trimmed 70687 records to 48206 (keeping 200 days of data) [2025-09-18T18:03:43.571742] [DEBUG] [LOCAL ] CHGG: Primary data saved (48206 records). [2025-09-18T18:03:43.571880] [INFO ] [MAIN ] CHGG: Full history saved. [2025-09-18T18:03:43.571957] [INFO ] [MAIN ] Update Progress: 440/2372 symbols completed. CHGG took 44.6s. Estimated remaining: 4h 39m 34s. Rate: 6.9 symbols/min [2025-09-18T18:03:44.186091] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:03:44.218407] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:03:44.332727] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:03:44.334204] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:03:44.334608] [DEBUG] [LOCAL ] CHPT: No existing data file found in primary storage. [2025-09-18T18:03:44.334815] [WARN ] [MAIN ] CHPT: No existing data found, performing full refresh instead. [2025-09-18T18:03:44.335182] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-18T18:03:44.335228] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-18T18:03:44.335270] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-09-18T18:03:44.335302] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-18T18:03:44.393325] [DEBUG] [LOCAL ] CHN: Loaded 4806 existing records from primary storage. [2025-09-18T18:03:44.413820] [INFO ] [MAIN ] CHN: Loaded 4806 existing records. [2025-09-18T18:03:44.584775] [DEBUG] [LOCAL ] CHT: Loaded 19812 existing records from primary storage. [2025-09-18T18:03:44.637062] [INFO ] [MAIN ] CHT: Loaded 19812 existing records. [2025-09-18T18:03:44.836943] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:03:44.905245] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-18T18:03:44.978461] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-18T18:03:45.018123] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-09-18T18:03:45.032412] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-18T18:03:45.007781] [DEBUG] [LOCAL ] CHWY: Loaded 53626 existing records from primary storage. [2025-09-18T18:03:45.150889] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:03:45.112873] [INFO ] [MAIN ] CHWY: Loaded 53626 existing records. [2025-09-18T18:03:45.191667] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-18T18:03:45.240127] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-18T18:03:45.311358] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-09-18T18:03:45.316712] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-18T18:03:45.311283] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:03:45.402942] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-11. [2025-09-18T18:03:45.756127] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:03:45.806677] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-18T18:03:45.854522] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-18T18:03:45.877728] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-09-18T18:03:45.907836] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-18T18:03:46.092951] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:03:46.120803] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-11. [2025-09-18T18:03:46.339629] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:03:46.366438] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-11. [2025-09-18T18:03:46.476857] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:03:46.477150] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-11. [2025-09-18T18:03:46.781524] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-18T18:03:46.783542] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-09-18T18:03:47.242952] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-18T18:03:47.244927] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-09-18T18:03:47.293518] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-18T18:03:47.297909] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-09-18T18:03:47.546537] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-11 (2.14 seconds). [2025-09-18T18:03:47.557308] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-09-18T18:03:47.816018] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-18T18:03:47.818048] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-18T18:03:48.034732] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-18T18:03:48.038693] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-09-18T18:03:48.268444] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-18T18:03:48.282672] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-09-18T18:03:48.284238] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-18T18:03:48.286297] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-18T18:03:48.722328] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-18T18:03:48.723996] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-18T18:03:48.790412] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-18T18:03:48.794338] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-18T18:03:49.185373] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-18T18:03:49.319545] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-18T18:03:49.470895] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-18T18:03:49.566173] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-18T18:03:49.749750] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-18T18:03:49.975311] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-18T18:03:50.119501] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-09-18T18:03:50.919608] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-18T18:03:51.371002] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-18T18:03:51.719534] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-18T18:03:51.955624] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-18T18:03:52.203390] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-18T18:03:52.519547] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-18T18:03:53.319587] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-09-18T18:03:54.119527] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-18T18:03:54.154130] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-18T18:03:54.798580] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-18T18:03:54.919587] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-18T18:03:55.184966] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-18T18:03:55.390619] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-18T18:03:55.391980] [INFO ] [REMOTE ] CHN: Full fetch complete (7595 records). [2025-09-18T18:03:55.392051] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-18T18:03:55.734610] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-18T18:03:55.777800] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-09-18T18:03:55.777881] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-09-18T18:03:55.778104] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-09-18T18:03:55.778144] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-09-18T18:03:55.778543] [DEBUG] [LOCAL ] CHN: Trimmed 7595 records to 4842 (keeping 200 days of data) [2025-09-18T18:03:55.808029] [DEBUG] [LOCAL ] CHN: Primary data saved (4842 records). [2025-09-18T18:03:55.808149] [INFO ] [MAIN ] CHN: Full history saved. [2025-09-18T18:03:55.808239] [INFO ] [MAIN ] Update Progress: 441/2372 symbols completed. CHN took 12.2s. Estimated remaining: 4h 39m 41s. Rate: 6.9 symbols/min [2025-09-18T18:03:55.983115] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:03:56.042077] [DEBUG] [LOCAL ] CI: Loaded 50011 existing records from primary storage. [2025-09-18T18:03:56.042254] [INFO ] [MAIN ] CI: Loaded 50011 existing records. [2025-09-18T18:03:56.218159] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:03:56.218425] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-18T18:03:56.218482] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-18T18:03:56.220055] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-18T18:03:56.220117] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-18T18:03:56.533015] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-18T18:03:56.575154] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:03:57.319595] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-11. [2025-09-18T18:03:57.834696] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-18T18:03:58.010900] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-18T18:03:58.119517] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-18T18:03:58.919555] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-18T18:03:59.011473] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-18T18:03:59.719528] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-18T18:03:59.812352] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-18T18:04:00.020145] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-18T18:04:00.519547] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-18T18:04:01.319569] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-18T18:04:01.639546] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-18T18:04:02.124737] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-18T18:04:02.134290] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-18T18:04:02.649928] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-18T18:04:02.919593] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-18T18:04:03.719568] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-09-18T18:04:03.819303] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-18T18:04:03.842600] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T18:04:04.519570] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-18T18:04:05.205572] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T18:04:05.229608] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-18T18:04:05.319558] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-18T18:04:06.119564] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-18T18:04:06.919622] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-18T18:04:07.237552] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-18T18:04:07.261803] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T18:04:07.719547] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-18T18:04:08.519608] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-09-18T18:04:08.658338] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-18T18:04:08.661428] [INFO ] [REMOTE ] CHT: Full fetch complete (27400 records). [2025-09-18T18:04:08.661519] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-18T18:04:09.046302] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-09-18T18:04:09.046575] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-09-18T18:04:09.047042] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-09-18T18:04:09.047241] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-09-18T18:04:09.048637] [DEBUG] [LOCAL ] CHT: Trimmed 27400 records to 19893 (keeping 200 days of data) [2025-09-18T18:04:09.188463] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-18T18:04:09.216757] [DEBUG] [LOCAL ] CHT: Primary data saved (19893 records). [2025-09-18T18:04:09.216960] [INFO ] [MAIN ] CHT: Full history saved. [2025-09-18T18:04:09.217105] [INFO ] [MAIN ] Update Progress: 442/2372 symbols completed. CHT took 25.6s. Estimated remaining: 4h 39m 53s. Rate: 6.9 symbols/min [2025-09-18T18:04:09.328485] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-18T18:04:09.413996] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:04:09.434127] [DEBUG] [LOCAL ] CIA: Loaded 16809 existing records from primary storage. [2025-09-18T18:04:09.434260] [INFO ] [MAIN ] CIA: Loaded 16809 existing records. [2025-09-18T18:04:09.636798] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:04:09.637050] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-18T18:04:09.637100] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-18T18:04:09.637779] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-09-18T18:04:09.637843] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-18T18:04:10.019766] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:04:10.119962] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-11. [2025-09-18T18:04:10.122961] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-18T18:04:10.919519] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-18T18:04:11.125680] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-18T18:04:11.228940] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-18T18:04:11.719555] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-18T18:04:12.519541] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-09-18T18:04:12.628699] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-18T18:04:13.319698] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-18T18:04:13.417925] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-18T18:04:13.528990] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-18T18:04:14.119632] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-18T18:04:14.919582] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-09-18T18:04:15.243158] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-18T18:04:15.461139] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-18T18:04:15.719550] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-18T18:04:16.144374] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-18T18:04:16.300706] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-18T18:04:16.519568] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-18T18:04:17.319571] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-18T18:04:17.987721] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T18:04:18.119550] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-18T18:04:18.925019] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-18T18:04:18.953387] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-18T18:04:19.700059] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-18T18:04:19.719498] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-18T18:04:19.785782] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-18T18:04:19.791387] [INFO ] [REMOTE ] CHPT: Full fetch complete (73751 records). [2025-09-18T18:04:19.791514] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-18T18:04:20.196816] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-09-18T18:04:20.196898] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-09-18T18:04:20.197982] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-09-18T18:04:20.198078] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-09-18T18:04:20.200079] [DEBUG] [LOCAL ] CHPT: Trimmed 73751 records to 50058 (keeping 200 days of data) [2025-09-18T18:04:20.427845] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-18T18:04:20.519636] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-18T18:04:20.531408] [DEBUG] [LOCAL ] CHPT: Primary data saved (50058 records). [2025-09-18T18:04:20.531945] [INFO ] [MAIN ] CHPT: Full history saved. [2025-09-18T18:04:20.532050] [INFO ] [MAIN ] Update Progress: 443/2372 symbols completed. CHPT took 37.0s. Estimated remaining: 4h 39m 55s. Rate: 6.9 symbols/min [2025-09-18T18:04:20.723188] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:04:20.760627] [DEBUG] [LOCAL ] CIB: Loaded 31166 existing records from primary storage. [2025-09-18T18:04:20.760950] [INFO ] [MAIN ] CIB: Loaded 31166 existing records. [2025-09-18T18:04:20.955818] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:04:20.956149] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-18T18:04:20.956217] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-18T18:04:20.957097] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-18T18:04:20.957159] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-18T18:04:21.317949] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:04:21.319499] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-11. [2025-09-18T18:04:22.119561] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-18T18:04:22.519203] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-18T18:04:22.645314] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-18T18:04:22.919549] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-18T18:04:23.653192] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-18T18:04:23.719520] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-18T18:04:24.060752] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-18T18:04:24.519587] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-18T18:04:25.319526] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-18T18:04:25.356211] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-18T18:04:25.736783] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-18T18:04:26.119589] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-18T18:04:26.925010] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-09-18T18:04:26.935501] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-18T18:04:26.942994] [INFO ] [REMOTE ] CHWY: Full fetch complete (77118 records). [2025-09-18T18:04:26.943150] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-18T18:04:26.944162] [FATAL] [VALIDATOR ] CHWY: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:04:26.944262] [FATAL] [MAIN ] CHWY: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:04:26.944307] [WARN ] [MAIN ] CHWY: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:04:26.944349] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-18T18:04:26.944436] [DEBUG] [LOCAL ] CHWY: No primary data file found to delete. [2025-09-18T18:04:26.944496] [INFO ] [LOCAL ] CHWY: Starting deletion of derivative data. [2025-09-18T18:04:26.944910] [DEBUG] [LOCAL ] CHWY: Deleted derivative data file. [2025-09-18T18:04:26.945033] [INFO ] [MAIN ] Update Progress: 444/2372 symbols completed. CHWY took 43.4s. Estimated remaining: 4h 39m 37s. Rate: 6.9 symbols/min [2025-09-18T18:04:27.133357] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:04:27.133564] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-18T18:04:27.133608] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-18T18:04:27.133772] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-18T18:04:27.133846] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-18T18:04:27.133900] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-18T18:04:27.133934] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-18T18:04:27.512530] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:04:27.560843] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T18:04:27.719588] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-11. [2025-09-18T18:04:27.959060] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-18T18:04:28.209168] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-18T18:04:28.519548] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-18T18:04:29.319566] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-09-18T18:04:29.743358] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-18T18:04:30.119580] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-09-18T18:04:30.276976] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-18T18:04:30.919561] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-18T18:04:31.118240] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-18T18:04:31.719552] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-09-18T18:04:32.086611] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-18T18:04:32.338623] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-18T18:04:32.519620] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-18T18:04:33.319600] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-18T18:04:33.735502] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-18T18:04:33.979538] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T18:04:33.986629] [INFO ] [REMOTE ] CI: Full fetch complete (72384 records). [2025-09-18T18:04:33.986832] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-18T18:04:34.127117] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-18T18:04:34.386591] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-18T18:04:34.386717] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-18T18:04:34.387487] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-18T18:04:34.387549] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-18T18:04:34.389088] [DEBUG] [LOCAL ] CI: Trimmed 72384 records to 50340 (keeping 200 days of data) [2025-09-18T18:04:34.617143] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-18T18:04:34.723254] [DEBUG] [LOCAL ] CI: Primary data saved (50340 records). [2025-09-18T18:04:34.723420] [INFO ] [MAIN ] CI: Full history saved. [2025-09-18T18:04:34.723568] [INFO ] [MAIN ] Update Progress: 445/2372 symbols completed. CI took 38.9s. Estimated remaining: 4h 39m 24s. Rate: 6.9 symbols/min [2025-09-18T18:04:34.896032] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:04:34.926419] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-18T18:04:34.950697] [DEBUG] [LOCAL ] CIEN: Loaded 52111 existing records from primary storage. [2025-09-18T18:04:34.950850] [INFO ] [MAIN ] CIEN: Loaded 52111 existing records. [2025-09-18T18:04:35.130621] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:04:35.130926] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-18T18:04:35.130980] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-18T18:04:35.132469] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-18T18:04:35.132530] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-18T18:04:35.489535] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:04:35.719497] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-11. [2025-09-18T18:04:36.268564] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-18T18:04:36.519540] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-18T18:04:36.874106] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-18T18:04:37.203943] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-18T18:04:37.319546] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-09-18T18:04:38.119575] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-18T18:04:38.662585] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T18:04:38.919731] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-18T18:04:39.365626] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-18T18:04:39.719860] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-18T18:04:40.117502] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-18T18:04:40.519547] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-18T18:04:41.046733] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-18T18:04:41.319610] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-18T18:04:41.337184] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-18T18:04:41.743376] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-18T18:04:42.119549] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-18T18:04:42.919606] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-09-18T18:04:43.430090] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-18T18:04:43.719550] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-18T18:04:44.408940] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T18:04:44.519509] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-18T18:04:44.557070] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-18T18:04:44.928761] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-18T18:04:45.319547] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-18T18:04:46.119542] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-18T18:04:46.331368] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T18:04:46.333485] [INFO ] [REMOTE ] CIA: Full fetch complete (22950 records). [2025-09-18T18:04:46.333559] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-18T18:04:46.334095] [FATAL] [VALIDATOR ] CIA: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:04:46.334267] [FATAL] [MAIN ] CIA: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:04:46.334336] [WARN ] [MAIN ] CIA: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:04:46.334405] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-18T18:04:46.334493] [DEBUG] [LOCAL ] CIA: No primary data file found to delete. [2025-09-18T18:04:46.334550] [INFO ] [LOCAL ] CIA: Starting deletion of derivative data. [2025-09-18T18:04:46.335035] [DEBUG] [LOCAL ] CIA: Deleted derivative data file. [2025-09-18T18:04:46.335147] [INFO ] [MAIN ] Update Progress: 446/2372 symbols completed. CIA took 37.1s. Estimated remaining: 4h 39m 28s. Rate: 6.9 symbols/min [2025-09-18T18:04:46.504842] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:04:46.505091] [DEBUG] [LOCAL ] CIF: No existing data file found in primary storage. [2025-09-18T18:04:46.505145] [WARN ] [MAIN ] CIF: No existing data found, performing full refresh instead. [2025-09-18T18:04:46.505294] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-18T18:04:46.505338] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-18T18:04:46.505381] [DEBUG] [LOCAL ] CIF: No primary data file found to delete. [2025-09-18T18:04:46.505415] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-18T18:04:46.904359] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:04:46.919495] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-11. [2025-09-18T18:04:47.142178] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-18T18:04:47.445175] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-18T18:04:47.719539] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-09-18T18:04:48.519542] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-18T18:04:49.319605] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-18T18:04:49.531261] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-18T18:04:49.984858] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-18T18:04:50.119540] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-18T18:04:50.877704] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-18T18:04:50.919501] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-18T18:04:51.075235] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-18T18:04:51.271984] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-18T18:04:51.719495] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-18T18:04:52.519593] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-18T18:04:52.775520] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-18T18:04:52.780449] [INFO ] [REMOTE ] CIB: Full fetch complete (44123 records). [2025-09-18T18:04:52.780593] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-18T18:04:53.175905] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-18T18:04:53.175998] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-18T18:04:53.176536] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-18T18:04:53.176578] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-18T18:04:53.177631] [DEBUG] [LOCAL ] CIB: Trimmed 44123 records to 31402 (keeping 200 days of data) [2025-09-18T18:04:53.329185] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-18T18:04:53.370294] [DEBUG] [LOCAL ] CIB: Primary data saved (31402 records). [2025-09-18T18:04:53.370457] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-18T18:04:53.370672] [INFO ] [MAIN ] Update Progress: 447/2372 symbols completed. CIB took 32.8s. Estimated remaining: 4h 39m 12s. Rate: 6.9 symbols/min [2025-09-18T18:04:53.549557] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:04:53.598131] [DEBUG] [LOCAL ] CIG: Loaded 43706 existing records from primary storage. [2025-09-18T18:04:53.598282] [INFO ] [MAIN ] CIG: Loaded 43706 existing records. [2025-09-18T18:04:53.781604] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:04:53.781903] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-18T18:04:53.781953] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-18T18:04:53.784595] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-18T18:04:53.784698] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-18T18:04:54.034222] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-18T18:04:54.056293] [INFO ] [REMOTE ] CICB: Full fetch complete (2162 records). [2025-09-18T18:04:54.081776] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-18T18:04:54.122401] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-09-18T18:04:54.235725] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:04:54.364234] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-18T18:04:54.364567] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:04:54.364749] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:04:54.364832] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-18T18:04:54.364981] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-18T18:04:54.365187] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-18T18:04:54.365322] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-18T18:04:54.365515] [INFO ] [MAIN ] Update Progress: 448/2372 symbols completed. CICB took 27.4s. Estimated remaining: 4h 38m 30s. Rate: 6.9 symbols/min [2025-09-18T18:04:54.598497] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:04:54.602089] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-18T18:04:54.630860] [DEBUG] [LOCAL ] CII: Loaded 15798 existing records from primary storage. [2025-09-18T18:04:54.630995] [INFO ] [MAIN ] CII: Loaded 15798 existing records. [2025-09-18T18:04:54.817083] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:04:54.817356] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-18T18:04:54.817405] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-18T18:04:54.818039] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-18T18:04:54.818101] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-18T18:04:54.924741] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-11. [2025-09-18T18:04:54.925228] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-18T18:04:55.192728] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:04:55.719553] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-18T18:04:56.417676] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-18T18:04:56.519503] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-09-18T18:04:57.319549] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-18T18:04:57.506506] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-18T18:04:57.735832] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-18T18:04:57.825320] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-18T18:04:58.119563] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-11. [2025-09-18T18:04:58.919524] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-18T18:04:59.043027] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-18T18:04:59.719571] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-18T18:05:00.229943] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-18T18:05:00.287472] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T18:05:00.519544] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-18T18:05:01.319599] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-09-18T18:05:02.119595] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-09-18T18:05:02.248015] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-18T18:05:02.497054] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-18T18:05:02.739576] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-18T18:05:02.919549] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-18T18:05:03.719548] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-18T18:05:04.519551] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-09-18T18:05:04.683610] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-18T18:05:04.959572] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-18T18:05:05.114803] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-18T18:05:05.319526] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-18T18:05:06.119589] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-18T18:05:06.919614] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-18T18:05:07.058585] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-18T18:05:07.065111] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-18T18:05:07.719585] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-18T18:05:08.523184] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-18T18:05:08.527381] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-18T18:05:08.564497] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T18:05:09.319610] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-18T18:05:10.119586] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-18T18:05:10.555879] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-18T18:05:10.563260] [INFO ] [REMOTE ] CIEN: Full fetch complete (75350 records). [2025-09-18T18:05:10.563385] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-18T18:05:10.816775] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-18T18:05:10.930789] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-18T18:05:10.931487] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T18:05:11.017025] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-18T18:05:11.017184] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-18T18:05:11.018099] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-18T18:05:11.018195] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-18T18:05:11.020240] [DEBUG] [LOCAL ] CIEN: Trimmed 75350 records to 52491 (keeping 200 days of data) [2025-09-18T18:05:11.340716] [DEBUG] [LOCAL ] CIEN: Primary data saved (52491 records). [2025-09-18T18:05:11.340868] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-18T18:05:11.341002] [INFO ] [MAIN ] Update Progress: 449/2372 symbols completed. CIEN took 36.6s. Estimated remaining: 4h 38m 57s. Rate: 6.9 symbols/min [2025-09-18T18:05:11.532495] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:05:11.532720] [DEBUG] [LOCAL ] CIM: No existing data file found in primary storage. [2025-09-18T18:05:11.532814] [WARN ] [MAIN ] CIM: No existing data found, performing full refresh instead. [2025-09-18T18:05:11.532967] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-18T18:05:11.533017] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-18T18:05:11.533068] [DEBUG] [LOCAL ] CIM: No primary data file found to delete. [2025-09-18T18:05:11.533124] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-18T18:05:11.730350] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-18T18:05:11.899236] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:05:12.519564] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-11. [2025-09-18T18:05:12.578237] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-18T18:05:12.612696] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-18T18:05:13.319556] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-18T18:05:13.757477] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-18T18:05:14.119564] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-09-18T18:05:14.631296] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-18T18:05:14.919581] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-18T18:05:15.261628] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-18T18:05:15.332981] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-18T18:05:15.719580] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-18T18:05:16.519555] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-18T18:05:17.046544] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-18T18:05:17.195769] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-18T18:05:17.319512] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-18T18:05:18.119602] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-18T18:05:18.741177] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T18:05:18.742931] [INFO ] [REMOTE ] CIF: Full fetch complete (6599 records). [2025-09-18T18:05:18.743053] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-18T18:05:18.924691] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-09-18T18:05:19.164883] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-09-18T18:05:19.165096] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-09-18T18:05:19.165344] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-09-18T18:05:19.165471] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-09-18T18:05:19.166183] [DEBUG] [LOCAL ] CIF: Trimmed 6599 records to 4548 (keeping 200 days of data) [2025-09-18T18:05:19.218410] [DEBUG] [LOCAL ] CIF: Primary data saved (4548 records). [2025-09-18T18:05:19.218544] [INFO ] [MAIN ] CIF: Full history saved. [2025-09-18T18:05:19.218724] [INFO ] [MAIN ] Update Progress: 450/2372 symbols completed. CIF took 32.9s. Estimated remaining: 4h 38m 45s. Rate: 6.9 symbols/min [2025-09-18T18:05:19.231957] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-18T18:05:19.400208] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:05:19.405624] [DEBUG] [LOCAL ] CIMN: Loaded 2658 existing records from primary storage. [2025-09-18T18:05:19.405736] [INFO ] [MAIN ] CIMN: Loaded 2658 existing records. [2025-09-18T18:05:19.610080] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:05:19.610404] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-18T18:05:19.610468] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-18T18:05:19.610769] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-09-18T18:05:19.610830] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-18T18:05:19.724701] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-18T18:05:19.977114] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:05:20.232775] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-18T18:05:20.519544] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-11. [2025-09-18T18:05:21.062980] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-18T18:05:21.112971] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T18:05:21.319538] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-18T18:05:22.119605] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-18T18:05:22.640092] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-18T18:05:22.927534] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-18T18:05:22.931495] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-18T18:05:23.719590] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-18T18:05:24.519541] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-18T18:05:24.585062] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-18T18:05:25.102040] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-18T18:05:25.123188] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-18T18:05:25.135811] [INFO ] [REMOTE ] CIG: Full fetch complete (60772 records). [2025-09-18T18:05:25.136259] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-18T18:05:25.321679] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-18T18:05:25.538561] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-18T18:05:25.538659] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-18T18:05:25.539320] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-18T18:05:25.539365] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-18T18:05:25.540637] [DEBUG] [LOCAL ] CIG: Trimmed 60772 records to 44042 (keeping 200 days of data) [2025-09-18T18:05:25.803187] [DEBUG] [LOCAL ] CIG: Primary data saved (44042 records). [2025-09-18T18:05:25.803451] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-18T18:05:25.805601] [INFO ] [MAIN ] Update Progress: 451/2372 symbols completed. CIG took 32.4s. Estimated remaining: 4h 38m 27s. Rate: 6.9 symbols/min [2025-09-18T18:05:25.989769] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:05:25.990175] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-09-18T18:05:25.990234] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-09-18T18:05:25.990479] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-18T18:05:25.990534] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-18T18:05:25.990579] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-18T18:05:25.990612] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-18T18:05:26.130740] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-18T18:05:26.357839] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:05:26.712335] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T18:05:26.729460] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-18T18:05:26.919554] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-18T18:05:27.719607] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-11. [2025-09-18T18:05:28.280205] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-18T18:05:28.441052] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-18T18:05:28.519519] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-09-18T18:05:29.065929] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-18T18:05:29.319563] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-18T18:05:30.119550] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-09-18T18:05:30.249023] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T18:05:30.470269] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-18T18:05:30.919549] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-09-18T18:05:31.383721] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-18T18:05:31.719567] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-18T18:05:32.179928] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-18T18:05:32.519598] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-09-18T18:05:32.997303] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-18T18:05:33.319592] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-18T18:05:34.119559] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-18T18:05:34.531555] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-18T18:05:34.919594] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-18T18:05:35.078485] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-18T18:05:35.719563] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-18T18:05:36.059356] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-18T18:05:36.102386] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-18T18:05:36.519593] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-18T18:05:37.042144] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-18T18:05:37.319591] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-18T18:05:38.119550] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-18T18:05:38.725456] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-18T18:05:38.748319] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-18T18:05:38.919537] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-18T18:05:39.719544] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-18T18:05:40.081257] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-18T18:05:40.086385] [INFO ] [REMOTE ] CIM: Full fetch complete (54304 records). [2025-09-18T18:05:40.086505] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-18T18:05:40.249920] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-18T18:05:40.481540] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-09-18T18:05:40.481632] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-09-18T18:05:40.482304] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-09-18T18:05:40.482412] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-09-18T18:05:40.485489] [DEBUG] [LOCAL ] CIM: Trimmed 54304 records to 37425 (keeping 200 days of data) [2025-09-18T18:05:40.545838] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-18T18:05:40.721749] [DEBUG] [LOCAL ] CIM: Primary data saved (37425 records). [2025-09-18T18:05:40.721893] [INFO ] [MAIN ] CIM: Full history saved. [2025-09-18T18:05:40.721994] [INFO ] [MAIN ] Update Progress: 452/2372 symbols completed. CIM took 29.4s. Estimated remaining: 4h 38m 45s. Rate: 6.9 symbols/min [2025-09-18T18:05:40.892300] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:05:40.892526] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-09-18T18:05:40.892582] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-09-18T18:05:40.892758] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-09-18T18:05:40.892806] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-18T18:05:40.892849] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-18T18:05:40.892900] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-09-18T18:05:40.999536] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-18T18:05:41.265397] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:05:41.319533] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-11. [2025-09-18T18:05:41.515200] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:05:41.515585] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-11 [2025-09-18T18:05:42.119545] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-09-18T18:05:42.318326] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:05:42.318691] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-09-18T18:05:42.919559] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-18T18:05:43.520126] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-18T18:05:43.719561] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-18T18:05:44.476830] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-18T18:05:44.479783] [INFO ] [REMOTE ] CII: Full fetch complete (23106 records). [2025-09-18T18:05:44.479870] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-18T18:05:44.524694] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-18T18:05:44.861504] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-18T18:05:44.861586] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-18T18:05:44.862013] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-18T18:05:44.862078] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-18T18:05:44.862780] [DEBUG] [LOCAL ] CII: Trimmed 23106 records to 15979 (keeping 200 days of data) [2025-09-18T18:05:44.974252] [DEBUG] [LOCAL ] CII: Primary data saved (15979 records). [2025-09-18T18:05:44.974411] [INFO ] [MAIN ] CII: Full history saved. [2025-09-18T18:05:44.974514] [INFO ] [MAIN ] Update Progress: 453/2372 symbols completed. CII took 50.6s. Estimated remaining: 4h 38m 17s. Rate: 6.9 symbols/min [2025-09-18T18:05:45.083688] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-18T18:05:45.155584] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:05:45.179434] [DEBUG] [LOCAL ] CINT: Loaded 18038 existing records from primary storage. [2025-09-18T18:05:45.179579] [INFO ] [MAIN ] CINT: Loaded 18038 existing records. [2025-09-18T18:05:45.326006] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-18T18:05:45.370401] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:05:45.370703] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-18T18:05:45.370762] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-18T18:05:45.371383] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-18T18:05:45.371464] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-18T18:05:45.732331] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:05:45.854938] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-18T18:05:46.119549] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-18T18:05:46.480851] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-18T18:05:46.919566] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-11. [2025-09-18T18:05:47.719559] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-09-18T18:05:47.941710] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:05:47.943140] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-09-18T18:05:47.944983] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-18T18:05:48.519563] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-18T18:05:48.952081] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-18T18:05:49.319546] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-18T18:05:49.778917] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-18T18:05:50.119541] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-09-18T18:05:50.723416] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-18T18:05:50.919572] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-18T18:05:51.430893] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-18T18:05:51.719595] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-09-18T18:05:52.511339] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-18T18:05:52.519496] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-18T18:05:53.319571] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-18T18:05:53.561716] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-18T18:05:53.773379] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-18T18:05:54.119583] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-18T18:05:54.698073] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-18T18:05:54.698943] [INFO ] [REMOTE ] CIMN: Full fetch complete (3899 records). [2025-09-18T18:05:54.699015] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-18T18:05:54.924757] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-18T18:05:55.064090] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-09-18T18:05:55.064168] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-09-18T18:05:55.064307] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-09-18T18:05:55.064391] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-09-18T18:05:55.064806] [DEBUG] [LOCAL ] CIMN: Trimmed 3899 records to 2676 (keeping 200 days of data) [2025-09-18T18:05:55.081462] [DEBUG] [LOCAL ] CIMN: Primary data saved (2676 records). [2025-09-18T18:05:55.081542] [INFO ] [MAIN ] CIMN: Full history saved. [2025-09-18T18:05:55.081615] [INFO ] [MAIN ] Update Progress: 454/2372 symbols completed. CIMN took 35.9s. Estimated remaining: 4h 38m 14s. Rate: 6.9 symbols/min [2025-09-18T18:05:55.258579] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:05:55.279528] [DEBUG] [LOCAL ] CIO: Loaded 19929 existing records from primary storage. [2025-09-18T18:05:55.279690] [INFO ] [MAIN ] CIO: Loaded 19929 existing records. [2025-09-18T18:05:55.458059] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:05:55.458361] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-18T18:05:55.458428] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-18T18:05:55.459048] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-09-18T18:05:55.459109] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-18T18:05:55.726784] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-18T18:05:55.817352] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:05:56.027855] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-18T18:05:56.029166] [INFO ] [REMOTE ] CIMO: Full fetch complete (5432 records). [2025-09-18T18:05:56.029263] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-18T18:05:56.216297] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-18T18:05:56.216550] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:05:56.216633] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:05:56.216722] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-18T18:05:56.216785] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-18T18:05:56.216835] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-09-18T18:05:56.216919] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-09-18T18:05:56.217004] [INFO ] [MAIN ] Update Progress: 455/2372 symbols completed. CIMO took 30.4s. Estimated remaining: 4h 37m 34s. Rate: 6.9 symbols/min [2025-09-18T18:05:56.398350] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:05:56.433372] [DEBUG] [LOCAL ] CION: Loaded 29296 existing records from primary storage. [2025-09-18T18:05:56.433518] [INFO ] [MAIN ] CION: Loaded 29296 existing records. [2025-09-18T18:05:56.524662] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-02. [2025-09-18T18:05:56.617088] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-18T18:05:56.648568] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:05:56.649709] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-18T18:05:56.649770] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-18T18:05:56.650606] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-09-18T18:05:56.650692] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-18T18:05:56.789627] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:05:56.792492] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-02 [2025-09-18T18:05:57.047159] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:05:57.319552] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-03. [2025-09-18T18:05:57.532965] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:05:57.533321] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-03 [2025-09-18T18:05:58.119555] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-11. [2025-09-18T18:05:58.919559] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-04. [2025-09-18T18:05:59.138545] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:05:59.138986] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-04 [2025-09-18T18:05:59.345974] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-18T18:05:59.719551] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-11. [2025-09-18T18:06:00.519573] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-05. [2025-09-18T18:06:01.022776] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:06:01.023292] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-05 [2025-09-18T18:06:01.047104] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-18T18:06:01.319587] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-09-18T18:06:02.119578] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-06. [2025-09-18T18:06:02.338617] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:06:02.339054] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-06 [2025-09-18T18:06:02.408596] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-18T18:06:02.919554] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-09-18T18:06:03.719587] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-07. [2025-09-18T18:06:03.763577] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T18:06:04.006837] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:06:04.007299] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-07 [2025-09-18T18:06:04.519632] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-18T18:06:05.288325] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-18T18:06:05.319498] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-18T18:06:06.119526] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-18T18:06:06.260727] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-18T18:06:06.896482] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-18T18:06:06.919498] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-18T18:06:07.719525] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-18T18:06:08.012238] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-18T18:06:08.519692] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-09-18T18:06:08.547922] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-18T18:06:09.319553] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-18T18:06:09.987924] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-18T18:06:10.086914] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-18T18:06:10.119555] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-09-18T18:06:10.919577] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-18T18:06:11.218505] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-18T18:06:11.653911] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-18T18:06:11.719558] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-18T18:06:12.519559] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-18T18:06:12.747873] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-18T18:06:13.319513] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-18T18:06:13.390781] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-18T18:06:14.119561] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-08. [2025-09-18T18:06:14.225868] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-18T18:06:14.343191] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:06:14.343517] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-08 [2025-09-18T18:06:14.919555] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-18T18:06:15.719576] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-09. [2025-09-18T18:06:15.963082] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:06:15.963447] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-09 [2025-09-18T18:06:15.963549] [INFO ] [REMOTE ] CIMP: Full fetch complete (0 records). [2025-09-18T18:06:15.963593] [DEBUG] [VALIDATOR ] CIMP: Validating primary data. [2025-09-18T18:06:15.963635] [WARN ] [VALIDATOR ] CIMP: No data provided for validation! [2025-09-18T18:06:15.963723] [FATAL] [MAIN ] CIMP: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:06:15.963817] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:06:15.963911] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-18T18:06:15.964009] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-18T18:06:15.964067] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-09-18T18:06:15.964192] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-09-18T18:06:15.964284] [INFO ] [MAIN ] Update Progress: 456/2372 symbols completed. CIMP took 35.2s. Estimated remaining: 4h 38m 12s. Rate: 6.9 symbols/min [2025-09-18T18:06:16.140158] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:06:16.197143] [DEBUG] [LOCAL ] CIVI: Loaded 52586 existing records from primary storage. [2025-09-18T18:06:16.197356] [INFO ] [MAIN ] CIVI: Loaded 52586 existing records. [2025-09-18T18:06:16.389709] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:06:16.389975] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-18T18:06:16.390025] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-18T18:06:16.391879] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-09-18T18:06:16.391951] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-18T18:06:16.522724] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-18T18:06:16.706980] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-18T18:06:16.754318] [INFO ] [REMOTE ] CINT: Full fetch complete (25717 records). [2025-09-18T18:06:16.780014] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-18T18:06:16.932639] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:06:17.325008] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-18T18:06:17.435305] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-09-18T18:06:17.435434] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-09-18T18:06:17.436212] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-09-18T18:06:17.436292] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-09-18T18:06:17.438154] [DEBUG] [LOCAL ] CINT: Trimmed 25717 records to 18294 (keeping 200 days of data) [2025-09-18T18:06:17.587865] [DEBUG] [LOCAL ] CINT: Primary data saved (18294 records). [2025-09-18T18:06:17.588116] [INFO ] [MAIN ] CINT: Full history saved. [2025-09-18T18:06:17.588246] [INFO ] [MAIN ] Update Progress: 457/2372 symbols completed. CINT took 32.6s. Estimated remaining: 4h 37m 33s. Rate: 6.9 symbols/min [2025-09-18T18:06:17.816097] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:06:17.842271] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T18:06:17.910768] [DEBUG] [LOCAL ] CL: Loaded 53644 existing records from primary storage. [2025-09-18T18:06:17.910957] [INFO ] [MAIN ] CL: Loaded 53644 existing records. [2025-09-18T18:06:18.134063] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-18T18:06:18.142590] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:06:18.142902] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-18T18:06:18.142960] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-18T18:06:18.144696] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-09-18T18:06:18.144766] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-18T18:06:18.525843] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-18T18:06:18.569729] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:06:18.919551] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-18T18:06:19.372988] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-18T18:06:19.719566] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-11. [2025-09-18T18:06:19.823179] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-18T18:06:20.519615] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-18T18:06:21.319581] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-18T18:06:21.415733] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-18T18:06:21.508587] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-18T18:06:22.119565] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-09-18T18:06:22.266981] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-18T18:06:22.919551] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-18T18:06:23.719547] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-11. [2025-09-18T18:06:23.915103] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-18T18:06:23.951774] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-18T18:06:23.955084] [INFO ] [REMOTE ] CIO: Full fetch complete (28802 records). [2025-09-18T18:06:23.955165] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-18T18:06:23.955713] [FATAL] [VALIDATOR ] CIO: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:06:23.955799] [FATAL] [MAIN ] CIO: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:06:23.955863] [WARN ] [MAIN ] CIO: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:06:23.955934] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-18T18:06:23.955999] [DEBUG] [LOCAL ] CIO: No primary data file found to delete. [2025-09-18T18:06:23.956036] [INFO ] [LOCAL ] CIO: Starting deletion of derivative data. [2025-09-18T18:06:23.956414] [DEBUG] [LOCAL ] CIO: Deleted derivative data file. [2025-09-18T18:06:23.956505] [INFO ] [MAIN ] Update Progress: 458/2372 symbols completed. CIO took 28.9s. Estimated remaining: 4h 37m 15s. Rate: 6.9 symbols/min [2025-09-18T18:06:24.131367] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:06:24.178859] [DEBUG] [LOCAL ] CLB: Loaded 33294 existing records from primary storage. [2025-09-18T18:06:24.179010] [INFO ] [MAIN ] CLB: Loaded 33294 existing records. [2025-09-18T18:06:24.363736] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:06:24.364010] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-18T18:06:24.364061] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-18T18:06:24.365309] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-09-18T18:06:24.365373] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-18T18:06:24.547152] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-18T18:06:24.750677] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:06:25.324718] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-11. [2025-09-18T18:06:25.344938] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-18T18:06:25.439971] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T18:06:26.119552] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-18T18:06:26.352252] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-18T18:06:26.919514] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-09-18T18:06:27.042439] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-18T18:06:27.719554] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-18T18:06:28.508246] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-18T18:06:28.519542] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-18T18:06:28.863873] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T18:06:29.319563] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-18T18:06:30.007187] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T18:06:30.119543] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-18T18:06:30.654230] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T18:06:30.658520] [INFO ] [REMOTE ] CION: Full fetch complete (41249 records). [2025-09-18T18:06:30.658715] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-18T18:06:30.929436] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-09-18T18:06:31.048220] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-09-18T18:06:31.048303] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-09-18T18:06:31.048835] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-09-18T18:06:31.048898] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-09-18T18:06:31.049799] [DEBUG] [LOCAL ] CION: Trimmed 41249 records to 29561 (keeping 200 days of data) [2025-09-18T18:06:31.225482] [DEBUG] [LOCAL ] CION: Primary data saved (29561 records). [2025-09-18T18:06:31.225622] [INFO ] [MAIN ] CION: Full history saved. [2025-09-18T18:06:31.225742] [INFO ] [MAIN ] Update Progress: 459/2372 symbols completed. CION took 35.0s. Estimated remaining: 4h 37m 0s. Rate: 6.9 symbols/min [2025-09-18T18:06:31.396702] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:06:31.411402] [DEBUG] [LOCAL ] CLCO: Loaded 13549 existing records from primary storage. [2025-09-18T18:06:31.411578] [INFO ] [MAIN ] CLCO: Loaded 13549 existing records. [2025-09-18T18:06:31.604457] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:06:31.604764] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-18T18:06:31.604826] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-18T18:06:31.605264] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-09-18T18:06:31.605324] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-18T18:06:31.724762] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-09-18T18:06:31.980017] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:06:32.268083] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-18T18:06:32.519520] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-11. [2025-09-18T18:06:32.598324] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-18T18:06:32.839467] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T18:06:33.319543] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-09-18T18:06:33.548469] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-18T18:06:34.119553] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-18T18:06:34.704219] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T18:06:34.919542] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-18T18:06:35.645535] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-18T18:06:35.719507] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-18T18:06:36.519611] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-09-18T18:06:36.566337] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-18T18:06:37.034085] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-18T18:06:37.319550] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-09-18T18:06:37.421266] [DEBUG] [REMOTE ] CLCO: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-18T18:06:37.421601] [WARN ] [REMOTE ] CLCO: No data returned for month 2024-12 [2025-09-18T18:06:37.596768] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-18T18:06:38.119546] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-09-18T18:06:38.919566] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-18T18:06:39.213958] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-18T18:06:39.719546] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-18T18:06:40.519551] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-18T18:06:41.319564] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-18T18:06:41.783905] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (2.86 seconds). [2025-09-18T18:06:41.909081] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-18T18:06:42.119542] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-18T18:06:42.803406] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-18T18:06:42.919556] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-18T18:06:43.295256] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-18T18:06:43.420288] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-18T18:06:43.719564] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-18T18:06:44.435722] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T18:06:44.519546] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-18T18:06:44.790274] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-18T18:06:45.319561] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-18T18:06:45.451602] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-18T18:06:46.119544] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-18T18:06:46.500971] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-18T18:06:46.919564] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-18T18:06:47.526673] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-18T18:06:47.719541] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-18T18:06:48.096757] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-18T18:06:48.519575] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-18T18:06:49.112444] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-18T18:06:49.267932] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-18T18:06:49.319531] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-18T18:06:50.119628] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-18T18:06:50.745819] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-18T18:06:50.929240] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-18T18:06:50.951061] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-18T18:06:51.719562] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-18T18:06:52.064055] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-18T18:06:52.519601] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-18T18:06:53.319537] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-18T18:06:53.855120] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-18T18:06:54.122665] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-18T18:06:54.128326] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-18T18:06:54.406635] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-18T18:06:54.919587] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-18T18:06:55.719708] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-18T18:06:56.037852] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-18T18:06:56.045246] [INFO ] [REMOTE ] CL: Full fetch complete (77454 records). [2025-09-18T18:06:56.045378] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-18T18:06:56.449530] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-09-18T18:06:56.449846] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-09-18T18:06:56.450726] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-09-18T18:06:56.450840] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-09-18T18:06:56.453171] [DEBUG] [LOCAL ] CL: Trimmed 77454 records to 54034 (keeping 200 days of data) [2025-09-18T18:06:56.522040] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-18T18:06:56.601567] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-18T18:06:56.737836] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-18T18:06:56.740759] [INFO ] [REMOTE ] CLCO: Full fetch complete (19577 records). [2025-09-18T18:06:56.741366] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-18T18:06:56.941713] [WARN ] [VALIDATOR ] CLCO: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-18T18:06:56.942963] [FATAL] [MAIN ] CLCO: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:06:56.943547] [WARN ] [MAIN ] CLCO: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:06:56.944167] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-18T18:06:56.945020] [DEBUG] [LOCAL ] CLCO: No primary data file found to delete. [2025-09-18T18:06:56.945316] [INFO ] [LOCAL ] CLCO: Starting deletion of derivative data. [2025-09-18T18:06:56.946434] [DEBUG] [LOCAL ] CLCO: Deleted derivative data file. [2025-09-18T18:06:56.946777] [INFO ] [MAIN ] Update Progress: 460/2372 symbols completed. CLCO took 25.7s. Estimated remaining: 4h 38m 2s. Rate: 6.9 symbols/min [2025-09-18T18:06:57.174946] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:06:57.228534] [DEBUG] [LOCAL ] CLDT: Loaded 26202 existing records from primary storage. [2025-09-18T18:06:57.229309] [INFO ] [MAIN ] CLDT: Loaded 26202 existing records. [2025-09-18T18:06:57.323109] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-18T18:06:57.402147] [DEBUG] [LOCAL ] CL: Primary data saved (54034 records). [2025-09-18T18:06:57.416294] [INFO ] [MAIN ] CL: Full history saved. [2025-09-18T18:06:57.417562] [INFO ] [MAIN ] Update Progress: 461/2372 symbols completed. CL took 39.8s. Estimated remaining: 4h 37m 19s. Rate: 6.9 symbols/min [2025-09-18T18:06:57.510843] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:06:57.543742] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-18T18:06:57.554708] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-18T18:06:57.560620] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-09-18T18:06:57.565858] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-18T18:06:57.719471] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:06:58.048862] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T18:06:58.052991] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:06:58.080496] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-09-18T18:06:58.080697] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-09-18T18:06:58.124671] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-11. [2025-09-18T18:06:58.261422] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:06:58.261711] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-18T18:06:58.261767] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-18T18:06:58.263092] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-09-18T18:06:58.263151] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-18T18:06:58.609900] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:06:58.919558] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-11. [2025-09-18T18:06:59.076354] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-18T18:06:59.226117] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-18T18:06:59.719625] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-18T18:07:00.519563] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-18T18:07:00.862778] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T18:07:01.029542] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-11 (2.11 seconds). [2025-09-18T18:07:01.319587] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-09-18T18:07:02.119573] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-09-18T18:07:02.269702] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-18T18:07:02.277737] [INFO ] [REMOTE ] CIVI: Full fetch complete (75214 records). [2025-09-18T18:07:02.277938] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-18T18:07:02.694931] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-09-18T18:07:02.695032] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-09-18T18:07:02.695902] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-09-18T18:07:02.695974] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-09-18T18:07:02.697719] [DEBUG] [LOCAL ] CIVI: Trimmed 75214 records to 52973 (keeping 200 days of data) [2025-09-18T18:07:02.922306] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-18T18:07:03.039098] [DEBUG] [LOCAL ] CIVI: Primary data saved (52973 records). [2025-09-18T18:07:03.039288] [INFO ] [MAIN ] CIVI: Full history saved. [2025-09-18T18:07:03.039406] [INFO ] [MAIN ] Update Progress: 462/2372 symbols completed. CIVI took 47.1s. Estimated remaining: 4h 36m 58s. Rate: 6.9 symbols/min [2025-09-18T18:07:03.256608] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:07:03.259956] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-18T18:07:03.301847] [DEBUG] [LOCAL ] CLH: Loaded 28629 existing records from primary storage. [2025-09-18T18:07:03.302001] [INFO ] [MAIN ] CLH: Loaded 28629 existing records. [2025-09-18T18:07:03.508097] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:07:03.509364] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T18:07:03.509731] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-18T18:07:03.515483] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-18T18:07:03.516406] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-09-18T18:07:03.516471] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-18T18:07:03.724780] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-09-18T18:07:03.886536] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:07:04.519610] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-11. [2025-09-18T18:07:04.573737] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-18T18:07:04.580947] [INFO ] [REMOTE ] CLB: Full fetch complete (46029 records). [2025-09-18T18:07:04.581229] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-18T18:07:04.885804] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-18T18:07:05.018208] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-09-18T18:07:05.018328] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-09-18T18:07:05.019151] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-09-18T18:07:05.019226] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-09-18T18:07:05.020843] [DEBUG] [LOCAL ] CLB: Trimmed 46029 records to 33545 (keeping 200 days of data) [2025-09-18T18:07:05.230113] [DEBUG] [LOCAL ] CLB: Primary data saved (33545 records). [2025-09-18T18:07:05.230264] [INFO ] [MAIN ] CLB: Full history saved. [2025-09-18T18:07:05.230377] [INFO ] [MAIN ] Update Progress: 463/2372 symbols completed. CLB took 41.3s. Estimated remaining: 4h 36m 22s. Rate: 6.9 symbols/min [2025-09-18T18:07:05.327592] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-18T18:07:05.406799] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:07:05.422498] [DEBUG] [LOCAL ] CLPR: Loaded 11669 existing records from primary storage. [2025-09-18T18:07:05.422672] [INFO ] [MAIN ] CLPR: Loaded 11669 existing records. [2025-09-18T18:07:05.600837] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:07:05.601331] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-18T18:07:05.601465] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-18T18:07:05.602069] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-09-18T18:07:05.602226] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-18T18:07:05.741424] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-18T18:07:05.988736] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:07:06.125478] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-09-18T18:07:06.130023] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-18T18:07:06.919571] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-11. [2025-09-18T18:07:07.172293] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T18:07:07.719609] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-18T18:07:07.845111] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-18T18:07:08.519598] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-09-18T18:07:08.839931] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-18T18:07:09.243108] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-18T18:07:09.319716] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-09-18T18:07:10.119607] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-18T18:07:10.638781] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-18T18:07:10.919563] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-18T18:07:11.404755] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-18T18:07:11.719611] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-18T18:07:12.521145] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-09-18T18:07:12.523344] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-18T18:07:12.599033] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-18T18:07:13.133829] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-18T18:07:13.319522] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-18T18:07:14.063170] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-18T18:07:14.119554] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-18T18:07:14.919582] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-18T18:07:15.096588] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-18T18:07:15.487047] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-18T18:07:15.719566] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-18T18:07:16.519545] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-09-18T18:07:16.761462] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-18T18:07:17.319598] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-18T18:07:18.063388] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-18T18:07:18.099722] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T18:07:18.119498] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-18T18:07:18.815733] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-18T18:07:18.919570] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-18T18:07:19.502249] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-18T18:07:19.719577] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-18T18:07:20.519571] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-18T18:07:21.319609] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-18T18:07:21.698479] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-18T18:07:21.942142] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-18T18:07:22.119564] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-18T18:07:22.396564] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-18T18:07:22.919573] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-18T18:07:23.719563] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-18T18:07:24.519580] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-18T18:07:24.564611] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-18T18:07:24.600152] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-18T18:07:24.603856] [INFO ] [REMOTE ] CLDT: Full fetch complete (37059 records). [2025-09-18T18:07:24.603987] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-18T18:07:25.023164] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-09-18T18:07:25.024081] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-09-18T18:07:25.025236] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-18T18:07:25.026008] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-09-18T18:07:25.034068] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-09-18T18:07:25.035834] [DEBUG] [LOCAL ] CLDT: Trimmed 37059 records to 26416 (keeping 200 days of data) [2025-09-18T18:07:25.187144] [DEBUG] [LOCAL ] CLDT: Primary data saved (26416 records). [2025-09-18T18:07:25.187318] [INFO ] [MAIN ] CLDT: Full history saved. [2025-09-18T18:07:25.187430] [INFO ] [MAIN ] Update Progress: 464/2372 symbols completed. CLDT took 28.2s. Estimated remaining: 4h 37m 0s. Rate: 6.9 symbols/min [2025-09-18T18:07:25.337696] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-18T18:07:25.345719] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-18T18:07:25.377386] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:07:25.434538] [DEBUG] [LOCAL ] CLS: Loaded 53646 existing records from primary storage. [2025-09-18T18:07:25.434737] [INFO ] [MAIN ] CLS: Loaded 53646 existing records. [2025-09-18T18:07:25.659282] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:07:25.659617] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-18T18:07:25.659701] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-18T18:07:25.661088] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-09-18T18:07:25.661151] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-18T18:07:26.018042] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:07:26.119558] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-11. [2025-09-18T18:07:26.530958] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-18T18:07:26.919566] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-18T18:07:27.719544] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-18T18:07:28.246279] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-11 (2.13 seconds). [2025-09-18T18:07:28.516193] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-18T18:07:28.526614] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-18T18:07:28.554504] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-18T18:07:29.250233] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-18T18:07:29.319573] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-18T18:07:30.119554] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-18T18:07:30.919598] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-18T18:07:31.198226] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-18T18:07:31.555911] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-18T18:07:31.556137] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-18T18:07:31.569347] [INFO ] [REMOTE ] CLPR: Full fetch complete (17843 records). [2025-09-18T18:07:31.569915] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-18T18:07:31.570974] [FATAL] [VALIDATOR ] CLPR: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:07:31.571067] [FATAL] [MAIN ] CLPR: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:07:31.571141] [WARN ] [MAIN ] CLPR: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:07:31.571235] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-18T18:07:31.571347] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-09-18T18:07:31.571421] [INFO ] [LOCAL ] CLPR: Starting deletion of derivative data. [2025-09-18T18:07:31.572031] [DEBUG] [LOCAL ] CLPR: Deleted derivative data file. [2025-09-18T18:07:31.572135] [INFO ] [MAIN ] Update Progress: 465/2372 symbols completed. CLPR took 26.3s. Estimated remaining: 4h 36m 42s. Rate: 6.9 symbols/min [2025-09-18T18:07:31.726378] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-18T18:07:31.761006] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:07:31.812221] [DEBUG] [LOCAL ] CLVT: Loaded 52026 existing records from primary storage. [2025-09-18T18:07:31.812393] [INFO ] [MAIN ] CLVT: Loaded 52026 existing records. [2025-09-18T18:07:31.994726] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:07:31.995031] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-18T18:07:31.995115] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-18T18:07:31.997792] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-09-18T18:07:31.997857] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-18T18:07:32.369687] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:07:32.519542] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-11. [2025-09-18T18:07:33.319567] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-09-18T18:07:33.946260] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-18T18:07:34.029845] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-18T18:07:34.119504] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-09-18T18:07:34.877745] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-18T18:07:34.919494] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-09-18T18:07:35.455854] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T18:07:35.719580] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-09-18T18:07:36.519551] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-18T18:07:37.093954] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-18T18:07:37.132889] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-18T18:07:37.319539] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-18T18:07:37.352147] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-18T18:07:38.119581] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-18T18:07:38.919545] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-18T18:07:38.969212] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-18T18:07:39.130095] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T18:07:39.134319] [INFO ] [REMOTE ] CLH: Full fetch complete (41709 records). [2025-09-18T18:07:39.134489] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-18T18:07:39.535181] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-09-18T18:07:39.535271] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-09-18T18:07:39.535902] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-09-18T18:07:39.535987] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-09-18T18:07:39.536999] [DEBUG] [LOCAL ] CLH: Trimmed 41709 records to 28807 (keeping 200 days of data) [2025-09-18T18:07:39.715226] [DEBUG] [LOCAL ] CLH: Primary data saved (28807 records). [2025-09-18T18:07:39.715409] [INFO ] [MAIN ] CLH: Full history saved. [2025-09-18T18:07:39.715529] [INFO ] [MAIN ] Update Progress: 466/2372 symbols completed. CLH took 36.7s. Estimated remaining: 4h 36m 31s. Rate: 6.9 symbols/min [2025-09-18T18:07:39.727562] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-18T18:07:39.897809] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:07:39.920288] [DEBUG] [LOCAL ] CLW: Loaded 22071 existing records from primary storage. [2025-09-18T18:07:39.920413] [INFO ] [MAIN ] CLW: Loaded 22071 existing records. [2025-09-18T18:07:40.102004] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:07:40.102263] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-18T18:07:40.102312] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-18T18:07:40.102874] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-09-18T18:07:40.102936] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-18T18:07:40.463908] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:07:40.519493] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-11. [2025-09-18T18:07:40.834959] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-18T18:07:41.325230] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-18T18:07:41.345679] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-18T18:07:41.916417] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-18T18:07:42.119557] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-18T18:07:42.919535] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-18T18:07:43.086274] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-18T18:07:43.542578] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T18:07:43.719533] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-18T18:07:44.519554] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-09-18T18:07:45.319520] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-18T18:07:45.398795] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-18T18:07:45.449729] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-18T18:07:45.541393] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-18T18:07:46.119532] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-09-18T18:07:46.919511] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-18T18:07:47.081804] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-18T18:07:47.089735] [INFO ] [REMOTE ] CLF: Full fetch complete (77692 records). [2025-09-18T18:07:47.089959] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-18T18:07:47.226800] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-18T18:07:47.518085] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-09-18T18:07:47.518212] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-09-18T18:07:47.519335] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-09-18T18:07:47.519421] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-09-18T18:07:47.525946] [DEBUG] [LOCAL ] CLF: Trimmed 77692 records to 54131 (keeping 200 days of data) [2025-09-18T18:07:47.731996] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-18T18:07:47.852636] [DEBUG] [LOCAL ] CLF: Primary data saved (54131 records). [2025-09-18T18:07:47.852814] [INFO ] [MAIN ] CLF: Full history saved. [2025-09-18T18:07:47.852996] [INFO ] [MAIN ] Update Progress: 467/2372 symbols completed. CLF took 50.4s. Estimated remaining: 4h 36m 20s. Rate: 6.9 symbols/min [2025-09-18T18:07:48.027381] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:07:48.083501] [DEBUG] [LOCAL ] CLX: Loaded 51407 existing records from primary storage. [2025-09-18T18:07:48.083754] [INFO ] [MAIN ] CLX: Loaded 51407 existing records. [2025-09-18T18:07:48.261787] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:07:48.262044] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-18T18:07:48.262092] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-18T18:07:48.263231] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-09-18T18:07:48.263309] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-18T18:07:48.524685] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-18T18:07:48.627880] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:07:49.172396] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T18:07:49.309875] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-18T18:07:49.320501] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-11. [2025-09-18T18:07:49.435429] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-18T18:07:50.119583] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-18T18:07:50.830739] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-18T18:07:50.919504] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-09-18T18:07:51.719607] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-18T18:07:52.480512] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-18T18:07:52.520058] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-18T18:07:52.525421] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-18T18:07:53.155840] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-18T18:07:53.319563] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-18T18:07:54.119591] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-09-18T18:07:54.795130] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-18T18:07:54.912103] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T18:07:54.922783] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-18T18:07:55.438468] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-18T18:07:55.719541] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-18T18:07:56.519596] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-18T18:07:56.844692] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-18T18:07:57.285478] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-18T18:07:57.293042] [INFO ] [REMOTE ] CLVT: Full fetch complete (75084 records). [2025-09-18T18:07:57.293226] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-18T18:07:57.327207] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-18T18:07:57.611691] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-18T18:07:57.752900] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-09-18T18:07:57.752992] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-09-18T18:07:57.753926] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-09-18T18:07:57.754000] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-09-18T18:07:57.756482] [DEBUG] [LOCAL ] CLVT: Trimmed 75084 records to 52395 (keeping 200 days of data) [2025-09-18T18:07:58.062544] [DEBUG] [LOCAL ] CLVT: Primary data saved (52395 records). [2025-09-18T18:07:58.062762] [INFO ] [MAIN ] CLVT: Full history saved. [2025-09-18T18:07:58.062893] [INFO ] [MAIN ] Update Progress: 468/2372 symbols completed. CLVT took 26.5s. Estimated remaining: 4h 36m 17s. Rate: 6.9 symbols/min [2025-09-18T18:07:58.126157] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-18T18:07:58.255386] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:07:58.303531] [DEBUG] [LOCAL ] CM: Loaded 48663 existing records from primary storage. [2025-09-18T18:07:58.303722] [INFO ] [MAIN ] CM: Loaded 48663 existing records. [2025-09-18T18:07:58.487826] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:07:58.488095] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-18T18:07:58.488155] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-18T18:07:58.489529] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-09-18T18:07:58.489591] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-18T18:07:58.848830] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:07:58.923516] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-11. [2025-09-18T18:07:58.928609] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-18T18:07:59.153638] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-18T18:07:59.719584] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-18T18:08:00.292867] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-18T18:08:00.463136] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-18T18:08:00.519505] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-18T18:08:01.319576] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-18T18:08:01.535493] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-18T18:08:02.119620] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-18T18:08:02.919629] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-09-18T18:08:02.994014] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-18T18:08:03.628115] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-18T18:08:03.719527] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-18T18:08:04.348055] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-18T18:08:04.512901] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T18:08:04.519487] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-18T18:08:05.319535] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-18T18:08:05.572916] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-18T18:08:05.576864] [INFO ] [REMOTE ] CLW: Full fetch complete (35127 records). [2025-09-18T18:08:05.577008] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-18T18:08:05.967044] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-09-18T18:08:05.967213] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-09-18T18:08:05.967707] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-09-18T18:08:05.967769] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-09-18T18:08:05.969873] [DEBUG] [LOCAL ] CLW: Trimmed 35127 records to 22217 (keeping 200 days of data) [2025-09-18T18:08:06.107011] [DEBUG] [LOCAL ] CLW: Primary data saved (22217 records). [2025-09-18T18:08:06.107155] [INFO ] [MAIN ] CLW: Full history saved. [2025-09-18T18:08:06.107301] [INFO ] [MAIN ] Update Progress: 469/2372 symbols completed. CLW took 26.4s. Estimated remaining: 4h 36m 6s. Rate: 6.9 symbols/min [2025-09-18T18:08:06.128129] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-18T18:08:06.281244] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:08:06.336731] [DEBUG] [LOCAL ] CMA: Loaded 50303 existing records from primary storage. [2025-09-18T18:08:06.336884] [INFO ] [MAIN ] CMA: Loaded 50303 existing records. [2025-09-18T18:08:06.514718] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:08:06.515034] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-18T18:08:06.515084] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-18T18:08:06.516809] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-18T18:08:06.516873] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-18T18:08:06.880801] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:08:06.919495] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-11. [2025-09-18T18:08:07.019605] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-18T18:08:07.719575] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-09-18T18:08:08.440174] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-18T18:08:08.517540] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-18T18:08:08.527556] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-18T18:08:09.038806] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-18T18:08:09.319564] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-09-18T18:08:10.119568] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-18T18:08:10.683515] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T18:08:10.925559] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-18T18:08:10.940936] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-18T18:08:10.950505] [INFO ] [REMOTE ] CLS: Full fetch complete (76930 records). [2025-09-18T18:08:10.950637] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-18T18:08:10.951684] [FATAL] [VALIDATOR ] CLS: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:08:10.951794] [FATAL] [MAIN ] CLS: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:08:10.951852] [WARN ] [MAIN ] CLS: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:08:10.951919] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-18T18:08:10.951985] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-09-18T18:08:10.952037] [INFO ] [LOCAL ] CLS: Starting deletion of derivative data. [2025-09-18T18:08:10.952478] [DEBUG] [LOCAL ] CLS: Deleted derivative data file. [2025-09-18T18:08:10.952636] [INFO ] [MAIN ] Update Progress: 470/2372 symbols completed. CLS took 45.8s. Estimated remaining: 4h 35m 41s. Rate: 6.9 symbols/min [2025-09-18T18:08:11.124028] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:08:11.148163] [DEBUG] [LOCAL ] CMBT: Loaded 21060 existing records from primary storage. [2025-09-18T18:08:11.148351] [INFO ] [MAIN ] CMBT: Loaded 21060 existing records. [2025-09-18T18:08:11.336961] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:08:11.337742] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-18T18:08:11.337925] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-18T18:08:11.338746] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-09-18T18:08:11.338806] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-18T18:08:11.704601] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:08:11.719531] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-09-18T18:08:11.757954] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-18T18:08:12.519623] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-18T18:08:12.862088] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-18T18:08:13.102361] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T18:08:13.319555] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-18T18:08:13.913441] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-18T18:08:14.119570] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-18T18:08:14.903503] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T18:08:14.919498] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-18T18:08:15.478474] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-18T18:08:15.719553] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-11. [2025-09-18T18:08:16.519564] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-18T18:08:16.765732] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-18T18:08:16.943824] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-18T18:08:17.319592] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-18T18:08:18.119550] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-09-18T18:08:18.517966] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-18T18:08:18.919583] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-18T18:08:19.116501] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-18T18:08:19.345192] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T18:08:19.719581] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-18T18:08:20.193144] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-18T18:08:20.519555] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-18T18:08:21.185064] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-18T18:08:21.319595] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-09-18T18:08:22.119564] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-18T18:08:22.246557] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-18T18:08:22.361917] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-18T18:08:22.919587] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-18T18:08:23.717471] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-18T18:08:23.726829] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-18T18:08:24.228509] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-18T18:08:24.377390] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-18T18:08:24.519541] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-18T18:08:25.319552] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-18T18:08:26.119559] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-18T18:08:26.919584] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-18T18:08:26.998905] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-18T18:08:27.384515] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-18T18:08:27.719565] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-18T18:08:28.519594] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-18T18:08:28.555817] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-18T18:08:28.572019] [INFO ] [REMOTE ] CLX: Full fetch complete (72597 records). [2025-09-18T18:08:28.572853] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (3.25 seconds). [2025-09-18T18:08:28.576434] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-18T18:08:28.996857] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-09-18T18:08:28.996980] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-09-18T18:08:28.997787] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-09-18T18:08:28.997872] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-09-18T18:08:29.000102] [DEBUG] [LOCAL ] CLX: Trimmed 72597 records to 51779 (keeping 200 days of data) [2025-09-18T18:08:29.122594] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-18T18:08:29.341551] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-18T18:08:29.385772] [DEBUG] [LOCAL ] CLX: Primary data saved (51779 records). [2025-09-18T18:08:29.385939] [INFO ] [MAIN ] CLX: Full history saved. [2025-09-18T18:08:29.386044] [INFO ] [MAIN ] Update Progress: 471/2372 symbols completed. CLX took 41.5s. Estimated remaining: 4h 36m 12s. Rate: 6.9 symbols/min [2025-09-18T18:08:29.561554] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:08:29.618683] [DEBUG] [LOCAL ] CMC: Loaded 45786 existing records from primary storage. [2025-09-18T18:08:29.619045] [INFO ] [MAIN ] CMC: Loaded 45786 existing records. [2025-09-18T18:08:29.801114] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:08:29.801435] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-18T18:08:29.801493] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-18T18:08:29.802496] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-18T18:08:29.802559] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-18T18:08:30.122778] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-18T18:08:30.207719] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:08:30.222630] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-18T18:08:30.260029] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-18T18:08:30.919561] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-18T18:08:31.719564] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-11. [2025-09-18T18:08:32.519565] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-18T18:08:33.223999] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (3.10 seconds). [2025-09-18T18:08:33.248967] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-18T18:08:33.319526] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-18T18:08:33.479092] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-18T18:08:33.732160] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-18T18:08:33.739409] [INFO ] [REMOTE ] CM: Full fetch complete (69244 records). [2025-09-18T18:08:33.739565] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-18T18:08:34.128112] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-18T18:08:34.131679] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-09-18T18:08:34.132935] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-09-18T18:08:34.133714] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-09-18T18:08:34.133923] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-09-18T18:08:34.136816] [DEBUG] [LOCAL ] CM: Trimmed 69244 records to 49009 (keeping 200 days of data) [2025-09-18T18:08:34.437606] [DEBUG] [LOCAL ] CM: Primary data saved (49009 records). [2025-09-18T18:08:34.437795] [INFO ] [MAIN ] CM: Full history saved. [2025-09-18T18:08:34.437891] [INFO ] [MAIN ] Update Progress: 472/2372 symbols completed. CM took 36.4s. Estimated remaining: 4h 35m 49s. Rate: 6.9 symbols/min [2025-09-18T18:08:34.631674] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:08:34.639617] [DEBUG] [LOCAL ] CMCM: Loaded 4637 existing records from primary storage. [2025-09-18T18:08:34.639777] [INFO ] [MAIN ] CMCM: Loaded 4637 existing records. [2025-09-18T18:08:34.883490] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:08:34.911953] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-18T18:08:34.912279] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-18T18:08:34.914400] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T18:08:34.914451] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-18T18:08:34.924695] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-09-18T18:08:34.925037] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-18T18:08:35.323097] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-18T18:08:35.327347] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:08:35.719557] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-18T18:08:36.519555] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-18T18:08:36.552393] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-18T18:08:36.572870] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-18T18:08:37.319535] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-11. [2025-09-18T18:08:38.031242] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-18T18:08:38.119529] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-18T18:08:38.242852] [DEBUG] [REMOTE ] CMBT: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-18T18:08:38.243217] [WARN ] [REMOTE ] CMBT: No data returned for month 2025-08 [2025-09-18T18:08:38.736806] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-18T18:08:38.744251] [INFO ] [REMOTE ] CMA: Full fetch complete (73263 records). [2025-09-18T18:08:38.744433] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-18T18:08:38.925335] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-09-18T18:08:39.144479] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-09-18T18:08:39.144573] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-09-18T18:08:39.145349] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-09-18T18:08:39.145415] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-09-18T18:08:39.146906] [DEBUG] [LOCAL ] CMA: Trimmed 73263 records to 50675 (keeping 200 days of data) [2025-09-18T18:08:39.464049] [DEBUG] [LOCAL ] CMA: Primary data saved (50675 records). [2025-09-18T18:08:39.464227] [INFO ] [MAIN ] CMA: Full history saved. [2025-09-18T18:08:39.464326] [INFO ] [MAIN ] Update Progress: 473/2372 symbols completed. CMA took 33.4s. Estimated remaining: 4h 35m 25s. Rate: 6.9 symbols/min [2025-09-18T18:08:39.646101] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:08:39.646342] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-18T18:08:39.646401] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-18T18:08:39.646567] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-18T18:08:39.646611] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-18T18:08:39.646700] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-18T18:08:39.646756] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-18T18:08:39.731275] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-18T18:08:39.771531] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-18T18:08:40.025858] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:08:40.519551] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-09-18T18:08:41.319556] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-09-18T18:08:41.944354] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-18T18:08:41.944483] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-18T18:08:41.952840] [INFO ] [REMOTE ] CMBT: Full fetch complete (23581 records). [2025-09-18T18:08:41.952921] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-18T18:08:42.131080] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-18T18:08:42.145722] [WARN ] [VALIDATOR ] CMBT: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-18T18:08:42.146187] [FATAL] [MAIN ] CMBT: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:08:42.146286] [WARN ] [MAIN ] CMBT: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:08:42.146475] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-18T18:08:42.146694] [DEBUG] [LOCAL ] CMBT: No primary data file found to delete. [2025-09-18T18:08:42.146896] [INFO ] [LOCAL ] CMBT: Starting deletion of derivative data. [2025-09-18T18:08:42.147429] [DEBUG] [LOCAL ] CMBT: Deleted derivative data file. [2025-09-18T18:08:42.147696] [INFO ] [MAIN ] Update Progress: 474/2372 symbols completed. CMBT took 31.2s. Estimated remaining: 4h 34m 52s. Rate: 6.9 symbols/min [2025-09-18T18:08:42.326933] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:08:42.358531] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-18T18:08:42.430855] [DEBUG] [LOCAL ] CMG: Loaded 53720 existing records from primary storage. [2025-09-18T18:08:42.431007] [INFO ] [MAIN ] CMG: Loaded 53720 existing records. [2025-09-18T18:08:42.608126] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:08:42.608386] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-18T18:08:42.608442] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-18T18:08:42.609513] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-09-18T18:08:42.609574] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-18T18:08:42.924739] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-18T18:08:42.971944] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:08:43.032565] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-18T18:08:43.719545] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-18T18:08:44.347685] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-18T18:08:44.440109] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-18T18:08:44.519548] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-11. [2025-09-18T18:08:44.820291] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:08:44.820618] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-11 [2025-09-18T18:08:45.319587] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-18T18:08:46.119557] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-11. [2025-09-18T18:08:46.674376] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-18T18:08:46.919510] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-18T18:08:47.719576] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-18T18:08:48.137334] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-18T18:08:48.344025] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T18:08:48.358815] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-18T18:08:48.519550] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-18T18:08:48.890635] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-18T18:08:49.319551] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-09-18T18:08:49.586722] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:08:49.587053] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-09-18T18:08:50.119554] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-18T18:08:50.690275] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-18T18:08:50.919544] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-18T18:08:51.719597] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-18T18:08:52.334631] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-18T18:08:52.519613] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-18T18:08:53.319514] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-09-18T18:08:53.329294] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-18T18:08:53.362565] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-18T18:08:53.602353] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:08:53.602734] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-09-18T18:08:54.119566] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-18T18:08:54.864974] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-18T18:08:54.867322] [INFO ] [REMOTE ] CMCM: Full fetch complete (7057 records). [2025-09-18T18:08:54.867419] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-18T18:08:54.929948] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-09-18T18:08:55.371395] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-18T18:08:55.371559] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-18T18:08:55.372003] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-18T18:08:55.372089] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-18T18:08:55.372944] [DEBUG] [LOCAL ] CMCM: Trimmed 7057 records to 4678 (keeping 200 days of data) [2025-09-18T18:08:55.413186] [DEBUG] [LOCAL ] CMCM: Primary data saved (4678 records). [2025-09-18T18:08:55.413400] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-18T18:08:55.413547] [INFO ] [MAIN ] Update Progress: 475/2372 symbols completed. CMCM took 21.0s. Estimated remaining: 4h 35m 2s. Rate: 6.9 symbols/min [2025-09-18T18:08:55.704287] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:08:55.719628] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-18T18:08:55.758130] [DEBUG] [LOCAL ] CMI: Loaded 41930 existing records from primary storage. [2025-09-18T18:08:55.758297] [INFO ] [MAIN ] CMI: Loaded 41930 existing records. [2025-09-18T18:08:55.999422] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:08:55.999880] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-18T18:08:55.999962] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-18T18:08:56.001473] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-09-18T18:08:56.001557] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-18T18:08:56.374445] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:08:56.519552] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-11. [2025-09-18T18:08:57.171528] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-18T18:08:57.251478] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-18T18:08:57.319495] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-09-18T18:08:57.556082] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-18T18:08:58.119556] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-18T18:08:58.919618] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-09-18T18:08:59.242337] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-18T18:08:59.356016] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-18T18:08:59.719553] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-18T18:09:00.171731] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-18T18:09:00.519559] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-09-18T18:09:01.010001] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-18T18:09:01.319567] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-18T18:09:02.119568] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-02. [2025-09-18T18:09:02.919559] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-18T18:09:03.071559] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-18T18:09:03.383712] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:09:03.384059] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-02 [2025-09-18T18:09:03.719725] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-03. [2025-09-18T18:09:03.961009] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:09:03.961359] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-03 [2025-09-18T18:09:04.519576] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-04. [2025-09-18T18:09:04.740928] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:09:04.741260] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-04 [2025-09-18T18:09:04.795127] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (3.48 seconds). [2025-09-18T18:09:05.120506] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-18T18:09:05.126876] [INFO ] [REMOTE ] CMC: Full fetch complete (66634 records). [2025-09-18T18:09:05.127028] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-18T18:09:05.328445] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-05. [2025-09-18T18:09:05.532884] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-18T18:09:05.532973] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-18T18:09:05.533761] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-18T18:09:05.533856] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-18T18:09:05.535307] [DEBUG] [LOCAL ] CMC: Trimmed 66634 records to 46140 (keeping 200 days of data) [2025-09-18T18:09:05.814425] [DEBUG] [LOCAL ] CMC: Primary data saved (46140 records). [2025-09-18T18:09:05.814581] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-18T18:09:05.814699] [INFO ] [MAIN ] Update Progress: 476/2372 symbols completed. CMC took 36.4s. Estimated remaining: 4h 34m 60s. Rate: 6.9 symbols/min [2025-09-18T18:09:06.009903] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:09:06.047300] [DEBUG] [LOCAL ] CMP: Loaded 36678 existing records from primary storage. [2025-09-18T18:09:06.047443] [INFO ] [MAIN ] CMP: Loaded 36678 existing records. [2025-09-18T18:09:06.124690] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-18T18:09:06.232934] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:09:06.233171] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-18T18:09:06.233221] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-18T18:09:06.234482] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-09-18T18:09:06.234543] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-18T18:09:06.632049] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:09:06.639687] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-18T18:09:06.919578] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-11. [2025-09-18T18:09:07.719549] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-18T18:09:07.894330] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-18T18:09:08.311515] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T18:09:08.519629] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-09-18T18:09:09.319569] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-18T18:09:09.734237] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-18T18:09:09.882314] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-18T18:09:10.119547] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-18T18:09:10.919556] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-06. [2025-09-18T18:09:11.719630] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-09-18T18:09:12.075415] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-09-18T18:09:12.529301] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-18T18:09:12.549771] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-18T18:09:12.576021] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-18T18:09:13.254683] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-18T18:09:13.319560] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-07. [2025-09-18T18:09:13.860367] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-18T18:09:14.119560] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-18T18:09:14.251715] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T18:09:14.919558] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-08. [2025-09-18T18:09:15.513205] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-18T18:09:15.540537] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-18T18:09:15.719554] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-18T18:09:16.519572] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-09. [2025-09-18T18:09:17.195370] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-18T18:09:17.209933] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-18T18:09:17.212582] [INFO ] [REMOTE ] CMDB: Full fetch complete (10471 records). [2025-09-18T18:09:17.212690] [DEBUG] [VALIDATOR ] CMDB: Validating primary data. [2025-09-18T18:09:17.324605] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-18T18:09:17.403554] [WARN ] [VALIDATOR ] CMDB: Validation failed - insufficient historical data. Have 93 unique days, need 200 days [2025-09-18T18:09:17.403926] [FATAL] [MAIN ] CMDB: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:09:17.404014] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:09:17.404104] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-18T18:09:17.404187] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-18T18:09:17.404260] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-18T18:09:17.404374] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-18T18:09:17.404482] [INFO ] [MAIN ] Update Progress: 477/2372 symbols completed. CMDB took 37.9s. Estimated remaining: 4h 35m 3s. Rate: 6.9 symbols/min [2025-09-18T18:09:18.119559] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-18T18:09:18.813013] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T18:09:18.919534] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-18T18:09:19.484537] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T18:09:19.719618] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-18T18:09:19.823882] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-18T18:09:20.519560] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-18T18:09:21.319582] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-18T18:09:21.730661] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-18T18:09:21.773599] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-18T18:09:22.119617] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-18T18:09:22.892082] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-18T18:09:22.919567] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-18T18:09:23.719588] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-18T18:09:23.818879] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-18T18:09:24.523435] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-18T18:09:24.529747] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-18T18:09:24.536432] [INFO ] [REMOTE ] CMI: Full fetch complete (59698 records). [2025-09-18T18:09:24.536574] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-18T18:09:24.917471] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-09-18T18:09:24.917555] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-09-18T18:09:24.918251] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-09-18T18:09:24.918316] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-09-18T18:09:24.919570] [DEBUG] [LOCAL ] CMI: Trimmed 59698 records to 42298 (keeping 200 days of data) [2025-09-18T18:09:25.183708] [DEBUG] [LOCAL ] CMI: Primary data saved (42298 records). [2025-09-18T18:09:25.183872] [INFO ] [MAIN ] CMI: Full history saved. [2025-09-18T18:09:25.183965] [INFO ] [MAIN ] Update Progress: 478/2372 symbols completed. CMI took 29.8s. Estimated remaining: 4h 34m 50s. Rate: 6.9 symbols/min [2025-09-18T18:09:25.549122] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-18T18:09:25.560030] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-18T18:09:25.961390] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T18:09:26.119576] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-18T18:09:27.433462] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-18T18:09:27.442098] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-18T18:09:27.533972] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-18T18:09:27.719613] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-18T18:09:28.587113] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-18T18:09:28.594283] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-18T18:09:29.798096] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-18T18:09:29.810349] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-18T18:09:29.847122] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-18T18:09:29.851524] [INFO ] [REMOTE ] CMP: Full fetch complete (53247 records). [2025-09-18T18:09:29.851638] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-18T18:09:30.243831] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-09-18T18:09:30.243975] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-09-18T18:09:30.244715] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-09-18T18:09:30.244783] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-09-18T18:09:30.246131] [DEBUG] [LOCAL ] CMP: Trimmed 53247 records to 36915 (keeping 200 days of data) [2025-09-18T18:09:30.458037] [DEBUG] [LOCAL ] CMP: Primary data saved (36915 records). [2025-09-18T18:09:30.458214] [INFO ] [MAIN ] CMP: Full history saved. [2025-09-18T18:09:30.458323] [INFO ] [MAIN ] Update Progress: 479/2372 symbols completed. CMP took 24.6s. Estimated remaining: 4h 34m 28s. Rate: 6.9 symbols/min [2025-09-18T18:09:32.145289] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-18T18:09:32.152919] [INFO ] [REMOTE ] CMG: Full fetch complete (77722 records). [2025-09-18T18:09:32.153071] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-18T18:09:32.566483] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-09-18T18:09:32.566572] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-09-18T18:09:32.567377] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-09-18T18:09:32.567445] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-09-18T18:09:32.568995] [DEBUG] [LOCAL ] CMG: Trimmed 77722 records to 54110 (keeping 200 days of data) [2025-09-18T18:09:32.891618] [DEBUG] [LOCAL ] CMG: Primary data saved (54110 records). [2025-09-18T18:09:32.891784] [INFO ] [MAIN ] CMG: Full history saved. [2025-09-18T18:09:32.893500] [INFO ] [MAIN ] Update Progress: 480/2372 symbols completed. CMG took 50.7s. Estimated remaining: 4h 33m 55s. Rate: 6.9 symbols/min [2025-09-18T18:09:33.432555] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:09:33.587359] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:09:33.632378] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:09:33.655669] [DEBUG] [LOCAL ] CMSC: Loaded 5121 existing records from primary storage. [2025-09-18T18:09:33.651935] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:09:33.655962] [INFO ] [MAIN ] CMSC: Loaded 5121 existing records. [2025-09-18T18:09:33.728402] [DEBUG] [LOCAL ] CMSA: Loaded 3344 existing records from primary storage. [2025-09-18T18:09:33.745432] [INFO ] [MAIN ] CMSA: Loaded 3344 existing records. [2025-09-18T18:09:33.952731] [DEBUG] [LOCAL ] CMRE: Loaded 35727 existing records from primary storage. [2025-09-18T18:09:33.991022] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:09:33.991247] [INFO ] [MAIN ] CMRE: Loaded 35727 existing records. [2025-09-18T18:09:34.076432] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-18T18:09:34.132348] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-18T18:09:34.148406] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:09:34.162960] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-18T18:09:34.173576] [DEBUG] [LOCAL ] CMS: Loaded 52651 existing records from primary storage. [2025-09-18T18:09:34.172612] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-18T18:09:34.173841] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-18T18:09:34.173911] [INFO ] [MAIN ] CMS: Loaded 52651 existing records. [2025-09-18T18:09:34.189537] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-18T18:09:34.245447] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-09-18T18:09:34.295907] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-18T18:09:34.647192] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:09:34.812313] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-18T18:09:34.905979] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-18T18:09:34.873813] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:09:34.984133] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-18T18:09:35.019683] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-18T18:09:35.004021] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-18T18:09:35.081163] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-18T18:09:35.150808] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-09-18T18:09:35.202662] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-18T18:09:35.394629] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:09:35.386233] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:09:35.419987] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-11. [2025-09-18T18:09:35.425374] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-11. [2025-09-18T18:09:35.972780] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:09:35.996578] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-11. [2025-09-18T18:09:36.028188] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:09:36.028476] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-11. [2025-09-18T18:09:36.036242] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-18T18:09:36.037424] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-09-18T18:09:36.112686] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-18T18:09:36.114014] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-09-18T18:09:36.519279] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-18T18:09:36.521022] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-09-18T18:09:36.549036] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-18T18:09:36.550890] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-09-18T18:09:36.936819] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-18T18:09:36.938372] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-18T18:09:37.089963] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-18T18:09:37.161301] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-18T18:09:37.262969] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-18T18:09:37.326106] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-09-18T18:09:37.346166] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-18T18:09:38.119533] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-09-18T18:09:38.478599] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-18T18:09:38.919551] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-18T18:09:39.302966] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-18T18:09:39.576276] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-18T18:09:39.719553] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-09-18T18:09:40.519503] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-09-18T18:09:40.992145] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-18T18:09:41.319551] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-18T18:09:42.084119] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-18T18:09:42.119532] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-18T18:09:42.343627] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-18T18:09:42.919543] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-18T18:09:43.303976] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-18T18:09:43.640537] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-18T18:09:43.719523] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-18T18:09:44.292238] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-18T18:09:44.519563] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-18T18:09:45.319548] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-18T18:09:45.328435] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-18T18:09:46.119554] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-18T18:09:46.631038] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-18T18:09:46.793569] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-18T18:09:46.919559] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-18T18:09:47.719608] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-18T18:09:48.519618] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-18T18:09:48.640475] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-18T18:09:48.868467] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-18T18:09:49.158698] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-18T18:09:49.319543] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-18T18:09:50.119556] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-18T18:09:50.709924] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T18:09:50.919549] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-18T18:09:51.477845] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-18T18:09:51.719559] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-18T18:09:51.770079] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-18T18:09:52.519559] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-18T18:09:53.153183] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-18T18:09:53.159579] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-18T18:09:53.319541] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-18T18:09:54.119567] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-18T18:09:54.487419] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-18T18:09:54.686874] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-18T18:09:54.919561] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-18T18:09:55.456813] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-18T18:09:55.719556] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-18T18:09:56.290916] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-18T18:09:56.519543] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-18T18:09:57.319559] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-18T18:09:57.876694] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T18:09:58.119589] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-18T18:09:58.640518] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-18T18:09:58.919578] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-18T18:09:59.039066] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-18T18:09:59.719569] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-18T18:10:00.301558] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-18T18:10:00.312125] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-18T18:10:00.519586] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-18T18:10:01.319609] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-18T18:10:01.548441] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-18T18:10:01.550034] [INFO ] [REMOTE ] CMSA: Full fetch complete (5025 records). [2025-09-18T18:10:01.550164] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-18T18:10:01.997463] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-09-18T18:10:01.997560] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-09-18T18:10:01.997780] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-09-18T18:10:01.997861] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-09-18T18:10:01.998597] [DEBUG] [LOCAL ] CMSA: Trimmed 5025 records to 3384 (keeping 200 days of data) [2025-09-18T18:10:02.022238] [DEBUG] [LOCAL ] CMSA: Primary data saved (3384 records). [2025-09-18T18:10:02.022411] [INFO ] [MAIN ] CMSA: Full history saved. [2025-09-18T18:10:02.022551] [INFO ] [MAIN ] Update Progress: 481/2372 symbols completed. CMSA took 29.1s. Estimated remaining: 4h 35m 6s. Rate: 6.9 symbols/min [2025-09-18T18:10:02.125093] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-18T18:10:02.236101] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:10:02.247576] [DEBUG] [LOCAL ] CMSD: Loaded 8164 existing records from primary storage. [2025-09-18T18:10:02.247750] [INFO ] [MAIN ] CMSD: Loaded 8164 existing records. [2025-09-18T18:10:02.441033] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:10:02.441305] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-18T18:10:02.441358] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-18T18:10:02.441848] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-09-18T18:10:02.441911] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-18T18:10:02.827942] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:10:02.919591] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-18T18:10:03.246777] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-18T18:10:03.522292] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-18T18:10:03.524055] [INFO ] [REMOTE ] CMSC: Full fetch complete (7149 records). [2025-09-18T18:10:03.524128] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-18T18:10:03.724741] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-18T18:10:03.773108] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-18T18:10:03.836015] [INFO ] [REMOTE ] CMRE: Full fetch complete (49306 records). [2025-09-18T18:10:03.836189] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-18T18:10:04.045047] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-18T18:10:04.058611] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-18T18:10:04.064068] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-18T18:10:04.070133] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-18T18:10:04.095825] [DEBUG] [LOCAL ] CMSC: Trimmed 7149 records to 5156 (keeping 200 days of data) [2025-09-18T18:10:04.308701] [DEBUG] [LOCAL ] CMSC: Primary data saved (5156 records). [2025-09-18T18:10:04.325197] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-18T18:10:04.327222] [INFO ] [MAIN ] Update Progress: 482/2372 symbols completed. CMSC took 31.4s. Estimated remaining: 4h 34m 32s. Rate: 6.9 symbols/min [2025-09-18T18:10:04.398398] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-09-18T18:10:04.423404] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-09-18T18:10:04.433171] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-09-18T18:10:04.438842] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-09-18T18:10:04.473533] [DEBUG] [LOCAL ] CMRE: Trimmed 49306 records to 35979 (keeping 200 days of data) [2025-09-18T18:10:04.530467] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-11. [2025-09-18T18:10:04.602384] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:10:04.773404] [DEBUG] [LOCAL ] CMTG: Loaded 37816 existing records from primary storage. [2025-09-18T18:10:04.774129] [INFO ] [MAIN ] CMTG: Loaded 37816 existing records. [2025-09-18T18:10:04.978902] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:10:04.980004] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-18T18:10:04.980395] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-18T18:10:04.982468] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-18T18:10:04.982852] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-18T18:10:05.369447] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:10:05.372437] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-11. [2025-09-18T18:10:05.372692] [DEBUG] [LOCAL ] CMRE: Primary data saved (35979 records). [2025-09-18T18:10:05.373606] [INFO ] [MAIN ] CMRE: Full history saved. [2025-09-18T18:10:05.373806] [INFO ] [MAIN ] Update Progress: 483/2372 symbols completed. CMRE took 32.5s. Estimated remaining: 4h 33m 54s. Rate: 6.9 symbols/min [2025-09-18T18:10:05.416579] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-18T18:10:05.561589] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:10:05.561837] [DEBUG] [LOCAL ] CMU: No existing data file found in primary storage. [2025-09-18T18:10:05.561936] [WARN ] [MAIN ] CMU: No existing data found, performing full refresh instead. [2025-09-18T18:10:05.562185] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-18T18:10:05.562307] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-18T18:10:05.562430] [DEBUG] [LOCAL ] CMU: No primary data file found to delete. [2025-09-18T18:10:05.562553] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-18T18:10:05.915805] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-18T18:10:05.989615] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:10:06.119603] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-11. [2025-09-18T18:10:06.559695] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-18T18:10:06.678367] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-18T18:10:06.919619] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-09-18T18:10:07.719534] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-18T18:10:08.201562] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-18T18:10:08.519553] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-09-18T18:10:09.319609] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-09-18T18:10:09.446540] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-18T18:10:09.465112] [INFO ] [REMOTE ] CMS: Full fetch complete (75865 records). [2025-09-18T18:10:09.465395] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-18T18:10:09.467814] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-18T18:10:09.806504] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-18T18:10:09.905585] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-09-18T18:10:09.905726] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-09-18T18:10:09.906546] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-09-18T18:10:09.906596] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-09-18T18:10:09.908259] [DEBUG] [LOCAL ] CMS: Trimmed 75865 records to 53032 (keeping 200 days of data) [2025-09-18T18:10:10.143198] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-09-18T18:10:10.264908] [DEBUG] [LOCAL ] CMS: Primary data saved (53032 records). [2025-09-18T18:10:10.265103] [INFO ] [MAIN ] CMS: Full history saved. [2025-09-18T18:10:10.265265] [INFO ] [MAIN ] Update Progress: 484/2372 symbols completed. CMS took 37.4s. Estimated remaining: 4h 33m 30s. Rate: 6.9 symbols/min [2025-09-18T18:10:10.448303] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:10:10.479627] [DEBUG] [LOCAL ] CNA: Loaded 32829 existing records from primary storage. [2025-09-18T18:10:10.479798] [INFO ] [MAIN ] CNA: Loaded 32829 existing records. [2025-09-18T18:10:10.660813] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:10:10.661077] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-18T18:10:10.661126] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-18T18:10:10.661985] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-18T18:10:10.662056] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-18T18:10:10.924965] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-09-18T18:10:10.962493] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T18:10:11.060704] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:10:11.719561] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-09-18T18:10:12.301832] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-18T18:10:12.336815] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-18T18:10:12.519569] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-18T18:10:13.319577] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-18T18:10:13.911426] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-18T18:10:13.936615] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T18:10:14.119573] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-18T18:10:14.919592] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-18T18:10:15.706836] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T18:10:15.719509] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-18T18:10:15.741510] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-18T18:10:16.519586] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-11. [2025-09-18T18:10:17.319615] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-18T18:10:17.355672] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T18:10:17.456462] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-18T18:10:17.974941] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-18T18:10:18.119568] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-18T18:10:18.864341] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-18T18:10:18.919560] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-18T18:10:19.376637] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-18T18:10:19.719596] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-09-18T18:10:20.519584] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-18T18:10:20.836342] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-18T18:10:21.319544] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-18T18:10:21.845377] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-18T18:10:22.030212] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-18T18:10:22.119546] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-18T18:10:22.919564] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-18T18:10:22.980092] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-18T18:10:23.719598] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-18T18:10:24.336058] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-18T18:10:24.353398] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-18T18:10:24.519554] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-18T18:10:25.240218] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T18:10:25.319562] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-18T18:10:26.063149] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-18T18:10:26.119528] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-18T18:10:26.775974] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-18T18:10:26.919578] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-09-18T18:10:27.719568] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-18T18:10:28.015486] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-18T18:10:28.519573] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-18T18:10:29.318337] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-18T18:10:29.319931] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-18T18:10:29.321604] [INFO ] [REMOTE ] CMSD: Full fetch complete (12621 records). [2025-09-18T18:10:29.321939] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-18T18:10:29.669956] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-18T18:10:29.764779] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-09-18T18:10:29.764881] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-09-18T18:10:29.765254] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-09-18T18:10:29.765318] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-09-18T18:10:29.766705] [DEBUG] [LOCAL ] CMSD: Trimmed 12621 records to 8213 (keeping 200 days of data) [2025-09-18T18:10:29.825952] [DEBUG] [LOCAL ] CMSD: Primary data saved (8213 records). [2025-09-18T18:10:29.826111] [INFO ] [MAIN ] CMSD: Full history saved. [2025-09-18T18:10:29.826315] [INFO ] [MAIN ] Update Progress: 485/2372 symbols completed. CMSD took 27.8s. Estimated remaining: 4h 34m 4s. Rate: 6.9 symbols/min [2025-09-18T18:10:30.001558] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:10:30.070935] [DEBUG] [LOCAL ] CNC: Loaded 53729 existing records from primary storage. [2025-09-18T18:10:30.071088] [INFO ] [MAIN ] CNC: Loaded 53729 existing records. [2025-09-18T18:10:30.124780] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-18T18:10:30.251907] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:10:30.252156] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-18T18:10:30.252219] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-18T18:10:30.253585] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-09-18T18:10:30.253676] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-18T18:10:30.619033] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:10:30.639570] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-18T18:10:30.876939] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-18T18:10:30.919526] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-18T18:10:31.507550] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-18T18:10:31.719548] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-18T18:10:32.519541] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-18T18:10:33.027875] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-18T18:10:33.052792] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-18T18:10:33.319563] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-18T18:10:34.119572] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-18T18:10:34.418130] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-18T18:10:34.423276] [INFO ] [REMOTE ] CMTG: Full fetch complete (52967 records). [2025-09-18T18:10:34.423386] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-18T18:10:34.815132] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-18T18:10:34.815247] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-18T18:10:34.815938] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-18T18:10:34.816026] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-18T18:10:34.822354] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-18T18:10:34.825052] [INFO ] [REMOTE ] CMU: Full fetch complete (9644 records). [2025-09-18T18:10:34.825132] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-18T18:10:34.857418] [DEBUG] [LOCAL ] CMTG: Trimmed 52967 records to 38077 (keeping 200 days of data) [2025-09-18T18:10:34.925165] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-18T18:10:35.438357] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-09-18T18:10:35.438150] [DEBUG] [LOCAL ] CMTG: Primary data saved (38077 records). [2025-09-18T18:10:35.438550] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-09-18T18:10:35.438667] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-18T18:10:35.439077] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-18T18:10:35.439271] [INFO ] [MAIN ] Update Progress: 486/2372 symbols completed. CMTG took 31.1s. Estimated remaining: 4h 33m 43s. Rate: 6.9 symbols/min [2025-09-18T18:10:35.439557] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-09-18T18:10:35.472150] [DEBUG] [LOCAL ] CMU: Trimmed 9644 records to 7421 (keeping 200 days of data) [2025-09-18T18:10:35.673364] [DEBUG] [LOCAL ] CMU: Primary data saved (7421 records). [2025-09-18T18:10:35.673489] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-18T18:10:35.669516] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:10:35.673633] [INFO ] [MAIN ] Update Progress: 487/2372 symbols completed. CMU took 30.3s. Estimated remaining: 4h 33m 2s. Rate: 6.9 symbols/min [2025-09-18T18:10:35.719735] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-11. [2025-09-18T18:10:35.794591] [DEBUG] [LOCAL ] CNF: Loaded 10708 existing records from primary storage. [2025-09-18T18:10:35.794761] [INFO ] [MAIN ] CNF: Loaded 10708 existing records. [2025-09-18T18:10:35.972006] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:10:36.056391] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:10:36.056804] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-18T18:10:36.056970] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-18T18:10:36.057583] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-09-18T18:10:36.057705] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-18T18:10:36.402563] [DEBUG] [LOCAL ] CNH: Loaded 53561 existing records from primary storage. [2025-09-18T18:10:36.426629] [INFO ] [MAIN ] CNH: Loaded 53561 existing records. [2025-09-18T18:10:36.463517] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:10:36.533035] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-11. [2025-09-18T18:10:36.669838] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-18T18:10:36.668568] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:10:36.677161] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-18T18:10:36.677223] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-18T18:10:36.678783] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-09-18T18:10:36.678846] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-18T18:10:37.045242] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:10:37.319506] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-18T18:10:37.419111] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-18T18:10:37.609713] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-18T18:10:38.119559] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-09-18T18:10:38.577810] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-18T18:10:38.919563] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-09-18T18:10:39.547849] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-18T18:10:39.719524] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-11. [2025-09-18T18:10:39.762157] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-18T18:10:40.519559] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-09-18T18:10:41.082174] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-18T18:10:41.319520] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-18T18:10:41.378580] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-18T18:10:42.119610] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-18T18:10:42.539275] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-18T18:10:42.593700] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-18T18:10:42.919597] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-18T18:10:43.676440] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-18T18:10:43.719510] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-09-18T18:10:44.519564] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-18T18:10:45.102600] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-18T18:10:45.319528] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-18T18:10:45.440921] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-18T18:10:45.805423] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-18T18:10:46.119567] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-18T18:10:46.919551] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-18T18:10:47.059402] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-18T18:10:47.719546] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-18T18:10:48.288187] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-18T18:10:48.337716] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-18T18:10:48.519545] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-18T18:10:49.319563] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-18T18:10:50.128791] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-09-18T18:10:50.134601] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-18T18:10:50.352457] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-18T18:10:50.919561] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-18T18:10:51.719557] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-18T18:10:52.320249] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-18T18:10:52.439360] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-18T18:10:52.519578] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-18T18:10:53.111945] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-18T18:10:53.266991] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-18T18:10:53.269516] [INFO ] [REMOTE ] CNF: Full fetch complete (12610 records). [2025-09-18T18:10:53.269603] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-18T18:10:53.324845] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-18T18:10:53.660631] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-09-18T18:10:53.660751] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-09-18T18:10:53.661115] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-09-18T18:10:53.661181] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-09-18T18:10:53.661786] [DEBUG] [LOCAL ] CNF: Trimmed 12610 records to 10837 (keeping 200 days of data) [2025-09-18T18:10:53.723028] [DEBUG] [LOCAL ] CNF: Primary data saved (10837 records). [2025-09-18T18:10:53.723174] [INFO ] [MAIN ] CNF: Full history saved. [2025-09-18T18:10:53.723265] [INFO ] [MAIN ] Update Progress: 488/2372 symbols completed. CNF took 18.3s. Estimated remaining: 4h 33m 29s. Rate: 6.9 symbols/min [2025-09-18T18:10:53.895606] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:10:53.954865] [DEBUG] [LOCAL ] CNI: Loaded 51663 existing records from primary storage. [2025-09-18T18:10:53.955098] [INFO ] [MAIN ] CNI: Loaded 51663 existing records. [2025-09-18T18:10:54.120824] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-09-18T18:10:54.142369] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:10:54.142712] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-18T18:10:54.142782] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-18T18:10:54.144379] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-09-18T18:10:54.144518] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-18T18:10:54.507706] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:10:54.758141] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-18T18:10:54.919559] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-18T18:10:55.571443] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-18T18:10:55.719592] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-11. [2025-09-18T18:10:55.890447] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-18T18:10:55.895289] [INFO ] [REMOTE ] CNA: Full fetch complete (45282 records). [2025-09-18T18:10:55.895437] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-18T18:10:56.291728] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-09-18T18:10:56.291825] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-09-18T18:10:56.292372] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-09-18T18:10:56.292415] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-09-18T18:10:56.293544] [DEBUG] [LOCAL ] CNA: Trimmed 45282 records to 33018 (keeping 200 days of data) [2025-09-18T18:10:56.499601] [DEBUG] [LOCAL ] CNA: Primary data saved (33018 records). [2025-09-18T18:10:56.499807] [INFO ] [MAIN ] CNA: Full history saved. [2025-09-18T18:10:56.499966] [INFO ] [MAIN ] Update Progress: 489/2372 symbols completed. CNA took 46.2s. Estimated remaining: 4h 32m 57s. Rate: 6.9 symbols/min [2025-09-18T18:10:56.531855] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-18T18:10:56.673902] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:10:56.725525] [DEBUG] [LOCAL ] CNK: Loaded 52910 existing records from primary storage. [2025-09-18T18:10:56.725713] [INFO ] [MAIN ] CNK: Loaded 52910 existing records. [2025-09-18T18:10:56.910340] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:10:56.910596] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-18T18:10:56.910668] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-18T18:10:56.912170] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-18T18:10:56.912233] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-18T18:10:57.286117] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:10:57.319516] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-11. [2025-09-18T18:10:57.371990] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T18:10:58.032439] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-18T18:10:58.119505] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-18T18:10:58.695464] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-18T18:10:58.919602] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-09-18T18:10:59.719744] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-18T18:10:59.902097] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-18T18:11:00.374821] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-18T18:11:00.519587] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-09-18T18:11:01.319560] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-18T18:11:01.668851] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-18T18:11:02.119784] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-09-18T18:11:02.323689] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-18T18:11:02.804514] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-18T18:11:02.919545] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-09-18T18:11:03.719578] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-18T18:11:03.968797] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-18T18:11:04.337399] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-18T18:11:04.519573] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-18T18:11:05.151777] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-18T18:11:05.319620] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-18T18:11:05.849072] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T18:11:06.119583] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-18T18:11:06.919595] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-18T18:11:07.008622] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-18T18:11:07.719593] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-18T18:11:07.814241] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-18T18:11:08.296501] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T18:11:08.519611] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-18T18:11:09.319625] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-18T18:11:09.573311] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-18T18:11:09.963275] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T18:11:10.119580] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-18T18:11:10.877462] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-18T18:11:10.919523] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-18T18:11:11.719605] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-18T18:11:12.497323] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-18T18:11:12.519558] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-18T18:11:12.608972] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-18T18:11:13.230636] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-18T18:11:13.319542] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-18T18:11:14.119545] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-18T18:11:14.327009] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-18T18:11:14.334944] [INFO ] [REMOTE ] CNH: Full fetch complete (76983 records). [2025-09-18T18:11:14.335146] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-18T18:11:14.337311] [FATAL] [VALIDATOR ] CNH: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:11:14.337464] [FATAL] [MAIN ] CNH: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:11:14.337528] [WARN ] [MAIN ] CNH: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:11:14.337616] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-18T18:11:14.337725] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-09-18T18:11:14.337772] [INFO ] [LOCAL ] CNH: Starting deletion of derivative data. [2025-09-18T18:11:14.338236] [DEBUG] [LOCAL ] CNH: Deleted derivative data file. [2025-09-18T18:11:14.338342] [INFO ] [MAIN ] Update Progress: 490/2372 symbols completed. CNH took 38.7s. Estimated remaining: 4h 33m 24s. Rate: 6.9 symbols/min [2025-09-18T18:11:14.520354] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:11:14.577241] [DEBUG] [LOCAL ] CNM: Loaded 50949 existing records from primary storage. [2025-09-18T18:11:14.577389] [INFO ] [MAIN ] CNM: Loaded 50949 existing records. [2025-09-18T18:11:14.784193] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:11:14.784598] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-18T18:11:14.784784] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-18T18:11:14.786367] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-09-18T18:11:14.786445] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-18T18:11:14.932723] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-18T18:11:15.024686] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-18T18:11:15.230996] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:11:15.719557] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-11. [2025-09-18T18:11:15.802441] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-18T18:11:16.519576] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-18T18:11:16.970796] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-18T18:11:17.242135] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-18T18:11:17.319528] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-18T18:11:17.888350] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-18T18:11:18.119552] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-18T18:11:18.919560] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-09-18T18:11:19.579799] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-18T18:11:19.589213] [INFO ] [REMOTE ] CNC: Full fetch complete (77508 records). [2025-09-18T18:11:19.589546] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-18T18:11:19.719701] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-18T18:11:20.032288] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-09-18T18:11:20.032579] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-09-18T18:11:20.033477] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-09-18T18:11:20.033565] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-09-18T18:11:20.066241] [DEBUG] [LOCAL ] CNC: Trimmed 77508 records to 54119 (keeping 200 days of data) [2025-09-18T18:11:20.067555] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-18T18:11:20.429165] [DEBUG] [LOCAL ] CNC: Primary data saved (54119 records). [2025-09-18T18:11:20.429335] [INFO ] [MAIN ] CNC: Full history saved. [2025-09-18T18:11:20.429439] [INFO ] [MAIN ] Update Progress: 491/2372 symbols completed. CNC took 50.6s. Estimated remaining: 4h 33m 5s. Rate: 6.9 symbols/min [2025-09-18T18:11:20.522136] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-18T18:11:20.611428] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:11:20.643073] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-18T18:11:20.682531] [DEBUG] [LOCAL ] CNMD: Loaded 32668 existing records from primary storage. [2025-09-18T18:11:20.682717] [INFO ] [MAIN ] CNMD: Loaded 32668 existing records. [2025-09-18T18:11:20.874480] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:11:20.874800] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-18T18:11:20.874855] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-18T18:11:20.876594] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-09-18T18:11:20.876686] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-18T18:11:21.251500] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:11:21.291526] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-18T18:11:21.319559] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-11. [2025-09-18T18:11:22.012523] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T18:11:22.119584] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-18T18:11:22.908717] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-18T18:11:22.919487] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-09-18T18:11:23.604957] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T18:11:23.719505] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-18T18:11:24.059287] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-18T18:11:24.519584] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-09-18T18:11:25.319549] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-18T18:11:25.622579] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-18T18:11:25.874054] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-18T18:11:26.119555] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-18T18:11:26.924623] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-18T18:11:26.929834] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-18T18:11:26.937811] [INFO ] [REMOTE ] CNK: Full fetch complete (75452 records). [2025-09-18T18:11:26.937966] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-18T18:11:27.375805] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-09-18T18:11:27.375946] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-09-18T18:11:27.376988] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-09-18T18:11:27.377204] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-09-18T18:11:27.379396] [DEBUG] [LOCAL ] CNK: Trimmed 75452 records to 53299 (keeping 200 days of data) [2025-09-18T18:11:27.533262] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T18:11:27.723983] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-09-18T18:11:27.772360] [DEBUG] [LOCAL ] CNK: Primary data saved (53299 records). [2025-09-18T18:11:27.772535] [INFO ] [MAIN ] CNK: Full history saved. [2025-09-18T18:11:27.772634] [INFO ] [MAIN ] Update Progress: 492/2372 symbols completed. CNK took 31.3s. Estimated remaining: 4h 32m 51s. Rate: 6.9 symbols/min [2025-09-18T18:11:27.960667] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:11:27.999845] [DEBUG] [LOCAL ] CNNE: Loaded 36931 existing records from primary storage. [2025-09-18T18:11:28.000031] [INFO ] [MAIN ] CNNE: Loaded 36931 existing records. [2025-09-18T18:11:28.199584] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:11:28.199937] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-18T18:11:28.200021] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-18T18:11:28.201205] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-09-18T18:11:28.201271] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-18T18:11:28.524799] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-18T18:11:28.609335] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:11:28.799090] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-18T18:11:28.874823] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T18:11:29.319545] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-11. [2025-09-18T18:11:30.119517] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-18T18:11:30.261102] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-18T18:11:30.323189] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-18T18:11:30.919554] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-18T18:11:31.713991] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T18:11:31.724173] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-09-18T18:11:32.519547] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-18T18:11:32.717433] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-18T18:11:32.764540] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-18T18:11:33.319555] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-18T18:11:33.825842] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-18T18:11:34.119633] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-18T18:11:34.919515] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-18T18:11:35.047381] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-18T18:11:35.054704] [INFO ] [REMOTE ] CNI: Full fetch complete (74554 records). [2025-09-18T18:11:35.054845] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-18T18:11:35.474676] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-09-18T18:11:35.474775] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-09-18T18:11:35.475560] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-09-18T18:11:35.475605] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-09-18T18:11:35.477081] [DEBUG] [LOCAL ] CNI: Trimmed 74554 records to 52046 (keeping 200 days of data) [2025-09-18T18:11:35.730568] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-09-18T18:11:35.735437] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-18T18:11:35.852224] [DEBUG] [LOCAL ] CNI: Primary data saved (52046 records). [2025-09-18T18:11:35.852416] [INFO ] [MAIN ] CNI: Full history saved. [2025-09-18T18:11:35.853444] [INFO ] [MAIN ] Update Progress: 493/2372 symbols completed. CNI took 42.1s. Estimated remaining: 4h 32m 40s. Rate: 6.9 symbols/min [2025-09-18T18:11:36.038777] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:11:36.039023] [DEBUG] [LOCAL ] CNO: No existing data file found in primary storage. [2025-09-18T18:11:36.039079] [WARN ] [MAIN ] CNO: No existing data found, performing full refresh instead. [2025-09-18T18:11:36.039236] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-18T18:11:36.039281] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-18T18:11:36.039325] [DEBUG] [LOCAL ] CNO: No primary data file found to delete. [2025-09-18T18:11:36.039358] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-18T18:11:36.414592] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:11:36.472826] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-18T18:11:36.519506] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-18T18:11:36.537521] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-18T18:11:37.319556] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-18T18:11:37.964792] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T18:11:38.119527] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-18T18:11:38.878830] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-18T18:11:38.919500] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-18T18:11:39.145160] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-18T18:11:39.719543] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-18T18:11:40.216458] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-18T18:11:40.519524] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-11. [2025-09-18T18:11:40.745429] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-18T18:11:41.319549] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-18T18:11:41.988275] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-18T18:11:42.119589] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-18T18:11:42.919727] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-09-18T18:11:43.016368] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-18T18:11:43.273110] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-18T18:11:43.719571] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-18T18:11:43.966122] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T18:11:44.519565] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-09-18T18:11:45.046938] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-18T18:11:45.319539] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-18T18:11:46.074968] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-18T18:11:46.119496] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-18T18:11:46.603341] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-18T18:11:46.919557] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-18T18:11:47.633397] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-18T18:11:47.719581] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-18T18:11:48.281111] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T18:11:48.519621] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-18T18:11:49.319590] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-18T18:11:49.634948] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-18T18:11:49.642191] [INFO ] [REMOTE ] CNM: Full fetch complete (73462 records). [2025-09-18T18:11:49.642332] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-18T18:11:50.069934] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-09-18T18:11:50.070166] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-09-18T18:11:50.071094] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-09-18T18:11:50.071210] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-09-18T18:11:50.073327] [DEBUG] [LOCAL ] CNM: Trimmed 73462 records to 51337 (keeping 200 days of data) [2025-09-18T18:11:50.147323] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-18T18:11:50.191229] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-18T18:11:50.219863] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-18T18:11:50.225686] [INFO ] [REMOTE ] CNMD: Full fetch complete (46808 records). [2025-09-18T18:11:50.226338] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-18T18:11:50.633584] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-09-18T18:11:50.633961] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-09-18T18:11:50.635435] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-09-18T18:11:50.636336] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-09-18T18:11:50.640276] [DEBUG] [LOCAL ] CNMD: Trimmed 46808 records to 32887 (keeping 200 days of data) [2025-09-18T18:11:50.919816] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-18T18:11:50.999852] [DEBUG] [LOCAL ] CNMD: Primary data saved (32887 records). [2025-09-18T18:11:51.006074] [INFO ] [MAIN ] CNMD: Full history saved. [2025-09-18T18:11:51.020606] [INFO ] [MAIN ] Update Progress: 494/2372 symbols completed. CNMD took 30.6s. Estimated remaining: 4h 32m 56s. Rate: 6.9 symbols/min [2025-09-18T18:11:51.204772] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:11:51.206226] [DEBUG] [LOCAL ] CNP: No existing data file found in primary storage. [2025-09-18T18:11:51.206673] [WARN ] [MAIN ] CNP: No existing data found, performing full refresh instead. [2025-09-18T18:11:51.207240] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-18T18:11:51.207560] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-18T18:11:51.209148] [DEBUG] [LOCAL ] CNP: No primary data file found to delete. [2025-09-18T18:11:51.209541] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-18T18:11:51.387550] [DEBUG] [LOCAL ] CNM: Primary data saved (51337 records). [2025-09-18T18:11:51.404407] [INFO ] [MAIN ] CNM: Full history saved. [2025-09-18T18:11:51.414786] [INFO ] [MAIN ] Update Progress: 495/2372 symbols completed. CNM took 37.1s. Estimated remaining: 4h 32m 16s. Rate: 6.9 symbols/min [2025-09-18T18:11:51.755949] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:11:51.772432] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-11. [2025-09-18T18:11:51.849359] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:11:51.889753] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-18T18:11:51.971520] [DEBUG] [LOCAL ] CNQ: Loaded 53583 existing records from primary storage. [2025-09-18T18:11:51.971788] [INFO ] [MAIN ] CNQ: Loaded 53583 existing records. [2025-09-18T18:11:52.256071] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:11:52.256418] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-18T18:11:52.256506] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-18T18:11:52.258211] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-09-18T18:11:52.258289] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-18T18:11:52.525001] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-18T18:11:52.714365] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-18T18:11:52.894417] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:11:53.319585] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-18T18:11:53.713830] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-18T18:11:53.767720] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-18T18:11:54.119570] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-11. [2025-09-18T18:11:54.528969] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T18:11:54.919593] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-18T18:11:55.703634] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-18T18:11:55.719500] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-09-18T18:11:56.277620] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-18T18:11:56.519564] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-09-18T18:11:57.176990] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-18T18:11:57.319541] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-18T18:11:58.119604] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-09-18T18:11:58.248136] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-18T18:11:58.486630] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T18:11:58.919594] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-18T18:11:59.719891] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-09-18T18:11:59.728338] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T18:12:00.382976] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-18T18:12:00.519587] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-18T18:12:01.212834] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T18:12:01.319608] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-18T18:12:02.119558] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-18T18:12:02.515138] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-18T18:12:02.520803] [INFO ] [REMOTE ] CNNE: Full fetch complete (48860 records). [2025-09-18T18:12:02.520958] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-18T18:12:02.915270] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-09-18T18:12:02.915373] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-09-18T18:12:02.916009] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-09-18T18:12:02.916085] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-09-18T18:12:02.918065] [DEBUG] [LOCAL ] CNNE: Trimmed 48860 records to 37218 (keeping 200 days of data) [2025-09-18T18:12:02.919583] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-18T18:12:03.154482] [DEBUG] [LOCAL ] CNNE: Primary data saved (37218 records). [2025-09-18T18:12:03.154669] [INFO ] [MAIN ] CNNE: Full history saved. [2025-09-18T18:12:03.154782] [INFO ] [MAIN ] Update Progress: 496/2372 symbols completed. CNNE took 35.4s. Estimated remaining: 4h 32m 18s. Rate: 6.9 symbols/min [2025-09-18T18:12:03.332737] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:12:03.332937] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-09-18T18:12:03.332977] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-09-18T18:12:03.333125] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-18T18:12:03.333193] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-18T18:12:03.333264] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-18T18:12:03.333300] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-18T18:12:03.706312] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:12:03.719519] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-11. [2025-09-18T18:12:04.013853] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:12:04.014219] [WARN ] [REMOTE ] CNR: No data returned for month 2024-11 [2025-09-18T18:12:04.125496] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (2.81 seconds). [2025-09-18T18:12:04.519605] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-09-18T18:12:04.797736] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-09-18T18:12:04.921189] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-18T18:12:05.127519] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:12:05.127910] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-09-18T18:12:05.319539] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-18T18:12:06.119563] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-18T18:12:06.919533] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-09-18T18:12:07.420464] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-18T18:12:07.665787] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-18T18:12:07.719528] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-18T18:12:07.874073] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T18:12:08.519555] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-09-18T18:12:09.267297] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-18T18:12:09.319549] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-18T18:12:10.094428] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-18T18:12:10.119501] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-09-18T18:12:10.833606] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-18T18:12:10.919587] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-18T18:12:11.481073] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T18:12:11.719514] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-09-18T18:12:12.387701] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-18T18:12:12.519570] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-18T18:12:13.319563] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-18T18:12:14.119626] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-18T18:12:14.433922] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-18T18:12:14.919595] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-09-18T18:12:15.356515] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-09-18T18:12:15.719599] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-18T18:12:15.977806] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-09-18T18:12:16.393889] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-18T18:12:16.519494] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-18T18:12:16.758044] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-18T18:12:17.132470] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-18T18:12:17.319560] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-18T18:12:18.008424] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T18:12:18.015982] [INFO ] [REMOTE ] CNO: Full fetch complete (60387 records). [2025-09-18T18:12:18.016138] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-18T18:12:18.124612] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-09-18T18:12:18.405507] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-09-18T18:12:18.405592] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-09-18T18:12:18.406308] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-09-18T18:12:18.406375] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-09-18T18:12:18.407602] [DEBUG] [LOCAL ] CNO: Trimmed 60387 records to 41931 (keeping 200 days of data) [2025-09-18T18:12:18.663844] [DEBUG] [LOCAL ] CNO: Primary data saved (41931 records). [2025-09-18T18:12:18.663981] [INFO ] [MAIN ] CNO: Full history saved. [2025-09-18T18:12:18.664056] [INFO ] [MAIN ] Update Progress: 497/2372 symbols completed. CNO took 42.8s. Estimated remaining: 4h 32m 35s. Rate: 6.9 symbols/min [2025-09-18T18:12:18.836949] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:12:18.857715] [DEBUG] [LOCAL ] CNS: Loaded 21185 existing records from primary storage. [2025-09-18T18:12:18.857860] [INFO ] [MAIN ] CNS: Loaded 21185 existing records. [2025-09-18T18:12:18.928513] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-18T18:12:19.043701] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:12:19.044419] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-18T18:12:19.044503] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-18T18:12:19.045290] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-09-18T18:12:19.045354] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-18T18:12:19.405850] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:12:19.437402] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-18T18:12:19.689789] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-18T18:12:19.719506] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-09-18T18:12:20.519532] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-18T18:12:20.565392] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-18T18:12:20.965525] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T18:12:21.319587] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-09-18T18:12:22.079935] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-18T18:12:22.119567] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-11. [2025-09-18T18:12:22.927930] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-18T18:12:22.933152] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-18T18:12:22.989158] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-18T18:12:23.719565] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-09-18T18:12:24.519577] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-18T18:12:24.603972] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T18:12:24.658935] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-18T18:12:24.665858] [INFO ] [REMOTE ] CNQ: Full fetch complete (76992 records). [2025-09-18T18:12:24.665979] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-18T18:12:24.667466] [FATAL] [VALIDATOR ] CNQ: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:12:24.667558] [FATAL] [MAIN ] CNQ: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:12:24.667601] [WARN ] [MAIN ] CNQ: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:12:24.667663] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-18T18:12:24.667750] [DEBUG] [LOCAL ] CNQ: No primary data file found to delete. [2025-09-18T18:12:24.667829] [INFO ] [LOCAL ] CNQ: Starting deletion of derivative data. [2025-09-18T18:12:24.668291] [DEBUG] [LOCAL ] CNQ: Deleted derivative data file. [2025-09-18T18:12:24.668401] [INFO ] [MAIN ] Update Progress: 498/2372 symbols completed. CNQ took 33.2s. Estimated remaining: 4h 32m 16s. Rate: 6.9 symbols/min [2025-09-18T18:12:24.836511] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:12:24.887046] [DEBUG] [LOCAL ] CNX: Loaded 51373 existing records from primary storage. [2025-09-18T18:12:24.887199] [INFO ] [MAIN ] CNX: Loaded 51373 existing records. [2025-09-18T18:12:25.063803] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:12:25.064070] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-18T18:12:25.064118] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-18T18:12:25.065424] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-18T18:12:25.065484] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-18T18:12:25.324703] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-09-18T18:12:25.435703] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:12:26.119546] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-11. [2025-09-18T18:12:26.374083] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-18T18:12:26.790572] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-18T18:12:26.796580] [INFO ] [REMOTE ] CNR: Full fetch complete (54972 records). [2025-09-18T18:12:26.796733] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-09-18T18:12:26.924686] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-09-18T18:12:26.990616] [WARN ] [VALIDATOR ] CNR: Validation failed - insufficient historical data. Have 170 unique days, need 200 days [2025-09-18T18:12:26.991225] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:12:26.991297] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:12:26.991370] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-18T18:12:26.991436] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-18T18:12:26.991518] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-09-18T18:12:26.991582] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-09-18T18:12:26.991676] [INFO ] [MAIN ] Update Progress: 499/2372 symbols completed. CNR took 23.8s. Estimated remaining: 4h 31m 44s. Rate: 6.9 symbols/min [2025-09-18T18:12:27.167579] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:12:27.206139] [DEBUG] [LOCAL ] CODI: Loaded 39600 existing records from primary storage. [2025-09-18T18:12:27.206316] [INFO ] [MAIN ] CODI: Loaded 39600 existing records. [2025-09-18T18:12:27.385237] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:12:27.385491] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-18T18:12:27.385540] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-18T18:12:27.386443] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-09-18T18:12:27.386511] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-18T18:12:27.723017] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-18T18:12:27.745563] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:12:27.775828] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-18T18:12:27.873574] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T18:12:28.519543] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-18T18:12:29.273541] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-18T18:12:29.319538] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-09-18T18:12:29.346119] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-18T18:12:30.119544] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-18T18:12:30.919540] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-11. [2025-09-18T18:12:31.031297] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-18T18:12:31.067458] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-18T18:12:31.719584] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-18T18:12:31.966296] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-18T18:12:32.519594] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-18T18:12:33.319541] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-09-18T18:12:33.419413] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-18T18:12:33.427616] [INFO ] [REMOTE ] CNP: Full fetch complete (77188 records). [2025-09-18T18:12:33.427930] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-18T18:12:33.553089] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-18T18:12:33.884134] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-09-18T18:12:33.884231] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-09-18T18:12:33.885067] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-09-18T18:12:33.885134] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-09-18T18:12:33.889426] [DEBUG] [LOCAL ] CNP: Trimmed 77188 records to 53859 (keeping 200 days of data) [2025-09-18T18:12:34.120540] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-18T18:12:34.236114] [DEBUG] [LOCAL ] CNP: Primary data saved (53859 records). [2025-09-18T18:12:34.236258] [INFO ] [MAIN ] CNP: Full history saved. [2025-09-18T18:12:34.236336] [INFO ] [MAIN ] Update Progress: 500/2372 symbols completed. CNP took 43.2s. Estimated remaining: 4h 31m 29s. Rate: 6.9 symbols/min [2025-09-18T18:12:34.406268] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:12:34.463050] [DEBUG] [LOCAL ] COF: Loaded 53610 existing records from primary storage. [2025-09-18T18:12:34.463331] [INFO ] [MAIN ] COF: Loaded 53610 existing records. [2025-09-18T18:12:34.613352] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-18T18:12:34.691472] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:12:34.691876] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-18T18:12:34.691953] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-18T18:12:34.693309] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-09-18T18:12:34.693387] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-18T18:12:34.924739] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-09-18T18:12:35.076167] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:12:35.089080] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-18T18:12:35.719546] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-11. [2025-09-18T18:12:36.373079] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-18T18:12:36.519552] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-18T18:12:37.319540] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-09-18T18:12:37.751552] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-11 (2.03 seconds). [2025-09-18T18:12:38.098908] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-18T18:12:38.120223] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-18T18:12:38.123711] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-18T18:12:38.897463] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-18T18:12:38.919498] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-18T18:12:39.719541] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-09-18T18:12:40.004207] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-18T18:12:40.519556] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-18T18:12:41.319523] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-18T18:12:41.365345] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-18T18:12:41.784906] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-18T18:12:42.105152] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-18T18:12:42.119496] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-18T18:12:42.919582] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-09-18T18:12:43.478589] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T18:12:43.719533] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-18T18:12:44.511272] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-18T18:12:44.526695] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-18T18:12:45.319608] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-18T18:12:45.595558] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-18T18:12:45.624961] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-18T18:12:46.119556] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-18T18:12:46.504815] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-18T18:12:46.919558] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-18T18:12:47.635745] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-18T18:12:47.719525] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-18T18:12:48.519603] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-18T18:12:48.667330] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-18T18:12:49.257764] [DEBUG] [REMOTE ] COF: Error fetching primary data for 2025-03: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-18T18:12:49.257945] [WARN ] [REMOTE ] COF: No data returned for month 2025-03 [2025-09-18T18:12:49.319547] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-18T18:12:49.390141] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-18T18:12:49.393823] [INFO ] [REMOTE ] CNS: Full fetch complete (29694 records). [2025-09-18T18:12:49.393910] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-18T18:12:49.768367] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-09-18T18:12:49.768452] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-09-18T18:12:49.768894] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-09-18T18:12:49.768957] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-09-18T18:12:49.770896] [DEBUG] [LOCAL ] CNS: Trimmed 29694 records to 21340 (keeping 200 days of data) [2025-09-18T18:12:49.925617] [DEBUG] [LOCAL ] CNS: Primary data saved (21340 records). [2025-09-18T18:12:49.925998] [INFO ] [MAIN ] CNS: Full history saved. [2025-09-18T18:12:49.926450] [INFO ] [MAIN ] Update Progress: 501/2372 symbols completed. CNS took 31.3s. Estimated remaining: 4h 31m 47s. Rate: 6.9 symbols/min [2025-09-18T18:12:50.105485] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:12:50.119586] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-18T18:12:50.172358] [DEBUG] [LOCAL ] COHR: Loaded 53373 existing records from primary storage. [2025-09-18T18:12:50.172536] [INFO ] [MAIN ] COHR: Loaded 53373 existing records. [2025-09-18T18:12:50.352458] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:12:50.352778] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-18T18:12:50.352846] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-18T18:12:50.354152] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-18T18:12:50.354215] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-18T18:12:50.718245] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:12:50.919576] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-11. [2025-09-18T18:12:51.165506] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-18T18:12:51.719613] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-18T18:12:51.945855] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-18T18:12:52.435047] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-18T18:12:52.519585] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-09-18T18:12:53.319581] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-18T18:12:53.488485] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-18T18:12:54.079367] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-18T18:12:54.119533] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-09-18T18:12:54.621975] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T18:12:54.919550] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-18T18:12:55.719619] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-18T18:12:56.160518] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-18T18:12:56.255916] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T18:12:56.519556] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-18T18:12:57.319574] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-18T18:12:57.488512] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-18T18:12:57.920554] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-18T18:12:58.119548] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-18T18:12:58.915629] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-18T18:12:58.919784] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-18T18:12:59.360013] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T18:12:59.719589] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-18T18:13:00.519562] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-18T18:13:01.157921] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-18T18:13:01.183358] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T18:13:01.190301] [INFO ] [REMOTE ] CODI: Full fetch complete (49820 records). [2025-09-18T18:13:01.190407] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-18T18:13:01.324626] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-18T18:13:01.592432] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-09-18T18:13:01.592516] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-09-18T18:13:01.593238] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-09-18T18:13:01.593305] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-09-18T18:13:01.596025] [DEBUG] [LOCAL ] CODI: Trimmed 49820 records to 39862 (keeping 200 days of data) [2025-09-18T18:13:01.852317] [DEBUG] [LOCAL ] CODI: Primary data saved (39862 records). [2025-09-18T18:13:01.852479] [INFO ] [MAIN ] CODI: Full history saved. [2025-09-18T18:13:01.852590] [INFO ] [MAIN ] Update Progress: 502/2372 symbols completed. CODI took 34.9s. Estimated remaining: 4h 31m 50s. Rate: 6.9 symbols/min [2025-09-18T18:13:02.040386] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:13:02.095064] [DEBUG] [LOCAL ] COLD: Loaded 51890 existing records from primary storage. [2025-09-18T18:13:02.095220] [INFO ] [MAIN ] COLD: Loaded 51890 existing records. [2025-09-18T18:13:02.127347] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-18T18:13:02.285216] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:13:02.285769] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-18T18:13:02.285854] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-18T18:13:02.287247] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-09-18T18:13:02.287327] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-18T18:13:02.497189] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-18T18:13:02.724748] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:13:02.919543] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-18T18:13:03.197302] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-18T18:13:03.719498] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-18T18:13:03.934709] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-18T18:13:04.519558] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-18T18:13:04.870087] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-18T18:13:05.097437] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-18T18:13:05.104608] [INFO ] [REMOTE ] CNX: Full fetch complete (74553 records). [2025-09-18T18:13:05.104812] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-18T18:13:05.324683] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-11. [2025-09-18T18:13:05.512877] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-09-18T18:13:05.512972] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-09-18T18:13:05.513790] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-09-18T18:13:05.513859] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-09-18T18:13:05.515443] [DEBUG] [LOCAL ] CNX: Trimmed 74553 records to 51751 (keeping 200 days of data) [2025-09-18T18:13:05.828179] [DEBUG] [LOCAL ] CNX: Primary data saved (51751 records). [2025-09-18T18:13:05.828604] [INFO ] [MAIN ] CNX: Full history saved. [2025-09-18T18:13:05.828729] [INFO ] [MAIN ] Update Progress: 503/2372 symbols completed. CNX took 41.2s. Estimated remaining: 4h 31m 24s. Rate: 6.9 symbols/min [2025-09-18T18:13:06.001461] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:13:06.057272] [DEBUG] [LOCAL ] COMP: Loaded 53381 existing records from primary storage. [2025-09-18T18:13:06.057427] [INFO ] [MAIN ] COMP: Loaded 53381 existing records. [2025-09-18T18:13:06.126406] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-18T18:13:06.247270] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-18T18:13:06.285744] [INFO ] [REMOTE ] COF: Full fetch complete (69042 records). [2025-09-18T18:13:06.289705] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-18T18:13:06.289553] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:13:06.290300] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-18T18:13:06.290362] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-18T18:13:06.305520] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-09-18T18:13:06.348719] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-18T18:13:06.688066] [WARN ] [VALIDATOR ] COF: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-18T18:13:06.741088] [FATAL] [MAIN ] COF: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:13:06.762554] [WARN ] [MAIN ] COF: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:13:06.768310] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-18T18:13:06.779591] [DEBUG] [LOCAL ] COF: No primary data file found to delete. [2025-09-18T18:13:06.801235] [INFO ] [LOCAL ] COF: Starting deletion of derivative data. [2025-09-18T18:13:06.817523] [DEBUG] [LOCAL ] COF: Deleted derivative data file. [2025-09-18T18:13:06.827996] [INFO ] [MAIN ] Update Progress: 504/2372 symbols completed. COF took 32.6s. Estimated remaining: 4h 30m 46s. Rate: 6.9 symbols/min [2025-09-18T18:13:06.905763] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:13:06.934747] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-11. [2025-09-18T18:13:07.088521] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:13:07.118954] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-18T18:13:07.171702] [DEBUG] [LOCAL ] CON: Loaded 38889 existing records from primary storage. [2025-09-18T18:13:07.171862] [INFO ] [MAIN ] CON: Loaded 38889 existing records. [2025-09-18T18:13:07.355519] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:13:07.355803] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-18T18:13:07.355857] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-18T18:13:07.356866] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-09-18T18:13:07.356932] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-18T18:13:07.720980] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:13:07.721096] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-09-18T18:13:08.047849] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-18T18:13:08.287397] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-18T18:13:08.519561] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-18T18:13:09.081322] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T18:13:09.319566] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-09-18T18:13:10.119551] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-11. [2025-09-18T18:13:10.658340] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-18T18:13:10.919614] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-18T18:13:11.167035] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-18T18:13:11.393152] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T18:13:11.719729] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-09-18T18:13:12.519588] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-09-18T18:13:12.767224] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-18T18:13:12.957587] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-18T18:13:13.319569] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-18T18:13:13.729375] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-18T18:13:14.119592] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-09-18T18:13:14.919560] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-18T18:13:15.362760] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-18T18:13:15.431766] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-18T18:13:15.719617] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-09-18T18:13:16.149002] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-18T18:13:16.519606] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-18T18:13:17.319561] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-18T18:13:17.484610] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-18T18:13:17.626035] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-18T18:13:18.119600] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-18T18:13:18.776296] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T18:13:18.919498] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-18T18:13:19.577557] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T18:13:19.719584] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-18T18:13:20.212048] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-18T18:13:20.519550] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-18T18:13:21.319588] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-18T18:13:21.672293] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-18T18:13:22.119524] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-18T18:13:22.169179] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-18T18:13:22.610888] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-18T18:13:22.919583] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-18T18:13:23.687820] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-18T18:13:23.719619] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-18T18:13:24.365736] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T18:13:24.519569] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-18T18:13:25.319589] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-18T18:13:25.772601] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-18T18:13:25.829296] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-18T18:13:25.839377] [INFO ] [REMOTE ] COHR: Full fetch complete (76936 records). [2025-09-18T18:13:25.839512] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-18T18:13:26.124821] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-18T18:13:26.237483] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-18T18:13:26.237563] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-18T18:13:26.238406] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-18T18:13:26.238485] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-18T18:13:26.240132] [DEBUG] [LOCAL ] COHR: Trimmed 76936 records to 53762 (keeping 200 days of data) [2025-09-18T18:13:26.553214] [DEBUG] [LOCAL ] COHR: Primary data saved (53762 records). [2025-09-18T18:13:26.553354] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-18T18:13:26.554179] [INFO ] [MAIN ] Update Progress: 505/2372 symbols completed. COHR took 36.6s. Estimated remaining: 4h 31m 19s. Rate: 6.9 symbols/min [2025-09-18T18:13:26.724956] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:13:26.750688] [DEBUG] [LOCAL ] COOK: Loaded 24122 existing records from primary storage. [2025-09-18T18:13:26.750829] [INFO ] [MAIN ] COOK: Loaded 24122 existing records. [2025-09-18T18:13:26.934331] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:13:26.934756] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-18T18:13:26.934831] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-18T18:13:26.928716] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-18T18:13:26.936230] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-18T18:13:26.936396] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-18T18:13:27.333935] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-18T18:13:27.339761] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:13:27.546827] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-18T18:13:27.719550] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-11. [2025-09-18T18:13:28.202965] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-18T18:13:28.517535] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-18T18:13:28.522030] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-09-18T18:13:29.319572] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-18T18:13:29.435727] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-18T18:13:30.119555] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-09-18T18:13:30.714187] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T18:13:30.919553] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-18T18:13:31.139875] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-18T18:13:31.719574] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-18T18:13:32.383712] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T18:13:32.390215] [INFO ] [REMOTE ] CON: Full fetch complete (57267 records). [2025-09-18T18:13:32.390358] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-18T18:13:32.529417] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-18T18:13:32.782971] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-09-18T18:13:32.783104] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-09-18T18:13:32.783905] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-09-18T18:13:32.783976] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-09-18T18:13:32.785495] [DEBUG] [LOCAL ] CON: Trimmed 57267 records to 39213 (keeping 200 days of data) [2025-09-18T18:13:33.026666] [DEBUG] [LOCAL ] CON: Primary data saved (39213 records). [2025-09-18T18:13:33.026823] [INFO ] [MAIN ] CON: Full history saved. [2025-09-18T18:13:33.026912] [INFO ] [MAIN ] Update Progress: 506/2372 symbols completed. CON took 26.2s. Estimated remaining: 4h 31m 2s. Rate: 6.9 symbols/min [2025-09-18T18:13:33.199442] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:13:33.254053] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-09-18T18:13:33.254228] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-09-18T18:13:33.320566] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-18T18:13:33.447441] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:13:33.447852] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-18T18:13:33.447933] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-18T18:13:33.449311] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-18T18:13:33.449386] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-18T18:13:33.597000] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-18T18:13:33.870296] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:13:34.119557] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-18T18:13:34.205619] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-18T18:13:34.233512] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-18T18:13:34.919592] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-18T18:13:35.581604] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-18T18:13:35.719566] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-18T18:13:36.040282] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-18T18:13:36.519561] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-18T18:13:37.319529] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-18T18:13:37.539675] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-18T18:13:37.548443] [INFO ] [REMOTE ] COLD: Full fetch complete (73864 records). [2025-09-18T18:13:37.548584] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-18T18:13:37.834892] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-18T18:13:37.964764] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-09-18T18:13:37.964846] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-09-18T18:13:37.965589] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-09-18T18:13:37.965634] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-09-18T18:13:37.967125] [DEBUG] [LOCAL ] COLD: Trimmed 73864 records to 52280 (keeping 200 days of data) [2025-09-18T18:13:38.139367] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-18T18:13:38.280560] [DEBUG] [LOCAL ] COLD: Primary data saved (52280 records). [2025-09-18T18:13:38.280727] [INFO ] [MAIN ] COLD: Full history saved. [2025-09-18T18:13:38.280823] [INFO ] [MAIN ] Update Progress: 507/2372 symbols completed. COLD took 36.4s. Estimated remaining: 4h 30m 40s. Rate: 6.9 symbols/min [2025-09-18T18:13:38.508759] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:13:38.563902] [DEBUG] [LOCAL ] COR: Loaded 47343 existing records from primary storage. [2025-09-18T18:13:38.564104] [INFO ] [MAIN ] COR: Loaded 47343 existing records. [2025-09-18T18:13:38.800043] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:13:38.800387] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-18T18:13:38.800446] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-18T18:13:38.801836] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-09-18T18:13:38.801919] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-18T18:13:38.924762] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-11. [2025-09-18T18:13:39.186431] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:13:39.250030] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-18T18:13:39.365604] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-18T18:13:39.719606] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-18T18:13:40.519538] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-11. [2025-09-18T18:13:40.917131] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-18T18:13:41.319589] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-18T18:13:41.505292] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-18T18:13:41.976011] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-18T18:13:42.119584] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-09-18T18:13:42.305793] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-18T18:13:42.919566] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-18T18:13:43.599890] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-18T18:13:43.719569] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-18T18:13:44.022772] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-18T18:13:44.519588] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-09-18T18:13:45.319546] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-09-18T18:13:45.392812] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-18T18:13:46.119602] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-18T18:13:46.178937] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-18T18:13:46.919557] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-18T18:13:47.040429] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-18T18:13:47.305980] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-18T18:13:47.719557] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-09-18T18:13:48.350735] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-18T18:13:48.519589] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-18T18:13:49.319534] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-18T18:13:49.502023] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-18T18:13:50.119726] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-18T18:13:50.223236] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-18T18:13:50.230918] [INFO ] [REMOTE ] COMP: Full fetch complete (76886 records). [2025-09-18T18:13:50.231098] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-18T18:13:50.592721] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-18T18:13:50.637914] [INFO ] [REMOTE ] COOK: Full fetch complete (32762 records). [2025-09-18T18:13:50.656899] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-18T18:13:50.657110] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-09-18T18:13:50.657352] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-09-18T18:13:50.658257] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-09-18T18:13:50.690601] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-09-18T18:13:50.767691] [DEBUG] [LOCAL ] COMP: Trimmed 76886 records to 53771 (keeping 200 days of data) [2025-09-18T18:13:50.945137] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-18T18:13:51.275711] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-18T18:13:51.276674] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-18T18:13:51.277571] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-18T18:13:51.277720] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-18T18:13:51.313295] [DEBUG] [LOCAL ] COOK: Trimmed 32762 records to 24332 (keeping 200 days of data) [2025-09-18T18:13:51.451321] [DEBUG] [LOCAL ] COMP: Primary data saved (53771 records). [2025-09-18T18:13:51.453408] [INFO ] [MAIN ] COMP: Full history saved. [2025-09-18T18:13:51.453882] [INFO ] [MAIN ] Update Progress: 508/2372 symbols completed. COMP took 45.6s. Estimated remaining: 4h 30m 48s. Rate: 6.9 symbols/min [2025-09-18T18:13:51.662439] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:13:51.693636] [DEBUG] [LOCAL ] COOK: Primary data saved (24332 records). [2025-09-18T18:13:51.693836] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-18T18:13:51.693963] [INFO ] [MAIN ] Update Progress: 509/2372 symbols completed. COOK took 25.1s. Estimated remaining: 4h 30m 8s. Rate: 6.9 symbols/min [2025-09-18T18:13:51.943031] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:13:51.961016] [DEBUG] [LOCAL ] COTY: Loaded 53266 existing records from primary storage. [2025-09-18T18:13:51.961264] [INFO ] [MAIN ] COTY: Loaded 53266 existing records. [2025-09-18T18:13:52.164845] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:13:52.165300] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-18T18:13:52.165353] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-18T18:13:52.167072] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-09-18T18:13:52.167148] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-18T18:13:52.366028] [DEBUG] [LOCAL ] COUR: Loaded 48861 existing records from primary storage. [2025-09-18T18:13:52.380457] [INFO ] [MAIN ] COUR: Loaded 48861 existing records. [2025-09-18T18:13:52.403147] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-18T18:13:52.572231] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-18T18:13:52.811227] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:13:52.828319] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-11. [2025-09-18T18:13:52.836310] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:13:52.836900] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-18T18:13:52.837253] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-18T18:13:52.839020] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-09-18T18:13:52.839112] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-18T18:13:53.128443] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-18T18:13:53.270480] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:13:53.319543] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-11. [2025-09-18T18:13:54.119554] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-18T18:13:54.438819] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-18T18:13:54.709532] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-18T18:13:54.814955] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-18T18:13:54.919522] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-09-18T18:13:55.542014] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-18T18:13:55.719545] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-18T18:13:56.519635] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-18T18:13:56.722228] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-18T18:13:57.319575] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-09-18T18:13:57.656899] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-18T18:13:58.119600] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-18T18:13:58.263211] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-18T18:13:58.709158] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T18:13:58.919601] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-09-18T18:13:59.719568] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-18T18:13:59.985518] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-18T18:14:00.519554] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-09-18T18:14:00.751536] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-18T18:14:01.051459] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T18:14:01.319542] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-18T18:14:01.953455] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T18:14:02.119595] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-18T18:14:02.764803] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T18:14:02.919595] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-18T18:14:03.411550] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-18T18:14:03.719565] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-18T18:14:04.519556] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-18T18:14:04.795013] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-18T18:14:05.319699] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-18T18:14:05.524069] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-18T18:14:06.119597] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-18T18:14:06.279950] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-18T18:14:06.919593] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-18T18:14:07.339022] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-18T18:14:07.656238] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T18:14:07.719549] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-18T18:14:08.498560] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T18:14:08.519501] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-18T18:14:09.255988] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-18T18:14:09.319528] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-18T18:14:09.968245] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T18:14:10.119572] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-18T18:14:10.650527] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-18T18:14:10.919575] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-18T18:14:11.719560] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-18T18:14:11.867726] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-18T18:14:12.519543] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-18T18:14:12.788270] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-18T18:14:13.270250] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-18T18:14:13.279378] [INFO ] [REMOTE ] COR: Full fetch complete (68715 records). [2025-09-18T18:14:13.279528] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-18T18:14:13.328637] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-18T18:14:13.690995] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-09-18T18:14:13.691076] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-09-18T18:14:13.691805] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-09-18T18:14:13.691867] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-09-18T18:14:13.693182] [DEBUG] [LOCAL ] COR: Trimmed 68715 records to 47685 (keeping 200 days of data) [2025-09-18T18:14:13.996667] [DEBUG] [LOCAL ] COR: Primary data saved (47685 records). [2025-09-18T18:14:13.996891] [INFO ] [MAIN ] COR: Full history saved. [2025-09-18T18:14:13.997007] [INFO ] [MAIN ] Update Progress: 510/2372 symbols completed. COR took 35.7s. Estimated remaining: 4h 30m 49s. Rate: 6.9 symbols/min [2025-09-18T18:14:14.124752] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-18T18:14:14.173079] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:14:14.225429] [DEBUG] [LOCAL ] CP: Loaded 53294 existing records from primary storage. [2025-09-18T18:14:14.225583] [INFO ] [MAIN ] CP: Loaded 53294 existing records. [2025-09-18T18:14:14.409901] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:14:14.410437] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-18T18:14:14.410711] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-18T18:14:14.418399] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-18T18:14:14.431688] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-18T18:14:14.430701] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-18T18:14:14.482823] [INFO ] [REMOTE ] COP: Full fetch complete (77626 records). [2025-09-18T18:14:14.509243] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-18T18:14:15.197711] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:14:15.254434] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-11. [2025-09-18T18:14:15.254747] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-09-18T18:14:15.266453] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-09-18T18:14:15.267458] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-09-18T18:14:15.267840] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-09-18T18:14:15.270840] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-18T18:14:15.281394] [DEBUG] [LOCAL ] COP: Trimmed 77626 records to 54117 (keeping 200 days of data) [2025-09-18T18:14:15.622283] [DEBUG] [LOCAL ] COP: Primary data saved (54117 records). [2025-09-18T18:14:15.622420] [INFO ] [MAIN ] COP: Full history saved. [2025-09-18T18:14:15.622506] [INFO ] [MAIN ] Update Progress: 511/2372 symbols completed. COP took 42.6s. Estimated remaining: 4h 30m 14s. Rate: 6.9 symbols/min [2025-09-18T18:14:15.725205] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-18T18:14:15.816551] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:14:15.849887] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-18T18:14:15.889454] [DEBUG] [LOCAL ] CPA: Loaded 29179 existing records from primary storage. [2025-09-18T18:14:15.889600] [INFO ] [MAIN ] CPA: Loaded 29179 existing records. [2025-09-18T18:14:16.068083] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:14:16.068335] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-18T18:14:16.068402] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-18T18:14:16.069223] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-09-18T18:14:16.069284] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-18T18:14:16.428628] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:14:16.519498] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-11. [2025-09-18T18:14:17.050628] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-18T18:14:17.319549] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-09-18T18:14:17.653559] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-18T18:14:17.711184] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-18T18:14:18.119555] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-18T18:14:18.897192] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-18T18:14:18.919491] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-09-18T18:14:19.719555] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-18T18:14:19.859330] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-18T18:14:20.528594] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-09-18T18:14:20.530819] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T18:14:21.177728] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T18:14:21.319543] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-18T18:14:21.650030] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-18T18:14:22.119559] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-18T18:14:22.919623] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-09-18T18:14:23.200060] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-18T18:14:23.536547] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T18:14:23.719547] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-18T18:14:24.015916] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-18T18:14:24.519607] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-18T18:14:25.212350] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T18:14:25.319496] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-18T18:14:26.119584] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-18T18:14:26.666976] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-18T18:14:26.674878] [INFO ] [REMOTE ] COUR: Full fetch complete (70761 records). [2025-09-18T18:14:26.675107] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-18T18:14:26.924749] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-18T18:14:27.101147] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-09-18T18:14:27.101311] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-09-18T18:14:27.102145] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-09-18T18:14:27.102418] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-09-18T18:14:27.121694] [DEBUG] [LOCAL ] COUR: Trimmed 70761 records to 49223 (keeping 200 days of data) [2025-09-18T18:14:27.122302] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-18T18:14:27.130110] [INFO ] [REMOTE ] COTY: Full fetch complete (76563 records). [2025-09-18T18:14:27.130278] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-18T18:14:27.131117] [FATAL] [VALIDATOR ] COTY: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:14:27.131214] [FATAL] [MAIN ] COTY: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:14:27.131261] [WARN ] [MAIN ] COTY: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:14:27.131300] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-18T18:14:27.131361] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-09-18T18:14:27.131408] [INFO ] [LOCAL ] COTY: Starting deletion of derivative data. [2025-09-18T18:14:27.132124] [DEBUG] [LOCAL ] COTY: Deleted derivative data file. [2025-09-18T18:14:27.132246] [INFO ] [MAIN ] Update Progress: 512/2372 symbols completed. COTY took 35.7s. Estimated remaining: 4h 30m 16s. Rate: 6.9 symbols/min [2025-09-18T18:14:27.413858] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:14:27.431557] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-18T18:14:27.431718] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-18T18:14:27.431942] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-18T18:14:27.432000] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-18T18:14:27.432044] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-18T18:14:27.432078] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-18T18:14:27.847438] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-18T18:14:27.885337] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-18T18:14:27.958743] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:14:28.016125] [DEBUG] [LOCAL ] COUR: Primary data saved (49223 records). [2025-09-18T18:14:28.016309] [INFO ] [MAIN ] COUR: Full history saved. [2025-09-18T18:14:28.017829] [INFO ] [MAIN ] Update Progress: 513/2372 symbols completed. COUR took 36.3s. Estimated remaining: 4h 29m 39s. Rate: 6.9 symbols/min [2025-09-18T18:14:28.192579] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:14:28.228118] [DEBUG] [LOCAL ] CPAY: Loaded 31370 existing records from primary storage. [2025-09-18T18:14:28.228276] [INFO ] [MAIN ] CPAY: Loaded 31370 existing records. [2025-09-18T18:14:28.409962] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:14:28.410203] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-18T18:14:28.410251] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-18T18:14:28.411134] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-09-18T18:14:28.411194] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-18T18:14:28.524629] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-11. [2025-09-18T18:14:28.774256] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:14:29.055432] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-18T18:14:29.095250] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-18T18:14:29.148980] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-18T18:14:29.319531] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-18T18:14:30.119543] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-11. [2025-09-18T18:14:30.919596] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-09-18T18:14:31.100295] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-18T18:14:31.169063] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-18T18:14:31.278066] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-18T18:14:31.719547] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-09-18T18:14:32.519542] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-18T18:14:32.912916] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-18T18:14:33.319543] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-09-18T18:14:33.887321] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-18T18:14:33.905250] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T18:14:34.119580] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-18T18:14:34.468802] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-18T18:14:34.919599] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-18T18:14:35.719547] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-09-18T18:14:36.519534] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-18T18:14:36.597574] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-18T18:14:36.667205] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T18:14:37.319557] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-18T18:14:37.595219] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-18T18:14:38.119631] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-18T18:14:38.437054] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-18T18:14:38.928269] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-18T18:14:38.947938] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-18T18:14:39.525528] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-18T18:14:39.719561] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-18T18:14:40.519555] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-18T18:14:40.836366] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-18T18:14:40.919957] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-18T18:14:41.319576] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-18T18:14:42.119579] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-18T18:14:42.389529] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-18T18:14:42.432724] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-18T18:14:42.919548] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-18T18:14:43.353612] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-18T18:14:43.719578] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-18T18:14:44.519572] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-18T18:14:45.044352] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-18T18:14:45.319576] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-18T18:14:45.892486] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-18T18:14:46.119553] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-18T18:14:46.390823] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-18T18:14:46.844147] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-18T18:14:46.919556] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-18T18:14:47.719550] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-18T18:14:48.123340] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-18T18:14:48.127467] [INFO ] [REMOTE ] CPA: Full fetch complete (42318 records). [2025-09-18T18:14:48.127594] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-18T18:14:48.509465] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-09-18T18:14:48.509590] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-09-18T18:14:48.510210] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-09-18T18:14:48.510288] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-09-18T18:14:48.514552] [DEBUG] [LOCAL ] CPA: Trimmed 42318 records to 29299 (keeping 200 days of data) [2025-09-18T18:14:48.569457] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-18T18:14:48.706755] [DEBUG] [LOCAL ] CPA: Primary data saved (29299 records). [2025-09-18T18:14:48.706914] [INFO ] [MAIN ] CPA: Full history saved. [2025-09-18T18:14:48.707035] [INFO ] [MAIN ] Update Progress: 514/2372 symbols completed. CPA took 33.1s. Estimated remaining: 4h 30m 13s. Rate: 6.9 symbols/min [2025-09-18T18:14:48.880609] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:14:48.897859] [DEBUG] [LOCAL ] CPF: Loaded 15587 existing records from primary storage. [2025-09-18T18:14:48.897992] [INFO ] [MAIN ] CPF: Loaded 15587 existing records. [2025-09-18T18:14:49.105836] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-18T18:14:49.128832] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:14:49.129845] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-18T18:14:49.129930] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-18T18:14:49.130771] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-09-18T18:14:49.130850] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-18T18:14:49.334437] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-18T18:14:49.531804] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:14:50.119577] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-18T18:14:50.376948] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-18T18:14:50.377948] [INFO ] [REMOTE ] CPAC: Full fetch complete (1903 records). [2025-09-18T18:14:50.378045] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-18T18:14:50.588550] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-18T18:14:50.623706] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-18T18:14:50.623954] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:14:50.624027] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:14:50.624111] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-18T18:14:50.624219] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-18T18:14:50.624279] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-18T18:14:50.624325] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-18T18:14:50.624411] [INFO ] [MAIN ] Update Progress: 515/2372 symbols completed. CPAC took 23.5s. Estimated remaining: 4h 29m 40s. Rate: 6.9 symbols/min [2025-09-18T18:14:50.795943] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:14:50.811665] [DEBUG] [LOCAL ] CPK: Loaded 13134 existing records from primary storage. [2025-09-18T18:14:50.811834] [INFO ] [MAIN ] CPK: Loaded 13134 existing records. [2025-09-18T18:14:50.924630] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-11. [2025-09-18T18:14:50.991465] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:14:50.991782] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-18T18:14:50.991892] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-18T18:14:50.992434] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-18T18:14:50.992494] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-18T18:14:51.401128] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:14:51.442345] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-18T18:14:51.719610] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-11. [2025-09-18T18:14:52.006232] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-18T18:14:52.519583] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-09-18T18:14:52.727360] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T18:14:53.319550] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-09-18T18:14:53.335354] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-18T18:14:54.126149] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-18T18:14:54.130100] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-18T18:14:54.919599] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-09-18T18:14:55.380849] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-18T18:14:55.719521] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-18T18:14:55.911107] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-18T18:14:56.519609] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-09-18T18:14:56.789087] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-18T18:14:57.295096] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-18T18:14:57.319503] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-18T18:14:58.119589] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-18T18:14:58.919568] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-18T18:14:59.015962] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-18T18:14:59.027124] [INFO ] [REMOTE ] CP: Full fetch complete (77007 records). [2025-09-18T18:14:59.027325] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-18T18:14:59.462006] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-18T18:14:59.462288] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-18T18:14:59.468796] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-18T18:14:59.469840] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-18T18:14:59.469934] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-18T18:14:59.471665] [DEBUG] [LOCAL ] CP: Trimmed 77007 records to 53681 (keeping 200 days of data) [2025-09-18T18:14:59.719944] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-18T18:14:59.812396] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-18T18:14:59.836412] [DEBUG] [LOCAL ] CP: Primary data saved (53681 records). [2025-09-18T18:14:59.836603] [INFO ] [MAIN ] CP: Full history saved. [2025-09-18T18:14:59.836922] [INFO ] [MAIN ] Update Progress: 516/2372 symbols completed. CP took 45.8s. Estimated remaining: 4h 29m 33s. Rate: 6.9 symbols/min [2025-09-18T18:15:00.012982] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:15:00.066867] [DEBUG] [LOCAL ] CPNG: Loaded 53671 existing records from primary storage. [2025-09-18T18:15:00.067036] [INFO ] [MAIN ] CPNG: Loaded 53671 existing records. [2025-09-18T18:15:00.246387] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:15:00.246730] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-18T18:15:00.246797] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-18T18:15:00.247942] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-09-18T18:15:00.248002] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-18T18:15:00.529596] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-18T18:15:00.615736] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:15:01.122579] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-18T18:15:01.319549] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-18T18:15:01.692844] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-18T18:15:02.119585] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-11. [2025-09-18T18:15:02.919553] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-18T18:15:03.500622] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-18T18:15:03.505447] [INFO ] [REMOTE ] CPAY: Full fetch complete (45311 records). [2025-09-18T18:15:03.505535] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-18T18:15:03.729507] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-18T18:15:03.891307] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-09-18T18:15:03.891394] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-09-18T18:15:03.891956] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-09-18T18:15:03.892024] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-09-18T18:15:03.894764] [DEBUG] [LOCAL ] CPAY: Trimmed 45311 records to 31613 (keeping 200 days of data) [2025-09-18T18:15:04.097434] [DEBUG] [LOCAL ] CPAY: Primary data saved (31613 records). [2025-09-18T18:15:04.097572] [INFO ] [MAIN ] CPAY: Full history saved. [2025-09-18T18:15:04.097716] [INFO ] [MAIN ] Update Progress: 517/2372 symbols completed. CPAY took 36.1s. Estimated remaining: 4h 29m 8s. Rate: 6.9 symbols/min [2025-09-18T18:15:04.804107] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-18T18:15:04.807369] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-18T18:15:05.925529] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-11 (3.81 seconds). [2025-09-18T18:15:05.945238] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-09-18T18:15:05.946831] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-18T18:15:06.119552] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-18T18:15:06.224060] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T18:15:06.919522] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-18T18:15:07.206035] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-18T18:15:07.719619] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-18T18:15:07.750310] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-18T18:15:07.859065] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-18T18:15:08.295343] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-18T18:15:08.519594] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-09-18T18:15:09.319624] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-18T18:15:10.111922] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-18T18:15:10.119486] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-18T18:15:10.651538] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-18T18:15:10.831634] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-18T18:15:10.919558] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-18T18:15:11.719576] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-18T18:15:12.519600] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-18T18:15:12.857779] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-18T18:15:13.319567] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-18T18:15:13.773550] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.85 seconds). [2025-09-18T18:15:14.119521] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-18T18:15:14.191752] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-18T18:15:14.301092] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-18T18:15:14.919548] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-18T18:15:15.719573] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-18T18:15:15.830963] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-18T18:15:16.099092] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-18T18:15:16.519514] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-18T18:15:16.827845] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-18T18:15:16.830429] [INFO ] [REMOTE ] CPF: Full fetch complete (24144 records). [2025-09-18T18:15:16.830520] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-18T18:15:16.831166] [FATAL] [VALIDATOR ] CPF: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:15:16.831257] [FATAL] [MAIN ] CPF: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:15:16.831308] [WARN ] [MAIN ] CPF: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:15:16.831377] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-18T18:15:16.831443] [DEBUG] [LOCAL ] CPF: No primary data file found to delete. [2025-09-18T18:15:16.831482] [INFO ] [LOCAL ] CPF: Starting deletion of derivative data. [2025-09-18T18:15:16.832065] [DEBUG] [LOCAL ] CPF: Deleted derivative data file. [2025-09-18T18:15:16.832168] [INFO ] [MAIN ] Update Progress: 518/2372 symbols completed. CPF took 28.1s. Estimated remaining: 4h 29m 14s. Rate: 6.9 symbols/min [2025-09-18T18:15:17.319535] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-18T18:15:18.232972] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-18T18:15:18.235034] [INFO ] [REMOTE ] CPK: Full fetch complete (17463 records). [2025-09-18T18:15:18.235106] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-18T18:15:18.618938] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-09-18T18:15:18.619225] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-09-18T18:15:18.619711] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-09-18T18:15:18.619823] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-09-18T18:15:18.620861] [DEBUG] [LOCAL ] CPK: Trimmed 17463 records to 13277 (keeping 200 days of data) [2025-09-18T18:15:18.747505] [DEBUG] [LOCAL ] CPK: Primary data saved (13277 records). [2025-09-18T18:15:18.749575] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-18T18:15:18.748334] [INFO ] [MAIN ] CPK: Full history saved. [2025-09-18T18:15:18.760720] [INFO ] [MAIN ] Update Progress: 519/2372 symbols completed. CPK took 28.1s. Estimated remaining: 4h 28m 41s. Rate: 6.9 symbols/min [2025-09-18T18:15:18.761316] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-18T18:15:20.813778] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-18T18:15:20.825997] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-18T18:15:22.925168] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-18T18:15:22.936168] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-18T18:15:25.006845] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-18T18:15:25.018960] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-18T18:15:27.631582] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-18T18:15:27.643671] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-18T18:15:29.635315] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-18T18:15:29.644130] [INFO ] [REMOTE ] CPNG: Full fetch complete (77166 records). [2025-09-18T18:15:29.644321] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-18T18:15:29.645692] [FATAL] [VALIDATOR ] CPNG: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:15:29.645859] [FATAL] [MAIN ] CPNG: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:15:29.645919] [WARN ] [MAIN ] CPNG: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:15:29.645966] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-18T18:15:29.646045] [DEBUG] [LOCAL ] CPNG: No primary data file found to delete. [2025-09-18T18:15:29.646113] [INFO ] [LOCAL ] CPNG: Starting deletion of derivative data. [2025-09-18T18:15:29.646631] [DEBUG] [LOCAL ] CPNG: Deleted derivative data file. [2025-09-18T18:15:29.646794] [INFO ] [MAIN ] Update Progress: 520/2372 symbols completed. CPNG took 29.8s. Estimated remaining: 4h 28m 40s. Rate: 6.9 symbols/min [2025-09-18T18:15:30.328564] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:15:30.368630] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:15:30.333154] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:15:30.380892] [DEBUG] [LOCAL ] CPRI: No existing data file found in primary storage. [2025-09-18T18:15:30.386604] [WARN ] [MAIN ] CPRI: No existing data found, performing full refresh instead. [2025-09-18T18:15:30.456962] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-18T18:15:30.456704] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:15:30.457534] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-18T18:15:30.465267] [DEBUG] [LOCAL ] CPRI: No primary data file found to delete. [2025-09-18T18:15:30.465388] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-18T18:15:30.572261] [DEBUG] [LOCAL ] CPS: Loaded 26389 existing records from primary storage. [2025-09-18T18:15:30.615770] [INFO ] [MAIN ] CPS: Loaded 26389 existing records. [2025-09-18T18:15:30.692032] [DEBUG] [LOCAL ] CQP: Loaded 20089 existing records from primary storage. [2025-09-18T18:15:30.744139] [INFO ] [MAIN ] CQP: Loaded 20089 existing records. [2025-09-18T18:15:30.833012] [DEBUG] [LOCAL ] CPT: Loaded 44362 existing records from primary storage. [2025-09-18T18:15:30.929636] [INFO ] [MAIN ] CPT: Loaded 44362 existing records. [2025-09-18T18:15:31.192278] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:15:31.259715] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-18T18:15:31.317527] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-18T18:15:31.402798] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:15:31.514037] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:15:31.513903] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-11. [2025-09-18T18:15:31.514383] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-09-18T18:15:31.531547] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-18T18:15:31.541157] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-18T18:15:31.547093] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-18T18:15:31.562454] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:15:31.587004] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-18T18:15:31.595757] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-18T18:15:31.607042] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-18T18:15:31.649594] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-18T18:15:31.666996] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-09-18T18:15:31.691819] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-18T18:15:32.673123] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:15:32.684075] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-11. [2025-09-18T18:15:32.779701] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:15:32.797807] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-11. [2025-09-18T18:15:32.819185] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:15:32.819599] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-11. [2025-09-18T18:15:33.696920] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-11 (2.18 seconds). [2025-09-18T18:15:33.707177] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-09-18T18:15:33.765564] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-18T18:15:33.770290] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-09-18T18:15:33.870714] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-18T18:15:33.875076] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-09-18T18:15:34.283074] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-18T18:15:34.292180] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-09-18T18:15:34.560007] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-18T18:15:34.565005] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-09-18T18:15:34.647539] [DEBUG] [REMOTE ] CPS: Error fetching primary data for 2024-12: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-18T18:15:34.647766] [WARN ] [REMOTE ] CPS: No data returned for month 2024-12 [2025-09-18T18:15:34.648241] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-09-18T18:15:35.339944] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-18T18:15:35.350989] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-09-18T18:15:35.445819] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-18T18:15:35.454571] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-09-18T18:15:35.525214] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-18T18:15:35.531184] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-18T18:15:35.720750] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-18T18:15:35.726420] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-18T18:15:36.524469] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-18T18:15:36.529958] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-18T18:15:36.656628] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-18T18:15:36.662055] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-18T18:15:36.817433] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-18T18:15:36.827419] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-18T18:15:36.914180] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-18T18:15:36.925070] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-18T18:15:37.364323] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-18T18:15:37.369270] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-18T18:15:37.549543] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-18T18:15:37.556035] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-18T18:15:38.200977] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-18T18:15:38.210318] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-18T18:15:38.222174] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-18T18:15:38.379741] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T18:15:38.919622] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-18T18:15:38.986267] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T18:15:39.551758] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-18T18:15:39.719508] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-18T18:15:39.803962] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-18T18:15:40.519568] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-18T18:15:41.319526] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-18T18:15:41.375998] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T18:15:41.837070] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T18:15:42.119619] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-18T18:15:42.800983] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T18:15:42.919558] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-18T18:15:43.351479] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-18T18:15:43.680901] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-18T18:15:43.719558] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-18T18:15:44.519624] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-18T18:15:44.954345] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-18T18:15:45.319584] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-18T18:15:46.119600] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-18T18:15:46.254212] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-18T18:15:46.657295] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T18:15:46.919582] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-18T18:15:47.085266] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-18T18:15:47.719590] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-18T18:15:48.492451] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-18T18:15:48.519570] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-18T18:15:48.714247] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-18T18:15:49.225909] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-18T18:15:49.229297] [INFO ] [REMOTE ] CQP: Full fetch complete (30939 records). [2025-09-18T18:15:49.229432] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-18T18:15:49.324693] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-18T18:15:49.640185] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-18T18:15:49.640273] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-18T18:15:49.640759] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-18T18:15:49.640837] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-18T18:15:49.641721] [DEBUG] [LOCAL ] CQP: Trimmed 30939 records to 20205 (keeping 200 days of data) [2025-09-18T18:15:49.765627] [DEBUG] [LOCAL ] CQP: Primary data saved (20205 records). [2025-09-18T18:15:49.765782] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-18T18:15:49.765865] [INFO ] [MAIN ] Update Progress: 521/2372 symbols completed. CQP took 20.1s. Estimated remaining: 4h 29m 12s. Rate: 6.9 symbols/min [2025-09-18T18:15:49.936949] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:15:49.963121] [DEBUG] [LOCAL ] CR: Loaded 24730 existing records from primary storage. [2025-09-18T18:15:49.963254] [INFO ] [MAIN ] CR: Loaded 24730 existing records. [2025-09-18T18:15:50.125170] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-18T18:15:50.145804] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:15:50.146618] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-18T18:15:50.146707] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-18T18:15:50.147502] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-09-18T18:15:50.147564] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-18T18:15:50.540382] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:15:50.556302] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-18T18:15:50.919557] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-18T18:15:51.567340] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-18T18:15:51.719579] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-11. [2025-09-18T18:15:51.857012] [DEBUG] [REMOTE ] CR: Error fetching primary data for 2024-11: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [2025-09-18T18:15:51.857179] [WARN ] [REMOTE ] CR: No data returned for month 2024-11 [2025-09-18T18:15:52.519558] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-18T18:15:52.570747] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-18T18:15:53.319544] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-18T18:15:54.035030] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-18T18:15:54.119508] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-09-18T18:15:54.151004] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-18T18:15:54.919544] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-18T18:15:55.085725] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-18T18:15:55.719567] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-09-18T18:15:55.931884] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T18:15:55.935542] [INFO ] [REMOTE ] CPS: Full fetch complete (33407 records). [2025-09-18T18:15:55.935677] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-18T18:15:56.137576] [WARN ] [VALIDATOR ] CPS: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-18T18:15:56.138039] [FATAL] [MAIN ] CPS: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:15:56.138111] [WARN ] [MAIN ] CPS: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:15:56.138185] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-18T18:15:56.138254] [DEBUG] [LOCAL ] CPS: No primary data file found to delete. [2025-09-18T18:15:56.138293] [INFO ] [LOCAL ] CPS: Starting deletion of derivative data. [2025-09-18T18:15:56.138720] [DEBUG] [LOCAL ] CPS: Deleted derivative data file. [2025-09-18T18:15:56.138825] [INFO ] [MAIN ] Update Progress: 522/2372 symbols completed. CPS took 26.5s. Estimated remaining: 4h 28m 55s. Rate: 6.9 symbols/min [2025-09-18T18:15:56.326225] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:15:56.326484] [DEBUG] [LOCAL ] CRBD: No existing data file found in primary storage. [2025-09-18T18:15:56.326543] [WARN ] [MAIN ] CRBD: No existing data found, performing full refresh instead. [2025-09-18T18:15:56.326740] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-18T18:15:56.326797] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-18T18:15:56.326845] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-09-18T18:15:56.326881] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-18T18:15:56.524744] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-18T18:15:56.716749] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:15:56.885079] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T18:15:57.319598] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-11. [2025-09-18T18:15:57.534796] [DEBUG] [REMOTE ] CRBD: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:15:57.535135] [WARN ] [REMOTE ] CRBD: No data returned for month 2024-11 [2025-09-18T18:15:58.004562] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-18T18:15:58.011235] [INFO ] [REMOTE ] CPT: Full fetch complete (63310 records). [2025-09-18T18:15:58.011550] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-18T18:15:58.124662] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-18T18:15:58.408408] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-09-18T18:15:58.408498] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-09-18T18:15:58.409235] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-09-18T18:15:58.409327] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-09-18T18:15:58.411911] [DEBUG] [LOCAL ] CPT: Trimmed 63310 records to 44714 (keeping 200 days of data) [2025-09-18T18:15:58.692718] [DEBUG] [LOCAL ] CPT: Primary data saved (44714 records). [2025-09-18T18:15:58.692869] [INFO ] [MAIN ] CPT: Full history saved. [2025-09-18T18:15:58.692957] [INFO ] [MAIN ] Update Progress: 523/2372 symbols completed. CPT took 29.0s. Estimated remaining: 4h 28m 25s. Rate: 6.9 symbols/min [2025-09-18T18:15:58.876884] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:15:58.927080] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-09-18T18:15:58.930324] [DEBUG] [LOCAL ] CRBG: Loaded 52342 existing records from primary storage. [2025-09-18T18:15:58.930618] [INFO ] [MAIN ] CRBG: Loaded 52342 existing records. [2025-09-18T18:15:59.116428] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:15:59.116750] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-18T18:15:59.116819] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-18T18:15:59.118251] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-09-18T18:15:59.118316] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-18T18:15:59.471635] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T18:15:59.536191] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:15:59.719583] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-18T18:16:00.145788] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-18T18:16:00.519576] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-11. [2025-09-18T18:16:01.319618] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-09-18T18:16:01.684997] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-18T18:16:02.106125] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-18T18:16:02.124551] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-18T18:16:02.125567] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-18T18:16:02.919632] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-18T18:16:03.692598] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T18:16:03.719510] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-18T18:16:04.376907] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-18T18:16:04.519576] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-18T18:16:04.702279] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-18T18:16:05.319593] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-18T18:16:06.098078] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-18T18:16:06.105417] [INFO ] [REMOTE ] CPRI: Full fetch complete (76032 records). [2025-09-18T18:16:06.105570] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-18T18:16:06.127779] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-09-18T18:16:06.463063] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-18T18:16:06.544512] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-09-18T18:16:06.544608] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-09-18T18:16:06.545400] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-09-18T18:16:06.545456] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-09-18T18:16:06.546952] [DEBUG] [LOCAL ] CPRI: Trimmed 76032 records to 52972 (keeping 200 days of data) [2025-09-18T18:16:06.849838] [DEBUG] [LOCAL ] CPRI: Primary data saved (52972 records). [2025-09-18T18:16:06.849983] [INFO ] [MAIN ] CPRI: Full history saved. [2025-09-18T18:16:06.850101] [INFO ] [MAIN ] Update Progress: 524/2372 symbols completed. CPRI took 37.2s. Estimated remaining: 4h 28m 14s. Rate: 6.9 symbols/min [2025-09-18T18:16:06.928931] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-18T18:16:07.027952] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:16:07.082260] [DEBUG] [LOCAL ] CRC: Loaded 44532 existing records from primary storage. [2025-09-18T18:16:07.082431] [INFO ] [MAIN ] CRC: Loaded 44532 existing records. [2025-09-18T18:16:07.259639] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:16:07.259923] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-18T18:16:07.259977] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-18T18:16:07.261057] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-09-18T18:16:07.261118] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-18T18:16:07.617984] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:16:07.719565] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-11. [2025-09-18T18:16:07.764987] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-18T18:16:08.020662] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-18T18:16:08.519571] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-18T18:16:09.273097] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-18T18:16:09.319493] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-09-18T18:16:09.652986] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-18T18:16:10.119550] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-18T18:16:10.596506] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-18T18:16:10.919546] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-09-18T18:16:11.053271] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T18:16:11.719561] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-09-18T18:16:12.524683] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-18T18:16:12.544389] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-18T18:16:12.888455] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T18:16:13.319553] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-18T18:16:13.390928] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-18T18:16:14.119605] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-18T18:16:14.399118] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-18T18:16:14.875226] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-18T18:16:14.919543] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-18T18:16:15.719592] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-18T18:16:16.116547] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-18T18:16:16.519558] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-18T18:16:16.980401] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-18T18:16:16.984084] [INFO ] [REMOTE ] CR: Full fetch complete (34563 records). [2025-09-18T18:16:16.984169] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-18T18:16:16.984733] [FATAL] [VALIDATOR ] CR: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:16:16.984849] [FATAL] [MAIN ] CR: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:16:16.984893] [WARN ] [MAIN ] CR: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:16:16.984956] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-18T18:16:16.985034] [DEBUG] [LOCAL ] CR: No primary data file found to delete. [2025-09-18T18:16:16.985091] [INFO ] [LOCAL ] CR: Starting deletion of derivative data. [2025-09-18T18:16:16.985455] [DEBUG] [LOCAL ] CR: Deleted derivative data file. [2025-09-18T18:16:16.985549] [INFO ] [MAIN ] Update Progress: 525/2372 symbols completed. CR took 27.2s. Estimated remaining: 4h 28m 10s. Rate: 6.9 symbols/min [2025-09-18T18:16:17.163234] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:16:17.163424] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-18T18:16:17.163463] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-18T18:16:17.163638] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-18T18:16:17.163743] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-18T18:16:17.163849] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-18T18:16:17.163890] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-18T18:16:17.346844] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-18T18:16:17.539809] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:16:17.908839] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-18T18:16:17.968229] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-18T18:16:18.119528] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-18T18:16:18.919558] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-18T18:16:18.963592] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-18T18:16:19.719546] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-11. [2025-09-18T18:16:19.918693] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:16:19.919039] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-11 [2025-09-18T18:16:20.431932] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-18T18:16:20.519517] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-18T18:16:21.319548] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-09-18T18:16:21.608133] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:16:21.608451] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-09-18T18:16:22.119545] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-18T18:16:22.295692] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-18T18:16:22.919710] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-09-18T18:16:23.119975] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:16:23.120370] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-09-18T18:16:23.616273] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-18T18:16:23.719558] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-18T18:16:24.519576] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-18T18:16:25.209053] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T18:16:25.319556] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-18T18:16:25.969603] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-18T18:16:26.119550] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-18T18:16:26.451985] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-18T18:16:26.919540] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-02. [2025-09-18T18:16:27.185264] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:16:27.185551] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-02 [2025-09-18T18:16:27.450719] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-18T18:16:27.719546] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-03. [2025-09-18T18:16:27.933001] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:16:27.933371] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-03 [2025-09-18T18:16:28.519560] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-18T18:16:29.319557] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-18T18:16:30.040213] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-18T18:16:30.098338] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-18T18:16:30.119496] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-18T18:16:30.919559] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-18T18:16:31.044134] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-18T18:16:31.046880] [INFO ] [REMOTE ] CRBD: Full fetch complete (15319 records). [2025-09-18T18:16:31.047072] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-18T18:16:31.259555] [WARN ] [VALIDATOR ] CRBD: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-18T18:16:31.259869] [FATAL] [MAIN ] CRBD: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:16:31.259941] [WARN ] [MAIN ] CRBD: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:16:31.260014] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-18T18:16:31.260080] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-09-18T18:16:31.260119] [INFO ] [LOCAL ] CRBD: Starting deletion of derivative data. [2025-09-18T18:16:31.260160] [DEBUG] [LOCAL ] CRBD: No derivative data file found to delete. [2025-09-18T18:16:31.260222] [INFO ] [MAIN ] Update Progress: 526/2372 symbols completed. CRBD took 35.1s. Estimated remaining: 4h 28m 21s. Rate: 6.9 symbols/min [2025-09-18T18:16:31.435525] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:16:31.504398] [DEBUG] [LOCAL ] CRGY: Loaded 52521 existing records from primary storage. [2025-09-18T18:16:31.504584] [INFO ] [MAIN ] CRGY: Loaded 52521 existing records. [2025-09-18T18:16:31.694418] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:16:31.694720] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-18T18:16:31.694779] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-18T18:16:31.696051] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-18T18:16:31.696141] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-18T18:16:31.727503] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-18T18:16:32.066589] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:16:32.519554] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-04. [2025-09-18T18:16:32.565698] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-18T18:16:32.706360] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:16:32.706742] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-04 [2025-09-18T18:16:33.037254] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-18T18:16:33.319542] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-05. [2025-09-18T18:16:33.592725] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:16:33.593076] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-05 [2025-09-18T18:16:34.119543] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-11. [2025-09-18T18:16:34.919544] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-18T18:16:35.719550] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-06. [2025-09-18T18:16:35.830366] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-18T18:16:36.519568] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-18T18:16:36.607094] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-18T18:16:37.319618] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-09-18T18:16:37.932439] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-18T18:16:38.070450] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-18T18:16:38.119614] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-18T18:16:38.855734] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-18T18:16:38.919583] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-07. [2025-09-18T18:16:39.594628] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-18T18:16:39.719553] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-18T18:16:40.519555] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-09-18T18:16:41.154911] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-18T18:16:41.162113] [INFO ] [REMOTE ] CRC: Full fetch complete (61918 records). [2025-09-18T18:16:41.162240] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-18T18:16:41.328101] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-18T18:16:41.577980] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-09-18T18:16:41.578101] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-09-18T18:16:41.578825] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-09-18T18:16:41.578890] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-09-18T18:16:41.580243] [DEBUG] [LOCAL ] CRC: Trimmed 61918 records to 44876 (keeping 200 days of data) [2025-09-18T18:16:41.856777] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-09-18T18:16:41.945667] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T18:16:41.963593] [DEBUG] [LOCAL ] CRC: Primary data saved (44876 records). [2025-09-18T18:16:41.963811] [INFO ] [MAIN ] CRC: Full history saved. [2025-09-18T18:16:41.964669] [INFO ] [MAIN ] Update Progress: 527/2372 symbols completed. CRC took 35.1s. Estimated remaining: 4h 28m 19s. Rate: 6.9 symbols/min [2025-09-18T18:16:42.122670] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-08. [2025-09-18T18:16:42.142288] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:16:42.200979] [DEBUG] [LOCAL ] CRH: Loaded 53472 existing records from primary storage. [2025-09-18T18:16:42.201159] [INFO ] [MAIN ] CRH: Loaded 53472 existing records. [2025-09-18T18:16:42.399415] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:16:42.399771] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-18T18:16:42.399830] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-18T18:16:42.401227] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-09-18T18:16:42.401294] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-18T18:16:42.777128] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:16:42.919571] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-18T18:16:43.022871] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-18T18:16:43.030809] [INFO ] [REMOTE ] CRBG: Full fetch complete (75530 records). [2025-09-18T18:16:43.031011] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-18T18:16:43.447966] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-09-18T18:16:43.448074] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-09-18T18:16:43.448898] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-09-18T18:16:43.448967] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-09-18T18:16:43.450800] [DEBUG] [LOCAL ] CRBG: Trimmed 75530 records to 52724 (keeping 200 days of data) [2025-09-18T18:16:43.719573] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-11. [2025-09-18T18:16:43.800214] [DEBUG] [LOCAL ] CRBG: Primary data saved (52724 records). [2025-09-18T18:16:43.800363] [INFO ] [MAIN ] CRBG: Full history saved. [2025-09-18T18:16:43.800450] [INFO ] [MAIN ] Update Progress: 528/2372 symbols completed. CRBG took 45.1s. Estimated remaining: 4h 27m 46s. Rate: 6.9 symbols/min [2025-09-18T18:16:43.971127] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:16:44.023870] [DEBUG] [LOCAL ] CRI: Loaded 49995 existing records from primary storage. [2025-09-18T18:16:44.024040] [INFO ] [MAIN ] CRI: Loaded 49995 existing records. [2025-09-18T18:16:44.202923] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:16:44.203197] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-18T18:16:44.203266] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-18T18:16:44.204459] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-09-18T18:16:44.204520] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-18T18:16:44.569349] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:16:44.569783] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-11. [2025-09-18T18:16:44.598711] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-18T18:16:44.693243] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-09-18T18:16:45.319525] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-18T18:16:45.508629] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-18T18:16:46.119527] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-09. [2025-09-18T18:16:46.217450] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T18:16:46.920414] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-09-18T18:16:46.923188] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-18T18:16:47.719599] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-18T18:16:48.478203] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-18T18:16:48.519513] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-09-18T18:16:48.641152] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-18T18:16:48.648432] [INFO ] [REMOTE ] CRCL: Full fetch complete (28269 records). [2025-09-18T18:16:48.648525] [DEBUG] [VALIDATOR ] CRCL: Validating primary data. [2025-09-18T18:16:48.837394] [WARN ] [VALIDATOR ] CRCL: Validation failed - insufficient historical data. Have 73 unique days, need 200 days [2025-09-18T18:16:48.837833] [FATAL] [MAIN ] CRCL: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:16:48.837908] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:16:48.837959] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-18T18:16:48.838022] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-18T18:16:48.838066] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-18T18:16:48.838139] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-18T18:16:48.838222] [INFO ] [MAIN ] Update Progress: 529/2372 symbols completed. CRCL took 31.9s. Estimated remaining: 4h 27m 25s. Rate: 6.9 symbols/min [2025-09-18T18:16:49.018903] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:16:49.019136] [DEBUG] [LOCAL ] CRK: No existing data file found in primary storage. [2025-09-18T18:16:49.019193] [WARN ] [MAIN ] CRK: No existing data found, performing full refresh instead. [2025-09-18T18:16:49.019307] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-18T18:16:49.019348] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-18T18:16:49.019391] [DEBUG] [LOCAL ] CRK: No primary data file found to delete. [2025-09-18T18:16:49.019425] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-18T18:16:49.324661] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-09-18T18:16:49.419214] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:16:49.449755] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-18T18:16:49.793791] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-18T18:16:50.119546] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-18T18:16:50.919623] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-18T18:16:51.162433] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-18T18:16:51.597759] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-18T18:16:51.719567] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-11. [2025-09-18T18:16:52.183594] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-18T18:16:52.519584] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-18T18:16:53.319568] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-09-18T18:16:53.495801] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-18T18:16:53.988449] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-18T18:16:54.119524] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-18T18:16:54.887849] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-18T18:16:54.919544] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-18T18:16:55.690777] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-18T18:16:55.719505] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-18T18:16:56.519595] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-09-18T18:16:56.718550] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-18T18:16:57.248114] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-18T18:16:57.319503] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-18T18:16:58.119599] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-18T18:16:58.303824] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-18T18:16:58.919624] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-18T18:16:58.954487] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-18T18:16:58.961837] [INFO ] [REMOTE ] CRGY: Full fetch complete (75729 records). [2025-09-18T18:16:58.961979] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-18T18:16:59.354478] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-09-18T18:16:59.354586] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-09-18T18:16:59.355454] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-09-18T18:16:59.355545] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-09-18T18:16:59.357950] [DEBUG] [LOCAL ] CRGY: Trimmed 75729 records to 52911 (keeping 200 days of data) [2025-09-18T18:16:59.711080] [DEBUG] [LOCAL ] CRGY: Primary data saved (52911 records). [2025-09-18T18:16:59.711318] [INFO ] [MAIN ] CRGY: Full history saved. [2025-09-18T18:16:59.711513] [INFO ] [MAIN ] Update Progress: 530/2372 symbols completed. CRGY took 28.5s. Estimated remaining: 4h 27m 24s. Rate: 6.9 symbols/min [2025-09-18T18:16:59.745759] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-09-18T18:16:59.888364] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:16:59.930973] [DEBUG] [LOCAL ] CRL: Loaded 43772 existing records from primary storage. [2025-09-18T18:16:59.931191] [INFO ] [MAIN ] CRL: Loaded 43772 existing records. [2025-09-18T18:17:00.114521] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:17:00.115027] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-18T18:17:00.115120] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-18T18:17:00.116592] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-09-18T18:17:00.116687] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-18T18:17:00.517323] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:17:00.512861] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-18T18:17:00.527987] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-11. [2025-09-18T18:17:00.705868] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-18T18:17:01.334264] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-18T18:17:01.356827] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T18:17:02.119552] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-18T18:17:02.214253] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-18T18:17:02.875308] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T18:17:02.919551] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-09-18T18:17:03.565223] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T18:17:03.719578] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-18T18:17:04.449966] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-18T18:17:04.519574] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-09-18T18:17:05.150880] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-18T18:17:05.319516] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-18T18:17:06.002496] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-18T18:17:06.119510] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-18T18:17:06.919547] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-18T18:17:06.980796] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-18T18:17:07.591235] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-18T18:17:07.719544] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-18T18:17:08.519577] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-18T18:17:08.952233] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-18T18:17:09.208673] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-18T18:17:09.319503] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-18T18:17:09.878384] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T18:17:10.119514] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-18T18:17:10.919577] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-18T18:17:10.960274] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T18:17:11.719573] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-18T18:17:11.955668] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-18T18:17:12.524083] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-18T18:17:12.531032] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-18T18:17:13.243063] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-18T18:17:13.319506] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-18T18:17:14.119575] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-18T18:17:14.173413] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-18T18:17:14.919545] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-18T18:17:14.997921] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-18T18:17:15.727892] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-18T18:17:15.745874] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-18T18:17:16.515479] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-18T18:17:16.524986] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-18T18:17:17.319559] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-18T18:17:17.542469] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-18T18:17:17.549430] [INFO ] [REMOTE ] CRI: Full fetch complete (70638 records). [2025-09-18T18:17:17.549571] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-18T18:17:17.948554] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-09-18T18:17:17.948749] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-09-18T18:17:17.949511] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-09-18T18:17:17.949560] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-09-18T18:17:17.951179] [DEBUG] [LOCAL ] CRI: Trimmed 70638 records to 50352 (keeping 200 days of data) [2025-09-18T18:17:18.135837] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-18T18:17:18.274518] [DEBUG] [LOCAL ] CRI: Primary data saved (50352 records). [2025-09-18T18:17:18.274680] [INFO ] [MAIN ] CRI: Full history saved. [2025-09-18T18:17:18.274786] [INFO ] [MAIN ] Update Progress: 531/2372 symbols completed. CRI took 34.5s. Estimated remaining: 4h 27m 49s. Rate: 6.9 symbols/min [2025-09-18T18:17:18.465123] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:17:18.500990] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-18T18:17:18.564838] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-09-18T18:17:18.564995] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-09-18T18:17:18.755914] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:17:18.756568] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-18T18:17:18.756810] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-18T18:17:18.758458] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-09-18T18:17:18.758561] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-18T18:17:18.901522] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-18T18:17:18.923952] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-18T18:17:19.175344] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:17:19.390987] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-18T18:17:19.719594] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-18T18:17:20.519575] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-11. [2025-09-18T18:17:20.854179] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-18T18:17:21.319556] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-18T18:17:21.479817] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-18T18:17:22.119565] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-18T18:17:22.627879] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-11 (2.11 seconds). [2025-09-18T18:17:22.667576] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-18T18:17:22.919542] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-18T18:17:23.476800] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-18T18:17:23.486810] [INFO ] [REMOTE ] CRK: Full fetch complete (75327 records). [2025-09-18T18:17:23.487007] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-18T18:17:23.724717] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-18T18:17:23.905794] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-09-18T18:17:23.905889] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-09-18T18:17:23.906680] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-09-18T18:17:23.906783] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-09-18T18:17:23.908539] [DEBUG] [LOCAL ] CRK: Trimmed 75327 records to 52520 (keeping 200 days of data) [2025-09-18T18:17:24.222215] [DEBUG] [LOCAL ] CRK: Primary data saved (52520 records). [2025-09-18T18:17:24.222354] [INFO ] [MAIN ] CRK: Full history saved. [2025-09-18T18:17:24.222473] [INFO ] [MAIN ] Update Progress: 532/2372 symbols completed. CRK took 35.4s. Estimated remaining: 4h 27m 31s. Rate: 6.9 symbols/min [2025-09-18T18:17:24.410210] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:17:24.458029] [DEBUG] [LOCAL ] CRS: Loaded 43581 existing records from primary storage. [2025-09-18T18:17:24.458249] [INFO ] [MAIN ] CRS: Loaded 43581 existing records. [2025-09-18T18:17:24.535796] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-09-18T18:17:24.585156] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-18T18:17:24.675303] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:17:24.675776] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-18T18:17:24.675850] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-18T18:17:24.677032] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-09-18T18:17:24.677094] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-18T18:17:25.034151] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:17:25.319553] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-11. [2025-09-18T18:17:25.699377] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-18T18:17:26.119551] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-18T18:17:26.719995] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-18T18:17:26.783444] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-18T18:17:26.919504] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-09-18T18:17:27.719603] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-18T18:17:27.868456] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-18T18:17:27.880023] [INFO ] [REMOTE ] CRH: Full fetch complete (76742 records). [2025-09-18T18:17:27.880225] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-18T18:17:27.881328] [FATAL] [VALIDATOR ] CRH: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:17:27.881448] [FATAL] [MAIN ] CRH: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:17:27.881507] [WARN ] [MAIN ] CRH: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:17:27.881582] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-18T18:17:27.881679] [DEBUG] [LOCAL ] CRH: No primary data file found to delete. [2025-09-18T18:17:27.881751] [INFO ] [LOCAL ] CRH: Starting deletion of derivative data. [2025-09-18T18:17:27.882134] [DEBUG] [LOCAL ] CRH: Deleted derivative data file. [2025-09-18T18:17:27.883887] [INFO ] [MAIN ] Update Progress: 533/2372 symbols completed. CRH took 45.9s. Estimated remaining: 4h 27m 5s. Rate: 6.9 symbols/min [2025-09-18T18:17:28.061081] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:17:28.061285] [DEBUG] [LOCAL ] CRT: No existing data file found in primary storage. [2025-09-18T18:17:28.061325] [WARN ] [MAIN ] CRT: No existing data found, performing full refresh instead. [2025-09-18T18:17:28.061482] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-18T18:17:28.061526] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-18T18:17:28.061570] [DEBUG] [LOCAL ] CRT: No primary data file found to delete. [2025-09-18T18:17:28.061618] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-18T18:17:28.451739] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:17:28.519548] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-11. [2025-09-18T18:17:29.070915] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-18T18:17:29.108590] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-18T18:17:29.138034] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-18T18:17:29.148070] [INFO ] [REMOTE ] CRL: Full fetch complete (62638 records). [2025-09-18T18:17:29.148262] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-18T18:17:29.323949] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-09-18T18:17:29.559728] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-09-18T18:17:29.559816] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-09-18T18:17:29.560474] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-09-18T18:17:29.560515] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-09-18T18:17:29.562121] [DEBUG] [LOCAL ] CRL: Trimmed 62638 records to 43985 (keeping 200 days of data) [2025-09-18T18:17:29.842811] [DEBUG] [LOCAL ] CRL: Primary data saved (43985 records). [2025-09-18T18:17:29.842951] [INFO ] [MAIN ] CRL: Full history saved. [2025-09-18T18:17:29.843102] [INFO ] [MAIN ] Update Progress: 534/2372 symbols completed. CRL took 30.1s. Estimated remaining: 4h 26m 33s. Rate: 6.9 symbols/min [2025-09-18T18:17:30.014365] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:17:30.057974] [DEBUG] [LOCAL ] CSAN: Loaded 42065 existing records from primary storage. [2025-09-18T18:17:30.058265] [INFO ] [MAIN ] CSAN: Loaded 42065 existing records. [2025-09-18T18:17:30.133490] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-09-18T18:17:30.180115] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-18T18:17:30.261353] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:17:30.261640] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-18T18:17:30.261721] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-18T18:17:30.262619] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-18T18:17:30.262718] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-18T18:17:30.619693] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:17:30.919570] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-18T18:17:31.492860] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T18:17:31.719580] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-09-18T18:17:32.519543] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-11. [2025-09-18T18:17:32.953932] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-18T18:17:33.082618] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-18T18:17:33.319562] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-18T18:17:33.843430] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-18T18:17:34.119604] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-18T18:17:34.919556] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-09-18T18:17:35.429572] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-18T18:17:35.609777] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-18T18:17:35.719554] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-18T18:17:35.796296] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-18T18:17:36.519576] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-18T18:17:37.157275] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-18T18:17:37.319557] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-09-18T18:17:37.961610] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-18T18:17:38.119559] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-18T18:17:38.627029] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T18:17:38.919597] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-18T18:17:39.655022] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-18T18:17:39.719561] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-18T18:17:40.350303] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-18T18:17:40.519581] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-18T18:17:41.162032] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-18T18:17:41.319557] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-18T18:17:41.507814] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-18T18:17:42.119548] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-09-18T18:17:42.705273] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T18:17:42.919568] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-18T18:17:43.482549] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-18T18:17:43.719628] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-18T18:17:44.519547] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-18T18:17:45.315581] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-18T18:17:45.319631] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-18T18:17:45.365123] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-18T18:17:45.390763] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T18:17:46.119571] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-18T18:17:46.737079] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-18T18:17:46.919537] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-18T18:17:47.719551] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-18T18:17:48.519610] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-18T18:17:48.587562] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-18T18:17:48.701544] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-18T18:17:48.966334] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-18T18:17:49.003703] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-18T18:17:49.319621] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-18T18:17:50.119599] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-18T18:17:50.919588] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-18T18:17:51.283376] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-18T18:17:51.719567] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-18T18:17:51.917742] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-18T18:17:52.519540] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-18T18:17:52.578107] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-18T18:17:52.959305] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-18T18:17:53.319601] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-18T18:17:53.782408] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-18T18:17:54.119611] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-18T18:17:54.919592] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-18T18:17:55.094795] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-18T18:17:55.102725] [INFO ] [REMOTE ] CRM: Full fetch complete (77773 records). [2025-09-18T18:17:55.102930] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-18T18:17:55.488349] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-18T18:17:55.557599] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-09-18T18:17:55.557809] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-09-18T18:17:55.558797] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-09-18T18:17:55.559097] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-09-18T18:17:55.572179] [DEBUG] [LOCAL ] CRM: Trimmed 77773 records to 54160 (keeping 200 days of data) [2025-09-18T18:17:55.594344] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-18T18:17:55.719708] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-18T18:17:55.952157] [DEBUG] [LOCAL ] CRM: Primary data saved (54160 records). [2025-09-18T18:17:55.952312] [INFO ] [MAIN ] CRM: Full history saved. [2025-09-18T18:17:55.952399] [INFO ] [MAIN ] Update Progress: 535/2372 symbols completed. CRM took 37.7s. Estimated remaining: 4h 27m 24s. Rate: 6.9 symbols/min [2025-09-18T18:17:56.126873] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:17:56.165277] [DEBUG] [LOCAL ] CSL: Loaded 31435 existing records from primary storage. [2025-09-18T18:17:56.165465] [INFO ] [MAIN ] CSL: Loaded 31435 existing records. [2025-09-18T18:17:56.355908] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:17:56.356252] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-18T18:17:56.356302] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-18T18:17:56.357396] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-09-18T18:17:56.357459] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-18T18:17:56.491290] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-18T18:17:56.531483] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-18T18:17:56.552340] [INFO ] [REMOTE ] CRT: Full fetch complete (7535 records). [2025-09-18T18:17:56.597580] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-18T18:17:56.906687] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:17:57.132996] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-09-18T18:17:57.133089] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-09-18T18:17:57.133290] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-09-18T18:17:57.133329] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-09-18T18:17:57.133828] [DEBUG] [LOCAL ] CRT: Trimmed 7535 records to 4920 (keeping 200 days of data) [2025-09-18T18:17:57.164595] [DEBUG] [LOCAL ] CRT: Primary data saved (4920 records). [2025-09-18T18:17:57.164730] [INFO ] [MAIN ] CRT: Full history saved. [2025-09-18T18:17:57.164839] [INFO ] [MAIN ] Update Progress: 536/2372 symbols completed. CRT took 29.3s. Estimated remaining: 4h 26m 49s. Rate: 6.9 symbols/min [2025-09-18T18:17:57.325822] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-11. [2025-09-18T18:17:57.351155] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:17:57.371223] [DEBUG] [LOCAL ] CSR: Loaded 12384 existing records from primary storage. [2025-09-18T18:17:57.371349] [INFO ] [MAIN ] CSR: Loaded 12384 existing records. [2025-09-18T18:17:57.555683] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:17:57.555980] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-18T18:17:57.556049] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-18T18:17:57.556598] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-18T18:17:57.556705] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-18T18:17:57.914124] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:17:58.119740] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-11. [2025-09-18T18:17:58.124567] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T18:17:58.385063] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-18T18:17:58.919556] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-18T18:17:58.990594] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-18T18:17:59.719573] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-18T18:18:00.489314] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-18T18:18:00.519513] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-18T18:18:01.280691] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-18T18:18:01.290570] [INFO ] [REMOTE ] CRS: Full fetch complete (62324 records). [2025-09-18T18:18:01.290863] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-18T18:18:01.324633] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-09-18T18:18:01.706770] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-09-18T18:18:01.706870] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-09-18T18:18:01.707553] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-18T18:18:01.707632] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-09-18T18:18:01.709079] [DEBUG] [LOCAL ] CRS: Trimmed 62324 records to 43895 (keeping 200 days of data) [2025-09-18T18:18:02.006323] [DEBUG] [LOCAL ] CRS: Primary data saved (43895 records). [2025-09-18T18:18:02.006501] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-18T18:18:02.006601] [INFO ] [MAIN ] Update Progress: 537/2372 symbols completed. CRS took 37.8s. Estimated remaining: 4h 26m 27s. Rate: 6.9 symbols/min [2025-09-18T18:18:02.124858] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-09-18T18:18:02.198419] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:18:02.227312] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-18T18:18:02.277627] [DEBUG] [LOCAL ] CSTM: Loaded 47803 existing records from primary storage. [2025-09-18T18:18:02.277840] [INFO ] [MAIN ] CSTM: Loaded 47803 existing records. [2025-09-18T18:18:02.459157] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:18:02.459425] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-18T18:18:02.459475] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-18T18:18:02.460441] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-18T18:18:02.460502] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-18T18:18:02.818958] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:18:02.919531] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-11. [2025-09-18T18:18:03.719617] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-18T18:18:04.172836] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (2.85 seconds). [2025-09-18T18:18:04.519558] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-09-18T18:18:04.765442] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-09-18T18:18:05.319551] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-09-18T18:18:05.733074] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-18T18:18:05.803593] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-11 (2.88 seconds). [2025-09-18T18:18:05.831219] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-18T18:18:05.845729] [INFO ] [REMOTE ] CSAN: Full fetch complete (60693 records). [2025-09-18T18:18:05.846937] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-18T18:18:05.846540] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-18T18:18:06.124707] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-09-18T18:18:06.252857] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-18T18:18:06.253062] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-18T18:18:06.253797] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-18T18:18:06.253862] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-18T18:18:06.255226] [DEBUG] [LOCAL ] CSAN: Trimmed 60693 records to 42325 (keeping 200 days of data) [2025-09-18T18:18:06.490249] [DEBUG] [LOCAL ] CSAN: Primary data saved (42325 records). [2025-09-18T18:18:06.490391] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-18T18:18:06.490500] [INFO ] [MAIN ] Update Progress: 538/2372 symbols completed. CSAN took 36.6s. Estimated remaining: 4h 26m 4s. Rate: 6.9 symbols/min [2025-09-18T18:18:06.660322] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:18:06.676717] [DEBUG] [LOCAL ] CSV: Loaded 13078 existing records from primary storage. [2025-09-18T18:18:06.676872] [INFO ] [MAIN ] CSV: Loaded 13078 existing records. [2025-09-18T18:18:06.863671] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:18:06.864000] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-18T18:18:06.864058] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-18T18:18:06.864550] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-09-18T18:18:06.864611] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-18T18:18:06.929984] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-18T18:18:07.237205] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:18:07.554189] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-18T18:18:07.719544] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-11. [2025-09-18T18:18:08.406162] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-18T18:18:08.505035] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-18T18:18:08.519497] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-09-18T18:18:09.319557] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-18T18:18:09.425810] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-18T18:18:10.119562] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-18T18:18:10.128888] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-18T18:18:10.919563] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-18T18:18:11.482090] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T18:18:11.719522] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-18T18:18:11.788970] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-18T18:18:12.519555] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-09-18T18:18:13.319566] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-09-18T18:18:14.119542] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-18T18:18:14.347828] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-18T18:18:14.644895] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-18T18:18:14.815380] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-18T18:18:14.919533] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-18T18:18:15.475060] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (2.96 seconds). [2025-09-18T18:18:15.542346] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-18T18:18:15.719563] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-18T18:18:16.519549] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-18T18:18:16.682526] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-18T18:18:17.319506] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-18T18:18:17.560610] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-18T18:18:18.119515] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-18T18:18:18.232659] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-18T18:18:18.919560] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-18T18:18:18.970831] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-18T18:18:19.719548] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-18T18:18:19.824740] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-18T18:18:20.519563] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-18T18:18:21.075790] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-18T18:18:21.105836] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-18T18:18:21.319539] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-18T18:18:22.119598] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-18T18:18:22.919596] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-18T18:18:23.382265] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-18T18:18:23.603200] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-18T18:18:23.621374] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T18:18:23.719496] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-18T18:18:24.519544] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-18T18:18:24.830988] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-18T18:18:25.193542] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-18T18:18:25.319545] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-18T18:18:26.119545] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-18T18:18:26.291635] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-18T18:18:26.919598] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-18T18:18:27.358279] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T18:18:27.615819] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-18T18:18:27.618202] [INFO ] [REMOTE ] CSV: Full fetch complete (19334 records). [2025-09-18T18:18:27.618286] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-18T18:18:27.722491] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-18T18:18:27.987637] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-09-18T18:18:27.987774] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-09-18T18:18:27.988157] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-18T18:18:27.988200] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-09-18T18:18:27.988918] [DEBUG] [LOCAL ] CSV: Trimmed 19334 records to 13238 (keeping 200 days of data) [2025-09-18T18:18:28.076852] [DEBUG] [LOCAL ] CSV: Primary data saved (13238 records). [2025-09-18T18:18:28.077020] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-18T18:18:28.077124] [INFO ] [MAIN ] Update Progress: 539/2372 symbols completed. CSV took 21.6s. Estimated remaining: 4h 26m 39s. Rate: 6.9 symbols/min [2025-09-18T18:18:28.254041] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:18:28.254249] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-18T18:18:28.254303] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-18T18:18:28.254445] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-18T18:18:28.254487] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-18T18:18:28.254528] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-18T18:18:28.254561] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-18T18:18:28.525521] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-18T18:18:28.615566] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:18:28.676484] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-18T18:18:29.319552] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-18T18:18:29.842602] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-18T18:18:29.848941] [INFO ] [REMOTE ] CSL: Full fetch complete (44591 records). [2025-09-18T18:18:29.849157] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-18T18:18:30.048863] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-18T18:18:30.124376] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-18T18:18:30.293958] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-09-18T18:18:30.294060] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-09-18T18:18:30.294833] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-09-18T18:18:30.294904] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-09-18T18:18:30.295995] [DEBUG] [LOCAL ] CSL: Trimmed 44591 records to 31709 (keeping 200 days of data) [2025-09-18T18:18:30.496682] [DEBUG] [LOCAL ] CSL: Primary data saved (31709 records). [2025-09-18T18:18:30.496838] [INFO ] [MAIN ] CSL: Full history saved. [2025-09-18T18:18:30.496938] [INFO ] [MAIN ] Update Progress: 540/2372 symbols completed. CSL took 34.5s. Estimated remaining: 4h 26m 9s. Rate: 6.9 symbols/min [2025-09-18T18:18:30.716214] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:18:30.725460] [DEBUG] [LOCAL ] CTBB: Loaded 7279 existing records from primary storage. [2025-09-18T18:18:30.725582] [INFO ] [MAIN ] CTBB: Loaded 7279 existing records. [2025-09-18T18:18:30.907455] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:18:30.907800] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-18T18:18:30.907858] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-18T18:18:30.908256] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-18T18:18:30.908317] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-18T18:18:30.929676] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-18T18:18:31.227895] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-18T18:18:31.274059] [INFO ] [REMOTE ] CSR: Full fetch complete (17370 records). [2025-09-18T18:18:31.284433] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-18T18:18:31.343233] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:18:31.682664] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-18T18:18:31.682758] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-18T18:18:31.683146] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-18T18:18:31.683187] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-18T18:18:31.683869] [DEBUG] [LOCAL ] CSR: Trimmed 17370 records to 12508 (keeping 200 days of data) [2025-09-18T18:18:31.721504] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-11. [2025-09-18T18:18:31.767492] [DEBUG] [LOCAL ] CSR: Primary data saved (12508 records). [2025-09-18T18:18:31.767666] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-18T18:18:31.767794] [INFO ] [MAIN ] Update Progress: 541/2372 symbols completed. CSR took 34.6s. Estimated remaining: 4h 25m 35s. Rate: 6.9 symbols/min [2025-09-18T18:18:31.938369] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:18:31.949518] [DEBUG] [LOCAL ] CTDD: Loaded 5877 existing records from primary storage. [2025-09-18T18:18:31.949670] [INFO ] [MAIN ] CTDD: Loaded 5877 existing records. [2025-09-18T18:18:32.128948] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:18:32.129222] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-18T18:18:32.129271] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-18T18:18:32.129553] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-09-18T18:18:32.129612] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-18T18:18:32.499015] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:18:32.519502] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-11. [2025-09-18T18:18:32.542871] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-18T18:18:32.832116] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-18T18:18:33.319552] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-09-18T18:18:33.333952] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-18T18:18:34.119557] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-18T18:18:34.189453] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-18T18:18:34.919580] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-09-18T18:18:35.507224] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-18T18:18:35.570891] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T18:18:35.719601] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-09-18T18:18:36.173012] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-18T18:18:36.519542] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-18T18:18:37.319554] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-11. [2025-09-18T18:18:37.517405] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:18:37.517764] [WARN ] [REMOTE ] CSW: No data returned for month 2024-11 [2025-09-18T18:18:37.804752] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-18T18:18:38.119545] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-09-18T18:18:38.801767] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-18T18:18:38.919539] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-18T18:18:39.373107] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-18T18:18:39.719552] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-18T18:18:40.519610] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-09-18T18:18:40.801236] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:18:40.801561] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-09-18T18:18:41.328720] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-18T18:18:41.331397] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-18T18:18:42.119596] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-18T18:18:42.135557] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-18T18:18:42.919608] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-18T18:18:43.574512] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-18T18:18:43.719600] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-18T18:18:43.965114] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-18T18:18:44.344235] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-18T18:18:44.519548] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-18T18:18:45.145483] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-18T18:18:45.319563] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-09-18T18:18:45.544798] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:18:45.545137] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-09-18T18:18:46.119549] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-18T18:18:46.919554] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-18T18:18:47.567838] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-18T18:18:47.719553] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-18T18:18:47.909431] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-18T18:18:47.916567] [INFO ] [REMOTE ] CSTM: Full fetch complete (68720 records). [2025-09-18T18:18:47.916778] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-18T18:18:48.268983] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-18T18:18:48.345344] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-09-18T18:18:48.345435] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-09-18T18:18:48.346261] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-09-18T18:18:48.346329] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-09-18T18:18:48.347979] [DEBUG] [LOCAL ] CSTM: Trimmed 68720 records to 48163 (keeping 200 days of data) [2025-09-18T18:18:48.520915] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-18T18:18:48.647239] [DEBUG] [LOCAL ] CSTM: Primary data saved (48163 records). [2025-09-18T18:18:48.647429] [INFO ] [MAIN ] CSTM: Full history saved. [2025-09-18T18:18:48.647536] [INFO ] [MAIN ] Update Progress: 542/2372 symbols completed. CSTM took 46.6s. Estimated remaining: 4h 25m 54s. Rate: 6.9 symbols/min [2025-09-18T18:18:48.819992] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:18:48.820218] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-18T18:18:48.820274] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-18T18:18:48.820425] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-18T18:18:48.820467] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-18T18:18:48.820507] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-18T18:18:48.820539] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-18T18:18:49.183124] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:18:49.319575] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-11. [2025-09-18T18:18:49.388362] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-18T18:18:49.665808] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2024-11 (0.35 seconds). [2025-09-18T18:18:50.119549] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-09-18T18:18:50.321127] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:18:50.321517] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-09-18T18:18:50.919556] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-18T18:18:51.598506] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-18T18:18:51.719587] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-18T18:18:52.336248] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-18T18:18:52.519567] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-18T18:18:53.162613] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-18T18:18:53.319554] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-01. [2025-09-18T18:18:53.536396] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:18:53.536760] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-01 [2025-09-18T18:18:54.119559] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-18T18:18:54.747495] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T18:18:54.919542] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-02. [2025-09-18T18:18:55.203498] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:18:55.203971] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-02 [2025-09-18T18:18:55.719552] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-02. [2025-09-18T18:18:55.910404] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:18:55.910748] [WARN ] [REMOTE ] CSW: No data returned for month 2025-02 [2025-09-18T18:18:56.519576] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-03. [2025-09-18T18:18:56.795666] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:18:56.796112] [WARN ] [REMOTE ] CSW: No data returned for month 2025-03 [2025-09-18T18:18:57.319561] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-03. [2025-09-18T18:18:57.549982] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:18:57.550852] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-03 [2025-09-18T18:18:58.119553] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-04. [2025-09-18T18:18:58.394008] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:18:58.394405] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-04 [2025-09-18T18:18:58.919602] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-05. [2025-09-18T18:18:59.676539] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-18T18:18:59.719546] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-18T18:19:00.415479] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-18T18:19:00.519537] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-18T18:19:01.238196] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-18T18:19:01.239563] [INFO ] [REMOTE ] CTDD: Full fetch complete (8591 records). [2025-09-18T18:19:01.239638] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-18T18:19:01.240128] [FATAL] [VALIDATOR ] CTDD: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:19:01.240218] [FATAL] [MAIN ] CTDD: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:19:01.240263] [WARN ] [MAIN ] CTDD: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:19:01.240330] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-18T18:19:01.240396] [DEBUG] [LOCAL ] CTDD: No primary data file found to delete. [2025-09-18T18:19:01.240435] [INFO ] [LOCAL ] CTDD: Starting deletion of derivative data. [2025-09-18T18:19:01.240864] [DEBUG] [LOCAL ] CTDD: Deleted derivative data file. [2025-09-18T18:19:01.240963] [INFO ] [MAIN ] Update Progress: 543/2372 symbols completed. CTDD took 29.5s. Estimated remaining: 4h 25m 59s. Rate: 6.9 symbols/min [2025-09-18T18:19:01.324620] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-04. [2025-09-18T18:19:01.416981] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:19:01.417158] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-18T18:19:01.417195] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-18T18:19:01.417342] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-18T18:19:01.417441] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-18T18:19:01.417506] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-18T18:19:01.417551] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-18T18:19:01.577577] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:19:01.627259] [WARN ] [REMOTE ] CSW: No data returned for month 2025-04 [2025-09-18T18:19:01.814138] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:19:02.119555] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-06. [2025-09-18T18:19:02.536721] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-18T18:19:02.919549] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-05. [2025-09-18T18:19:03.124907] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:19:03.125459] [WARN ] [REMOTE ] CSW: No data returned for month 2025-05 [2025-09-18T18:19:03.719582] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-06. [2025-09-18T18:19:04.475957] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-18T18:19:04.519526] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-07. [2025-09-18T18:19:05.273844] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-18T18:19:05.319503] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-18T18:19:05.830888] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-18T18:19:06.119593] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-18T18:19:06.716098] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-18T18:19:06.717772] [INFO ] [REMOTE ] CTBB: Full fetch complete (11197 records). [2025-09-18T18:19:06.717867] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-18T18:19:06.926532] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-11. [2025-09-18T18:19:07.105005] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-18T18:19:07.105106] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-18T18:19:07.105482] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-18T18:19:07.105525] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-18T18:19:07.106286] [DEBUG] [LOCAL ] CTBB: Trimmed 11197 records to 7314 (keeping 200 days of data) [2025-09-18T18:19:07.164113] [DEBUG] [LOCAL ] CTBB: Primary data saved (7314 records). [2025-09-18T18:19:07.164279] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-18T18:19:07.164399] [INFO ] [MAIN ] Update Progress: 544/2372 symbols completed. CTBB took 36.7s. Estimated remaining: 4h 25m 40s. Rate: 6.9 symbols/min [2025-09-18T18:19:07.288594] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:19:07.325490] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-11 [2025-09-18T18:19:07.347498] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:19:07.380990] [DEBUG] [LOCAL ] CTO: Loaded 28505 existing records from primary storage. [2025-09-18T18:19:07.381163] [INFO ] [MAIN ] CTO: Loaded 28505 existing records. [2025-09-18T18:19:07.560979] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:19:07.561290] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-18T18:19:07.561398] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-18T18:19:07.562352] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-09-18T18:19:07.562412] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-18T18:19:07.721773] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-07. [2025-09-18T18:19:07.920289] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:19:08.011570] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-18T18:19:08.519592] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-08. [2025-09-18T18:19:09.319572] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-11. [2025-09-18T18:19:09.556224] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-18T18:19:10.119554] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-08. [2025-09-18T18:19:10.370637] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:19:10.371017] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-08 [2025-09-18T18:19:10.752631] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T18:19:10.919587] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-09. [2025-09-18T18:19:11.719538] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-09. [2025-09-18T18:19:11.778124] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-18T18:19:11.781029] [INFO ] [REMOTE ] CSW: Full fetch complete (7638 records). [2025-09-18T18:19:11.781107] [DEBUG] [VALIDATOR ] CSW: Validating primary data. [2025-09-18T18:19:11.990636] [WARN ] [VALIDATOR ] CSW: Validation failed - insufficient historical data. Have 71 unique days, need 200 days [2025-09-18T18:19:11.990909] [FATAL] [MAIN ] CSW: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:19:11.990982] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:19:11.991055] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-18T18:19:11.991147] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-18T18:19:11.991223] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-18T18:19:11.991327] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-18T18:19:11.991412] [INFO ] [MAIN ] Update Progress: 545/2372 symbols completed. CSW took 43.9s. Estimated remaining: 4h 25m 19s. Rate: 6.9 symbols/min [2025-09-18T18:19:12.136761] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:19:12.165393] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-09 [2025-09-18T18:19:12.166709] [INFO ] [REMOTE ] CTEST: Full fetch complete (1021 records). [2025-09-18T18:19:12.167814] [DEBUG] [VALIDATOR ] CTEST: Validating primary data. [2025-09-18T18:19:12.170080] [FATAL] [VALIDATOR ] CTEST: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:19:12.169206] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:19:12.170258] [FATAL] [MAIN ] CTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:19:12.170718] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:19:12.170797] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-18T18:19:12.170886] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-18T18:19:12.170978] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-18T18:19:12.171057] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-18T18:19:12.171238] [INFO ] [MAIN ] Update Progress: 546/2372 symbols completed. CTEST took 23.5s. Estimated remaining: 4h 24m 41s. Rate: 6.9 symbols/min [2025-09-18T18:19:12.356083] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:19:12.368245] [DEBUG] [LOCAL ] CTOS: Loaded 37050 existing records from primary storage. [2025-09-18T18:19:12.370268] [INFO ] [MAIN ] CTOS: Loaded 37050 existing records. [2025-09-18T18:19:12.526697] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-09-18T18:19:12.560557] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:19:12.560929] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-18T18:19:12.560980] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-18T18:19:12.575306] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-09-18T18:19:12.575450] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-18T18:19:12.726105] [DEBUG] [LOCAL ] CTRA: Loaded 53649 existing records from primary storage. [2025-09-18T18:19:12.743130] [INFO ] [MAIN ] CTRA: Loaded 53649 existing records. [2025-09-18T18:19:12.883598] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:19:12.947114] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-09-18T18:19:13.083427] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:19:13.122956] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-18T18:19:13.133769] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-18T18:19:13.150414] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-18T18:19:13.159936] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-18T18:19:13.163730] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:19:13.325352] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-09-18T18:19:13.559119] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:19:14.119547] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-11. [2025-09-18T18:19:14.666203] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T18:19:14.919553] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-09-18T18:19:15.537004] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T18:19:15.719519] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-11. [2025-09-18T18:19:16.114227] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-18T18:19:16.519568] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-18T18:19:17.319571] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-09-18T18:19:17.410043] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-18T18:19:17.592191] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:19:17.592552] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-09-18T18:19:17.800547] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-18T18:19:18.119564] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-02. [2025-09-18T18:19:18.546456] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-18T18:19:18.919567] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-09-18T18:19:19.719579] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-09-18T18:19:20.519519] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-03. [2025-09-18T18:19:20.628578] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-18T18:19:20.828804] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T18:19:21.137171] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-18T18:19:21.319543] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-09-18T18:19:22.119575] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-04. [2025-09-18T18:19:22.925126] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-09-18T18:19:22.925988] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-18T18:19:23.201812] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-18T18:19:23.719552] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-18T18:19:24.095849] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T18:19:24.519566] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-18T18:19:25.319596] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-18T18:19:25.417463] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-18T18:19:25.576352] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-18T18:19:26.119548] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-18T18:19:26.579830] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-18T18:19:26.919553] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-18T18:19:27.135949] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-18T18:19:27.719555] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-18T18:19:28.056011] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-18T18:19:28.519596] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-18T18:19:29.319556] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-18T18:19:29.600888] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-18T18:19:29.728330] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T18:19:30.119551] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-05. [2025-09-18T18:19:30.624314] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-18T18:19:30.919595] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-18T18:19:30.941819] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-18T18:19:31.719608] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-18T18:19:32.338960] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-18T18:19:32.519539] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-18T18:19:33.319577] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-18T18:19:33.446331] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-18T18:19:33.474900] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-18T18:19:34.119604] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-18T18:19:34.385979] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-18T18:19:34.919625] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-18T18:19:35.719624] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-18T18:19:35.759983] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-18T18:19:36.515051] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-18T18:19:36.523708] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-18T18:19:36.972997] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T18:19:37.319608] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-18T18:19:38.119615] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-06. [2025-09-18T18:19:38.318567] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-18T18:19:38.382678] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-18T18:19:38.656965] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-18T18:19:38.919574] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-07. [2025-09-18T18:19:39.719562] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-18T18:19:39.818422] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-18T18:19:40.519793] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-08. [2025-09-18T18:19:41.319592] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-18T18:19:41.678891] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-18T18:19:41.810752] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-18T18:19:42.119604] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-09. [2025-09-18T18:19:42.253049] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-18T18:19:42.259804] [INFO ] [REMOTE ] CTOS: Full fetch complete (53051 records). [2025-09-18T18:19:42.259970] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-18T18:19:42.261279] [FATAL] [VALIDATOR ] CTOS: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:19:42.261382] [FATAL] [MAIN ] CTOS: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:19:42.261463] [WARN ] [MAIN ] CTOS: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:19:42.261575] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-18T18:19:42.261899] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-09-18T18:19:42.261990] [INFO ] [LOCAL ] CTOS: Starting deletion of derivative data. [2025-09-18T18:19:42.262525] [DEBUG] [LOCAL ] CTOS: Deleted derivative data file. [2025-09-18T18:19:42.262685] [INFO ] [MAIN ] Update Progress: 547/2372 symbols completed. CTOS took 30.3s. Estimated remaining: 4h 25m 44s. Rate: 6.9 symbols/min [2025-09-18T18:19:42.446035] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:19:42.499003] [DEBUG] [LOCAL ] CTRE: Loaded 49196 existing records from primary storage. [2025-09-18T18:19:42.499144] [INFO ] [MAIN ] CTRE: Loaded 49196 existing records. [2025-09-18T18:19:42.682813] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:19:42.683113] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-18T18:19:42.683168] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-18T18:19:42.685048] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-18T18:19:42.685111] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-18T18:19:42.926312] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-18T18:19:42.989434] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-18T18:19:43.038297] [INFO ] [REMOTE ] CTEV: Full fetch complete (13201 records). [2025-09-18T18:19:43.052983] [DEBUG] [VALIDATOR ] CTEV: Validating primary data. [2025-09-18T18:19:43.116503] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:19:43.269353] [WARN ] [VALIDATOR ] CTEV: Validation failed - insufficient historical data. Have 140 unique days, need 200 days [2025-09-18T18:19:43.269680] [FATAL] [MAIN ] CTEV: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:19:43.269759] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:19:43.269832] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-18T18:19:43.269907] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-18T18:19:43.269945] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-18T18:19:43.269987] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-18T18:19:43.270063] [INFO ] [MAIN ] Update Progress: 548/2372 symbols completed. CTEV took 42.0s. Estimated remaining: 4h 25m 10s. Rate: 6.9 symbols/min [2025-09-18T18:19:43.450114] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:19:43.450289] [DEBUG] [LOCAL ] CTRI: No existing data file found in primary storage. [2025-09-18T18:19:43.450329] [WARN ] [MAIN ] CTRI: No existing data found, performing full refresh instead. [2025-09-18T18:19:43.450488] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-18T18:19:43.450537] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-18T18:19:43.450590] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-09-18T18:19:43.450625] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-18T18:19:43.729490] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-18T18:19:43.842676] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:19:44.201356] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-18T18:19:44.519576] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-11. [2025-09-18T18:19:45.319598] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-11. [2025-09-18T18:19:45.570085] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-18T18:19:45.909160] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T18:19:46.119629] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-18T18:19:46.727101] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-18T18:19:46.919607] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-09-18T18:19:47.250392] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-18T18:19:47.254478] [INFO ] [REMOTE ] CTO: Full fetch complete (41866 records). [2025-09-18T18:19:47.254566] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-18T18:19:47.632370] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-09-18T18:19:47.632458] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-09-18T18:19:47.633006] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-09-18T18:19:47.633081] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-09-18T18:19:47.634141] [DEBUG] [LOCAL ] CTO: Trimmed 41866 records to 28716 (keeping 200 days of data) [2025-09-18T18:19:47.725747] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-18T18:19:47.814533] [DEBUG] [LOCAL ] CTO: Primary data saved (28716 records). [2025-09-18T18:19:47.814721] [INFO ] [MAIN ] CTO: Full history saved. [2025-09-18T18:19:47.814845] [INFO ] [MAIN ] Update Progress: 549/2372 symbols completed. CTO took 40.7s. Estimated remaining: 4h 24m 47s. Rate: 6.9 symbols/min [2025-09-18T18:19:47.995321] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:19:48.017666] [DEBUG] [LOCAL ] CTS: Loaded 19336 existing records from primary storage. [2025-09-18T18:19:48.017827] [INFO ] [MAIN ] CTS: Loaded 19336 existing records. [2025-09-18T18:19:48.200068] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:19:48.200457] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-18T18:19:48.200532] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-18T18:19:48.201201] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-18T18:19:48.201274] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-18T18:19:48.520043] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-09-18T18:19:48.563555] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:19:48.608483] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-18T18:19:49.219446] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T18:19:49.229141] [INFO ] [REMOTE ] CTRA: Full fetch complete (77511 records). [2025-09-18T18:19:49.229372] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-18T18:19:49.327683] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-11. [2025-09-18T18:19:49.663175] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-18T18:19:49.663290] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-18T18:19:49.664868] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-18T18:19:49.664953] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-18T18:19:49.667144] [DEBUG] [LOCAL ] CTRA: Trimmed 77511 records to 54039 (keeping 200 days of data) [2025-09-18T18:19:49.828563] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T18:19:50.055054] [DEBUG] [LOCAL ] CTRA: Primary data saved (54039 records). [2025-09-18T18:19:50.055243] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-18T18:19:50.055379] [INFO ] [MAIN ] Update Progress: 550/2372 symbols completed. CTRA took 37.9s. Estimated remaining: 4h 24m 17s. Rate: 6.9 symbols/min [2025-09-18T18:19:50.126639] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-09-18T18:19:50.254357] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:19:50.311351] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-18T18:19:50.333868] [DEBUG] [LOCAL ] CTVA: Loaded 53231 existing records from primary storage. [2025-09-18T18:19:50.334120] [INFO ] [MAIN ] CTVA: Loaded 53231 existing records. [2025-09-18T18:19:50.527955] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:19:50.528324] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-18T18:19:50.528406] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-18T18:19:50.530439] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-09-18T18:19:50.530514] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-18T18:19:50.886972] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:19:50.919511] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-11. [2025-09-18T18:19:51.719586] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-09-18T18:19:51.939421] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-18T18:19:52.519534] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-18T18:19:52.582910] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-18T18:19:52.716327] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-18T18:19:53.319583] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-18T18:19:53.868161] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T18:19:54.119589] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-09-18T18:19:54.497150] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-18T18:19:54.919601] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-18T18:19:55.719593] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-09-18T18:19:55.764021] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-18T18:19:56.325573] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-18T18:19:56.403611] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-18T18:19:56.519599] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-09-18T18:19:57.319588] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-09-18T18:19:57.519708] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-18T18:19:58.119578] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-18T18:19:58.919697] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-18T18:19:58.957414] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-18T18:19:59.591459] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-18T18:19:59.621439] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-18T18:19:59.719586] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-18T18:20:00.519556] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-18T18:20:01.319612] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-18T18:20:01.503159] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-18T18:20:02.119629] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-18T18:20:02.175416] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-18T18:20:02.403102] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-18T18:20:02.919546] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-18T18:20:03.639967] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-18T18:20:03.719535] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-18T18:20:04.124942] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-18T18:20:04.519580] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-18T18:20:05.319579] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-18T18:20:05.411821] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-18T18:20:05.589793] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-18T18:20:06.119567] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-18T18:20:06.307355] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-18T18:20:06.919600] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-18T18:20:07.719550] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-18T18:20:07.896808] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-18T18:20:08.519586] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-18T18:20:09.167438] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-18T18:20:09.319585] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-18T18:20:09.411148] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-18T18:20:09.450299] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-18T18:20:10.119546] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-18T18:20:10.861788] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-18T18:20:10.932539] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-18T18:20:10.957113] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T18:20:11.719548] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-18T18:20:12.179130] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T18:20:12.519585] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-18T18:20:13.319552] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-18T18:20:13.665121] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-18T18:20:13.718064] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-18T18:20:14.119575] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-18T18:20:14.928698] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-18T18:20:14.950308] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-18T18:20:15.719560] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-18T18:20:16.204919] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-18T18:20:16.264196] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-18T18:20:16.519537] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-18T18:20:17.046259] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-18T18:20:17.225493] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-18T18:20:17.229130] [INFO ] [REMOTE ] CTS: Full fetch complete (26449 records). [2025-09-18T18:20:17.229228] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-18T18:20:17.324747] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-18T18:20:17.616948] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-18T18:20:17.617043] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-18T18:20:17.617446] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-18T18:20:17.617488] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-18T18:20:17.619416] [DEBUG] [LOCAL ] CTS: Trimmed 26449 records to 19514 (keeping 200 days of data) [2025-09-18T18:20:17.744381] [DEBUG] [LOCAL ] CTS: Primary data saved (19514 records). [2025-09-18T18:20:17.744526] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-18T18:20:17.744633] [INFO ] [MAIN ] Update Progress: 551/2372 symbols completed. CTS took 29.9s. Estimated remaining: 4h 25m 11s. Rate: 6.9 symbols/min [2025-09-18T18:20:17.920129] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:20:17.921188] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-18T18:20:17.921244] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-18T18:20:17.921487] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-18T18:20:17.921717] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-18T18:20:17.921782] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-18T18:20:17.921817] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-18T18:20:18.124685] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-18T18:20:18.287801] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:20:18.919554] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-11. [2025-09-18T18:20:19.303422] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-11 (0.38 seconds). [2025-09-18T18:20:19.719540] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-09-18T18:20:19.924896] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-18T18:20:19.990574] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-09-18T18:20:20.519548] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-09-18T18:20:20.868572] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-18T18:20:21.024013] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (3.70 seconds). [2025-09-18T18:20:21.031062] [INFO ] [REMOTE ] CTRI: Full fetch complete (50366 records). [2025-09-18T18:20:21.031186] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-18T18:20:21.322726] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-18T18:20:21.414701] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-09-18T18:20:21.414793] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-09-18T18:20:21.415362] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-09-18T18:20:21.415405] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-09-18T18:20:21.416497] [DEBUG] [LOCAL ] CTRI: Trimmed 50366 records to 37668 (keeping 200 days of data) [2025-09-18T18:20:21.651033] [DEBUG] [LOCAL ] CTRI: Primary data saved (37668 records). [2025-09-18T18:20:21.651196] [INFO ] [MAIN ] CTRI: Full history saved. [2025-09-18T18:20:21.651298] [INFO ] [MAIN ] Update Progress: 552/2372 symbols completed. CTRI took 38.4s. Estimated remaining: 4h 24m 46s. Rate: 6.9 symbols/min [2025-09-18T18:20:21.740892] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-18T18:20:21.834320] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:20:21.895593] [DEBUG] [LOCAL ] CUBE: Loaded 50754 existing records from primary storage. [2025-09-18T18:20:21.895794] [INFO ] [MAIN ] CUBE: Loaded 50754 existing records. [2025-09-18T18:20:22.070841] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:20:22.071118] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-18T18:20:22.071174] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-18T18:20:22.072373] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-09-18T18:20:22.072435] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-18T18:20:22.124743] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-18T18:20:22.429937] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:20:22.919547] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-11. [2025-09-18T18:20:23.719561] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-18T18:20:24.098839] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-18T18:20:24.119163] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-18T18:20:24.126070] [INFO ] [REMOTE ] CTRE: Full fetch complete (70924 records). [2025-09-18T18:20:24.126186] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-18T18:20:24.521082] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-18T18:20:24.548050] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-18T18:20:24.548223] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-18T18:20:24.549209] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-18T18:20:24.549426] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-18T18:20:24.560725] [DEBUG] [LOCAL ] CTRE: Trimmed 70924 records to 49577 (keeping 200 days of data) [2025-09-18T18:20:24.582033] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-18T18:20:24.905568] [DEBUG] [LOCAL ] CTRE: Primary data saved (49577 records). [2025-09-18T18:20:24.905736] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-18T18:20:24.905838] [INFO ] [MAIN ] Update Progress: 553/2372 symbols completed. CTRE took 42.6s. Estimated remaining: 4h 24m 19s. Rate: 6.9 symbols/min [2025-09-18T18:20:25.002547] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-18T18:20:25.082743] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:20:25.110370] [DEBUG] [LOCAL ] CUBI: Loaded 27280 existing records from primary storage. [2025-09-18T18:20:25.110502] [INFO ] [MAIN ] CUBI: Loaded 27280 existing records. [2025-09-18T18:20:25.290444] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:20:25.290827] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-18T18:20:25.290885] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-18T18:20:25.291525] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-09-18T18:20:25.291584] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-18T18:20:25.324625] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-18T18:20:25.654791] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:20:26.119532] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-09-18T18:20:26.919562] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-11. [2025-09-18T18:20:27.269971] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-18T18:20:27.724352] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-18T18:20:27.730528] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-18T18:20:28.268758] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-18T18:20:28.519598] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-09-18T18:20:29.258055] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-18T18:20:29.268780] [INFO ] [REMOTE ] CTVA: Full fetch complete (76377 records). [2025-09-18T18:20:29.269006] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-18T18:20:29.270264] [FATAL] [VALIDATOR ] CTVA: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:20:29.270399] [FATAL] [MAIN ] CTVA: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:20:29.270470] [WARN ] [MAIN ] CTVA: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:20:29.270542] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-18T18:20:29.270670] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-09-18T18:20:29.270751] [INFO ] [LOCAL ] CTVA: Starting deletion of derivative data. [2025-09-18T18:20:29.271294] [DEBUG] [LOCAL ] CTVA: Deleted derivative data file. [2025-09-18T18:20:29.271427] [INFO ] [MAIN ] Update Progress: 554/2372 symbols completed. CTVA took 39.2s. Estimated remaining: 4h 23m 56s. Rate: 6.9 symbols/min [2025-09-18T18:20:29.324741] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-09-18T18:20:29.483408] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:20:29.539749] [DEBUG] [LOCAL ] CUK: Loaded 51042 existing records from primary storage. [2025-09-18T18:20:29.540132] [INFO ] [MAIN ] CUK: Loaded 51042 existing records. [2025-09-18T18:20:29.734132] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:20:29.734402] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-18T18:20:29.734451] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-18T18:20:29.735564] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-18T18:20:29.735625] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-18T18:20:30.105190] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-18T18:20:30.120732] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-18T18:20:30.147301] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:20:30.506213] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-18T18:20:30.871474] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T18:20:30.919499] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-11. [2025-09-18T18:20:31.719563] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-18T18:20:32.020079] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-18T18:20:32.519549] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-09-18T18:20:32.731221] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-18T18:20:33.319560] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-18T18:20:33.430800] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-18T18:20:34.119551] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-18T18:20:34.430905] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-18T18:20:34.919529] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-18T18:20:35.028608] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-18T18:20:35.295421] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-18T18:20:35.719575] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-18T18:20:36.519563] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-09-18T18:20:36.569924] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-18T18:20:37.319543] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-18T18:20:38.119522] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-18T18:20:38.150450] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-18T18:20:38.919562] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-18T18:20:39.070735] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-18T18:20:39.158819] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-18T18:20:39.342702] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-18T18:20:39.343430] [INFO ] [REMOTE ] CUBB: Full fetch complete (924 records). [2025-09-18T18:20:39.343520] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-18T18:20:39.523579] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-18T18:20:39.523846] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:20:39.523936] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:20:39.524031] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-18T18:20:39.524112] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-18T18:20:39.524155] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-18T18:20:39.524213] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-18T18:20:39.524297] [INFO ] [MAIN ] Update Progress: 555/2372 symbols completed. CUBB took 21.8s. Estimated remaining: 4h 23m 53s. Rate: 6.9 symbols/min [2025-09-18T18:20:39.697897] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:20:39.698090] [DEBUG] [LOCAL ] CULP: No existing data file found in primary storage. [2025-09-18T18:20:39.698130] [WARN ] [MAIN ] CULP: No existing data found, performing full refresh instead. [2025-09-18T18:20:39.698340] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-18T18:20:39.698394] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-18T18:20:39.698440] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-09-18T18:20:39.698475] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-18T18:20:39.729709] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-18T18:20:40.068561] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:20:40.519542] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-18T18:20:41.319521] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-11. [2025-09-18T18:20:41.384537] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-18T18:20:41.669947] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-18T18:20:41.923818] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-18T18:20:42.119556] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-18T18:20:42.919592] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-18T18:20:43.208184] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-18T18:20:43.719556] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-09-18T18:20:44.519549] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-18T18:20:44.562978] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-18T18:20:45.319592] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-18T18:20:45.424758] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-18T18:20:45.451848] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-18T18:20:46.119572] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-18T18:20:46.919561] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-18T18:20:47.077364] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-18T18:20:47.719517] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-18T18:20:47.774519] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-18T18:20:47.940671] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-18T18:20:48.519555] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-18T18:20:49.319578] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-09-18T18:20:49.501131] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-18T18:20:49.819375] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-18T18:20:50.119558] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-18T18:20:50.205204] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-18T18:20:50.919559] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-18T18:20:51.432753] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-18T18:20:51.719554] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-18T18:20:52.519529] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-09-18T18:20:52.901017] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-18T18:20:53.081105] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-18T18:20:53.089374] [INFO ] [REMOTE ] CUBE: Full fetch complete (72790 records). [2025-09-18T18:20:53.089540] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-18T18:20:53.225139] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-18T18:20:53.325942] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-18T18:20:53.511713] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-09-18T18:20:53.511817] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-09-18T18:20:53.512610] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-09-18T18:20:53.512684] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-09-18T18:20:53.514330] [DEBUG] [LOCAL ] CUBE: Trimmed 72790 records to 51124 (keeping 200 days of data) [2025-09-18T18:20:53.838858] [DEBUG] [LOCAL ] CUBE: Primary data saved (51124 records). [2025-09-18T18:20:53.839005] [INFO ] [MAIN ] CUBE: Full history saved. [2025-09-18T18:20:53.840115] [INFO ] [MAIN ] Update Progress: 556/2372 symbols completed. CUBE took 32.2s. Estimated remaining: 4h 24m 2s. Rate: 6.9 symbols/min [2025-09-18T18:20:54.010351] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:20:54.043709] [DEBUG] [LOCAL ] CURB: Loaded 33031 existing records from primary storage. [2025-09-18T18:20:54.043880] [INFO ] [MAIN ] CURB: Loaded 33031 existing records. [2025-09-18T18:20:54.125696] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-18T18:20:54.243219] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:20:54.243500] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-18T18:20:54.243552] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-18T18:20:54.244471] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-09-18T18:20:54.244536] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-18T18:20:54.626235] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:20:54.919545] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-11. [2025-09-18T18:20:55.188847] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-18T18:20:55.278416] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-18T18:20:55.719566] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-18T18:20:55.938141] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-18T18:20:56.519551] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-09-18T18:20:56.912295] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-18T18:20:56.917011] [INFO ] [REMOTE ] CUBI: Full fetch complete (39111 records). [2025-09-18T18:20:56.917105] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-18T18:20:57.297452] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-09-18T18:20:57.297543] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-09-18T18:20:57.298044] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-09-18T18:20:57.298106] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-09-18T18:20:57.299034] [DEBUG] [LOCAL ] CUBI: Trimmed 39111 records to 27519 (keeping 200 days of data) [2025-09-18T18:20:57.348727] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-18T18:20:57.471763] [DEBUG] [LOCAL ] CUBI: Primary data saved (27519 records). [2025-09-18T18:20:57.471918] [INFO ] [MAIN ] CUBI: Full history saved. [2025-09-18T18:20:57.472022] [INFO ] [MAIN ] Update Progress: 557/2372 symbols completed. CUBI took 32.6s. Estimated remaining: 4h 23m 37s. Rate: 6.9 symbols/min [2025-09-18T18:20:57.835961] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-18T18:20:58.119568] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-09-18T18:20:58.919568] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-18T18:20:58.956268] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-18T18:20:59.117748] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-18T18:20:59.297784] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-18T18:20:59.719587] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-18T18:21:00.152868] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-18T18:21:00.519549] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-18T18:21:00.958054] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-18T18:21:01.319549] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-18T18:21:02.119569] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-18T18:21:02.919557] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-18T18:21:04.219032] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (2.90 seconds). [2025-09-18T18:21:04.220479] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-18T18:21:04.858745] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-18T18:21:04.860143] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-18T18:21:05.107309] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-18T18:21:05.319594] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-18T18:21:05.448530] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-18T18:21:05.659679] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (3.54 seconds). [2025-09-18T18:21:06.119544] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-18T18:21:06.665994] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-18T18:21:06.919558] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-18T18:21:07.719577] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-18T18:21:08.088316] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-18T18:21:08.088147] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-18T18:21:08.130519] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-18T18:21:08.519543] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-18T18:21:09.319550] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-18T18:21:10.119601] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-18T18:21:10.182408] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-18T18:21:10.540726] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-18T18:21:10.548064] [INFO ] [REMOTE ] CUK: Full fetch complete (73483 records). [2025-09-18T18:21:10.548210] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-18T18:21:10.659494] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-18T18:21:10.681557] [INFO ] [REMOTE ] CULP: Full fetch complete (4773 records). [2025-09-18T18:21:10.704902] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-18T18:21:10.925535] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-18T18:21:11.345083] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-09-18T18:21:11.361496] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-09-18T18:21:11.369116] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-09-18T18:21:11.369965] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-09-18T18:21:11.370050] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-09-18T18:21:11.370100] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-09-18T18:21:11.370352] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-09-18T18:21:11.370409] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-09-18T18:21:11.371053] [DEBUG] [LOCAL ] CULP: Trimmed 4773 records to 3147 (keeping 200 days of data) [2025-09-18T18:21:11.379268] [DEBUG] [LOCAL ] CUK: Trimmed 73483 records to 51410 (keeping 200 days of data) [2025-09-18T18:21:11.450573] [DEBUG] [LOCAL ] CULP: Primary data saved (3147 records). [2025-09-18T18:21:11.451031] [INFO ] [MAIN ] CULP: Full history saved. [2025-09-18T18:21:11.476694] [INFO ] [MAIN ] Update Progress: 558/2372 symbols completed. CULP took 32.0s. Estimated remaining: 4h 23m 46s. Rate: 6.9 symbols/min [2025-09-18T18:21:11.697567] [DEBUG] [LOCAL ] CUK: Primary data saved (51410 records). [2025-09-18T18:21:11.697746] [INFO ] [MAIN ] CUK: Full history saved. [2025-09-18T18:21:11.697844] [INFO ] [MAIN ] Update Progress: 559/2372 symbols completed. CUK took 42.4s. Estimated remaining: 4h 23m 9s. Rate: 6.9 symbols/min [2025-09-18T18:21:12.345776] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-18T18:21:12.352489] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-18T18:21:13.667449] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-18T18:21:13.675041] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-18T18:21:15.031046] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-18T18:21:15.038868] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-18T18:21:16.696695] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-18T18:21:16.703780] [INFO ] [REMOTE ] CURB: Full fetch complete (47095 records). [2025-09-18T18:21:16.703955] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-18T18:21:17.095199] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-09-18T18:21:17.095285] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-09-18T18:21:17.095866] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-09-18T18:21:17.095942] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-09-18T18:21:17.097115] [DEBUG] [LOCAL ] CURB: Trimmed 47095 records to 33297 (keeping 200 days of data) [2025-09-18T18:21:17.304268] [DEBUG] [LOCAL ] CURB: Primary data saved (33297 records). [2025-09-18T18:21:17.304507] [INFO ] [MAIN ] CURB: Full history saved. [2025-09-18T18:21:17.304665] [INFO ] [MAIN ] Update Progress: 560/2372 symbols completed. CURB took 23.5s. Estimated remaining: 4h 22m 51s. Rate: 6.9 symbols/min [2025-09-18T18:21:18.141474] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:21:18.134295] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:21:18.166567] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:21:18.168002] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:21:18.168929] [DEBUG] [LOCAL ] CURV: No existing data file found in primary storage. [2025-09-18T18:21:18.169034] [WARN ] [MAIN ] CURV: No existing data found, performing full refresh instead. [2025-09-18T18:21:18.170299] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-18T18:21:18.170439] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-18T18:21:18.170550] [DEBUG] [LOCAL ] CURV: No primary data file found to delete. [2025-09-18T18:21:18.170636] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-18T18:21:18.326492] [DEBUG] [LOCAL ] CVEO: Loaded 15638 existing records from primary storage. [2025-09-18T18:21:18.353342] [INFO ] [MAIN ] CVEO: Loaded 15638 existing records. [2025-09-18T18:21:18.663679] [DEBUG] [LOCAL ] CUZ: Loaded 49356 existing records from primary storage. [2025-09-18T18:21:18.697695] [INFO ] [MAIN ] CUZ: Loaded 49356 existing records. [2025-09-18T18:21:18.817010] [DEBUG] [LOCAL ] CVE: Loaded 53558 existing records from primary storage. [2025-09-18T18:21:18.858804] [INFO ] [MAIN ] CVE: Loaded 53558 existing records. [2025-09-18T18:21:18.916805] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:21:18.956967] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:21:18.987160] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-18T18:21:18.996420] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-11. [2025-09-18T18:21:19.038990] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-18T18:21:19.106497] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-09-18T18:21:19.133065] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-18T18:21:19.133211] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:21:19.186235] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-18T18:21:19.216391] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-18T18:21:19.279420] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-09-18T18:21:19.300744] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-18T18:21:19.314219] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:21:19.348927] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-18T18:21:19.384869] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-18T18:21:19.503000] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-18T18:21:19.550552] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-18T18:21:20.003856] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:21:20.033459] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-11. [2025-09-18T18:21:20.278592] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:21:20.289212] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-11. [2025-09-18T18:21:20.352021] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:21:20.352380] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-11. [2025-09-18T18:21:20.386618] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T18:21:20.392947] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-09-18T18:21:21.062795] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-18T18:21:21.067302] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-09-18T18:21:21.690063] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-18T18:21:21.699061] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-09-18T18:21:21.708901] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-18T18:21:21.712177] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-09-18T18:21:22.057172] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-18T18:21:22.067199] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-09-18T18:21:22.142841] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-18T18:21:22.153105] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-09-18T18:21:22.285424] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-18T18:21:22.287809] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-18T18:21:22.634777] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-18T18:21:22.869560] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-18T18:21:22.919512] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-18T18:21:23.525419] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-18T18:21:23.719526] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-09-18T18:21:23.738182] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-18T18:21:23.847726] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-18T18:21:24.519552] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-09-18T18:21:25.319561] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-18T18:21:25.394172] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-18T18:21:26.044921] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-18T18:21:26.119514] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-18T18:21:26.325891] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T18:21:26.919543] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-18T18:21:27.719530] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-18T18:21:27.902898] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-18T18:21:28.519543] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-18T18:21:29.067274] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-18T18:21:29.103247] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-18T18:21:29.319560] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-18T18:21:29.988932] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-18T18:21:30.119570] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-18T18:21:30.388852] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-18T18:21:30.747877] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-18T18:21:30.919606] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-18T18:21:31.719584] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-18T18:21:32.519545] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-18T18:21:32.684038] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-18T18:21:33.319535] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-18T18:21:33.377861] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-18T18:21:33.672544] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-18T18:21:34.119595] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-18T18:21:34.482982] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-18T18:21:34.919559] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-18T18:21:35.041568] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T18:21:35.719572] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-18T18:21:35.827353] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-18T18:21:36.519564] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-18T18:21:36.905014] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-18T18:21:37.319608] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-18T18:21:38.119718] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-18T18:21:38.477633] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-18T18:21:38.550747] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-18T18:21:38.919569] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-18T18:21:38.935478] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-18T18:21:39.719614] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-18T18:21:40.418563] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-18T18:21:40.519856] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-18T18:21:40.519750] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-18T18:21:41.319596] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-18T18:21:41.892070] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-18T18:21:42.119588] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-18T18:21:42.260082] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-18T18:21:42.262601] [INFO ] [REMOTE ] CVEO: Full fetch complete (20142 records). [2025-09-18T18:21:42.262724] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-18T18:21:42.644222] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-09-18T18:21:42.644320] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-09-18T18:21:42.644703] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-09-18T18:21:42.644777] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-09-18T18:21:42.645859] [DEBUG] [LOCAL ] CVEO: Trimmed 20142 records to 15698 (keeping 200 days of data) [2025-09-18T18:21:42.738845] [DEBUG] [LOCAL ] CVEO: Primary data saved (15698 records). [2025-09-18T18:21:42.738985] [INFO ] [MAIN ] CVEO: Full history saved. [2025-09-18T18:21:42.739075] [INFO ] [MAIN ] Update Progress: 561/2372 symbols completed. CVEO took 25.4s. Estimated remaining: 4h 23m 36s. Rate: 6.9 symbols/min [2025-09-18T18:21:42.916282] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:21:42.919520] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-18T18:21:42.964871] [DEBUG] [LOCAL ] CVI: Loaded 46415 existing records from primary storage. [2025-09-18T18:21:42.965058] [INFO ] [MAIN ] CVI: Loaded 46415 existing records. [2025-09-18T18:21:43.149151] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:21:43.149619] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-18T18:21:43.149738] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-18T18:21:43.151305] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-09-18T18:21:43.151370] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-18T18:21:43.558118] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:21:43.573773] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T18:21:43.579368] [INFO ] [REMOTE ] CURV: Full fetch complete (39842 records). [2025-09-18T18:21:43.579486] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-18T18:21:43.735483] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-11. [2025-09-18T18:21:43.987632] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-09-18T18:21:43.987745] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-09-18T18:21:43.988233] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-09-18T18:21:43.988274] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-09-18T18:21:43.989253] [DEBUG] [LOCAL ] CURV: Trimmed 39842 records to 26800 (keeping 200 days of data) [2025-09-18T18:21:44.143391] [DEBUG] [LOCAL ] CURV: Primary data saved (26800 records). [2025-09-18T18:21:44.143540] [INFO ] [MAIN ] CURV: Full history saved. [2025-09-18T18:21:44.143633] [INFO ] [MAIN ] Update Progress: 562/2372 symbols completed. CURV took 26.8s. Estimated remaining: 4h 23m 3s. Rate: 6.9 symbols/min [2025-09-18T18:21:44.319496] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:21:44.336907] [DEBUG] [LOCAL ] CVLG: Loaded 15413 existing records from primary storage. [2025-09-18T18:21:44.337040] [INFO ] [MAIN ] CVLG: Loaded 15413 existing records. [2025-09-18T18:21:44.519815] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-18T18:21:44.524034] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:21:44.525503] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-18T18:21:44.525564] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-18T18:21:44.526266] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-18T18:21:44.526328] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-18T18:21:44.919871] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:21:44.954239] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-18T18:21:45.117621] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-18T18:21:45.319540] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-11. [2025-09-18T18:21:46.119626] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-18T18:21:46.312704] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-18T18:21:46.348996] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-18T18:21:46.919556] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-09-18T18:21:47.419883] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T18:21:47.453046] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-18T18:21:47.719559] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-18T18:21:48.519591] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-09-18T18:21:49.319571] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-09-18T18:21:49.467515] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-18T18:21:49.518850] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-18T18:21:50.119565] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-18T18:21:50.924738] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-18T18:21:50.942199] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-18T18:21:50.960865] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-18T18:21:51.719631] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-18T18:21:52.393954] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-18T18:21:52.404098] [INFO ] [REMOTE ] CUZ: Full fetch complete (70166 records). [2025-09-18T18:21:52.404302] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-18T18:21:52.405953] [FATAL] [VALIDATOR ] CUZ: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:21:52.406061] [FATAL] [MAIN ] CUZ: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:21:52.406135] [WARN ] [MAIN ] CUZ: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:21:52.406233] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-18T18:21:52.406334] [DEBUG] [LOCAL ] CUZ: No primary data file found to delete. [2025-09-18T18:21:52.406449] [INFO ] [LOCAL ] CUZ: Starting deletion of derivative data. [2025-09-18T18:21:52.407018] [DEBUG] [LOCAL ] CUZ: Deleted derivative data file. [2025-09-18T18:21:52.407144] [INFO ] [MAIN ] Update Progress: 563/2372 symbols completed. CUZ took 35.1s. Estimated remaining: 4h 22m 53s. Rate: 6.9 symbols/min [2025-09-18T18:21:52.524690] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-18T18:21:52.593581] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:21:52.654266] [DEBUG] [LOCAL ] CVNA: Loaded 53072 existing records from primary storage. [2025-09-18T18:21:52.654425] [INFO ] [MAIN ] CVNA: Loaded 53072 existing records. [2025-09-18T18:21:52.845755] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-18T18:21:52.863279] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:21:52.863817] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-18T18:21:52.863875] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-18T18:21:52.865536] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-18T18:21:52.865622] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-18T18:21:53.233486] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:21:53.319497] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-11. [2025-09-18T18:21:54.119509] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-18T18:21:54.230943] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-18T18:21:54.919549] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-18T18:21:55.152440] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-18T18:21:55.342037] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-18T18:21:55.719583] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-18T18:21:56.519554] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-09-18T18:21:56.676281] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-18T18:21:56.872688] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-18T18:21:57.319544] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-09-18T18:21:57.674873] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-18T18:21:58.119566] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-18T18:21:58.919609] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-18T18:21:59.070351] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-18T18:21:59.173355] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-18T18:21:59.719555] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-18T18:22:00.519598] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-09-18T18:22:00.651157] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-18T18:22:00.659880] [INFO ] [REMOTE ] CVE: Full fetch complete (77389 records). [2025-09-18T18:22:00.660063] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-18T18:22:01.085057] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-18T18:22:01.085149] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-18T18:22:01.085958] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-18T18:22:01.086028] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-18T18:22:01.093615] [DEBUG] [LOCAL ] CVE: Trimmed 77389 records to 53947 (keeping 200 days of data) [2025-09-18T18:22:01.338390] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-18T18:22:01.375583] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-18T18:22:01.504558] [DEBUG] [LOCAL ] CVE: Primary data saved (53947 records). [2025-09-18T18:22:01.504749] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-18T18:22:01.504868] [INFO ] [MAIN ] Update Progress: 564/2372 symbols completed. CVE took 44.2s. Estimated remaining: 4h 22m 46s. Rate: 6.9 symbols/min [2025-09-18T18:22:01.684579] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:22:01.684847] [DEBUG] [LOCAL ] CVS: No existing data file found in primary storage. [2025-09-18T18:22:01.684912] [WARN ] [MAIN ] CVS: No existing data found, performing full refresh instead. [2025-09-18T18:22:01.685177] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-18T18:22:01.685245] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-18T18:22:01.685314] [DEBUG] [LOCAL ] CVS: No primary data file found to delete. [2025-09-18T18:22:01.685367] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-18T18:22:02.065136] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:22:02.119556] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-11. [2025-09-18T18:22:02.367721] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-18T18:22:02.466881] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-18T18:22:02.919591] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-18T18:22:03.719620] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-18T18:22:03.768611] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-18T18:22:04.039525] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-18T18:22:04.519591] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-18T18:22:05.223050] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-18T18:22:05.319548] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-09-18T18:22:05.333367] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-18T18:22:06.119601] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-18T18:22:06.919587] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-18T18:22:07.377718] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-18T18:22:07.719548] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-09-18T18:22:07.774623] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-18T18:22:07.812036] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-18T18:22:07.814301] [INFO ] [REMOTE ] CVLG: Full fetch complete (20405 records). [2025-09-18T18:22:07.814377] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-18T18:22:08.217896] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-18T18:22:08.217984] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-18T18:22:08.218488] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-18T18:22:08.218570] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-18T18:22:08.219340] [DEBUG] [LOCAL ] CVLG: Trimmed 20405 records to 15548 (keeping 200 days of data) [2025-09-18T18:22:08.329396] [DEBUG] [LOCAL ] CVLG: Primary data saved (15548 records). [2025-09-18T18:22:08.329556] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-18T18:22:08.329704] [INFO ] [MAIN ] Update Progress: 565/2372 symbols completed. CVLG took 24.2s. Estimated remaining: 4h 22m 31s. Rate: 6.9 symbols/min [2025-09-18T18:22:08.510165] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:22:08.519694] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-18T18:22:08.586534] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-09-18T18:22:08.586719] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-09-18T18:22:08.772554] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:22:08.772837] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-18T18:22:08.772888] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-18T18:22:08.774434] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-18T18:22:08.774498] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-18T18:22:09.142168] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:22:09.319524] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-11. [2025-09-18T18:22:09.844955] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-18T18:22:09.886684] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-18T18:22:10.119559] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-18T18:22:10.919573] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-18T18:22:11.344915] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-11 (2.03 seconds). [2025-09-18T18:22:11.573684] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T18:22:11.719557] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-18T18:22:12.519603] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-09-18T18:22:12.829963] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-18T18:22:13.323354] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-18T18:22:13.329750] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T18:22:14.119621] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-18T18:22:14.742257] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-18T18:22:14.919604] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-09-18T18:22:15.414314] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-18T18:22:15.719560] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-18T18:22:16.037689] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-18T18:22:16.519545] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-18T18:22:16.963281] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-18T18:22:17.319581] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-18T18:22:17.939372] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-18T18:22:18.055548] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-18T18:22:18.119539] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-18T18:22:18.919533] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-18T18:22:19.177824] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-18T18:22:19.342539] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-18T18:22:19.719586] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-18T18:22:20.519546] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-18T18:22:21.099717] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-18T18:22:21.319566] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-18T18:22:21.585166] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-18T18:22:21.855714] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-18T18:22:21.866376] [INFO ] [REMOTE ] CVI: Full fetch complete (67065 records). [2025-09-18T18:22:21.866587] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-18T18:22:22.124850] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-18T18:22:22.284770] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-09-18T18:22:22.284854] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-09-18T18:22:22.285554] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-09-18T18:22:22.285597] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-09-18T18:22:22.287041] [DEBUG] [LOCAL ] CVI: Trimmed 67065 records to 46782 (keeping 200 days of data) [2025-09-18T18:22:22.587623] [DEBUG] [LOCAL ] CVI: Primary data saved (46782 records). [2025-09-18T18:22:22.587792] [INFO ] [MAIN ] CVI: Full history saved. [2025-09-18T18:22:22.589290] [INFO ] [MAIN ] Update Progress: 566/2372 symbols completed. CVI took 39.9s. Estimated remaining: 4h 22m 40s. Rate: 6.9 symbols/min [2025-09-18T18:22:22.773382] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:22:22.773861] [DEBUG] [LOCAL ] CW: No existing data file found in primary storage. [2025-09-18T18:22:22.773920] [WARN ] [MAIN ] CW: No existing data found, performing full refresh instead. [2025-09-18T18:22:22.774240] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-18T18:22:22.774319] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-18T18:22:22.774405] [DEBUG] [LOCAL ] CW: No primary data file found to delete. [2025-09-18T18:22:22.774456] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-18T18:22:22.924768] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-18T18:22:23.208294] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:22:23.374921] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-18T18:22:23.719746] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-18T18:22:23.955929] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-18T18:22:24.519627] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-11. [2025-09-18T18:22:25.319523] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-18T18:22:25.432691] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-18T18:22:25.608353] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T18:22:25.759162] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-18T18:22:26.119556] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-18T18:22:26.919524] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-09-18T18:22:27.362921] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-18T18:22:27.719522] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-18T18:22:27.828309] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-18T18:22:27.890993] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-18T18:22:28.519547] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-18T18:22:29.319551] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-09-18T18:22:29.754382] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-18T18:22:30.119565] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-18T18:22:30.459854] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-18T18:22:30.657117] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-18T18:22:30.919528] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-18T18:22:31.719523] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-18T18:22:32.232304] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-18T18:22:32.259838] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-18T18:22:32.519569] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-18T18:22:33.319550] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-18T18:22:34.120192] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-18T18:22:34.413265] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-18T18:22:34.433967] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-18T18:22:34.434326] [INFO ] [REMOTE ] CVS: Full fetch complete (77311 records). [2025-09-18T18:22:34.434700] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-18T18:22:34.448142] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.73 seconds). [2025-09-18T18:22:34.448859] [FATAL] [VALIDATOR ] CVS: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:22:34.466307] [FATAL] [MAIN ] CVS: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:22:34.467081] [WARN ] [MAIN ] CVS: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:22:34.467196] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-18T18:22:34.467837] [DEBUG] [LOCAL ] CVS: No primary data file found to delete. [2025-09-18T18:22:34.467944] [INFO ] [LOCAL ] CVS: Starting deletion of derivative data. [2025-09-18T18:22:34.468023] [DEBUG] [LOCAL ] CVS: No derivative data file found to delete. [2025-09-18T18:22:34.468152] [INFO ] [MAIN ] Update Progress: 567/2372 symbols completed. CVS took 33.0s. Estimated remaining: 4h 22m 41s. Rate: 6.9 symbols/min [2025-09-18T18:22:34.723364] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:22:34.787771] [DEBUG] [LOCAL ] CWAN: Loaded 52384 existing records from primary storage. [2025-09-18T18:22:34.788003] [INFO ] [MAIN ] CWAN: Loaded 52384 existing records. [2025-09-18T18:22:34.924710] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-18T18:22:34.994728] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:22:34.995286] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-18T18:22:34.995365] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-18T18:22:34.997744] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-09-18T18:22:34.997808] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-18T18:22:35.368542] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:22:35.719539] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-18T18:22:35.912056] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-18T18:22:35.920438] [INFO ] [REMOTE ] CVNA: Full fetch complete (76602 records). [2025-09-18T18:22:35.920881] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-18T18:22:36.343214] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-18T18:22:36.343467] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-18T18:22:36.344926] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-18T18:22:36.345082] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-18T18:22:36.360405] [DEBUG] [LOCAL ] CVNA: Trimmed 76602 records to 53454 (keeping 200 days of data) [2025-09-18T18:22:36.362110] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-18T18:22:36.557406] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-18T18:22:36.724207] [DEBUG] [LOCAL ] CVNA: Primary data saved (53454 records). [2025-09-18T18:22:36.724702] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-18T18:22:36.724818] [INFO ] [MAIN ] Update Progress: 568/2372 symbols completed. CVNA took 44.3s. Estimated remaining: 4h 22m 12s. Rate: 6.9 symbols/min [2025-09-18T18:22:36.909343] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:22:36.958866] [DEBUG] [LOCAL ] CWEN: Loaded 45031 existing records from primary storage. [2025-09-18T18:22:36.959040] [INFO ] [MAIN ] CWEN: Loaded 45031 existing records. [2025-09-18T18:22:37.146976] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:22:37.147286] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-18T18:22:37.147335] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-18T18:22:37.148750] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-09-18T18:22:37.148814] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-18T18:22:37.324457] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-11. [2025-09-18T18:22:37.513461] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:22:37.649269] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-18T18:22:38.082900] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-18T18:22:38.119564] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-18T18:22:38.706068] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-18T18:22:38.919574] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-11. [2025-09-18T18:22:39.133265] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-18T18:22:39.719591] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-18T18:22:40.367161] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-18T18:22:40.519576] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-09-18T18:22:41.319571] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-18T18:22:41.867473] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-18T18:22:42.119684] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-18T18:22:42.128085] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-18T18:22:42.189549] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-18T18:22:42.919602] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-09-18T18:22:43.719567] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-18T18:22:44.123347] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T18:22:44.373716] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-18T18:22:44.381497] [INFO ] [REMOTE ] CVX: Full fetch complete (77768 records). [2025-09-18T18:22:44.381691] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-18T18:22:44.528820] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-09-18T18:22:44.820340] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-18T18:22:44.820527] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-18T18:22:44.821356] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-18T18:22:44.821432] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-18T18:22:44.836792] [DEBUG] [LOCAL ] CVX: Trimmed 77768 records to 54150 (keeping 200 days of data) [2025-09-18T18:22:44.838529] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-18T18:22:45.202702] [DEBUG] [LOCAL ] CVX: Primary data saved (54150 records). [2025-09-18T18:22:45.202864] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-18T18:22:45.202965] [INFO ] [MAIN ] Update Progress: 569/2372 symbols completed. CVX took 36.9s. Estimated remaining: 4h 22m 2s. Rate: 6.9 symbols/min [2025-09-18T18:22:45.324755] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-18T18:22:45.379003] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:22:45.438794] [DEBUG] [LOCAL ] CWH: Loaded 51416 existing records from primary storage. [2025-09-18T18:22:45.438948] [INFO ] [MAIN ] CWH: Loaded 51416 existing records. [2025-09-18T18:22:45.621077] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:22:45.621339] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-18T18:22:45.621387] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-18T18:22:45.622637] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-09-18T18:22:45.622719] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-18T18:22:46.001776] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:22:46.074247] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-18T18:22:46.119531] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-09-18T18:22:46.552805] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-18T18:22:46.556190] [INFO ] [REMOTE ] CW: Full fetch complete (33449 records). [2025-09-18T18:22:46.556272] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-18T18:22:46.556972] [FATAL] [VALIDATOR ] CW: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:22:46.557057] [FATAL] [MAIN ] CW: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:22:46.557126] [WARN ] [MAIN ] CW: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:22:46.557176] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-18T18:22:46.557234] [DEBUG] [LOCAL ] CW: No primary data file found to delete. [2025-09-18T18:22:46.557270] [INFO ] [LOCAL ] CW: Starting deletion of derivative data. [2025-09-18T18:22:46.557310] [DEBUG] [LOCAL ] CW: No derivative data file found to delete. [2025-09-18T18:22:46.557365] [INFO ] [MAIN ] Update Progress: 570/2372 symbols completed. CW took 24.0s. Estimated remaining: 4h 21m 30s. Rate: 6.9 symbols/min [2025-09-18T18:22:46.743890] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:22:46.804872] [DEBUG] [LOCAL ] CWK: Loaded 49420 existing records from primary storage. [2025-09-18T18:22:46.805034] [INFO ] [MAIN ] CWK: Loaded 49420 existing records. [2025-09-18T18:22:46.924716] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-11. [2025-09-18T18:22:46.989362] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:22:46.989597] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-18T18:22:46.989670] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-18T18:22:46.990913] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-09-18T18:22:46.990974] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-18T18:22:47.370408] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:22:47.563453] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-18T18:22:47.719570] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-18T18:22:48.331515] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-18T18:22:48.519532] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-09-18T18:22:48.921500] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-18T18:22:49.319538] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-11. [2025-09-18T18:22:50.119096] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-18T18:22:50.128383] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-18T18:22:50.636686] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-18T18:22:50.919582] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-09-18T18:22:51.687971] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-18T18:22:51.719557] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-18T18:22:52.172664] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T18:22:52.519566] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-09-18T18:22:53.319559] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-18T18:22:53.512637] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-18T18:22:53.898592] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-18T18:22:54.119557] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-18T18:22:54.642414] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-18T18:22:54.919542] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-18T18:22:55.543878] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-18T18:22:55.719568] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-18T18:22:56.371115] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-18T18:22:56.519565] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-18T18:22:57.034823] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-18T18:22:57.319549] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-18T18:22:57.950163] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T18:22:58.119592] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-18T18:22:58.514431] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-18T18:22:58.919564] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-09-18T18:22:59.719556] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-18T18:23:00.261958] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-18T18:23:00.519602] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-18T18:23:01.319571] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-18T18:23:02.186299] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-18T18:23:02.196129] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-18T18:23:02.502365] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-18T18:23:02.919545] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-18T18:23:03.517258] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T18:23:03.719548] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-18T18:23:04.426884] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T18:23:04.519574] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-18T18:23:04.724562] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (6.60 seconds). [2025-09-18T18:23:04.964919] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-18T18:23:05.046140] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (5.33 seconds). [2025-09-18T18:23:05.319613] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-18T18:23:05.913269] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T18:23:06.119607] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-18T18:23:06.919570] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-18T18:23:07.060148] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-18T18:23:07.314213] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-18T18:23:07.323880] [INFO ] [REMOTE ] CWEN: Full fetch complete (64191 records). [2025-09-18T18:23:07.324073] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-18T18:23:07.724881] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-18T18:23:07.729934] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-09-18T18:23:07.730027] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-09-18T18:23:07.731050] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-09-18T18:23:07.731247] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-09-18T18:23:07.732849] [DEBUG] [LOCAL ] CWEN: Trimmed 64191 records to 45379 (keeping 200 days of data) [2025-09-18T18:23:08.012489] [DEBUG] [LOCAL ] CWEN: Primary data saved (45379 records). [2025-09-18T18:23:08.012624] [INFO ] [MAIN ] CWEN: Full history saved. [2025-09-18T18:23:08.012743] [INFO ] [MAIN ] Update Progress: 571/2372 symbols completed. CWEN took 31.3s. Estimated remaining: 4h 22m 2s. Rate: 6.9 symbols/min [2025-09-18T18:23:08.189035] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:23:08.189209] [DEBUG] [LOCAL ] CWT: No existing data file found in primary storage. [2025-09-18T18:23:08.189245] [WARN ] [MAIN ] CWT: No existing data found, performing full refresh instead. [2025-09-18T18:23:08.189413] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-18T18:23:08.189456] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-18T18:23:08.189498] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-09-18T18:23:08.189531] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-18T18:23:08.519935] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-18T18:23:08.624609] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:23:08.653534] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-18T18:23:09.319514] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-18T18:23:09.422493] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-18T18:23:10.092152] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T18:23:10.119501] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-18T18:23:10.564842] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-18T18:23:10.919554] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-18T18:23:11.719604] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-18T18:23:11.866734] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-18T18:23:12.519539] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-18T18:23:12.735332] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-18T18:23:13.192817] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-18T18:23:13.319556] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-11. [2025-09-18T18:23:13.840820] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T18:23:14.119547] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-18T18:23:14.446351] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-18T18:23:14.919546] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-18T18:23:15.719600] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-09-18T18:23:15.837712] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-18T18:23:16.275685] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-18T18:23:16.519590] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-18T18:23:16.626311] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-18T18:23:17.319613] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-18T18:23:18.119545] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-09-18T18:23:18.265912] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-18T18:23:18.276135] [INFO ] [REMOTE ] CWAN: Full fetch complete (74526 records). [2025-09-18T18:23:18.276266] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-18T18:23:18.277197] [FATAL] [VALIDATOR ] CWAN: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:23:18.277291] [FATAL] [MAIN ] CWAN: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:23:18.277335] [WARN ] [MAIN ] CWAN: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:23:18.277403] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-18T18:23:18.277475] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-09-18T18:23:18.277513] [INFO ] [LOCAL ] CWAN: Starting deletion of derivative data. [2025-09-18T18:23:18.277956] [DEBUG] [LOCAL ] CWAN: Deleted derivative data file. [2025-09-18T18:23:18.278057] [INFO ] [MAIN ] Update Progress: 572/2372 symbols completed. CWAN took 43.8s. Estimated remaining: 4h 21m 58s. Rate: 6.9 symbols/min [2025-09-18T18:23:18.455943] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:23:18.505270] [DEBUG] [LOCAL ] CX: Loaded 52839 existing records from primary storage. [2025-09-18T18:23:18.505418] [INFO ] [MAIN ] CX: Loaded 52839 existing records. [2025-09-18T18:23:18.687532] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:23:18.687837] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-18T18:23:18.687897] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-18T18:23:18.688971] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-09-18T18:23:18.689036] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-18T18:23:18.929370] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-18T18:23:19.060952] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-18T18:23:19.083411] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:23:19.090866] [INFO ] [REMOTE ] CWH: Full fetch complete (72519 records). [2025-09-18T18:23:19.091087] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-18T18:23:19.188323] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-18T18:23:19.518683] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-09-18T18:23:19.518809] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-09-18T18:23:19.519579] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-09-18T18:23:19.519625] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-09-18T18:23:19.521260] [DEBUG] [LOCAL ] CWH: Trimmed 72519 records to 51794 (keeping 200 days of data) [2025-09-18T18:23:19.742567] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-18T18:23:19.863933] [DEBUG] [LOCAL ] CWH: Primary data saved (51794 records). [2025-09-18T18:23:19.864099] [INFO ] [MAIN ] CWH: Full history saved. [2025-09-18T18:23:19.864213] [INFO ] [MAIN ] Update Progress: 573/2372 symbols completed. CWH took 34.7s. Estimated remaining: 4h 21m 27s. Rate: 6.9 symbols/min [2025-09-18T18:23:20.062399] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:23:20.072158] [DEBUG] [LOCAL ] CXE: Loaded 7257 existing records from primary storage. [2025-09-18T18:23:20.072276] [INFO ] [MAIN ] CXE: Loaded 7257 existing records. [2025-09-18T18:23:20.267263] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:23:20.267601] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-18T18:23:20.267682] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-18T18:23:20.268005] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-18T18:23:20.268098] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-18T18:23:20.524708] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-11. [2025-09-18T18:23:20.632623] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:23:20.655582] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-18T18:23:20.663038] [INFO ] [REMOTE ] CWK: Full fetch complete (70651 records). [2025-09-18T18:23:20.663217] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-18T18:23:21.085395] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-09-18T18:23:21.085534] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-09-18T18:23:21.086514] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-09-18T18:23:21.086624] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-09-18T18:23:21.105727] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-18T18:23:21.104865] [DEBUG] [LOCAL ] CWK: Trimmed 70651 records to 49789 (keeping 200 days of data) [2025-09-18T18:23:21.319771] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-11. [2025-09-18T18:23:21.410375] [DEBUG] [LOCAL ] CWK: Primary data saved (49789 records). [2025-09-18T18:23:21.410983] [INFO ] [MAIN ] CWK: Full history saved. [2025-09-18T18:23:21.411764] [INFO ] [MAIN ] Update Progress: 574/2372 symbols completed. CWK took 34.9s. Estimated remaining: 4h 20m 56s. Rate: 6.9 symbols/min [2025-09-18T18:23:21.605501] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:23:21.612772] [DEBUG] [LOCAL ] CXH: Loaded 4420 existing records from primary storage. [2025-09-18T18:23:21.612899] [INFO ] [MAIN ] CXH: Loaded 4420 existing records. [2025-09-18T18:23:21.801971] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:23:21.802291] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-18T18:23:21.802351] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-18T18:23:21.802708] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-09-18T18:23:21.802772] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-18T18:23:22.104639] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-18T18:23:22.124594] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-09-18T18:23:22.196530] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:23:22.242557] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-18T18:23:22.911358] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-18T18:23:22.919494] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-09-18T18:23:23.690179] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-18T18:23:23.719503] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-18T18:23:24.519590] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-11. [2025-09-18T18:23:24.608201] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-18T18:23:24.968859] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-18T18:23:25.319542] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-09-18T18:23:25.924691] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-18T18:23:26.119580] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-18T18:23:26.919556] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-09-18T18:23:27.017570] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-18T18:23:27.719752] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-18T18:23:28.524668] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-18T18:23:28.542210] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-18T18:23:28.784398] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-18T18:23:28.946517] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-18T18:23:29.319554] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-09-18T18:23:29.763338] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-18T18:23:30.119551] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-18T18:23:30.553086] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-18T18:23:30.919562] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-18T18:23:31.308787] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-18T18:23:31.719545] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-18T18:23:32.203617] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-18T18:23:32.519581] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-18T18:23:33.319545] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-18T18:23:33.365002] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-18T18:23:33.876718] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-18T18:23:34.119621] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-18T18:23:34.919543] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-18T18:23:35.385066] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-18T18:23:35.389603] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-18T18:23:35.719567] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-09-18T18:23:36.519609] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-18T18:23:37.148970] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-18T18:23:37.319585] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-18T18:23:37.422499] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-18T18:23:38.120155] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-18T18:23:38.229923] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-18T18:23:38.748331] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-18T18:23:38.919586] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-18T18:23:39.558844] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-18T18:23:39.719547] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-18T18:23:40.519584] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-18T18:23:41.113005] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-18T18:23:41.114889] [INFO ] [REMOTE ] CXE: Full fetch complete (11856 records). [2025-09-18T18:23:41.114962] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-18T18:23:41.324913] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-18T18:23:41.493686] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-18T18:23:41.493870] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-18T18:23:41.494332] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-18T18:23:41.494447] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-18T18:23:41.495286] [DEBUG] [LOCAL ] CXE: Trimmed 11856 records to 7287 (keeping 200 days of data) [2025-09-18T18:23:41.565617] [DEBUG] [LOCAL ] CXE: Primary data saved (7287 records). [2025-09-18T18:23:41.566322] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-18T18:23:41.567287] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-18T18:23:41.567427] [INFO ] [MAIN ] Update Progress: 575/2372 symbols completed. CXE took 21.7s. Estimated remaining: 4h 21m 23s. Rate: 6.9 symbols/min [2025-09-18T18:23:41.747728] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:23:41.792772] [DEBUG] [LOCAL ] CXM: Loaded 47981 existing records from primary storage. [2025-09-18T18:23:41.792919] [INFO ] [MAIN ] CXM: Loaded 47981 existing records. [2025-09-18T18:23:41.971518] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:23:41.971802] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-18T18:23:41.971868] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-18T18:23:41.973007] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-09-18T18:23:41.973071] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-18T18:23:42.127567] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-18T18:23:42.299355] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-18T18:23:42.356181] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:23:42.919630] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-11. [2025-09-18T18:23:43.719533] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-18T18:23:44.041631] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-18T18:23:44.135560] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-18T18:23:44.175963] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-18T18:23:44.519576] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-09-18T18:23:45.319586] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-18T18:23:45.906305] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T18:23:46.119766] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-18T18:23:46.494063] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-18T18:23:46.919624] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-18T18:23:47.719587] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-09-18T18:23:47.803659] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-18T18:23:47.995626] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-18T18:23:47.997104] [INFO ] [REMOTE ] CXH: Full fetch complete (5514 records). [2025-09-18T18:23:47.997174] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-18T18:23:47.997712] [FATAL] [VALIDATOR ] CXH: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:23:47.997796] [FATAL] [MAIN ] CXH: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:23:47.997840] [WARN ] [MAIN ] CXH: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:23:47.997907] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-18T18:23:47.997987] [DEBUG] [LOCAL ] CXH: No primary data file found to delete. [2025-09-18T18:23:47.998042] [INFO ] [LOCAL ] CXH: Starting deletion of derivative data. [2025-09-18T18:23:47.998389] [DEBUG] [LOCAL ] CXH: Deleted derivative data file. [2025-09-18T18:23:47.998508] [INFO ] [MAIN ] Update Progress: 576/2372 symbols completed. CXH took 26.6s. Estimated remaining: 4h 21m 7s. Rate: 6.9 symbols/min [2025-09-18T18:23:48.170903] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:23:48.171104] [DEBUG] [LOCAL ] CXT: No existing data file found in primary storage. [2025-09-18T18:23:48.171147] [WARN ] [MAIN ] CXT: No existing data found, performing full refresh instead. [2025-09-18T18:23:48.171287] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-18T18:23:48.171329] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-18T18:23:48.171375] [DEBUG] [LOCAL ] CXT: No primary data file found to delete. [2025-09-18T18:23:48.171413] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-18T18:23:48.524763] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-18T18:23:48.593804] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:23:48.968864] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T18:23:49.319548] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-18T18:23:50.119589] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-11. [2025-09-18T18:23:50.315554] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-18T18:23:50.382396] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-18T18:23:50.919547] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-18T18:23:51.127684] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T18:23:51.719544] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-09-18T18:23:52.415611] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T18:23:52.519561] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-18T18:23:52.945892] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T18:23:53.319606] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-09-18T18:23:53.708352] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-18T18:23:54.119584] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-18T18:23:54.389362] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-18T18:23:54.919580] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-18T18:23:55.719546] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-18T18:23:55.930187] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-18T18:23:55.958060] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-18T18:23:56.519547] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-18T18:23:57.214110] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-18T18:23:57.319550] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-18T18:23:57.549301] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-18T18:23:57.553242] [INFO ] [REMOTE ] CWT: Full fetch complete (40201 records). [2025-09-18T18:23:57.553334] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-18T18:23:57.944628] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-09-18T18:23:57.944744] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-09-18T18:23:57.945281] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-09-18T18:23:57.945329] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-09-18T18:23:57.946266] [DEBUG] [LOCAL ] CWT: Trimmed 40201 records to 28182 (keeping 200 days of data) [2025-09-18T18:23:58.119805] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-18T18:23:58.127764] [DEBUG] [LOCAL ] CWT: Primary data saved (28182 records). [2025-09-18T18:23:58.127846] [INFO ] [MAIN ] CWT: Full history saved. [2025-09-18T18:23:58.127918] [INFO ] [MAIN ] Update Progress: 577/2372 symbols completed. CWT took 50.1s. Estimated remaining: 4h 21m 3s. Rate: 6.9 symbols/min [2025-09-18T18:23:58.308180] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:23:58.353080] [DEBUG] [LOCAL ] CXW: Loaded 44602 existing records from primary storage. [2025-09-18T18:23:58.353227] [INFO ] [MAIN ] CXW: Loaded 44602 existing records. [2025-09-18T18:23:58.538969] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:23:58.539260] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-18T18:23:58.539329] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-18T18:23:58.540507] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-09-18T18:23:58.540795] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-18T18:23:58.935722] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-18T18:23:58.942534] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:23:58.994888] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-18T18:23:59.376322] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-18T18:23:59.719548] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-11. [2025-09-18T18:24:00.519520] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-18T18:24:00.566042] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-18T18:24:01.290592] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-18T18:24:01.319490] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-09-18T18:24:02.119553] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-18T18:24:02.515140] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-18T18:24:02.919558] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-18T18:24:03.620040] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-18T18:24:03.719552] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-09-18T18:24:04.490896] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-18T18:24:04.497749] [INFO ] [REMOTE ] CX: Full fetch complete (75817 records). [2025-09-18T18:24:04.497867] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-18T18:24:04.498785] [FATAL] [VALIDATOR ] CX: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:24:04.498880] [FATAL] [MAIN ] CX: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:24:04.498956] [WARN ] [MAIN ] CX: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:24:04.499014] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-18T18:24:04.499079] [DEBUG] [LOCAL ] CX: No primary data file found to delete. [2025-09-18T18:24:04.499116] [INFO ] [LOCAL ] CX: Starting deletion of derivative data. [2025-09-18T18:24:04.499623] [DEBUG] [LOCAL ] CX: Deleted derivative data file. [2025-09-18T18:24:04.499758] [INFO ] [MAIN ] Update Progress: 578/2372 symbols completed. CX took 46.2s. Estimated remaining: 4h 20m 47s. Rate: 6.9 symbols/min [2025-09-18T18:24:04.530755] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-18T18:24:04.676238] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:24:04.706093] [DEBUG] [LOCAL ] CYD: Loaded 26862 existing records from primary storage. [2025-09-18T18:24:04.706251] [INFO ] [MAIN ] CYD: Loaded 26862 existing records. [2025-09-18T18:24:04.895181] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:24:04.895413] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-18T18:24:04.895461] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-18T18:24:04.896362] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-09-18T18:24:04.896423] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-18T18:24:05.263231] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:24:05.289860] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-18T18:24:05.319501] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-18T18:24:05.351302] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-18T18:24:05.961357] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T18:24:06.119541] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-18T18:24:06.724154] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-18T18:24:06.919547] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-18T18:24:07.439776] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-18T18:24:07.719542] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-11. [2025-09-18T18:24:08.360966] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-18T18:24:08.401720] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T18:24:08.519540] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-18T18:24:09.319546] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-18T18:24:09.831968] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-18T18:24:10.119535] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-18T18:24:10.908264] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T18:24:10.919493] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-09-18T18:24:11.400301] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-18T18:24:11.453870] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T18:24:11.461270] [INFO ] [REMOTE ] CXM: Full fetch complete (68637 records). [2025-09-18T18:24:11.461529] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-18T18:24:11.462562] [FATAL] [VALIDATOR ] CXM: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:24:11.462708] [FATAL] [MAIN ] CXM: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:24:11.462764] [WARN ] [MAIN ] CXM: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:24:11.462810] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-18T18:24:11.463083] [DEBUG] [LOCAL ] CXM: No primary data file found to delete. [2025-09-18T18:24:11.463355] [INFO ] [LOCAL ] CXM: Starting deletion of derivative data. [2025-09-18T18:24:11.463982] [DEBUG] [LOCAL ] CXM: Deleted derivative data file. [2025-09-18T18:24:11.464163] [INFO ] [MAIN ] Update Progress: 579/2372 symbols completed. CXM took 29.9s. Estimated remaining: 4h 20m 32s. Rate: 6.9 symbols/min [2025-09-18T18:24:11.633478] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:24:11.678135] [DEBUG] [LOCAL ] CYH: Loaded 48029 existing records from primary storage. [2025-09-18T18:24:11.678288] [INFO ] [MAIN ] CYH: Loaded 48029 existing records. [2025-09-18T18:24:11.724801] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-09-18T18:24:11.865003] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:24:11.865233] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-18T18:24:11.865283] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-18T18:24:11.866359] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-09-18T18:24:11.866421] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-18T18:24:12.246804] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:24:12.471147] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-18T18:24:12.519520] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-18T18:24:13.319545] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-18T18:24:14.119559] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-11. [2025-09-18T18:24:14.648671] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-18T18:24:14.919565] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-18T18:24:15.617176] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-18T18:24:15.719551] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-18T18:24:15.915072] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-18T18:24:16.320022] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T18:24:16.519536] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-18T18:24:16.671675] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-18T18:24:17.319561] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-18T18:24:17.857989] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-18T18:24:18.119559] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-18T18:24:18.283095] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-18T18:24:18.919576] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-09-18T18:24:19.300694] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-18T18:24:19.719607] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-18T18:24:20.524821] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-18T18:24:20.559049] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-18T18:24:20.617667] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-18T18:24:21.319569] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-18T18:24:21.862209] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-18T18:24:22.119601] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-18T18:24:22.580040] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-18T18:24:22.919550] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-09-18T18:24:23.358400] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T18:24:23.719603] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-18T18:24:24.519525] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-18T18:24:24.548610] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-18T18:24:24.777831] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-18T18:24:25.319568] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-18T18:24:25.893944] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-18T18:24:26.119566] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-18T18:24:26.928400] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-18T18:24:26.947851] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-18T18:24:27.719538] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-18T18:24:27.760403] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-18T18:24:28.076215] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-18T18:24:28.080805] [INFO ] [REMOTE ] CXT: Full fetch complete (44688 records). [2025-09-18T18:24:28.080896] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-18T18:24:28.466140] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-09-18T18:24:28.466243] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-09-18T18:24:28.466855] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-09-18T18:24:28.466948] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-09-18T18:24:28.467944] [DEBUG] [LOCAL ] CXT: Trimmed 44688 records to 31312 (keeping 200 days of data) [2025-09-18T18:24:28.521349] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-18T18:24:28.672450] [DEBUG] [LOCAL ] CXT: Primary data saved (31312 records). [2025-09-18T18:24:28.672674] [INFO ] [MAIN ] CXT: Full history saved. [2025-09-18T18:24:28.672796] [INFO ] [MAIN ] Update Progress: 580/2372 symbols completed. CXT took 40.7s. Estimated remaining: 4h 20m 50s. Rate: 6.9 symbols/min [2025-09-18T18:24:28.876433] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:24:28.935726] [DEBUG] [LOCAL ] D: Loaded 53647 existing records from primary storage. [2025-09-18T18:24:28.935877] [INFO ] [MAIN ] D: Loaded 53647 existing records. [2025-09-18T18:24:29.124580] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:24:29.125067] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-18T18:24:29.125182] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-18T18:24:29.126799] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-09-18T18:24:29.126866] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-18T18:24:29.308522] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T18:24:29.320801] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-18T18:24:29.555675] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:24:29.776867] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-18T18:24:30.119555] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-18T18:24:30.680001] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T18:24:30.919552] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-18T18:24:31.263880] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-18T18:24:31.270248] [INFO ] [REMOTE ] CXW: Full fetch complete (64997 records). [2025-09-18T18:24:31.270431] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-18T18:24:31.694710] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-09-18T18:24:31.694803] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-09-18T18:24:31.695507] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-09-18T18:24:31.695551] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-09-18T18:24:31.696926] [DEBUG] [LOCAL ] CXW: Trimmed 64997 records to 44915 (keeping 200 days of data) [2025-09-18T18:24:31.746612] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-18T18:24:31.984671] [DEBUG] [LOCAL ] CXW: Primary data saved (44915 records). [2025-09-18T18:24:31.984880] [INFO ] [MAIN ] CXW: Full history saved. [2025-09-18T18:24:31.985074] [INFO ] [MAIN ] Update Progress: 581/2372 symbols completed. CXW took 33.9s. Estimated remaining: 4h 20m 24s. Rate: 6.9 symbols/min [2025-09-18T18:24:32.176580] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:24:32.176881] [DEBUG] [LOCAL ] DAC: No existing data file found in primary storage. [2025-09-18T18:24:32.176940] [WARN ] [MAIN ] DAC: No existing data found, performing full refresh instead. [2025-09-18T18:24:32.177089] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-18T18:24:32.177133] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-18T18:24:32.177176] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-09-18T18:24:32.177209] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-18T18:24:32.528809] [INFO ] [REMOTE ] D: Fetching primary data for 2024-11. [2025-09-18T18:24:32.575790] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:24:32.608988] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-18T18:24:33.231692] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T18:24:33.237910] [INFO ] [REMOTE ] CYD: Full fetch complete (31452 records). [2025-09-18T18:24:33.238061] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-18T18:24:33.324688] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-18T18:24:33.631048] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-09-18T18:24:33.631135] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-09-18T18:24:33.631773] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-09-18T18:24:33.631837] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-09-18T18:24:33.633370] [DEBUG] [LOCAL ] CYD: Trimmed 31452 records to 27150 (keeping 200 days of data) [2025-09-18T18:24:33.807422] [DEBUG] [LOCAL ] CYD: Primary data saved (27150 records). [2025-09-18T18:24:33.807559] [INFO ] [MAIN ] CYD: Full history saved. [2025-09-18T18:24:33.807676] [INFO ] [MAIN ] Update Progress: 582/2372 symbols completed. CYD took 29.3s. Estimated remaining: 4h 19m 54s. Rate: 6.9 symbols/min [2025-09-18T18:24:33.990602] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:24:34.041178] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-09-18T18:24:34.041339] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-09-18T18:24:34.124784] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-11. [2025-09-18T18:24:34.239614] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:24:34.240283] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-18T18:24:34.240401] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-18T18:24:34.242770] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-09-18T18:24:34.242846] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-18T18:24:34.594724] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-11 (2.07 seconds). [2025-09-18T18:24:34.681623] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:24:34.717825] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-18T18:24:34.865509] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-18T18:24:34.919486] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-09-18T18:24:35.719560] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-09-18T18:24:35.746234] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-18T18:24:36.519583] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-11. [2025-09-18T18:24:37.331827] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-18T18:24:37.353444] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-18T18:24:38.119604] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-09-18T18:24:38.649307] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-11 (2.13 seconds). [2025-09-18T18:24:38.875406] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-18T18:24:38.919557] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-09-18T18:24:38.952972] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-18T18:24:39.719561] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-09-18T18:24:40.519614] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-18T18:24:40.716538] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-18T18:24:41.319570] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-18T18:24:41.735354] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-18T18:24:42.001826] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T18:24:42.004828] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-18T18:24:42.119598] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-18T18:24:42.869873] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-18T18:24:42.919515] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-18T18:24:43.719578] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-18T18:24:43.913503] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-18T18:24:44.519595] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-09-18T18:24:45.324886] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-18T18:24:45.337210] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-18T18:24:45.486454] [DEBUG] [REMOTE ] DAC: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-18T18:24:45.486818] [WARN ] [REMOTE ] DAC: No data returned for month 2025-05 [2025-09-18T18:24:46.119551] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-18T18:24:46.541143] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-18T18:24:46.919563] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-18T18:24:47.701557] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-18T18:24:47.719542] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-18T18:24:47.770608] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-18T18:24:48.519613] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-18T18:24:48.653378] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T18:24:49.319631] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-18T18:24:50.119597] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-18T18:24:50.588482] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-18T18:24:50.922170] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-18T18:24:50.924837] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-18T18:24:50.931470] [INFO ] [REMOTE ] CYH: Full fetch complete (70429 records). [2025-09-18T18:24:50.931662] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-18T18:24:51.362987] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-09-18T18:24:51.363120] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-09-18T18:24:51.363968] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-09-18T18:24:51.364051] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-09-18T18:24:51.368241] [DEBUG] [LOCAL ] CYH: Trimmed 70429 records to 48382 (keeping 200 days of data) [2025-09-18T18:24:51.660820] [DEBUG] [LOCAL ] CYH: Primary data saved (48382 records). [2025-09-18T18:24:51.660965] [INFO ] [MAIN ] CYH: Full history saved. [2025-09-18T18:24:51.661112] [INFO ] [MAIN ] Update Progress: 583/2372 symbols completed. CYH took 40.2s. Estimated remaining: 4h 20m 14s. Rate: 6.9 symbols/min [2025-09-18T18:24:51.725511] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-18T18:24:51.842724] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:24:51.881893] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-18T18:24:51.928900] [DEBUG] [LOCAL ] DAN: Loaded 49034 existing records from primary storage. [2025-09-18T18:24:51.929052] [INFO ] [MAIN ] DAN: Loaded 49034 existing records. [2025-09-18T18:24:52.159079] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:24:52.159602] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-18T18:24:52.159683] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-18T18:24:52.161070] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-09-18T18:24:52.161131] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-18T18:24:52.512526] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:24:52.519492] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-11. [2025-09-18T18:24:52.684127] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-18T18:24:52.957113] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-18T18:24:53.319548] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-18T18:24:54.119611] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-18T18:24:54.332403] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-18T18:24:54.919552] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-09-18T18:24:55.301008] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-18T18:24:55.671974] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-18T18:24:55.719498] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-18T18:24:56.148511] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T18:24:56.519600] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-18T18:24:57.262838] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T18:24:57.264773] [INFO ] [REMOTE ] DAC: Full fetch complete (18209 records). [2025-09-18T18:24:57.264850] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-18T18:24:57.321122] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-09-18T18:24:57.461102] [WARN ] [VALIDATOR ] DAC: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-18T18:24:57.461529] [FATAL] [MAIN ] DAC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:24:57.461602] [WARN ] [MAIN ] DAC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:24:57.461705] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-18T18:24:57.461776] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-09-18T18:24:57.461817] [INFO ] [LOCAL ] DAC: Starting deletion of derivative data. [2025-09-18T18:24:57.461875] [DEBUG] [LOCAL ] DAC: No derivative data file found to delete. [2025-09-18T18:24:57.461970] [INFO ] [MAIN ] Update Progress: 584/2372 symbols completed. DAC took 25.5s. Estimated remaining: 4h 19m 56s. Rate: 6.9 symbols/min [2025-09-18T18:24:57.674000] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-18T18:24:57.677287] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:24:57.688455] [DEBUG] [LOCAL ] DAO: No existing data file found in primary storage. [2025-09-18T18:24:57.688538] [WARN ] [MAIN ] DAO: No existing data found, performing full refresh instead. [2025-09-18T18:24:57.688890] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-18T18:24:57.689355] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-18T18:24:57.689433] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-09-18T18:24:57.689472] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-18T18:24:58.056213] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:24:58.119503] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-18T18:24:58.793334] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-18T18:24:58.919514] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-18T18:24:59.719930] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-18T18:25:00.286410] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-18T18:25:00.370171] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-18T18:25:00.519595] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-18T18:25:01.319562] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-11. [2025-09-18T18:25:01.450239] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-18T18:25:02.119519] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-18T18:25:02.179784] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-18T18:25:02.844184] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-18T18:25:02.919507] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-09-18T18:25:03.719545] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-18T18:25:03.863114] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-18T18:25:03.902800] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-18T18:25:04.519558] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-18T18:25:05.266382] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-18T18:25:05.319559] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-18T18:25:06.119553] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-18T18:25:06.586039] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-18T18:25:06.639976] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-18T18:25:06.919557] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-18T18:25:07.719540] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-18T18:25:07.969838] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-18T18:25:08.519524] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-18T18:25:08.956232] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-18T18:25:08.998552] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-18T18:25:09.319542] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-09-18T18:25:10.119550] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-18T18:25:10.187264] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-18T18:25:10.295450] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-18T18:25:10.307459] [INFO ] [REMOTE ] D: Full fetch complete (77503 records). [2025-09-18T18:25:10.307694] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-18T18:25:10.709163] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-09-18T18:25:10.709260] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-09-18T18:25:10.710065] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-09-18T18:25:10.710132] [DEBUG] [LOCAL ] D: Saving primary data. [2025-09-18T18:25:10.711739] [DEBUG] [LOCAL ] D: Trimmed 77503 records to 54037 (keeping 200 days of data) [2025-09-18T18:25:10.940684] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-18T18:25:11.072041] [DEBUG] [LOCAL ] D: Primary data saved (54037 records). [2025-09-18T18:25:11.072221] [INFO ] [MAIN ] D: Full history saved. [2025-09-18T18:25:11.073284] [INFO ] [MAIN ] Update Progress: 585/2372 symbols completed. D took 42.4s. Estimated remaining: 4h 20m 2s. Rate: 6.9 symbols/min [2025-09-18T18:25:11.252529] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:25:11.252747] [DEBUG] [LOCAL ] DAR: No existing data file found in primary storage. [2025-09-18T18:25:11.252803] [WARN ] [MAIN ] DAR: No existing data found, performing full refresh instead. [2025-09-18T18:25:11.252996] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-18T18:25:11.253041] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-18T18:25:11.253084] [DEBUG] [LOCAL ] DAR: No primary data file found to delete. [2025-09-18T18:25:11.253118] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-18T18:25:11.628530] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:25:11.691991] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-18T18:25:11.719491] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-18T18:25:12.229839] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-18T18:25:12.519542] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-18T18:25:13.266059] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-18T18:25:13.319553] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-18T18:25:14.033212] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T18:25:14.119554] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-18T18:25:14.919576] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-11. [2025-09-18T18:25:15.196864] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-18T18:25:15.208360] [INFO ] [REMOTE ] DAL: Full fetch complete (77714 records). [2025-09-18T18:25:15.208562] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-18T18:25:15.629540] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-09-18T18:25:15.629699] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-09-18T18:25:15.630553] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-09-18T18:25:15.630600] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-09-18T18:25:15.632118] [DEBUG] [LOCAL ] DAL: Trimmed 77714 records to 54143 (keeping 200 days of data) [2025-09-18T18:25:15.724354] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-18T18:25:15.967342] [DEBUG] [LOCAL ] DAL: Primary data saved (54143 records). [2025-09-18T18:25:15.967510] [INFO ] [MAIN ] DAL: Full history saved. [2025-09-18T18:25:15.967621] [INFO ] [MAIN ] Update Progress: 586/2372 symbols completed. DAL took 42.2s. Estimated remaining: 4h 19m 42s. Rate: 6.9 symbols/min [2025-09-18T18:25:16.156774] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:25:16.191112] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-18T18:25:16.236888] [DEBUG] [LOCAL ] DAVA: Loaded 40308 existing records from primary storage. [2025-09-18T18:25:16.237055] [INFO ] [MAIN ] DAVA: Loaded 40308 existing records. [2025-09-18T18:25:16.429778] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:25:16.430227] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-18T18:25:16.430402] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-18T18:25:16.431839] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-18T18:25:16.431904] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-18T18:25:16.527888] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-18T18:25:16.662339] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-18T18:25:16.738266] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-18T18:25:16.898104] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:25:17.319552] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-09-18T18:25:18.119592] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-11. [2025-09-18T18:25:18.158408] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-18T18:25:18.165775] [INFO ] [REMOTE ] DAN: Full fetch complete (70784 records). [2025-09-18T18:25:18.165959] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-18T18:25:18.583195] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-09-18T18:25:18.583284] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-09-18T18:25:18.584100] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-09-18T18:25:18.584165] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-09-18T18:25:18.585571] [DEBUG] [LOCAL ] DAN: Trimmed 70784 records to 49394 (keeping 200 days of data) [2025-09-18T18:25:18.843278] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-18T18:25:18.927771] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-09-18T18:25:18.947442] [DEBUG] [LOCAL ] DAN: Primary data saved (49394 records). [2025-09-18T18:25:18.947576] [INFO ] [MAIN ] DAN: Full history saved. [2025-09-18T18:25:18.947692] [INFO ] [MAIN ] Update Progress: 587/2372 symbols completed. DAN took 27.3s. Estimated remaining: 4h 19m 16s. Rate: 6.9 symbols/min [2025-09-18T18:25:19.120925] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:25:19.169988] [DEBUG] [LOCAL ] DAY: Loaded 50042 existing records from primary storage. [2025-09-18T18:25:19.170146] [INFO ] [MAIN ] DAY: Loaded 50042 existing records. [2025-09-18T18:25:19.348090] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:25:19.348427] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-18T18:25:19.348484] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-18T18:25:19.349554] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-09-18T18:25:19.349616] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-18T18:25:19.721173] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:25:19.721287] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-18T18:25:19.744311] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-18T18:25:20.256414] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-18T18:25:20.519552] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-11. [2025-09-18T18:25:20.715384] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-18T18:25:21.319563] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-09-18T18:25:22.037914] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-18T18:25:22.119550] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-18T18:25:22.339312] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-18T18:25:22.919570] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-09-18T18:25:23.434532] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-18T18:25:23.719545] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-18T18:25:24.210548] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-18T18:25:24.519565] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-18T18:25:24.795623] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-18T18:25:25.319593] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-18T18:25:25.573828] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-18T18:25:25.926340] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-18T18:25:26.119563] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-18T18:25:26.919545] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-18T18:25:27.719564] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-09-18T18:25:27.818213] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-18T18:25:27.961792] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-18T18:25:28.519575] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-18T18:25:29.026164] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T18:25:29.319601] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-09-18T18:25:29.570514] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-18T18:25:29.574938] [INFO ] [REMOTE ] DAO: Full fetch complete (32438 records). [2025-09-18T18:25:29.575084] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-18T18:25:29.991093] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-09-18T18:25:29.991178] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-09-18T18:25:29.991621] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-09-18T18:25:29.991694] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-09-18T18:25:29.992458] [DEBUG] [LOCAL ] DAO: Trimmed 32438 records to 21693 (keeping 200 days of data) [2025-09-18T18:25:30.121612] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-18T18:25:30.125245] [DEBUG] [LOCAL ] DAO: Primary data saved (21693 records). [2025-09-18T18:25:30.125384] [INFO ] [MAIN ] DAO: Full history saved. [2025-09-18T18:25:30.125460] [INFO ] [MAIN ] Update Progress: 588/2372 symbols completed. DAO took 32.7s. Estimated remaining: 4h 19m 14s. Rate: 6.9 symbols/min [2025-09-18T18:25:30.297149] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:25:30.297334] [DEBUG] [LOCAL ] DB: No existing data file found in primary storage. [2025-09-18T18:25:30.297372] [WARN ] [MAIN ] DB: No existing data found, performing full refresh instead. [2025-09-18T18:25:30.297527] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-18T18:25:30.297570] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-18T18:25:30.297613] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-09-18T18:25:30.297668] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-18T18:25:30.651537] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:25:30.817818] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-18T18:25:30.919584] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-11. [2025-09-18T18:25:31.719540] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-18T18:25:31.826783] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-18T18:25:32.401023] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-18T18:25:32.519637] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-18T18:25:33.236434] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-18T18:25:33.319590] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-18T18:25:33.567326] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-18T18:25:34.119628] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-18T18:25:34.900890] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-18T18:25:34.919499] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-18T18:25:35.701937] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T18:25:35.719497] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-18T18:25:36.234092] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-18T18:25:36.519608] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-18T18:25:37.072893] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-18T18:25:37.319574] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-18T18:25:38.119582] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-09-18T18:25:38.428049] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-18T18:25:38.632084] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-18T18:25:38.919565] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-18T18:25:39.382403] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-18T18:25:39.719560] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-18T18:25:40.486436] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-18T18:25:40.519531] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-18T18:25:41.072722] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-18T18:25:41.319597] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-18T18:25:41.842535] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T18:25:42.119547] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-18T18:25:42.919574] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-09-18T18:25:43.020467] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-18T18:25:43.719559] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-18T18:25:43.948800] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-18T18:25:44.364934] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-18T18:25:44.519536] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-18T18:25:45.045308] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-18T18:25:45.319558] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-18T18:25:46.119557] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-18T18:25:46.187700] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T18:25:46.761090] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-18T18:25:46.767993] [INFO ] [REMOTE ] DAVA: Full fetch complete (54943 records). [2025-09-18T18:25:46.768112] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-18T18:25:46.924718] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-18T18:25:47.163700] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-18T18:25:47.163979] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-18T18:25:47.164716] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-18T18:25:47.164781] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-18T18:25:47.165880] [DEBUG] [LOCAL ] DAVA: Trimmed 54943 records to 40658 (keeping 200 days of data) [2025-09-18T18:25:47.395167] [DEBUG] [LOCAL ] DAVA: Primary data saved (40658 records). [2025-09-18T18:25:47.395294] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-18T18:25:47.395377] [INFO ] [MAIN ] Update Progress: 589/2372 symbols completed. DAVA took 31.4s. Estimated remaining: 4h 19m 32s. Rate: 6.9 symbols/min [2025-09-18T18:25:47.570998] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:25:47.571270] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-09-18T18:25:47.571378] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-09-18T18:25:47.571669] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-18T18:25:47.571732] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-18T18:25:47.571909] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-18T18:25:47.571986] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-18T18:25:47.721285] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-18T18:25:47.983114] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:25:47.977308] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-18T18:25:48.519586] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-11. [2025-09-18T18:25:48.676356] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-18T18:25:48.682974] [INFO ] [REMOTE ] DAY: Full fetch complete (71617 records). [2025-09-18T18:25:48.683119] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-18T18:25:49.074578] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-09-18T18:25:49.074707] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-09-18T18:25:49.075466] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-18T18:25:49.075511] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-09-18T18:25:49.077083] [DEBUG] [LOCAL ] DAY: Trimmed 71617 records to 50388 (keeping 200 days of data) [2025-09-18T18:25:49.335107] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-18T18:25:49.370977] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-18T18:25:49.396224] [DEBUG] [LOCAL ] DAY: Primary data saved (50388 records). [2025-09-18T18:25:49.396344] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-18T18:25:49.396426] [INFO ] [MAIN ] Update Progress: 590/2372 symbols completed. DAY took 30.4s. Estimated remaining: 4h 19m 3s. Rate: 6.9 symbols/min [2025-09-18T18:25:49.576200] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:25:49.611110] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-18T18:25:49.656606] [DEBUG] [LOCAL ] DBI: Loaded 45297 existing records from primary storage. [2025-09-18T18:25:49.656775] [INFO ] [MAIN ] DBI: Loaded 45297 existing records. [2025-09-18T18:25:49.835544] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:25:49.835829] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-18T18:25:49.835879] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-18T18:25:49.837036] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-09-18T18:25:49.837101] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-18T18:25:50.125306] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-18T18:25:50.211588] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:25:50.919552] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-11. [2025-09-18T18:25:51.173664] [DEBUG] [REMOTE ] DB: Error fetching primary data for 2025-04: Server request status code is 503. [2025-09-18T18:25:51.174039] [WARN ] [REMOTE ] DB: No data returned for month 2025-04 [2025-09-18T18:25:51.266787] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-18T18:25:51.719554] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-18T18:25:52.316092] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-18T18:25:52.519544] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-18T18:25:53.312298] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T18:25:53.322969] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-09-18T18:25:54.119562] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-18T18:25:54.352700] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-18T18:25:54.402118] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-18T18:25:54.919560] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-09-18T18:25:55.719566] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-09-18T18:25:55.820906] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-18T18:25:55.828529] [INFO ] [REMOTE ] DAR: Full fetch complete (74376 records). [2025-09-18T18:25:55.828726] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-18T18:25:56.015791] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-18T18:25:56.273080] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-09-18T18:25:56.273163] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-09-18T18:25:56.273958] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-09-18T18:25:56.274025] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-09-18T18:25:56.275444] [DEBUG] [LOCAL ] DAR: Trimmed 74376 records to 52223 (keeping 200 days of data) [2025-09-18T18:25:56.543098] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-18T18:25:56.587044] [DEBUG] [LOCAL ] DAR: Primary data saved (52223 records). [2025-09-18T18:25:56.587188] [INFO ] [MAIN ] DAR: Full history saved. [2025-09-18T18:25:56.587268] [INFO ] [MAIN ] Update Progress: 591/2372 symbols completed. DAR took 45.5s. Estimated remaining: 4h 18m 49s. Rate: 6.9 symbols/min [2025-09-18T18:25:56.801694] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:25:56.801932] [DEBUG] [LOCAL ] DBL: No existing data file found in primary storage. [2025-09-18T18:25:56.801983] [WARN ] [MAIN ] DBL: No existing data found, performing full refresh instead. [2025-09-18T18:25:56.802135] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-18T18:25:56.802179] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-18T18:25:56.802221] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-09-18T18:25:56.802253] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-18T18:25:57.159598] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:25:57.222162] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T18:25:57.319508] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-11. [2025-09-18T18:25:58.115472] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-18T18:25:58.119482] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-09-18T18:25:58.246558] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-18T18:25:58.654291] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-18T18:25:58.919561] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-09-18T18:25:59.682213] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-18T18:25:59.719564] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-18T18:26:00.519553] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-18T18:26:01.319604] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-09-18T18:26:01.408885] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-18T18:26:01.566955] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-18T18:26:02.119543] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-18T18:26:02.839977] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T18:26:02.919505] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-18T18:26:03.212734] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-18T18:26:03.719575] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-18T18:26:04.167290] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T18:26:04.264052] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-18T18:26:04.519621] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-18T18:26:05.319581] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-18T18:26:06.119565] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-18T18:26:06.190742] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-18T18:26:06.919631] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-18T18:26:07.021257] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-18T18:26:07.118316] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-18T18:26:07.719556] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-18T18:26:08.519542] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-18T18:26:08.835196] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-18T18:26:08.842912] [INFO ] [REMOTE ] DB: Full fetch complete (65743 records). [2025-09-18T18:26:08.843098] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-18T18:26:09.051985] [WARN ] [VALIDATOR ] DB: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-18T18:26:09.052758] [FATAL] [MAIN ] DB: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:26:09.052839] [WARN ] [MAIN ] DB: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:26:09.052925] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-18T18:26:09.053056] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-09-18T18:26:09.053114] [INFO ] [LOCAL ] DB: Starting deletion of derivative data. [2025-09-18T18:26:09.053187] [DEBUG] [LOCAL ] DB: No derivative data file found to delete. [2025-09-18T18:26:09.053477] [INFO ] [MAIN ] Update Progress: 592/2372 symbols completed. DB took 38.9s. Estimated remaining: 4h 18m 52s. Rate: 6.9 symbols/min [2025-09-18T18:26:09.245476] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:26:09.253203] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-18T18:26:09.290367] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-18T18:26:09.319943] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-18T18:26:09.341169] [DEBUG] [LOCAL ] DBRG: Loaded 49831 existing records from primary storage. [2025-09-18T18:26:09.341324] [INFO ] [MAIN ] DBRG: Loaded 49831 existing records. [2025-09-18T18:26:09.543284] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:26:09.543560] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-18T18:26:09.543609] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-18T18:26:09.544882] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-09-18T18:26:09.544946] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-18T18:26:09.931860] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:26:10.119544] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-18T18:26:10.198693] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-18T18:26:10.885046] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-18T18:26:10.919534] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-18T18:26:11.440128] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-18T18:26:11.719543] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-18T18:26:12.519544] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-11. [2025-09-18T18:26:12.620341] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-18T18:26:13.319546] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-18T18:26:14.042120] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-18T18:26:14.119545] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-09-18T18:26:14.192853] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-18T18:26:14.919554] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-18T18:26:15.608501] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T18:26:15.719581] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-18T18:26:16.228140] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-18T18:26:16.519555] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-09-18T18:26:16.618551] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-18T18:26:17.319585] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-18T18:26:18.119598] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-18T18:26:18.205390] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-18T18:26:18.919547] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-18T18:26:18.967378] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-18T18:26:19.014552] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-18T18:26:19.719530] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-18T18:26:19.797129] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-18T18:26:20.274257] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-18T18:26:20.519595] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-18T18:26:21.311986] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-18T18:26:21.313780] [INFO ] [REMOTE ] DBL: Full fetch complete (12484 records). [2025-09-18T18:26:21.313875] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-18T18:26:21.325182] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-18T18:26:21.690083] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-09-18T18:26:21.690189] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-09-18T18:26:21.690541] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-09-18T18:26:21.690593] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-09-18T18:26:21.691143] [DEBUG] [LOCAL ] DBL: Trimmed 12484 records to 9122 (keeping 200 days of data) [2025-09-18T18:26:21.750373] [DEBUG] [LOCAL ] DBL: Primary data saved (9122 records). [2025-09-18T18:26:21.750520] [INFO ] [MAIN ] DBL: Full history saved. [2025-09-18T18:26:21.750604] [INFO ] [MAIN ] Update Progress: 593/2372 symbols completed. DBL took 25.2s. Estimated remaining: 4h 18m 55s. Rate: 6.9 symbols/min [2025-09-18T18:26:21.927790] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:26:21.928148] [DEBUG] [LOCAL ] DCI: No existing data file found in primary storage. [2025-09-18T18:26:21.928205] [WARN ] [MAIN ] DCI: No existing data found, performing full refresh instead. [2025-09-18T18:26:21.928348] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-18T18:26:21.928391] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-18T18:26:21.928434] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-09-18T18:26:21.928467] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-18T18:26:22.124765] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-18T18:26:22.286207] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:26:22.423790] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-18T18:26:22.427523] [INFO ] [REMOTE ] DBD: Full fetch complete (30143 records). [2025-09-18T18:26:22.427704] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-18T18:26:22.428306] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:26:22.428399] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:26:22.428444] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:26:22.428544] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-18T18:26:22.428695] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-18T18:26:22.428773] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-09-18T18:26:22.428890] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-09-18T18:26:22.428997] [INFO ] [MAIN ] Update Progress: 594/2372 symbols completed. DBD took 35.0s. Estimated remaining: 4h 18m 22s. Rate: 6.9 symbols/min [2025-09-18T18:26:22.628411] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:26:22.644125] [DEBUG] [LOCAL ] DCO: Loaded 13509 existing records from primary storage. [2025-09-18T18:26:22.644311] [INFO ] [MAIN ] DCO: Loaded 13509 existing records. [2025-09-18T18:26:22.824183] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:26:22.824495] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-18T18:26:22.824552] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-18T18:26:22.825250] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-09-18T18:26:22.825312] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-18T18:26:22.925438] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-11. [2025-09-18T18:26:23.181191] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:26:23.528584] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T18:26:23.719591] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-11. [2025-09-18T18:26:24.190579] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T18:26:24.519601] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-18T18:26:24.784363] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-18T18:26:25.319599] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-18T18:26:26.046987] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T18:26:26.119552] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-18T18:26:26.779477] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T18:26:26.919574] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-09-18T18:26:27.719605] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-09-18T18:26:27.831086] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-18T18:26:28.344449] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-18T18:26:28.521727] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-18T18:26:28.525305] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-18T18:26:29.319575] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-09-18T18:26:29.841516] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-18T18:26:29.847632] [INFO ] [REMOTE ] DBI: Full fetch complete (66252 records). [2025-09-18T18:26:29.847770] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-18T18:26:29.848414] [FATAL] [VALIDATOR ] DBI: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:26:29.848503] [FATAL] [MAIN ] DBI: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:26:29.848546] [WARN ] [MAIN ] DBI: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:26:29.848586] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-18T18:26:29.848793] [DEBUG] [LOCAL ] DBI: No primary data file found to delete. [2025-09-18T18:26:29.848872] [INFO ] [LOCAL ] DBI: Starting deletion of derivative data. [2025-09-18T18:26:29.849508] [DEBUG] [LOCAL ] DBI: Deleted derivative data file. [2025-09-18T18:26:29.849612] [INFO ] [MAIN ] Update Progress: 595/2372 symbols completed. DBI took 40.5s. Estimated remaining: 4h 18m 10s. Rate: 6.9 symbols/min [2025-09-18T18:26:30.017297] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:26:30.017520] [DEBUG] [LOCAL ] DD: No existing data file found in primary storage. [2025-09-18T18:26:30.017577] [WARN ] [MAIN ] DD: No existing data found, performing full refresh instead. [2025-09-18T18:26:30.017741] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-18T18:26:30.017808] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-18T18:26:30.017890] [DEBUG] [LOCAL ] DD: No primary data file found to delete. [2025-09-18T18:26:30.017964] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-18T18:26:30.124674] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-18T18:26:30.315925] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-18T18:26:30.395748] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:26:30.919546] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-18T18:26:31.719584] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-09-18T18:26:31.819050] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-18T18:26:32.069477] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-18T18:26:32.519567] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-18T18:26:32.823491] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-18T18:26:33.319579] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-18T18:26:34.119517] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-18T18:26:34.218539] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-18T18:26:34.289740] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-18T18:26:34.630176] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-18T18:26:34.919529] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-18T18:26:35.719545] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-18T18:26:36.346986] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T18:26:36.519582] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-18T18:26:36.555143] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-18T18:26:37.319586] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-18T18:26:38.119628] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-18T18:26:38.500143] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-18T18:26:38.763805] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-18T18:26:38.867542] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-18T18:26:38.919568] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-18T18:26:39.719601] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-11. [2025-09-18T18:26:40.407351] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T18:26:40.519567] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-18T18:26:41.203442] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-18T18:26:41.319553] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-09-18T18:26:41.769437] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-18T18:26:42.119565] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-18T18:26:42.796360] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-18T18:26:42.919604] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-18T18:26:43.690637] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-18T18:26:43.719506] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-18T18:26:44.173251] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-18T18:26:44.180141] [INFO ] [REMOTE ] DBRG: Full fetch complete (72068 records). [2025-09-18T18:26:44.180346] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-18T18:26:44.521764] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-09-18T18:26:44.609996] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-09-18T18:26:44.609832] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-18T18:26:44.610208] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-09-18T18:26:44.615890] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-09-18T18:26:44.616025] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-09-18T18:26:44.617940] [DEBUG] [LOCAL ] DBRG: Trimmed 72068 records to 50211 (keeping 200 days of data) [2025-09-18T18:26:44.939872] [DEBUG] [LOCAL ] DBRG: Primary data saved (50211 records). [2025-09-18T18:26:44.940126] [INFO ] [MAIN ] DBRG: Full history saved. [2025-09-18T18:26:44.940390] [INFO ] [MAIN ] Update Progress: 596/2372 symbols completed. DBRG took 35.9s. Estimated remaining: 4h 18m 20s. Rate: 6.9 symbols/min [2025-09-18T18:26:45.114178] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:26:45.165942] [DEBUG] [LOCAL ] DDD: Loaded 50817 existing records from primary storage. [2025-09-18T18:26:45.166090] [INFO ] [MAIN ] DDD: Loaded 50817 existing records. [2025-09-18T18:26:45.324736] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-18T18:26:45.358515] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:26:45.358787] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-18T18:26:45.358840] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-18T18:26:45.359897] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-09-18T18:26:45.359974] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-18T18:26:45.726105] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:26:46.119584] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-18T18:26:46.163990] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-18T18:26:46.852066] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T18:26:46.873588] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-18T18:26:46.919505] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-18T18:26:47.719545] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-18T18:26:48.229828] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-18T18:26:48.519517] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-18T18:26:48.532380] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-18T18:26:48.535552] [INFO ] [REMOTE ] DCO: Full fetch complete (19639 records). [2025-09-18T18:26:48.535705] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-18T18:26:48.958750] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-09-18T18:26:48.958853] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-09-18T18:26:48.959262] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-09-18T18:26:48.959329] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-09-18T18:26:48.961197] [DEBUG] [LOCAL ] DCO: Trimmed 19639 records to 13679 (keeping 200 days of data) [2025-09-18T18:26:49.049696] [DEBUG] [LOCAL ] DCO: Primary data saved (13679 records). [2025-09-18T18:26:49.049839] [INFO ] [MAIN ] DCO: Full history saved. [2025-09-18T18:26:49.049942] [INFO ] [MAIN ] Update Progress: 597/2372 symbols completed. DCO took 26.6s. Estimated remaining: 4h 17m 57s. Rate: 6.9 symbols/min [2025-09-18T18:26:49.319546] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-11. [2025-09-18T18:26:50.119605] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-18T18:26:50.300533] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-18T18:26:50.919546] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-18T18:26:51.121683] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-18T18:26:51.293842] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T18:26:51.719573] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-18T18:26:52.519707] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-09-18T18:26:52.752975] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-18T18:26:52.833692] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-18T18:26:53.319545] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-18T18:26:54.008451] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T18:26:54.119545] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-09-18T18:26:54.919556] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-18T18:26:55.137284] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-18T18:26:55.719615] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-18T18:26:55.987057] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-18T18:26:56.444284] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T18:26:56.450196] [INFO ] [REMOTE ] DCI: Full fetch complete (54317 records). [2025-09-18T18:26:56.450309] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-18T18:26:56.528303] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-18T18:26:56.840733] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-09-18T18:26:56.840952] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-09-18T18:26:56.842003] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-09-18T18:26:56.842100] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-09-18T18:26:56.844607] [DEBUG] [LOCAL ] DCI: Trimmed 54317 records to 38012 (keeping 200 days of data) [2025-09-18T18:26:57.094670] [DEBUG] [LOCAL ] DCI: Primary data saved (38012 records). [2025-09-18T18:26:57.094829] [INFO ] [MAIN ] DCI: Full history saved. [2025-09-18T18:26:57.095019] [INFO ] [MAIN ] Update Progress: 598/2372 symbols completed. DCI took 35.3s. Estimated remaining: 4h 17m 47s. Rate: 6.9 symbols/min [2025-09-18T18:26:57.457503] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-18T18:26:57.470629] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-18T18:26:58.071055] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-18T18:26:58.119513] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-18T18:26:59.208468] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-18T18:26:59.220147] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-18T18:26:59.798101] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-18T18:26:59.809183] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-18T18:27:01.220588] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-18T18:27:01.234424] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-18T18:27:01.591507] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-18T18:27:01.604064] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-18T18:27:04.552687] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (2.95 seconds). [2025-09-18T18:27:04.566467] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-18T18:27:04.645126] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (3.41 seconds). [2025-09-18T18:27:04.657048] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-18T18:27:06.303292] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-18T18:27:06.311104] [INFO ] [REMOTE ] DD: Full fetch complete (76070 records). [2025-09-18T18:27:06.311348] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-18T18:27:06.548895] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-18T18:27:06.653979] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-18T18:27:06.769832] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-09-18T18:27:06.769983] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-09-18T18:27:06.770884] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-09-18T18:27:06.770951] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-09-18T18:27:06.775454] [DEBUG] [LOCAL ] DD: Trimmed 76070 records to 53183 (keeping 200 days of data) [2025-09-18T18:27:07.125861] [DEBUG] [LOCAL ] DD: Primary data saved (53183 records). [2025-09-18T18:27:07.126013] [INFO ] [MAIN ] DD: Full history saved. [2025-09-18T18:27:07.126118] [INFO ] [MAIN ] Update Progress: 599/2372 symbols completed. DD took 37.3s. Estimated remaining: 4h 17m 42s. Rate: 6.9 symbols/min [2025-09-18T18:27:08.276274] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-18T18:27:08.287523] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-18T18:27:10.164855] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-18T18:27:10.175929] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-18T18:27:12.222366] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-18T18:27:12.229503] [INFO ] [REMOTE ] DDD: Full fetch complete (73555 records). [2025-09-18T18:27:12.229666] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-18T18:27:12.624698] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-09-18T18:27:12.624790] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-09-18T18:27:12.625589] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-09-18T18:27:12.625681] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-09-18T18:27:12.628916] [DEBUG] [LOCAL ] DDD: Trimmed 73555 records to 51205 (keeping 200 days of data) [2025-09-18T18:27:12.926876] [DEBUG] [LOCAL ] DDD: Primary data saved (51205 records). [2025-09-18T18:27:12.927398] [INFO ] [MAIN ] DDD: Full history saved. [2025-09-18T18:27:12.927681] [INFO ] [MAIN ] Update Progress: 600/2372 symbols completed. DDD took 28.0s. Estimated remaining: 4h 17m 24s. Rate: 6.9 symbols/min [2025-09-18T18:27:13.527155] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:27:13.596021] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:27:13.648685] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:27:13.672858] [DEBUG] [LOCAL ] DE: No existing data file found in primary storage. [2025-09-18T18:27:13.683836] [WARN ] [MAIN ] DE: No existing data found, performing full refresh instead. [2025-09-18T18:27:13.703733] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:27:13.706770] [DEBUG] [LOCAL ] DDT: Loaded 2079 existing records from primary storage. [2025-09-18T18:27:13.707230] [INFO ] [MAIN ] DDT: Loaded 2079 existing records. [2025-09-18T18:27:13.707155] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-18T18:27:13.736604] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-18T18:27:13.779510] [DEBUG] [LOCAL ] DE: No primary data file found to delete. [2025-09-18T18:27:13.779719] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-18T18:27:13.954088] [DEBUG] [LOCAL ] DDS: Loaded 13559 existing records from primary storage. [2025-09-18T18:27:14.017855] [DEBUG] [LOCAL ] DDL: Loaded 36306 existing records from primary storage. [2025-09-18T18:27:14.010944] [INFO ] [MAIN ] DDS: Loaded 13559 existing records. [2025-09-18T18:27:14.033563] [INFO ] [MAIN ] DDL: Loaded 36306 existing records. [2025-09-18T18:27:14.246239] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:27:14.388135] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-18T18:27:14.388308] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-18T18:27:14.467708] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-09-18T18:27:14.566494] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-18T18:27:14.627717] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:27:14.808161] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:27:14.813774] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-18T18:27:14.814084] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-11. [2025-09-18T18:27:14.813501] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:27:14.819508] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-18T18:27:14.853312] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-09-18T18:27:14.859598] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-18T18:27:14.908701] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-18T18:27:14.946373] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-18T18:27:15.037923] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-09-18T18:27:15.193383] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-18T18:27:15.595893] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:27:15.604827] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-11. [2025-09-18T18:27:15.799081] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:27:15.823861] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-11. [2025-09-18T18:27:16.017323] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:27:16.017818] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-11. [2025-09-18T18:27:16.239383] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-18T18:27:16.240901] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-09-18T18:27:16.751547] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-18T18:27:16.755003] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-09-18T18:27:16.814589] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-18T18:27:16.816040] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-09-18T18:27:16.864549] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-18T18:27:16.874505] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-09-18T18:27:17.183311] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-18T18:27:17.185074] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-18T18:27:17.333178] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-18T18:27:17.348125] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-09-18T18:27:17.365910] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-18T18:27:17.371796] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-09-18T18:27:17.501542] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-18T18:27:17.503340] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-18T18:27:17.895950] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-18T18:27:17.897989] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-18T18:27:17.928005] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-18T18:27:17.931488] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-18T18:27:18.202859] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T18:27:18.217085] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-09-18T18:27:18.341511] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-18T18:27:18.343234] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-18T18:27:18.458683] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T18:27:18.587092] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-18T18:27:18.645602] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-18T18:27:18.919585] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-18T18:27:19.728749] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-09-18T18:27:19.731260] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T18:27:19.766589] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-18T18:27:20.519607] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-18T18:27:21.118031] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-18T18:27:21.141113] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-18T18:27:21.319559] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-18T18:27:21.789609] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-18T18:27:22.119557] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-18T18:27:22.730343] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-18T18:27:22.919586] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-18T18:27:23.719557] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-18T18:27:23.940021] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-18T18:27:24.519540] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-18T18:27:25.319581] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-18T18:27:25.547540] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-18T18:27:25.941915] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-18T18:27:26.119558] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-18T18:27:26.737367] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T18:27:26.919548] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-18T18:27:27.719577] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-18T18:27:27.951624] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-18T18:27:28.519604] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-18T18:27:28.590934] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-18T18:27:28.641598] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T18:27:29.073591] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-18T18:27:29.074710] [INFO ] [REMOTE ] DDT: Full fetch complete (2896 records). [2025-09-18T18:27:29.074821] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-18T18:27:29.324832] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-18T18:27:29.455306] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-09-18T18:27:29.455404] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-09-18T18:27:29.455548] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-09-18T18:27:29.455588] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-09-18T18:27:29.455992] [DEBUG] [LOCAL ] DDT: Trimmed 2896 records to 2096 (keeping 200 days of data) [2025-09-18T18:27:29.473518] [DEBUG] [LOCAL ] DDT: Primary data saved (2096 records). [2025-09-18T18:27:29.473671] [INFO ] [MAIN ] DDT: Full history saved. [2025-09-18T18:27:29.473814] [INFO ] [MAIN ] Update Progress: 601/2372 symbols completed. DDT took 16.5s. Estimated remaining: 4h 17m 39s. Rate: 6.9 symbols/min [2025-09-18T18:27:29.652088] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:27:29.694966] [DEBUG] [LOCAL ] DEA: Loaded 41744 existing records from primary storage. [2025-09-18T18:27:29.695117] [INFO ] [MAIN ] DEA: Loaded 41744 existing records. [2025-09-18T18:27:29.879055] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:27:29.879344] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-18T18:27:29.879399] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-18T18:27:29.880709] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-18T18:27:29.880773] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-18T18:27:30.124725] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-18T18:27:30.247160] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:27:30.919593] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-18T18:27:31.134684] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-18T18:27:31.377381] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-18T18:27:31.719639] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-11. [2025-09-18T18:27:31.904492] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-18T18:27:32.519618] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-18T18:27:33.266747] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-18T18:27:33.319497] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-09-18T18:27:34.119686] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-18T18:27:34.248513] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-18T18:27:34.669298] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-18T18:27:34.895094] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-18T18:27:34.919496] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-09-18T18:27:35.719544] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-18T18:27:36.356194] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-18T18:27:36.519623] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-18T18:27:37.182197] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T18:27:37.319532] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-18T18:27:38.119552] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-18T18:27:38.162135] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-18T18:27:38.919516] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-18T18:27:38.951696] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-18T18:27:39.381795] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-18T18:27:39.719543] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-18T18:27:40.387292] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-18T18:27:40.519569] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-18T18:27:41.319546] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-18T18:27:41.469071] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-18T18:27:41.490617] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-18T18:27:41.492749] [INFO ] [REMOTE ] DDS: Full fetch complete (19305 records). [2025-09-18T18:27:41.492826] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-18T18:27:41.857264] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-09-18T18:27:41.857344] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-09-18T18:27:41.857703] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-09-18T18:27:41.857789] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-09-18T18:27:41.858547] [DEBUG] [LOCAL ] DDS: Trimmed 19305 records to 13611 (keeping 200 days of data) [2025-09-18T18:27:41.947423] [DEBUG] [LOCAL ] DDS: Primary data saved (13611 records). [2025-09-18T18:27:41.947591] [INFO ] [MAIN ] DDS: Full history saved. [2025-09-18T18:27:41.947727] [INFO ] [MAIN ] Update Progress: 602/2372 symbols completed. DDS took 29.0s. Estimated remaining: 4h 17m 41s. Rate: 6.9 symbols/min [2025-09-18T18:27:42.118955] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:27:42.119522] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-18T18:27:42.165240] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-18T18:27:42.181106] [DEBUG] [LOCAL ] DEC: Loaded 31026 existing records from primary storage. [2025-09-18T18:27:42.181502] [INFO ] [MAIN ] DEC: Loaded 31026 existing records. [2025-09-18T18:27:42.359380] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:27:42.359663] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-18T18:27:42.359761] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-18T18:27:42.360636] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-09-18T18:27:42.360732] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-18T18:27:42.718295] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:27:42.919540] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-11. [2025-09-18T18:27:43.719532] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-18T18:27:43.756572] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-18T18:27:43.765508] [INFO ] [REMOTE ] DE: Full fetch complete (69489 records). [2025-09-18T18:27:43.765715] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-18T18:27:44.171939] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-09-18T18:27:44.172028] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-09-18T18:27:44.172772] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-09-18T18:27:44.172836] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-09-18T18:27:44.174298] [DEBUG] [LOCAL ] DE: Trimmed 69489 records to 48145 (keeping 200 days of data) [2025-09-18T18:27:44.311605] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T18:27:44.514762] [DEBUG] [LOCAL ] DE: Primary data saved (48145 records). [2025-09-18T18:27:44.514929] [INFO ] [MAIN ] DE: Full history saved. [2025-09-18T18:27:44.515018] [INFO ] [MAIN ] Update Progress: 603/2372 symbols completed. DE took 31.6s. Estimated remaining: 4h 17m 14s. Rate: 6.9 symbols/min [2025-09-18T18:27:44.527062] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-09-18T18:27:44.694043] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:27:44.694283] [DEBUG] [LOCAL ] DECK: No existing data file found in primary storage. [2025-09-18T18:27:44.694338] [WARN ] [MAIN ] DECK: No existing data found, performing full refresh instead. [2025-09-18T18:27:44.694493] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-18T18:27:44.694535] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-18T18:27:44.694576] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-09-18T18:27:44.694610] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-18T18:27:45.099626] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:27:45.269318] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-18T18:27:45.319531] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-18T18:27:45.746428] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-18T18:27:46.119603] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-11. [2025-09-18T18:27:46.636417] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T18:27:46.919549] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-09-18T18:27:47.719528] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-18T18:27:47.802606] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-18T18:27:47.839324] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-18T18:27:48.519547] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-18T18:27:48.925890] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-18T18:27:49.319556] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-18T18:27:49.678155] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-18T18:27:50.119560] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-09-18T18:27:50.403386] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-18T18:27:50.919550] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-18T18:27:51.719526] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-18T18:27:51.759500] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-18T18:27:52.071842] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-18T18:27:52.519543] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-18T18:27:53.170055] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T18:27:53.319571] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-09-18T18:27:53.674874] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-18T18:27:53.680859] [INFO ] [REMOTE ] DDL: Full fetch complete (53264 records). [2025-09-18T18:27:53.680971] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-18T18:27:54.084798] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-09-18T18:27:54.084916] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-09-18T18:27:54.085523] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-09-18T18:27:54.085567] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-09-18T18:27:54.086710] [DEBUG] [LOCAL ] DDL: Trimmed 53264 records to 36628 (keeping 200 days of data) [2025-09-18T18:27:54.138088] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-18T18:27:54.304350] [DEBUG] [LOCAL ] DDL: Primary data saved (36628 records). [2025-09-18T18:27:54.304507] [INFO ] [MAIN ] DDL: Full history saved. [2025-09-18T18:27:54.304599] [INFO ] [MAIN ] Update Progress: 604/2372 symbols completed. DDL took 41.4s. Estimated remaining: 4h 17m 9s. Rate: 6.9 symbols/min [2025-09-18T18:27:54.481257] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:27:54.532934] [DEBUG] [LOCAL ] DEI: Loaded 48536 existing records from primary storage. [2025-09-18T18:27:54.533137] [INFO ] [MAIN ] DEI: Loaded 48536 existing records. [2025-09-18T18:27:54.737010] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:27:54.737262] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-18T18:27:54.737311] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-18T18:27:54.738671] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-09-18T18:27:54.738732] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-18T18:27:54.930454] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-18T18:27:55.105265] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:27:55.136119] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-18T18:27:55.374532] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T18:27:55.719548] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-18T18:27:56.449304] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-18T18:27:56.519546] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-18T18:27:56.792049] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-18T18:27:57.319544] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-18T18:27:58.041964] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T18:27:58.047551] [INFO ] [REMOTE ] DEA: Full fetch complete (63104 records). [2025-09-18T18:27:58.047753] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-18T18:27:58.124687] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-11. [2025-09-18T18:27:58.445972] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-18T18:27:58.446081] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-18T18:27:58.446837] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-18T18:27:58.446916] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-18T18:27:58.448495] [DEBUG] [LOCAL ] DEA: Trimmed 63104 records to 42080 (keeping 200 days of data) [2025-09-18T18:27:58.529343] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T18:27:58.729678] [DEBUG] [LOCAL ] DEA: Primary data saved (42080 records). [2025-09-18T18:27:58.729824] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-18T18:27:58.729911] [INFO ] [MAIN ] Update Progress: 605/2372 symbols completed. DEA took 29.3s. Estimated remaining: 4h 16m 47s. Rate: 6.9 symbols/min [2025-09-18T18:27:58.904607] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:27:58.919556] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-18T18:27:58.959389] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-09-18T18:27:58.959542] [INFO ] [MAIN ] DELL: Loaded 53736 existing records. [2025-09-18T18:27:59.143226] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:27:59.143520] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-18T18:27:59.143582] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-18T18:27:59.145305] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-09-18T18:27:59.145369] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-18T18:27:59.559375] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:27:59.719554] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-11. [2025-09-18T18:27:59.934223] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-18T18:28:00.003956] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-18T18:28:00.519602] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-18T18:28:01.319579] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-18T18:28:02.119575] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-09-18T18:28:02.202204] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-11 (2.48 seconds). [2025-09-18T18:28:02.261361] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-18T18:28:02.511035] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-18T18:28:02.919551] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-09-18T18:28:03.362375] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-18T18:28:03.719570] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-18T18:28:04.519552] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-18T18:28:05.319513] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-09-18T18:28:05.400556] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-09-18T18:28:05.429095] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-18T18:28:05.540007] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-18T18:28:06.119567] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-09-18T18:28:06.703326] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T18:28:06.919549] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-18T18:28:07.719548] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-18T18:28:08.198828] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-18T18:28:08.203454] [INFO ] [REMOTE ] DEC: Full fetch complete (42408 records). [2025-09-18T18:28:08.203842] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-18T18:28:08.209719] [FATAL] [VALIDATOR ] DEC: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:28:08.209947] [FATAL] [MAIN ] DEC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:28:08.210040] [WARN ] [MAIN ] DEC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:28:08.210128] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-18T18:28:08.210240] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-09-18T18:28:08.210302] [INFO ] [LOCAL ] DEC: Starting deletion of derivative data. [2025-09-18T18:28:08.210874] [DEBUG] [LOCAL ] DEC: Deleted derivative data file. [2025-09-18T18:28:08.211019] [INFO ] [MAIN ] Update Progress: 606/2372 symbols completed. DEC took 26.3s. Estimated remaining: 4h 16m 41s. Rate: 6.9 symbols/min [2025-09-18T18:28:08.390591] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:28:08.424473] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-18T18:28:08.487418] [DEBUG] [LOCAL ] DEO: Loaded 48969 existing records from primary storage. [2025-09-18T18:28:08.487622] [INFO ] [MAIN ] DEO: Loaded 48969 existing records. [2025-09-18T18:28:08.532045] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-18T18:28:08.683153] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:28:08.683403] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-18T18:28:08.683453] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-18T18:28:08.684816] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-09-18T18:28:08.684875] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-18T18:28:09.047814] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:28:09.254287] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-18T18:28:09.319547] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-18T18:28:10.119578] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-18T18:28:10.805936] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-18T18:28:10.919598] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-18T18:28:11.032185] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-18T18:28:11.719540] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-18T18:28:12.005878] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-18T18:28:12.316832] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T18:28:12.519576] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-18T18:28:13.319636] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-18T18:28:14.124317] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-11. [2025-09-18T18:28:14.127041] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-18T18:28:14.177904] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-18T18:28:14.919602] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-18T18:28:15.241989] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-18T18:28:15.719600] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-18T18:28:16.049410] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-18T18:28:16.519548] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-09-18T18:28:17.319558] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-18T18:28:17.413417] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-18T18:28:17.457438] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-18T18:28:18.048057] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-18T18:28:18.119567] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-09-18T18:28:18.516761] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-18T18:28:18.919598] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-18T18:28:19.719575] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-18T18:28:19.956690] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-18T18:28:20.519602] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-18T18:28:21.153188] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-18T18:28:21.319558] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-18T18:28:21.565994] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-18T18:28:22.119697] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-18T18:28:22.343394] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-18T18:28:22.919585] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-18T18:28:23.232628] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-18T18:28:23.719558] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-18T18:28:24.062400] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-18T18:28:24.446890] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T18:28:24.519499] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-18T18:28:25.319569] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-18T18:28:26.057398] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-18T18:28:26.119506] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-18T18:28:26.179460] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T18:28:26.919524] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-18T18:28:26.965217] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-18T18:28:27.719701] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-18T18:28:27.997841] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-18T18:28:28.005252] [INFO ] [REMOTE ] DECK: Full fetch complete (76416 records). [2025-09-18T18:28:28.005393] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-18T18:28:28.402732] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-09-18T18:28:28.402861] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-09-18T18:28:28.404625] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-09-18T18:28:28.404951] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-09-18T18:28:28.408376] [DEBUG] [LOCAL ] DECK: Trimmed 76416 records to 53698 (keeping 200 days of data) [2025-09-18T18:28:28.531306] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-18T18:28:28.536467] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-18T18:28:28.819182] [DEBUG] [LOCAL ] DECK: Primary data saved (53698 records). [2025-09-18T18:28:28.819429] [INFO ] [MAIN ] DECK: Full history saved. [2025-09-18T18:28:28.819537] [INFO ] [MAIN ] Update Progress: 607/2372 symbols completed. DECK took 44.3s. Estimated remaining: 4h 17m 7s. Rate: 6.9 symbols/min [2025-09-18T18:28:29.012883] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:28:29.056561] [DEBUG] [LOCAL ] DFH: Loaded 33130 existing records from primary storage. [2025-09-18T18:28:29.056847] [INFO ] [MAIN ] DFH: Loaded 33130 existing records. [2025-09-18T18:28:29.269214] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:28:29.269581] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-18T18:28:29.269668] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-18T18:28:29.270887] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-09-18T18:28:29.270952] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-18T18:28:29.324783] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-18T18:28:29.729973] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:28:29.831082] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-18T18:28:29.872992] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-18T18:28:30.119561] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-18T18:28:30.919570] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-18T18:28:31.029279] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-18T18:28:31.637675] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T18:28:31.644693] [INFO ] [REMOTE ] DEI: Full fetch complete (69346 records). [2025-09-18T18:28:31.644844] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-18T18:28:31.724664] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-18T18:28:32.114602] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-09-18T18:28:32.114735] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-09-18T18:28:32.115507] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-09-18T18:28:32.115554] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-09-18T18:28:32.116969] [DEBUG] [LOCAL ] DEI: Trimmed 69346 records to 48891 (keeping 200 days of data) [2025-09-18T18:28:32.406040] [DEBUG] [LOCAL ] DEI: Primary data saved (48891 records). [2025-09-18T18:28:32.406175] [INFO ] [MAIN ] DEI: Full history saved. [2025-09-18T18:28:32.406276] [INFO ] [MAIN ] Update Progress: 608/2372 symbols completed. DEI took 38.1s. Estimated remaining: 4h 16m 43s. Rate: 6.9 symbols/min [2025-09-18T18:28:32.524818] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-11. [2025-09-18T18:28:32.616992] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:28:32.640682] [DEBUG] [LOCAL ] DFIN: Loaded 23550 existing records from primary storage. [2025-09-18T18:28:32.640893] [INFO ] [MAIN ] DFIN: Loaded 23550 existing records. [2025-09-18T18:28:32.820414] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:28:32.820709] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-18T18:28:32.820766] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-18T18:28:32.821532] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-09-18T18:28:32.821592] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-18T18:28:33.176089] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:28:33.319595] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-11. [2025-09-18T18:28:33.458974] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-09-18T18:28:33.466619] [INFO ] [REMOTE ] DELL: Full fetch complete (77812 records). [2025-09-18T18:28:33.466833] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-18T18:28:33.889140] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-09-18T18:28:33.889358] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-09-18T18:28:33.890535] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-09-18T18:28:33.890722] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-09-18T18:28:33.926930] [DEBUG] [LOCAL ] DELL: Trimmed 77812 records to 54126 (keeping 200 days of data) [2025-09-18T18:28:33.942528] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-18T18:28:33.955227] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T18:28:34.148005] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-09-18T18:28:34.316407] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-18T18:28:34.339773] [DEBUG] [LOCAL ] DELL: Primary data saved (54126 records). [2025-09-18T18:28:34.339941] [INFO ] [MAIN ] DELL: Full history saved. [2025-09-18T18:28:34.340037] [INFO ] [MAIN ] Update Progress: 609/2372 symbols completed. DELL took 35.6s. Estimated remaining: 4h 16m 15s. Rate: 6.9 symbols/min [2025-09-18T18:28:34.517807] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:28:34.530896] [DEBUG] [LOCAL ] DFP: Loaded 11799 existing records from primary storage. [2025-09-18T18:28:34.531018] [INFO ] [MAIN ] DFP: Loaded 11799 existing records. [2025-09-18T18:28:34.724408] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:28:34.724749] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-18T18:28:34.724812] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-18T18:28:34.725241] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-09-18T18:28:34.725303] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-18T18:28:34.926252] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-18T18:28:35.110364] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:28:35.634688] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T18:28:35.719569] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-11. [2025-09-18T18:28:36.519524] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-09-18T18:28:36.680342] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-18T18:28:36.736697] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-18T18:28:37.319542] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-18T18:28:37.602387] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-18T18:28:38.119568] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-09-18T18:28:38.908044] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-18T18:28:38.914978] [INFO ] [REMOTE ] DEO: Full fetch complete (71328 records). [2025-09-18T18:28:38.915103] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-18T18:28:38.927204] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-09-18T18:28:39.335691] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-09-18T18:28:39.335805] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-09-18T18:28:39.336627] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-09-18T18:28:39.336765] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-09-18T18:28:39.357461] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-18T18:28:39.365111] [DEBUG] [LOCAL ] DEO: Trimmed 71328 records to 49348 (keeping 200 days of data) [2025-09-18T18:28:39.685228] [DEBUG] [LOCAL ] DEO: Primary data saved (49348 records). [2025-09-18T18:28:39.685422] [INFO ] [MAIN ] DEO: Full history saved. [2025-09-18T18:28:39.686975] [INFO ] [MAIN ] Update Progress: 610/2372 symbols completed. DEO took 31.5s. Estimated remaining: 4h 15m 56s. Rate: 6.9 symbols/min [2025-09-18T18:28:39.724735] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-18T18:28:39.872733] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:28:39.873782] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-18T18:28:39.932702] [DEBUG] [LOCAL ] DG: Loaded 53309 existing records from primary storage. [2025-09-18T18:28:39.932891] [INFO ] [MAIN ] DG: Loaded 53309 existing records. [2025-09-18T18:28:40.112430] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:28:40.112714] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-18T18:28:40.112772] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-18T18:28:40.114153] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-09-18T18:28:40.114213] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-18T18:28:40.474450] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:28:40.519497] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-11. [2025-09-18T18:28:41.106445] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T18:28:41.319578] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-18T18:28:42.119549] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-09-18T18:28:42.375581] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-18T18:28:42.441884] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-18T18:28:42.919504] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-09-18T18:28:43.020073] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-18T18:28:43.414986] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-18T18:28:43.719555] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-18T18:28:44.519546] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-18T18:28:44.807886] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-18T18:28:45.319558] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-18T18:28:46.028605] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-18T18:28:46.054769] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T18:28:46.119535] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-18T18:28:46.919555] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-18T18:28:47.157706] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-18T18:28:47.719626] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-18T18:28:48.177437] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-18T18:28:48.352482] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-18T18:28:48.519595] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-18T18:28:49.319576] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-18T18:28:49.704196] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-18T18:28:50.119602] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-18T18:28:50.232068] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-18T18:28:50.919563] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-18T18:28:51.086357] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-18T18:28:51.533507] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-18T18:28:51.719585] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-09-18T18:28:52.519599] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-18T18:28:53.319563] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-18T18:28:53.564667] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-18T18:28:53.754473] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-18T18:28:53.912971] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-18T18:28:54.119527] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-18T18:28:54.749221] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-18T18:28:54.919511] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-18T18:28:55.719549] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-09-18T18:28:56.014178] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-18T18:28:56.519532] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-18T18:28:57.308806] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T18:28:57.319489] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-18T18:28:57.551246] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-18T18:28:58.062714] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T18:28:58.065252] [INFO ] [REMOTE ] DFP: Full fetch complete (16218 records). [2025-09-18T18:28:58.065338] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-18T18:28:58.128132] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-18T18:28:58.432898] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-09-18T18:28:58.432978] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-09-18T18:28:58.433304] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-09-18T18:28:58.433392] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-09-18T18:28:58.433996] [DEBUG] [LOCAL ] DFP: Trimmed 16218 records to 11867 (keeping 200 days of data) [2025-09-18T18:28:58.504114] [DEBUG] [LOCAL ] DFP: Primary data saved (11867 records). [2025-09-18T18:28:58.504242] [INFO ] [MAIN ] DFP: Full history saved. [2025-09-18T18:28:58.504326] [INFO ] [MAIN ] Update Progress: 611/2372 symbols completed. DFP took 24.2s. Estimated remaining: 4h 16m 17s. Rate: 6.9 symbols/min [2025-09-18T18:28:58.673926] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:28:58.674142] [DEBUG] [LOCAL ] DGX: No existing data file found in primary storage. [2025-09-18T18:28:58.674198] [WARN ] [MAIN ] DGX: No existing data found, performing full refresh instead. [2025-09-18T18:28:58.674339] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-18T18:28:58.674402] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-18T18:28:58.674446] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-09-18T18:28:58.674479] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-18T18:28:58.929034] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-18T18:28:59.033989] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:28:59.700222] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-18T18:28:59.719508] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-18T18:29:00.018942] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-18T18:29:00.519570] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-18T18:29:01.319507] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-11. [2025-09-18T18:29:01.444383] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-18T18:29:01.448249] [INFO ] [REMOTE ] DFIN: Full fetch complete (33170 records). [2025-09-18T18:29:01.448330] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-18T18:29:01.858552] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-09-18T18:29:01.858701] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-09-18T18:29:01.859276] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-09-18T18:29:01.859363] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-09-18T18:29:01.860944] [DEBUG] [LOCAL ] DFIN: Trimmed 33170 records to 23738 (keeping 200 days of data) [2025-09-18T18:29:02.017867] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-18T18:29:02.066117] [DEBUG] [LOCAL ] DFIN: Primary data saved (23738 records). [2025-09-18T18:29:02.066265] [INFO ] [MAIN ] DFIN: Full history saved. [2025-09-18T18:29:02.066398] [INFO ] [MAIN ] Update Progress: 612/2372 symbols completed. DFIN took 29.7s. Estimated remaining: 4h 15m 53s. Rate: 6.9 symbols/min [2025-09-18T18:29:02.130529] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-18T18:29:02.239625] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:29:02.261020] [DEBUG] [LOCAL ] DHF: Loaded 21199 existing records from primary storage. [2025-09-18T18:29:02.261259] [INFO ] [MAIN ] DHF: Loaded 21199 existing records. [2025-09-18T18:29:02.436217] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:29:02.436463] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-18T18:29:02.436510] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-18T18:29:02.437089] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-09-18T18:29:02.437167] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-18T18:29:02.803951] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:29:02.832327] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-18T18:29:02.919488] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-09-18T18:29:03.719554] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-18T18:29:04.142865] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-18T18:29:04.238900] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-18T18:29:04.519560] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-18T18:29:04.980006] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-18T18:29:05.319553] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-09-18T18:29:06.119541] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-18T18:29:06.213624] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-18T18:29:06.919580] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-18T18:29:06.984625] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-18T18:29:07.139416] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-18T18:29:07.719590] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-18T18:29:08.519590] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-11. [2025-09-18T18:29:08.829027] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-18T18:29:08.894881] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-18T18:29:09.260444] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-18T18:29:09.319593] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-18T18:29:10.119596] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-18T18:29:10.919555] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-09-18T18:29:11.007875] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-18T18:29:11.221637] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-18T18:29:11.228241] [INFO ] [REMOTE ] DFH: Full fetch complete (49147 records). [2025-09-18T18:29:11.228460] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-18T18:29:11.644049] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-09-18T18:29:11.644142] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-09-18T18:29:11.645073] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-09-18T18:29:11.645135] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-09-18T18:29:11.648834] [DEBUG] [LOCAL ] DFH: Trimmed 49147 records to 33349 (keeping 200 days of data) [2025-09-18T18:29:11.742688] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-18T18:29:11.770253] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-18T18:29:11.873515] [DEBUG] [LOCAL ] DFH: Primary data saved (33349 records). [2025-09-18T18:29:11.873722] [INFO ] [MAIN ] DFH: Full history saved. [2025-09-18T18:29:11.873899] [INFO ] [MAIN ] Update Progress: 613/2372 symbols completed. DFH took 43.1s. Estimated remaining: 4h 15m 47s. Rate: 6.9 symbols/min [2025-09-18T18:29:12.049407] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:29:12.114745] [DEBUG] [LOCAL ] DHI: Loaded 53375 existing records from primary storage. [2025-09-18T18:29:12.114918] [INFO ] [MAIN ] DHI: Loaded 53375 existing records. [2025-09-18T18:29:12.299630] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:29:12.299883] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-18T18:29:12.299960] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-18T18:29:12.301243] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-09-18T18:29:12.301303] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-18T18:29:12.528567] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-09-18T18:29:12.665920] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:29:13.319601] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-11. [2025-09-18T18:29:13.366867] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T18:29:13.972552] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-18T18:29:14.119510] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-18T18:29:14.807665] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-18T18:29:14.919598] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-18T18:29:15.719577] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-09-18T18:29:15.968466] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-18T18:29:15.978946] [INFO ] [REMOTE ] DG: Full fetch complete (77117 records). [2025-09-18T18:29:15.979139] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-18T18:29:16.397666] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-09-18T18:29:16.397817] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-09-18T18:29:16.398618] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-09-18T18:29:16.398700] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-09-18T18:29:16.400243] [DEBUG] [LOCAL ] DG: Trimmed 77117 records to 53697 (keeping 200 days of data) [2025-09-18T18:29:16.519564] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-18T18:29:16.775979] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-18T18:29:16.794100] [DEBUG] [LOCAL ] DG: Primary data saved (53697 records). [2025-09-18T18:29:16.794258] [INFO ] [MAIN ] DG: Full history saved. [2025-09-18T18:29:16.794985] [INFO ] [MAIN ] Update Progress: 614/2372 symbols completed. DG took 37.1s. Estimated remaining: 4h 15m 28s. Rate: 6.9 symbols/min [2025-09-18T18:29:16.963171] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:29:17.034929] [DEBUG] [LOCAL ] DHR: Loaded 53371 existing records from primary storage. [2025-09-18T18:29:17.035111] [INFO ] [MAIN ] DHR: Loaded 53371 existing records. [2025-09-18T18:29:17.238892] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:29:17.240375] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-18T18:29:17.247196] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-18T18:29:17.247760] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-18T18:29:17.250563] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-09-18T18:29:17.250661] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-18T18:29:17.326846] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-18T18:29:17.622495] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:29:17.720054] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-18T18:29:18.111497] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-18T18:29:18.119493] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-18T18:29:18.919616] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-11. [2025-09-18T18:29:19.219320] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-18T18:29:19.719587] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-18T18:29:20.491009] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-18T18:29:20.519501] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-09-18T18:29:21.319601] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-18T18:29:21.412705] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-18T18:29:22.124761] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-09-18T18:29:22.151358] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-18T18:29:22.187469] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-18T18:29:22.919671] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-09-18T18:29:23.719588] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-18T18:29:24.133961] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-18T18:29:24.423489] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-18T18:29:24.519569] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-18T18:29:25.137447] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T18:29:25.319519] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-18T18:29:25.571792] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-18T18:29:26.119559] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-18T18:29:26.895244] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-18T18:29:26.919496] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-18T18:29:27.084695] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-18T18:29:27.715231] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-18T18:29:27.720268] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-18T18:29:28.519532] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-18T18:29:28.943101] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-18T18:29:29.319569] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-18T18:29:30.011184] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T18:29:30.119539] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-18T18:29:30.919549] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-18T18:29:30.967407] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-18T18:29:31.713372] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T18:29:31.724828] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-18T18:29:31.812800] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-18T18:29:31.815739] [INFO ] [REMOTE ] DHF: Full fetch complete (29410 records). [2025-09-18T18:29:31.815822] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-18T18:29:31.816377] [FATAL] [VALIDATOR ] DHF: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:29:31.816460] [FATAL] [MAIN ] DHF: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:29:31.816503] [WARN ] [MAIN ] DHF: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:29:31.816549] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-18T18:29:31.816620] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-09-18T18:29:31.816722] [INFO ] [LOCAL ] DHF: Starting deletion of derivative data. [2025-09-18T18:29:31.817599] [DEBUG] [LOCAL ] DHF: Deleted derivative data file. [2025-09-18T18:29:31.817745] [INFO ] [MAIN ] Update Progress: 615/2372 symbols completed. DHF took 29.8s. Estimated remaining: 4h 15m 37s. Rate: 6.9 symbols/min [2025-09-18T18:29:31.986408] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:29:32.039179] [DEBUG] [LOCAL ] DHT: Loaded 48062 existing records from primary storage. [2025-09-18T18:29:32.039358] [INFO ] [MAIN ] DHT: Loaded 48062 existing records. [2025-09-18T18:29:32.214743] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:29:32.215051] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-18T18:29:32.215105] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-18T18:29:32.216336] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-09-18T18:29:32.216396] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-18T18:29:32.535241] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-18T18:29:32.577710] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:29:33.319569] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-11. [2025-09-18T18:29:33.428813] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-18T18:29:34.114841] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T18:29:34.125084] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-18T18:29:34.919565] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-18T18:29:35.166534] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-18T18:29:35.719510] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-09-18T18:29:35.781326] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-18T18:29:36.519540] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-18T18:29:36.752784] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-18T18:29:37.013851] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-18T18:29:37.319602] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-18T18:29:38.119539] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-09-18T18:29:38.158041] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T18:29:38.929795] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-18T18:29:38.956510] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-18T18:29:39.719515] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-18T18:29:39.806405] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-18T18:29:40.439206] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T18:29:40.444910] [INFO ] [REMOTE ] DGX: Full fetch complete (65046 records). [2025-09-18T18:29:40.445034] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-18T18:29:40.524636] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-09-18T18:29:40.841599] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-09-18T18:29:40.841715] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-09-18T18:29:40.842425] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-09-18T18:29:40.842471] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-09-18T18:29:40.843945] [DEBUG] [LOCAL ] DGX: Trimmed 65046 records to 45793 (keeping 200 days of data) [2025-09-18T18:29:41.141361] [DEBUG] [LOCAL ] DGX: Primary data saved (45793 records). [2025-09-18T18:29:41.141514] [INFO ] [MAIN ] DGX: Full history saved. [2025-09-18T18:29:41.141591] [INFO ] [MAIN ] Update Progress: 616/2372 symbols completed. DGX took 42.6s. Estimated remaining: 4h 15m 30s. Rate: 6.9 symbols/min [2025-09-18T18:29:41.311501] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:29:41.319593] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-18T18:29:41.327526] [DEBUG] [LOCAL ] DHX: Loaded 13221 existing records from primary storage. [2025-09-18T18:29:41.327612] [INFO ] [MAIN ] DHX: Loaded 13221 existing records. [2025-09-18T18:29:41.507013] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:29:41.507324] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-18T18:29:41.507378] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-18T18:29:41.507851] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-09-18T18:29:41.507912] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-18T18:29:41.891308] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:29:41.957475] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T18:29:42.005145] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-18T18:29:42.119539] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-18T18:29:42.919540] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-09-18T18:29:43.431502] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-18T18:29:43.719578] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-11. [2025-09-18T18:29:43.802412] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-18T18:29:44.320174] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-18T18:29:44.341518] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-18T18:29:44.519533] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-18T18:29:45.319550] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-09-18T18:29:46.119526] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-18T18:29:46.239197] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-18T18:29:46.246563] [INFO ] [REMOTE ] DHR: Full fetch complete (77113 records). [2025-09-18T18:29:46.246752] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-18T18:29:46.430253] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T18:29:46.649140] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-09-18T18:29:46.649232] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-09-18T18:29:46.650220] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-09-18T18:29:46.650309] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-09-18T18:29:46.651912] [DEBUG] [LOCAL ] DHR: Trimmed 77113 records to 53757 (keeping 200 days of data) [2025-09-18T18:29:46.946195] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-09-18T18:29:46.999710] [DEBUG] [LOCAL ] DHR: Primary data saved (53757 records). [2025-09-18T18:29:46.999846] [INFO ] [MAIN ] DHR: Full history saved. [2025-09-18T18:29:47.000593] [INFO ] [MAIN ] Update Progress: 617/2372 symbols completed. DHR took 30.2s. Estimated remaining: 4h 15m 13s. Rate: 6.9 symbols/min [2025-09-18T18:29:47.191900] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:29:47.206734] [DEBUG] [LOCAL ] DIAX: Loaded 12293 existing records from primary storage. [2025-09-18T18:29:47.206867] [INFO ] [MAIN ] DIAX: Loaded 12293 existing records. [2025-09-18T18:29:47.382169] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:29:47.382436] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-18T18:29:47.382490] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-18T18:29:47.382914] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-09-18T18:29:47.382976] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-18T18:29:47.739553] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:29:47.734700] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-09-18T18:29:47.859896] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-18T18:29:48.479181] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-18T18:29:48.519507] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-18T18:29:48.864783] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-18T18:29:49.319572] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-11. [2025-09-18T18:29:49.504165] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-18T18:29:50.119559] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-09-18T18:29:50.214584] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-18T18:29:50.919569] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-09-18T18:29:51.719548] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-18T18:29:51.879058] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-18T18:29:51.897410] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-18T18:29:52.276381] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-18T18:29:52.519523] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-18T18:29:53.319565] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-18T18:29:53.474532] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-18T18:29:54.119548] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-09-18T18:29:54.815994] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-18T18:29:54.919523] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-18T18:29:55.076886] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-18T18:29:55.364997] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-18T18:29:55.719549] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-18T18:29:56.519527] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-18T18:29:56.546046] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-18T18:29:57.319513] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-09-18T18:29:57.612481] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-18T18:29:58.119547] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-18T18:29:58.910233] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T18:29:58.920121] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-18T18:29:59.613096] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-18T18:29:59.719592] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-18T18:29:59.947569] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-18T18:30:00.474694] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-18T18:30:00.519522] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-18T18:30:01.319549] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-18T18:30:01.444422] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T18:30:02.119598] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-09-18T18:30:02.919617] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-18T18:30:03.593844] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-18T18:30:03.719554] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-18T18:30:03.874569] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-18T18:30:03.912841] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-18T18:30:04.519530] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-09-18T18:30:05.319555] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-18T18:30:06.119531] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-18T18:30:06.213095] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-18T18:30:06.221549] [INFO ] [REMOTE ] DHI: Full fetch complete (77052 records). [2025-09-18T18:30:06.221762] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-18T18:30:06.666748] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-09-18T18:30:06.666845] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-09-18T18:30:06.667755] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-09-18T18:30:06.667834] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-09-18T18:30:06.669525] [DEBUG] [LOCAL ] DHI: Trimmed 77052 records to 53765 (keeping 200 days of data) [2025-09-18T18:30:06.924426] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-18T18:30:06.930210] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-18T18:30:06.972022] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-18T18:30:07.001193] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-18T18:30:07.108461] [DEBUG] [LOCAL ] DHI: Primary data saved (53765 records). [2025-09-18T18:30:07.108662] [INFO ] [MAIN ] DHI: Full history saved. [2025-09-18T18:30:07.108779] [INFO ] [MAIN ] Update Progress: 618/2372 symbols completed. DHI took 55.2s. Estimated remaining: 4h 15m 37s. Rate: 6.9 symbols/min [2025-09-18T18:30:07.291497] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:30:07.329813] [DEBUG] [LOCAL ] DIN: Loaded 37411 existing records from primary storage. [2025-09-18T18:30:07.330016] [INFO ] [MAIN ] DIN: Loaded 37411 existing records. [2025-09-18T18:30:07.512709] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:30:07.513022] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-18T18:30:07.513091] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-18T18:30:07.514300] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-09-18T18:30:07.514366] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-18T18:30:07.728387] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-18T18:30:07.886963] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:30:07.894975] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-18T18:30:08.519520] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-11. [2025-09-18T18:30:08.598062] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-18T18:30:09.319562] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-18T18:30:10.119556] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-09-18T18:30:10.217073] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-18T18:30:10.220370] [INFO ] [REMOTE ] DIAX: Full fetch complete (17020 records). [2025-09-18T18:30:10.220556] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-18T18:30:10.401278] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-18T18:30:10.623173] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-09-18T18:30:10.623252] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-09-18T18:30:10.623579] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-09-18T18:30:10.623619] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-09-18T18:30:10.624206] [DEBUG] [LOCAL ] DIAX: Trimmed 17020 records to 12421 (keeping 200 days of data) [2025-09-18T18:30:10.713597] [DEBUG] [LOCAL ] DIAX: Primary data saved (12421 records). [2025-09-18T18:30:10.713886] [INFO ] [MAIN ] DIAX: Full history saved. [2025-09-18T18:30:10.714025] [INFO ] [MAIN ] Update Progress: 619/2372 symbols completed. DIAX took 23.7s. Estimated remaining: 4h 15m 13s. Rate: 6.9 symbols/min [2025-09-18T18:30:10.915620] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:30:10.919535] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-18T18:30:10.971949] [DEBUG] [LOCAL ] DINO: Loaded 52974 existing records from primary storage. [2025-09-18T18:30:10.972116] [INFO ] [MAIN ] DINO: Loaded 52974 existing records. [2025-09-18T18:30:11.153963] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:30:11.154344] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-18T18:30:11.154467] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-18T18:30:11.157007] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-18T18:30:11.157116] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-18T18:30:11.536225] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:30:11.719585] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-09-18T18:30:11.799813] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-18T18:30:11.806899] [INFO ] [REMOTE ] DHT: Full fetch complete (70051 records). [2025-09-18T18:30:11.807074] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-09-18T18:30:12.001283] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-18T18:30:12.127163] [INFO ] [REMOTE ] DHX: Full fetch complete (20890 records). [2025-09-18T18:30:12.127471] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-18T18:30:12.365148] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-09-18T18:30:12.370423] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-09-18T18:30:12.395854] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-09-18T18:30:12.405399] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-09-18T18:30:12.511862] [DEBUG] [LOCAL ] DHT: Trimmed 70051 records to 48423 (keeping 200 days of data) [2025-09-18T18:30:12.525721] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-11. [2025-09-18T18:30:12.717994] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-09-18T18:30:12.722024] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-09-18T18:30:12.724637] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-09-18T18:30:12.726022] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-09-18T18:30:12.737553] [DEBUG] [LOCAL ] DHX: Trimmed 20890 records to 13327 (keeping 200 days of data) [2025-09-18T18:30:12.913406] [DEBUG] [LOCAL ] DHX: Primary data saved (13327 records). [2025-09-18T18:30:12.920679] [INFO ] [MAIN ] DHX: Full history saved. [2025-09-18T18:30:12.922973] [INFO ] [MAIN ] Update Progress: 620/2372 symbols completed. DHX took 31.8s. Estimated remaining: 4h 14m 46s. Rate: 6.9 symbols/min [2025-09-18T18:30:13.124849] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:30:13.186407] [DEBUG] [LOCAL ] DHT: Primary data saved (48423 records). [2025-09-18T18:30:13.186609] [INFO ] [MAIN ] DHT: Full history saved. [2025-09-18T18:30:13.186768] [INFO ] [MAIN ] Update Progress: 621/2372 symbols completed. DHT took 41.4s. Estimated remaining: 4h 14m 14s. Rate: 6.9 symbols/min [2025-09-18T18:30:13.279985] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-18T18:30:13.322207] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-09-18T18:30:13.410508] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:30:13.410818] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-18T18:30:13.425528] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-18T18:30:13.425824] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-18T18:30:13.426679] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-09-18T18:30:13.425926] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-18T18:30:13.426800] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-18T18:30:13.426860] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-18T18:30:13.426924] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-09-18T18:30:13.840574] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:30:13.898736] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-18T18:30:13.902012] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-18T18:30:13.908638] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-18T18:30:13.942323] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-18T18:30:14.048491] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:30:14.128283] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-11. [2025-09-18T18:30:14.350273] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:30:14.667618] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-18T18:30:14.810027] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T18:30:14.919635] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-18T18:30:15.719571] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-11. [2025-09-18T18:30:16.406759] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-11 (3.88 seconds). [2025-09-18T18:30:16.470475] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-18T18:30:16.519534] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-18T18:30:17.319552] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-09-18T18:30:18.119602] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-09-18T18:30:18.605234] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-18T18:30:18.874434] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-18T18:30:18.919534] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-18T18:30:19.421924] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-11 (3.70 seconds). [2025-09-18T18:30:19.719606] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-09-18T18:30:20.317111] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T18:30:20.400051] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-18T18:30:20.519531] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-18T18:30:21.319604] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-09-18T18:30:21.981370] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-18T18:30:22.119550] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-18T18:30:22.259295] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-09-18T18:30:22.866152] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T18:30:22.919549] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-18T18:30:23.267697] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-18T18:30:23.719544] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-09-18T18:30:24.061321] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-18T18:30:24.234743] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-18T18:30:24.519537] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-18T18:30:25.319566] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-18T18:30:25.768225] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-18T18:30:26.119524] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-18T18:30:26.241720] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-18T18:30:26.490784] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-18T18:30:26.919596] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-18T18:30:27.719577] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-18T18:30:28.519538] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-09-18T18:30:28.747521] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-18T18:30:28.816216] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-18T18:30:29.319550] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-18T18:30:30.119595] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-18T18:30:30.580550] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-18T18:30:30.923975] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-18T18:30:30.928116] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-18T18:30:30.977679] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-18T18:30:31.719563] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-18T18:30:32.519589] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-18T18:30:32.774861] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-18T18:30:33.104244] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-18T18:30:33.110090] [INFO ] [REMOTE ] DIN: Full fetch complete (54619 records). [2025-09-18T18:30:33.110267] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-18T18:30:33.112062] [FATAL] [VALIDATOR ] DIN: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:30:33.112355] [FATAL] [MAIN ] DIN: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:30:33.112445] [WARN ] [MAIN ] DIN: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:30:33.112548] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-18T18:30:33.112668] [DEBUG] [LOCAL ] DIN: No primary data file found to delete. [2025-09-18T18:30:33.112746] [INFO ] [LOCAL ] DIN: Starting deletion of derivative data. [2025-09-18T18:30:33.113219] [DEBUG] [LOCAL ] DIN: Deleted derivative data file. [2025-09-18T18:30:33.113378] [INFO ] [MAIN ] Update Progress: 622/2372 symbols completed. DIN took 26.0s. Estimated remaining: 4h 14m 36s. Rate: 6.9 symbols/min [2025-09-18T18:30:33.286459] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:30:33.286720] [DEBUG] [LOCAL ] DK: No existing data file found in primary storage. [2025-09-18T18:30:33.286776] [WARN ] [MAIN ] DK: No existing data found, performing full refresh instead. [2025-09-18T18:30:33.286921] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-18T18:30:33.286965] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-18T18:30:33.287006] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-09-18T18:30:33.287038] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-18T18:30:33.328596] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-18T18:30:33.642983] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:30:33.757027] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-18T18:30:34.119555] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-18T18:30:34.485550] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-18T18:30:34.581676] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-18T18:30:34.919549] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-18T18:30:35.262583] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-18T18:30:35.719564] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-18T18:30:36.219279] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-18T18:30:36.519534] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-18T18:30:37.319596] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-18T18:30:37.836153] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-18T18:30:37.837185] [INFO ] [REMOTE ] DIVY: Full fetch complete (1719 records). [2025-09-18T18:30:37.837299] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-18T18:30:38.030793] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-18T18:30:38.030995] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:30:38.031067] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:30:38.031142] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-18T18:30:38.031211] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-18T18:30:38.031249] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-18T18:30:38.031306] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-18T18:30:38.031392] [INFO ] [MAIN ] Update Progress: 623/2372 symbols completed. DIVY took 24.8s. Estimated remaining: 4h 14m 17s. Rate: 6.9 symbols/min [2025-09-18T18:30:38.125613] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-11. [2025-09-18T18:30:38.223578] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:30:38.245942] [DEBUG] [LOCAL ] DKL: Loaded 19568 existing records from primary storage. [2025-09-18T18:30:38.246072] [INFO ] [MAIN ] DKL: Loaded 19568 existing records. [2025-09-18T18:30:38.435223] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:30:38.435496] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-18T18:30:38.435577] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-18T18:30:38.436299] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-09-18T18:30:38.436362] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-18T18:30:38.836720] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:30:38.889870] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-18T18:30:38.919493] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-11. [2025-09-18T18:30:39.679568] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-18T18:30:39.719498] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-18T18:30:39.803362] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-18T18:30:40.519535] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-18T18:30:41.319573] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-09-18T18:30:41.910906] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-18T18:30:42.002092] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-18T18:30:42.119549] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-18T18:30:42.590299] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-18T18:30:42.919559] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-09-18T18:30:43.719528] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-09-18T18:30:43.923053] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-18T18:30:44.166005] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-18T18:30:44.519531] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-18T18:30:44.904356] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-18T18:30:45.319571] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-09-18T18:30:46.119579] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-18T18:30:46.183914] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-18T18:30:46.374780] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-18T18:30:46.919601] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-18T18:30:47.684719] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-18T18:30:47.719489] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-18T18:30:48.519586] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-18T18:30:49.280903] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-18T18:30:49.322126] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-18T18:30:49.325102] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T18:30:50.070298] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-18T18:30:50.119513] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-18T18:30:50.556999] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-18T18:30:50.919564] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-18T18:30:51.621570] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-18T18:30:51.719544] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-18T18:30:52.102237] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-18T18:30:52.519546] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-18T18:30:53.319510] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-18T18:30:53.634422] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-18T18:30:53.767311] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-18T18:30:54.119555] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-18T18:30:54.925862] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-18T18:30:54.931833] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-18T18:30:55.719555] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-18T18:30:55.868825] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-18T18:30:55.876636] [INFO ] [REMOTE ] DINO: Full fetch complete (76484 records). [2025-09-18T18:30:55.876848] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-18T18:30:56.330992] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-09-18T18:30:56.331212] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-09-18T18:30:56.332252] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-09-18T18:30:56.332388] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-09-18T18:30:56.347169] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-18T18:30:56.352696] [DEBUG] [LOCAL ] DINO: Trimmed 76484 records to 53364 (keeping 200 days of data) [2025-09-18T18:30:56.545968] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-18T18:30:56.699432] [DEBUG] [LOCAL ] DINO: Primary data saved (53364 records). [2025-09-18T18:30:56.699591] [INFO ] [MAIN ] DINO: Full history saved. [2025-09-18T18:30:56.700824] [INFO ] [MAIN ] Update Progress: 624/2372 symbols completed. DINO took 46.0s. Estimated remaining: 4h 14m 36s. Rate: 6.9 symbols/min [2025-09-18T18:30:56.876083] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:30:56.929881] [DEBUG] [LOCAL ] DKS: Loaded 49985 existing records from primary storage. [2025-09-18T18:30:56.930078] [INFO ] [MAIN ] DKS: Loaded 49985 existing records. [2025-09-18T18:30:57.161290] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:30:57.161607] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-18T18:30:57.161751] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-18T18:30:57.163957] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-09-18T18:30:57.164018] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-18T18:30:57.324067] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-18T18:30:57.543397] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-18T18:30:57.542546] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:30:57.953709] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-18T18:30:57.961131] [INFO ] [REMOTE ] DIS: Full fetch complete (77937 records). [2025-09-18T18:30:57.961273] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-18T18:30:58.134727] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-18T18:30:58.373045] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-18T18:30:58.373149] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-18T18:30:58.374002] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-18T18:30:58.374068] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-18T18:30:58.375942] [DEBUG] [LOCAL ] DIS: Trimmed 77937 records to 54178 (keeping 200 days of data) [2025-09-18T18:30:58.739527] [DEBUG] [LOCAL ] DIS: Primary data saved (54178 records). [2025-09-18T18:30:58.739712] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-18T18:30:58.739818] [INFO ] [MAIN ] Update Progress: 625/2372 symbols completed. DIS took 45.8s. Estimated remaining: 4h 14m 9s. Rate: 6.9 symbols/min [2025-09-18T18:30:58.917666] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:30:58.928113] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-11. [2025-09-18T18:30:58.931219] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-18T18:30:58.963163] [DEBUG] [LOCAL ] DLB: Loaded 32282 existing records from primary storage. [2025-09-18T18:30:58.963303] [INFO ] [MAIN ] DLB: Loaded 32282 existing records. [2025-09-18T18:30:59.177373] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:30:59.179808] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-18T18:30:59.179991] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-18T18:30:59.189904] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-18T18:30:59.191322] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-09-18T18:30:59.191392] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-18T18:30:59.549558] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:30:59.719540] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-18T18:31:00.519531] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-18T18:31:00.568511] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-18T18:31:00.930909] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-18T18:31:01.319558] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-09-18T18:31:01.975725] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T18:31:02.119542] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-18T18:31:02.919518] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-18T18:31:03.019563] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-18T18:31:03.058464] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-18T18:31:03.061108] [INFO ] [REMOTE ] DKL: Full fetch complete (29653 records). [2025-09-18T18:31:03.061184] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-18T18:31:03.428614] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-09-18T18:31:03.428722] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-09-18T18:31:03.429153] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-09-18T18:31:03.429194] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-09-18T18:31:03.429948] [DEBUG] [LOCAL ] DKL: Trimmed 29653 records to 19651 (keeping 200 days of data) [2025-09-18T18:31:03.549580] [DEBUG] [LOCAL ] DKL: Primary data saved (19651 records). [2025-09-18T18:31:03.549768] [INFO ] [MAIN ] DKL: Full history saved. [2025-09-18T18:31:03.549912] [INFO ] [MAIN ] Update Progress: 626/2372 symbols completed. DKL took 25.5s. Estimated remaining: 4h 13m 49s. Rate: 6.9 symbols/min [2025-09-18T18:31:03.718592] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:31:03.719473] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-09-18T18:31:03.727905] [DEBUG] [LOCAL ] DLNG: Loaded 6311 existing records from primary storage. [2025-09-18T18:31:03.727999] [INFO ] [MAIN ] DLNG: Loaded 6311 existing records. [2025-09-18T18:31:03.915691] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:31:03.915922] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-18T18:31:03.916022] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-18T18:31:03.916441] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-09-18T18:31:03.916506] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-18T18:31:04.286259] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:31:04.528264] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-11. [2025-09-18T18:31:04.549119] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-18T18:31:05.319533] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-18T18:31:05.367413] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-18T18:31:06.119623] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-18T18:31:06.217453] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-18T18:31:06.785595] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T18:31:06.919519] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-18T18:31:07.592519] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-18T18:31:07.719620] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-18T18:31:08.519625] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-11. [2025-09-18T18:31:08.816789] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-18T18:31:08.831329] [INFO ] [REMOTE ] DK: Full fetch complete (70405 records). [2025-09-18T18:31:08.831563] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-18T18:31:09.228415] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-18T18:31:09.324687] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-09-18T18:31:09.453294] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-09-18T18:31:09.453422] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-09-18T18:31:09.454594] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-09-18T18:31:09.454819] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-09-18T18:31:09.456703] [DEBUG] [LOCAL ] DK: Trimmed 70405 records to 49841 (keeping 200 days of data) [2025-09-18T18:31:09.594046] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-18T18:31:09.881709] [DEBUG] [LOCAL ] DK: Primary data saved (49841 records). [2025-09-18T18:31:09.881875] [INFO ] [MAIN ] DK: Full history saved. [2025-09-18T18:31:09.881959] [INFO ] [MAIN ] Update Progress: 627/2372 symbols completed. DK took 36.8s. Estimated remaining: 4h 13m 34s. Rate: 6.9 symbols/min [2025-09-18T18:31:10.070831] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:31:10.126467] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-18T18:31:10.129731] [DEBUG] [LOCAL ] DLR: Loaded 51265 existing records from primary storage. [2025-09-18T18:31:10.129966] [INFO ] [MAIN ] DLR: Loaded 51265 existing records. [2025-09-18T18:31:10.308302] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:31:10.308565] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-18T18:31:10.308614] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-18T18:31:10.309901] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-09-18T18:31:10.309962] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-18T18:31:10.658779] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:31:10.919512] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-11. [2025-09-18T18:31:11.317890] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-18T18:31:11.692388] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-18T18:31:11.719572] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-09-18T18:31:12.388410] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-18T18:31:12.493258] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-18T18:31:12.519604] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-09-18T18:31:13.319583] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-18T18:31:14.119590] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-09-18T18:31:14.515906] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-18T18:31:14.919596] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-09-18T18:31:15.180702] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-18T18:31:15.371757] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-18T18:31:15.719610] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-18T18:31:16.081327] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-18T18:31:16.213331] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-18T18:31:16.519583] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-18T18:31:17.319549] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-18T18:31:17.722897] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-18T18:31:18.119552] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-18T18:31:18.813179] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-18T18:31:18.919577] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-18T18:31:19.271076] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-18T18:31:19.719632] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-18T18:31:20.519557] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-18T18:31:20.573327] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-18T18:31:20.851021] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-18T18:31:21.319570] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-09-18T18:31:21.543302] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-18T18:31:22.119639] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-18T18:31:22.889150] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-18T18:31:22.919527] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-18T18:31:22.983883] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-18T18:31:23.632558] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-18T18:31:23.719541] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-18T18:31:24.519549] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-18T18:31:25.119424] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-18T18:31:25.319537] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-18T18:31:25.376332] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-18T18:31:25.786905] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-18T18:31:26.119575] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-18T18:31:26.919572] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-18T18:31:27.719593] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-18T18:31:28.064144] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-18T18:31:28.128552] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T18:31:28.519557] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-18T18:31:29.175028] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-18T18:31:29.319563] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-18T18:31:29.525956] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-18T18:31:29.927689] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-18T18:31:29.929077] [INFO ] [REMOTE ] DLNG: Full fetch complete (12093 records). [2025-09-18T18:31:29.929149] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-18T18:31:30.124689] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-18T18:31:30.301136] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-09-18T18:31:30.301219] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-09-18T18:31:30.301491] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-09-18T18:31:30.301530] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-09-18T18:31:30.302081] [DEBUG] [LOCAL ] DLNG: Trimmed 12093 records to 6345 (keeping 200 days of data) [2025-09-18T18:31:30.339625] [DEBUG] [LOCAL ] DLNG: Primary data saved (6345 records). [2025-09-18T18:31:30.339799] [INFO ] [MAIN ] DLNG: Full history saved. [2025-09-18T18:31:30.339947] [INFO ] [MAIN ] Update Progress: 628/2372 symbols completed. DLNG took 26.8s. Estimated remaining: 4h 13m 58s. Rate: 6.9 symbols/min [2025-09-18T18:31:30.523141] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:31:30.575290] [DEBUG] [LOCAL ] DLX: Loaded 29317 existing records from primary storage. [2025-09-18T18:31:30.575449] [INFO ] [MAIN ] DLX: Loaded 29317 existing records. [2025-09-18T18:31:30.754726] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:31:30.754972] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-18T18:31:30.755029] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-18T18:31:30.756061] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-18T18:31:30.756135] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-18T18:31:30.933002] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-18T18:31:31.120750] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:31:31.524920] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-18T18:31:31.719559] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-11. [2025-09-18T18:31:32.519581] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-18T18:31:32.562024] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-18T18:31:32.640094] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-18T18:31:33.319582] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-18T18:31:33.495433] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-18T18:31:34.119585] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-09-18T18:31:34.919973] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-18T18:31:34.921720] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-18T18:31:35.166975] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-18T18:31:35.719564] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-18T18:31:35.919311] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-18T18:31:36.519583] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-18T18:31:37.319615] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-18T18:31:37.550800] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-18T18:31:37.563610] [INFO ] [REMOTE ] DKS: Full fetch complete (71499 records). [2025-09-18T18:31:37.563862] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-18T18:31:37.988078] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-09-18T18:31:37.988220] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-09-18T18:31:37.989580] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-09-18T18:31:37.989737] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-09-18T18:31:38.023342] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T18:31:38.021747] [DEBUG] [LOCAL ] DKS: Trimmed 71499 records to 50351 (keeping 200 days of data) [2025-09-18T18:31:38.135779] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-09-18T18:31:38.362442] [DEBUG] [LOCAL ] DKS: Primary data saved (50351 records). [2025-09-18T18:31:38.362584] [INFO ] [MAIN ] DKS: Full history saved. [2025-09-18T18:31:38.363600] [INFO ] [MAIN ] Update Progress: 629/2372 symbols completed. DKS took 41.7s. Estimated remaining: 4h 13m 47s. Rate: 6.9 symbols/min [2025-09-18T18:31:38.537074] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:31:38.561250] [DEBUG] [LOCAL ] DLY: Loaded 19271 existing records from primary storage. [2025-09-18T18:31:38.561377] [INFO ] [MAIN ] DLY: Loaded 19271 existing records. [2025-09-18T18:31:38.742394] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:31:38.742829] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-18T18:31:38.742911] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-18T18:31:38.749633] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-09-18T18:31:38.757484] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-18T18:31:38.802155] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-18T18:31:38.874665] [INFO ] [REMOTE ] DLB: Full fetch complete (46937 records). [2025-09-18T18:31:38.880796] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-18T18:31:38.924979] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-18T18:31:39.362116] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:31:39.606747] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-09-18T18:31:39.606493] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-18T18:31:39.609510] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-09-18T18:31:39.614006] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-09-18T18:31:39.614226] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-09-18T18:31:39.615677] [DEBUG] [LOCAL ] DLB: Trimmed 46937 records to 32524 (keeping 200 days of data) [2025-09-18T18:31:39.725509] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-11. [2025-09-18T18:31:39.839687] [DEBUG] [LOCAL ] DLB: Primary data saved (32524 records). [2025-09-18T18:31:39.839821] [INFO ] [MAIN ] DLB: Full history saved. [2025-09-18T18:31:39.839943] [INFO ] [MAIN ] Update Progress: 630/2372 symbols completed. DLB took 41.1s. Estimated remaining: 4h 13m 18s. Rate: 6.9 symbols/min [2025-09-18T18:31:40.015673] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:31:40.015856] [DEBUG] [LOCAL ] DMA: No existing data file found in primary storage. [2025-09-18T18:31:40.015911] [WARN ] [MAIN ] DMA: No existing data found, performing full refresh instead. [2025-09-18T18:31:40.016062] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-18T18:31:40.016136] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-18T18:31:40.016209] [DEBUG] [LOCAL ] DMA: No primary data file found to delete. [2025-09-18T18:31:40.016244] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-18T18:31:40.401116] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:31:40.519538] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-18T18:31:40.645936] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-18T18:31:40.777404] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-18T18:31:41.319547] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-18T18:31:41.950988] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T18:31:42.119590] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-09-18T18:31:42.919506] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-11. [2025-09-18T18:31:43.067460] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-18T18:31:43.221256] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-18T18:31:43.310725] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-11 (0.39 seconds). [2025-09-18T18:31:43.719544] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-09-18T18:31:44.519566] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-18T18:31:44.744325] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-18T18:31:45.319770] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-18T18:31:46.124701] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-18T18:31:46.138232] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-18T18:31:46.156934] [INFO ] [REMOTE ] DLR: Full fetch complete (73776 records). [2025-09-18T18:31:46.158445] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-18T18:31:46.158282] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-18T18:31:46.162966] [FATAL] [VALIDATOR ] DLR: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:31:46.163766] [FATAL] [MAIN ] DLR: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:31:46.164038] [WARN ] [MAIN ] DLR: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:31:46.165177] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-18T18:31:46.165283] [DEBUG] [LOCAL ] DLR: No primary data file found to delete. [2025-09-18T18:31:46.165342] [INFO ] [LOCAL ] DLR: Starting deletion of derivative data. [2025-09-18T18:31:46.165811] [DEBUG] [LOCAL ] DLR: Deleted derivative data file. [2025-09-18T18:31:46.166001] [INFO ] [MAIN ] Update Progress: 631/2372 symbols completed. DLR took 36.3s. Estimated remaining: 4h 13m 3s. Rate: 6.9 symbols/min [2025-09-18T18:31:46.339051] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:31:46.339226] [DEBUG] [LOCAL ] DMB: No existing data file found in primary storage. [2025-09-18T18:31:46.339263] [WARN ] [MAIN ] DMB: No existing data found, performing full refresh instead. [2025-09-18T18:31:46.339404] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-18T18:31:46.339485] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-18T18:31:46.339549] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-09-18T18:31:46.339596] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-18T18:31:46.714261] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:31:46.919559] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-11. [2025-09-18T18:31:47.517962] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-18T18:31:47.644794] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-18T18:31:47.719551] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-09-18T18:31:48.519545] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-18T18:31:48.566052] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-18T18:31:49.319551] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-09-18T18:31:49.770350] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-18T18:31:49.864118] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-18T18:31:50.119548] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-18T18:31:50.919551] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-18T18:31:51.220049] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-18T18:31:51.719547] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-18T18:31:51.747936] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-18T18:31:52.519572] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-18T18:31:52.635755] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T18:31:53.258278] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-18T18:31:53.319531] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-18T18:31:54.015148] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-18T18:31:54.119555] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-18T18:31:54.904672] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-18T18:31:54.919505] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-18T18:31:55.703239] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-18T18:31:55.719496] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-18T18:31:56.454600] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-18T18:31:56.519552] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-18T18:31:57.319542] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-18T18:31:57.944349] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-18T18:31:58.084137] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-18T18:31:58.119540] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-18T18:31:58.919538] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-18T18:31:58.958960] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-18T18:31:59.719543] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-18T18:31:59.881358] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-18T18:32:00.420547] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-18T18:32:00.519547] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-09-18T18:32:01.280127] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-18T18:32:01.319584] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-18T18:32:02.119690] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-18T18:32:02.663243] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-18T18:32:02.849969] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-18T18:32:02.919585] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-18T18:32:03.719612] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-18T18:32:04.118972] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-18T18:32:04.123099] [INFO ] [REMOTE ] DLX: Full fetch complete (41088 records). [2025-09-18T18:32:04.123237] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-18T18:32:04.519987] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-18T18:32:04.519561] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-09-18T18:32:04.521491] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-18T18:32:04.522091] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-18T18:32:04.522156] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-18T18:32:04.523694] [DEBUG] [LOCAL ] DLX: Trimmed 41088 records to 29538 (keeping 200 days of data) [2025-09-18T18:32:04.716475] [DEBUG] [LOCAL ] DLX: Primary data saved (29538 records). [2025-09-18T18:32:04.716614] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-18T18:32:04.716805] [INFO ] [MAIN ] Update Progress: 632/2372 symbols completed. DLX took 34.4s. Estimated remaining: 4h 13m 21s. Rate: 6.9 symbols/min [2025-09-18T18:32:04.898432] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:32:04.907278] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-18T18:32:04.910615] [INFO ] [REMOTE ] DMB: Full fetch complete (15044 records). [2025-09-18T18:32:04.910793] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-18T18:32:05.027006] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-18T18:32:05.038934] [DEBUG] [LOCAL ] DMO: Loaded 9862 existing records from primary storage. [2025-09-18T18:32:05.039305] [INFO ] [MAIN ] DMO: Loaded 9862 existing records. [2025-09-18T18:32:05.324723] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-18T18:32:05.524669] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:32:05.601196] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-09-18T18:32:05.601316] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-09-18T18:32:05.601020] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-18T18:32:05.601752] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-09-18T18:32:05.601899] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-09-18T18:32:05.602101] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-18T18:32:05.602735] [DEBUG] [LOCAL ] DMB: Trimmed 15044 records to 10199 (keeping 200 days of data) [2025-09-18T18:32:05.603547] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-09-18T18:32:05.603630] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-18T18:32:06.030296] [DEBUG] [LOCAL ] DMB: Primary data saved (10199 records). [2025-09-18T18:32:06.046795] [INFO ] [MAIN ] DMB: Full history saved. [2025-09-18T18:32:06.051411] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:32:06.051918] [INFO ] [MAIN ] Update Progress: 633/2372 symbols completed. DMB took 19.9s. Estimated remaining: 4h 12m 52s. Rate: 6.9 symbols/min [2025-09-18T18:32:06.124803] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-18T18:32:06.235060] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:32:06.298897] [DEBUG] [LOCAL ] DNA: Loaded 48544 existing records from primary storage. [2025-09-18T18:32:06.299050] [INFO ] [MAIN ] DNA: Loaded 48544 existing records. [2025-09-18T18:32:06.479978] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:32:06.480331] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-18T18:32:06.480469] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-18T18:32:06.486917] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-09-18T18:32:06.495242] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-18T18:32:06.501346] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-18T18:32:06.628805] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-18T18:32:06.879291] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:32:06.919514] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-11. [2025-09-18T18:32:07.719561] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-11. [2025-09-18T18:32:08.479766] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-18T18:32:08.519549] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-18T18:32:08.981908] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-11 (2.06 seconds). [2025-09-18T18:32:09.013590] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-18T18:32:09.319557] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-09-18T18:32:10.083637] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-18T18:32:10.119553] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-18T18:32:10.919571] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-09-18T18:32:11.018274] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-18T18:32:11.719607] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-18T18:32:12.362270] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-18T18:32:12.383462] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-18T18:32:12.519583] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-09-18T18:32:13.132271] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-18T18:32:13.319558] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-18T18:32:13.935961] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-18T18:32:14.119587] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-09-18T18:32:14.919548] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-18T18:32:15.377728] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-18T18:32:15.719562] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-18T18:32:15.854690] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-18T18:32:16.148566] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-18T18:32:16.519604] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-18T18:32:17.192997] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-18T18:32:17.319599] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-18T18:32:18.119564] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-18T18:32:18.919580] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-18T18:32:18.983727] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-18T18:32:19.238302] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-18T18:32:19.719584] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-18T18:32:19.809244] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-18T18:32:19.814711] [INFO ] [REMOTE ] DLY: Full fetch complete (27844 records). [2025-09-18T18:32:19.814825] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-18T18:32:19.815521] [FATAL] [VALIDATOR ] DLY: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:32:19.815678] [FATAL] [MAIN ] DLY: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:32:19.815745] [WARN ] [MAIN ] DLY: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:32:19.815829] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-18T18:32:19.815912] [DEBUG] [LOCAL ] DLY: No primary data file found to delete. [2025-09-18T18:32:19.815965] [INFO ] [LOCAL ] DLY: Starting deletion of derivative data. [2025-09-18T18:32:19.816667] [DEBUG] [LOCAL ] DLY: Deleted derivative data file. [2025-09-18T18:32:19.816789] [INFO ] [MAIN ] Update Progress: 634/2372 symbols completed. DLY took 41.5s. Estimated remaining: 4h 12m 57s. Rate: 6.9 symbols/min [2025-09-18T18:32:19.996704] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:32:20.049771] [DEBUG] [LOCAL ] DNOW: Loaded 43483 existing records from primary storage. [2025-09-18T18:32:20.049931] [INFO ] [MAIN ] DNOW: Loaded 43483 existing records. [2025-09-18T18:32:20.236500] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:32:20.236842] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-18T18:32:20.236910] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-18T18:32:20.238065] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-09-18T18:32:20.238146] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-18T18:32:20.524679] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-18T18:32:20.611026] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:32:21.316367] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-18T18:32:21.317921] [INFO ] [REMOTE ] DMA: Full fetch complete (6428 records). [2025-09-18T18:32:21.317997] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-18T18:32:21.318395] [FATAL] [VALIDATOR ] DMA: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:32:21.318500] [FATAL] [MAIN ] DMA: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:32:21.318557] [WARN ] [MAIN ] DMA: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:32:21.318625] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-18T18:32:21.318732] [DEBUG] [LOCAL ] DMA: No primary data file found to delete. [2025-09-18T18:32:21.318779] [INFO ] [LOCAL ] DMA: Starting deletion of derivative data. [2025-09-18T18:32:21.318822] [DEBUG] [LOCAL ] DMA: No derivative data file found to delete. [2025-09-18T18:32:21.318881] [INFO ] [MAIN ] Update Progress: 635/2372 symbols completed. DMA took 41.5s. Estimated remaining: 4h 12m 29s. Rate: 6.9 symbols/min [2025-09-18T18:32:21.332705] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-11. [2025-09-18T18:32:21.516211] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:32:21.516618] [DEBUG] [LOCAL ] DNP: No existing data file found in primary storage. [2025-09-18T18:32:21.516720] [WARN ] [MAIN ] DNP: No existing data found, performing full refresh instead. [2025-09-18T18:32:21.541564] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-18T18:32:21.544483] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-18T18:32:21.544625] [DEBUG] [LOCAL ] DNP: No primary data file found to delete. [2025-09-18T18:32:21.544964] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-18T18:32:21.579771] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-18T18:32:21.927877] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:32:22.119573] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-11. [2025-09-18T18:32:22.919704] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-18T18:32:22.920903] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-18T18:32:23.346958] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-18T18:32:23.474286] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-18T18:32:23.719557] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-09-18T18:32:24.519600] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-18T18:32:25.137845] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-18T18:32:25.155332] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-18T18:32:25.319560] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-09-18T18:32:26.119564] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-18T18:32:26.408953] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-18T18:32:26.700578] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-18T18:32:26.919552] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-18T18:32:27.719590] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-09-18T18:32:28.519567] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-18T18:32:28.912691] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-18T18:32:29.319559] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-18T18:32:30.007178] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-18T18:32:30.119544] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-18T18:32:30.618097] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-18T18:32:30.919534] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-18T18:32:31.014694] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-18T18:32:31.525688] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T18:32:31.719570] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-18T18:32:32.519552] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-09-18T18:32:32.555832] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-18T18:32:33.319553] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-18T18:32:33.942157] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-18T18:32:34.114306] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-18T18:32:34.121695] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-18T18:32:34.410132] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-18T18:32:34.919546] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-18T18:32:35.719560] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-18T18:32:35.790912] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-18T18:32:36.519595] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-18T18:32:36.631557] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-18T18:32:36.633443] [INFO ] [REMOTE ] DMO: Full fetch complete (14399 records). [2025-09-18T18:32:36.633697] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-18T18:32:36.634356] [FATAL] [VALIDATOR ] DMO: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:32:36.634515] [FATAL] [MAIN ] DMO: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:32:36.634584] [WARN ] [MAIN ] DMO: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:32:36.634834] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-18T18:32:36.634942] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-09-18T18:32:36.635011] [INFO ] [LOCAL ] DMO: Starting deletion of derivative data. [2025-09-18T18:32:36.644790] [DEBUG] [LOCAL ] DMO: Deleted derivative data file. [2025-09-18T18:32:36.660581] [INFO ] [MAIN ] Update Progress: 636/2372 symbols completed. DMO took 31.9s. Estimated remaining: 4h 12m 38s. Rate: 6.9 symbols/min [2025-09-18T18:32:36.662550] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-18T18:32:36.848806] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:32:36.906672] [DEBUG] [LOCAL ] DOC: Loaded 53537 existing records from primary storage. [2025-09-18T18:32:36.906826] [INFO ] [MAIN ] DOC: Loaded 53537 existing records. [2025-09-18T18:32:37.100910] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:32:37.101179] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-18T18:32:37.101228] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-18T18:32:37.102367] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-09-18T18:32:37.102428] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-18T18:32:37.324726] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-18T18:32:37.460705] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:32:38.119564] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-11. [2025-09-18T18:32:38.526280] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-18T18:32:38.555746] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-18T18:32:38.919560] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-18T18:32:39.719551] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-18T18:32:39.983341] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-18T18:32:40.170624] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-18T18:32:40.519580] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-18T18:32:41.319539] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-09-18T18:32:41.425544] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-18T18:32:41.829694] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-18T18:32:42.119556] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-18T18:32:42.919514] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-18T18:32:42.999723] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-18T18:32:43.719603] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-18T18:32:43.780419] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-18T18:32:43.840015] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-18T18:32:44.519575] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-18T18:32:45.245209] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-18T18:32:45.251620] [INFO ] [REMOTE ] DNA: Full fetch complete (70543 records). [2025-09-18T18:32:45.251820] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-18T18:32:45.252697] [FATAL] [VALIDATOR ] DNA: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:32:45.252791] [FATAL] [MAIN ] DNA: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:32:45.252865] [WARN ] [MAIN ] DNA: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:32:45.252925] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-18T18:32:45.253010] [DEBUG] [LOCAL ] DNA: No primary data file found to delete. [2025-09-18T18:32:45.253051] [INFO ] [LOCAL ] DNA: Starting deletion of derivative data. [2025-09-18T18:32:45.253423] [DEBUG] [LOCAL ] DNA: Deleted derivative data file. [2025-09-18T18:32:45.253536] [INFO ] [MAIN ] Update Progress: 637/2372 symbols completed. DNA took 39.2s. Estimated remaining: 4h 12m 29s. Rate: 6.9 symbols/min [2025-09-18T18:32:45.319551] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-09-18T18:32:45.662432] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T18:32:46.119590] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-18T18:32:46.919546] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-18T18:32:46.956863] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-18T18:32:47.450329] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T18:32:47.458907] [INFO ] [REMOTE ] DNOW: Full fetch complete (62147 records). [2025-09-18T18:32:47.459067] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-18T18:32:47.732431] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-18T18:32:47.876090] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-09-18T18:32:47.876178] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-09-18T18:32:47.876866] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-09-18T18:32:47.876929] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-09-18T18:32:47.878216] [DEBUG] [LOCAL ] DNOW: Trimmed 62147 records to 43837 (keeping 200 days of data) [2025-09-18T18:32:48.138183] [DEBUG] [LOCAL ] DNOW: Primary data saved (43837 records). [2025-09-18T18:32:48.138333] [INFO ] [MAIN ] DNOW: Full history saved. [2025-09-18T18:32:48.139107] [INFO ] [MAIN ] Update Progress: 638/2372 symbols completed. DNOW took 28.3s. Estimated remaining: 4h 12m 4s. Rate: 6.9 symbols/min [2025-09-18T18:32:48.436231] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T18:32:48.519500] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-18T18:32:49.188954] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-18T18:32:49.319549] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-18T18:32:49.632741] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-18T18:32:50.119551] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-18T18:32:51.163847] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-18T18:32:51.176048] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-18T18:32:51.494185] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-18T18:32:51.719544] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-18T18:32:52.835444] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T18:32:52.862961] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-18T18:32:52.867195] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-18T18:32:53.319546] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-18T18:32:54.457555] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T18:32:54.465258] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-18T18:32:54.590164] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-18T18:32:54.919593] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-18T18:32:55.791083] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T18:32:55.795955] [INFO ] [REMOTE ] DNP: Full fetch complete (49385 records). [2025-09-18T18:32:55.796068] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-18T18:32:56.171834] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-09-18T18:32:56.171917] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-09-18T18:32:56.172499] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-09-18T18:32:56.172542] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-09-18T18:32:56.176799] [DEBUG] [LOCAL ] DNP: Trimmed 49385 records to 33722 (keeping 200 days of data) [2025-09-18T18:32:56.380161] [DEBUG] [LOCAL ] DNP: Primary data saved (33722 records). [2025-09-18T18:32:56.380341] [INFO ] [MAIN ] DNP: Full history saved. [2025-09-18T18:32:56.380457] [INFO ] [MAIN ] Update Progress: 639/2372 symbols completed. DNP took 35.1s. Estimated remaining: 4h 11m 54s. Rate: 6.9 symbols/min [2025-09-18T18:32:56.655246] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-18T18:32:56.666158] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-18T18:32:58.451862] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-18T18:32:58.463721] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-18T18:33:00.111542] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-18T18:33:00.123545] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-18T18:33:02.607215] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-18T18:33:02.615072] [INFO ] [REMOTE ] DOC: Full fetch complete (77204 records). [2025-09-18T18:33:02.615212] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-18T18:33:03.029873] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-09-18T18:33:03.029962] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-09-18T18:33:03.030846] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-09-18T18:33:03.030914] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-09-18T18:33:03.032497] [DEBUG] [LOCAL ] DOC: Trimmed 77204 records to 53925 (keeping 200 days of data) [2025-09-18T18:33:03.366436] [DEBUG] [LOCAL ] DOC: Primary data saved (53925 records). [2025-09-18T18:33:03.366631] [INFO ] [MAIN ] DOC: Full history saved. [2025-09-18T18:33:03.366767] [INFO ] [MAIN ] Update Progress: 640/2372 symbols completed. DOC took 26.7s. Estimated remaining: 4h 11m 41s. Rate: 6.9 symbols/min [2025-09-18T18:33:03.962067] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:33:03.936776] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:33:04.026173] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:33:04.088861] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:33:04.190860] [DEBUG] [LOCAL ] DOLE: Loaded 37792 existing records from primary storage. [2025-09-18T18:33:04.192112] [DEBUG] [LOCAL ] DOCN: Loaded 50400 existing records from primary storage. [2025-09-18T18:33:04.192812] [DEBUG] [LOCAL ] DOUG: Loaded 34861 existing records from primary storage. [2025-09-18T18:33:04.192264] [INFO ] [MAIN ] DOCN: Loaded 50400 existing records. [2025-09-18T18:33:04.222902] [INFO ] [MAIN ] DOLE: Loaded 37792 existing records. [2025-09-18T18:33:04.223033] [INFO ] [MAIN ] DOUG: Loaded 34861 existing records. [2025-09-18T18:33:04.377600] [DEBUG] [LOCAL ] DOCS: Loaded 51388 existing records from primary storage. [2025-09-18T18:33:04.468193] [INFO ] [MAIN ] DOCS: Loaded 51388 existing records. [2025-09-18T18:33:04.899316] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:33:04.887956] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:33:04.923730] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:33:04.950089] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-18T18:33:04.923966] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-18T18:33:04.959172] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-18T18:33:04.983352] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-18T18:33:04.983527] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:33:04.983868] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-18T18:33:04.983915] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-18T18:33:04.984842] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-09-18T18:33:04.985053] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-18T18:33:04.985180] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-09-18T18:33:04.990629] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-18T18:33:04.984973] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-18T18:33:04.997168] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-18T18:33:04.990567] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-18T18:33:05.020851] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-18T18:33:05.131320] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-09-18T18:33:05.253257] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-18T18:33:06.326032] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:33:06.390393] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-11. [2025-09-18T18:33:06.495086] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:33:06.490079] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:33:06.499942] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-11. [2025-09-18T18:33:06.499596] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-11. [2025-09-18T18:33:06.586242] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:33:06.586974] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-11. [2025-09-18T18:33:07.784115] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-18T18:33:07.792208] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-09-18T18:33:07.934179] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-18T18:33:07.942024] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-09-18T18:33:07.972828] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-18T18:33:07.982623] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-09-18T18:33:08.165564] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-18T18:33:08.175617] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-09-18T18:33:09.407163] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-18T18:33:09.416895] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-09-18T18:33:09.444766] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T18:33:09.452532] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-09-18T18:33:09.483163] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T18:33:09.492455] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-09-18T18:33:09.560957] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T18:33:09.571597] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-09-18T18:33:10.558319] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-18T18:33:10.567104] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-18T18:33:10.623183] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T18:33:10.632521] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-18T18:33:10.958121] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-18T18:33:10.968579] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-18T18:33:11.040002] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-18T18:33:11.050685] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-18T18:33:11.639521] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T18:33:11.648171] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-18T18:33:11.947618] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T18:33:11.955707] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-18T18:33:12.315721] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T18:33:12.456963] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T18:33:12.519540] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-18T18:33:12.625950] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-18T18:33:13.060889] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-18T18:33:13.319581] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-18T18:33:14.119705] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-18T18:33:14.755315] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-18T18:33:14.919633] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-18T18:33:15.411445] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-18T18:33:15.719707] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-18T18:33:16.519622] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-18T18:33:16.884001] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-18T18:33:17.102761] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (2.98 seconds). [2025-09-18T18:33:17.319537] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-18T18:33:17.724556] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-18T18:33:17.759924] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-18T18:33:18.119611] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-18T18:33:18.622389] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-18T18:33:18.919609] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-18T18:33:19.719628] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-18T18:33:19.879855] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-18T18:33:20.523188] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-18T18:33:20.529785] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-18T18:33:20.605899] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T18:33:21.319545] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-18T18:33:22.119608] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-18T18:33:22.509023] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-18T18:33:22.691722] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-18T18:33:22.919567] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-18T18:33:23.652618] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T18:33:23.719504] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-18T18:33:24.123608] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-18T18:33:24.519544] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-18T18:33:25.319557] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-18T18:33:25.539227] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-18T18:33:25.817001] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-18T18:33:26.119548] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-18T18:33:26.919596] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-18T18:33:27.325626] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-18T18:33:27.575055] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-18T18:33:27.719508] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-18T18:33:28.329254] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-18T18:33:28.334085] [INFO ] [REMOTE ] DOUG: Full fetch complete (51820 records). [2025-09-18T18:33:28.334189] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-18T18:33:28.528449] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-18T18:33:28.741997] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-09-18T18:33:28.742087] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-09-18T18:33:28.742750] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-09-18T18:33:28.742818] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-09-18T18:33:28.744098] [DEBUG] [LOCAL ] DOUG: Trimmed 51820 records to 35182 (keeping 200 days of data) [2025-09-18T18:33:28.940105] [DEBUG] [LOCAL ] DOUG: Primary data saved (35182 records). [2025-09-18T18:33:28.940249] [INFO ] [MAIN ] DOUG: Full history saved. [2025-09-18T18:33:28.940383] [INFO ] [MAIN ] Update Progress: 641/2372 symbols completed. DOUG took 25.6s. Estimated remaining: 4h 12m 18s. Rate: 6.9 symbols/min [2025-09-18T18:33:29.115902] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:33:29.116172] [DEBUG] [LOCAL ] DOV: No existing data file found in primary storage. [2025-09-18T18:33:29.116228] [WARN ] [MAIN ] DOV: No existing data found, performing full refresh instead. [2025-09-18T18:33:29.116390] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-18T18:33:29.116434] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-18T18:33:29.116475] [DEBUG] [LOCAL ] DOV: No primary data file found to delete. [2025-09-18T18:33:29.116507] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-18T18:33:29.334056] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-18T18:33:29.487740] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:33:29.556763] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-18T18:33:30.119558] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-11. [2025-09-18T18:33:30.332420] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-18T18:33:30.527638] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-18T18:33:30.919597] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-18T18:33:31.719562] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-18T18:33:31.831210] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-18T18:33:32.437555] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-18T18:33:32.519552] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-09-18T18:33:33.200761] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-18T18:33:33.210577] [INFO ] [REMOTE ] DOLE: Full fetch complete (52951 records). [2025-09-18T18:33:33.210759] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-18T18:33:33.324804] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-18T18:33:33.611941] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-09-18T18:33:33.612026] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-09-18T18:33:33.612702] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-09-18T18:33:33.612768] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-09-18T18:33:33.613874] [DEBUG] [LOCAL ] DOLE: Trimmed 52951 records to 38101 (keeping 200 days of data) [2025-09-18T18:33:33.877495] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T18:33:33.889040] [DEBUG] [LOCAL ] DOLE: Primary data saved (38101 records). [2025-09-18T18:33:33.890195] [INFO ] [MAIN ] DOLE: Full history saved. [2025-09-18T18:33:33.890326] [INFO ] [MAIN ] Update Progress: 642/2372 symbols completed. DOLE took 30.5s. Estimated remaining: 4h 11m 59s. Rate: 6.9 symbols/min [2025-09-18T18:33:34.062673] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:33:34.062922] [DEBUG] [LOCAL ] DOW: No existing data file found in primary storage. [2025-09-18T18:33:34.062979] [WARN ] [MAIN ] DOW: No existing data found, performing full refresh instead. [2025-09-18T18:33:34.063122] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-18T18:33:34.063211] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-18T18:33:34.063279] [DEBUG] [LOCAL ] DOW: No primary data file found to delete. [2025-09-18T18:33:34.063315] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-18T18:33:34.124759] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-18T18:33:34.414581] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:33:34.919698] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-11. [2025-09-18T18:33:35.192249] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-18T18:33:35.199565] [INFO ] [REMOTE ] DOCN: Full fetch complete (70850 records). [2025-09-18T18:33:35.199739] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-18T18:33:35.612557] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-18T18:33:35.612682] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-18T18:33:35.613498] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-18T18:33:35.613546] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-18T18:33:35.615153] [DEBUG] [LOCAL ] DOCN: Trimmed 70850 records to 50790 (keeping 200 days of data) [2025-09-18T18:33:35.719739] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-09-18T18:33:35.948325] [DEBUG] [LOCAL ] DOCN: Primary data saved (50790 records). [2025-09-18T18:33:35.948582] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-18T18:33:35.948773] [INFO ] [MAIN ] Update Progress: 643/2372 symbols completed. DOCN took 32.6s. Estimated remaining: 4h 11m 32s. Rate: 6.9 symbols/min [2025-09-18T18:33:36.121510] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-18T18:33:36.164910] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:33:36.165249] [INFO ] [REMOTE ] DOCS: Full fetch complete (74115 records). [2025-09-18T18:33:36.166242] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-18T18:33:36.311178] [DEBUG] [LOCAL ] DPG: Loaded 13284 existing records from primary storage. [2025-09-18T18:33:36.321606] [INFO ] [MAIN ] DPG: Loaded 13284 existing records. [2025-09-18T18:33:36.660141] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:33:36.692202] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-18T18:33:36.695910] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-18T18:33:36.706829] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-09-18T18:33:36.735841] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-18T18:33:36.831621] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-09-18T18:33:36.838685] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-09-18T18:33:36.865584] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-09-18T18:33:36.865733] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-09-18T18:33:36.958085] [DEBUG] [LOCAL ] DOCS: Trimmed 74115 records to 51729 (keeping 200 days of data) [2025-09-18T18:33:37.268075] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-11 (2.35 seconds). [2025-09-18T18:33:37.309192] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-09-18T18:33:37.319072] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:33:37.321063] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-11. [2025-09-18T18:33:37.458535] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-18T18:33:37.576102] [DEBUG] [LOCAL ] DOCS: Primary data saved (51729 records). [2025-09-18T18:33:37.576304] [INFO ] [MAIN ] DOCS: Full history saved. [2025-09-18T18:33:37.576440] [INFO ] [MAIN ] Update Progress: 644/2372 symbols completed. DOCS took 34.2s. Estimated remaining: 4h 11m 4s. Rate: 6.9 symbols/min [2025-09-18T18:33:37.759480] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:33:37.808470] [DEBUG] [LOCAL ] DQ: Loaded 43073 existing records from primary storage. [2025-09-18T18:33:37.808697] [INFO ] [MAIN ] DQ: Loaded 43073 existing records. [2025-09-18T18:33:37.996252] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:33:37.996541] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-18T18:33:37.996592] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-18T18:33:37.997730] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-09-18T18:33:37.997792] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-18T18:33:38.124709] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-18T18:33:38.381034] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:33:38.382454] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-18T18:33:38.919556] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-09-18T18:33:39.155385] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-18T18:33:39.719571] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-11. [2025-09-18T18:33:39.777430] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-18T18:33:39.805961] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-18T18:33:40.519569] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-18T18:33:41.197138] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-18T18:33:41.319496] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-09-18T18:33:42.119543] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-09-18T18:33:42.153927] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-18T18:33:42.660589] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T18:33:42.919543] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-18T18:33:43.719523] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-09-18T18:33:43.973605] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-18T18:33:44.387020] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-18T18:33:44.519543] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-09-18T18:33:44.654097] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-18T18:33:45.319555] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-18T18:33:45.923600] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-18T18:33:46.119567] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-18T18:33:46.208724] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-18T18:33:46.919559] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-18T18:33:47.719498] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-18T18:33:48.230528] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-18T18:33:48.315682] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T18:33:48.519521] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-18T18:33:48.633853] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-18T18:33:49.319552] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-18T18:33:49.884512] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T18:33:50.119624] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-18T18:33:50.268744] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-18T18:33:50.919552] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-18T18:33:51.719569] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-18T18:33:52.011062] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-18T18:33:52.440316] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-18T18:33:52.519494] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-18T18:33:52.757925] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-18T18:33:53.319545] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-18T18:33:53.899342] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T18:33:54.119545] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-18T18:33:54.129736] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-18T18:33:54.919599] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-18T18:33:55.719621] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-18T18:33:55.943976] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-18T18:33:56.313545] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-18T18:33:56.498414] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-18T18:33:56.519513] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-18T18:33:57.113963] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-18T18:33:57.319560] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-18T18:33:58.119557] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-18T18:33:58.919544] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-18T18:33:59.278722] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-18T18:33:59.281132] [INFO ] [REMOTE ] DPG: Full fetch complete (18700 records). [2025-09-18T18:33:59.281282] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-18T18:33:59.281878] [FATAL] [VALIDATOR ] DPG: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:33:59.281970] [FATAL] [MAIN ] DPG: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:33:59.282034] [WARN ] [MAIN ] DPG: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:33:59.282155] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-18T18:33:59.282283] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-09-18T18:33:59.282374] [INFO ] [LOCAL ] DPG: Starting deletion of derivative data. [2025-09-18T18:33:59.282928] [DEBUG] [LOCAL ] DPG: Deleted derivative data file. [2025-09-18T18:33:59.283080] [INFO ] [MAIN ] Update Progress: 645/2372 symbols completed. DPG took 23.3s. Estimated remaining: 4h 11m 30s. Rate: 6.9 symbols/min [2025-09-18T18:33:59.472429] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:33:59.510097] [DEBUG] [LOCAL ] DRD: Loaded 36296 existing records from primary storage. [2025-09-18T18:33:59.510256] [INFO ] [MAIN ] DRD: Loaded 36296 existing records. [2025-09-18T18:33:59.726110] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-18T18:33:59.732932] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:33:59.736590] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-18T18:33:59.747839] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-18T18:33:59.748315] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-18T18:33:59.749572] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-09-18T18:33:59.749638] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-18T18:34:00.141449] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:34:00.165712] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-18T18:34:00.519553] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-18T18:34:01.116045] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T18:34:01.319588] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-11. [2025-09-18T18:34:02.119513] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-18T18:34:02.596939] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-18T18:34:02.919557] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-18T18:34:03.067466] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-18T18:34:03.632482] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T18:34:03.643215] [INFO ] [REMOTE ] DOV: Full fetch complete (64588 records). [2025-09-18T18:34:03.643414] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-18T18:34:03.724751] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-18T18:34:04.060667] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-09-18T18:34:04.060833] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-09-18T18:34:04.061816] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-09-18T18:34:04.061890] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-09-18T18:34:04.063946] [DEBUG] [LOCAL ] DOV: Trimmed 64588 records to 46188 (keeping 200 days of data) [2025-09-18T18:34:04.399673] [DEBUG] [LOCAL ] DOV: Primary data saved (46188 records). [2025-09-18T18:34:04.399904] [INFO ] [MAIN ] DOV: Full history saved. [2025-09-18T18:34:04.400010] [INFO ] [MAIN ] Update Progress: 646/2372 symbols completed. DOV took 35.5s. Estimated remaining: 4h 11m 12s. Rate: 6.9 symbols/min [2025-09-18T18:34:04.523464] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-09-18T18:34:04.621194] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:34:04.686574] [DEBUG] [LOCAL ] DRH: Loaded 50435 existing records from primary storage. [2025-09-18T18:34:04.686764] [INFO ] [MAIN ] DRH: Loaded 50435 existing records. [2025-09-18T18:34:04.883072] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:34:04.883462] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-18T18:34:04.883539] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-18T18:34:04.884892] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-09-18T18:34:04.884956] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-18T18:34:05.029355] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-18T18:34:05.304281] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:34:05.323995] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-18T18:34:05.329847] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-18T18:34:05.362499] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T18:34:06.119610] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-18T18:34:06.919622] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-11. [2025-09-18T18:34:07.656193] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-18T18:34:07.719601] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-09-18T18:34:08.096524] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-18T18:34:08.519508] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-18T18:34:08.544568] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T18:34:08.575842] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-18T18:34:09.319582] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-09-18T18:34:10.119540] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-18T18:34:10.147765] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-18T18:34:10.574071] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-18T18:34:10.919590] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-18T18:34:11.719584] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-18T18:34:12.278826] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-18T18:34:12.347661] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-18T18:34:12.355396] [INFO ] [REMOTE ] DQ: Full fetch complete (62748 records). [2025-09-18T18:34:12.355693] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-18T18:34:12.524815] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-09-18T18:34:12.802686] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-09-18T18:34:12.802802] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-09-18T18:34:12.803578] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-09-18T18:34:12.803719] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-09-18T18:34:12.807036] [DEBUG] [LOCAL ] DQ: Trimmed 62748 records to 43417 (keeping 200 days of data) [2025-09-18T18:34:13.079148] [DEBUG] [LOCAL ] DQ: Primary data saved (43417 records). [2025-09-18T18:34:13.079328] [INFO ] [MAIN ] DQ: Full history saved. [2025-09-18T18:34:13.081810] [INFO ] [MAIN ] Update Progress: 647/2372 symbols completed. DQ took 35.5s. Estimated remaining: 4h 11m 3s. Rate: 6.9 symbols/min [2025-09-18T18:34:13.276884] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:34:13.321767] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-18T18:34:13.330383] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-18T18:34:13.375345] [DEBUG] [LOCAL ] DRI: Loaded 47796 existing records from primary storage. [2025-09-18T18:34:13.375531] [INFO ] [MAIN ] DRI: Loaded 47796 existing records. [2025-09-18T18:34:13.550987] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:34:13.551260] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-18T18:34:13.551333] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-18T18:34:13.552860] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-09-18T18:34:13.552937] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-18T18:34:13.902660] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:34:14.012348] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T18:34:14.119529] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-11. [2025-09-18T18:34:14.919553] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-18T18:34:15.122187] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-18T18:34:15.137331] [INFO ] [REMOTE ] DOW: Full fetch complete (77661 records). [2025-09-18T18:34:15.137484] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-18T18:34:15.546948] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-09-18T18:34:15.547166] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-09-18T18:34:15.548691] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-09-18T18:34:15.548781] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-09-18T18:34:15.551317] [DEBUG] [LOCAL ] DOW: Trimmed 77661 records to 54123 (keeping 200 days of data) [2025-09-18T18:34:15.760862] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-18T18:34:15.941497] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-18T18:34:15.970239] [DEBUG] [LOCAL ] DOW: Primary data saved (54123 records). [2025-09-18T18:34:15.970383] [INFO ] [MAIN ] DOW: Full history saved. [2025-09-18T18:34:15.970497] [INFO ] [MAIN ] Update Progress: 648/2372 symbols completed. DOW took 42.1s. Estimated remaining: 4h 10m 39s. Rate: 6.9 symbols/min [2025-09-18T18:34:16.150298] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:34:16.162547] [DEBUG] [LOCAL ] DRLL: Loaded 10062 existing records from primary storage. [2025-09-18T18:34:16.162763] [INFO ] [MAIN ] DRLL: Loaded 10062 existing records. [2025-09-18T18:34:16.361401] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:34:16.361793] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-18T18:34:16.361862] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-18T18:34:16.362725] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-09-18T18:34:16.362858] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-18T18:34:16.522121] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-09-18T18:34:16.707907] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-18T18:34:16.774289] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:34:17.222748] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-18T18:34:17.319550] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-11. [2025-09-18T18:34:18.082520] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-18T18:34:18.119512] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-09-18T18:34:18.517456] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-18T18:34:18.919629] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-09-18T18:34:19.584950] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-18T18:34:19.719590] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-18T18:34:19.814970] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-18T18:34:20.519580] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-18T18:34:21.328076] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-18T18:34:21.345798] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-18T18:34:21.915906] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T18:34:22.119582] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-18T18:34:22.919544] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-09-18T18:34:23.340353] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-18T18:34:23.415680] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-18T18:34:23.444696] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-18T18:34:23.719542] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-18T18:34:24.439616] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-18T18:34:24.519601] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-18T18:34:25.319583] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-18T18:34:26.080751] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-18T18:34:26.119497] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-18T18:34:26.440232] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-18T18:34:26.774732] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-18T18:34:26.919524] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-18T18:34:27.719565] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-18T18:34:28.324588] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-18T18:34:28.519538] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-18T18:34:29.151802] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T18:34:29.319544] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-18T18:34:29.951707] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T18:34:30.119545] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-18T18:34:30.789929] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-18T18:34:30.919607] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-18T18:34:31.260026] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T18:34:31.719607] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-18T18:34:32.519568] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-18T18:34:32.708120] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-18T18:34:32.738281] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-18T18:34:33.319560] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-18T18:34:34.119523] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-18T18:34:34.194743] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-18T18:34:34.202497] [INFO ] [REMOTE ] DRD: Full fetch complete (47740 records). [2025-09-18T18:34:34.202723] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-18T18:34:34.203574] [FATAL] [VALIDATOR ] DRD: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:34:34.203739] [FATAL] [MAIN ] DRD: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:34:34.203829] [WARN ] [MAIN ] DRD: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:34:34.203926] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-18T18:34:34.204012] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-09-18T18:34:34.204055] [INFO ] [LOCAL ] DRD: Starting deletion of derivative data. [2025-09-18T18:34:34.204434] [DEBUG] [LOCAL ] DRD: Deleted derivative data file. [2025-09-18T18:34:34.204557] [INFO ] [MAIN ] Update Progress: 649/2372 symbols completed. DRD took 34.9s. Estimated remaining: 4h 10m 55s. Rate: 6.9 symbols/min [2025-09-18T18:34:34.385307] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:34:34.425993] [DEBUG] [LOCAL ] DSL: Loaded 28148 existing records from primary storage. [2025-09-18T18:34:34.426141] [INFO ] [MAIN ] DSL: Loaded 28148 existing records. [2025-09-18T18:34:34.617593] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:34:34.625203] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-18T18:34:34.625278] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-18T18:34:34.628142] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-18T18:34:34.629382] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-09-18T18:34:34.629445] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-18T18:34:34.922615] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-18T18:34:35.011125] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:34:35.044593] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-18T18:34:35.719557] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-18T18:34:35.747086] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-18T18:34:36.519614] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-18T18:34:37.319629] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-18T18:34:37.614557] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-18T18:34:37.818164] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-18T18:34:38.105755] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T18:34:38.119499] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-18T18:34:38.919561] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-18T18:34:39.521481] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-18T18:34:39.721142] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-18T18:34:39.722971] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-18T18:34:39.725210] [INFO ] [REMOTE ] DRLL: Full fetch complete (16353 records). [2025-09-18T18:34:39.725303] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-18T18:34:40.123124] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-09-18T18:34:40.123287] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-09-18T18:34:40.123711] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-09-18T18:34:40.123774] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-09-18T18:34:40.124289] [DEBUG] [LOCAL ] DRLL: Trimmed 16353 records to 10099 (keeping 200 days of data) [2025-09-18T18:34:40.186959] [DEBUG] [LOCAL ] DRLL: Primary data saved (10099 records). [2025-09-18T18:34:40.187113] [INFO ] [MAIN ] DRLL: Full history saved. [2025-09-18T18:34:40.187286] [INFO ] [MAIN ] Update Progress: 650/2372 symbols completed. DRLL took 24.2s. Estimated remaining: 4h 10m 39s. Rate: 6.9 symbols/min [2025-09-18T18:34:40.357940] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:34:40.374983] [DEBUG] [LOCAL ] DSM: Loaded 15865 existing records from primary storage. [2025-09-18T18:34:40.375110] [INFO ] [MAIN ] DSM: Loaded 15865 existing records. [2025-09-18T18:34:40.524730] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-18T18:34:40.583591] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:34:40.587706] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-18T18:34:40.587770] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-18T18:34:40.588431] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-09-18T18:34:40.588491] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-18T18:34:40.951525] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:34:41.219043] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-18T18:34:41.319511] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-18T18:34:42.019292] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-18T18:34:42.119536] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-11. [2025-09-18T18:34:42.779294] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T18:34:42.786465] [INFO ] [REMOTE ] DRH: Full fetch complete (71711 records). [2025-09-18T18:34:42.786634] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-18T18:34:42.926772] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-18T18:34:43.185130] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-09-18T18:34:43.185450] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-09-18T18:34:43.186248] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-09-18T18:34:43.186313] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-09-18T18:34:43.187841] [DEBUG] [LOCAL ] DRH: Trimmed 71711 records to 50816 (keeping 200 days of data) [2025-09-18T18:34:43.485138] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-18T18:34:43.500804] [DEBUG] [LOCAL ] DRH: Primary data saved (50816 records). [2025-09-18T18:34:43.500915] [INFO ] [MAIN ] DRH: Full history saved. [2025-09-18T18:34:43.500992] [INFO ] [MAIN ] Update Progress: 651/2372 symbols completed. DRH took 39.1s. Estimated remaining: 4h 10m 16s. Rate: 6.9 symbols/min [2025-09-18T18:34:43.672495] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:34:43.672827] [DEBUG] [LOCAL ] DSMC: No existing data file found in primary storage. [2025-09-18T18:34:43.672887] [WARN ] [MAIN ] DSMC: No existing data found, performing full refresh instead. [2025-09-18T18:34:43.673179] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-18T18:34:43.673238] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-18T18:34:43.673287] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-09-18T18:34:43.673320] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-18T18:34:43.724712] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-11. [2025-09-18T18:34:44.044899] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:34:44.369009] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-18T18:34:44.519540] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-18T18:34:45.320639] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-11. [2025-09-18T18:34:45.327236] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-18T18:34:45.877093] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-18T18:34:45.883251] [INFO ] [REMOTE ] DRI: Full fetch complete (68932 records). [2025-09-18T18:34:45.883399] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-18T18:34:45.884312] [FATAL] [VALIDATOR ] DRI: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:34:45.884459] [FATAL] [MAIN ] DRI: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:34:45.884516] [WARN ] [MAIN ] DRI: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:34:45.884560] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-18T18:34:45.884623] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-09-18T18:34:45.884700] [INFO ] [LOCAL ] DRI: Starting deletion of derivative data. [2025-09-18T18:34:45.885189] [DEBUG] [LOCAL ] DRI: Deleted derivative data file. [2025-09-18T18:34:45.886433] [INFO ] [MAIN ] Update Progress: 652/2372 symbols completed. DRI took 32.8s. Estimated remaining: 4h 9m 51s. Rate: 6.9 symbols/min [2025-09-18T18:34:46.015043] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-18T18:34:46.070731] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:34:46.070908] [DEBUG] [LOCAL ] DSU: No existing data file found in primary storage. [2025-09-18T18:34:46.070947] [WARN ] [MAIN ] DSU: No existing data found, performing full refresh instead. [2025-09-18T18:34:46.071095] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-18T18:34:46.071140] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-18T18:34:46.071183] [DEBUG] [LOCAL ] DSU: No primary data file found to delete. [2025-09-18T18:34:46.071218] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-18T18:34:46.124779] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-09-18T18:34:46.435185] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:34:46.919556] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-09-18T18:34:47.081880] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-18T18:34:47.380296] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-18T18:34:47.719546] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-09-18T18:34:48.519547] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-09-18T18:34:48.569423] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-18T18:34:49.319515] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-11. [2025-09-18T18:34:49.501782] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-18T18:34:50.119557] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-09-18T18:34:50.592326] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T18:34:50.919517] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-09-18T18:34:51.247110] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-18T18:34:51.320187] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T18:34:51.719556] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-18T18:34:52.159934] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-18T18:34:52.519548] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-18T18:34:53.039270] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-18T18:34:53.319552] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-18T18:34:53.867122] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-18T18:34:54.119554] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-09-18T18:34:54.919533] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-18T18:34:55.137672] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-18T18:34:55.719541] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-09-18T18:34:55.939823] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-18T18:34:56.519540] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-18T18:34:56.834809] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-18T18:34:56.926193] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-18T18:34:57.319552] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-18T18:34:58.119577] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-18T18:34:58.368598] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-18T18:34:58.919562] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-18T18:34:59.277944] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-18T18:34:59.643614] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-18T18:34:59.719620] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-18T18:35:00.519605] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-18T18:35:00.971629] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-18T18:35:01.319558] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-18T18:35:01.693286] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-18T18:35:01.720759] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-18T18:35:02.119585] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-18T18:35:02.919571] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-18T18:35:03.111173] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-18T18:35:03.719568] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-18T18:35:04.282930] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-18T18:35:04.302052] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-18T18:35:04.519550] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-18T18:35:05.319572] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-18T18:35:05.694060] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-18T18:35:06.119593] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-18T18:35:06.580192] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-18T18:35:06.919580] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-18T18:35:07.374355] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-18T18:35:07.719517] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-18T18:35:08.175072] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-18T18:35:08.427473] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-18T18:35:08.519512] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-18T18:35:09.319552] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-18T18:35:09.379349] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-18T18:35:10.119548] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-18T18:35:10.422996] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-18T18:35:10.457625] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-18T18:35:10.919515] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-18T18:35:11.719584] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-18T18:35:12.239803] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T18:35:12.519591] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-18T18:35:12.871169] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-18T18:35:13.319579] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-18T18:35:13.385281] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-18T18:35:14.119565] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-18T18:35:14.195081] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-18T18:35:14.919569] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-18T18:35:15.102189] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-18T18:35:15.719512] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-18T18:35:15.923705] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-18T18:35:15.926186] [INFO ] [REMOTE ] DSM: Full fetch complete (24646 records). [2025-09-18T18:35:15.926291] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-18T18:35:15.927064] [FATAL] [VALIDATOR ] DSM: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:35:15.927150] [FATAL] [MAIN ] DSM: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:35:15.927219] [WARN ] [MAIN ] DSM: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:35:15.927313] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-18T18:35:15.927406] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-09-18T18:35:15.927451] [INFO ] [LOCAL ] DSM: Starting deletion of derivative data. [2025-09-18T18:35:15.927834] [DEBUG] [LOCAL ] DSM: Deleted derivative data file. [2025-09-18T18:35:15.927932] [INFO ] [MAIN ] Update Progress: 653/2372 symbols completed. DSM took 35.7s. Estimated remaining: 4h 10m 38s. Rate: 6.9 symbols/min [2025-09-18T18:35:16.102525] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:35:16.127749] [DEBUG] [LOCAL ] DSX: Loaded 24715 existing records from primary storage. [2025-09-18T18:35:16.127887] [INFO ] [MAIN ] DSX: Loaded 24715 existing records. [2025-09-18T18:35:16.309978] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:35:16.310301] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-18T18:35:16.310362] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-18T18:35:16.311300] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-09-18T18:35:16.311364] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-18T18:35:16.524776] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-18T18:35:16.677177] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:35:16.944219] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-18T18:35:17.287374] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-18T18:35:17.289137] [INFO ] [REMOTE ] DSMC: Full fetch complete (2839 records). [2025-09-18T18:35:17.289244] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-18T18:35:17.324763] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-11. [2025-09-18T18:35:17.685794] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-09-18T18:35:17.685901] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-09-18T18:35:17.686047] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-09-18T18:35:17.686112] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-09-18T18:35:17.686463] [DEBUG] [LOCAL ] DSMC: Trimmed 2839 records to 2010 (keeping 200 days of data) [2025-09-18T18:35:17.698948] [DEBUG] [LOCAL ] DSMC: Primary data saved (2010 records). [2025-09-18T18:35:17.699010] [INFO ] [MAIN ] DSMC: Full history saved. [2025-09-18T18:35:17.699070] [INFO ] [MAIN ] Update Progress: 654/2372 symbols completed. DSMC took 34.2s. Estimated remaining: 4h 10m 11s. Rate: 6.9 symbols/min [2025-09-18T18:35:17.869492] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:35:17.921172] [DEBUG] [LOCAL ] DT: Loaded 52956 existing records from primary storage. [2025-09-18T18:35:17.921325] [INFO ] [MAIN ] DT: Loaded 52956 existing records. [2025-09-18T18:35:18.103606] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:35:18.103916] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-18T18:35:18.103967] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-18T18:35:18.105431] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-18T18:35:18.105495] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-18T18:35:18.126248] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-18T18:35:18.485371] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:35:18.919560] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-18T18:35:19.032186] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-18T18:35:19.391330] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-18T18:35:19.395303] [INFO ] [REMOTE ] DSU: Full fetch complete (31984 records). [2025-09-18T18:35:19.395387] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-18T18:35:19.724977] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-09-18T18:35:19.775026] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-09-18T18:35:19.775110] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-09-18T18:35:19.775599] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-09-18T18:35:19.775668] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-09-18T18:35:19.776424] [DEBUG] [LOCAL ] DSU: Trimmed 31984 records to 21836 (keeping 200 days of data) [2025-09-18T18:35:19.893446] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-18T18:35:19.900025] [INFO ] [REMOTE ] DSL: Full fetch complete (40980 records). [2025-09-18T18:35:19.900676] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-18T18:35:19.902327] [FATAL] [VALIDATOR ] DSL: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:35:19.902990] [FATAL] [MAIN ] DSL: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:35:19.903299] [WARN ] [MAIN ] DSL: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:35:19.903714] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-18T18:35:19.904037] [DEBUG] [LOCAL ] DSL: No primary data file found to delete. [2025-09-18T18:35:19.904398] [INFO ] [LOCAL ] DSL: Starting deletion of derivative data. [2025-09-18T18:35:19.905508] [DEBUG] [LOCAL ] DSL: Deleted derivative data file. [2025-09-18T18:35:19.906454] [INFO ] [MAIN ] Update Progress: 655/2372 symbols completed. DSL took 45.7s. Estimated remaining: 4h 9m 45s. Rate: 6.9 symbols/min [2025-09-18T18:35:20.109442] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:35:20.133764] [DEBUG] [LOCAL ] DSU: Primary data saved (21836 records). [2025-09-18T18:35:20.137106] [DEBUG] [LOCAL ] DTB: Loaded 4684 existing records from primary storage. [2025-09-18T18:35:20.137325] [INFO ] [MAIN ] DSU: Full history saved. [2025-09-18T18:35:20.137542] [INFO ] [MAIN ] Update Progress: 656/2372 symbols completed. DSU took 34.3s. Estimated remaining: 4h 9m 14s. Rate: 6.9 symbols/min [2025-09-18T18:35:20.137436] [INFO ] [MAIN ] DTB: Loaded 4684 existing records. [2025-09-18T18:35:20.506988] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:35:20.523482] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-11. [2025-09-18T18:35:20.528405] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-18T18:35:20.528199] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:35:20.529242] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-18T18:35:20.530711] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-09-18T18:35:20.530780] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-18T18:35:20.880442] [DEBUG] [LOCAL ] DTE: Loaded 47994 existing records from primary storage. [2025-09-18T18:35:20.903936] [INFO ] [MAIN ] DTE: Loaded 47994 existing records. [2025-09-18T18:35:21.016797] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:35:21.141824] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:35:21.142120] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-18T18:35:21.142190] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-18T18:35:21.143853] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-09-18T18:35:21.143917] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-18T18:35:21.326858] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-11. [2025-09-18T18:35:21.518077] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-18T18:35:21.588572] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:35:22.119563] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-09-18T18:35:22.230165] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-18T18:35:22.299802] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-18T18:35:22.919557] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-09-18T18:35:23.094796] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-18T18:35:23.587102] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-18T18:35:23.719546] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-09-18T18:35:24.117940] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-18T18:35:24.519601] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-18T18:35:25.319595] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-11. [2025-09-18T18:35:25.471911] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-18T18:35:26.119573] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-09-18T18:35:26.919702] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-18T18:35:27.595464] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-11 (2.28 seconds). [2025-09-18T18:35:27.719498] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-09-18T18:35:27.810762] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-18T18:35:27.900261] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-18T18:35:28.519619] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-09-18T18:35:29.059244] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T18:35:29.319587] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-18T18:35:29.636834] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-18T18:35:29.862880] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-18T18:35:30.119557] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-09-18T18:35:30.919549] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-18T18:35:31.719711] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-18T18:35:31.848784] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-18T18:35:32.317633] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T18:35:32.519557] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-18T18:35:32.833405] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-18T18:35:33.319611] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-18T18:35:34.119630] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-18T18:35:34.193360] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-18T18:35:34.224914] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-18T18:35:34.587666] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-18T18:35:34.919561] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-18T18:35:35.719535] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-18T18:35:36.519547] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-18T18:35:36.741288] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-18T18:35:37.116074] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-18T18:35:37.301110] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-18T18:35:37.319485] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-18T18:35:38.119542] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-18T18:35:38.468171] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-18T18:35:38.919561] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-18T18:35:39.719546] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-18T18:35:40.028258] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-18T18:35:40.077613] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-18T18:35:40.519563] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-18T18:35:41.057938] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-18T18:35:41.305593] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-18T18:35:41.319499] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-18T18:35:42.119548] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-18T18:35:42.678765] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-18T18:35:42.919545] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-18T18:35:43.011901] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-18T18:35:43.719562] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-18T18:35:44.496579] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T18:35:44.519515] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-18T18:35:45.319551] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-18T18:35:45.490632] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-18T18:35:45.692851] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-18T18:35:45.889975] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-18T18:35:46.119542] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-18T18:35:46.919583] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-18T18:35:47.543332] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-18T18:35:47.719588] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-18T18:35:47.892685] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-18T18:35:48.519624] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-18T18:35:49.149543] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T18:35:49.319521] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-18T18:35:49.996108] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-18T18:35:50.119545] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-18T18:35:50.548495] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-18T18:35:50.888867] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-18T18:35:50.892883] [INFO ] [REMOTE ] DSX: Full fetch complete (37640 records). [2025-09-18T18:35:50.892971] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-18T18:35:50.925138] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-18T18:35:51.296592] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-09-18T18:35:51.296722] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-09-18T18:35:51.297265] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-09-18T18:35:51.297330] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-09-18T18:35:51.298222] [DEBUG] [LOCAL ] DSX: Trimmed 37640 records to 24874 (keeping 200 days of data) [2025-09-18T18:35:51.347082] [DEBUG] [REMOTE ] DTB: Error fetching primary data for 2025-09: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [2025-09-18T18:35:51.356030] [WARN ] [REMOTE ] DTB: No data returned for month 2025-09 [2025-09-18T18:35:51.382256] [INFO ] [REMOTE ] DTB: Full fetch complete (6123 records). [2025-09-18T18:35:51.386706] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-18T18:35:51.388772] [FATAL] [VALIDATOR ] DTB: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:35:51.390949] [FATAL] [MAIN ] DTB: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:35:51.391773] [WARN ] [MAIN ] DTB: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:35:51.391857] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-18T18:35:51.392766] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-09-18T18:35:51.393313] [INFO ] [LOCAL ] DTB: Starting deletion of derivative data. [2025-09-18T18:35:51.397845] [DEBUG] [LOCAL ] DTB: Deleted derivative data file. [2025-09-18T18:35:51.398797] [INFO ] [MAIN ] Update Progress: 657/2372 symbols completed. DTB took 31.5s. Estimated remaining: 4h 10m 4s. Rate: 6.9 symbols/min [2025-09-18T18:35:51.589561] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:35:51.591158] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-18T18:35:51.592494] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-18T18:35:51.600295] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-18T18:35:51.600411] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-18T18:35:51.601415] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-18T18:35:51.601804] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-18T18:35:51.728761] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-18T18:35:51.902243] [DEBUG] [LOCAL ] DSX: Primary data saved (24874 records). [2025-09-18T18:35:51.913833] [INFO ] [MAIN ] DSX: Full history saved. [2025-09-18T18:35:51.925985] [INFO ] [MAIN ] Update Progress: 658/2372 symbols completed. DSX took 36.0s. Estimated remaining: 4h 9m 34s. Rate: 6.9 symbols/min [2025-09-18T18:35:52.132566] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:35:52.227084] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:35:52.238341] [DEBUG] [LOCAL ] DTG: Loaded 5889 existing records from primary storage. [2025-09-18T18:35:52.238508] [INFO ] [MAIN ] DTG: Loaded 5889 existing records. [2025-09-18T18:35:52.440685] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:35:52.440992] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-18T18:35:52.441048] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-18T18:35:52.441428] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-09-18T18:35:52.441486] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-18T18:35:52.524727] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-18T18:35:52.808915] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:35:53.319545] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-11. [2025-09-18T18:35:53.454202] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-18T18:35:53.920695] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-18T18:35:54.119690] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-18T18:35:54.119761] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-11. [2025-09-18T18:35:54.128557] [INFO ] [REMOTE ] DT: Full fetch complete (76475 records). [2025-09-18T18:35:54.128697] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-18T18:35:54.572837] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-09-18T18:35:54.572945] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-09-18T18:35:54.573839] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-09-18T18:35:54.573907] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-09-18T18:35:54.575595] [DEBUG] [LOCAL ] DT: Trimmed 76475 records to 53342 (keeping 200 days of data) [2025-09-18T18:35:54.892025] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-18T18:35:54.910834] [DEBUG] [LOCAL ] DT: Primary data saved (53342 records). [2025-09-18T18:35:54.910959] [INFO ] [MAIN ] DT: Full history saved. [2025-09-18T18:35:54.911043] [INFO ] [MAIN ] Update Progress: 659/2372 symbols completed. DT took 37.2s. Estimated remaining: 4h 9m 10s. Rate: 6.9 symbols/min [2025-09-18T18:35:54.924680] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-18T18:35:55.116306] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:35:55.116496] [DEBUG] [LOCAL ] DTM: No existing data file found in primary storage. [2025-09-18T18:35:55.116553] [WARN ] [MAIN ] DTM: No existing data found, performing full refresh instead. [2025-09-18T18:35:55.116805] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-18T18:35:55.116859] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-18T18:35:55.116904] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-09-18T18:35:55.116939] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-18T18:35:55.540396] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:35:55.719557] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-09-18T18:35:56.519595] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-11. [2025-09-18T18:35:56.547946] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-18T18:35:56.554931] [INFO ] [REMOTE ] DTE: Full fetch complete (69158 records). [2025-09-18T18:35:56.555090] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-18T18:35:56.706856] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-18T18:35:57.012138] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-09-18T18:35:57.012254] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-09-18T18:35:57.013342] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-09-18T18:35:57.013415] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-09-18T18:35:57.015037] [DEBUG] [LOCAL ] DTE: Trimmed 69158 records to 48330 (keeping 200 days of data) [2025-09-18T18:35:57.321177] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-09-18T18:35:57.337288] [DEBUG] [LOCAL ] DTE: Primary data saved (48330 records). [2025-09-18T18:35:57.337483] [INFO ] [MAIN ] DTE: Full history saved. [2025-09-18T18:35:57.337669] [INFO ] [MAIN ] Update Progress: 660/2372 symbols completed. DTE took 37.2s. Estimated remaining: 4h 8m 45s. Rate: 6.9 symbols/min [2025-09-18T18:35:57.516295] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:35:57.516472] [DEBUG] [LOCAL ] DTW: No existing data file found in primary storage. [2025-09-18T18:35:57.516510] [WARN ] [MAIN ] DTW: No existing data found, performing full refresh instead. [2025-09-18T18:35:57.516696] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-18T18:35:57.516751] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-18T18:35:57.516795] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-09-18T18:35:57.516828] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-18T18:35:57.803177] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-18T18:35:57.883164] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:35:58.119563] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-09-18T18:35:58.286252] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-18T18:35:58.420567] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-18T18:35:58.919568] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-18T18:35:59.322700] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-18T18:35:59.719562] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-11. [2025-09-18T18:36:00.519561] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-09-18T18:36:00.692367] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-18T18:36:01.110675] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-18T18:36:01.319572] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-09-18T18:36:02.119558] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-09-18T18:36:02.919561] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-18T18:36:03.719569] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-18T18:36:05.063058] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (3.74 seconds). [2025-09-18T18:36:05.073225] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-09-18T18:36:07.323493] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (4.40 seconds). [2025-09-18T18:36:07.324797] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-18T18:36:08.088745] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (4.37 seconds). [2025-09-18T18:36:08.090802] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-18T18:36:08.533750] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-18T18:36:08.536234] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-18T18:36:09.111059] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-18T18:36:09.113104] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-18T18:36:09.337681] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (7.22 seconds). [2025-09-18T18:36:09.340611] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-09-18T18:36:09.479365] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-18T18:36:09.480612] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-18T18:36:09.675685] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-18T18:36:10.119583] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-18T18:36:10.579104] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-18T18:36:10.645307] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-18T18:36:10.710517] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-18T18:36:10.898994] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (5.83 seconds). [2025-09-18T18:36:10.919507] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-18T18:36:11.719564] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-18T18:36:12.242104] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-18T18:36:12.519614] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-18T18:36:12.761384] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-18T18:36:12.808698] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-18T18:36:13.319544] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-18T18:36:13.803573] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-18T18:36:14.119558] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-18T18:36:14.536019] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-18T18:36:14.919567] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-18T18:36:15.600308] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-18T18:36:15.601714] [INFO ] [REMOTE ] DTG: Full fetch complete (9026 records). [2025-09-18T18:36:15.601803] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-18T18:36:15.724713] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-18T18:36:15.978010] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-09-18T18:36:15.978088] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-09-18T18:36:15.978304] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-09-18T18:36:15.978342] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-09-18T18:36:15.978811] [DEBUG] [LOCAL ] DTG: Trimmed 9026 records to 5943 (keeping 200 days of data) [2025-09-18T18:36:16.016830] [DEBUG] [LOCAL ] DTG: Primary data saved (5943 records). [2025-09-18T18:36:16.016968] [INFO ] [MAIN ] DTG: Full history saved. [2025-09-18T18:36:16.017057] [INFO ] [MAIN ] Update Progress: 661/2372 symbols completed. DTG took 24.1s. Estimated remaining: 4h 9m 2s. Rate: 6.9 symbols/min [2025-09-18T18:36:16.189042] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:36:16.256323] [DEBUG] [LOCAL ] DUK: Loaded 53477 existing records from primary storage. [2025-09-18T18:36:16.255226] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-18T18:36:16.256527] [INFO ] [MAIN ] DUK: Loaded 53477 existing records. [2025-09-18T18:36:16.443803] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:36:16.444105] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-18T18:36:16.444173] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-18T18:36:16.445772] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-09-18T18:36:16.445842] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-18T18:36:16.524705] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-18T18:36:16.822759] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:36:17.319560] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-18T18:36:17.836910] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-18T18:36:18.119557] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-11. [2025-09-18T18:36:18.623013] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T18:36:18.919598] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-18T18:36:19.570154] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-18T18:36:19.719550] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-18T18:36:20.175313] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-18T18:36:20.503333] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-11 (2.38 seconds). [2025-09-18T18:36:20.519499] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-18T18:36:21.097665] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-18T18:36:21.319542] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-09-18T18:36:22.119550] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-18T18:36:22.828628] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-18T18:36:22.919519] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-18T18:36:23.161008] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-18T18:36:23.385051] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-18T18:36:23.719579] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-09-18T18:36:24.519550] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-18T18:36:25.139568] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T18:36:25.140920] [INFO ] [REMOTE ] DTW: Full fetch complete (7894 records). [2025-09-18T18:36:25.140990] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-18T18:36:25.325434] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-18T18:36:25.514231] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-09-18T18:36:25.514352] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-09-18T18:36:25.514679] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-09-18T18:36:25.514846] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-09-18T18:36:25.515544] [DEBUG] [LOCAL ] DTW: Trimmed 7894 records to 4957 (keeping 200 days of data) [2025-09-18T18:36:25.547639] [DEBUG] [LOCAL ] DTW: Primary data saved (4957 records). [2025-09-18T18:36:25.547784] [INFO ] [MAIN ] DTW: Full history saved. [2025-09-18T18:36:25.547859] [INFO ] [MAIN ] Update Progress: 662/2372 symbols completed. DTW took 28.2s. Estimated remaining: 4h 8m 56s. Rate: 6.9 symbols/min [2025-09-18T18:36:25.725445] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:36:25.757165] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-18T18:36:25.760258] [DEBUG] [LOCAL ] DUKB: Loaded 6452 existing records from primary storage. [2025-09-18T18:36:25.770523] [INFO ] [MAIN ] DUKB: Loaded 6452 existing records. [2025-09-18T18:36:25.956907] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:36:25.957341] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-18T18:36:25.957398] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-18T18:36:25.957773] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-18T18:36:25.957833] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-18T18:36:26.061630] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T18:36:26.068157] [INFO ] [REMOTE ] DTF: Full fetch complete (2200 records). [2025-09-18T18:36:26.088888] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-18T18:36:26.128555] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-18T18:36:26.508526] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-18T18:36:26.522140] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:36:26.518710] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:36:26.522471] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:36:26.522545] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-18T18:36:26.522621] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-18T18:36:26.522710] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-18T18:36:26.522783] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-18T18:36:26.522879] [INFO ] [MAIN ] Update Progress: 663/2372 symbols completed. DTF took 35.1s. Estimated remaining: 4h 8m 27s. Rate: 6.9 symbols/min [2025-09-18T18:36:26.701042] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:36:26.763474] [DEBUG] [LOCAL ] DV: Loaded 51293 existing records from primary storage. [2025-09-18T18:36:26.763623] [INFO ] [MAIN ] DV: Loaded 51293 existing records. [2025-09-18T18:36:26.924098] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-11. [2025-09-18T18:36:26.945377] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:36:26.946333] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-18T18:36:26.946392] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-18T18:36:26.950366] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-18T18:36:26.950432] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-18T18:36:27.312586] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:36:27.719545] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-11. [2025-09-18T18:36:27.914061] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-18T18:36:27.943618] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-18T18:36:28.519547] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-18T18:36:29.319551] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-09-18T18:36:29.534054] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-18T18:36:29.981419] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-18T18:36:30.106591] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T18:36:30.119494] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-18T18:36:30.919570] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-09-18T18:36:31.634432] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-18T18:36:31.719533] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-09-18T18:36:32.196187] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-18T18:36:32.519546] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-18T18:36:33.257829] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-18T18:36:33.319518] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-18T18:36:33.792363] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-18T18:36:33.981288] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-18T18:36:34.119573] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-18T18:36:34.576321] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-18T18:36:34.919545] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-18T18:36:35.719543] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-18T18:36:36.465915] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-18T18:36:36.519609] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-09-18T18:36:36.745350] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-18T18:36:37.319545] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-18T18:36:37.870477] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-18T18:36:38.119555] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-18T18:36:38.919563] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-18T18:36:39.118214] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-18T18:36:39.469741] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-18T18:36:39.500706] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T18:36:39.719595] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-18T18:36:40.519549] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-18T18:36:41.319572] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-18T18:36:41.436575] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-18T18:36:41.462790] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-18T18:36:42.119547] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-18T18:36:42.511766] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-18T18:36:42.727858] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-18T18:36:42.919548] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-18T18:36:43.524616] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-18T18:36:43.719561] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-18T18:36:44.519584] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-18T18:36:45.319545] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-18T18:36:45.489941] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-18T18:36:46.119552] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-18T18:36:46.253327] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-18T18:36:46.722400] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T18:36:46.919591] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-18T18:36:47.390861] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-18T18:36:47.719594] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-18T18:36:48.468716] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-18T18:36:48.519566] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-18T18:36:49.319684] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-18T18:36:49.374282] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-18T18:36:49.382910] [INFO ] [REMOTE ] DTM: Full fetch complete (64746 records). [2025-09-18T18:36:49.383124] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-18T18:36:49.772745] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-09-18T18:36:49.772834] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-09-18T18:36:49.773520] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-09-18T18:36:49.773580] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-09-18T18:36:49.774926] [DEBUG] [LOCAL ] DTM: Trimmed 64746 records to 44984 (keeping 200 days of data) [2025-09-18T18:36:50.058754] [DEBUG] [LOCAL ] DTM: Primary data saved (44984 records). [2025-09-18T18:36:50.058896] [INFO ] [MAIN ] DTM: Full history saved. [2025-09-18T18:36:50.058991] [INFO ] [MAIN ] Update Progress: 664/2372 symbols completed. DTM took 55.1s. Estimated remaining: 4h 8m 56s. Rate: 6.9 symbols/min [2025-09-18T18:36:50.127723] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-18T18:36:50.243040] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:36:50.277329] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-18T18:36:50.330057] [DEBUG] [LOCAL ] DVA: Loaded 41749 existing records from primary storage. [2025-09-18T18:36:50.330212] [INFO ] [MAIN ] DVA: Loaded 41749 existing records. [2025-09-18T18:36:50.507315] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:36:50.507580] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-18T18:36:50.507630] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-18T18:36:50.508868] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-09-18T18:36:50.508929] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-18T18:36:50.866713] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:36:50.919363] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-18T18:36:50.919550] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-18T18:36:51.050921] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-18T18:36:51.053265] [INFO ] [REMOTE ] DUKB: Full fetch complete (9636 records). [2025-09-18T18:36:51.053372] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-18T18:36:51.423960] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-18T18:36:51.424041] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-18T18:36:51.424302] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-18T18:36:51.424340] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-18T18:36:51.425209] [DEBUG] [LOCAL ] DUKB: Trimmed 9636 records to 6483 (keeping 200 days of data) [2025-09-18T18:36:51.467568] [DEBUG] [LOCAL ] DUKB: Primary data saved (6483 records). [2025-09-18T18:36:51.467742] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-18T18:36:51.467939] [INFO ] [MAIN ] Update Progress: 665/2372 symbols completed. DUKB took 25.9s. Estimated remaining: 4h 8m 29s. Rate: 6.9 symbols/min [2025-09-18T18:36:51.638986] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:36:51.705937] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-09-18T18:36:51.706089] [INFO ] [MAIN ] DVN: Loaded 53699 existing records. [2025-09-18T18:36:51.726593] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-11. [2025-09-18T18:36:51.907722] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:36:51.907976] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-18T18:36:51.908027] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-18T18:36:51.909804] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-09-18T18:36:51.909868] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-18T18:36:52.277739] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:36:52.519571] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-18T18:36:53.051093] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-18T18:36:53.319565] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-18T18:36:53.522186] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-18T18:36:53.958033] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-18T18:36:54.119548] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-18T18:36:54.919550] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-09-18T18:36:55.136016] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-18T18:36:55.414896] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T18:36:55.719565] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-18T18:36:56.264984] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-18T18:36:56.519577] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-09-18T18:36:57.157634] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-18T18:36:57.170357] [INFO ] [REMOTE ] DV: Full fetch complete (72989 records). [2025-09-18T18:36:57.170624] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-18T18:36:57.328725] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-18T18:36:57.581485] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-09-18T18:36:57.581588] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-09-18T18:36:57.582393] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-09-18T18:36:57.582484] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-09-18T18:36:57.584365] [DEBUG] [LOCAL ] DV: Trimmed 72989 records to 51678 (keeping 200 days of data) [2025-09-18T18:36:57.917158] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-18T18:36:57.946449] [DEBUG] [LOCAL ] DV: Primary data saved (51678 records). [2025-09-18T18:36:57.946614] [INFO ] [MAIN ] DV: Full history saved. [2025-09-18T18:36:57.946800] [INFO ] [MAIN ] Update Progress: 666/2372 symbols completed. DV took 31.4s. Estimated remaining: 4h 8m 14s. Rate: 6.9 symbols/min [2025-09-18T18:36:58.125228] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:36:58.125352] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-18T18:36:58.125869] [DEBUG] [LOCAL ] DX: No existing data file found in primary storage. [2025-09-18T18:36:58.126196] [WARN ] [MAIN ] DX: No existing data found, performing full refresh instead. [2025-09-18T18:36:58.129923] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-18T18:36:58.129985] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-18T18:36:58.130030] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-09-18T18:36:58.130075] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-18T18:36:58.505421] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:36:58.919546] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-11. [2025-09-18T18:36:59.221615] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-18T18:36:59.234828] [INFO ] [REMOTE ] DUK: Full fetch complete (77260 records). [2025-09-18T18:36:59.235010] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-18T18:36:59.645167] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-09-18T18:36:59.645411] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-09-18T18:36:59.646441] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-09-18T18:36:59.646537] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-09-18T18:36:59.651985] [DEBUG] [LOCAL ] DUK: Trimmed 77260 records to 53863 (keeping 200 days of data) [2025-09-18T18:36:59.741713] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-11. [2025-09-18T18:36:59.788379] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-18T18:37:00.049269] [DEBUG] [LOCAL ] DUK: Primary data saved (53863 records). [2025-09-18T18:37:00.049409] [INFO ] [MAIN ] DUK: Full history saved. [2025-09-18T18:37:00.049558] [INFO ] [MAIN ] Update Progress: 667/2372 symbols completed. DUK took 44.0s. Estimated remaining: 4h 7m 49s. Rate: 6.9 symbols/min [2025-09-18T18:37:00.217281] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:37:00.266794] [DEBUG] [LOCAL ] DXC: Loaded 49456 existing records from primary storage. [2025-09-18T18:37:00.266965] [INFO ] [MAIN ] DXC: Loaded 49456 existing records. [2025-09-18T18:37:00.442168] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:37:00.442412] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-18T18:37:00.442471] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-18T18:37:00.443540] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-18T18:37:00.443610] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-18T18:37:00.533395] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-18T18:37:00.862684] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:37:01.177295] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-11 (2.26 seconds). [2025-09-18T18:37:01.319558] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-09-18T18:37:01.408800] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-18T18:37:01.770106] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T18:37:02.119584] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-09-18T18:37:02.919554] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-18T18:37:03.493514] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-18T18:37:03.719535] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-09-18T18:37:03.916958] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-18T18:37:04.201128] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-18T18:37:04.519571] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-18T18:37:05.319599] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-11. [2025-09-18T18:37:05.611193] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-18T18:37:05.795745] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-18T18:37:06.119571] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-18T18:37:06.919515] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-09-18T18:37:06.955599] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-18T18:37:07.463400] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T18:37:07.719629] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-18T18:37:08.349534] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T18:37:08.519549] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-18T18:37:09.319598] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-18T18:37:09.865156] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-18T18:37:10.121467] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-18T18:37:10.124189] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-18T18:37:10.604738] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-18T18:37:10.919559] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-18T18:37:11.719609] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-09-18T18:37:11.917397] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-18T18:37:12.519581] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-18T18:37:12.973870] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-18T18:37:13.042819] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-18T18:37:13.319559] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-09-18T18:37:14.119572] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-18T18:37:14.270142] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-18T18:37:14.511769] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-18T18:37:14.919629] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-18T18:37:15.533922] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-18T18:37:15.719568] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-18T18:37:16.519558] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-18T18:37:16.863486] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-18T18:37:17.304984] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-18T18:37:17.313599] [INFO ] [REMOTE ] DVA: Full fetch complete (59594 records). [2025-09-18T18:37:17.313780] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-18T18:37:17.325793] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-18T18:37:17.713194] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-09-18T18:37:17.713326] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-09-18T18:37:17.714029] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-09-18T18:37:17.714092] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-09-18T18:37:17.715293] [DEBUG] [LOCAL ] DVA: Trimmed 59594 records to 42021 (keeping 200 days of data) [2025-09-18T18:37:18.002549] [DEBUG] [LOCAL ] DVA: Primary data saved (42021 records). [2025-09-18T18:37:18.002722] [INFO ] [MAIN ] DVA: Full history saved. [2025-09-18T18:37:18.002834] [INFO ] [MAIN ] Update Progress: 668/2372 symbols completed. DVA took 27.9s. Estimated remaining: 4h 8m 3s. Rate: 6.9 symbols/min [2025-09-18T18:37:18.124625] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-18T18:37:18.191143] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:37:18.191513] [DEBUG] [LOCAL ] DXYZ: No existing data file found in primary storage. [2025-09-18T18:37:18.191752] [WARN ] [MAIN ] DXYZ: No existing data found, performing full refresh instead. [2025-09-18T18:37:18.192071] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-18T18:37:18.192164] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-18T18:37:18.192389] [DEBUG] [LOCAL ] DXYZ: No primary data file found to delete. [2025-09-18T18:37:18.192477] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-18T18:37:18.561126] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:37:18.592888] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-18T18:37:18.919568] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-18T18:37:19.235513] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-18T18:37:19.435972] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-18T18:37:19.719563] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-18T18:37:20.519515] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-11. [2025-09-18T18:37:21.008380] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-18T18:37:21.261178] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T18:37:21.319515] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-18T18:37:22.119559] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-18T18:37:22.919610] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-18T18:37:23.101873] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-11 (2.58 seconds). [2025-09-18T18:37:23.311301] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-18T18:37:23.383470] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-18T18:37:23.719562] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-18T18:37:24.519539] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-09-18T18:37:24.944229] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-18T18:37:25.319532] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-18T18:37:25.408156] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-18T18:37:26.119586] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-18T18:37:26.919630] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-18T18:37:27.010634] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-18T18:37:27.101989] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-18T18:37:27.703178] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T18:37:27.719497] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-18T18:37:28.519507] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-09-18T18:37:28.783526] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-18T18:37:28.793671] [INFO ] [REMOTE ] DX: Full fetch complete (75081 records). [2025-09-18T18:37:28.793803] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-18T18:37:29.193762] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-09-18T18:37:29.193950] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-09-18T18:37:29.194841] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-09-18T18:37:29.194907] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-09-18T18:37:29.196490] [DEBUG] [LOCAL ] DX: Trimmed 75081 records to 52855 (keeping 200 days of data) [2025-09-18T18:37:29.320373] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-18T18:37:29.556833] [DEBUG] [LOCAL ] DX: Primary data saved (52855 records). [2025-09-18T18:37:29.556994] [INFO ] [MAIN ] DX: Full history saved. [2025-09-18T18:37:29.557076] [INFO ] [MAIN ] Update Progress: 669/2372 symbols completed. DX took 31.6s. Estimated remaining: 4h 8m 2s. Rate: 6.9 symbols/min [2025-09-18T18:37:29.776385] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-18T18:37:29.781035] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:37:29.827684] [DEBUG] [LOCAL ] DY: Loaded 30174 existing records from primary storage. [2025-09-18T18:37:29.827875] [INFO ] [MAIN ] DY: Loaded 30174 existing records. [2025-09-18T18:37:30.011863] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:37:30.012182] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-18T18:37:30.012231] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-18T18:37:30.013170] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-09-18T18:37:30.013230] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-18T18:37:30.124763] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-18T18:37:30.391882] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:37:30.711294] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-18T18:37:30.919536] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-18T18:37:31.086481] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-18T18:37:31.095990] [INFO ] [REMOTE ] DVN: Full fetch complete (77674 records). [2025-09-18T18:37:31.096175] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-18T18:37:31.532070] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-09-18T18:37:31.532161] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-09-18T18:37:31.533072] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-09-18T18:37:31.533145] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-09-18T18:37:31.534899] [DEBUG] [LOCAL ] DVN: Trimmed 77674 records to 54089 (keeping 200 days of data) [2025-09-18T18:37:31.750701] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-11. [2025-09-18T18:37:31.815498] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-18T18:37:31.950452] [DEBUG] [LOCAL ] DVN: Primary data saved (54089 records). [2025-09-18T18:37:31.950627] [INFO ] [MAIN ] DVN: Full history saved. [2025-09-18T18:37:31.952588] [INFO ] [MAIN ] Update Progress: 670/2372 symbols completed. DVN took 40.5s. Estimated remaining: 4h 7m 37s. Rate: 6.9 symbols/min [2025-09-18T18:37:32.120363] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:37:32.154863] [DEBUG] [LOCAL ] E: Loaded 33690 existing records from primary storage. [2025-09-18T18:37:32.155005] [INFO ] [MAIN ] E: Loaded 33690 existing records. [2025-09-18T18:37:32.330204] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:37:32.330461] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-18T18:37:32.330509] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-18T18:37:32.331505] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-09-18T18:37:32.331569] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-18T18:37:32.540291] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-18T18:37:32.696848] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:37:32.762693] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-18T18:37:33.319563] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-18T18:37:33.545871] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-18T18:37:34.119543] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-09-18T18:37:34.428397] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-18T18:37:34.919554] [INFO ] [REMOTE ] E: Fetching primary data for 2024-11. [2025-09-18T18:37:35.038802] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-18T18:37:35.144633] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-18T18:37:35.719580] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-18T18:37:36.306963] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T18:37:36.519601] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-09-18T18:37:37.319550] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-09-18T18:37:37.466310] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-18T18:37:37.661215] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-18T18:37:38.119552] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-18T18:37:38.625463] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T18:37:38.919556] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-09-18T18:37:39.719550] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-18T18:37:39.802155] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-18T18:37:39.867184] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T18:37:40.519548] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-18T18:37:41.319557] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-18T18:37:41.356422] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-18T18:37:41.433160] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-18T18:37:42.119568] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-18T18:37:42.901258] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-18T18:37:42.908462] [INFO ] [REMOTE ] DXC: Full fetch complete (68177 records). [2025-09-18T18:37:42.908618] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-18T18:37:42.924635] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-18T18:37:43.312374] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-18T18:37:43.312498] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-18T18:37:43.313581] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-18T18:37:43.313736] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-18T18:37:43.315843] [DEBUG] [LOCAL ] DXC: Trimmed 68177 records to 49827 (keeping 200 days of data) [2025-09-18T18:37:43.619548] [DEBUG] [LOCAL ] DXC: Primary data saved (49827 records). [2025-09-18T18:37:43.619733] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-18T18:37:43.619848] [INFO ] [MAIN ] Update Progress: 671/2372 symbols completed. DXC took 43.6s. Estimated remaining: 4h 7m 36s. Rate: 6.9 symbols/min [2025-09-18T18:37:43.724379] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-18T18:37:43.810759] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:37:43.854105] [DEBUG] [LOCAL ] EAF: Loaded 44299 existing records from primary storage. [2025-09-18T18:37:43.873260] [INFO ] [MAIN ] EAF: Loaded 44299 existing records. [2025-09-18T18:37:43.946955] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-18T18:37:44.064553] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:37:44.064848] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-18T18:37:44.064900] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-18T18:37:44.065886] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-09-18T18:37:44.065945] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-18T18:37:44.427399] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:37:44.519525] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-18T18:37:44.598399] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T18:37:44.894199] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-18T18:37:45.319602] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-18T18:37:46.119556] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-11. [2025-09-18T18:37:46.741070] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-18T18:37:46.912043] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T18:37:46.919602] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-18T18:37:47.626799] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-18T18:37:47.719540] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-18T18:37:48.335514] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T18:37:48.519550] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-18T18:37:48.883768] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-18T18:37:49.319562] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-18T18:37:50.012420] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T18:37:50.119509] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-18T18:37:50.919517] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-09-18T18:37:50.945368] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-18T18:37:51.327083] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-18T18:37:51.719541] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-18T18:37:52.221139] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-18T18:37:52.519554] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-18T18:37:52.913052] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-18T18:37:53.319545] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-09-18T18:37:54.119551] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-18T18:37:54.367334] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-18T18:37:54.372547] [INFO ] [REMOTE ] DXYZ: Full fetch complete (58350 records). [2025-09-18T18:37:54.372688] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-18T18:37:54.786260] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-09-18T18:37:54.786521] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-09-18T18:37:54.787264] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-09-18T18:37:54.787350] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-09-18T18:37:54.815692] [DEBUG] [LOCAL ] DXYZ: Trimmed 58350 records to 37029 (keeping 200 days of data) [2025-09-18T18:37:54.815517] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-18T18:37:54.919703] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-18T18:37:55.045257] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37029 records). [2025-09-18T18:37:55.045422] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-09-18T18:37:55.045518] [INFO ] [MAIN ] Update Progress: 672/2372 symbols completed. DXYZ took 37.0s. Estimated remaining: 4h 7m 34s. Rate: 6.9 symbols/min [2025-09-18T18:37:55.222846] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:37:55.228799] [DEBUG] [LOCAL ] EAI: Loaded 4011 existing records from primary storage. [2025-09-18T18:37:55.228902] [INFO ] [MAIN ] EAI: Loaded 4011 existing records. [2025-09-18T18:37:55.412935] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:37:55.413507] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-18T18:37:55.413585] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-18T18:37:55.417418] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-09-18T18:37:55.417529] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-18T18:37:55.724998] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-18T18:37:55.727607] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-18T18:37:55.818071] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:37:56.264745] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T18:37:56.519548] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-11. [2025-09-18T18:37:57.141368] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-18T18:37:57.197752] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-18T18:37:57.319562] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-18T18:37:58.119554] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-09-18T18:37:58.563593] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-18T18:37:58.710054] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-18T18:37:58.714585] [INFO ] [REMOTE ] E: Full fetch complete (48560 records). [2025-09-18T18:37:58.714774] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-18T18:37:58.924780] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-18T18:37:59.110218] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-09-18T18:37:59.110375] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-09-18T18:37:59.111151] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-09-18T18:37:59.111221] [DEBUG] [LOCAL ] E: Saving primary data. [2025-09-18T18:37:59.112555] [DEBUG] [LOCAL ] E: Trimmed 48560 records to 33908 (keeping 200 days of data) [2025-09-18T18:37:59.333821] [DEBUG] [LOCAL ] E: Primary data saved (33908 records). [2025-09-18T18:37:59.333961] [INFO ] [MAIN ] E: Full history saved. [2025-09-18T18:37:59.334051] [INFO ] [MAIN ] Update Progress: 673/2372 symbols completed. E took 27.4s. Estimated remaining: 4h 7m 14s. Rate: 6.9 symbols/min [2025-09-18T18:37:59.505315] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:37:59.536865] [DEBUG] [LOCAL ] EARN: Loaded 30842 existing records from primary storage. [2025-09-18T18:37:59.537006] [INFO ] [MAIN ] EARN: Loaded 30842 existing records. [2025-09-18T18:37:59.714827] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:37:59.715092] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-18T18:37:59.715163] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-18T18:37:59.715941] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-09-18T18:37:59.716004] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-18T18:37:59.727140] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-09-18T18:38:00.098595] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:38:00.519622] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-18T18:38:00.549245] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T18:38:00.839487] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-18T18:38:01.319578] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-18T18:38:01.552991] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-18T18:38:01.723389] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-18T18:38:02.119580] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-18T18:38:02.919576] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-18T18:38:03.719600] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-11. [2025-09-18T18:38:03.778606] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T18:38:03.980853] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-18T18:38:04.519631] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-18T18:38:05.315930] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-18T18:38:05.323507] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-09-18T18:38:05.573939] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-18T18:38:06.119561] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-18T18:38:06.620010] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-18T18:38:06.674353] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-18T18:38:06.919556] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-09-18T18:38:07.719555] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-18T18:38:08.388259] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-18T18:38:08.519618] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-18T18:38:09.137186] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-18T18:38:09.319573] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-18T18:38:09.797115] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-18T18:38:09.801617] [INFO ] [REMOTE ] DY: Full fetch complete (44668 records). [2025-09-18T18:38:09.801804] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-18T18:38:09.802585] [FATAL] [VALIDATOR ] DY: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:38:09.802707] [FATAL] [MAIN ] DY: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:38:09.802831] [WARN ] [MAIN ] DY: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:38:09.802912] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-18T18:38:09.802990] [DEBUG] [LOCAL ] DY: No primary data file found to delete. [2025-09-18T18:38:09.803029] [INFO ] [LOCAL ] DY: Starting deletion of derivative data. [2025-09-18T18:38:09.803542] [DEBUG] [LOCAL ] DY: Deleted derivative data file. [2025-09-18T18:38:09.803717] [INFO ] [MAIN ] Update Progress: 674/2372 symbols completed. DY took 40.2s. Estimated remaining: 4h 7m 9s. Rate: 6.9 symbols/min [2025-09-18T18:38:09.977958] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:38:10.026338] [DEBUG] [LOCAL ] EAT: Loaded 49826 existing records from primary storage. [2025-09-18T18:38:10.026491] [INFO ] [MAIN ] EAT: Loaded 49826 existing records. [2025-09-18T18:38:10.126312] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-18T18:38:10.212182] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:38:10.212446] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-18T18:38:10.212496] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-18T18:38:10.214352] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-09-18T18:38:10.214416] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-18T18:38:10.571432] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:38:10.623873] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-18T18:38:10.919576] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-18T18:38:11.719530] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-18T18:38:11.847027] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-18T18:38:12.144846] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T18:38:12.173911] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-18T18:38:12.519572] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-18T18:38:13.319552] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-18T18:38:13.848181] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-18T18:38:13.951118] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-18T18:38:14.119547] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-18T18:38:14.744056] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-18T18:38:14.919552] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-18T18:38:15.719576] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-18T18:38:16.519525] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-18T18:38:16.773032] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-18T18:38:17.089086] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-18T18:38:17.319496] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-18T18:38:17.339186] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-18T18:38:17.729094] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-18T18:38:18.119566] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-11. [2025-09-18T18:38:18.919632] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-18T18:38:19.719695] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-18T18:38:20.154570] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-11 (2.04 seconds). [2025-09-18T18:38:20.420246] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-18T18:38:20.519501] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-18T18:38:20.625358] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-18T18:38:21.319579] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-09-18T18:38:22.046566] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-18T18:38:22.050678] [INFO ] [REMOTE ] EAF: Full fetch complete (65142 records). [2025-09-18T18:38:22.050777] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-18T18:38:22.124740] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-18T18:38:22.442136] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-09-18T18:38:22.442216] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-09-18T18:38:22.442914] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-09-18T18:38:22.442976] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-09-18T18:38:22.444261] [DEBUG] [LOCAL ] EAF: Trimmed 65142 records to 44503 (keeping 200 days of data) [2025-09-18T18:38:22.714038] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T18:38:22.727165] [DEBUG] [LOCAL ] EAF: Primary data saved (44503 records). [2025-09-18T18:38:22.727242] [INFO ] [MAIN ] EAF: Full history saved. [2025-09-18T18:38:22.727312] [INFO ] [MAIN ] Update Progress: 675/2372 symbols completed. EAF took 39.1s. Estimated remaining: 4h 7m 11s. Rate: 6.9 symbols/min [2025-09-18T18:38:22.901097] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:38:22.921299] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-09-18T18:38:22.937253] [DEBUG] [LOCAL ] EB: Loaded 38136 existing records from primary storage. [2025-09-18T18:38:22.937378] [INFO ] [MAIN ] EB: Loaded 38136 existing records. [2025-09-18T18:38:23.118771] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:38:23.119023] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-18T18:38:23.119079] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-18T18:38:23.119781] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-18T18:38:23.119840] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-18T18:38:23.474435] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-18T18:38:23.503543] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:38:23.719510] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-11. [2025-09-18T18:38:24.519511] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-18T18:38:24.612491] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-18T18:38:25.319571] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-18T18:38:25.424847] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-18T18:38:25.485943] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-18T18:38:26.119553] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-18T18:38:26.919543] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-18T18:38:26.957625] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-18T18:38:27.211126] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-18T18:38:27.214813] [INFO ] [REMOTE ] EARN: Full fetch complete (46869 records). [2025-09-18T18:38:27.214901] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-18T18:38:27.603177] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-09-18T18:38:27.603264] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-09-18T18:38:27.603937] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-09-18T18:38:27.604004] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-09-18T18:38:27.605050] [DEBUG] [LOCAL ] EARN: Trimmed 46869 records to 30975 (keeping 200 days of data) [2025-09-18T18:38:27.698084] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-18T18:38:27.702241] [INFO ] [REMOTE ] EAI: Full fetch complete (6204 records). [2025-09-18T18:38:27.705737] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-18T18:38:27.724948] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-18T18:38:28.113384] [DEBUG] [LOCAL ] EARN: Primary data saved (30975 records). [2025-09-18T18:38:28.132128] [INFO ] [MAIN ] EARN: Full history saved. [2025-09-18T18:38:28.132275] [INFO ] [MAIN ] Update Progress: 676/2372 symbols completed. EARN took 28.8s. Estimated remaining: 4h 6m 54s. Rate: 6.9 symbols/min [2025-09-18T18:38:28.221088] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-09-18T18:38:28.242734] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-09-18T18:38:28.254539] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-09-18T18:38:28.271040] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-09-18T18:38:28.282329] [DEBUG] [LOCAL ] EAI: Trimmed 6204 records to 4051 (keeping 200 days of data) [2025-09-18T18:38:28.381170] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:38:28.385286] [DEBUG] [LOCAL ] EAI: Primary data saved (4051 records). [2025-09-18T18:38:28.385955] [INFO ] [MAIN ] EAI: Full history saved. [2025-09-18T18:38:28.386078] [INFO ] [MAIN ] Update Progress: 677/2372 symbols completed. EAI took 33.3s. Estimated remaining: 4h 6m 24s. Rate: 6.9 symbols/min [2025-09-18T18:38:28.405446] [DEBUG] [LOCAL ] EBF: Loaded 19679 existing records from primary storage. [2025-09-18T18:38:28.405581] [INFO ] [MAIN ] EBF: Loaded 19679 existing records. [2025-09-18T18:38:28.524805] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-09-18T18:38:28.584513] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:38:28.584792] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-18T18:38:28.584846] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-18T18:38:28.585367] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-09-18T18:38:28.585427] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-18T18:38:28.946972] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:38:29.319519] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-11. [2025-09-18T18:38:29.591332] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-18T18:38:29.952413] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-18T18:38:30.057414] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-18T18:38:30.119501] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-09-18T18:38:30.823927] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-18T18:38:30.919518] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-18T18:38:31.719573] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-09-18T18:38:32.519529] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-09-18T18:38:32.609149] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-18T18:38:32.934283] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-18T18:38:33.319565] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-18T18:38:33.674136] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T18:38:34.119549] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-18T18:38:34.899168] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-18T18:38:34.919494] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-18T18:38:35.183998] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-18T18:38:35.704140] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-18T18:38:35.719488] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-18T18:38:36.519567] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-18T18:38:36.689765] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-18T18:38:37.319602] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-18T18:38:38.081046] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-18T18:38:38.119494] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-18T18:38:38.391925] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-18T18:38:38.919547] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-18T18:38:39.719520] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-18T18:38:39.808399] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-18T18:38:40.192897] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-18T18:38:40.519543] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-18T18:38:40.916397] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-18T18:38:41.319554] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-18T18:38:42.111039] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T18:38:42.120391] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-18T18:38:42.340794] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-18T18:38:42.919529] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-18T18:38:43.045604] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T18:38:43.719543] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-18T18:38:44.380125] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T18:38:44.519561] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-18T18:38:45.319528] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-18T18:38:45.509413] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-18T18:38:45.540174] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-18T18:38:45.548444] [INFO ] [REMOTE ] EAT: Full fetch complete (71548 records). [2025-09-18T18:38:45.548571] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-18T18:38:45.957680] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-09-18T18:38:45.957794] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-09-18T18:38:45.958660] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-09-18T18:38:45.958730] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-09-18T18:38:45.960314] [DEBUG] [LOCAL ] EAT: Trimmed 71548 records to 50215 (keeping 200 days of data) [2025-09-18T18:38:46.139216] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-18T18:38:46.279746] [DEBUG] [LOCAL ] EAT: Primary data saved (50215 records). [2025-09-18T18:38:46.279891] [INFO ] [MAIN ] EAT: Full history saved. [2025-09-18T18:38:46.279979] [INFO ] [MAIN ] Update Progress: 678/2372 symbols completed. EAT took 36.5s. Estimated remaining: 4h 6m 38s. Rate: 6.9 symbols/min [2025-09-18T18:38:46.453813] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-18T18:38:46.919568] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-18T18:38:46.971111] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-18T18:38:46.973919] [INFO ] [REMOTE ] EBF: Full fetch complete (27247 records). [2025-09-18T18:38:46.974007] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-18T18:38:47.339975] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-09-18T18:38:47.340059] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-09-18T18:38:47.340474] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-09-18T18:38:47.340514] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-09-18T18:38:47.341323] [DEBUG] [LOCAL ] EBF: Trimmed 27247 records to 19811 (keeping 200 days of data) [2025-09-18T18:38:47.462006] [DEBUG] [LOCAL ] EBF: Primary data saved (19811 records). [2025-09-18T18:38:47.462193] [INFO ] [MAIN ] EBF: Full history saved. [2025-09-18T18:38:47.462302] [INFO ] [MAIN ] Update Progress: 679/2372 symbols completed. EBF took 19.3s. Estimated remaining: 4h 6m 11s. Rate: 6.9 symbols/min [2025-09-18T18:38:48.218395] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T18:38:48.226212] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-18T18:38:49.748111] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-18T18:38:49.756804] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-18T18:38:51.368725] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-18T18:38:51.381344] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-18T18:38:52.970316] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-18T18:38:52.979170] [INFO ] [REMOTE ] EB: Full fetch complete (57166 records). [2025-09-18T18:38:52.979419] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-18T18:38:53.532190] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-09-18T18:38:53.532302] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-09-18T18:38:53.533060] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-09-18T18:38:53.533128] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-09-18T18:38:53.534766] [DEBUG] [LOCAL ] EB: Trimmed 57166 records to 38499 (keeping 200 days of data) [2025-09-18T18:38:53.784539] [DEBUG] [LOCAL ] EB: Primary data saved (38499 records). [2025-09-18T18:38:53.784764] [INFO ] [MAIN ] EB: Full history saved. [2025-09-18T18:38:53.784869] [INFO ] [MAIN ] Update Progress: 680/2372 symbols completed. EB took 31.1s. Estimated remaining: 4h 5m 56s. Rate: 6.9 symbols/min [2025-09-18T18:38:54.520414] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:38:54.544548] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:38:54.547493] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:38:54.543728] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:38:54.636435] [DEBUG] [LOCAL ] ECAT: Loaded 29877 existing records from primary storage. [2025-09-18T18:38:54.636795] [INFO ] [MAIN ] ECAT: Loaded 29877 existing records. [2025-09-18T18:38:54.786105] [DEBUG] [LOCAL ] EBR: Loaded 43136 existing records from primary storage. [2025-09-18T18:38:54.786927] [DEBUG] [LOCAL ] EBS: Loaded 47008 existing records from primary storage. [2025-09-18T18:38:54.787220] [INFO ] [MAIN ] EBR: Loaded 43136 existing records. [2025-09-18T18:38:54.797597] [INFO ] [MAIN ] EBS: Loaded 47008 existing records. [2025-09-18T18:38:54.829365] [DEBUG] [LOCAL ] EC: Loaded 49474 existing records from primary storage. [2025-09-18T18:38:54.867613] [INFO ] [MAIN ] EC: Loaded 49474 existing records. [2025-09-18T18:38:55.062558] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:38:55.141979] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-18T18:38:55.164207] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-18T18:38:55.204952] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-09-18T18:38:55.247396] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-18T18:38:55.419586] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:38:55.441511] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:38:55.514098] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-18T18:38:55.525316] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-18T18:38:55.539613] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-18T18:38:55.583075] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-18T18:38:55.582898] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:38:55.572417] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-09-18T18:38:55.631078] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-18T18:38:55.648138] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-18T18:38:55.630974] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-09-18T18:38:55.666943] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-18T18:38:55.648276] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-18T18:38:55.666831] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-18T18:38:55.688732] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-18T18:38:56.580280] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:38:56.610679] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-11. [2025-09-18T18:38:56.878085] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:38:56.918294] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-11. [2025-09-18T18:38:57.034458] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:38:57.036580] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-11. [2025-09-18T18:38:57.040754] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:38:57.041914] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-11. [2025-09-18T18:38:58.049369] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-18T18:38:58.054125] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-09-18T18:38:58.394937] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-18T18:38:58.403248] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-09-18T18:38:58.780606] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-18T18:38:58.790439] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-09-18T18:38:58.855178] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-18T18:38:58.865381] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-09-18T18:38:58.886003] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-18T18:38:58.892064] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-09-18T18:39:00.095550] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-18T18:39:00.106048] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-09-18T18:39:00.142268] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-18T18:39:00.152525] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-09-18T18:39:00.170198] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-18T18:39:00.176462] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-18T18:39:00.365051] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T18:39:00.375079] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-09-18T18:39:01.496708] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-18T18:39:01.503388] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-18T18:39:02.022866] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-18T18:39:02.031796] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-18T18:39:02.170082] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-18T18:39:02.179208] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-18T18:39:02.940177] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-18T18:39:02.950091] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-18T18:39:04.279461] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-09-18T18:39:04.286356] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-18T18:39:04.845587] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (2.81 seconds). [2025-09-18T18:39:04.855441] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-18T18:39:05.375169] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (3.20 seconds). [2025-09-18T18:39:05.382561] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-18T18:39:05.454619] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-18T18:39:05.466728] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-18T18:39:06.119519] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-18T18:39:06.419500] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-18T18:39:06.613051] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T18:39:06.919558] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-18T18:39:06.984771] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-18T18:39:07.719606] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-18T18:39:08.400082] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-18T18:39:08.519531] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-18T18:39:09.202360] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-18T18:39:09.319576] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-18T18:39:09.823885] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-18T18:39:10.119556] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-18T18:39:10.451302] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-18T18:39:10.919545] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-18T18:39:11.587824] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-18T18:39:11.719575] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-18T18:39:12.124541] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-18T18:39:12.519560] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-18T18:39:12.779428] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-18T18:39:13.319541] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-18T18:39:14.119561] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-18T18:39:14.442224] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-18T18:39:14.899233] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-18T18:39:14.919492] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-18T18:39:15.719564] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-18T18:39:16.184426] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-18T18:39:16.519564] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-18T18:39:16.952910] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-18T18:39:16.957755] [INFO ] [REMOTE ] ECAT: Full fetch complete (42336 records). [2025-09-18T18:39:16.957878] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-18T18:39:17.321750] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-18T18:39:17.339485] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-09-18T18:39:17.341030] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-09-18T18:39:17.342205] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-09-18T18:39:17.342622] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-09-18T18:39:17.344543] [DEBUG] [LOCAL ] ECAT: Trimmed 42336 records to 30165 (keeping 200 days of data) [2025-09-18T18:39:17.481197] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-18T18:39:17.579894] [DEBUG] [LOCAL ] ECAT: Primary data saved (30165 records). [2025-09-18T18:39:17.580041] [INFO ] [MAIN ] ECAT: Full history saved. [2025-09-18T18:39:17.580156] [INFO ] [MAIN ] Update Progress: 681/2372 symbols completed. ECAT took 23.8s. Estimated remaining: 4h 6m 25s. Rate: 6.9 symbols/min [2025-09-18T18:39:17.763787] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:39:17.808092] [DEBUG] [LOCAL ] ECC: Loaded 43441 existing records from primary storage. [2025-09-18T18:39:17.808251] [INFO ] [MAIN ] ECC: Loaded 43441 existing records. [2025-09-18T18:39:17.986000] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-18T18:39:18.024380] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:39:18.024987] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-18T18:39:18.025358] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-18T18:39:18.026571] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-09-18T18:39:18.026632] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-18T18:39:18.124674] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-18T18:39:18.380487] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:39:18.919507] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-11. [2025-09-18T18:39:19.089797] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-18T18:39:19.719581] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-18T18:39:20.030138] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-18T18:39:20.436438] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-18T18:39:20.519502] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-09-18T18:39:21.319587] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-18T18:39:21.696606] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-18T18:39:22.119588] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-18T18:39:22.362818] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-18T18:39:22.639776] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-18T18:39:22.919586] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-18T18:39:23.591160] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T18:39:23.719540] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-09-18T18:39:24.519577] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-18T18:39:24.760908] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-18T18:39:24.831453] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-18T18:39:25.319630] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-18T18:39:25.876911] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-18T18:39:25.883193] [INFO ] [REMOTE ] EBS: Full fetch complete (67258 records). [2025-09-18T18:39:25.883307] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-18T18:39:26.124715] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-18T18:39:26.278118] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-09-18T18:39:26.278198] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-09-18T18:39:26.278929] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-09-18T18:39:26.278993] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-09-18T18:39:26.283098] [DEBUG] [LOCAL ] EBS: Trimmed 67258 records to 47331 (keeping 200 days of data) [2025-09-18T18:39:26.537853] [DEBUG] [LOCAL ] EBS: Primary data saved (47331 records). [2025-09-18T18:39:26.537982] [INFO ] [MAIN ] EBS: Full history saved. [2025-09-18T18:39:26.538080] [INFO ] [MAIN ] Update Progress: 682/2372 symbols completed. EBS took 32.8s. Estimated remaining: 4h 6m 17s. Rate: 6.9 symbols/min [2025-09-18T18:39:26.736925] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:39:26.737300] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-18T18:39:26.737396] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-18T18:39:26.737678] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-18T18:39:26.737885] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-18T18:39:26.738022] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-18T18:39:26.738748] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-18T18:39:26.900087] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-18T18:39:26.928000] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-18T18:39:27.155873] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:39:27.698559] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-18T18:39:27.719551] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-18T18:39:28.325637] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-18T18:39:28.337282] [INFO ] [REMOTE ] EBR: Full fetch complete (62391 records). [2025-09-18T18:39:28.337429] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-18T18:39:28.338222] [FATAL] [VALIDATOR ] EBR: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:39:28.338314] [FATAL] [MAIN ] EBR: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:39:28.338358] [WARN ] [MAIN ] EBR: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:39:28.338396] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-18T18:39:28.338470] [DEBUG] [LOCAL ] EBR: No primary data file found to delete. [2025-09-18T18:39:28.338527] [INFO ] [LOCAL ] EBR: Starting deletion of derivative data. [2025-09-18T18:39:28.339129] [DEBUG] [LOCAL ] EBR: Deleted derivative data file. [2025-09-18T18:39:28.339296] [INFO ] [MAIN ] Update Progress: 683/2372 symbols completed. EBR took 34.6s. Estimated remaining: 4h 5m 51s. Rate: 6.9 symbols/min [2025-09-18T18:39:28.515499] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:39:28.515753] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-09-18T18:39:28.515812] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-09-18T18:39:28.515959] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-18T18:39:28.516002] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-18T18:39:28.516045] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-18T18:39:28.516079] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-18T18:39:28.527371] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-18T18:39:28.896795] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:39:29.319585] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-11. [2025-09-18T18:39:29.406187] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-18T18:39:29.416402] [INFO ] [REMOTE ] EC: Full fetch complete (71854 records). [2025-09-18T18:39:29.416560] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-18T18:39:29.521895] [DEBUG] [REMOTE ] ECCU: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:39:29.533139] [WARN ] [REMOTE ] ECCU: No data returned for month 2024-11 [2025-09-18T18:39:29.835490] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-09-18T18:39:29.835594] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-09-18T18:39:29.838248] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-09-18T18:39:29.838385] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-09-18T18:39:29.842429] [DEBUG] [LOCAL ] EC: Trimmed 71854 records to 49826 (keeping 200 days of data) [2025-09-18T18:39:30.141451] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-11. [2025-09-18T18:39:30.208049] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-18T18:39:30.222730] [DEBUG] [LOCAL ] EC: Primary data saved (49826 records). [2025-09-18T18:39:30.222854] [INFO ] [MAIN ] EC: Full history saved. [2025-09-18T18:39:30.224939] [INFO ] [MAIN ] Update Progress: 684/2372 symbols completed. EC took 36.4s. Estimated remaining: 4h 5m 25s. Rate: 6.9 symbols/min [2025-09-18T18:39:30.396695] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:39:30.396896] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-18T18:39:30.396934] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-18T18:39:30.397088] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-18T18:39:30.397158] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-18T18:39:30.397228] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-18T18:39:30.397291] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-18T18:39:30.712479] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-18T18:39:30.781188] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:39:30.919594] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-18T18:39:31.719545] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-09-18T18:39:32.115094] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-18T18:39:32.519610] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-09-18T18:39:32.742008] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-18T18:39:32.882942] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-18T18:39:33.319624] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-18T18:39:33.847883] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-18T18:39:34.119587] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-09-18T18:39:34.488114] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-18T18:39:34.919617] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-09-18T18:39:35.244837] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-18T18:39:35.719569] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-18T18:39:36.519589] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-18T18:39:37.095612] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-18T18:39:37.319382] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-18T18:39:37.327911] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-11. [2025-09-18T18:39:37.768599] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-18T18:39:38.119621] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-09-18T18:39:38.490388] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-18T18:39:38.919632] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-18T18:39:39.719593] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-18T18:39:40.051298] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-18T18:39:40.134845] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-18T18:39:40.519578] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-18T18:39:40.796916] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-18T18:39:41.319548] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-18T18:39:42.119608] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-09-18T18:39:42.448666] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-18T18:39:42.919578] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-18T18:39:43.067671] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-18T18:39:43.169870] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-09-18T18:39:43.719547] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-18T18:39:44.519594] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-18T18:39:45.044282] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-18T18:39:45.319558] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-18T18:39:45.383210] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-18T18:39:45.589530] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-18T18:39:46.119603] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-18T18:39:46.553484] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-18T18:39:46.919539] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-18T18:39:47.250870] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-18T18:39:47.719590] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-18T18:39:48.519568] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-18T18:39:49.321842] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-18T18:39:49.332920] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-18T18:39:49.340486] [INFO ] [REMOTE ] ECC: Full fetch complete (60967 records). [2025-09-18T18:39:49.340593] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-18T18:39:49.419243] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-18T18:39:49.731366] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-09-18T18:39:49.731473] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-09-18T18:39:49.732591] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-09-18T18:39:49.732677] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-09-18T18:39:49.734717] [DEBUG] [LOCAL ] ECC: Trimmed 60967 records to 43720 (keeping 200 days of data) [2025-09-18T18:39:49.955458] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-18T18:39:50.008114] [DEBUG] [LOCAL ] ECC: Primary data saved (43720 records). [2025-09-18T18:39:50.008250] [INFO ] [MAIN ] ECC: Full history saved. [2025-09-18T18:39:50.008381] [INFO ] [MAIN ] Update Progress: 685/2372 symbols completed. ECC took 32.4s. Estimated remaining: 4h 5m 44s. Rate: 6.9 symbols/min [2025-09-18T18:39:50.124616] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-18T18:39:50.182817] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:39:50.182987] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-18T18:39:50.183026] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-18T18:39:50.183214] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-18T18:39:50.183283] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-18T18:39:50.183353] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-18T18:39:50.183390] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-18T18:39:50.543384] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:39:50.585383] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-18T18:39:50.919561] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-18T18:39:51.359808] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-18T18:39:51.719604] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-18T18:39:52.185716] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-18T18:39:52.519582] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-18T18:39:52.944548] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-18T18:39:53.319579] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-18T18:39:53.688214] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-18T18:39:54.119579] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-18T18:39:54.443278] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-18T18:39:54.919566] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-18T18:39:55.417222] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-18T18:39:55.719539] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-18T18:39:56.231384] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-18T18:39:56.519546] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-18T18:39:56.904896] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-18T18:39:57.319570] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-18T18:39:57.899665] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-18T18:39:57.900910] [INFO ] [REMOTE ] ECCU: Full fetch complete (4396 records). [2025-09-18T18:39:57.900996] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-18T18:39:58.096185] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 186 unique days, need 200 days [2025-09-18T18:39:58.096661] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:39:58.096748] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:39:58.096825] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-18T18:39:58.096912] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-18T18:39:58.096987] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-09-18T18:39:58.097070] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-09-18T18:39:58.097215] [INFO ] [MAIN ] Update Progress: 686/2372 symbols completed. ECCU took 29.8s. Estimated remaining: 4h 5m 33s. Rate: 6.9 symbols/min [2025-09-18T18:39:58.126266] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-18T18:39:58.283963] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:39:58.333743] [DEBUG] [LOCAL ] ECG: Loaded 34704 existing records from primary storage. [2025-09-18T18:39:58.333903] [INFO ] [MAIN ] ECG: Loaded 34704 existing records. [2025-09-18T18:39:58.511064] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:39:58.511328] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-18T18:39:58.511407] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-18T18:39:58.512581] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-09-18T18:39:58.512674] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-18T18:39:58.738015] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-18T18:39:58.771893] [INFO ] [REMOTE ] ECCW: Full fetch complete (1418 records). [2025-09-18T18:39:58.787976] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-18T18:39:58.920704] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-11. [2025-09-18T18:39:58.992586] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:39:59.075765] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-18T18:39:59.076011] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:39:59.076090] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:39:59.076183] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-18T18:39:59.076266] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-18T18:39:59.076307] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-18T18:39:59.076349] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-18T18:39:59.076437] [INFO ] [MAIN ] Update Progress: 687/2372 symbols completed. ECCW took 28.9s. Estimated remaining: 4h 5m 6s. Rate: 6.9 symbols/min [2025-09-18T18:39:59.247777] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:39:59.307763] [DEBUG] [LOCAL ] ECL: Loaded 46721 existing records from primary storage. [2025-09-18T18:39:59.307931] [INFO ] [MAIN ] ECL: Loaded 46721 existing records. [2025-09-18T18:39:59.392126] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-18T18:39:59.493587] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:39:59.493932] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-18T18:39:59.493988] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-18T18:39:59.495517] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-09-18T18:39:59.495591] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-18T18:39:59.724723] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-18T18:39:59.870166] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:40:00.331995] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-18T18:40:00.519541] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-11. [2025-09-18T18:40:01.319616] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-11. [2025-09-18T18:40:02.119528] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-09-18T18:40:02.177319] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-18T18:40:02.674539] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-18T18:40:02.757393] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-18T18:40:02.919556] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-09-18T18:40:03.719551] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-09-18T18:40:04.364500] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-18T18:40:04.519496] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-09-18T18:40:05.319515] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-18T18:40:05.450876] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-18T18:40:05.665739] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T18:40:05.835233] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-18T18:40:05.836216] [INFO ] [REMOTE ] ECCC: Full fetch complete (1288 records). [2025-09-18T18:40:05.836312] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-18T18:40:06.083414] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-18T18:40:06.083663] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:40:06.083737] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:40:06.083785] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-18T18:40:06.083843] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-18T18:40:06.083880] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-18T18:40:06.083920] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-18T18:40:06.083977] [INFO ] [MAIN ] Update Progress: 688/2372 symbols completed. ECCC took 39.5s. Estimated remaining: 4h 4m 53s. Rate: 6.9 symbols/min [2025-09-18T18:40:06.124614] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-09-18T18:40:06.262099] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:40:06.289324] [DEBUG] [LOCAL ] ECO: Loaded 18677 existing records from primary storage. [2025-09-18T18:40:06.289451] [INFO ] [MAIN ] ECO: Loaded 18677 existing records. [2025-09-18T18:40:06.471995] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:40:06.472254] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-18T18:40:06.472310] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-18T18:40:06.473327] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-18T18:40:06.473391] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-18T18:40:06.848376] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:40:06.919493] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-11. [2025-09-18T18:40:07.719723] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-18T18:40:07.932894] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-18T18:40:07.988794] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-18T18:40:08.519563] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-09-18T18:40:08.938720] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-18T18:40:09.312712] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-18T18:40:09.320871] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-09-18T18:40:10.119540] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-18T18:40:10.382575] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-18T18:40:10.494763] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-18T18:40:10.919547] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-18T18:40:11.719541] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-09-18T18:40:12.519611] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-18T18:40:12.967720] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T18:40:13.203171] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-18T18:40:13.319593] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-18T18:40:13.726927] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-18T18:40:13.767437] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-18T18:40:14.119580] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-18T18:40:14.919557] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-18T18:40:15.090867] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-18T18:40:15.719532] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-18T18:40:15.837823] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-18T18:40:16.519598] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-18T18:40:17.036086] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-18T18:40:17.136918] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T18:40:17.319568] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-18T18:40:18.119611] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-18T18:40:18.444844] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-18T18:40:18.743606] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-18T18:40:18.919542] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-18T18:40:19.391033] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-18T18:40:19.719558] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-18T18:40:20.519584] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-18T18:40:21.319504] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-18T18:40:21.662080] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-18T18:40:21.823998] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-18T18:40:22.119583] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-18T18:40:22.320419] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-18T18:40:22.434486] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-18T18:40:22.919581] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-18T18:40:23.719586] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-18T18:40:24.426352] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-18T18:40:24.463573] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-18T18:40:24.519543] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-18T18:40:25.319562] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-18T18:40:25.956400] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-18T18:40:26.119578] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-18T18:40:26.247260] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-18T18:40:26.919565] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-18T18:40:27.719600] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-18T18:40:27.910138] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-18T18:40:28.199198] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-18T18:40:28.200273] [INFO ] [REMOTE ] ECCX: Full fetch complete (1483 records). [2025-09-18T18:40:28.200364] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-18T18:40:28.413051] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-18T18:40:28.413498] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:40:28.413800] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:40:28.413966] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-18T18:40:28.419320] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-18T18:40:28.419433] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-18T18:40:28.425792] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-18T18:40:28.427025] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T18:40:28.427291] [INFO ] [MAIN ] Update Progress: 689/2372 symbols completed. ECCX took 38.4s. Estimated remaining: 4h 5m 17s. Rate: 6.9 symbols/min [2025-09-18T18:40:28.472560] [INFO ] [REMOTE ] ECG: Full fetch complete (51679 records). [2025-09-18T18:40:28.501351] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-18T18:40:28.528601] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-18T18:40:28.794406] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:40:29.063117] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-09-18T18:40:29.073862] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-09-18T18:40:29.075408] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-09-18T18:40:29.075519] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-09-18T18:40:29.076671] [DEBUG] [LOCAL ] ECVT: Loaded 43123 existing records from primary storage. [2025-09-18T18:40:29.077027] [INFO ] [MAIN ] ECVT: Loaded 43123 existing records. [2025-09-18T18:40:29.168127] [DEBUG] [LOCAL ] ECG: Trimmed 51679 records to 34945 (keeping 200 days of data) [2025-09-18T18:40:29.335825] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-18T18:40:29.345975] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:40:29.347320] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-18T18:40:29.347728] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-18T18:40:29.349286] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-18T18:40:29.350795] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-18T18:40:29.872405] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:40:29.875987] [DEBUG] [REMOTE ] ECL: Error fetching primary data for 2025-05: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-18T18:40:29.876585] [WARN ] [REMOTE ] ECL: No data returned for month 2025-05 [2025-09-18T18:40:29.879241] [DEBUG] [LOCAL ] ECG: Primary data saved (34945 records). [2025-09-18T18:40:29.879311] [INFO ] [MAIN ] ECG: Full history saved. [2025-09-18T18:40:29.879413] [INFO ] [MAIN ] Update Progress: 690/2372 symbols completed. ECG took 31.8s. Estimated remaining: 4h 4m 51s. Rate: 6.9 symbols/min [2025-09-18T18:40:30.047662] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:40:30.109438] [DEBUG] [LOCAL ] ED: Loaded 52827 existing records from primary storage. [2025-09-18T18:40:30.109583] [INFO ] [MAIN ] ED: Loaded 52827 existing records. [2025-09-18T18:40:30.130461] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-18T18:40:30.288290] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:40:30.288496] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-18T18:40:30.288543] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-18T18:40:30.289968] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-09-18T18:40:30.290075] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-18T18:40:30.643248] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:40:30.656600] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-18T18:40:30.919562] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-11. [2025-09-18T18:40:31.686254] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-18T18:40:31.719494] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-18T18:40:32.519579] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-11. [2025-09-18T18:40:32.672238] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-18T18:40:33.087693] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-18T18:40:33.319561] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-18T18:40:33.672822] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-18T18:40:34.119554] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-18T18:40:34.143104] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-18T18:40:34.919545] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-09-18T18:40:35.719543] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-09-18T18:40:35.805822] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-18T18:40:36.519617] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-18T18:40:36.663546] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-18T18:40:37.013725] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-18T18:40:37.319545] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-09-18T18:40:38.119587] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-09-18T18:40:38.204823] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-18T18:40:38.211477] [INFO ] [REMOTE ] ECL: Full fetch complete (60384 records). [2025-09-18T18:40:38.211588] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-18T18:40:38.408726] [WARN ] [VALIDATOR ] ECL: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-18T18:40:38.409319] [FATAL] [MAIN ] ECL: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:40:38.409390] [WARN ] [MAIN ] ECL: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:40:38.409438] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-18T18:40:38.409496] [DEBUG] [LOCAL ] ECL: No primary data file found to delete. [2025-09-18T18:40:38.409540] [INFO ] [LOCAL ] ECL: Starting deletion of derivative data. [2025-09-18T18:40:38.409937] [DEBUG] [LOCAL ] ECL: Deleted derivative data file. [2025-09-18T18:40:38.410749] [INFO ] [MAIN ] Update Progress: 691/2372 symbols completed. ECL took 39.3s. Estimated remaining: 4h 4m 41s. Rate: 6.9 symbols/min [2025-09-18T18:40:38.614885] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:40:38.643414] [DEBUG] [LOCAL ] EDD: Loaded 27235 existing records from primary storage. [2025-09-18T18:40:38.643558] [INFO ] [MAIN ] EDD: Loaded 27235 existing records. [2025-09-18T18:40:38.832306] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:40:38.832849] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-18T18:40:38.832955] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-18T18:40:38.833907] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-09-18T18:40:38.851971] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-18T18:40:38.888331] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-18T18:40:38.920750] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-18T18:40:39.248720] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:40:39.612744] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T18:40:39.717466] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-18T18:40:39.721328] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-18T18:40:40.519599] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-11. [2025-09-18T18:40:41.144986] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T18:40:41.281220] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-18T18:40:41.319493] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-18T18:40:42.119558] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-18T18:40:42.919552] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-09-18T18:40:43.081504] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-18T18:40:43.101300] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-18T18:40:43.104254] [INFO ] [REMOTE ] ECO: Full fetch complete (29575 records). [2025-09-18T18:40:43.104336] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-18T18:40:43.484358] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-09-18T18:40:43.484453] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-09-18T18:40:43.484971] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-09-18T18:40:43.485039] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-09-18T18:40:43.485969] [DEBUG] [LOCAL ] ECO: Trimmed 29575 records to 18799 (keeping 200 days of data) [2025-09-18T18:40:43.609744] [DEBUG] [LOCAL ] ECO: Primary data saved (18799 records). [2025-09-18T18:40:43.609896] [INFO ] [MAIN ] ECO: Full history saved. [2025-09-18T18:40:43.609986] [INFO ] [MAIN ] Update Progress: 692/2372 symbols completed. ECO took 37.5s. Estimated remaining: 4h 4m 24s. Rate: 6.9 symbols/min [2025-09-18T18:40:43.720842] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-18T18:40:43.786780] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:40:43.787014] [DEBUG] [LOCAL ] EDF: No existing data file found in primary storage. [2025-09-18T18:40:43.787071] [WARN ] [MAIN ] EDF: No existing data found, performing full refresh instead. [2025-09-18T18:40:43.787226] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-18T18:40:43.787272] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-18T18:40:43.787316] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-09-18T18:40:43.787350] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-18T18:40:44.169621] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:40:44.190718] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-18T18:40:44.519580] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-11. [2025-09-18T18:40:45.319577] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-09-18T18:40:45.518584] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-18T18:40:45.568987] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-18T18:40:46.006261] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-18T18:40:46.119535] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-18T18:40:46.919570] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-09-18T18:40:47.131428] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T18:40:47.719512] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-18T18:40:47.926237] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-18T18:40:48.519537] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-09-18T18:40:49.326514] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-18T18:40:49.348196] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-18T18:40:49.386778] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-18T18:40:50.119555] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-18T18:40:50.571180] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-18T18:40:50.801203] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-18T18:40:50.919557] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-18T18:40:51.593119] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-18T18:40:51.719557] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-18T18:40:52.519615] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-18T18:40:53.319604] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-18T18:40:53.557874] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-18T18:40:53.599902] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-18T18:40:54.119614] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-18T18:40:54.440093] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-18T18:40:54.919533] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-18T18:40:55.038189] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-18T18:40:55.719602] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-18T18:40:56.438944] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-18T18:40:56.458236] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-18T18:40:56.519571] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-18T18:40:57.319625] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-18T18:40:58.119596] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-18T18:40:58.264350] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-18T18:40:58.285932] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-18T18:40:58.919575] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-18T18:40:59.302941] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-18T18:40:59.721016] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-18T18:40:59.724777] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-18T18:41:00.519548] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-18T18:41:01.296207] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-18T18:41:01.304717] [INFO ] [REMOTE ] ED: Full fetch complete (76209 records). [2025-09-18T18:41:01.305063] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-18T18:41:01.329807] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-18T18:41:01.619006] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-18T18:41:01.650441] [INFO ] [REMOTE ] EDF: Full fetch complete (20826 records). [2025-09-18T18:41:01.662110] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-18T18:41:01.662951] [FATAL] [VALIDATOR ] EDF: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:41:01.663093] [FATAL] [MAIN ] EDF: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:41:01.663188] [WARN ] [MAIN ] EDF: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:41:01.669086] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-18T18:41:01.684595] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-09-18T18:41:01.684751] [INFO ] [LOCAL ] EDF: Starting deletion of derivative data. [2025-09-18T18:41:01.705412] [DEBUG] [LOCAL ] EDF: No derivative data file found to delete. [2025-09-18T18:41:01.715926] [INFO ] [MAIN ] Update Progress: 693/2372 symbols completed. EDF took 18.1s. Estimated remaining: 4h 4m 38s. Rate: 6.9 symbols/min [2025-09-18T18:41:01.814024] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-09-18T18:41:01.843995] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-09-18T18:41:01.876820] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-09-18T18:41:01.879423] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-09-18T18:41:01.933449] [DEBUG] [LOCAL ] ED: Trimmed 76209 records to 53213 (keeping 200 days of data) [2025-09-18T18:41:01.953930] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:41:02.071156] [DEBUG] [LOCAL ] EDN: Loaded 17653 existing records from primary storage. [2025-09-18T18:41:02.074030] [INFO ] [MAIN ] EDN: Loaded 17653 existing records. [2025-09-18T18:41:02.125061] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-18T18:41:02.294731] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:41:02.299482] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-18T18:41:02.299542] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-18T18:41:02.300049] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-09-18T18:41:02.300113] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-18T18:41:02.612481] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-18T18:41:02.920677] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-18T18:41:02.919854] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:41:02.942338] [DEBUG] [LOCAL ] ED: Primary data saved (53213 records). [2025-09-18T18:41:02.942567] [INFO ] [MAIN ] ED: Full history saved. [2025-09-18T18:41:02.942707] [INFO ] [MAIN ] Update Progress: 694/2372 symbols completed. ED took 33.1s. Estimated remaining: 4h 4m 11s. Rate: 6.9 symbols/min [2025-09-18T18:41:03.127185] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:41:03.175730] [DEBUG] [LOCAL ] EDU: Loaded 45331 existing records from primary storage. [2025-09-18T18:41:03.175949] [INFO ] [MAIN ] EDU: Loaded 45331 existing records. [2025-09-18T18:41:03.376343] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:41:03.376770] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-18T18:41:03.376833] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-18T18:41:03.378384] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-09-18T18:41:03.378450] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-18T18:41:03.722194] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-11. [2025-09-18T18:41:03.801069] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:41:03.829506] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-18T18:41:04.105039] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-18T18:41:04.519585] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-11. [2025-09-18T18:41:04.952947] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-18T18:41:05.319579] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-18T18:41:06.119595] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-09-18T18:41:06.411511] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-18T18:41:06.470709] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-18T18:41:06.919498] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-09-18T18:41:06.960844] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T18:41:07.719565] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-09-18T18:41:08.527578] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-18T18:41:08.545000] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-18T18:41:08.681789] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-18T18:41:09.319622] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-18T18:41:09.504683] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-18T18:41:10.119580] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-18T18:41:10.797802] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-18T18:41:10.919558] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-18T18:41:10.950060] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-18T18:41:11.719537] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-18T18:41:12.237862] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T18:41:12.519552] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-18T18:41:12.777519] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-18T18:41:13.319563] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-09-18T18:41:13.559549] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-18T18:41:13.564583] [INFO ] [REMOTE ] EDD: Full fetch complete (39175 records). [2025-09-18T18:41:13.564736] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-18T18:41:13.949034] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-09-18T18:41:13.949125] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-09-18T18:41:13.949637] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-09-18T18:41:13.949721] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-09-18T18:41:13.950703] [DEBUG] [LOCAL ] EDD: Trimmed 39175 records to 27486 (keeping 200 days of data) [2025-09-18T18:41:14.106848] [DEBUG] [LOCAL ] EDD: Primary data saved (27486 records). [2025-09-18T18:41:14.106985] [INFO ] [MAIN ] EDD: Full history saved. [2025-09-18T18:41:14.107072] [INFO ] [MAIN ] Update Progress: 695/2372 symbols completed. EDD took 35.7s. Estimated remaining: 4h 4m 8s. Rate: 6.9 symbols/min [2025-09-18T18:41:14.127730] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-18T18:41:14.284276] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:41:14.325663] [DEBUG] [LOCAL ] EE: Loaded 32569 existing records from primary storage. [2025-09-18T18:41:14.325851] [INFO ] [MAIN ] EE: Loaded 32569 existing records. [2025-09-18T18:41:14.507610] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:41:14.507893] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-18T18:41:14.507945] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-18T18:41:14.508721] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-09-18T18:41:14.508788] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-18T18:41:14.894675] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:41:14.921283] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-11. [2025-09-18T18:41:14.927408] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T18:41:15.402772] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-18T18:41:15.719551] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-18T18:41:15.976843] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-18T18:41:16.524857] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-18T18:41:16.531146] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-18T18:41:17.319581] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-18T18:41:18.119582] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-09-18T18:41:18.244256] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-18T18:41:18.883546] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-18T18:41:18.919493] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-18T18:41:18.973473] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-18T18:41:19.719547] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-09-18T18:41:20.352988] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-18T18:41:20.519537] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-18T18:41:20.806671] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-18T18:41:21.319552] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-18T18:41:22.080934] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-18T18:41:22.119510] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-18T18:41:22.143187] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-18T18:41:22.919556] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-18T18:41:23.474288] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-18T18:41:23.719524] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-18T18:41:24.196866] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-18T18:41:24.519598] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-18T18:41:24.952784] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T18:41:25.319575] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-18T18:41:25.398600] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-18T18:41:26.119545] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-18T18:41:26.581289] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-18T18:41:26.741484] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-18T18:41:26.919568] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-18T18:41:27.719574] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-18T18:41:28.409484] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T18:41:28.519562] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-18T18:41:29.209205] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-18T18:41:29.319503] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-18T18:41:29.926487] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-18T18:41:29.932582] [INFO ] [REMOTE ] ECVT: Full fetch complete (59742 records). [2025-09-18T18:41:29.932706] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-18T18:41:30.127775] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-18T18:41:30.332130] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-18T18:41:30.332354] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-18T18:41:30.333140] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-18T18:41:30.339210] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-18T18:41:30.351123] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-18T18:41:30.358306] [DEBUG] [LOCAL ] ECVT: Trimmed 59742 records to 43492 (keeping 200 days of data) [2025-09-18T18:41:30.601027] [DEBUG] [LOCAL ] ECVT: Primary data saved (43492 records). [2025-09-18T18:41:30.601159] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-18T18:41:30.601241] [INFO ] [MAIN ] Update Progress: 696/2372 symbols completed. ECVT took 1m 2s. Estimated remaining: 4h 4m 18s. Rate: 6.9 symbols/min [2025-09-18T18:41:30.769341] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:41:30.775505] [DEBUG] [LOCAL ] EEA: Loaded 2830 existing records from primary storage. [2025-09-18T18:41:30.775589] [INFO ] [MAIN ] EEA: Loaded 2830 existing records. [2025-09-18T18:41:30.924695] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-18T18:41:30.954867] [WARN ] [MAIN ] EEA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:41:30.955131] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-18T18:41:30.955180] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-18T18:41:30.955413] [DEBUG] [LOCAL ] EEA: Deleted primary data file. [2025-09-18T18:41:30.955472] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-18T18:41:31.317131] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:41:31.719516] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-11. [2025-09-18T18:41:32.220883] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-18T18:41:32.256149] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-18T18:41:32.389353] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-18T18:41:32.519674] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-18T18:41:33.319574] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-18T18:41:33.817329] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T18:41:34.119557] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-18T18:41:34.199620] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-18T18:41:34.203290] [INFO ] [REMOTE ] EDN: Full fetch complete (30485 records). [2025-09-18T18:41:34.203374] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-18T18:41:34.579573] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-09-18T18:41:34.579701] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-09-18T18:41:34.580169] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-09-18T18:41:34.580213] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-09-18T18:41:34.581252] [DEBUG] [LOCAL ] EDN: Trimmed 30485 records to 17946 (keeping 200 days of data) [2025-09-18T18:41:34.687036] [DEBUG] [LOCAL ] EDN: Primary data saved (17946 records). [2025-09-18T18:41:34.687192] [INFO ] [MAIN ] EDN: Full history saved. [2025-09-18T18:41:34.687282] [INFO ] [MAIN ] Update Progress: 697/2372 symbols completed. EDN took 32.9s. Estimated remaining: 4h 3m 58s. Rate: 6.9 symbols/min [2025-09-18T18:41:34.901622] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:41:34.914560] [DEBUG] [LOCAL ] EEX: Loaded 12320 existing records from primary storage. [2025-09-18T18:41:34.914712] [INFO ] [MAIN ] EEX: Loaded 12320 existing records. [2025-09-18T18:41:34.925875] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-09-18T18:41:35.094833] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:41:35.095094] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-18T18:41:35.095142] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-18T18:41:35.095513] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-09-18T18:41:35.095573] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-18T18:41:35.376003] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-18T18:41:35.456165] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:41:35.477789] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T18:41:35.719519] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-11. [2025-09-18T18:41:36.519547] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-09-18T18:41:36.637800] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-18T18:41:37.041892] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-18T18:41:37.319543] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-18T18:41:38.119590] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-18T18:41:38.756364] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-18T18:41:38.786807] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T18:41:38.919518] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-18T18:41:39.719548] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-18T18:41:40.182116] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-18T18:41:40.188405] [INFO ] [REMOTE ] EDU: Full fetch complete (66505 records). [2025-09-18T18:41:40.188526] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-18T18:41:40.528517] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-09-18T18:41:40.588088] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-09-18T18:41:40.588194] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-09-18T18:41:40.589046] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-09-18T18:41:40.589164] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-09-18T18:41:40.590612] [DEBUG] [LOCAL ] EDU: Trimmed 66505 records to 45632 (keeping 200 days of data) [2025-09-18T18:41:40.848747] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-18T18:41:40.889260] [DEBUG] [LOCAL ] EDU: Primary data saved (45632 records). [2025-09-18T18:41:40.889391] [INFO ] [MAIN ] EDU: Full history saved. [2025-09-18T18:41:40.889498] [INFO ] [MAIN ] Update Progress: 698/2372 symbols completed. EDU took 37.9s. Estimated remaining: 4h 3m 43s. Rate: 6.9 symbols/min [2025-09-18T18:41:41.058983] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:41:41.105329] [DEBUG] [LOCAL ] EFC: Loaded 46247 existing records from primary storage. [2025-09-18T18:41:41.105524] [INFO ] [MAIN ] EFC: Loaded 46247 existing records. [2025-09-18T18:41:41.292984] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:41:41.305256] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-18T18:41:41.305622] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-18T18:41:41.305866] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-18T18:41:41.312720] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-09-18T18:41:41.312787] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-18T18:41:41.325454] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-18T18:41:41.675567] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:41:41.996586] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-18T18:41:42.119527] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-11. [2025-09-18T18:41:42.919548] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-18T18:41:43.504814] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T18:41:43.719535] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-09-18T18:41:44.241598] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-18T18:41:44.245912] [INFO ] [REMOTE ] EE: Full fetch complete (43437 records). [2025-09-18T18:41:44.246011] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-18T18:41:44.524690] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-09-18T18:41:44.638383] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-09-18T18:41:44.638472] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-09-18T18:41:44.639055] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-09-18T18:41:44.639120] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-09-18T18:41:44.640177] [DEBUG] [LOCAL ] EE: Trimmed 43437 records to 32818 (keeping 200 days of data) [2025-09-18T18:41:44.851486] [DEBUG] [LOCAL ] EE: Primary data saved (32818 records). [2025-09-18T18:41:44.851613] [INFO ] [MAIN ] EE: Full history saved. [2025-09-18T18:41:44.853564] [INFO ] [MAIN ] Update Progress: 699/2372 symbols completed. EE took 30.7s. Estimated remaining: 4h 3m 23s. Rate: 6.9 symbols/min [2025-09-18T18:41:45.033186] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:41:45.050088] [DEBUG] [LOCAL ] EFR: Loaded 14091 existing records from primary storage. [2025-09-18T18:41:45.050216] [INFO ] [MAIN ] EFR: Loaded 14091 existing records. [2025-09-18T18:41:45.255082] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-18T18:41:45.259027] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:41:45.267949] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-18T18:41:45.268630] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-18T18:41:45.269221] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-09-18T18:41:45.269286] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-18T18:41:45.326344] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-18T18:41:45.621258] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-18T18:41:45.661724] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:41:46.068365] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-18T18:41:46.119530] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-18T18:41:46.919530] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-18T18:41:47.076016] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-18T18:41:47.433118] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-18T18:41:47.719552] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-18T18:41:48.156385] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-18T18:41:48.519601] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-09-18T18:41:49.319605] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-11. [2025-09-18T18:41:49.906404] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-18T18:41:50.119609] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-18T18:41:50.380988] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-18T18:41:50.919554] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-09-18T18:41:50.953400] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-18T18:41:51.719580] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-18T18:41:51.764609] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-18T18:41:52.519600] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-09-18T18:41:52.586614] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-18T18:41:53.092541] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-18T18:41:53.319603] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-18T18:41:53.957896] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-18T18:41:54.119584] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-18T18:41:54.907509] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-18T18:41:54.919496] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-18T18:41:55.686706] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-18T18:41:55.719571] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-18T18:41:56.519598] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-18T18:41:57.319702] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-18T18:41:57.493837] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-18T18:41:57.524137] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-18T18:41:57.844605] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-18T18:41:58.119612] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-18T18:41:58.770373] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-18T18:41:58.772254] [INFO ] [REMOTE ] EEX: Full fetch complete (20204 records). [2025-09-18T18:41:58.772347] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-18T18:41:58.926008] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-18T18:41:59.156796] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-09-18T18:41:59.156880] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-09-18T18:41:59.157256] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-09-18T18:41:59.157352] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-09-18T18:41:59.158107] [DEBUG] [LOCAL ] EEX: Trimmed 20204 records to 12439 (keeping 200 days of data) [2025-09-18T18:41:59.243264] [DEBUG] [LOCAL ] EEX: Primary data saved (12439 records). [2025-09-18T18:41:59.243550] [INFO ] [MAIN ] EEX: Full history saved. [2025-09-18T18:41:59.243806] [INFO ] [MAIN ] Update Progress: 700/2372 symbols completed. EEX took 24.6s. Estimated remaining: 4h 3m 28s. Rate: 6.9 symbols/min [2025-09-18T18:41:59.418599] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:41:59.433496] [DEBUG] [LOCAL ] EFT: Loaded 12511 existing records from primary storage. [2025-09-18T18:41:59.433677] [INFO ] [MAIN ] EFT: Loaded 12511 existing records. [2025-09-18T18:41:59.542614] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-18T18:41:59.621860] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:41:59.622132] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-18T18:41:59.622182] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-18T18:41:59.622601] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-09-18T18:41:59.622700] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-18T18:41:59.722940] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-18T18:42:00.010928] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:42:00.519538] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-18T18:42:00.822967] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-18T18:42:01.135386] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T18:42:01.136328] [INFO ] [REMOTE ] EEA: Full fetch complete (3985 records). [2025-09-18T18:42:01.136419] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-18T18:42:01.323740] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-18T18:42:01.528091] [DEBUG] [VALIDATOR ] EEA: All expected trading days are present. [2025-09-18T18:42:01.528175] [DEBUG] [VALIDATOR ] EEA: Primary data validation passed. [2025-09-18T18:42:01.528315] [INFO ] [MAIN ] EEA: Fetched primary data is valid. [2025-09-18T18:42:01.528357] [DEBUG] [LOCAL ] EEA: Saving primary data. [2025-09-18T18:42:01.528803] [DEBUG] [LOCAL ] EEA: Trimmed 3985 records to 2842 (keeping 200 days of data) [2025-09-18T18:42:01.547951] [DEBUG] [LOCAL ] EEA: Primary data saved (2842 records). [2025-09-18T18:42:01.548101] [INFO ] [MAIN ] EEA: Full history saved. [2025-09-18T18:42:01.548207] [INFO ] [MAIN ] Update Progress: 701/2372 symbols completed. EEA took 30.9s. Estimated remaining: 4h 3m 4s. Rate: 6.9 symbols/min [2025-09-18T18:42:01.721063] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:42:01.785728] [DEBUG] [LOCAL ] EFX: Loaded 45022 existing records from primary storage. [2025-09-18T18:42:01.785901] [INFO ] [MAIN ] EFX: Loaded 45022 existing records. [2025-09-18T18:42:01.973147] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:42:01.973442] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-18T18:42:01.973512] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-18T18:42:01.975042] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-09-18T18:42:01.975116] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-18T18:42:02.124744] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-11. [2025-09-18T18:42:02.346521] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:42:02.919605] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-11. [2025-09-18T18:42:03.719512] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-18T18:42:04.016764] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-18T18:42:04.519594] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-18T18:42:04.789942] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-11 (2.67 seconds). [2025-09-18T18:42:05.259361] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-11 (2.34 seconds). [2025-09-18T18:42:05.319516] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-09-18T18:42:05.560373] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-18T18:42:06.119621] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-18T18:42:06.454338] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-09-18T18:42:06.812336] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T18:42:06.919551] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-09-18T18:42:06.939823] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-18T18:42:07.719559] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-09-18T18:42:08.213747] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-18T18:42:08.519549] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-18T18:42:08.618185] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-18T18:42:09.319620] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-18T18:42:09.370872] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-18T18:42:10.119546] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-18T18:42:10.919548] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-18T18:42:11.182752] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-18T18:42:11.518422] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-18T18:42:11.719592] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-18T18:42:12.262205] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-18T18:42:12.336122] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-18T18:42:12.519601] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-18T18:42:13.319548] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-18T18:42:14.119602] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-09-18T18:42:14.455639] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-18T18:42:14.499367] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-18T18:42:14.502045] [INFO ] [REMOTE ] EFR: Full fetch complete (18462 records). [2025-09-18T18:42:14.502136] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-18T18:42:14.888357] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-18T18:42:14.888010] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-09-18T18:42:14.892075] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-09-18T18:42:14.892519] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-09-18T18:42:14.892607] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-09-18T18:42:14.893266] [DEBUG] [LOCAL ] EFR: Trimmed 18462 records to 14242 (keeping 200 days of data) [2025-09-18T18:42:14.933877] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-18T18:42:14.986693] [DEBUG] [LOCAL ] EFR: Primary data saved (14242 records). [2025-09-18T18:42:14.986839] [INFO ] [MAIN ] EFR: Full history saved. [2025-09-18T18:42:14.986971] [INFO ] [MAIN ] Update Progress: 702/2372 symbols completed. EFR took 30.1s. Estimated remaining: 4h 3m 6s. Rate: 6.9 symbols/min [2025-09-18T18:42:15.165147] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:42:15.214065] [DEBUG] [LOCAL ] EFXT: Loaded 29710 existing records from primary storage. [2025-09-18T18:42:15.214241] [INFO ] [MAIN ] EFXT: Loaded 29710 existing records. [2025-09-18T18:42:15.398170] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:42:15.398405] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-18T18:42:15.398455] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-18T18:42:15.399283] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-18T18:42:15.399357] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-18T18:42:15.722459] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-18T18:42:15.766121] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:42:15.772869] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-18T18:42:16.519559] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-18T18:42:17.319601] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-11. [2025-09-18T18:42:18.094301] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-18T18:42:18.119519] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-18T18:42:18.681582] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-18T18:42:18.919563] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-18T18:42:19.046558] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-18T18:42:19.673529] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-18T18:42:19.719531] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-18T18:42:19.817973] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-18T18:42:20.344291] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-18T18:42:20.519564] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-18T18:42:21.319598] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-18T18:42:22.119574] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-18T18:42:22.261911] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-18T18:42:22.322073] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-18T18:42:22.919623] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-09-18T18:42:23.719613] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-18T18:42:23.951548] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-18T18:42:24.013413] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-18T18:42:24.519577] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-09-18T18:42:25.159050] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-18T18:42:25.166042] [INFO ] [REMOTE ] EFC: Full fetch complete (65924 records). [2025-09-18T18:42:25.166205] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-18T18:42:25.329829] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-18T18:42:25.578616] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-09-18T18:42:25.578804] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-09-18T18:42:25.579777] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-09-18T18:42:25.579871] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-09-18T18:42:25.602392] [DEBUG] [LOCAL ] EFC: Trimmed 65924 records to 46603 (keeping 200 days of data) [2025-09-18T18:42:25.602248] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-18T18:42:25.925132] [DEBUG] [LOCAL ] EFC: Primary data saved (46603 records). [2025-09-18T18:42:25.925408] [INFO ] [MAIN ] EFC: Full history saved. [2025-09-18T18:42:25.925590] [INFO ] [MAIN ] Update Progress: 703/2372 symbols completed. EFC took 45.0s. Estimated remaining: 4h 3m 3s. Rate: 6.9 symbols/min [2025-09-18T18:42:26.103968] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:42:26.122399] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-18T18:42:26.135529] [DEBUG] [LOCAL ] EG: Loaded 29074 existing records from primary storage. [2025-09-18T18:42:26.135717] [INFO ] [MAIN ] EG: Loaded 29074 existing records. [2025-09-18T18:42:26.318732] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-18T18:42:26.343886] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:42:26.345437] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-18T18:42:26.345506] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-18T18:42:26.346462] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-09-18T18:42:26.346549] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-18T18:42:26.713533] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:42:26.919535] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-11. [2025-09-18T18:42:27.667070] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T18:42:27.719561] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-18T18:42:28.112270] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-18T18:42:28.519541] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-09-18T18:42:29.319554] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-18T18:42:29.595444] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-18T18:42:29.669561] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-18T18:42:29.852482] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-18T18:42:30.119569] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-18T18:42:30.919544] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-18T18:42:31.725552] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-09-18T18:42:31.742136] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-18T18:42:31.800320] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-18T18:42:32.519555] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-18T18:42:33.079052] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-18T18:42:33.319590] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-18T18:42:34.119561] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-18T18:42:34.195386] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-18T18:42:34.197575] [INFO ] [REMOTE ] EFT: Full fetch complete (17407 records). [2025-09-18T18:42:34.197694] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-18T18:42:34.598681] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-09-18T18:42:34.599244] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-09-18T18:42:34.599745] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-09-18T18:42:34.599849] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-09-18T18:42:34.610131] [DEBUG] [LOCAL ] EFT: Trimmed 17407 records to 12563 (keeping 200 days of data) [2025-09-18T18:42:34.630887] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-18T18:42:34.718358] [DEBUG] [LOCAL ] EFT: Primary data saved (12563 records). [2025-09-18T18:42:34.718519] [INFO ] [MAIN ] EFT: Full history saved. [2025-09-18T18:42:34.718633] [INFO ] [MAIN ] Update Progress: 704/2372 symbols completed. EFT took 35.5s. Estimated remaining: 4h 2m 54s. Rate: 6.9 symbols/min [2025-09-18T18:42:34.891619] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:42:34.932872] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-18T18:42:34.956680] [DEBUG] [LOCAL ] EGO: Loaded 51404 existing records from primary storage. [2025-09-18T18:42:34.956838] [INFO ] [MAIN ] EGO: Loaded 51404 existing records. [2025-09-18T18:42:35.144132] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:42:35.144769] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-18T18:42:35.144838] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-18T18:42:35.146084] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-09-18T18:42:35.146149] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-18T18:42:35.343975] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T18:42:35.561059] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:42:35.719590] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-18T18:42:36.355885] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-18T18:42:36.519553] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-18T18:42:36.838805] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-18T18:42:37.319592] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-18T18:42:37.985072] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-18T18:42:37.994814] [INFO ] [REMOTE ] EFX: Full fetch complete (64294 records). [2025-09-18T18:42:37.994943] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-18T18:42:38.124769] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-11. [2025-09-18T18:42:38.407302] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-09-18T18:42:38.407393] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-09-18T18:42:38.408169] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-09-18T18:42:38.408236] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-09-18T18:42:38.409593] [DEBUG] [LOCAL ] EFX: Trimmed 64294 records to 45372 (keeping 200 days of data) [2025-09-18T18:42:38.722141] [DEBUG] [LOCAL ] EFX: Primary data saved (45372 records). [2025-09-18T18:42:38.722344] [INFO ] [MAIN ] EFX: Full history saved. [2025-09-18T18:42:38.722461] [INFO ] [MAIN ] Update Progress: 705/2372 symbols completed. EFX took 37.2s. Estimated remaining: 4h 2m 34s. Rate: 6.9 symbols/min [2025-09-18T18:42:38.839008] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T18:42:38.926556] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:42:38.924612] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-18T18:42:38.969016] [DEBUG] [LOCAL ] EGP: Loaded 31484 existing records from primary storage. [2025-09-18T18:42:38.969172] [INFO ] [MAIN ] EGP: Loaded 31484 existing records. [2025-09-18T18:42:39.152220] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:42:39.152549] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-18T18:42:39.152607] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-18T18:42:39.153406] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-09-18T18:42:39.153466] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-18T18:42:39.546784] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:42:39.613139] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-18T18:42:39.719556] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-11. [2025-09-18T18:42:40.311279] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-18T18:42:40.519550] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-18T18:42:40.852947] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-18T18:42:41.319564] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-09-18T18:42:41.948258] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-18T18:42:42.119562] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-18T18:42:42.310597] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-18T18:42:42.919579] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-09-18T18:42:43.092124] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-18T18:42:43.719538] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-18T18:42:43.829950] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-18T18:42:44.519634] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-18T18:42:45.064262] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-18T18:42:45.319562] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-18T18:42:45.802807] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-18T18:42:46.119556] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-09-18T18:42:46.401515] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-18T18:42:46.919556] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-18T18:42:47.519763] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-18T18:42:47.719502] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-18T18:42:47.894771] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-18T18:42:47.898850] [INFO ] [REMOTE ] EG: Full fetch complete (43980 records). [2025-09-18T18:42:47.898976] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-18T18:42:48.279806] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-09-18T18:42:48.279921] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-09-18T18:42:48.280485] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-09-18T18:42:48.280556] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-09-18T18:42:48.281505] [DEBUG] [LOCAL ] EG: Trimmed 43980 records to 29272 (keeping 200 days of data) [2025-09-18T18:42:48.465340] [DEBUG] [LOCAL ] EG: Primary data saved (29272 records). [2025-09-18T18:42:48.465483] [INFO ] [MAIN ] EG: Full history saved. [2025-09-18T18:42:48.465568] [INFO ] [MAIN ] Update Progress: 706/2372 symbols completed. EG took 22.5s. Estimated remaining: 4h 2m 28s. Rate: 6.9 symbols/min [2025-09-18T18:42:48.530626] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-18T18:42:48.639364] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:42:48.679360] [DEBUG] [LOCAL ] EGY: Loaded 42412 existing records from primary storage. [2025-09-18T18:42:48.679773] [INFO ] [MAIN ] EGY: Loaded 42412 existing records. [2025-09-18T18:42:48.864804] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-18T18:42:48.896813] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:42:48.897844] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-18T18:42:48.897908] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-18T18:42:48.898826] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-09-18T18:42:48.898888] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-18T18:42:49.257002] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:42:49.319511] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-11. [2025-09-18T18:42:49.649602] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-18T18:42:50.119545] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-18T18:42:50.817250] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-18T18:42:50.919537] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-18T18:42:51.439932] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T18:42:51.719518] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-09-18T18:42:52.034055] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-18T18:42:52.519576] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-18T18:42:53.012582] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-18T18:42:53.319547] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-09-18T18:42:53.790069] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-18T18:42:54.119548] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-18T18:42:54.559996] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-18T18:42:54.919545] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-09-18T18:42:55.371928] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-18T18:42:55.719544] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-18T18:42:56.375075] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-18T18:42:56.519557] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-18T18:42:57.162433] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-18T18:42:57.319559] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-18T18:42:57.755549] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-18T18:42:58.119586] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-18T18:42:58.924556] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-18T18:42:58.928929] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-18T18:42:59.719523] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-18T18:42:59.841470] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-18T18:43:00.414527] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-18T18:43:00.519534] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-18T18:43:01.090730] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T18:43:01.319570] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-18T18:43:02.082508] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-18T18:43:02.119545] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-18T18:43:02.731714] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-18T18:43:02.736931] [INFO ] [REMOTE ] EFXT: Full fetch complete (44116 records). [2025-09-18T18:43:02.737135] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-18T18:43:02.930282] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-18T18:43:03.153179] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-18T18:43:03.153266] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-18T18:43:03.153910] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-18T18:43:03.153975] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-18T18:43:03.155045] [DEBUG] [LOCAL ] EFXT: Trimmed 44116 records to 29917 (keeping 200 days of data) [2025-09-18T18:43:03.341499] [DEBUG] [LOCAL ] EFXT: Primary data saved (29917 records). [2025-09-18T18:43:03.341663] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-18T18:43:03.341785] [INFO ] [MAIN ] Update Progress: 707/2372 symbols completed. EFXT took 48.4s. Estimated remaining: 4h 2m 34s. Rate: 6.9 symbols/min [2025-09-18T18:43:03.527778] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:43:03.555276] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-18T18:43:03.586900] [DEBUG] [LOCAL ] EHAB: Loaded 30202 existing records from primary storage. [2025-09-18T18:43:03.587040] [INFO ] [MAIN ] EHAB: Loaded 30202 existing records. [2025-09-18T18:43:03.724634] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-18T18:43:03.790787] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:43:03.791051] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-18T18:43:03.791100] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-18T18:43:03.791750] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-09-18T18:43:03.791810] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-18T18:43:04.147101] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:43:04.519504] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-11. [2025-09-18T18:43:04.651543] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-18T18:43:05.290138] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-18T18:43:05.319516] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-18T18:43:05.497234] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-18T18:43:06.119597] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-09-18T18:43:06.594599] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-18T18:43:06.919514] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-18T18:43:06.998245] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T18:43:07.719545] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-18T18:43:08.118500] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-18T18:43:08.519626] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-18T18:43:09.319554] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-18T18:43:09.523223] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-18T18:43:09.572563] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-18T18:43:10.119545] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-09-18T18:43:10.880673] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-18T18:43:10.886455] [INFO ] [REMOTE ] EGY: Full fetch complete (61766 records). [2025-09-18T18:43:10.886574] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-18T18:43:10.924638] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-18T18:43:11.281406] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-09-18T18:43:11.281534] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-09-18T18:43:11.289628] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-09-18T18:43:11.290749] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T18:43:11.290247] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-09-18T18:43:11.296998] [DEBUG] [LOCAL ] EGY: Trimmed 61766 records to 42731 (keeping 200 days of data) [2025-09-18T18:43:11.570718] [DEBUG] [LOCAL ] EGY: Primary data saved (42731 records). [2025-09-18T18:43:11.570890] [INFO ] [MAIN ] EGY: Full history saved. [2025-09-18T18:43:11.571009] [INFO ] [MAIN ] Update Progress: 708/2372 symbols completed. EGY took 23.1s. Estimated remaining: 4h 2m 24s. Rate: 6.9 symbols/min [2025-09-18T18:43:11.724685] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-18T18:43:11.782274] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:43:11.828441] [DEBUG] [LOCAL ] EHC: Loaded 41624 existing records from primary storage. [2025-09-18T18:43:11.828611] [INFO ] [MAIN ] EHC: Loaded 41624 existing records. [2025-09-18T18:43:12.028081] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:43:12.028350] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-18T18:43:12.028398] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-18T18:43:12.029315] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-18T18:43:12.029375] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-18T18:43:12.401571] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:43:12.433452] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-18T18:43:12.519549] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-18T18:43:13.319531] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-18T18:43:13.612403] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-18T18:43:13.663232] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T18:43:14.119574] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-18T18:43:14.271957] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-18T18:43:14.919551] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-11. [2025-09-18T18:43:15.483158] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T18:43:15.719547] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-18T18:43:16.357800] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-18T18:43:16.519555] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-09-18T18:43:17.135371] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T18:43:17.319573] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-18T18:43:17.692901] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-18T18:43:18.119543] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-09-18T18:43:18.395776] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-18T18:43:18.400474] [INFO ] [REMOTE ] EGP: Full fetch complete (45089 records). [2025-09-18T18:43:18.400570] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-18T18:43:18.773669] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-09-18T18:43:18.773762] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-09-18T18:43:18.774330] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-09-18T18:43:18.774371] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-09-18T18:43:18.775331] [DEBUG] [LOCAL ] EGP: Trimmed 45089 records to 31675 (keeping 200 days of data) [2025-09-18T18:43:18.927863] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-18T18:43:18.971206] [DEBUG] [LOCAL ] EGP: Primary data saved (31675 records). [2025-09-18T18:43:18.971354] [INFO ] [MAIN ] EGP: Full history saved. [2025-09-18T18:43:18.971525] [INFO ] [MAIN ] Update Progress: 709/2372 symbols completed. EGP took 40.2s. Estimated remaining: 4h 2m 12s. Rate: 6.9 symbols/min [2025-09-18T18:43:19.155122] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:43:19.166783] [DEBUG] [LOCAL ] EHI: Loaded 10163 existing records from primary storage. [2025-09-18T18:43:19.166911] [INFO ] [MAIN ] EHI: Loaded 10163 existing records. [2025-09-18T18:43:19.363907] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:43:19.364260] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-18T18:43:19.364381] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-18T18:43:19.364886] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-09-18T18:43:19.364959] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-18T18:43:19.542207] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-18T18:43:19.724753] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-18T18:43:19.802014] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:43:19.822692] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-18T18:43:20.519610] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-11. [2025-09-18T18:43:21.319711] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-18T18:43:21.646601] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-18T18:43:21.683980] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-18T18:43:22.119550] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-18T18:43:22.573024] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T18:43:22.919599] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-18T18:43:23.332226] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-18T18:43:23.719562] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-18T18:43:24.372530] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T18:43:24.519539] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-18T18:43:24.699555] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-18T18:43:25.319609] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-18T18:43:26.115901] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-18T18:43:26.122418] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-09-18T18:43:26.124250] [INFO ] [REMOTE ] EGO: Full fetch complete (73052 records). [2025-09-18T18:43:26.124363] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-18T18:43:26.526533] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-09-18T18:43:26.526623] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-09-18T18:43:26.527490] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-09-18T18:43:26.527544] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-09-18T18:43:26.529007] [DEBUG] [LOCAL ] EGO: Trimmed 73052 records to 51775 (keeping 200 days of data) [2025-09-18T18:43:26.791139] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-18T18:43:26.853171] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-18T18:43:26.896369] [DEBUG] [LOCAL ] EGO: Primary data saved (51775 records). [2025-09-18T18:43:26.896540] [INFO ] [MAIN ] EGO: Full history saved. [2025-09-18T18:43:26.896635] [INFO ] [MAIN ] Update Progress: 710/2372 symbols completed. EGO took 52.2s. Estimated remaining: 4h 2m 1s. Rate: 6.9 symbols/min [2025-09-18T18:43:26.927706] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-18T18:43:27.072623] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:43:27.072821] [DEBUG] [LOCAL ] EIC: No existing data file found in primary storage. [2025-09-18T18:43:27.072862] [WARN ] [MAIN ] EIC: No existing data found, performing full refresh instead. [2025-09-18T18:43:27.073022] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-18T18:43:27.073065] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-18T18:43:27.073105] [DEBUG] [LOCAL ] EIC: No primary data file found to delete. [2025-09-18T18:43:27.073136] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-18T18:43:27.426369] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:43:27.719561] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-18T18:43:28.173638] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-18T18:43:28.519562] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-11. [2025-09-18T18:43:29.123956] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T18:43:29.296849] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-18T18:43:29.319510] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-09-18T18:43:30.119571] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-18T18:43:30.299407] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-18T18:43:30.919542] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-18T18:43:31.195977] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-18T18:43:31.199944] [INFO ] [REMOTE ] EHAB: Full fetch complete (41685 records). [2025-09-18T18:43:31.200041] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-18T18:43:31.593354] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-09-18T18:43:31.593471] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-09-18T18:43:31.594105] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-09-18T18:43:31.594168] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-09-18T18:43:31.595781] [DEBUG] [LOCAL ] EHAB: Trimmed 41685 records to 30421 (keeping 200 days of data) [2025-09-18T18:43:31.731288] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-09-18T18:43:31.768955] [DEBUG] [LOCAL ] EHAB: Primary data saved (30421 records). [2025-09-18T18:43:31.769121] [INFO ] [MAIN ] EHAB: Full history saved. [2025-09-18T18:43:31.769228] [INFO ] [MAIN ] Update Progress: 711/2372 symbols completed. EHAB took 28.4s. Estimated remaining: 4h 1m 44s. Rate: 6.9 symbols/min [2025-09-18T18:43:31.941556] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:43:31.941791] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-18T18:43:31.941835] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-18T18:43:31.941995] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-18T18:43:31.942038] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-18T18:43:31.942080] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-18T18:43:31.942113] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-18T18:43:32.300903] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:43:32.384088] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-18T18:43:32.427992] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-18T18:43:32.519545] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-18T18:43:33.319575] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-11. [2025-09-18T18:43:33.440620] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-18T18:43:33.778558] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-18T18:43:34.119553] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-18T18:43:34.919746] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-18T18:43:35.509940] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-18T18:43:35.553814] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T18:43:35.719620] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-09-18T18:43:36.519554] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-18T18:43:36.598847] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-18T18:43:37.319569] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-09-18T18:43:37.637736] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-18T18:43:37.880908] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T18:43:38.119598] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-09-18T18:43:38.418207] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-18T18:43:38.919564] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-18T18:43:39.719552] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-18T18:43:40.451977] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-18T18:43:40.490163] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-18T18:43:40.519514] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-18T18:43:41.319589] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-18T18:43:41.650188] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-18T18:43:41.996257] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-18T18:43:42.001539] [INFO ] [REMOTE ] EHC: Full fetch complete (58821 records). [2025-09-18T18:43:42.001716] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-18T18:43:42.124639] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-18T18:43:42.393056] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-09-18T18:43:42.393142] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-09-18T18:43:42.393906] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-09-18T18:43:42.393973] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-09-18T18:43:42.395290] [DEBUG] [LOCAL ] EHC: Trimmed 58821 records to 41881 (keeping 200 days of data) [2025-09-18T18:43:42.655281] [DEBUG] [LOCAL ] EHC: Primary data saved (41881 records). [2025-09-18T18:43:42.655421] [INFO ] [MAIN ] EHC: Full history saved. [2025-09-18T18:43:42.655506] [INFO ] [MAIN ] Update Progress: 712/2372 symbols completed. EHC took 31.1s. Estimated remaining: 4h 1m 40s. Rate: 6.9 symbols/min [2025-09-18T18:43:42.828663] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:43:42.828866] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-18T18:43:42.828914] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-18T18:43:42.829055] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-18T18:43:42.829110] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-18T18:43:42.829178] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-18T18:43:42.829218] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-18T18:43:42.929419] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-18T18:43:43.144462] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-18T18:43:43.259479] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:43:43.309567] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-18T18:43:43.719553] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-11. [2025-09-18T18:43:44.285097] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-18T18:43:44.519607] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-09-18T18:43:45.003694] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-18T18:43:45.319557] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-18T18:43:45.905714] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-18T18:43:46.119515] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-09-18T18:43:46.461897] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-18T18:43:46.919550] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-18T18:43:47.719577] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-18T18:43:47.940121] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-18T18:43:48.519544] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-18T18:43:48.575504] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-18T18:43:49.245117] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-18T18:43:49.319524] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-18T18:43:49.576760] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-09-18T18:43:50.119576] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-18T18:43:50.919571] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-18T18:43:51.104365] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-18T18:43:51.243872] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-18T18:43:51.719525] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-18T18:43:52.090822] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-18T18:43:52.519613] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-18T18:43:52.964766] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-18T18:43:53.319592] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-18T18:43:53.996104] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-18T18:43:54.119525] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-18T18:43:54.543682] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-18T18:43:54.919548] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-18T18:43:55.392275] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-18T18:43:55.719545] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-18T18:43:56.024492] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-18T18:43:56.519599] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-18T18:43:57.319539] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-18T18:43:57.572170] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-18T18:43:57.643051] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-18T18:43:58.119574] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-18T18:43:58.555904] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-18T18:43:58.919584] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-18T18:43:59.719512] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-18T18:43:59.885340] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-18T18:44:00.307755] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-18T18:44:00.309083] [INFO ] [REMOTE ] EICB: Full fetch complete (2659 records). [2025-09-18T18:44:00.309178] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-18T18:44:00.503010] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-18T18:44:00.503234] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:44:00.503305] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:44:00.503378] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-18T18:44:00.503464] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-18T18:44:00.503521] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-18T18:44:00.503580] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-18T18:44:00.503709] [INFO ] [MAIN ] Update Progress: 713/2372 symbols completed. EICB took 17.8s. Estimated remaining: 4h 1m 52s. Rate: 6.9 symbols/min [2025-09-18T18:44:00.524723] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-18T18:44:00.673799] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:44:00.673992] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-09-18T18:44:00.674047] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-09-18T18:44:00.674186] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-18T18:44:00.674233] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-18T18:44:00.674274] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-18T18:44:00.674307] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-18T18:44:01.031256] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:44:01.319620] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-18T18:44:01.848880] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T18:44:01.961500] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-18T18:44:01.964305] [INFO ] [REMOTE ] EHI: Full fetch complete (16351 records). [2025-09-18T18:44:01.964397] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-18T18:44:01.965016] [FATAL] [VALIDATOR ] EHI: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:44:01.965122] [FATAL] [MAIN ] EHI: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:44:01.965202] [WARN ] [MAIN ] EHI: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:44:01.965292] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-18T18:44:01.965396] [DEBUG] [LOCAL ] EHI: No primary data file found to delete. [2025-09-18T18:44:01.965468] [INFO ] [LOCAL ] EHI: Starting deletion of derivative data. [2025-09-18T18:44:01.966026] [DEBUG] [LOCAL ] EHI: Deleted derivative data file. [2025-09-18T18:44:01.966146] [INFO ] [MAIN ] Update Progress: 714/2372 symbols completed. EHI took 43.0s. Estimated remaining: 4h 1m 27s. Rate: 6.9 symbols/min [2025-09-18T18:44:02.124722] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-18T18:44:02.151056] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:44:02.173979] [DEBUG] [LOCAL ] EIG: Loaded 20254 existing records from primary storage. [2025-09-18T18:44:02.174103] [INFO ] [MAIN ] EIG: Loaded 20254 existing records. [2025-09-18T18:44:02.356207] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:44:02.356451] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-18T18:44:02.356509] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-18T18:44:02.357163] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-18T18:44:02.357223] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-18T18:44:02.650401] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-18T18:44:02.724463] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:44:02.919583] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-11. [2025-09-18T18:44:03.440698] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-18T18:44:03.719536] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-11. [2025-09-18T18:44:04.511199] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-18T18:44:04.519489] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-18T18:44:04.944306] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-18T18:44:04.945081] [INFO ] [REMOTE ] EICA: Full fetch complete (1278 records). [2025-09-18T18:44:04.945150] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-18T18:44:05.122422] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-18T18:44:05.122621] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:44:05.122702] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:44:05.122752] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-18T18:44:05.122809] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-18T18:44:05.122884] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-18T18:44:05.122958] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-18T18:44:05.123051] [INFO ] [MAIN ] Update Progress: 715/2372 symbols completed. EICA took 33.4s. Estimated remaining: 4h 1m 5s. Rate: 6.9 symbols/min [2025-09-18T18:44:05.291193] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:44:05.326391] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-09-18T18:44:05.347977] [DEBUG] [LOCAL ] EIX: Loaded 53359 existing records from primary storage. [2025-09-18T18:44:05.348126] [INFO ] [MAIN ] EIX: Loaded 53359 existing records. [2025-09-18T18:44:05.530468] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:44:05.530805] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-18T18:44:05.530859] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-18T18:44:05.533041] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-09-18T18:44:05.533103] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-18T18:44:05.894168] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:44:06.119508] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-09-18T18:44:06.224055] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-18T18:44:06.724965] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-18T18:44:06.919583] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-09-18T18:44:07.702440] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-18T18:44:07.719546] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-11. [2025-09-18T18:44:08.519557] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-18T18:44:09.319563] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-09-18T18:44:09.436400] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-18T18:44:09.758436] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T18:44:09.807024] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-18T18:44:10.119541] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-18T18:44:10.919588] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-18T18:44:11.323149] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-18T18:44:11.599459] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T18:44:11.719500] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-18T18:44:12.519574] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-09-18T18:44:12.960695] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T18:44:13.319548] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-18T18:44:14.102059] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-18T18:44:14.119497] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-09-18T18:44:14.845200] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-18T18:44:14.848112] [INFO ] [REMOTE ] EIC: Full fetch complete (35688 records). [2025-09-18T18:44:14.848192] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-18T18:44:14.924772] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-18T18:44:15.235037] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-09-18T18:44:15.235195] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-09-18T18:44:15.235904] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-09-18T18:44:15.236008] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-09-18T18:44:15.237103] [DEBUG] [LOCAL ] EIC: Trimmed 35688 records to 24772 (keeping 200 days of data) [2025-09-18T18:44:15.394576] [DEBUG] [LOCAL ] EIC: Primary data saved (24772 records). [2025-09-18T18:44:15.394744] [INFO ] [MAIN ] EIC: Full history saved. [2025-09-18T18:44:15.394861] [INFO ] [MAIN ] Update Progress: 716/2372 symbols completed. EIC took 48.5s. Estimated remaining: 4h 0m 60s. Rate: 6.9 symbols/min [2025-09-18T18:44:15.602550] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:44:15.653406] [DEBUG] [LOCAL ] EL: Loaded 53462 existing records from primary storage. [2025-09-18T18:44:15.653552] [INFO ] [MAIN ] EL: Loaded 53462 existing records. [2025-09-18T18:44:15.727779] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-18T18:44:15.841241] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:44:15.841596] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-18T18:44:15.841826] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-18T18:44:15.850959] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-18T18:44:15.851630] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-18T18:44:15.851987] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-18T18:44:16.242707] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:44:16.237091] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-18T18:44:16.278285] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-18T18:44:16.519558] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-18T18:44:17.319582] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-11. [2025-09-18T18:44:18.011940] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-18T18:44:18.119557] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-18T18:44:18.605108] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-18T18:44:18.919560] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-18T18:44:19.440203] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-11 (2.12 seconds). [2025-09-18T18:44:19.719585] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-18T18:44:20.402578] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-18T18:44:20.519565] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-18T18:44:20.600843] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-18T18:44:21.105244] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-18T18:44:21.319566] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-18T18:44:22.024209] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-18T18:44:22.119581] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-09-18T18:44:22.919549] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-18T18:44:23.378472] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-18T18:44:23.719595] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-18T18:44:23.723422] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-18T18:44:24.519553] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-09-18T18:44:25.319605] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-18T18:44:25.405477] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-18T18:44:25.992254] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-18T18:44:25.993831] [INFO ] [REMOTE ] EICC: Full fetch complete (7754 records). [2025-09-18T18:44:25.993937] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-18T18:44:25.994338] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:44:25.994421] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:44:25.994464] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:44:25.994503] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-18T18:44:25.994612] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-18T18:44:25.994704] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-09-18T18:44:25.994783] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-09-18T18:44:25.994872] [INFO ] [MAIN ] Update Progress: 717/2372 symbols completed. EICC took 25.5s. Estimated remaining: 4h 0m 55s. Rate: 6.9 symbols/min [2025-09-18T18:44:26.119585] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-18T18:44:26.322375] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-18T18:44:26.843531] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-18T18:44:26.919504] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-18T18:44:27.719550] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-18T18:44:27.989568] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-18T18:44:28.519550] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-18T18:44:29.319530] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-18T18:44:29.384260] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-18T18:44:29.443307] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-18T18:44:30.119580] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-18T18:44:30.919618] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-18T18:44:31.304375] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-18T18:44:31.692197] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T18:44:31.716084] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-18T18:44:31.720342] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-18T18:44:32.519557] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-18T18:44:33.319585] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-18T18:44:33.574010] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-18T18:44:33.624544] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-18T18:44:34.119597] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-18T18:44:34.910451] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T18:44:34.920866] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-18T18:44:35.043706] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-18T18:44:35.047007] [INFO ] [REMOTE ] EIG: Full fetch complete (26785 records). [2025-09-18T18:44:35.047084] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-18T18:44:35.477578] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-18T18:44:35.477735] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-18T18:44:35.478668] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-18T18:44:35.478741] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-18T18:44:35.479510] [DEBUG] [LOCAL ] EIG: Trimmed 26785 records to 20425 (keeping 200 days of data) [2025-09-18T18:44:35.612615] [DEBUG] [LOCAL ] EIG: Primary data saved (20425 records). [2025-09-18T18:44:35.612772] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-18T18:44:35.612903] [INFO ] [MAIN ] Update Progress: 718/2372 symbols completed. EIG took 33.6s. Estimated remaining: 4h 0m 49s. Rate: 6.9 symbols/min [2025-09-18T18:44:35.719571] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-18T18:44:36.949215] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-18T18:44:36.961212] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-18T18:44:37.467232] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-18T18:44:37.478862] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-18T18:44:38.578516] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-18T18:44:38.591475] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-18T18:44:39.580683] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-18T18:44:39.592563] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-18T18:44:40.888313] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-18T18:44:40.897225] [INFO ] [REMOTE ] EIX: Full fetch complete (76774 records). [2025-09-18T18:44:40.897390] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-18T18:44:41.307787] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-09-18T18:44:41.307928] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-09-18T18:44:41.308799] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-09-18T18:44:41.308947] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-09-18T18:44:41.312186] [DEBUG] [LOCAL ] EIX: Trimmed 76774 records to 53743 (keeping 200 days of data) [2025-09-18T18:44:41.532957] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-18T18:44:41.580342] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-18T18:44:41.698253] [DEBUG] [LOCAL ] EIX: Primary data saved (53743 records). [2025-09-18T18:44:41.698396] [INFO ] [MAIN ] EIX: Full history saved. [2025-09-18T18:44:41.700368] [INFO ] [MAIN ] Update Progress: 719/2372 symbols completed. EIX took 36.6s. Estimated remaining: 4h 0m 34s. Rate: 6.9 symbols/min [2025-09-18T18:44:43.434174] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-18T18:44:43.446580] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-18T18:44:45.629063] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-18T18:44:45.641122] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-18T18:44:47.574106] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-18T18:44:47.582271] [INFO ] [REMOTE ] EL: Full fetch complete (77293 records). [2025-09-18T18:44:47.582418] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-18T18:44:47.989640] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-09-18T18:44:47.989752] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-09-18T18:44:47.990541] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-09-18T18:44:47.990585] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-09-18T18:44:47.992047] [DEBUG] [LOCAL ] EL: Trimmed 77293 records to 53826 (keeping 200 days of data) [2025-09-18T18:44:48.327127] [DEBUG] [LOCAL ] EL: Primary data saved (53826 records). [2025-09-18T18:44:48.327293] [INFO ] [MAIN ] EL: Full history saved. [2025-09-18T18:44:48.327413] [INFO ] [MAIN ] Update Progress: 720/2372 symbols completed. EL took 32.9s. Estimated remaining: 4h 0m 20s. Rate: 6.9 symbols/min [2025-09-18T18:44:48.945784] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:44:48.913857] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:44:49.000879] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:44:49.036799] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:44:49.037270] [DEBUG] [LOCAL ] ELC: No existing data file found in primary storage. [2025-09-18T18:44:49.037338] [WARN ] [MAIN ] ELC: No existing data found, performing full refresh instead. [2025-09-18T18:44:49.038315] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-18T18:44:49.038509] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-18T18:44:49.038570] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-09-18T18:44:49.038618] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-18T18:44:49.380535] [DEBUG] [LOCAL ] ELME: Loaded 39237 existing records from primary storage. [2025-09-18T18:44:49.420017] [INFO ] [MAIN ] ELME: Loaded 39237 existing records. [2025-09-18T18:44:49.455575] [DEBUG] [LOCAL ] ELF: Loaded 52337 existing records from primary storage. [2025-09-18T18:44:49.486207] [DEBUG] [LOCAL ] ELAN: Loaded 53180 existing records from primary storage. [2025-09-18T18:44:49.505361] [INFO ] [MAIN ] ELAN: Loaded 53180 existing records. [2025-09-18T18:44:49.510672] [INFO ] [MAIN ] ELF: Loaded 52337 existing records. [2025-09-18T18:44:49.681249] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:44:49.766120] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-11. [2025-09-18T18:44:49.927440] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:44:49.969386] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-18T18:44:50.041498] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-18T18:44:50.058172] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:44:50.089504] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-09-18T18:44:50.083802] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-18T18:44:50.096510] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-18T18:44:50.096398] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:44:50.089931] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-18T18:44:50.102002] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-18T18:44:50.135414] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-18T18:44:50.153254] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-18T18:44:50.176837] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-18T18:44:50.255354] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-18T18:44:50.282209] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-18T18:44:50.813583] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-18T18:44:50.884033] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-09-18T18:44:51.109389] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:44:51.151419] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:44:51.167096] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-11. [2025-09-18T18:44:51.199780] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-11. [2025-09-18T18:44:51.222381] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:44:51.222786] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-11. [2025-09-18T18:44:51.462096] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-18T18:44:51.463842] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-09-18T18:44:52.068768] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-18T18:44:52.070296] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-18T18:44:52.479427] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-18T18:44:52.481046] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-18T18:44:52.504478] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-18T18:44:52.512113] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-09-18T18:44:52.676465] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-18T18:44:52.686584] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-09-18T18:44:52.840118] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-18T18:44:52.841520] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-18T18:44:53.293261] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-11 (2.09 seconds). [2025-09-18T18:44:53.303602] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-09-18T18:44:53.369915] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-18T18:44:53.371525] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-18T18:44:53.513286] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-18T18:44:53.521487] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-09-18T18:44:53.882093] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-18T18:44:53.894451] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-18T18:44:53.915213] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T18:44:54.119608] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-09-18T18:44:54.461482] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-18T18:44:54.713195] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-18T18:44:54.856013] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-18T18:44:54.919498] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-09-18T18:44:55.411539] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-18T18:44:55.719610] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-18T18:44:56.502397] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T18:44:56.519486] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-18T18:44:56.739845] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-18T18:44:57.319518] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-18T18:44:58.119528] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-18T18:44:58.554785] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-18T18:44:58.628574] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-18T18:44:58.919513] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-18T18:44:59.428616] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-18T18:44:59.719533] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-18T18:45:00.519602] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-18T18:45:01.046946] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-18T18:45:01.308404] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T18:45:01.319850] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-18T18:45:01.922970] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T18:45:02.119513] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-18T18:45:02.345056] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-18T18:45:02.919560] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-18T18:45:03.719603] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-18T18:45:04.401111] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-18T18:45:04.519578] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-18T18:45:05.100513] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.98 seconds). [2025-09-18T18:45:05.136971] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-18T18:45:05.272027] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-18T18:45:05.273466] [INFO ] [REMOTE ] ELC: Full fetch complete (5188 records). [2025-09-18T18:45:05.273552] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-18T18:45:05.327896] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-18T18:45:05.647310] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-09-18T18:45:05.647388] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-09-18T18:45:05.647543] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-09-18T18:45:05.647581] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-09-18T18:45:05.648217] [DEBUG] [LOCAL ] ELC: Trimmed 5188 records to 3546 (keeping 200 days of data) [2025-09-18T18:45:05.670856] [DEBUG] [LOCAL ] ELC: Primary data saved (3546 records). [2025-09-18T18:45:05.670938] [INFO ] [MAIN ] ELC: Full history saved. [2025-09-18T18:45:05.671053] [INFO ] [MAIN ] Update Progress: 721/2372 symbols completed. ELC took 17.3s. Estimated remaining: 4h 0m 31s. Rate: 6.9 symbols/min [2025-09-18T18:45:05.840771] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:45:05.872130] [DEBUG] [LOCAL ] ELP: Loaded 26024 existing records from primary storage. [2025-09-18T18:45:05.872290] [INFO ] [MAIN ] ELP: Loaded 26024 existing records. [2025-09-18T18:45:06.049559] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:45:06.049832] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-18T18:45:06.049882] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-18T18:45:06.050717] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-09-18T18:45:06.050780] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-18T18:45:06.126758] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-18T18:45:06.411782] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:45:06.919562] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-11. [2025-09-18T18:45:07.331736] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-18T18:45:07.719532] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-18T18:45:07.848048] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-18T18:45:08.159908] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-18T18:45:08.519546] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-18T18:45:09.319618] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-09-18T18:45:09.603210] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-18T18:45:09.920625] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-18T18:45:10.119558] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-18T18:45:10.210392] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-18T18:45:10.919552] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-09-18T18:45:11.719507] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-18T18:45:11.963372] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-18T18:45:12.124126] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-18T18:45:12.519562] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-18T18:45:13.102802] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T18:45:13.319614] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-18T18:45:14.119572] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-18T18:45:14.663256] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T18:45:14.778743] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-18T18:45:14.919556] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-18T18:45:15.719519] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-18T18:45:15.826689] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-18T18:45:16.090506] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T18:45:16.519581] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-18T18:45:17.319591] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-18T18:45:18.114027] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-18T18:45:18.119612] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-18T18:45:18.415543] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-09-18T18:45:18.425207] [INFO ] [REMOTE ] ELF: Full fetch complete (75284 records). [2025-09-18T18:45:18.425371] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-18T18:45:18.840952] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-18T18:45:18.841048] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-18T18:45:18.841869] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-18T18:45:18.841937] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-18T18:45:18.843482] [DEBUG] [LOCAL ] ELF: Trimmed 75284 records to 52723 (keeping 200 days of data) [2025-09-18T18:45:18.930158] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-18T18:45:19.165507] [DEBUG] [LOCAL ] ELF: Primary data saved (52723 records). [2025-09-18T18:45:19.165693] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-18T18:45:19.165826] [INFO ] [MAIN ] Update Progress: 722/2372 symbols completed. ELF took 30.8s. Estimated remaining: 4h 0m 33s. Rate: 6.9 symbols/min [2025-09-18T18:45:19.375947] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:45:19.376209] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-18T18:45:19.376265] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-18T18:45:19.376447] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-18T18:45:19.376490] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-18T18:45:19.376533] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-18T18:45:19.376565] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-18T18:45:19.765236] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:45:19.766220] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-11. [2025-09-18T18:45:20.083675] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-09-18T18:45:20.142045] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-18T18:45:20.162604] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-11 (0.40 seconds). [2025-09-18T18:45:20.505814] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-18T18:45:20.519705] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-18T18:45:21.319592] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-18T18:45:22.119549] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-09-18T18:45:22.246978] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-18T18:45:22.295935] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-18T18:45:22.306222] [INFO ] [REMOTE ] ELAN: Full fetch complete (76679 records). [2025-09-18T18:45:22.306402] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-18T18:45:22.486956] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-18T18:45:22.706481] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-18T18:45:22.706580] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-18T18:45:22.707498] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-18T18:45:22.707577] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-18T18:45:22.709316] [DEBUG] [LOCAL ] ELAN: Trimmed 76679 records to 53570 (keeping 200 days of data) [2025-09-18T18:45:22.923192] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-09-18T18:45:23.039000] [DEBUG] [LOCAL ] ELAN: Primary data saved (53570 records). [2025-09-18T18:45:23.039158] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-18T18:45:23.039261] [INFO ] [MAIN ] Update Progress: 723/2372 symbols completed. ELAN took 34.7s. Estimated remaining: 4h 0m 14s. Rate: 6.9 symbols/min [2025-09-18T18:45:23.209967] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:45:23.254859] [DEBUG] [LOCAL ] ELS: Loaded 49360 existing records from primary storage. [2025-09-18T18:45:23.255046] [INFO ] [MAIN ] ELS: Loaded 49360 existing records. [2025-09-18T18:45:23.433377] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:45:23.436387] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-18T18:45:23.437904] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-18T18:45:23.437969] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-18T18:45:23.439602] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-09-18T18:45:23.439859] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-18T18:45:23.724743] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-18T18:45:23.819247] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:45:24.519539] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-11. [2025-09-18T18:45:25.055212] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T18:45:25.060839] [INFO ] [REMOTE ] ELME: Full fetch complete (55269 records). [2025-09-18T18:45:25.060950] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-18T18:45:25.061594] [FATAL] [VALIDATOR ] ELME: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T18:45:25.061702] [FATAL] [MAIN ] ELME: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:45:25.061765] [WARN ] [MAIN ] ELME: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:45:25.061840] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-18T18:45:25.061908] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-09-18T18:45:25.061957] [INFO ] [LOCAL ] ELME: Starting deletion of derivative data. [2025-09-18T18:45:25.062453] [DEBUG] [LOCAL ] ELME: Deleted derivative data file. [2025-09-18T18:45:25.062552] [INFO ] [MAIN ] Update Progress: 724/2372 symbols completed. ELME took 36.7s. Estimated remaining: 3h 59m 50s. Rate: 6.9 symbols/min [2025-09-18T18:45:25.240501] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:45:25.299163] [DEBUG] [LOCAL ] ELV: Loaded 50472 existing records from primary storage. [2025-09-18T18:45:25.299335] [INFO ] [MAIN ] ELV: Loaded 50472 existing records. [2025-09-18T18:45:25.324695] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-18T18:45:25.492186] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:45:25.492472] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-18T18:45:25.492530] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-18T18:45:25.494346] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-09-18T18:45:25.494408] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-18T18:45:25.865046] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:45:26.119548] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-18T18:45:26.270200] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-18T18:45:26.403304] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-18T18:45:26.463131] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-18T18:45:26.919547] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-18T18:45:27.191354] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-18T18:45:27.719537] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-18T18:45:28.519553] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-18T18:45:28.976681] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-18T18:45:29.017163] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T18:45:29.319543] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-18T18:45:29.831039] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-18T18:45:30.119539] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-18T18:45:30.919548] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-09-18T18:45:31.272501] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-18T18:45:31.719549] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-18T18:45:32.190937] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-18T18:45:32.519542] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-18T18:45:32.854943] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T18:45:32.934484] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-18T18:45:33.319548] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-11. [2025-09-18T18:45:34.119541] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-18T18:45:34.914129] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-18T18:45:34.919063] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-18T18:45:34.929007] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-18T18:45:34.931749] [INFO ] [REMOTE ] ELP: Full fetch complete (37726 records). [2025-09-18T18:45:34.931989] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-18T18:45:35.271357] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-18T18:45:35.329073] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-09-18T18:45:35.329162] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-09-18T18:45:35.329826] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-09-18T18:45:35.329903] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-09-18T18:45:35.331008] [DEBUG] [LOCAL ] ELP: Trimmed 37726 records to 26172 (keeping 200 days of data) [2025-09-18T18:45:35.486637] [DEBUG] [LOCAL ] ELP: Primary data saved (26172 records). [2025-09-18T18:45:35.486808] [INFO ] [MAIN ] ELP: Full history saved. [2025-09-18T18:45:35.486900] [INFO ] [MAIN ] Update Progress: 725/2372 symbols completed. ELP took 29.8s. Estimated remaining: 3h 59m 45s. Rate: 6.9 symbols/min [2025-09-18T18:45:35.666609] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:45:35.666814] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-18T18:45:35.666858] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-18T18:45:35.667001] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-18T18:45:35.667044] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-18T18:45:35.667084] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-18T18:45:35.667116] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-18T18:45:35.728152] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-09-18T18:45:36.052822] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:45:36.519550] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-09-18T18:45:37.319563] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-11. [2025-09-18T18:45:37.436803] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-18T18:45:37.488368] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:45:37.488843] [WARN ] [REMOTE ] EMA: No data returned for month 2024-11 [2025-09-18T18:45:38.119554] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-09-18T18:45:38.265082] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-18T18:45:38.919602] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-18T18:45:39.170432] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-09-18T18:45:39.719592] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-18T18:45:39.790743] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-18T18:45:40.519580] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-18T18:45:40.934682] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-18T18:45:40.935596] [INFO ] [REMOTE ] ELPC: Full fetch complete (1505 records). [2025-09-18T18:45:40.935692] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-18T18:45:41.130092] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-18T18:45:41.152969] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:45:41.153139] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:45:41.153202] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-18T18:45:41.154052] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-18T18:45:41.154970] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-18T18:45:41.163339] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-18T18:45:41.164135] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-18T18:45:41.164615] [INFO ] [MAIN ] Update Progress: 726/2372 symbols completed. ELPC took 22.0s. Estimated remaining: 3h 59m 29s. Rate: 6.9 symbols/min [2025-09-18T18:45:41.331832] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-18T18:45:41.335253] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:45:41.336223] [DEBUG] [LOCAL ] EMD: No existing data file found in primary storage. [2025-09-18T18:45:41.336268] [WARN ] [MAIN ] EMD: No existing data found, performing full refresh instead. [2025-09-18T18:45:41.336405] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-18T18:45:41.336449] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-18T18:45:41.336492] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-09-18T18:45:41.336524] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-18T18:45:41.703589] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:45:42.119555] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-09-18T18:45:42.338005] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:45:42.338354] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-09-18T18:45:42.919551] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-09-18T18:45:43.170290] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:45:43.170119] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-18T18:45:43.180245] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-09-18T18:45:43.719593] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-18T18:45:44.519563] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-11. [2025-09-18T18:45:45.319586] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-02. [2025-09-18T18:45:45.467851] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-18T18:45:45.528509] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:45:45.530041] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T18:45:45.530123] [WARN ] [REMOTE ] EMA: No data returned for month 2025-02 [2025-09-18T18:45:46.119557] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-18T18:45:46.919577] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-09-18T18:45:47.622071] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-18T18:45:47.719527] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-03. [2025-09-18T18:45:48.009372] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:45:48.009734] [WARN ] [REMOTE ] EMA: No data returned for month 2025-03 [2025-09-18T18:45:48.028760] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T18:45:48.519556] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-04. [2025-09-18T18:45:48.720308] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T18:45:48.720632] [WARN ] [REMOTE ] EMA: No data returned for month 2025-04 [2025-09-18T18:45:49.319574] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-05. [2025-09-18T18:45:49.735164] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-18T18:45:50.119562] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-18T18:45:50.919570] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-18T18:45:51.536718] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-18T18:45:51.719536] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-09-18T18:45:52.519549] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-06. [2025-09-18T18:45:52.792907] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-18T18:45:52.834042] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-18T18:45:53.104532] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-18T18:45:53.319572] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-18T18:45:54.119564] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-07. [2025-09-18T18:45:54.864109] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T18:45:54.915133] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-18T18:45:54.919482] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-08. [2025-09-18T18:45:55.719548] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-18T18:45:55.884701] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-18T18:45:56.519541] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-09. [2025-09-18T18:45:56.934385] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-18T18:45:57.179527] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-18T18:45:57.182313] [INFO ] [REMOTE ] EMA: Full fetch complete (7587 records). [2025-09-18T18:45:57.182400] [DEBUG] [VALIDATOR ] EMA: Validating primary data. [2025-09-18T18:45:57.330483] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-18T18:45:57.376922] [WARN ] [VALIDATOR ] EMA: Validation failed - insufficient historical data. Have 79 unique days, need 200 days [2025-09-18T18:45:57.377289] [FATAL] [MAIN ] EMA: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:45:57.377361] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:45:57.377436] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-18T18:45:57.377567] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-18T18:45:57.377619] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-18T18:45:57.377708] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-18T18:45:57.377784] [INFO ] [MAIN ] Update Progress: 727/2372 symbols completed. EMA took 21.9s. Estimated remaining: 3h 59m 37s. Rate: 6.9 symbols/min [2025-09-18T18:45:57.562745] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:45:57.608806] [DEBUG] [LOCAL ] EME: Loaded 31825 existing records from primary storage. [2025-09-18T18:45:57.608967] [INFO ] [MAIN ] EME: Loaded 31825 existing records. [2025-09-18T18:45:57.801659] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:45:57.801937] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-18T18:45:57.801986] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-18T18:45:57.802927] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-09-18T18:45:57.802987] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-18T18:45:58.135166] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-18T18:45:58.176780] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:45:58.873935] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-18T18:45:58.919596] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-18T18:45:59.099790] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-18T18:45:59.719572] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-11. [2025-09-18T18:46:00.519540] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-18T18:46:00.606791] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-18T18:46:01.184348] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-18T18:46:01.319573] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-09-18T18:46:02.117366] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-18T18:46:02.129061] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-18T18:46:02.788074] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-18T18:46:02.919536] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-18T18:46:03.122682] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-18T18:46:03.719560] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-18T18:46:04.492455] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-18T18:46:04.500331] [INFO ] [REMOTE ] ELS: Full fetch complete (70261 records). [2025-09-18T18:46:04.500477] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-18T18:46:04.524688] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-09-18T18:46:04.909045] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-09-18T18:46:04.909171] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-09-18T18:46:04.910324] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-09-18T18:46:04.910409] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-09-18T18:46:04.912517] [DEBUG] [LOCAL ] ELS: Trimmed 70261 records to 49743 (keeping 200 days of data) [2025-09-18T18:46:05.227548] [DEBUG] [LOCAL ] ELS: Primary data saved (49743 records). [2025-09-18T18:46:05.227787] [INFO ] [MAIN ] ELS: Full history saved. [2025-09-18T18:46:05.228023] [INFO ] [MAIN ] Update Progress: 728/2372 symbols completed. ELS took 42.2s. Estimated remaining: 3h 59m 27s. Rate: 6.9 symbols/min [2025-09-18T18:46:05.319738] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-18T18:46:05.404305] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:46:05.410080] [DEBUG] [LOCAL ] EMF: Loaded 3676 existing records from primary storage. [2025-09-18T18:46:05.410179] [INFO ] [MAIN ] EMF: Loaded 3676 existing records. [2025-09-18T18:46:05.618404] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-18T18:46:05.623884] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:46:05.624250] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-18T18:46:05.624304] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-18T18:46:05.624617] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-09-18T18:46:05.624705] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-18T18:46:06.002108] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:46:06.119501] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-11. [2025-09-18T18:46:06.152381] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-18T18:46:06.176560] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-18T18:46:06.740370] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-18T18:46:06.919534] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-18T18:46:07.719593] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-09-18T18:46:08.323385] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T18:46:08.484250] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-18T18:46:08.519516] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-09-18T18:46:09.056246] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-18T18:46:09.319588] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-18T18:46:10.119548] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-18T18:46:10.640039] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T18:46:10.794163] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-18T18:46:10.919576] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-18T18:46:11.390542] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-18T18:46:11.719606] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-18T18:46:12.412604] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-18T18:46:12.519601] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-18T18:46:13.319591] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-18T18:46:13.556991] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-18T18:46:14.119549] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-18T18:46:14.660011] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-18T18:46:14.919552] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-18T18:46:15.719589] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-18T18:46:15.891796] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-18T18:46:16.022866] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-18T18:46:16.086982] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-18T18:46:16.519557] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-18T18:46:17.319553] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-18T18:46:17.739072] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-18T18:46:18.119577] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-18T18:46:18.236934] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-18T18:46:18.919553] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-18T18:46:19.662273] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-18T18:46:19.719605] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-18T18:46:20.519556] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-18T18:46:20.561023] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-18T18:46:20.569743] [INFO ] [REMOTE ] ELV: Full fetch complete (73070 records). [2025-09-18T18:46:20.569897] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-18T18:46:21.001971] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-09-18T18:46:21.002102] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-09-18T18:46:21.003186] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-09-18T18:46:21.003263] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-09-18T18:46:21.005108] [DEBUG] [LOCAL ] ELV: Trimmed 73070 records to 50849 (keeping 200 days of data) [2025-09-18T18:46:21.320716] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-18T18:46:21.347024] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-18T18:46:21.370277] [DEBUG] [LOCAL ] ELV: Primary data saved (50849 records). [2025-09-18T18:46:21.370410] [INFO ] [MAIN ] ELV: Full history saved. [2025-09-18T18:46:21.370499] [INFO ] [MAIN ] Update Progress: 729/2372 symbols completed. ELV took 56.3s. Estimated remaining: 3h 59m 34s. Rate: 6.9 symbols/min [2025-09-18T18:46:21.555486] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:46:21.572136] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-18T18:46:21.621315] [DEBUG] [LOCAL ] EMN: Loaded 50259 existing records from primary storage. [2025-09-18T18:46:21.621467] [INFO ] [MAIN ] EMN: Loaded 50259 existing records. [2025-09-18T18:46:21.727309] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-18T18:46:21.807514] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:46:21.807802] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-18T18:46:21.807853] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-18T18:46:21.809137] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-18T18:46:21.809385] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-18T18:46:22.126182] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-18T18:46:22.170947] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:46:22.919577] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-18T18:46:23.190295] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-18T18:46:23.194714] [INFO ] [REMOTE ] EMD: Full fetch complete (32268 records). [2025-09-18T18:46:23.194885] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-18T18:46:23.621405] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-09-18T18:46:23.621508] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-09-18T18:46:23.622090] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-09-18T18:46:23.622182] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-09-18T18:46:23.623317] [DEBUG] [LOCAL ] EMD: Trimmed 32268 records to 21570 (keeping 200 days of data) [2025-09-18T18:46:23.720524] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-18T18:46:23.760587] [DEBUG] [LOCAL ] EMD: Primary data saved (21570 records). [2025-09-18T18:46:23.760758] [INFO ] [MAIN ] EMD: Full history saved. [2025-09-18T18:46:23.760860] [INFO ] [MAIN ] Update Progress: 730/2372 symbols completed. EMD took 42.6s. Estimated remaining: 3h 59m 11s. Rate: 6.9 symbols/min [2025-09-18T18:46:23.939354] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:46:23.953189] [DEBUG] [LOCAL ] EMO: Loaded 12281 existing records from primary storage. [2025-09-18T18:46:23.953351] [INFO ] [MAIN ] EMO: Loaded 12281 existing records. [2025-09-18T18:46:24.138776] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:46:24.139155] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-18T18:46:24.139235] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-18T18:46:24.139889] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-09-18T18:46:24.139993] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-18T18:46:24.249696] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-18T18:46:24.365191] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T18:46:24.521950] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-18T18:46:24.551376] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:46:25.319555] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-11. [2025-09-18T18:46:25.519164] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-18T18:46:25.828314] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-18T18:46:26.119553] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-09-18T18:46:26.919554] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-11. [2025-09-18T18:46:26.964683] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-18T18:46:27.719549] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-18T18:46:28.297452] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-18T18:46:28.519562] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-09-18T18:46:29.092677] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-18T18:46:29.193995] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-18T18:46:29.199473] [INFO ] [REMOTE ] EME: Full fetch complete (46652 records). [2025-09-18T18:46:29.199586] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-18T18:46:29.324626] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-09-18T18:46:29.600946] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-09-18T18:46:29.601041] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-09-18T18:46:29.601627] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-09-18T18:46:29.601719] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-09-18T18:46:29.602969] [DEBUG] [LOCAL ] EME: Trimmed 46652 records to 32125 (keeping 200 days of data) [2025-09-18T18:46:29.804945] [DEBUG] [LOCAL ] EME: Primary data saved (32125 records). [2025-09-18T18:46:29.805081] [INFO ] [MAIN ] EME: Full history saved. [2025-09-18T18:46:29.805163] [INFO ] [MAIN ] Update Progress: 731/2372 symbols completed. EME took 32.4s. Estimated remaining: 3h 58m 57s. Rate: 6.9 symbols/min [2025-09-18T18:46:29.980671] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:46:29.985618] [DEBUG] [LOCAL ] EMP: Loaded 3004 existing records from primary storage. [2025-09-18T18:46:29.985743] [INFO ] [MAIN ] EMP: Loaded 3004 existing records. [2025-09-18T18:46:30.126377] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-18T18:46:30.170749] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:46:30.170990] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-18T18:46:30.171039] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-18T18:46:30.171250] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-09-18T18:46:30.171309] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-18T18:46:30.534260] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:46:30.635934] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-18T18:46:30.919553] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-18T18:46:30.993155] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-18T18:46:31.518593] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-18T18:46:31.520284] [INFO ] [REMOTE ] EMF: Full fetch complete (7412 records). [2025-09-18T18:46:31.520412] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-18T18:46:31.726227] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-11. [2025-09-18T18:46:32.054596] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-09-18T18:46:32.054805] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-09-18T18:46:32.055284] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-09-18T18:46:32.055371] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-09-18T18:46:32.056368] [DEBUG] [LOCAL ] EMF: Trimmed 7412 records to 3712 (keeping 200 days of data) [2025-09-18T18:46:32.089420] [DEBUG] [LOCAL ] EMF: Primary data saved (3712 records). [2025-09-18T18:46:32.089588] [INFO ] [MAIN ] EMF: Full history saved. [2025-09-18T18:46:32.089715] [INFO ] [MAIN ] Update Progress: 732/2372 symbols completed. EMF took 26.9s. Estimated remaining: 3h 58m 33s. Rate: 6.9 symbols/min [2025-09-18T18:46:32.224120] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-18T18:46:32.310152] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:46:32.381564] [DEBUG] [LOCAL ] EMR: Loaded 53262 existing records from primary storage. [2025-09-18T18:46:32.381777] [INFO ] [MAIN ] EMR: Loaded 53262 existing records. [2025-09-18T18:46:32.524678] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-09-18T18:46:32.588253] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:46:32.588582] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-18T18:46:32.588678] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-18T18:46:32.590054] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-09-18T18:46:32.590122] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-18T18:46:33.039728] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:46:33.190942] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-18T18:46:33.319548] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-09-18T18:46:33.810439] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-18T18:46:34.119552] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-18T18:46:34.875101] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-18T18:46:34.919512] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-11. [2025-09-18T18:46:35.719537] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-18T18:46:36.504388] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-18T18:46:36.519491] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-09-18T18:46:36.544049] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-18T18:46:37.319546] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-18T18:46:37.971345] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-18T18:46:38.119540] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-18T18:46:38.251600] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-18T18:46:38.675602] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-18T18:46:38.919598] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-09-18T18:46:39.719561] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-09-18T18:46:40.295458] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T18:46:40.519551] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-18T18:46:41.070820] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-18T18:46:41.319563] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-18T18:46:41.503407] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-18T18:46:42.119596] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-18T18:46:42.613743] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-18T18:46:42.919570] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-18T18:46:43.719568] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-18T18:46:43.807110] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-18T18:46:44.206132] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-18T18:46:44.293138] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-18T18:46:44.519554] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-18T18:46:45.319532] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-18T18:46:45.409250] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-18T18:46:46.119602] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-18T18:46:46.919585] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-18T18:46:47.068992] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-18T18:46:47.088179] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-18T18:46:47.091198] [INFO ] [REMOTE ] EMO: Full fetch complete (17190 records). [2025-09-18T18:46:47.091271] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-18T18:46:47.453276] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-09-18T18:46:47.453360] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-09-18T18:46:47.453773] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-09-18T18:46:47.453848] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-09-18T18:46:47.454407] [DEBUG] [LOCAL ] EMO: Trimmed 17190 records to 12366 (keeping 200 days of data) [2025-09-18T18:46:47.527959] [DEBUG] [LOCAL ] EMO: Primary data saved (12366 records). [2025-09-18T18:46:47.528085] [INFO ] [MAIN ] EMO: Full history saved. [2025-09-18T18:46:47.528197] [INFO ] [MAIN ] Update Progress: 733/2372 symbols completed. EMO took 23.8s. Estimated remaining: 3h 58m 40s. Rate: 6.9 symbols/min [2025-09-18T18:46:47.701722] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:46:47.719583] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-18T18:46:47.759045] [DEBUG] [LOCAL ] ENB: Loaded 53527 existing records from primary storage. [2025-09-18T18:46:47.759188] [INFO ] [MAIN ] ENB: Loaded 53527 existing records. [2025-09-18T18:46:47.937525] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:46:47.937784] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-18T18:46:47.937848] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-18T18:46:47.939032] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-18T18:46:47.939093] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-18T18:46:48.299266] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:46:48.331504] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-18T18:46:48.519547] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-18T18:46:49.252589] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-18T18:46:49.319551] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-18T18:46:49.968157] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T18:46:50.119554] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-18T18:46:50.575592] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-18T18:46:50.919520] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-18T18:46:51.022796] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-18T18:46:51.719538] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-18T18:46:52.361442] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T18:46:52.519560] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-18T18:46:53.319581] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-18T18:46:53.360250] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-18T18:46:53.680988] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-18T18:46:53.868711] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-18T18:46:54.119554] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-18T18:46:54.919545] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-18T18:46:55.299069] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-18T18:46:55.725811] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-18T18:46:55.746763] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-18T18:46:56.519574] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-11. [2025-09-18T18:46:57.261502] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-18T18:46:57.319524] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-18T18:46:58.119613] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-18T18:46:58.429880] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-18T18:46:58.869802] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-18T18:46:58.919501] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-18T18:46:59.456022] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-18T18:46:59.463012] [INFO ] [REMOTE ] EMN: Full fetch complete (71704 records). [2025-09-18T18:46:59.463129] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-18T18:46:59.724660] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-09-18T18:46:59.889387] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-18T18:46:59.889504] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-18T18:46:59.890392] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-18T18:46:59.890461] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-18T18:46:59.892069] [DEBUG] [LOCAL ] EMN: Trimmed 71704 records to 50622 (keeping 200 days of data) [2025-09-18T18:47:00.219544] [DEBUG] [LOCAL ] EMN: Primary data saved (50622 records). [2025-09-18T18:47:00.219729] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-18T18:47:00.219836] [INFO ] [MAIN ] Update Progress: 734/2372 symbols completed. EMN took 38.8s. Estimated remaining: 3h 58m 40s. Rate: 6.9 symbols/min [2025-09-18T18:47:00.409360] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:47:00.414622] [DEBUG] [LOCAL ] ENFY: Loaded 3066 existing records from primary storage. [2025-09-18T18:47:00.414757] [INFO ] [MAIN ] ENFY: Loaded 3066 existing records. [2025-09-18T18:47:00.521170] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-18T18:47:00.604516] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:47:00.604800] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-18T18:47:00.604856] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-18T18:47:00.605182] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-09-18T18:47:00.605244] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-18T18:47:00.999556] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:47:00.994088] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-18T18:47:01.023387] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-18T18:47:01.032078] [INFO ] [REMOTE ] EMR: Full fetch complete (76951 records). [2025-09-18T18:47:01.032248] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-18T18:47:01.323081] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-18T18:47:01.448524] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-09-18T18:47:01.449340] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-09-18T18:47:01.450335] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-09-18T18:47:01.450441] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-09-18T18:47:01.468795] [DEBUG] [LOCAL ] EMR: Trimmed 76951 records to 53650 (keeping 200 days of data) [2025-09-18T18:47:01.486147] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-18T18:47:01.843154] [DEBUG] [LOCAL ] EMR: Primary data saved (53650 records). [2025-09-18T18:47:01.843301] [INFO ] [MAIN ] EMR: Full history saved. [2025-09-18T18:47:01.843400] [INFO ] [MAIN ] Update Progress: 735/2372 symbols completed. EMR took 29.8s. Estimated remaining: 3h 58m 15s. Rate: 6.9 symbols/min [2025-09-18T18:47:01.955757] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-18T18:47:02.029009] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:47:02.076378] [DEBUG] [LOCAL ] ENIC: Loaded 36947 existing records from primary storage. [2025-09-18T18:47:02.076531] [INFO ] [MAIN ] ENIC: Loaded 36947 existing records. [2025-09-18T18:47:02.124792] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-09-18T18:47:02.295064] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:47:02.295325] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-18T18:47:02.295373] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-18T18:47:02.296224] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-09-18T18:47:02.296285] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-18T18:47:02.652522] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:47:02.919542] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-11. [2025-09-18T18:47:03.719545] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-18T18:47:03.912205] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-18T18:47:03.969520] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-18T18:47:04.139185] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-18T18:47:04.519552] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-18T18:47:04.971444] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-18T18:47:05.319583] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-18T18:47:05.817159] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-18T18:47:05.818278] [INFO ] [REMOTE ] EMP: Full fetch complete (4292 records). [2025-09-18T18:47:05.818350] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-18T18:47:06.124679] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-18T18:47:06.190134] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-09-18T18:47:06.190215] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-09-18T18:47:06.190361] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-09-18T18:47:06.190399] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-09-18T18:47:06.190819] [DEBUG] [LOCAL ] EMP: Trimmed 4292 records to 3023 (keeping 200 days of data) [2025-09-18T18:47:06.209881] [DEBUG] [LOCAL ] EMP: Primary data saved (3023 records). [2025-09-18T18:47:06.209959] [INFO ] [MAIN ] EMP: Full history saved. [2025-09-18T18:47:06.210038] [INFO ] [MAIN ] Update Progress: 736/2372 symbols completed. EMP took 36.4s. Estimated remaining: 3h 57m 57s. Rate: 6.9 symbols/min [2025-09-18T18:47:06.387273] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:47:06.390976] [DEBUG] [LOCAL ] ENO: Loaded 2000 existing records from primary storage. [2025-09-18T18:47:06.391061] [INFO ] [MAIN ] ENO: Loaded 2000 existing records. [2025-09-18T18:47:06.572750] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:47:06.573093] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-18T18:47:06.573163] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-18T18:47:06.573446] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-09-18T18:47:06.573530] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-18T18:47:06.936860] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-11. [2025-09-18T18:47:06.942690] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:47:07.243403] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-11 (0.31 seconds). [2025-09-18T18:47:07.719616] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-11. [2025-09-18T18:47:07.996742] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-18T18:47:08.108843] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-11 (0.39 seconds). [2025-09-18T18:47:08.519554] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-18T18:47:09.319570] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-09-18T18:47:09.723749] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-18T18:47:09.982984] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T18:47:10.119532] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-18T18:47:10.919551] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-09-18T18:47:11.415561] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-18T18:47:11.711784] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-18T18:47:11.722373] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-09-18T18:47:12.322173] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-18T18:47:12.519553] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-18T18:47:12.971745] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-18T18:47:13.319548] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-18T18:47:14.119552] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-09-18T18:47:14.919512] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-18T18:47:15.052504] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-18T18:47:15.184078] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-09-18T18:47:15.277920] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-18T18:47:15.719539] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-18T18:47:16.519560] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-09-18T18:47:17.250992] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-18T18:47:17.268682] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-18T18:47:17.319506] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-18T18:47:18.119563] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-18T18:47:18.561917] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-18T18:47:18.919637] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-18T18:47:19.246234] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-18T18:47:19.250776] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-18T18:47:19.719550] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-18T18:47:20.035478] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-18T18:47:20.519593] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-18T18:47:21.319554] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-18T18:47:21.764803] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-18T18:47:21.926421] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-18T18:47:22.119582] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-18T18:47:22.919557] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-09-18T18:47:23.719544] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-18T18:47:23.947181] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-18T18:47:23.991867] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-18T18:47:24.043877] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-18T18:47:24.052854] [INFO ] [REMOTE ] ENB: Full fetch complete (77353 records). [2025-09-18T18:47:24.053007] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-18T18:47:24.491041] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-18T18:47:24.491151] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-18T18:47:24.492229] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-18T18:47:24.492313] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-18T18:47:24.494146] [DEBUG] [LOCAL ] ENB: Trimmed 77353 records to 53914 (keeping 200 days of data) [2025-09-18T18:47:24.584023] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-18T18:47:25.020549] [DEBUG] [LOCAL ] ENB: Primary data saved (53914 records). [2025-09-18T18:47:25.020887] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-18T18:47:25.023958] [INFO ] [MAIN ] Update Progress: 737/2372 symbols completed. ENB took 37.5s. Estimated remaining: 3h 58m 10s. Rate: 6.9 symbols/min [2025-09-18T18:47:25.303319] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:47:25.319696] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-18T18:47:25.362999] [DEBUG] [LOCAL ] ENOV: Loaded 45339 existing records from primary storage. [2025-09-18T18:47:25.363190] [INFO ] [MAIN ] ENOV: Loaded 45339 existing records. [2025-09-18T18:47:25.571802] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:47:25.572068] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-18T18:47:25.572120] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-18T18:47:25.573160] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-09-18T18:47:25.573235] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-18T18:47:25.898258] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-18T18:47:25.964362] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T18:47:25.992787] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:47:26.119555] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-18T18:47:26.919567] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-11. [2025-09-18T18:47:27.468326] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-18T18:47:27.719573] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-18T18:47:28.102598] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-18T18:47:28.206548] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-18T18:47:28.519563] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-18T18:47:29.319558] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-18T18:47:29.801864] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-18T18:47:30.070128] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-18T18:47:30.119489] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-18T18:47:30.919547] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-09-18T18:47:31.441930] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T18:47:31.719527] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-18T18:47:32.391979] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-18T18:47:32.519524] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-18T18:47:32.735316] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-18T18:47:32.831064] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-18T18:47:33.319543] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-09-18T18:47:34.119565] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-18T18:47:34.822733] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-18T18:47:34.852051] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-18T18:47:34.919497] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-18T18:47:35.719595] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-18T18:47:36.345171] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T18:47:36.358333] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-18T18:47:36.519494] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-18T18:47:37.319548] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-18T18:47:37.848090] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-18T18:47:38.119551] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-18T18:47:38.781222] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-18T18:47:38.919488] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-18T18:47:39.324441] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-18T18:47:39.719593] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-18T18:47:40.077245] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-18T18:47:40.112038] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-18T18:47:40.519548] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-18T18:47:41.319623] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-18T18:47:42.029634] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-18T18:47:42.030979] [INFO ] [REMOTE ] ENO: Full fetch complete (3235 records). [2025-09-18T18:47:42.031073] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-18T18:47:42.124220] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-18T18:47:42.273320] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-18T18:47:42.456494] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-09-18T18:47:42.456579] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-09-18T18:47:42.456736] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-09-18T18:47:42.456798] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-09-18T18:47:42.457149] [DEBUG] [LOCAL ] ENO: Trimmed 3235 records to 2006 (keeping 200 days of data) [2025-09-18T18:47:42.471714] [DEBUG] [LOCAL ] ENO: Primary data saved (2006 records). [2025-09-18T18:47:42.471776] [INFO ] [MAIN ] ENO: Full history saved. [2025-09-18T18:47:42.471900] [INFO ] [MAIN ] Update Progress: 738/2372 symbols completed. ENO took 36.3s. Estimated remaining: 3h 58m 21s. Rate: 6.9 symbols/min [2025-09-18T18:47:42.639257] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:47:42.706600] [DEBUG] [LOCAL ] ENR: Loaded 42554 existing records from primary storage. [2025-09-18T18:47:42.706803] [INFO ] [MAIN ] ENR: Loaded 42554 existing records. [2025-09-18T18:47:42.885695] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:47:42.886269] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-18T18:47:42.886404] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-18T18:47:42.887742] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-09-18T18:47:42.887812] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-18T18:47:42.924636] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-18T18:47:43.245607] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:47:43.596127] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-18T18:47:43.601732] [INFO ] [REMOTE ] ENIC: Full fetch complete (51092 records). [2025-09-18T18:47:43.601854] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-18T18:47:43.724586] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-11. [2025-09-18T18:47:43.990274] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-09-18T18:47:43.990361] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-09-18T18:47:43.991134] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-09-18T18:47:43.991201] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-09-18T18:47:43.992916] [DEBUG] [LOCAL ] ENIC: Trimmed 51092 records to 37105 (keeping 200 days of data) [2025-09-18T18:47:44.223687] [DEBUG] [LOCAL ] ENIC: Primary data saved (37105 records). [2025-09-18T18:47:44.223851] [INFO ] [MAIN ] ENIC: Full history saved. [2025-09-18T18:47:44.223991] [INFO ] [MAIN ] Update Progress: 739/2372 symbols completed. ENIC took 42.4s. Estimated remaining: 3h 57m 57s. Rate: 6.9 symbols/min [2025-09-18T18:47:44.398077] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:47:44.424944] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T18:47:44.465722] [DEBUG] [LOCAL ] ENS: Loaded 29302 existing records from primary storage. [2025-09-18T18:47:44.465895] [INFO ] [MAIN ] ENS: Loaded 29302 existing records. [2025-09-18T18:47:44.529405] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-18T18:47:44.649014] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:47:44.649254] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-18T18:47:44.649302] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-18T18:47:44.650191] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-09-18T18:47:44.650252] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-18T18:47:45.017466] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:47:45.040265] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-18T18:47:45.319572] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-11. [2025-09-18T18:47:46.119564] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-09-18T18:47:46.263966] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-18T18:47:46.321837] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-18T18:47:46.919557] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-18T18:47:47.165997] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T18:47:47.719534] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-18T18:47:48.220604] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-18T18:47:48.222320] [INFO ] [REMOTE ] ENFY: Full fetch complete (5681 records). [2025-09-18T18:47:48.222629] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-18T18:47:48.393270] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T18:47:48.523392] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-18T18:47:48.643680] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-09-18T18:47:48.643769] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-09-18T18:47:48.643978] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-09-18T18:47:48.644024] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-09-18T18:47:48.644555] [DEBUG] [LOCAL ] ENFY: Trimmed 5681 records to 3075 (keeping 200 days of data) [2025-09-18T18:47:48.662935] [DEBUG] [LOCAL ] ENFY: Primary data saved (3075 records). [2025-09-18T18:47:48.663054] [INFO ] [MAIN ] ENFY: Full history saved. [2025-09-18T18:47:48.663224] [INFO ] [MAIN ] Update Progress: 740/2372 symbols completed. ENFY took 48.4s. Estimated remaining: 3h 57m 38s. Rate: 6.9 symbols/min [2025-09-18T18:47:48.854341] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:47:48.888004] [DEBUG] [LOCAL ] ENVA: Loaded 25745 existing records from primary storage. [2025-09-18T18:47:48.888145] [INFO ] [MAIN ] ENVA: Loaded 25745 existing records. [2025-09-18T18:47:49.066062] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:47:49.066302] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-18T18:47:49.066351] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-18T18:47:49.067086] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-09-18T18:47:49.067147] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-18T18:47:49.326570] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-09-18T18:47:49.434161] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:47:49.935161] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-18T18:47:49.942405] [INFO ] [REMOTE ] ENOV: Full fetch complete (62877 records). [2025-09-18T18:47:49.942573] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-18T18:47:50.124834] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-09-18T18:47:50.345122] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-09-18T18:47:50.345209] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-09-18T18:47:50.345962] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-09-18T18:47:50.346028] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-09-18T18:47:50.347376] [DEBUG] [LOCAL ] ENOV: Trimmed 62877 records to 45663 (keeping 200 days of data) [2025-09-18T18:47:50.602658] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-18T18:47:50.671982] [DEBUG] [LOCAL ] ENOV: Primary data saved (45663 records). [2025-09-18T18:47:50.672159] [INFO ] [MAIN ] ENOV: Full history saved. [2025-09-18T18:47:50.673059] [INFO ] [MAIN ] Update Progress: 741/2372 symbols completed. ENOV took 25.6s. Estimated remaining: 3h 57m 15s. Rate: 6.9 symbols/min [2025-09-18T18:47:50.877318] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:47:50.893583] [DEBUG] [LOCAL ] EOD: Loaded 14181 existing records from primary storage. [2025-09-18T18:47:50.893772] [INFO ] [MAIN ] EOD: Loaded 14181 existing records. [2025-09-18T18:47:50.924827] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-18T18:47:51.076778] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:47:51.077105] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-18T18:47:51.077236] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-18T18:47:51.078056] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-18T18:47:51.078117] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-18T18:47:51.442029] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:47:51.462611] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T18:47:51.719694] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-11. [2025-09-18T18:47:52.389281] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-18T18:47:52.407821] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-18T18:47:52.519584] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-09-18T18:47:53.314836] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-18T18:47:53.319488] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-09-18T18:47:54.004036] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-18T18:47:54.119568] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-18T18:47:54.919547] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-11. [2025-09-18T18:47:54.969511] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-18T18:47:55.719543] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-18T18:47:55.773488] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-18T18:47:56.519555] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-09-18T18:47:57.124623] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-18T18:47:57.319540] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-09-18T18:47:57.585901] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-18T18:47:58.119588] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-18T18:47:58.145936] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-18T18:47:58.824242] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-18T18:47:58.919567] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-18T18:47:59.719568] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-18T18:47:59.786350] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-18T18:48:00.519556] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-18T18:48:00.825603] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-18T18:48:01.143938] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-18T18:48:01.319571] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-18T18:48:02.119547] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-09-18T18:48:02.919544] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-18T18:48:03.719569] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-18T18:48:03.754092] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-18T18:48:04.519562] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-18T18:48:05.686142] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (3.57 seconds). [2025-09-18T18:48:05.691061] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-18T18:48:06.131397] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (3.21 seconds). [2025-09-18T18:48:06.138096] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-18T18:48:06.256161] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-18T18:48:06.425775] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-18T18:48:06.698675] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T18:48:06.919554] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-18T18:48:07.522038] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-18T18:48:07.704892] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T18:48:07.719494] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-18T18:48:08.519575] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-18T18:48:09.064962] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-18T18:48:09.219284] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-18T18:48:09.222504] [INFO ] [REMOTE ] EOD: Full fetch complete (19679 records). [2025-09-18T18:48:09.222699] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-18T18:48:09.324691] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-18T18:48:09.614467] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-18T18:48:09.614569] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-18T18:48:09.615013] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-18T18:48:09.615076] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-18T18:48:09.615823] [DEBUG] [LOCAL ] EOD: Trimmed 19679 records to 14253 (keeping 200 days of data) [2025-09-18T18:48:09.698948] [DEBUG] [LOCAL ] EOD: Primary data saved (14253 records). [2025-09-18T18:48:09.699108] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-18T18:48:09.699216] [INFO ] [MAIN ] Update Progress: 742/2372 symbols completed. EOD took 19.0s. Estimated remaining: 3h 57m 29s. Rate: 6.9 symbols/min [2025-09-18T18:48:09.873821] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:48:09.929424] [DEBUG] [LOCAL ] EOG: Loaded 53342 existing records from primary storage. [2025-09-18T18:48:09.929594] [INFO ] [MAIN ] EOG: Loaded 53342 existing records. [2025-09-18T18:48:10.154155] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-18T18:48:10.160531] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:48:10.160816] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-18T18:48:10.160869] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-18T18:48:10.162274] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-18T18:48:10.162338] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-18T18:48:10.536471] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:48:10.563494] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T18:48:10.919577] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-18T18:48:11.627694] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-18T18:48:11.719537] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-18T18:48:12.051147] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T18:48:12.519545] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-18T18:48:13.216717] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T18:48:13.319511] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-18T18:48:13.473722] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-18T18:48:14.119570] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-18T18:48:14.919575] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-18T18:48:15.058024] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-18T18:48:15.719546] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-18T18:48:16.004462] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-18T18:48:16.009136] [INFO ] [REMOTE ] ENS: Full fetch complete (41668 records). [2025-09-18T18:48:16.009277] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-18T18:48:16.410852] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-09-18T18:48:16.410964] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-09-18T18:48:16.411557] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-09-18T18:48:16.411631] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-09-18T18:48:16.412788] [DEBUG] [LOCAL ] ENS: Trimmed 41668 records to 29560 (keeping 200 days of data) [2025-09-18T18:48:16.523337] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-11. [2025-09-18T18:48:16.605764] [DEBUG] [LOCAL ] ENS: Primary data saved (29560 records). [2025-09-18T18:48:16.605914] [INFO ] [MAIN ] ENS: Full history saved. [2025-09-18T18:48:16.606024] [INFO ] [MAIN ] Update Progress: 743/2372 symbols completed. ENS took 32.4s. Estimated remaining: 3h 57m 16s. Rate: 6.9 symbols/min [2025-09-18T18:48:16.775457] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:48:16.787464] [DEBUG] [LOCAL ] EOI: Loaded 10674 existing records from primary storage. [2025-09-18T18:48:16.787587] [INFO ] [MAIN ] EOI: Loaded 10674 existing records. [2025-09-18T18:48:16.973085] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:48:16.973492] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-18T18:48:16.973558] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-18T18:48:16.974062] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-18T18:48:16.974316] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-18T18:48:17.070194] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-18T18:48:17.330901] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-18T18:48:17.350718] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:48:17.804882] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-18T18:48:18.007078] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-18T18:48:18.119560] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-18T18:48:18.663253] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-18T18:48:18.919563] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-18T18:48:19.301223] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-18T18:48:19.307702] [INFO ] [REMOTE ] ENR: Full fetch complete (57813 records). [2025-09-18T18:48:19.307847] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-18T18:48:19.722241] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-11. [2025-09-18T18:48:19.723526] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-09-18T18:48:19.723769] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-09-18T18:48:19.724606] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-09-18T18:48:19.724795] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-09-18T18:48:19.726252] [DEBUG] [LOCAL ] ENR: Trimmed 57813 records to 42861 (keeping 200 days of data) [2025-09-18T18:48:19.976710] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-18T18:48:20.018663] [DEBUG] [LOCAL ] ENR: Primary data saved (42861 records). [2025-09-18T18:48:20.018811] [INFO ] [MAIN ] ENR: Full history saved. [2025-09-18T18:48:20.018906] [INFO ] [MAIN ] Update Progress: 744/2372 symbols completed. ENR took 37.5s. Estimated remaining: 3h 56m 56s. Rate: 6.9 symbols/min [2025-09-18T18:48:20.186854] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:48:20.204671] [DEBUG] [LOCAL ] EOS: Loaded 15560 existing records from primary storage. [2025-09-18T18:48:20.204811] [INFO ] [MAIN ] EOS: Loaded 15560 existing records. [2025-09-18T18:48:20.385814] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:48:20.386138] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-18T18:48:20.386219] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-18T18:48:20.386776] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-09-18T18:48:20.386840] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-18T18:48:20.524709] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-18T18:48:20.769461] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:48:20.770566] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-18T18:48:21.319539] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-11. [2025-09-18T18:48:21.467454] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-18T18:48:22.119566] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-09-18T18:48:22.279770] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-18T18:48:22.699337] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-18T18:48:22.919579] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-09-18T18:48:23.719554] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-09-18T18:48:24.519601] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-09-18T18:48:24.714279] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-18T18:48:24.744179] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-18T18:48:25.020972] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-18T18:48:25.319535] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-09-18T18:48:26.119613] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-18T18:48:26.919553] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-09-18T18:48:27.149949] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-18T18:48:27.424284] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-18T18:48:27.719583] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-18T18:48:27.767694] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-18T18:48:28.491990] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-18T18:48:28.519550] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-18T18:48:29.319546] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-18T18:48:29.942065] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T18:48:29.962987] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-18T18:48:30.119513] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-18T18:48:30.919537] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-18T18:48:31.685850] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T18:48:31.709204] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-18T18:48:31.719493] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-18T18:48:32.519534] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-18T18:48:32.748181] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-18T18:48:33.319597] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-18T18:48:34.119597] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-18T18:48:34.250803] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-18T18:48:34.287002] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-18T18:48:34.710403] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-18T18:48:34.919538] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-18T18:48:35.627563] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-18T18:48:35.719571] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-18T18:48:36.519566] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-18T18:48:36.680576] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-18T18:48:37.319541] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-18T18:48:37.587315] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-18T18:48:38.052042] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-18T18:48:38.119558] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-18T18:48:38.919585] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-18T18:48:38.965444] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-18T18:48:39.719599] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-18T18:48:40.172389] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-18T18:48:40.176722] [INFO ] [REMOTE ] ENVA: Full fetch complete (36402 records). [2025-09-18T18:48:40.176817] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-18T18:48:40.382150] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-18T18:48:40.524709] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-18T18:48:40.594770] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-09-18T18:48:40.594862] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-09-18T18:48:40.595362] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-09-18T18:48:40.595404] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-09-18T18:48:40.596692] [DEBUG] [LOCAL ] ENVA: Trimmed 36402 records to 25959 (keeping 200 days of data) [2025-09-18T18:48:40.764775] [DEBUG] [LOCAL ] ENVA: Primary data saved (25959 records). [2025-09-18T18:48:40.764926] [INFO ] [MAIN ] ENVA: Full history saved. [2025-09-18T18:48:40.765018] [INFO ] [MAIN ] Update Progress: 745/2372 symbols completed. ENVA took 52.1s. Estimated remaining: 3h 57m 13s. Rate: 6.9 symbols/min [2025-09-18T18:48:40.939981] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:48:40.949687] [DEBUG] [LOCAL ] EOT: Loaded 6861 existing records from primary storage. [2025-09-18T18:48:40.949834] [INFO ] [MAIN ] EOT: Loaded 6861 existing records. [2025-09-18T18:48:41.138977] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:48:41.145612] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-18T18:48:41.146543] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-18T18:48:41.146312] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-18T18:48:41.148841] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-09-18T18:48:41.149372] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-18T18:48:41.324721] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-18T18:48:41.547887] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:48:41.971553] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-18T18:48:42.119581] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-18T18:48:42.919526] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-18T18:48:43.047931] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-18T18:48:43.050325] [INFO ] [REMOTE ] EOS: Full fetch complete (23069 records). [2025-09-18T18:48:43.050403] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-18T18:48:43.413472] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-09-18T18:48:43.413549] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-09-18T18:48:43.413966] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-09-18T18:48:43.414029] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-09-18T18:48:43.414779] [DEBUG] [LOCAL ] EOS: Trimmed 23069 records to 15700 (keeping 200 days of data) [2025-09-18T18:48:43.507759] [DEBUG] [LOCAL ] EOS: Primary data saved (15700 records). [2025-09-18T18:48:43.507896] [INFO ] [MAIN ] EOS: Full history saved. [2025-09-18T18:48:43.507979] [INFO ] [MAIN ] Update Progress: 746/2372 symbols completed. EOS took 23.5s. Estimated remaining: 3h 56m 51s. Rate: 6.9 symbols/min [2025-09-18T18:48:43.682151] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:48:43.708544] [DEBUG] [LOCAL ] EPAC: Loaded 26971 existing records from primary storage. [2025-09-18T18:48:43.708715] [INFO ] [MAIN ] EPAC: Loaded 26971 existing records. [2025-09-18T18:48:43.729426] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-11. [2025-09-18T18:48:43.820702] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-18T18:48:43.908145] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:48:43.908430] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-18T18:48:43.908480] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-18T18:48:43.909128] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-09-18T18:48:43.909188] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-18T18:48:44.257984] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:48:44.519570] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-11. [2025-09-18T18:48:44.567020] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-18T18:48:45.319583] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-18T18:48:45.584935] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-18T18:48:45.902721] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-18T18:48:45.905726] [INFO ] [REMOTE ] EOI: Full fetch complete (15970 records). [2025-09-18T18:48:45.905841] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-18T18:48:46.124736] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-09-18T18:48:46.306148] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-18T18:48:46.306302] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-18T18:48:46.306803] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-18T18:48:46.306872] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-18T18:48:46.307477] [DEBUG] [LOCAL ] EOI: Trimmed 15970 records to 10796 (keeping 200 days of data) [2025-09-18T18:48:46.375568] [DEBUG] [LOCAL ] EOI: Primary data saved (10796 records). [2025-09-18T18:48:46.375757] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-18T18:48:46.375860] [INFO ] [MAIN ] Update Progress: 747/2372 symbols completed. EOI took 29.8s. Estimated remaining: 3h 56m 30s. Rate: 6.9 symbols/min [2025-09-18T18:48:46.555309] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:48:46.598009] [DEBUG] [LOCAL ] EPAM: Loaded 39739 existing records from primary storage. [2025-09-18T18:48:46.598156] [INFO ] [MAIN ] EPAM: Loaded 39739 existing records. [2025-09-18T18:48:46.777850] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:48:46.787599] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-18T18:48:46.787775] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-18T18:48:46.788898] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-18T18:48:46.788970] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-09-18T18:48:46.792930] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-18T18:48:46.932442] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-09-18T18:48:47.157790] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:48:47.719541] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-18T18:48:47.923853] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-18T18:48:48.519598] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-09-18T18:48:49.217414] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-18T18:48:49.319505] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-09-18T18:48:49.424093] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-18T18:48:49.866088] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-18T18:48:50.119546] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-09-18T18:48:50.617599] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-18T18:48:50.919555] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-11. [2025-09-18T18:48:51.719559] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-18T18:48:52.221711] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-18T18:48:52.519588] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-09-18T18:48:53.143875] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-18T18:48:53.319563] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-09-18T18:48:53.595320] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-18T18:48:53.987030] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-18T18:48:54.119541] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-09-18T18:48:54.573113] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-18T18:48:54.919541] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-18T18:48:55.719615] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-09-18T18:48:56.519551] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-09-18T18:48:56.827142] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-18T18:48:56.860889] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-18T18:48:56.917750] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-18T18:48:57.319548] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-09-18T18:48:57.849973] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-18T18:48:58.119543] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-18T18:48:58.919574] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-09-18T18:48:58.977952] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-18T18:48:59.719620] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-18T18:48:59.859613] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-18T18:48:59.861509] [INFO ] [REMOTE ] EOT: Full fetch complete (10888 records). [2025-09-18T18:48:59.861583] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-09-18T18:49:00.239380] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-09-18T18:49:00.239461] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-09-18T18:49:00.239784] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-09-18T18:49:00.239847] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-09-18T18:49:00.240282] [DEBUG] [LOCAL ] EOT: Trimmed 10888 records to 6898 (keeping 200 days of data) [2025-09-18T18:49:00.282771] [DEBUG] [LOCAL ] EOT: Primary data saved (6898 records). [2025-09-18T18:49:00.282888] [INFO ] [MAIN ] EOT: Full history saved. [2025-09-18T18:49:00.282972] [INFO ] [MAIN ] Update Progress: 748/2372 symbols completed. EOT took 19.5s. Estimated remaining: 3h 56m 32s. Rate: 6.9 symbols/min [2025-09-18T18:49:00.455700] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:49:00.501841] [DEBUG] [LOCAL ] EPC: Loaded 39929 existing records from primary storage. [2025-09-18T18:49:00.502020] [INFO ] [MAIN ] EPC: Loaded 39929 existing records. [2025-09-18T18:49:00.524735] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-09-18T18:49:00.682766] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:49:00.683043] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-18T18:49:00.683093] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-18T18:49:00.684328] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-09-18T18:49:00.684392] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-18T18:49:01.038040] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:49:01.319567] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-18T18:49:01.466326] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-18T18:49:01.874740] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-18T18:49:02.119598] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-11. [2025-09-18T18:49:02.556204] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T18:49:02.919557] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-18T18:49:03.128873] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T18:49:03.719559] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-18T18:49:04.519619] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-09-18T18:49:04.580592] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-18T18:49:04.588108] [INFO ] [REMOTE ] EOG: Full fetch complete (77109 records). [2025-09-18T18:49:04.588248] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-18T18:49:04.982836] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-18T18:49:04.983002] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-18T18:49:04.983888] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-18T18:49:04.983997] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-18T18:49:05.001281] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-18T18:49:05.007751] [DEBUG] [LOCAL ] EOG: Trimmed 77109 records to 53731 (keeping 200 days of data) [2025-09-18T18:49:05.330039] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-18T18:49:05.355812] [DEBUG] [LOCAL ] EOG: Primary data saved (53731 records). [2025-09-18T18:49:05.355909] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-18T18:49:05.356670] [INFO ] [MAIN ] Update Progress: 749/2372 symbols completed. EOG took 55.7s. Estimated remaining: 3h 56m 16s. Rate: 6.9 symbols/min [2025-09-18T18:49:05.530772] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:49:05.587003] [DEBUG] [LOCAL ] EPD: Loaded 53616 existing records from primary storage. [2025-09-18T18:49:05.587174] [INFO ] [MAIN ] EPD: Loaded 53616 existing records. [2025-09-18T18:49:05.770680] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:49:05.771076] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-18T18:49:05.771247] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-18T18:49:05.778383] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-18T18:49:05.789353] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-18T18:49:05.795730] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-18T18:49:06.124757] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-09-18T18:49:06.162479] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:49:06.351962] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-18T18:49:06.919579] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-11. [2025-09-18T18:49:07.574474] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-18T18:49:07.719571] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-18T18:49:08.519527] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-18T18:49:08.556949] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-18T18:49:08.809984] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-18T18:49:09.319555] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-09-18T18:49:09.724048] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-18T18:49:10.119612] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-09-18T18:49:10.864861] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-18T18:49:10.919508] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-18T18:49:11.268113] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T18:49:11.719570] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-18T18:49:12.371984] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-18T18:49:12.519539] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-18T18:49:13.124085] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-18T18:49:13.319539] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-09-18T18:49:13.695256] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-18T18:49:14.119563] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-18T18:49:14.919577] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-18T18:49:15.138907] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-18T18:49:15.268020] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-18T18:49:15.719493] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-18T18:49:15.821581] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-18T18:49:16.519599] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-18T18:49:16.985113] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-18T18:49:17.319560] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-18T18:49:17.878863] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-18T18:49:18.119624] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-18T18:49:18.371505] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-18T18:49:18.919593] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-18T18:49:19.126103] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T18:49:19.130420] [INFO ] [REMOTE ] EPAC: Full fetch complete (38944 records). [2025-09-18T18:49:19.130504] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-18T18:49:19.520355] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-09-18T18:49:19.520432] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-09-18T18:49:19.520963] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-09-18T18:49:19.521026] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-09-18T18:49:19.521851] [DEBUG] [LOCAL ] EPAC: Trimmed 38944 records to 27231 (keeping 200 days of data) [2025-09-18T18:49:19.672169] [DEBUG] [LOCAL ] EPAC: Primary data saved (27231 records). [2025-09-18T18:49:19.672304] [INFO ] [MAIN ] EPAC: Full history saved. [2025-09-18T18:49:19.672390] [INFO ] [MAIN ] Update Progress: 750/2372 symbols completed. EPAC took 36.2s. Estimated remaining: 3h 56m 19s. Rate: 6.9 symbols/min [2025-09-18T18:49:19.728713] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-18T18:49:19.845433] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:49:19.887468] [DEBUG] [LOCAL ] EPR: Loaded 44439 existing records from primary storage. [2025-09-18T18:49:19.887610] [INFO ] [MAIN ] EPR: Loaded 44439 existing records. [2025-09-18T18:49:20.064207] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:49:20.064459] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-18T18:49:20.064515] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-18T18:49:20.065961] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-09-18T18:49:20.066023] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-18T18:49:20.419008] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:49:20.519495] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-11. [2025-09-18T18:49:20.808615] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-18T18:49:20.843149] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-18T18:49:21.319623] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-18T18:49:21.809809] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-18T18:49:22.119576] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-18T18:49:22.913346] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T18:49:22.923853] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-09-18T18:49:23.132859] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-18T18:49:23.719542] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-18T18:49:24.470459] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-18T18:49:24.519503] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-09-18T18:49:24.846160] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-18T18:49:25.319541] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-18T18:49:26.005732] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T18:49:26.119551] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-18T18:49:26.511349] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-18T18:49:26.517235] [INFO ] [REMOTE ] EPC: Full fetch complete (56581 records). [2025-09-18T18:49:26.517378] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-18T18:49:26.899097] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-09-18T18:49:26.899187] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-09-18T18:49:26.899852] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-09-18T18:49:26.899914] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-09-18T18:49:26.901123] [DEBUG] [LOCAL ] EPC: Trimmed 56581 records to 40244 (keeping 200 days of data) [2025-09-18T18:49:26.955685] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-18T18:49:27.152144] [DEBUG] [LOCAL ] EPC: Primary data saved (40244 records). [2025-09-18T18:49:27.152278] [INFO ] [MAIN ] EPC: Full history saved. [2025-09-18T18:49:27.152358] [INFO ] [MAIN ] Update Progress: 751/2372 symbols completed. EPC took 26.9s. Estimated remaining: 3h 56m 8s. Rate: 6.9 symbols/min [2025-09-18T18:49:27.322106] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:49:27.366293] [DEBUG] [LOCAL ] EPRT: Loaded 48708 existing records from primary storage. [2025-09-18T18:49:27.366449] [INFO ] [MAIN ] EPRT: Loaded 48708 existing records. [2025-09-18T18:49:27.576600] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:49:27.577240] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-18T18:49:27.577355] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-18T18:49:27.579377] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-18T18:49:27.579431] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-09-18T18:49:27.587847] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-18T18:49:27.731239] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-18T18:49:27.957351] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:49:28.340055] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-18T18:49:28.519589] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-18T18:49:29.129523] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-18T18:49:29.319628] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-18T18:49:29.736058] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-18T18:49:30.119543] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-11. [2025-09-18T18:49:30.919518] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-18T18:49:31.333146] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-18T18:49:31.396129] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-18T18:49:31.719594] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-09-18T18:49:32.192232] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-18T18:49:32.519563] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-18T18:49:33.228776] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-18T18:49:33.319544] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-09-18T18:49:34.119602] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-18T18:49:34.163580] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-18T18:49:34.367118] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-18T18:49:34.919539] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-18T18:49:35.447114] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T18:49:35.719543] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-18T18:49:36.002932] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-18T18:49:36.519553] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-18T18:49:37.151303] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T18:49:37.319576] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-18T18:49:37.660054] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-18T18:49:38.119545] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-18T18:49:38.595981] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-18T18:49:38.919596] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-18T18:49:39.327514] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-18T18:49:39.719621] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-18T18:49:40.209119] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-18T18:49:40.519572] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-18T18:49:40.869219] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-18T18:49:41.319636] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-18T18:49:42.119588] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-18T18:49:42.539296] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-18T18:49:42.705153] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T18:49:42.919583] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-18T18:49:43.456478] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-18T18:49:43.719605] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-18T18:49:44.519617] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-18T18:49:44.835038] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-18T18:49:44.899578] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-18T18:49:44.905868] [INFO ] [REMOTE ] EPAM: Full fetch complete (55859 records). [2025-09-18T18:49:44.906068] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-18T18:49:45.290255] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-09-18T18:49:45.290371] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-09-18T18:49:45.291044] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-09-18T18:49:45.291126] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-09-18T18:49:45.292274] [DEBUG] [LOCAL ] EPAM: Trimmed 55859 records to 40056 (keeping 200 days of data) [2025-09-18T18:49:45.342718] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-18T18:49:45.537835] [DEBUG] [LOCAL ] EPAM: Primary data saved (40056 records). [2025-09-18T18:49:45.538018] [INFO ] [MAIN ] EPAM: Full history saved. [2025-09-18T18:49:45.538161] [INFO ] [MAIN ] Update Progress: 752/2372 symbols completed. EPAM took 59.2s. Estimated remaining: 3h 56m 20s. Rate: 6.9 symbols/min [2025-09-18T18:49:45.710688] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:49:45.724260] [DEBUG] [LOCAL ] EQBK: Loaded 10882 existing records from primary storage. [2025-09-18T18:49:45.724401] [INFO ] [MAIN ] EQBK: Loaded 10882 existing records. [2025-09-18T18:49:45.909308] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:49:45.909860] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-18T18:49:45.909996] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-18T18:49:45.910457] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-09-18T18:49:45.910521] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-18T18:49:46.127778] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-18T18:49:46.141013] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-18T18:49:46.313451] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:49:46.919551] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-11. [2025-09-18T18:49:47.163178] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-18T18:49:47.173210] [INFO ] [REMOTE ] EPR: Full fetch complete (62755 records). [2025-09-18T18:49:47.173374] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-18T18:49:47.570434] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-09-18T18:49:47.576823] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-09-18T18:49:47.577075] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-18T18:49:47.577940] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-09-18T18:49:47.580311] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-09-18T18:49:47.584597] [DEBUG] [LOCAL ] EPR: Trimmed 62755 records to 44723 (keeping 200 days of data) [2025-09-18T18:49:47.766938] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-18T18:49:47.840928] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-18T18:49:47.855813] [INFO ] [REMOTE ] EPD: Full fetch complete (77533 records). [2025-09-18T18:49:47.856982] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-18T18:49:48.266358] [DEBUG] [LOCAL ] EPR: Primary data saved (44723 records). [2025-09-18T18:49:48.284427] [INFO ] [MAIN ] EPR: Full history saved. [2025-09-18T18:49:48.287336] [INFO ] [MAIN ] Update Progress: 753/2372 symbols completed. EPR took 28.6s. Estimated remaining: 3h 55m 58s. Rate: 6.9 symbols/min [2025-09-18T18:49:48.365727] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-09-18T18:49:48.377975] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-09-18T18:49:48.408534] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-09-18T18:49:48.414850] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-09-18T18:49:48.454591] [DEBUG] [LOCAL ] EPD: Trimmed 77533 records to 54006 (keeping 200 days of data) [2025-09-18T18:49:48.568720] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:49:48.564015] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-09-18T18:49:48.781324] [DEBUG] [LOCAL ] EQH: Loaded 52667 existing records from primary storage. [2025-09-18T18:49:48.785189] [INFO ] [MAIN ] EQH: Loaded 52667 existing records. [2025-09-18T18:49:49.061688] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:49:49.064385] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-18T18:49:49.064785] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-18T18:49:49.067075] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-09-18T18:49:49.067163] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-18T18:49:49.471192] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:49:49.473358] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-11. [2025-09-18T18:49:49.481185] [DEBUG] [LOCAL ] EPD: Primary data saved (54006 records). [2025-09-18T18:49:49.481486] [INFO ] [MAIN ] EPD: Full history saved. [2025-09-18T18:49:49.483172] [INFO ] [MAIN ] Update Progress: 754/2372 symbols completed. EPD took 44.1s. Estimated remaining: 3h 55m 33s. Rate: 6.9 symbols/min [2025-09-18T18:49:49.675931] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T18:49:49.675303] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:49:49.712523] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-18T18:49:49.778636] [DEBUG] [LOCAL ] EQNR: Loaded 53049 existing records from primary storage. [2025-09-18T18:49:49.778853] [INFO ] [MAIN ] EQNR: Loaded 53049 existing records. [2025-09-18T18:49:49.969352] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:49:49.969917] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-18T18:49:49.970018] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-18T18:49:49.971187] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-09-18T18:49:49.971278] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-18T18:49:50.127981] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-18T18:49:50.335695] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:49:50.778181] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-18T18:49:50.919559] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-09-18T18:49:51.525572] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-18T18:49:51.719524] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-18T18:49:52.225575] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T18:49:52.519599] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-11. [2025-09-18T18:49:53.210431] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T18:49:53.319552] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-18T18:49:54.119566] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-09-18T18:49:54.376005] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-18T18:49:54.632143] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-18T18:49:54.640277] [INFO ] [REMOTE ] EPRT: Full fetch complete (68486 records). [2025-09-18T18:49:54.640418] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-18T18:49:54.929148] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-09-18T18:49:55.031236] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-09-18T18:49:55.031327] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-09-18T18:49:55.032134] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-09-18T18:49:55.032201] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-09-18T18:49:55.033666] [DEBUG] [LOCAL ] EPRT: Trimmed 68486 records to 49084 (keeping 200 days of data) [2025-09-18T18:49:55.153118] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-18T18:49:55.363826] [DEBUG] [LOCAL ] EPRT: Primary data saved (49084 records). [2025-09-18T18:49:55.363972] [INFO ] [MAIN ] EPRT: Full history saved. [2025-09-18T18:49:55.364121] [INFO ] [MAIN ] Update Progress: 755/2372 symbols completed. EPRT took 28.2s. Estimated remaining: 3h 55m 18s. Rate: 6.9 symbols/min [2025-09-18T18:49:55.536212] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:49:55.591473] [DEBUG] [LOCAL ] EQR: Loaded 51365 existing records from primary storage. [2025-09-18T18:49:55.591621] [INFO ] [MAIN ] EQR: Loaded 51365 existing records. [2025-09-18T18:49:55.724675] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-09-18T18:49:55.782037] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:49:55.782299] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-18T18:49:55.782357] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-18T18:49:55.783394] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-09-18T18:49:55.783458] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-18T18:49:56.150999] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:49:56.519573] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-18T18:49:56.658063] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-18T18:49:57.276577] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-18T18:49:57.319521] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-11. [2025-09-18T18:49:57.367148] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-18T18:49:58.119561] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-18T18:49:58.654323] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-18T18:49:58.898325] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-18T18:49:58.919503] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-09-18T18:49:59.719541] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-18T18:50:00.527095] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-09-18T18:50:00.546503] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-18T18:50:01.319579] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-18T18:50:01.402764] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-18T18:50:01.995492] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-18T18:50:02.119548] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-09-18T18:50:02.919547] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-18T18:50:03.245723] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-18T18:50:03.552326] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T18:50:03.571678] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-18T18:50:03.719552] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-18T18:50:04.519548] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-18T18:50:05.247115] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-18T18:50:05.319526] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-18T18:50:05.613487] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-18T18:50:06.004573] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-18T18:50:06.119573] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-18T18:50:06.919626] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-18T18:50:07.719578] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-18T18:50:07.785021] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-18T18:50:07.949717] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-18T18:50:08.519537] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-18T18:50:09.126519] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T18:50:09.145113] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T18:50:09.319585] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-18T18:50:10.119544] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-18T18:50:10.919561] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-18T18:50:11.166416] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-18T18:50:11.514164] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-18T18:50:11.719556] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-18T18:50:12.266767] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-18T18:50:12.519554] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-18T18:50:13.127972] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-18T18:50:13.319591] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-18T18:50:14.119568] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-18T18:50:14.919594] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-18T18:50:15.089832] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-18T18:50:15.092257] [INFO ] [REMOTE ] EQBK: Full fetch complete (15449 records). [2025-09-18T18:50:15.092350] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-18T18:50:15.443007] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-18T18:50:15.539770] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-09-18T18:50:15.539902] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-09-18T18:50:15.540376] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-09-18T18:50:15.540502] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-09-18T18:50:15.541414] [DEBUG] [LOCAL ] EQBK: Trimmed 15449 records to 10975 (keeping 200 days of data) [2025-09-18T18:50:15.621555] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-18T18:50:15.649719] [DEBUG] [LOCAL ] EQBK: Primary data saved (10975 records). [2025-09-18T18:50:15.649828] [INFO ] [MAIN ] EQBK: Full history saved. [2025-09-18T18:50:15.649907] [INFO ] [MAIN ] Update Progress: 756/2372 symbols completed. EQBK took 30.1s. Estimated remaining: 3h 55m 34s. Rate: 6.9 symbols/min [2025-09-18T18:50:15.724746] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-18T18:50:15.864459] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:50:15.864630] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-18T18:50:15.864705] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-18T18:50:15.864930] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-18T18:50:15.864973] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-18T18:50:15.865016] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-18T18:50:15.865048] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-18T18:50:16.254566] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:50:16.292865] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T18:50:16.519595] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-18T18:50:17.319562] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-11. [2025-09-18T18:50:17.577085] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-11 (0.26 seconds). [2025-09-18T18:50:17.708427] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-18T18:50:18.085088] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-18T18:50:18.119585] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-18T18:50:18.919557] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-18T18:50:19.719603] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-18T18:50:20.029265] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-18T18:50:20.371707] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T18:50:20.519539] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-09-18T18:50:20.982297] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-18T18:50:21.036110] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T18:50:21.319616] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-18T18:50:22.119599] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-09-18T18:50:22.388598] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-18T18:50:22.900253] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-18T18:50:22.919526] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-18T18:50:23.719545] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-18T18:50:24.091979] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-18T18:50:24.328185] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-18T18:50:24.519588] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-18T18:50:25.319566] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-18T18:50:26.119535] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-18T18:50:26.226700] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-18T18:50:26.374129] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-18T18:50:26.750769] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-18T18:50:26.758428] [INFO ] [REMOTE ] EQNR: Full fetch complete (76589 records). [2025-09-18T18:50:26.758583] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-18T18:50:26.923101] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-18T18:50:27.163392] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-09-18T18:50:27.163506] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-09-18T18:50:27.164432] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-09-18T18:50:27.164502] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-09-18T18:50:27.166585] [DEBUG] [LOCAL ] EQNR: Trimmed 76589 records to 53434 (keeping 200 days of data) [2025-09-18T18:50:27.504559] [DEBUG] [LOCAL ] EQNR: Primary data saved (53434 records). [2025-09-18T18:50:27.504774] [INFO ] [MAIN ] EQNR: Full history saved. [2025-09-18T18:50:27.504891] [INFO ] [MAIN ] Update Progress: 757/2372 symbols completed. EQNR took 38.0s. Estimated remaining: 3h 55m 32s. Rate: 6.9 symbols/min [2025-09-18T18:50:27.719553] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-18T18:50:27.947386] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-09-18T18:50:28.519564] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-18T18:50:28.599530] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-18T18:50:28.607749] [INFO ] [REMOTE ] EQH: Full fetch complete (76124 records). [2025-09-18T18:50:28.607887] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-18T18:50:28.994396] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-09-18T18:50:28.994481] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-09-18T18:50:28.995296] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-09-18T18:50:28.995366] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-09-18T18:50:28.998960] [DEBUG] [LOCAL ] EQH: Trimmed 76124 records to 53057 (keeping 200 days of data) [2025-09-18T18:50:29.319955] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-18T18:50:29.335799] [DEBUG] [LOCAL ] EQH: Primary data saved (53057 records). [2025-09-18T18:50:29.335908] [INFO ] [MAIN ] EQH: Full history saved. [2025-09-18T18:50:29.336018] [INFO ] [MAIN ] Update Progress: 758/2372 symbols completed. EQH took 41.0s. Estimated remaining: 3h 55m 8s. Rate: 6.9 symbols/min [2025-09-18T18:50:29.655811] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-18T18:50:29.980279] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-18T18:50:30.119553] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-18T18:50:30.919567] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-18T18:50:31.276457] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-18T18:50:31.719555] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-18T18:50:31.824800] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-18T18:50:31.833941] [INFO ] [REMOTE ] EQR: Full fetch complete (73518 records). [2025-09-18T18:50:31.834104] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-18T18:50:32.103974] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-18T18:50:32.237287] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-09-18T18:50:32.237458] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-09-18T18:50:32.238815] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-18T18:50:32.238890] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-09-18T18:50:32.240495] [DEBUG] [LOCAL ] EQR: Trimmed 73518 records to 51751 (keeping 200 days of data) [2025-09-18T18:50:32.526346] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-18T18:50:32.576498] [DEBUG] [LOCAL ] EQR: Primary data saved (51751 records). [2025-09-18T18:50:32.577328] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-18T18:50:32.577509] [INFO ] [MAIN ] Update Progress: 759/2372 symbols completed. EQR took 37.2s. Estimated remaining: 3h 54m 48s. Rate: 6.9 symbols/min [2025-09-18T18:50:33.008213] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-18T18:50:33.319543] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-18T18:50:33.854273] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-18T18:50:33.855699] [INFO ] [REMOTE ] EQS: Full fetch complete (2518 records). [2025-09-18T18:50:33.855774] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-18T18:50:34.047990] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-18T18:50:34.048187] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:50:34.048256] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:50:34.048336] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-18T18:50:34.048403] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-18T18:50:34.048441] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-18T18:50:34.048499] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-18T18:50:34.048583] [INFO ] [MAIN ] Update Progress: 760/2372 symbols completed. EQS took 18.4s. Estimated remaining: 3h 54m 24s. Rate: 6.9 symbols/min [2025-09-18T18:50:34.686866] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:50:34.758826] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:50:34.801693] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:50:34.807180] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:50:34.815298] [DEBUG] [LOCAL ] EQV: Loaded 2920 existing records from primary storage. [2025-09-18T18:50:34.815591] [INFO ] [MAIN ] EQV: Loaded 2920 existing records. [2025-09-18T18:50:35.057453] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:50:35.071143] [DEBUG] [LOCAL ] ERO: Loaded 41129 existing records from primary storage. [2025-09-18T18:50:35.071383] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-18T18:50:35.085539] [INFO ] [MAIN ] ERO: Loaded 41129 existing records. [2025-09-18T18:50:35.096765] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-18T18:50:35.126128] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-09-18T18:50:35.132217] [DEBUG] [LOCAL ] ERJ: Loaded 50957 existing records from primary storage. [2025-09-18T18:50:35.132354] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-18T18:50:35.141403] [INFO ] [MAIN ] ERJ: Loaded 50957 existing records. [2025-09-18T18:50:35.365322] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-09-18T18:50:35.390823] [INFO ] [MAIN ] EQT: Loaded 53682 existing records. [2025-09-18T18:50:35.743865] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:50:35.890635] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-18T18:50:35.907505] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-18T18:50:35.967275] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:50:35.973066] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-09-18T18:50:35.973269] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:50:35.973423] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-18T18:50:35.973911] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-18T18:50:35.974456] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-18T18:50:36.030021] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-18T18:50:36.089589] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-18T18:50:36.089715] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-18T18:50:36.110311] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-18T18:50:36.131294] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-18T18:50:36.191081] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-18T18:50:36.191019] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:50:36.201696] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-11. [2025-09-18T18:50:36.662227] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-18T18:50:36.729449] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-09-18T18:50:36.952000] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:50:36.996609] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-11. [2025-09-18T18:50:37.166234] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:50:37.171206] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:50:37.171527] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-11. [2025-09-18T18:50:37.319497] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-11. [2025-09-18T18:50:37.326254] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-18T18:50:38.119566] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-09-18T18:50:38.344411] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-18T18:50:38.773028] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-18T18:50:38.775263] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-18T18:50:38.919523] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-09-18T18:50:38.992594] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-18T18:50:39.719549] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-09-18T18:50:40.519523] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-09-18T18:50:40.692116] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-18T18:50:41.107739] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T18:50:41.319608] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-09-18T18:50:41.840265] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-18T18:50:42.119627] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-18T18:50:42.541060] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-18T18:50:42.632178] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-18T18:50:42.919585] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-18T18:50:43.719557] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-09-18T18:50:44.412158] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T18:50:44.519510] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-18T18:50:45.319582] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-18T18:50:45.608876] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-18T18:50:45.643628] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-18T18:50:45.678393] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-18T18:50:46.119554] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-18T18:50:46.528491] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-18T18:50:46.919592] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-09-18T18:50:47.719562] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-18T18:50:48.124279] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-18T18:50:48.347853] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T18:50:48.519621] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-18T18:50:49.319572] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-18T18:50:49.716256] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-18T18:50:49.887570] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-18T18:50:50.119553] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-18T18:50:50.580702] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-18T18:50:50.919566] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-18T18:50:51.480628] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-18T18:50:51.719564] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-18T18:50:52.519561] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-18T18:50:53.177540] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T18:50:53.319569] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-18T18:50:53.754256] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-18T18:50:53.755503] [INFO ] [REMOTE ] EQV: Full fetch complete (5715 records). [2025-09-18T18:50:53.755580] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-18T18:50:54.121538] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-18T18:50:54.254089] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-09-18T18:50:54.254397] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-09-18T18:50:54.254793] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-09-18T18:50:54.254930] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-09-18T18:50:54.255833] [DEBUG] [LOCAL ] EQV: Trimmed 5715 records to 2930 (keeping 200 days of data) [2025-09-18T18:50:54.275700] [DEBUG] [LOCAL ] EQV: Primary data saved (2930 records). [2025-09-18T18:50:54.275808] [INFO ] [MAIN ] EQV: Full history saved. [2025-09-18T18:50:54.276018] [INFO ] [MAIN ] Update Progress: 761/2372 symbols completed. EQV took 20.2s. Estimated remaining: 3h 54m 40s. Rate: 6.9 symbols/min [2025-09-18T18:50:54.492240] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-18T18:50:54.512181] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:50:54.576262] [DEBUG] [LOCAL ] ES: Loaded 52516 existing records from primary storage. [2025-09-18T18:50:54.576463] [INFO ] [MAIN ] ES: Loaded 52516 existing records. [2025-09-18T18:50:54.758517] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:50:54.758863] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-18T18:50:54.758919] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-18T18:50:54.760508] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-09-18T18:50:54.760573] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-18T18:50:54.924725] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-18T18:50:55.147662] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:50:55.719578] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-11. [2025-09-18T18:50:55.841548] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-18T18:50:56.218197] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-18T18:50:56.519560] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-18T18:50:57.301565] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-18T18:50:57.319498] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-09-18T18:50:58.119607] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-18T18:50:58.229145] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-18T18:50:58.919529] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-18T18:50:59.173690] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-18T18:50:59.208877] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-18T18:50:59.719555] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-18T18:51:00.519541] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-18T18:51:00.689083] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-18T18:51:01.319583] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-09-18T18:51:01.374291] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-18T18:51:02.119577] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-18T18:51:02.824250] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-18T18:51:02.919558] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-18T18:51:03.719608] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-18T18:51:04.457121] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (3.14 seconds). [2025-09-18T18:51:04.519517] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-18T18:51:05.099826] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (2.98 seconds). [2025-09-18T18:51:05.216142] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-18T18:51:05.319590] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-18T18:51:05.734802] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-18T18:51:06.119537] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-18T18:51:06.196274] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-18T18:51:06.530116] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-18T18:51:06.536511] [INFO ] [REMOTE ] ERO: Full fetch complete (58775 records). [2025-09-18T18:51:06.536632] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-18T18:51:06.937686] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-18T18:51:06.940726] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-09-18T18:51:06.941557] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-09-18T18:51:06.942326] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-09-18T18:51:06.942475] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-09-18T18:51:06.943897] [DEBUG] [LOCAL ] ERO: Trimmed 58775 records to 41425 (keeping 200 days of data) [2025-09-18T18:51:07.211372] [DEBUG] [LOCAL ] ERO: Primary data saved (41425 records). [2025-09-18T18:51:07.211549] [INFO ] [MAIN ] ERO: Full history saved. [2025-09-18T18:51:07.211670] [INFO ] [MAIN ] Update Progress: 762/2372 symbols completed. ERO took 33.2s. Estimated remaining: 3h 54m 40s. Rate: 6.9 symbols/min [2025-09-18T18:51:07.381884] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:51:07.382061] [DEBUG] [LOCAL ] ESAB: No existing data file found in primary storage. [2025-09-18T18:51:07.382127] [WARN ] [MAIN ] ESAB: No existing data found, performing full refresh instead. [2025-09-18T18:51:07.382328] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-18T18:51:07.382399] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-18T18:51:07.382494] [DEBUG] [LOCAL ] ESAB: No primary data file found to delete. [2025-09-18T18:51:07.382562] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-18T18:51:07.736453] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-18T18:51:07.775825] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:51:07.805082] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-18T18:51:08.482327] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-18T18:51:08.519510] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-18T18:51:09.319520] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-18T18:51:09.442735] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-18T18:51:09.950607] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T18:51:10.119543] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-11. [2025-09-18T18:51:10.919530] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-18T18:51:10.980921] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-18T18:51:11.034551] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-18T18:51:11.719592] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-18T18:51:12.519572] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-18T18:51:13.319584] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-09-18T18:51:13.527937] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-18T18:51:14.119614] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-18T18:51:14.487604] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-09-18T18:51:14.798345] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-18T18:51:14.920286] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-09-18T18:51:14.920171] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-18T18:51:15.292489] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-18T18:51:15.719569] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-18T18:51:15.917809] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-18T18:51:16.519619] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-18T18:51:17.319516] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-18T18:51:17.540088] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-18T18:51:18.119566] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-18T18:51:18.220472] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-18T18:51:18.227546] [INFO ] [REMOTE ] ERJ: Full fetch complete (72025 records). [2025-09-18T18:51:18.227778] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-18T18:51:18.305486] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-18T18:51:18.633178] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-09-18T18:51:18.633259] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-09-18T18:51:18.634062] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-09-18T18:51:18.634126] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-09-18T18:51:18.635537] [DEBUG] [LOCAL ] ERJ: Trimmed 72025 records to 51280 (keeping 200 days of data) [2025-09-18T18:51:18.923328] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-18T18:51:18.942838] [DEBUG] [LOCAL ] ERJ: Primary data saved (51280 records). [2025-09-18T18:51:18.943011] [INFO ] [MAIN ] ERJ: Full history saved. [2025-09-18T18:51:18.943163] [INFO ] [MAIN ] Update Progress: 763/2372 symbols completed. ERJ took 44.9s. Estimated remaining: 3h 54m 37s. Rate: 6.9 symbols/min [2025-09-18T18:51:19.115824] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:51:19.134046] [DEBUG] [LOCAL ] ESE: Loaded 16612 existing records from primary storage. [2025-09-18T18:51:19.134173] [INFO ] [MAIN ] ESE: Loaded 16612 existing records. [2025-09-18T18:51:19.344224] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:51:19.344489] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-18T18:51:19.344537] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-18T18:51:19.345253] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-18T18:51:19.345314] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-18T18:51:19.707671] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:51:19.719512] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-18T18:51:19.814971] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-18T18:51:20.013331] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-18T18:51:20.519604] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-18T18:51:21.094930] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-18T18:51:21.319562] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-18T18:51:21.858550] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-18T18:51:22.119560] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-11. [2025-09-18T18:51:22.920908] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-18T18:51:22.925471] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-18T18:51:23.026205] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-18T18:51:23.033732] [INFO ] [REMOTE ] EQT: Full fetch complete (77542 records). [2025-09-18T18:51:23.033872] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-18T18:51:23.430828] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-09-18T18:51:23.430979] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-09-18T18:51:23.431833] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-18T18:51:23.431900] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-09-18T18:51:23.433423] [DEBUG] [LOCAL ] EQT: Trimmed 77542 records to 54072 (keeping 200 days of data) [2025-09-18T18:51:23.722025] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-18T18:51:23.774337] [DEBUG] [LOCAL ] EQT: Primary data saved (54072 records). [2025-09-18T18:51:23.774469] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-18T18:51:23.775170] [INFO ] [MAIN ] Update Progress: 764/2372 symbols completed. EQT took 49.7s. Estimated remaining: 3h 54m 20s. Rate: 6.9 symbols/min [2025-09-18T18:51:23.961061] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:51:24.021462] [DEBUG] [LOCAL ] ESI: Loaded 50860 existing records from primary storage. [2025-09-18T18:51:24.021627] [INFO ] [MAIN ] ESI: Loaded 50860 existing records. [2025-09-18T18:51:24.217347] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:51:24.217734] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-18T18:51:24.217797] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-18T18:51:24.219340] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-18T18:51:24.219407] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-18T18:51:24.524946] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-09-18T18:51:24.633353] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:51:24.663854] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-18T18:51:24.671185] [INFO ] [REMOTE ] ES: Full fetch complete (75956 records). [2025-09-18T18:51:24.671310] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-18T18:51:25.070689] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-09-18T18:51:25.076052] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-09-18T18:51:25.086384] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-09-18T18:51:25.086525] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-09-18T18:51:25.087957] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T18:51:25.094909] [DEBUG] [LOCAL ] ES: Trimmed 75956 records to 52905 (keeping 200 days of data) [2025-09-18T18:51:25.323678] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-11. [2025-09-18T18:51:25.344772] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-18T18:51:25.426441] [DEBUG] [LOCAL ] ES: Primary data saved (52905 records). [2025-09-18T18:51:25.426596] [INFO ] [MAIN ] ES: Full history saved. [2025-09-18T18:51:25.426724] [INFO ] [MAIN ] Update Progress: 765/2372 symbols completed. ES took 31.2s. Estimated remaining: 3h 53m 57s. Rate: 6.9 symbols/min [2025-09-18T18:51:25.593912] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:51:25.631663] [DEBUG] [LOCAL ] ESNT: Loaded 38756 existing records from primary storage. [2025-09-18T18:51:25.631816] [INFO ] [MAIN ] ESNT: Loaded 38756 existing records. [2025-09-18T18:51:25.812525] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:51:25.812839] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-18T18:51:25.812913] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-18T18:51:25.813978] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-09-18T18:51:25.814041] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-18T18:51:26.124633] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-09-18T18:51:26.190133] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:51:26.754863] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T18:51:26.770463] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-18T18:51:26.919553] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-09-18T18:51:27.719567] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-18T18:51:28.520896] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-18T18:51:28.521030] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-11. [2025-09-18T18:51:28.612688] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T18:51:29.319551] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-18T18:51:29.776864] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-18T18:51:30.119554] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-18T18:51:30.317686] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-18T18:51:30.919550] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-09-18T18:51:31.075141] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-18T18:51:31.719559] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-18T18:51:32.353692] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-18T18:51:32.526550] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-09-18T18:51:32.544833] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-18T18:51:33.319540] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-18T18:51:33.733031] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-18T18:51:34.119560] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-18T18:51:34.322548] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-18T18:51:34.919554] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-09-18T18:51:35.138215] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-18T18:51:35.142410] [INFO ] [REMOTE ] ESAB: Full fetch complete (34886 records). [2025-09-18T18:51:35.142564] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-18T18:51:35.545039] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-09-18T18:51:35.545130] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-09-18T18:51:35.545682] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-09-18T18:51:35.545759] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-09-18T18:51:35.546667] [DEBUG] [LOCAL ] ESAB: Trimmed 34886 records to 25833 (keeping 200 days of data) [2025-09-18T18:51:35.718738] [DEBUG] [LOCAL ] ESAB: Primary data saved (25833 records). [2025-09-18T18:51:35.719033] [INFO ] [MAIN ] ESAB: Full history saved. [2025-09-18T18:51:35.719154] [INFO ] [MAIN ] Update Progress: 766/2372 symbols completed. ESAB took 28.5s. Estimated remaining: 3h 53m 51s. Rate: 6.9 symbols/min [2025-09-18T18:51:35.719602] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-18T18:51:35.901757] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:51:35.947389] [DEBUG] [LOCAL ] ESRT: Loaded 46440 existing records from primary storage. [2025-09-18T18:51:35.947534] [INFO ] [MAIN ] ESRT: Loaded 46440 existing records. [2025-09-18T18:51:36.127391] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:51:36.127751] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-18T18:51:36.127962] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-18T18:51:36.129498] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-18T18:51:36.129567] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-18T18:51:36.414576] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-18T18:51:36.533462] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-18T18:51:36.540015] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:51:36.856179] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-18T18:51:37.319567] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-11. [2025-09-18T18:51:37.905889] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-18T18:51:38.119579] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-18T18:51:38.630682] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-18T18:51:38.919579] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-18T18:51:39.337639] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T18:51:39.719599] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-09-18T18:51:40.446512] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T18:51:40.519678] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-18T18:51:41.002821] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-18T18:51:41.319564] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-09-18T18:51:42.119570] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-18T18:51:42.335412] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-18T18:51:42.526064] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-18T18:51:42.919552] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-18T18:51:43.276224] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-18T18:51:43.719565] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-18T18:51:44.286941] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-18T18:51:44.519569] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-18T18:51:45.319516] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-18T18:51:45.357711] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T18:51:45.559244] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-18T18:51:46.119523] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-18T18:51:46.213408] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-18T18:51:46.919552] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-18T18:51:47.511187] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-18T18:51:47.719580] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-18T18:51:48.096785] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-18T18:51:48.519544] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-18T18:51:49.127827] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-18T18:51:49.319570] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-18T18:51:50.110491] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-18T18:51:50.120249] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-18T18:51:50.133961] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-18T18:51:50.919595] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-18T18:51:51.493258] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T18:51:51.719589] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-18T18:51:51.788392] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-18T18:51:52.519543] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-18T18:51:52.939395] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-18T18:51:53.319569] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-18T18:51:54.119575] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-18T18:51:54.301375] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-18T18:51:54.450494] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-18T18:51:54.919566] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-18T18:51:55.232531] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-18T18:51:55.719548] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-18T18:51:56.519523] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-18T18:51:56.677731] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-18T18:51:56.804873] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-18T18:51:56.810076] [INFO ] [REMOTE ] ESNT: Full fetch complete (57173 records). [2025-09-18T18:51:56.810286] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-18T18:51:57.192462] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-09-18T18:51:57.192549] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-09-18T18:51:57.193219] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-09-18T18:51:57.193300] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-09-18T18:51:57.194521] [DEBUG] [LOCAL ] ESNT: Trimmed 57173 records to 39104 (keeping 200 days of data) [2025-09-18T18:51:57.366509] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-18T18:51:57.428823] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-18T18:51:57.457290] [DEBUG] [LOCAL ] ESNT: Primary data saved (39104 records). [2025-09-18T18:51:57.457458] [INFO ] [MAIN ] ESNT: Full history saved. [2025-09-18T18:51:57.457572] [INFO ] [MAIN ] Update Progress: 767/2372 symbols completed. ESNT took 32.0s. Estimated remaining: 3h 54m 10s. Rate: 6.9 symbols/min [2025-09-18T18:51:57.628610] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:51:57.664173] [DEBUG] [LOCAL ] ESS: Loaded 30078 existing records from primary storage. [2025-09-18T18:51:57.664360] [INFO ] [MAIN ] ESS: Loaded 30078 existing records. [2025-09-18T18:51:57.868585] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:51:57.868853] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-18T18:51:57.868902] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-18T18:51:57.869850] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-18T18:51:57.869911] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-18T18:51:58.124724] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-18T18:51:58.230915] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:51:58.835916] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-18T18:51:58.919571] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-18T18:51:59.719546] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-11. [2025-09-18T18:51:59.855835] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-18T18:51:59.874791] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-18T18:51:59.878324] [INFO ] [REMOTE ] ESE: Full fetch complete (21729 records). [2025-09-18T18:51:59.878445] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-18T18:52:00.256294] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-18T18:52:00.256382] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-18T18:52:00.256793] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-18T18:52:00.256866] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-18T18:52:00.257820] [DEBUG] [LOCAL ] ESE: Trimmed 21729 records to 16775 (keeping 200 days of data) [2025-09-18T18:52:00.360510] [DEBUG] [LOCAL ] ESE: Primary data saved (16775 records). [2025-09-18T18:52:00.360713] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-18T18:52:00.360854] [INFO ] [MAIN ] Update Progress: 768/2372 symbols completed. ESE took 41.4s. Estimated remaining: 3h 53m 49s. Rate: 6.9 symbols/min [2025-09-18T18:52:00.531858] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:52:00.528373] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-18T18:52:00.581171] [DEBUG] [LOCAL ] ESTC: Loaded 50222 existing records from primary storage. [2025-09-18T18:52:00.581309] [INFO ] [MAIN ] ESTC: Loaded 50222 existing records. [2025-09-18T18:52:00.765805] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:52:00.766096] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-18T18:52:00.766163] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-18T18:52:00.767932] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-18T18:52:00.768027] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-18T18:52:01.147542] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:52:01.163834] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-18T18:52:01.319545] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-09-18T18:52:02.119588] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-11. [2025-09-18T18:52:02.219378] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-18T18:52:02.233110] [INFO ] [REMOTE ] ESI: Full fetch complete (72071 records). [2025-09-18T18:52:02.233311] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-18T18:52:02.633900] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-18T18:52:02.634013] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-18T18:52:02.634938] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-18T18:52:02.635021] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-18T18:52:02.636874] [DEBUG] [LOCAL ] ESI: Trimmed 72071 records to 51232 (keeping 200 days of data) [2025-09-18T18:52:02.741418] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-18T18:52:02.942016] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-09-18T18:52:02.984237] [DEBUG] [LOCAL ] ESI: Primary data saved (51232 records). [2025-09-18T18:52:02.984407] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-18T18:52:02.985969] [INFO ] [MAIN ] Update Progress: 769/2372 symbols completed. ESI took 39.2s. Estimated remaining: 3h 53m 27s. Rate: 6.9 symbols/min [2025-09-18T18:52:03.164050] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:52:03.228571] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-09-18T18:52:03.228770] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-09-18T18:52:03.410988] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:52:03.411241] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-18T18:52:03.411330] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-18T18:52:03.412626] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-09-18T18:52:03.412721] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-18T18:52:03.723953] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-18T18:52:03.779197] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:52:03.811133] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-18T18:52:04.032306] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-18T18:52:04.519611] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-11. [2025-09-18T18:52:05.013437] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-18T18:52:05.319554] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-18T18:52:06.119551] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-18T18:52:06.425583] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-18T18:52:06.682497] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-18T18:52:06.919556] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-18T18:52:07.285596] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-18T18:52:07.292129] [INFO ] [REMOTE ] ESRT: Full fetch complete (66213 records). [2025-09-18T18:52:07.292275] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-18T18:52:07.696473] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-18T18:52:07.696620] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-18T18:52:07.697803] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-18T18:52:07.697880] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-18T18:52:07.699785] [DEBUG] [LOCAL ] ESRT: Trimmed 66213 records to 46741 (keeping 200 days of data) [2025-09-18T18:52:07.764042] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-09-18T18:52:07.990020] [DEBUG] [LOCAL ] ESRT: Primary data saved (46741 records). [2025-09-18T18:52:07.990153] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-18T18:52:07.990305] [INFO ] [MAIN ] Update Progress: 770/2372 symbols completed. ESRT took 32.3s. Estimated remaining: 3h 53m 11s. Rate: 6.9 symbols/min [2025-09-18T18:52:08.166689] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:52:08.180535] [DEBUG] [LOCAL ] ETB: Loaded 12220 existing records from primary storage. [2025-09-18T18:52:08.180687] [INFO ] [MAIN ] ETB: Loaded 12220 existing records. [2025-09-18T18:52:08.302340] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-18T18:52:08.385786] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:52:08.386040] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-18T18:52:08.386106] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-18T18:52:08.386548] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-09-18T18:52:08.386608] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-18T18:52:08.526325] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-18T18:52:08.752495] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:52:09.319598] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-11. [2025-09-18T18:52:09.758172] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-18T18:52:09.777219] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-18T18:52:09.809371] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-18T18:52:10.119542] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-18T18:52:10.919564] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-09-18T18:52:11.481231] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-18T18:52:11.719556] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-09-18T18:52:12.274795] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-18T18:52:12.519508] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-18T18:52:12.668959] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-18T18:52:13.319526] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-18T18:52:13.380640] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-18T18:52:14.119552] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-09-18T18:52:14.887378] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-18T18:52:14.919538] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-18T18:52:15.254635] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-18T18:52:15.719566] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-09-18T18:52:15.905480] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-18T18:52:16.519565] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-18T18:52:17.302219] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-18T18:52:17.319506] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-09-18T18:52:17.473191] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-18T18:52:18.119569] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-18T18:52:18.733898] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-18T18:52:18.919550] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-18T18:52:19.719565] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-18T18:52:20.260373] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-18T18:52:20.271995] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-18T18:52:20.314735] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T18:52:20.519561] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-18T18:52:21.319553] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-18T18:52:22.119569] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-18T18:52:22.450619] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-18T18:52:22.789496] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-18T18:52:22.919547] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-18T18:52:23.628780] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T18:52:23.719502] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-18T18:52:24.209924] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-18T18:52:24.215347] [INFO ] [REMOTE ] ESS: Full fetch complete (43248 records). [2025-09-18T18:52:24.215541] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-18T18:52:24.525792] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-18T18:52:24.633359] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-09-18T18:52:24.633446] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-09-18T18:52:24.634113] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-09-18T18:52:24.634180] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-09-18T18:52:24.635266] [DEBUG] [LOCAL ] ESS: Trimmed 43248 records to 30329 (keeping 200 days of data) [2025-09-18T18:52:24.847572] [DEBUG] [LOCAL ] ESS: Primary data saved (30329 records). [2025-09-18T18:52:24.847753] [INFO ] [MAIN ] ESS: Full history saved. [2025-09-18T18:52:24.847866] [INFO ] [MAIN ] Update Progress: 771/2372 symbols completed. ESS took 27.4s. Estimated remaining: 3h 53m 19s. Rate: 6.9 symbols/min [2025-09-18T18:52:25.027684] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:52:25.056736] [DEBUG] [LOCAL ] ETD: Loaded 27396 existing records from primary storage. [2025-09-18T18:52:25.057051] [INFO ] [MAIN ] ETD: Loaded 27396 existing records. [2025-09-18T18:52:25.240469] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:52:25.241065] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-18T18:52:25.241146] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-18T18:52:25.242193] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-18T18:52:25.242259] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-18T18:52:25.328112] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-18T18:52:25.432161] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-18T18:52:25.498481] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-18T18:52:25.671453] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:52:26.119552] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-18T18:52:26.919557] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-18T18:52:27.719632] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-11. [2025-09-18T18:52:27.764022] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-18T18:52:27.838869] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-18T18:52:27.911003] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-18T18:52:28.490426] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-18T18:52:28.519502] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-09-18T18:52:29.319598] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-18T18:52:29.584561] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-18T18:52:30.119546] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-18T18:52:30.819210] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T18:52:30.919562] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-18T18:52:31.702269] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-18T18:52:31.719514] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-18T18:52:31.966586] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-18T18:52:32.222878] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-18T18:52:32.519565] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-18T18:52:33.319541] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-18T18:52:34.103453] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-18T18:52:34.119502] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-18T18:52:34.225946] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-18T18:52:34.919556] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-18T18:52:35.572242] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-18T18:52:35.574022] [INFO ] [REMOTE ] ETB: Full fetch complete (17786 records). [2025-09-18T18:52:35.574114] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-18T18:52:35.724725] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-18T18:52:35.980512] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-09-18T18:52:35.980621] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-09-18T18:52:35.981132] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-09-18T18:52:35.981188] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-09-18T18:52:35.982033] [DEBUG] [LOCAL ] ETB: Trimmed 17786 records to 12286 (keeping 200 days of data) [2025-09-18T18:52:36.070625] [DEBUG] [LOCAL ] ETB: Primary data saved (12286 records). [2025-09-18T18:52:36.071221] [INFO ] [MAIN ] ETB: Full history saved. [2025-09-18T18:52:36.071437] [INFO ] [MAIN ] Update Progress: 772/2372 symbols completed. ETB took 28.1s. Estimated remaining: 3h 53m 15s. Rate: 6.9 symbols/min [2025-09-18T18:52:36.271922] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:52:36.293276] [DEBUG] [LOCAL ] ETG: Loaded 17040 existing records from primary storage. [2025-09-18T18:52:36.293535] [INFO ] [MAIN ] ETG: Loaded 17040 existing records. [2025-09-18T18:52:36.448462] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-18T18:52:36.525957] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-18T18:52:36.550012] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:52:36.551252] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-18T18:52:36.551334] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-18T18:52:36.552398] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-09-18T18:52:36.552521] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-18T18:52:36.946491] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:52:37.179452] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T18:52:37.319553] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-18T18:52:38.119598] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-11. [2025-09-18T18:52:38.519014] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-18T18:52:38.919595] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-09-18T18:52:38.935360] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-18T18:52:39.109466] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-18T18:52:39.119511] [INFO ] [REMOTE ] ESTC: Full fetch complete (72103 records). [2025-09-18T18:52:39.119738] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-18T18:52:39.538789] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-18T18:52:39.538874] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-18T18:52:39.539723] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-18T18:52:39.539792] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-18T18:52:39.541300] [DEBUG] [LOCAL ] ESTC: Trimmed 72103 records to 50598 (keeping 200 days of data) [2025-09-18T18:52:39.725331] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-18T18:52:39.864831] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T18:52:39.889090] [DEBUG] [LOCAL ] ESTC: Primary data saved (50598 records). [2025-09-18T18:52:39.889205] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-18T18:52:39.889311] [INFO ] [MAIN ] Update Progress: 773/2372 symbols completed. ESTC took 39.5s. Estimated remaining: 3h 52m 56s. Rate: 6.9 symbols/min [2025-09-18T18:52:40.079601] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:52:40.097635] [DEBUG] [LOCAL ] ETJ: Loaded 16934 existing records from primary storage. [2025-09-18T18:52:40.097805] [INFO ] [MAIN ] ETJ: Loaded 16934 existing records. [2025-09-18T18:52:40.283330] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:52:40.283609] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-18T18:52:40.283718] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-18T18:52:40.284200] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-09-18T18:52:40.284260] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-18T18:52:40.527906] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-18T18:52:40.648359] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:52:41.319590] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-11. [2025-09-18T18:52:41.620439] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-18T18:52:42.064208] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-18T18:52:42.071953] [INFO ] [REMOTE ] ET: Full fetch complete (77946 records). [2025-09-18T18:52:42.072134] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-18T18:52:42.125904] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-09-18T18:52:42.254191] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-18T18:52:42.502514] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-09-18T18:52:42.502616] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-09-18T18:52:42.503460] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-09-18T18:52:42.503524] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-09-18T18:52:42.505226] [DEBUG] [LOCAL ] ET: Trimmed 77946 records to 54179 (keeping 200 days of data) [2025-09-18T18:52:42.855002] [DEBUG] [LOCAL ] ET: Primary data saved (54179 records). [2025-09-18T18:52:42.855143] [INFO ] [MAIN ] ET: Full history saved. [2025-09-18T18:52:42.855976] [INFO ] [MAIN ] Update Progress: 774/2372 symbols completed. ET took 39.9s. Estimated remaining: 3h 52m 36s. Rate: 6.9 symbols/min [2025-09-18T18:52:42.924620] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-18T18:52:43.035338] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:52:43.090822] [DEBUG] [LOCAL ] ETN: Loaded 52875 existing records from primary storage. [2025-09-18T18:52:43.090981] [INFO ] [MAIN ] ETN: Loaded 52875 existing records. [2025-09-18T18:52:43.288824] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:52:43.289209] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-18T18:52:43.289345] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-18T18:52:43.299185] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-18T18:52:43.299325] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-18T18:52:43.305350] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-18T18:52:43.677982] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:52:43.719543] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-09-18T18:52:43.934048] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-18T18:52:44.361281] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-18T18:52:44.519602] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-18T18:52:45.319563] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-11. [2025-09-18T18:52:45.623050] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-18T18:52:46.119606] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-09-18T18:52:46.911458] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-18T18:52:46.919486] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-18T18:52:47.178296] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-18T18:52:47.613531] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-18T18:52:47.719549] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-09-18T18:52:48.519558] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-18T18:52:49.319513] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-09-18T18:52:49.356639] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-18T18:52:49.513293] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-18T18:52:50.119523] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-09-18T18:52:50.139190] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T18:52:50.919605] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-18T18:52:51.719572] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-18T18:52:51.914059] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-18T18:52:51.944228] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-18T18:52:52.420770] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-18T18:52:52.519574] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-18T18:52:53.319568] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-18T18:52:53.532067] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-18T18:52:54.119610] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-18T18:52:54.919523] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-18T18:52:55.169149] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-18T18:52:55.195417] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-18T18:52:55.621553] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-18T18:52:55.719504] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-18T18:52:56.519581] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-18T18:52:57.262892] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-18T18:52:57.319548] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-18T18:52:57.777630] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-18T18:52:58.031701] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-18T18:52:58.119604] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-18T18:52:58.919611] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-18T18:52:59.209585] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-18T18:52:59.211995] [INFO ] [REMOTE ] ETG: Full fetch complete (25124 records). [2025-09-18T18:52:59.212069] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-18T18:52:59.589626] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-09-18T18:52:59.589766] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-09-18T18:52:59.590219] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-18T18:52:59.590282] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-09-18T18:52:59.591131] [DEBUG] [LOCAL ] ETG: Trimmed 25124 records to 17132 (keeping 200 days of data) [2025-09-18T18:52:59.700218] [DEBUG] [LOCAL ] ETG: Primary data saved (17132 records). [2025-09-18T18:52:59.700359] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-18T18:52:59.700448] [INFO ] [MAIN ] Update Progress: 775/2372 symbols completed. ETG took 23.6s. Estimated remaining: 3h 52m 44s. Rate: 6.9 symbols/min [2025-09-18T18:52:59.724678] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-18T18:52:59.881328] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:52:59.890579] [DEBUG] [LOCAL ] ETO: Loaded 6633 existing records from primary storage. [2025-09-18T18:52:59.890723] [INFO ] [MAIN ] ETO: Loaded 6633 existing records. [2025-09-18T18:53:00.067058] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:53:00.067302] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-18T18:53:00.067355] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-18T18:53:00.067698] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-09-18T18:53:00.067760] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-18T18:53:00.429033] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:53:00.519511] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-11. [2025-09-18T18:53:01.220235] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-18T18:53:01.319541] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-09-18T18:53:01.571336] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-18T18:53:01.660136] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-18T18:53:02.000802] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (3.08 seconds). [2025-09-18T18:53:02.119572] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-09-18T18:53:02.596743] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-18T18:53:02.919563] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-18T18:53:03.719586] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-18T18:53:04.154358] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-18T18:53:04.367791] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-18T18:53:04.519593] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-18T18:53:05.319553] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-18T18:53:05.606546] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-18T18:53:06.119568] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-18T18:53:06.729519] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-18T18:53:06.894577] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T18:53:06.919498] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-18T18:53:07.719584] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-18T18:53:08.458724] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-18T18:53:08.519569] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-18T18:53:08.793711] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-18T18:53:09.168328] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-18T18:53:09.319533] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-18T18:53:09.746291] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-18T18:53:10.119548] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-18T18:53:10.919593] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-18T18:53:11.719569] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-18T18:53:11.898808] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-18T18:53:12.087777] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-18T18:53:12.519511] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-18T18:53:12.551845] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-18T18:53:13.230031] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-18T18:53:13.319554] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-18T18:53:14.119574] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-18T18:53:14.919629] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-18T18:53:15.520002] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T18:53:15.719526] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-18T18:53:16.138743] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-09-18T18:53:16.162241] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-18T18:53:16.453068] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-18T18:53:16.455963] [INFO ] [REMOTE ] ETJ: Full fetch complete (24863 records). [2025-09-18T18:53:16.456056] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-18T18:53:16.524699] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-18T18:53:16.829136] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-09-18T18:53:16.829225] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-09-18T18:53:16.829639] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-18T18:53:16.829726] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-09-18T18:53:16.830586] [DEBUG] [LOCAL ] ETJ: Trimmed 24863 records to 17115 (keeping 200 days of data) [2025-09-18T18:53:16.930720] [DEBUG] [LOCAL ] ETJ: Primary data saved (17115 records). [2025-09-18T18:53:16.930872] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-18T18:53:16.930963] [INFO ] [MAIN ] Update Progress: 776/2372 symbols completed. ETJ took 37.0s. Estimated remaining: 3h 52m 52s. Rate: 6.9 symbols/min [2025-09-18T18:53:17.098227] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:53:17.152842] [DEBUG] [LOCAL ] ETR: Loaded 53245 existing records from primary storage. [2025-09-18T18:53:17.153053] [INFO ] [MAIN ] ETR: Loaded 53245 existing records. [2025-09-18T18:53:17.325303] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-18T18:53:17.331666] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:53:17.331881] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-18T18:53:17.331946] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-18T18:53:17.333311] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-09-18T18:53:17.333406] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-18T18:53:17.686990] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:53:17.981181] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T18:53:17.985532] [INFO ] [REMOTE ] ETD: Full fetch complete (37835 records). [2025-09-18T18:53:17.985615] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-18T18:53:18.125679] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-11. [2025-09-18T18:53:18.361370] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-18T18:53:18.361444] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-18T18:53:18.361960] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-18T18:53:18.362022] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-18T18:53:18.362865] [DEBUG] [LOCAL ] ETD: Trimmed 37835 records to 27603 (keeping 200 days of data) [2025-09-18T18:53:18.522323] [DEBUG] [LOCAL ] ETD: Primary data saved (27603 records). [2025-09-18T18:53:18.522455] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-18T18:53:18.522539] [INFO ] [MAIN ] Update Progress: 777/2372 symbols completed. ETD took 53.7s. Estimated remaining: 3h 52m 29s. Rate: 6.9 symbols/min [2025-09-18T18:53:18.689562] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:53:18.711788] [DEBUG] [LOCAL ] ETV: Loaded 21538 existing records from primary storage. [2025-09-18T18:53:18.711935] [INFO ] [MAIN ] ETV: Loaded 21538 existing records. [2025-09-18T18:53:18.893914] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:53:18.894180] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-18T18:53:18.894242] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-18T18:53:18.894873] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-09-18T18:53:18.894934] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-18T18:53:18.926168] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-18T18:53:19.254304] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:53:19.283581] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-18T18:53:19.290812] [INFO ] [REMOTE ] ETN: Full fetch complete (76436 records). [2025-09-18T18:53:19.290929] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-18T18:53:19.696462] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-18T18:53:19.696586] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-18T18:53:19.697601] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-18T18:53:19.697703] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-18T18:53:19.699744] [DEBUG] [LOCAL ] ETN: Trimmed 76436 records to 53258 (keeping 200 days of data) [2025-09-18T18:53:19.759179] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-11. [2025-09-18T18:53:20.029619] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-18T18:53:20.127246] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-18T18:53:20.262726] [DEBUG] [LOCAL ] ETN: Primary data saved (53258 records). [2025-09-18T18:53:20.262950] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-18T18:53:20.263957] [INFO ] [MAIN ] Update Progress: 778/2372 symbols completed. ETN took 37.4s. Estimated remaining: 3h 52m 6s. Rate: 6.9 symbols/min [2025-09-18T18:53:20.519632] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:53:20.519827] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-09-18T18:53:20.548260] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-18T18:53:20.581555] [DEBUG] [LOCAL ] ETW: Loaded 25306 existing records from primary storage. [2025-09-18T18:53:20.581777] [INFO ] [MAIN ] ETW: Loaded 25306 existing records. [2025-09-18T18:53:20.865276] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:53:20.865536] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-18T18:53:20.865585] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-18T18:53:20.866292] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-18T18:53:20.866353] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-18T18:53:21.231149] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:53:21.319592] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-09-18T18:53:22.119516] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-18T18:53:22.312938] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-18T18:53:22.491760] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-18T18:53:22.690493] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-18T18:53:22.919539] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-18T18:53:23.436106] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-18T18:53:23.719565] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-09-18T18:53:24.519547] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-11. [2025-09-18T18:53:24.894477] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T18:53:25.319547] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-09-18T18:53:25.429081] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-18T18:53:26.119547] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-18T18:53:26.836679] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-18T18:53:26.838036] [INFO ] [REMOTE ] ETO: Full fetch complete (9288 records). [2025-09-18T18:53:26.838108] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-18T18:53:26.929449] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-18T18:53:27.239253] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-09-18T18:53:27.239392] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-09-18T18:53:27.239726] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-09-18T18:53:27.239827] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-09-18T18:53:27.240460] [DEBUG] [LOCAL ] ETO: Trimmed 9288 records to 6678 (keeping 200 days of data) [2025-09-18T18:53:27.282376] [DEBUG] [LOCAL ] ETO: Primary data saved (6678 records). [2025-09-18T18:53:27.282513] [INFO ] [MAIN ] ETO: Full history saved. [2025-09-18T18:53:27.282631] [INFO ] [MAIN ] Update Progress: 779/2372 symbols completed. ETO took 27.6s. Estimated remaining: 3h 51m 53s. Rate: 6.9 symbols/min [2025-09-18T18:53:27.429746] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-18T18:53:27.493119] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:53:27.501108] [DEBUG] [LOCAL ] ETX: Loaded 4905 existing records from primary storage. [2025-09-18T18:53:27.501211] [INFO ] [MAIN ] ETX: Loaded 4905 existing records. [2025-09-18T18:53:27.709754] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:53:27.710084] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-18T18:53:27.710140] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-18T18:53:27.710377] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-09-18T18:53:27.710439] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-18T18:53:27.727091] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-09-18T18:53:28.068712] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T18:53:28.109554] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:53:28.519548] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-11. [2025-09-18T18:53:28.830479] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-18T18:53:29.078717] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-18T18:53:29.319550] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-09-18T18:53:29.985132] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-18T18:53:30.119500] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-18T18:53:30.919588] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-09-18T18:53:31.719543] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-09-18T18:53:31.842062] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-18T18:53:31.866511] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T18:53:32.060574] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-18T18:53:32.519544] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-18T18:53:33.062801] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-18T18:53:33.319600] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-18T18:53:34.119585] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-18T18:53:34.864430] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-18T18:53:34.889325] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-18T18:53:34.919491] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-18T18:53:35.719575] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-18T18:53:36.152350] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-18T18:53:36.151831] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-18T18:53:36.519587] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-18T18:53:37.066843] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-18T18:53:37.319511] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-18T18:53:37.826376] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-18T18:53:38.119540] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-18T18:53:38.919553] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-18T18:53:39.719561] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-18T18:53:39.720715] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-18T18:53:40.008449] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-18T18:53:40.375441] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-18T18:53:40.519582] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-18T18:53:41.319540] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-18T18:53:41.613838] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-18T18:53:42.119553] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-18T18:53:42.910614] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-18T18:53:42.922693] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-18T18:53:43.156580] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-18T18:53:43.719553] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-18T18:53:43.983012] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-18T18:53:44.057069] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-18T18:53:44.519551] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-18T18:53:45.272172] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-18T18:53:45.319552] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-18T18:53:46.119563] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-18T18:53:46.331615] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-18T18:53:46.919541] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-18T18:53:47.689021] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-18T18:53:47.719502] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-18T18:53:47.985834] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-18T18:53:48.519637] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-18T18:53:49.319557] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-18T18:53:49.365598] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-18T18:53:49.391801] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-18T18:53:50.119527] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-18T18:53:50.254896] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-18T18:53:50.850226] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-18T18:53:50.851693] [INFO ] [REMOTE ] ETX: Full fetch complete (6974 records). [2025-09-18T18:53:50.851766] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-18T18:53:50.924668] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-18T18:53:51.212660] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-09-18T18:53:51.212755] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-09-18T18:53:51.212952] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-09-18T18:53:51.212994] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-09-18T18:53:51.213388] [DEBUG] [LOCAL ] ETX: Trimmed 6974 records to 4940 (keeping 200 days of data) [2025-09-18T18:53:51.243401] [DEBUG] [LOCAL ] ETX: Primary data saved (4940 records). [2025-09-18T18:53:51.243497] [INFO ] [MAIN ] ETX: Full history saved. [2025-09-18T18:53:51.243579] [INFO ] [MAIN ] Update Progress: 780/2372 symbols completed. ETX took 24.0s. Estimated remaining: 3h 52m 16s. Rate: 6.9 symbols/min [2025-09-18T18:53:51.409899] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:53:51.435538] [DEBUG] [LOCAL ] ETY: Loaded 23047 existing records from primary storage. [2025-09-18T18:53:51.435701] [INFO ] [MAIN ] ETY: Loaded 23047 existing records. [2025-09-18T18:53:51.620420] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:53:51.620734] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-18T18:53:51.620803] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-18T18:53:51.621463] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-09-18T18:53:51.621522] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-18T18:53:51.725078] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-18T18:53:51.996533] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:53:52.519545] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-11. [2025-09-18T18:53:52.665922] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-18T18:53:52.764833] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-18T18:53:53.319559] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-18T18:53:53.447914] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-18T18:53:54.119527] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-18T18:53:54.263444] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-18T18:53:54.919584] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-18T18:53:55.719587] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-18T18:53:55.906115] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-18T18:53:55.914357] [INFO ] [REMOTE ] ETR: Full fetch complete (76783 records). [2025-09-18T18:53:55.914508] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-18T18:53:56.249581] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-18T18:53:56.367985] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-09-18T18:53:56.368076] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-09-18T18:53:56.368908] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-09-18T18:53:56.368984] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-09-18T18:53:56.370487] [DEBUG] [LOCAL ] ETR: Trimmed 76783 records to 53626 (keeping 200 days of data) [2025-09-18T18:53:56.564612] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-18T18:53:56.611292] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-18T18:53:56.616410] [INFO ] [REMOTE ] ETV: Full fetch complete (31807 records). [2025-09-18T18:53:56.617087] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-18T18:53:57.036038] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-09-18T18:53:57.036388] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-09-18T18:53:57.036990] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-09-18T18:53:57.037685] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-09-18T18:53:57.041302] [DEBUG] [LOCAL ] ETV: Trimmed 31807 records to 21803 (keeping 200 days of data) [2025-09-18T18:53:57.257471] [DEBUG] [LOCAL ] ETR: Primary data saved (53626 records). [2025-09-18T18:53:57.258688] [INFO ] [MAIN ] ETR: Full history saved. [2025-09-18T18:53:57.258841] [INFO ] [MAIN ] Update Progress: 781/2372 symbols completed. ETR took 40.3s. Estimated remaining: 3h 52m 1s. Rate: 6.9 symbols/min [2025-09-18T18:53:57.320501] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-09-18T18:53:57.460666] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:53:57.463979] [DEBUG] [LOCAL ] ETV: Primary data saved (21803 records). [2025-09-18T18:53:57.464120] [INFO ] [MAIN ] ETV: Full history saved. [2025-09-18T18:53:57.464216] [INFO ] [MAIN ] Update Progress: 782/2372 symbols completed. ETV took 38.9s. Estimated remaining: 3h 51m 35s. Rate: 6.9 symbols/min [2025-09-18T18:53:57.661740] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:53:57.658108] [DEBUG] [LOCAL ] EVC: Loaded 20341 existing records from primary storage. [2025-09-18T18:53:57.671283] [INFO ] [MAIN ] EVC: Loaded 20341 existing records. [2025-09-18T18:53:57.672897] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-18T18:53:57.697987] [INFO ] [REMOTE ] ETW: Full fetch complete (36322 records). [2025-09-18T18:53:57.724838] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-18T18:53:57.978216] [DEBUG] [LOCAL ] EVEX: Loaded 29040 existing records from primary storage. [2025-09-18T18:53:58.006814] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:53:58.006921] [INFO ] [MAIN ] EVEX: Loaded 29040 existing records. [2025-09-18T18:53:58.065467] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-18T18:53:58.070836] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-18T18:53:58.140817] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-09-18T18:53:58.141119] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-18T18:53:58.506506] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:53:58.603397] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-18T18:53:58.617774] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-18T18:53:58.657359] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-09-18T18:53:58.681930] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-18T18:53:58.691813] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-18T18:53:58.699149] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-18T18:53:58.716271] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-18T18:53:58.716396] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-18T18:53:58.760192] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-18T18:53:58.836182] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-09-18T18:53:58.863741] [DEBUG] [LOCAL ] ETW: Trimmed 36322 records to 25572 (keeping 200 days of data) [2025-09-18T18:53:59.232565] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:53:59.258171] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-11. [2025-09-18T18:53:59.424625] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:53:59.440798] [DEBUG] [LOCAL ] ETW: Primary data saved (25572 records). [2025-09-18T18:53:59.440886] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-18T18:53:59.441021] [INFO ] [MAIN ] Update Progress: 783/2372 symbols completed. ETW took 39.2s. Estimated remaining: 3h 51m 13s. Rate: 6.9 symbols/min [2025-09-18T18:53:59.626534] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:53:59.636716] [DEBUG] [LOCAL ] EVF: Loaded 9070 existing records from primary storage. [2025-09-18T18:53:59.636843] [INFO ] [MAIN ] EVF: Loaded 9070 existing records. [2025-09-18T18:53:59.724635] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-11. [2025-09-18T18:53:59.830803] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:53:59.831193] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-18T18:53:59.831399] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-18T18:53:59.831930] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-18T18:53:59.832028] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-18T18:53:59.924027] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-18T18:54:00.230695] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-18T18:54:00.251586] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:54:00.519507] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-18T18:54:00.884297] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-18T18:54:01.319563] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-11. [2025-09-18T18:54:01.802983] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-18T18:54:02.119566] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-09-18T18:54:02.718863] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-18T18:54:02.919567] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-09-18T18:54:03.719597] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-18T18:54:04.421431] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T18:54:04.519550] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-09-18T18:54:04.613869] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-18T18:54:04.961428] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-18T18:54:05.046960] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-18T18:54:05.319601] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-09-18T18:54:06.119589] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-18T18:54:06.475492] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-18T18:54:06.598829] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-18T18:54:06.919577] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-09-18T18:54:07.719630] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-18T18:54:08.283255] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T18:54:08.412750] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-18T18:54:08.519554] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-18T18:54:09.319563] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-09-18T18:54:09.721468] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-18T18:54:10.119580] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-18T18:54:10.513692] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-18T18:54:10.919549] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-18T18:54:11.187792] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-18T18:54:11.719565] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-18T18:54:12.103053] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-18T18:54:12.385819] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-18T18:54:12.519753] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-18T18:54:13.319562] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-18T18:54:14.119560] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-18T18:54:14.176633] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T18:54:14.919586] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-18T18:54:15.027344] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-18T18:54:15.719554] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-18T18:54:15.967836] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-18T18:54:16.083917] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-18T18:54:16.519526] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-18T18:54:16.655127] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T18:54:17.319533] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-18T18:54:17.678297] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-18T18:54:18.050135] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-18T18:54:18.119548] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-18T18:54:18.919578] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-18T18:54:18.954457] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-18T18:54:19.719557] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-18T18:54:19.746903] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-18T18:54:20.519557] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-18T18:54:20.608069] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T18:54:21.310791] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-18T18:54:21.319492] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-18T18:54:22.032018] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-18T18:54:22.119543] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-18T18:54:22.919514] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-18T18:54:23.095698] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-18T18:54:23.098824] [INFO ] [REMOTE ] EVC: Full fetch complete (31313 records). [2025-09-18T18:54:23.098922] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-18T18:54:23.477819] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-09-18T18:54:23.477900] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-09-18T18:54:23.478604] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-09-18T18:54:23.478699] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-09-18T18:54:23.480143] [DEBUG] [LOCAL ] EVC: Trimmed 31313 records to 20499 (keeping 200 days of data) [2025-09-18T18:54:23.538300] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-18T18:54:23.612122] [DEBUG] [LOCAL ] EVC: Primary data saved (20499 records). [2025-09-18T18:54:23.612261] [INFO ] [MAIN ] EVC: Full history saved. [2025-09-18T18:54:23.612367] [INFO ] [MAIN ] Update Progress: 784/2372 symbols completed. EVC took 26.4s. Estimated remaining: 3h 51m 35s. Rate: 6.9 symbols/min [2025-09-18T18:54:23.724741] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-18T18:54:23.785385] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:54:23.793617] [DEBUG] [LOCAL ] EVG: Loaded 5837 existing records from primary storage. [2025-09-18T18:54:23.793796] [INFO ] [MAIN ] EVG: Loaded 5837 existing records. [2025-09-18T18:54:23.976694] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:54:23.976962] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-18T18:54:23.977010] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-18T18:54:23.977387] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-09-18T18:54:23.977451] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-18T18:54:24.344796] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:54:24.519568] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-11. [2025-09-18T18:54:24.739035] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-18T18:54:25.084333] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-18T18:54:25.319542] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-18T18:54:26.119560] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-09-18T18:54:26.695213] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-18T18:54:26.724683] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-18T18:54:26.919565] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-18T18:54:27.680815] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-18T18:54:27.719553] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-18T18:54:28.246293] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-18T18:54:28.519548] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-18T18:54:29.278898] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-18T18:54:29.319582] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-09-18T18:54:29.908360] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-18T18:54:30.119558] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-18T18:54:30.919566] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-18T18:54:31.115202] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-18T18:54:31.119182] [INFO ] [REMOTE ] ETY: Full fetch complete (34402 records). [2025-09-18T18:54:31.119275] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-18T18:54:31.482683] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-18T18:54:31.528570] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-09-18T18:54:31.528770] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-09-18T18:54:31.529576] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-09-18T18:54:31.529698] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-09-18T18:54:31.530788] [DEBUG] [LOCAL ] ETY: Trimmed 34402 records to 23221 (keeping 200 days of data) [2025-09-18T18:54:31.693908] [DEBUG] [LOCAL ] ETY: Primary data saved (23221 records). [2025-09-18T18:54:31.694055] [INFO ] [MAIN ] ETY: Full history saved. [2025-09-18T18:54:31.694226] [INFO ] [MAIN ] Update Progress: 785/2372 symbols completed. ETY took 40.5s. Estimated remaining: 3h 51m 25s. Rate: 6.9 symbols/min [2025-09-18T18:54:31.724751] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-18T18:54:31.896452] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:54:31.948133] [DEBUG] [LOCAL ] EVH: Loaded 49333 existing records from primary storage. [2025-09-18T18:54:31.948303] [INFO ] [MAIN ] EVH: Loaded 49333 existing records. [2025-09-18T18:54:32.133247] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:54:32.133528] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-18T18:54:32.133591] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-18T18:54:32.134927] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-09-18T18:54:32.135003] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-18T18:54:32.427214] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-18T18:54:32.503796] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:54:32.519510] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-11. [2025-09-18T18:54:33.319560] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-18T18:54:33.749911] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-18T18:54:34.119546] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-18T18:54:34.396286] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-18T18:54:34.630444] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-18T18:54:34.919567] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-09-18T18:54:35.719551] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-18T18:54:36.275611] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T18:54:36.519561] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-18T18:54:37.007975] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-18T18:54:37.313148] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T18:54:37.321537] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-09-18T18:54:38.119590] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-18T18:54:38.919551] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-18T18:54:38.956465] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-18T18:54:38.981329] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-18T18:54:38.983254] [INFO ] [REMOTE ] EVF: Full fetch complete (11664 records). [2025-09-18T18:54:38.983450] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-18T18:54:39.357580] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-18T18:54:39.357743] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-18T18:54:39.358061] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-18T18:54:39.358103] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-18T18:54:39.358560] [DEBUG] [LOCAL ] EVF: Trimmed 11664 records to 9156 (keeping 200 days of data) [2025-09-18T18:54:39.419869] [DEBUG] [LOCAL ] EVF: Primary data saved (9156 records). [2025-09-18T18:54:39.420028] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-18T18:54:39.420163] [INFO ] [MAIN ] Update Progress: 786/2372 symbols completed. EVF took 40.0s. Estimated remaining: 3h 51m 14s. Rate: 6.9 symbols/min [2025-09-18T18:54:39.590413] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:54:39.606804] [DEBUG] [LOCAL ] EVN: Loaded 10928 existing records from primary storage. [2025-09-18T18:54:39.606925] [INFO ] [MAIN ] EVN: Loaded 10928 existing records. [2025-09-18T18:54:39.724701] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-18T18:54:39.789435] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:54:39.789723] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-18T18:54:39.789781] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-18T18:54:39.790407] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-09-18T18:54:39.790470] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-18T18:54:40.216765] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:54:40.253505] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-18T18:54:40.519540] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-18T18:54:40.589297] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-18T18:54:40.596134] [INFO ] [REMOTE ] EVEX: Full fetch complete (41142 records). [2025-09-18T18:54:40.596238] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-18T18:54:40.994233] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-09-18T18:54:40.998486] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-09-18T18:54:40.999773] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-18T18:54:40.999541] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-09-18T18:54:41.001943] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-09-18T18:54:41.002851] [DEBUG] [LOCAL ] EVEX: Trimmed 41142 records to 29397 (keeping 200 days of data) [2025-09-18T18:54:41.181449] [DEBUG] [LOCAL ] EVEX: Primary data saved (29397 records). [2025-09-18T18:54:41.181587] [INFO ] [MAIN ] EVEX: Full history saved. [2025-09-18T18:54:41.181704] [INFO ] [MAIN ] Update Progress: 787/2372 symbols completed. EVEX took 43.7s. Estimated remaining: 3h 50m 52s. Rate: 6.9 symbols/min [2025-09-18T18:54:41.327522] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-18T18:54:41.361960] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:54:41.409025] [DEBUG] [LOCAL ] EVR: Loaded 35950 existing records from primary storage. [2025-09-18T18:54:41.409204] [INFO ] [MAIN ] EVR: Loaded 35950 existing records. [2025-09-18T18:54:41.588782] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:54:41.589042] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-18T18:54:41.589090] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-18T18:54:41.590255] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-09-18T18:54:41.590319] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-18T18:54:41.954519] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:54:42.119547] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-11. [2025-09-18T18:54:42.577902] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T18:54:42.919549] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-18T18:54:43.421087] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-18T18:54:43.497097] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-18T18:54:43.719552] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-18T18:54:44.519553] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-11. [2025-09-18T18:54:45.122716] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-18T18:54:45.130818] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-18T18:54:45.319569] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-09-18T18:54:45.934842] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-18T18:54:46.119541] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-09-18T18:54:46.919538] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-09-18T18:54:46.935002] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T18:54:47.719563] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-18T18:54:48.268297] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-18T18:54:48.269905] [INFO ] [REMOTE ] EVG: Full fetch complete (8055 records). [2025-09-18T18:54:48.269979] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-18T18:54:48.525607] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-18T18:54:48.543599] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-18T18:54:48.675960] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-09-18T18:54:48.676038] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-09-18T18:54:48.676242] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-09-18T18:54:48.676280] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-09-18T18:54:48.676718] [DEBUG] [LOCAL ] EVG: Trimmed 8055 records to 5860 (keeping 200 days of data) [2025-09-18T18:54:48.717176] [DEBUG] [LOCAL ] EVG: Primary data saved (5860 records). [2025-09-18T18:54:48.717273] [INFO ] [MAIN ] EVG: Full history saved. [2025-09-18T18:54:48.717376] [INFO ] [MAIN ] Update Progress: 788/2372 symbols completed. EVG took 25.1s. Estimated remaining: 3h 50m 40s. Rate: 6.9 symbols/min [2025-09-18T18:54:48.886035] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:54:48.907954] [DEBUG] [LOCAL ] EVT: Loaded 17711 existing records from primary storage. [2025-09-18T18:54:48.908080] [INFO ] [MAIN ] EVT: Loaded 17711 existing records. [2025-09-18T18:54:49.084181] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:54:49.084435] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-18T18:54:49.084491] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-18T18:54:49.085280] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-09-18T18:54:49.085341] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-18T18:54:49.328615] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-18T18:54:49.447135] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:54:49.979429] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-18T18:54:50.010715] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-18T18:54:50.119505] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-18T18:54:50.919567] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-11. [2025-09-18T18:54:51.495701] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-18T18:54:51.518761] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-18T18:54:51.719560] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-18T18:54:52.519557] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-09-18T18:54:53.279371] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-18T18:54:53.319496] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-18T18:54:53.684863] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T18:54:54.119562] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-18T18:54:54.828728] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-18T18:54:54.919549] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-18T18:54:55.054375] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-18T18:54:55.426218] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-18T18:54:55.719549] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-18T18:54:56.519556] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-09-18T18:54:56.957638] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-18T18:54:57.319555] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-18T18:54:57.520240] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-18T18:54:58.015285] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-18T18:54:58.119499] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-18T18:54:58.716582] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-18T18:54:58.919588] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-09-18T18:54:59.719563] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-18T18:54:59.959028] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-18T18:55:00.519548] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-18T18:55:01.319887] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-18T18:55:01.320801] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-18T18:55:01.353535] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-18T18:55:02.119559] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-18T18:55:02.834974] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-18T18:55:02.919568] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-18T18:55:03.230559] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-18T18:55:03.719574] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-18T18:55:04.130741] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-18T18:55:04.139015] [INFO ] [REMOTE ] EVH: Full fetch complete (71559 records). [2025-09-18T18:55:04.139158] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-18T18:55:04.523347] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-18T18:55:04.659509] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-09-18T18:55:04.660582] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-09-18T18:55:04.662804] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T18:55:04.661594] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-09-18T18:55:04.662981] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-09-18T18:55:04.669625] [DEBUG] [LOCAL ] EVH: Trimmed 71559 records to 49711 (keeping 200 days of data) [2025-09-18T18:55:05.090196] [DEBUG] [LOCAL ] EVH: Primary data saved (49711 records). [2025-09-18T18:55:05.090426] [INFO ] [MAIN ] EVH: Full history saved. [2025-09-18T18:55:05.090547] [INFO ] [MAIN ] Update Progress: 789/2372 symbols completed. EVH took 33.4s. Estimated remaining: 3h 50m 47s. Rate: 6.9 symbols/min [2025-09-18T18:55:05.331513] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-18T18:55:05.336795] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:55:05.370206] [DEBUG] [LOCAL ] EVTC: Loaded 26671 existing records from primary storage. [2025-09-18T18:55:05.370792] [INFO ] [MAIN ] EVTC: Loaded 26671 existing records. [2025-09-18T18:55:05.618027] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:55:05.618304] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-18T18:55:05.618357] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-18T18:55:05.619235] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-09-18T18:55:05.619302] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-18T18:55:06.004607] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:55:06.052508] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-18T18:55:06.119557] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-18T18:55:06.306677] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-18T18:55:06.825121] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-18T18:55:06.827287] [INFO ] [REMOTE ] EVN: Full fetch complete (17449 records). [2025-09-18T18:55:06.827362] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-18T18:55:06.926409] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-18T18:55:07.217757] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-09-18T18:55:07.217849] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-09-18T18:55:07.218238] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-09-18T18:55:07.218282] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-09-18T18:55:07.218867] [DEBUG] [LOCAL ] EVN: Trimmed 17449 records to 11003 (keeping 200 days of data) [2025-09-18T18:55:07.292166] [DEBUG] [LOCAL ] EVN: Primary data saved (11003 records). [2025-09-18T18:55:07.292324] [INFO ] [MAIN ] EVN: Full history saved. [2025-09-18T18:55:07.292418] [INFO ] [MAIN ] Update Progress: 790/2372 symbols completed. EVN took 27.9s. Estimated remaining: 3h 50m 25s. Rate: 6.9 symbols/min [2025-09-18T18:55:07.467853] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:55:07.508242] [DEBUG] [LOCAL ] EVTL: Loaded 36355 existing records from primary storage. [2025-09-18T18:55:07.508422] [INFO ] [MAIN ] EVTL: Loaded 36355 existing records. [2025-09-18T18:55:07.690376] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:55:07.690733] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-18T18:55:07.690795] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-18T18:55:07.691750] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-09-18T18:55:07.691816] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-18T18:55:07.724986] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-11. [2025-09-18T18:55:08.080316] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:55:08.438266] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-18T18:55:08.519546] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-18T18:55:08.606084] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-18T18:55:09.319555] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-09-18T18:55:09.522316] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-18T18:55:10.119564] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-18T18:55:10.328055] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-18T18:55:10.919549] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-09-18T18:55:11.612127] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-18T18:55:11.728263] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-11. [2025-09-18T18:55:11.729772] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-18T18:55:12.519521] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-18T18:55:12.897568] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-18T18:55:13.272671] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-18T18:55:13.319524] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-18T18:55:14.119550] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-18T18:55:14.414834] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-18T18:55:14.924699] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-09-18T18:55:14.938844] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-18T18:55:15.719557] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-18T18:55:16.202115] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-18T18:55:16.519553] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-18T18:55:16.662310] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-18T18:55:17.099715] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-18T18:55:17.319577] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-18T18:55:18.032565] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-18T18:55:18.119585] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-18T18:55:18.919576] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-18T18:55:19.158715] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-18T18:55:19.719507] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-18T18:55:19.907190] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-18T18:55:20.519526] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-09-18T18:55:20.634912] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-18T18:55:21.319543] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-18T18:55:21.882972] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-18T18:55:21.945239] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T18:55:22.119547] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-18T18:55:22.919541] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-18T18:55:23.156751] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-18T18:55:23.524192] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-18T18:55:23.526769] [INFO ] [REMOTE ] EVT: Full fetch complete (25551 records). [2025-09-18T18:55:23.526857] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-18T18:55:23.724777] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-18T18:55:23.914089] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-09-18T18:55:23.914216] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-09-18T18:55:23.914824] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-09-18T18:55:23.914906] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-09-18T18:55:23.916160] [DEBUG] [LOCAL ] EVT: Trimmed 25551 records to 17782 (keeping 200 days of data) [2025-09-18T18:55:24.037441] [DEBUG] [LOCAL ] EVT: Primary data saved (17782 records). [2025-09-18T18:55:24.037614] [INFO ] [MAIN ] EVT: Full history saved. [2025-09-18T18:55:24.037764] [INFO ] [MAIN ] Update Progress: 791/2372 symbols completed. EVT took 35.3s. Estimated remaining: 3h 50m 32s. Rate: 6.9 symbols/min [2025-09-18T18:55:24.221140] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:55:24.245227] [DEBUG] [LOCAL ] EVTR: Loaded 22776 existing records from primary storage. [2025-09-18T18:55:24.245388] [INFO ] [MAIN ] EVTR: Loaded 22776 existing records. [2025-09-18T18:55:24.427144] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:55:24.427392] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-18T18:55:24.427481] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-18T18:55:24.428233] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-18T18:55:24.428296] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-18T18:55:24.527457] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-18T18:55:24.823049] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:55:24.837580] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-18T18:55:25.319538] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-18T18:55:25.381978] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-18T18:55:26.119573] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-18T18:55:26.373474] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-18T18:55:26.378354] [INFO ] [REMOTE ] EVR: Full fetch complete (50557 records). [2025-09-18T18:55:26.378474] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-18T18:55:26.789429] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-09-18T18:55:26.789524] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-09-18T18:55:26.790211] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-09-18T18:55:26.790277] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-09-18T18:55:26.791502] [DEBUG] [LOCAL ] EVR: Trimmed 50557 records to 36199 (keeping 200 days of data) [2025-09-18T18:55:26.909519] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-18T18:55:26.919672] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-18T18:55:27.055376] [DEBUG] [LOCAL ] EVR: Primary data saved (36199 records). [2025-09-18T18:55:27.055533] [INFO ] [MAIN ] EVR: Full history saved. [2025-09-18T18:55:27.055620] [INFO ] [MAIN ] Update Progress: 792/2372 symbols completed. EVR took 45.9s. Estimated remaining: 3h 50m 12s. Rate: 6.9 symbols/min [2025-09-18T18:55:27.230577] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:55:27.295472] [DEBUG] [LOCAL ] EW: Loaded 53397 existing records from primary storage. [2025-09-18T18:55:27.295657] [INFO ] [MAIN ] EW: Loaded 53397 existing records. [2025-09-18T18:55:27.473701] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:55:27.473970] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-18T18:55:27.474020] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-18T18:55:27.475177] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-09-18T18:55:27.475241] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-18T18:55:27.728355] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-11. [2025-09-18T18:55:27.835199] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:55:28.009739] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-18T18:55:28.519547] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-11. [2025-09-18T18:55:28.681502] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-18T18:55:29.319596] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-18T18:55:29.896742] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-18T18:55:30.119606] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-09-18T18:55:30.637265] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T18:55:30.919547] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-09-18T18:55:31.481037] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T18:55:31.629017] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-18T18:55:31.719522] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-18T18:55:32.519543] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-18T18:55:33.319566] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-09-18T18:55:33.427186] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-18T18:55:33.488825] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-18T18:55:34.119565] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-18T18:55:34.721073] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-18T18:55:34.919522] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-18T18:55:35.719598] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-18T18:55:35.967003] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-18T18:55:36.519552] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-18T18:55:36.647775] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-18T18:55:36.669967] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-18T18:55:36.674587] [INFO ] [REMOTE ] EVTC: Full fetch complete (37782 records). [2025-09-18T18:55:36.674786] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-18T18:55:37.061974] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-09-18T18:55:37.062057] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-09-18T18:55:37.062582] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-09-18T18:55:37.062623] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-09-18T18:55:37.067975] [DEBUG] [LOCAL ] EVTC: Trimmed 37782 records to 26890 (keeping 200 days of data) [2025-09-18T18:55:37.228491] [DEBUG] [LOCAL ] EVTC: Primary data saved (26890 records). [2025-09-18T18:55:37.228627] [INFO ] [MAIN ] EVTC: Full history saved. [2025-09-18T18:55:37.228759] [INFO ] [MAIN ] Update Progress: 793/2372 symbols completed. EVTC took 32.1s. Estimated remaining: 3h 50m 6s. Rate: 6.9 symbols/min [2025-09-18T18:55:37.324717] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-09-18T18:55:37.412620] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:55:37.447075] [DEBUG] [LOCAL ] EXG: Loaded 34879 existing records from primary storage. [2025-09-18T18:55:37.447231] [INFO ] [MAIN ] EXG: Loaded 34879 existing records. [2025-09-18T18:55:37.624386] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:55:37.624619] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-18T18:55:37.624700] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-18T18:55:37.625635] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-09-18T18:55:37.625723] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-18T18:55:37.979681] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:55:38.103735] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-18T18:55:38.120800] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-18T18:55:38.123803] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-18T18:55:38.919550] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-18T18:55:39.122020] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-18T18:55:39.719567] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-11. [2025-09-18T18:55:40.511618] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T18:55:40.522218] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-18T18:55:40.600849] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-18T18:55:41.319547] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-09-18T18:55:42.076448] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-18T18:55:42.083377] [INFO ] [REMOTE ] EVTL: Full fetch complete (49890 records). [2025-09-18T18:55:42.083494] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-18T18:55:42.127112] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-18T18:55:42.494775] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-09-18T18:55:42.494996] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-09-18T18:55:42.495740] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-09-18T18:55:42.495864] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-09-18T18:55:42.497948] [DEBUG] [LOCAL ] EVTL: Trimmed 49890 records to 36740 (keeping 200 days of data) [2025-09-18T18:55:42.517910] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-18T18:55:42.735659] [DEBUG] [LOCAL ] EVTL: Primary data saved (36740 records). [2025-09-18T18:55:42.735832] [INFO ] [MAIN ] EVTL: Full history saved. [2025-09-18T18:55:42.735934] [INFO ] [MAIN ] Update Progress: 794/2372 symbols completed. EVTL took 35.4s. Estimated remaining: 3h 49m 51s. Rate: 6.9 symbols/min [2025-09-18T18:55:42.920301] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-18T18:55:42.920216] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:55:42.977963] [DEBUG] [LOCAL ] EXK: Loaded 53075 existing records from primary storage. [2025-09-18T18:55:42.978110] [INFO ] [MAIN ] EXK: Loaded 53075 existing records. [2025-09-18T18:55:43.174228] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:55:43.174506] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-18T18:55:43.174567] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-18T18:55:43.175562] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-09-18T18:55:43.175622] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-18T18:55:43.536948] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:55:43.719539] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-11. [2025-09-18T18:55:44.014411] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-18T18:55:44.037637] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-18T18:55:44.519560] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-18T18:55:45.031614] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-18T18:55:45.290679] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-18T18:55:45.319534] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-18T18:55:46.119536] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-09-18T18:55:46.244339] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-18T18:55:46.919579] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-09-18T18:55:47.452424] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T18:55:47.720114] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-18T18:55:47.724472] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-18T18:55:48.519604] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-09-18T18:55:49.319564] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-18T18:55:49.532556] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-18T18:55:49.641458] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-18T18:55:50.086393] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-18T18:55:50.119510] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-18T18:55:50.919562] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-18T18:55:51.719570] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-18T18:55:51.849125] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-18T18:55:52.271359] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-18T18:55:52.519527] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-18T18:55:52.658099] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-18T18:55:53.319595] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-18T18:55:54.092112] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-18T18:55:54.119497] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-18T18:55:54.542266] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-18T18:55:54.919553] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-18T18:55:55.628601] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-18T18:55:55.719514] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-18T18:55:56.272451] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-18T18:55:56.519581] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-18T18:55:56.937257] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-18T18:55:56.944582] [INFO ] [REMOTE ] EW: Full fetch complete (77193 records). [2025-09-18T18:55:56.944769] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-18T18:55:57.324622] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-18T18:55:57.405302] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-09-18T18:55:57.405413] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-09-18T18:55:57.406271] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-09-18T18:55:57.406338] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-09-18T18:55:57.408005] [DEBUG] [LOCAL ] EW: Trimmed 77193 records to 53787 (keeping 200 days of data) [2025-09-18T18:55:57.734063] [DEBUG] [LOCAL ] EW: Primary data saved (53787 records). [2025-09-18T18:55:57.734210] [INFO ] [MAIN ] EW: Full history saved. [2025-09-18T18:55:57.734300] [INFO ] [MAIN ] Update Progress: 795/2372 symbols completed. EW took 30.7s. Estimated remaining: 3h 49m 55s. Rate: 6.9 symbols/min [2025-09-18T18:55:57.917786] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:55:57.939046] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T18:55:57.978433] [DEBUG] [LOCAL ] EXP: Loaded 30344 existing records from primary storage. [2025-09-18T18:55:57.978581] [INFO ] [MAIN ] EXP: Loaded 30344 existing records. [2025-09-18T18:55:58.124718] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-18T18:55:58.164814] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:55:58.165112] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-18T18:55:58.165170] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-18T18:55:58.166167] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-09-18T18:55:58.166230] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-18T18:55:58.552352] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:55:58.919607] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-11. [2025-09-18T18:55:59.287196] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-18T18:55:59.312447] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-18T18:55:59.317417] [INFO ] [REMOTE ] EVTR: Full fetch complete (31145 records). [2025-09-18T18:55:59.317496] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-18T18:55:59.691852] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-09-18T18:55:59.691961] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-09-18T18:55:59.692545] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-09-18T18:55:59.692610] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-09-18T18:55:59.694302] [DEBUG] [LOCAL ] EVTR: Trimmed 31145 records to 23028 (keeping 200 days of data) [2025-09-18T18:55:59.747171] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-18T18:55:59.839556] [DEBUG] [LOCAL ] EVTR: Primary data saved (23028 records). [2025-09-18T18:55:59.839721] [INFO ] [MAIN ] EVTR: Full history saved. [2025-09-18T18:55:59.839817] [INFO ] [MAIN ] Update Progress: 796/2372 symbols completed. EVTR took 35.8s. Estimated remaining: 3h 49m 33s. Rate: 6.9 symbols/min [2025-09-18T18:56:00.029448] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:56:00.085907] [DEBUG] [LOCAL ] EXPD: Loaded 48206 existing records from primary storage. [2025-09-18T18:56:00.086063] [INFO ] [MAIN ] EXPD: Loaded 48206 existing records. [2025-09-18T18:56:00.274715] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:56:00.275136] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-18T18:56:00.275302] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-18T18:56:00.281682] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-09-18T18:56:00.288921] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-18T18:56:00.295239] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-18T18:56:00.524794] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-09-18T18:56:00.672521] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:56:00.816409] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-18T18:56:01.319555] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-11. [2025-09-18T18:56:01.935238] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-18T18:56:02.119535] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-09-18T18:56:02.653233] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-18T18:56:02.919605] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-18T18:56:03.494539] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T18:56:03.719569] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-18T18:56:04.107845] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-18T18:56:04.519614] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-09-18T18:56:04.571789] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-18T18:56:05.319558] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-18T18:56:06.119521] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-18T18:56:06.199247] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-18T18:56:06.800163] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-18T18:56:06.919505] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-18T18:56:07.443479] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T18:56:07.719605] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-18T18:56:08.439905] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-18T18:56:08.519551] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-18T18:56:09.107289] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-18T18:56:09.319541] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-18T18:56:10.119515] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-18T18:56:10.214110] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-18T18:56:10.429015] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-18T18:56:10.919598] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-18T18:56:11.191122] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-18T18:56:11.719547] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-18T18:56:12.522540] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-18T18:56:12.525785] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-18T18:56:13.241374] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-18T18:56:13.319547] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-18T18:56:13.768147] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-18T18:56:14.119540] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-09-18T18:56:14.623844] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T18:56:14.919549] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-18T18:56:15.527825] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-18T18:56:15.719609] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-18T18:56:16.004908] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-18T18:56:16.010544] [INFO ] [REMOTE ] EXG: Full fetch complete (50064 records). [2025-09-18T18:56:16.010821] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-18T18:56:16.529228] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-18T18:56:16.553568] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-09-18T18:56:16.553747] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-09-18T18:56:16.555036] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-09-18T18:56:16.555145] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-09-18T18:56:16.556808] [DEBUG] [LOCAL ] EXG: Trimmed 50064 records to 35077 (keeping 200 days of data) [2025-09-18T18:56:16.829602] [DEBUG] [LOCAL ] EXG: Primary data saved (35077 records). [2025-09-18T18:56:16.829862] [INFO ] [MAIN ] EXG: Full history saved. [2025-09-18T18:56:16.830051] [INFO ] [MAIN ] Update Progress: 797/2372 symbols completed. EXG took 39.6s. Estimated remaining: 3h 49m 41s. Rate: 6.9 symbols/min [2025-09-18T18:56:17.319639] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-18T18:56:17.719440] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-18T18:56:17.727038] [INFO ] [REMOTE ] EXK: Full fetch complete (76259 records). [2025-09-18T18:56:17.727171] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-18T18:56:18.124835] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-09-18T18:56:18.124943] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-09-18T18:56:18.125855] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-09-18T18:56:18.125940] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-09-18T18:56:18.127626] [DEBUG] [LOCAL ] EXK: Trimmed 76259 records to 53465 (keeping 200 days of data) [2025-09-18T18:56:18.260147] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-18T18:56:18.276922] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-18T18:56:18.406978] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-18T18:56:18.519205] [DEBUG] [LOCAL ] EXK: Primary data saved (53465 records). [2025-09-18T18:56:18.519356] [INFO ] [MAIN ] EXK: Full history saved. [2025-09-18T18:56:18.519458] [INFO ] [MAIN ] Update Progress: 798/2372 symbols completed. EXK took 35.8s. Estimated remaining: 3h 49m 18s. Rate: 6.9 symbols/min [2025-09-18T18:56:18.919601] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-18T18:56:20.078108] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-18T18:56:20.088907] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-18T18:56:20.112277] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-18T18:56:20.519544] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-18T18:56:21.498205] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-18T18:56:21.505020] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-18T18:56:21.571381] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-18T18:56:22.119545] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-18T18:56:22.683025] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-18T18:56:22.687269] [INFO ] [REMOTE ] EXP: Full fetch complete (43050 records). [2025-09-18T18:56:22.687383] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-18T18:56:23.074284] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-09-18T18:56:23.074397] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-09-18T18:56:23.075200] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-09-18T18:56:23.075279] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-09-18T18:56:23.076469] [DEBUG] [LOCAL ] EXP: Trimmed 43050 records to 30581 (keeping 200 days of data) [2025-09-18T18:56:23.286871] [DEBUG] [LOCAL ] EXP: Primary data saved (30581 records). [2025-09-18T18:56:23.287033] [INFO ] [MAIN ] EXP: Full history saved. [2025-09-18T18:56:23.287176] [INFO ] [MAIN ] Update Progress: 799/2372 symbols completed. EXP took 25.6s. Estimated remaining: 3h 49m 1s. Rate: 6.9 symbols/min [2025-09-18T18:56:23.383472] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-18T18:56:23.397673] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-18T18:56:24.969575] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-18T18:56:24.979663] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-18T18:56:26.856169] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-18T18:56:26.868493] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-18T18:56:28.184809] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-18T18:56:28.195199] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-18T18:56:29.529437] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T18:56:29.537603] [INFO ] [REMOTE ] EXPD: Full fetch complete (68972 records). [2025-09-18T18:56:29.537782] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-18T18:56:29.936978] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-09-18T18:56:29.937070] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-09-18T18:56:29.937868] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-09-18T18:56:29.937962] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-09-18T18:56:29.939433] [DEBUG] [LOCAL ] EXPD: Trimmed 68972 records to 48569 (keeping 200 days of data) [2025-09-18T18:56:30.248190] [DEBUG] [LOCAL ] EXPD: Primary data saved (48569 records). [2025-09-18T18:56:30.248509] [INFO ] [MAIN ] EXPD: Full history saved. [2025-09-18T18:56:30.248853] [INFO ] [MAIN ] Update Progress: 800/2372 symbols completed. EXPD took 30.4s. Estimated remaining: 3h 48m 49s. Rate: 6.9 symbols/min [2025-09-18T18:56:30.834384] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:56:30.915124] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:56:30.975980] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:56:30.979246] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:56:31.137184] [DEBUG] [LOCAL ] FBIN: Loaded 50468 existing records from primary storage. [2025-09-18T18:56:31.138208] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-09-18T18:56:31.139442] [DEBUG] [LOCAL ] EXR: Loaded 45616 existing records from primary storage. [2025-09-18T18:56:31.139707] [INFO ] [MAIN ] FBIN: Loaded 50468 existing records. [2025-09-18T18:56:31.139546] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-09-18T18:56:31.152150] [INFO ] [MAIN ] EXR: Loaded 45616 existing records. [2025-09-18T18:56:31.140430] [DEBUG] [LOCAL ] FAF: Loaded 42079 existing records from primary storage. [2025-09-18T18:56:31.212502] [INFO ] [MAIN ] FAF: Loaded 42079 existing records. [2025-09-18T18:56:31.730836] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:56:31.879848] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-18T18:56:31.856516] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:56:31.913302] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:56:31.933922] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-18T18:56:31.935704] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-18T18:56:31.949546] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-18T18:56:31.949450] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:56:31.950156] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-18T18:56:31.950360] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-18T18:56:31.949758] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-18T18:56:31.949310] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-18T18:56:31.985861] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-18T18:56:31.985938] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-09-18T18:56:31.985730] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-18T18:56:31.991551] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-18T18:56:31.991331] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-18T18:56:31.991777] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-18T18:56:32.074148] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-18T18:56:32.152338] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-18T18:56:33.384178] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:56:33.398611] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:56:33.478140] [INFO ] [REMOTE ] F: Fetching primary data for 2024-11. [2025-09-18T18:56:33.500438] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:56:33.507445] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:56:33.501226] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-11. [2025-09-18T18:56:33.508814] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-11. [2025-09-18T18:56:33.508362] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-11. [2025-09-18T18:56:34.865558] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-18T18:56:34.874625] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-09-18T18:56:34.913045] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-18T18:56:34.940063] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-09-18T18:56:34.947188] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-18T18:56:34.957794] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-09-18T18:56:35.482501] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-18T18:56:35.493289] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-09-18T18:56:36.415570] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-18T18:56:36.424973] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-09-18T18:56:36.608390] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-18T18:56:36.615611] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-09-18T18:56:36.717941] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-18T18:56:36.727619] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-09-18T18:56:37.629206] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-18T18:56:37.640470] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-09-18T18:56:37.706483] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-18T18:56:37.735711] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-18T18:56:37.737942] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-18T18:56:37.745589] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-18T18:56:37.885971] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-18T18:56:37.896265] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-18T18:56:38.643740] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-18T18:56:38.650889] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-18T18:56:39.014686] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-18T18:56:39.025240] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-18T18:56:39.064095] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-18T18:56:39.666795] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-18T18:56:39.719516] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-18T18:56:40.156825] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T18:56:40.519574] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-18T18:56:40.593115] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T18:56:41.139462] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-18T18:56:41.319553] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-18T18:56:42.108284] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-18T18:56:42.119480] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-18T18:56:42.751392] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T18:56:42.919540] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-18T18:56:43.682618] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T18:56:43.719498] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-18T18:56:44.207905] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-18T18:56:44.519588] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-18T18:56:44.888044] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-18T18:56:45.319580] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-18T18:56:45.839984] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-18T18:56:46.119583] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-18T18:56:46.427589] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-18T18:56:46.919605] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-18T18:56:47.726480] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-18T18:56:47.747220] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-18T18:56:48.519590] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-18T18:56:49.319589] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-18T18:56:49.415750] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-18T18:56:49.518725] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-18T18:56:49.913118] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-18T18:56:50.119553] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-18T18:56:50.819000] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-18T18:56:50.919499] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-18T18:56:51.719545] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-18T18:56:51.800013] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-18T18:56:51.945015] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-18T18:56:52.519594] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-18T18:56:53.052200] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-18T18:56:53.319550] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-18T18:56:54.119559] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-18T18:56:54.749753] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-18T18:56:54.757501] [INFO ] [REMOTE ] EXR: Full fetch complete (65541 records). [2025-09-18T18:56:54.757613] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-18T18:56:54.920200] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-18T18:56:55.173378] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-18T18:56:55.173538] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-18T18:56:55.174506] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-18T18:56:55.174986] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-18T18:56:55.222584] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-18T18:56:55.220410] [DEBUG] [LOCAL ] EXR: Trimmed 65541 records to 45952 (keeping 200 days of data) [2025-09-18T18:56:55.250832] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-18T18:56:55.257721] [INFO ] [REMOTE ] FAF: Full fetch complete (57392 records). [2025-09-18T18:56:55.257970] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-18T18:56:55.759238] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-18T18:56:55.896539] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-09-18T18:56:55.900146] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-09-18T18:56:55.908341] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-09-18T18:56:55.908432] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-09-18T18:56:55.917492] [DEBUG] [LOCAL ] FAF: Trimmed 57392 records to 42390 (keeping 200 days of data) [2025-09-18T18:56:56.063037] [DEBUG] [LOCAL ] EXR: Primary data saved (45952 records). [2025-09-18T18:56:56.063745] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-18T18:56:56.064120] [INFO ] [MAIN ] Update Progress: 801/2372 symbols completed. EXR took 25.8s. Estimated remaining: 3h 49m 14s. Rate: 6.9 symbols/min [2025-09-18T18:56:56.246220] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:56:56.280912] [DEBUG] [LOCAL ] FBK: Loaded 25283 existing records from primary storage. [2025-09-18T18:56:56.284355] [INFO ] [MAIN ] FBK: Loaded 25283 existing records. [2025-09-18T18:56:56.569552] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:56:56.570918] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-18T18:56:56.571270] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-18T18:56:56.572743] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-09-18T18:56:56.572817] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-18T18:56:56.989886] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:56:56.994360] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-11. [2025-09-18T18:56:57.043026] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-18T18:56:57.056486] [DEBUG] [LOCAL ] FAF: Primary data saved (42390 records). [2025-09-18T18:56:57.056671] [INFO ] [MAIN ] FAF: Full history saved. [2025-09-18T18:56:57.056821] [INFO ] [MAIN ] Update Progress: 802/2372 symbols completed. FAF took 26.8s. Estimated remaining: 3h 48m 50s. Rate: 6.9 symbols/min [2025-09-18T18:56:57.274460] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:56:57.320423] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-18T18:56:57.322466] [DEBUG] [LOCAL ] FBP: Loaded 46391 existing records from primary storage. [2025-09-18T18:56:57.322724] [INFO ] [MAIN ] FBP: Loaded 46391 existing records. [2025-09-18T18:56:57.505814] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:56:57.506104] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-18T18:56:57.506189] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-18T18:56:57.507386] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-09-18T18:56:57.507448] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-18T18:56:57.861619] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:56:57.915179] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-18T18:56:58.086731] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-18T18:56:58.119542] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-09-18T18:56:58.829490] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-18T18:56:58.919562] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-09-18T18:56:59.069087] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-18T18:56:59.078406] [INFO ] [REMOTE ] FBIN: Full fetch complete (72407 records). [2025-09-18T18:56:59.078693] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-18T18:56:59.504959] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-18T18:56:59.505111] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-18T18:56:59.506173] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-18T18:56:59.506259] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-18T18:56:59.508389] [DEBUG] [LOCAL ] FBIN: Trimmed 72407 records to 50823 (keeping 200 days of data) [2025-09-18T18:56:59.640044] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-18T18:56:59.734137] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-18T18:56:59.882617] [DEBUG] [LOCAL ] FBIN: Primary data saved (50823 records). [2025-09-18T18:56:59.882944] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-18T18:56:59.883092] [INFO ] [MAIN ] Update Progress: 803/2372 symbols completed. FBIN took 29.6s. Estimated remaining: 3h 48m 30s. Rate: 6.9 symbols/min [2025-09-18T18:57:00.078391] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:57:00.119994] [DEBUG] [LOCAL ] FBRT: Loaded 34325 existing records from primary storage. [2025-09-18T18:57:00.120195] [INFO ] [MAIN ] FBRT: Loaded 34325 existing records. [2025-09-18T18:57:00.334611] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:57:00.334953] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-18T18:57:00.335008] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-18T18:57:00.336121] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-09-18T18:57:00.336185] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-18T18:57:00.521608] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-11. [2025-09-18T18:57:00.778199] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:57:00.982602] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T18:57:01.319607] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-18T18:57:02.119513] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-18T18:57:02.339678] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-18T18:57:02.743791] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-18T18:57:02.919549] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-11. [2025-09-18T18:57:03.719569] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-09-18T18:57:04.519551] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-18T18:57:05.239377] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-11 (2.32 seconds). [2025-09-18T18:57:05.270067] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-18T18:57:05.329862] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-09-18T18:57:05.336775] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (3.22 seconds). [2025-09-18T18:57:05.517437] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-18T18:57:06.119548] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-18T18:57:06.643721] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-18T18:57:06.919560] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-09-18T18:57:07.719561] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-18T18:57:08.226679] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-18T18:57:08.435392] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-18T18:57:08.519597] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-18T18:57:08.862875] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T18:57:09.319618] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-09-18T18:57:10.119563] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-18T18:57:10.683385] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-18T18:57:10.919548] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-18T18:57:10.989002] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-18T18:57:11.549245] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-18T18:57:11.643349] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-18T18:57:11.719593] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-18T18:57:12.519590] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-18T18:57:12.809114] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-18T18:57:13.319568] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-18T18:57:14.068732] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-18T18:57:14.119501] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-18T18:57:14.919596] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-18T18:57:15.719575] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-18T18:57:16.107025] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-18T18:57:16.158007] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.84 seconds). [2025-09-18T18:57:16.519565] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-18T18:57:16.764487] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-18T18:57:17.174771] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-18T18:57:17.319562] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-18T18:57:17.688170] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-18T18:57:18.119569] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-18T18:57:18.377789] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-18T18:57:18.919544] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-18T18:57:19.574168] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T18:57:19.719550] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-18T18:57:20.519550] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-18T18:57:20.963383] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-18T18:57:20.971245] [INFO ] [REMOTE ] F: Full fetch complete (77998 records). [2025-09-18T18:57:20.971460] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-18T18:57:21.335067] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-18T18:57:21.383146] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-18T18:57:21.446181] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-18T18:57:21.446368] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-18T18:57:21.447373] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-18T18:57:21.447550] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-18T18:57:21.468110] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-18T18:57:21.475087] [DEBUG] [LOCAL ] F: Trimmed 77998 records to 54210 (keeping 200 days of data) [2025-09-18T18:57:21.845615] [DEBUG] [LOCAL ] F: Primary data saved (54210 records). [2025-09-18T18:57:21.845777] [INFO ] [MAIN ] F: Full history saved. [2025-09-18T18:57:21.845870] [INFO ] [MAIN ] Update Progress: 804/2372 symbols completed. F took 51.6s. Estimated remaining: 3h 48m 47s. Rate: 6.9 symbols/min [2025-09-18T18:57:22.014609] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:57:22.031156] [DEBUG] [LOCAL ] FC: Loaded 15420 existing records from primary storage. [2025-09-18T18:57:22.031280] [INFO ] [MAIN ] FC: Loaded 15420 existing records. [2025-09-18T18:57:22.124635] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-18T18:57:22.214316] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:57:22.214552] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-18T18:57:22.214623] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-18T18:57:22.215120] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-09-18T18:57:22.215178] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-18T18:57:22.571415] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:57:22.602016] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-18T18:57:22.919531] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-18T18:57:23.107799] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-18T18:57:23.719559] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-18T18:57:24.257559] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-18T18:57:24.508254] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-18T18:57:24.513493] [INFO ] [REMOTE ] FBK: Full fetch complete (32515 records). [2025-09-18T18:57:24.513748] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-18T18:57:24.524757] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-18T18:57:24.916409] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-09-18T18:57:24.916550] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-09-18T18:57:24.917108] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-09-18T18:57:24.917174] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-09-18T18:57:24.918237] [DEBUG] [LOCAL ] FBK: Trimmed 32515 records to 25471 (keeping 200 days of data) [2025-09-18T18:57:25.072123] [DEBUG] [LOCAL ] FBK: Primary data saved (25471 records). [2025-09-18T18:57:25.072323] [INFO ] [MAIN ] FBK: Full history saved. [2025-09-18T18:57:25.072432] [INFO ] [MAIN ] Update Progress: 805/2372 symbols completed. FBK took 29.0s. Estimated remaining: 3h 48m 27s. Rate: 6.9 symbols/min [2025-09-18T18:57:25.241687] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:57:25.283130] [DEBUG] [LOCAL ] FCF: Loaded 39938 existing records from primary storage. [2025-09-18T18:57:25.283284] [INFO ] [MAIN ] FCF: Loaded 39938 existing records. [2025-09-18T18:57:25.325604] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-18T18:57:25.470775] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:57:25.471017] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-18T18:57:25.471066] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-18T18:57:25.472097] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-09-18T18:57:25.472159] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-18T18:57:25.862793] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:57:26.119543] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-11. [2025-09-18T18:57:26.183503] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-18T18:57:26.919597] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-18T18:57:27.663103] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-18T18:57:27.719563] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-09-18T18:57:27.909557] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-18T18:57:27.932211] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T18:57:27.936805] [INFO ] [REMOTE ] FBRT: Full fetch complete (48007 records). [2025-09-18T18:57:27.936916] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-18T18:57:28.338509] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-09-18T18:57:28.342465] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-09-18T18:57:28.342801] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-18T18:57:28.346932] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-09-18T18:57:28.347007] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-09-18T18:57:28.348048] [DEBUG] [LOCAL ] FBRT: Trimmed 48007 records to 34575 (keeping 200 days of data) [2025-09-18T18:57:28.529994] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-18T18:57:28.556088] [DEBUG] [LOCAL ] FBRT: Primary data saved (34575 records). [2025-09-18T18:57:28.556196] [INFO ] [MAIN ] FBRT: Full history saved. [2025-09-18T18:57:28.556292] [INFO ] [MAIN ] Update Progress: 806/2372 symbols completed. FBRT took 28.7s. Estimated remaining: 3h 48m 8s. Rate: 6.9 symbols/min [2025-09-18T18:57:28.733806] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:57:28.761600] [DEBUG] [LOCAL ] FCN: Loaded 26361 existing records from primary storage. [2025-09-18T18:57:28.761767] [INFO ] [MAIN ] FCN: Loaded 26361 existing records. [2025-09-18T18:57:28.939897] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:57:28.940186] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-18T18:57:28.940236] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-18T18:57:28.941062] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-09-18T18:57:28.941123] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-18T18:57:29.297044] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:57:29.319522] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-11. [2025-09-18T18:57:29.862207] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T18:57:29.868263] [INFO ] [REMOTE ] FBP: Full fetch complete (66170 records). [2025-09-18T18:57:29.868390] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-18T18:57:30.130028] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-11. [2025-09-18T18:57:30.261439] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-09-18T18:57:30.261620] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-09-18T18:57:30.262396] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-09-18T18:57:30.262449] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-09-18T18:57:30.263862] [DEBUG] [LOCAL ] FBP: Trimmed 66170 records to 46725 (keeping 200 days of data) [2025-09-18T18:57:30.385683] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-18T18:57:30.578257] [DEBUG] [LOCAL ] FBP: Primary data saved (46725 records). [2025-09-18T18:57:30.578435] [INFO ] [MAIN ] FBP: Full history saved. [2025-09-18T18:57:30.578553] [INFO ] [MAIN ] Update Progress: 807/2372 symbols completed. FBP took 33.5s. Estimated remaining: 3h 47m 46s. Rate: 6.9 symbols/min [2025-09-18T18:57:30.754014] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:57:30.798462] [DEBUG] [LOCAL ] FCPT: Loaded 37547 existing records from primary storage. [2025-09-18T18:57:30.798670] [INFO ] [MAIN ] FCPT: Loaded 37547 existing records. [2025-09-18T18:57:30.924836] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-09-18T18:57:30.984396] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:57:30.984723] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-18T18:57:30.984784] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-18T18:57:30.985915] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-09-18T18:57:30.985976] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-18T18:57:31.351485] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:57:31.410871] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-18T18:57:31.719547] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-11. [2025-09-18T18:57:31.785085] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-18T18:57:32.519567] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-09-18T18:57:32.800747] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-18T18:57:33.172979] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-18T18:57:33.319516] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-18T18:57:34.070745] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-18T18:57:34.119501] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-18T18:57:34.851212] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-18T18:57:34.919514] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-18T18:57:35.719689] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-09-18T18:57:35.751693] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-18T18:57:36.519554] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-18T18:57:37.101448] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-18T18:57:37.224338] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T18:57:37.319509] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-09-18T18:57:38.119559] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-09-18T18:57:38.874101] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T18:57:38.919501] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-18T18:57:39.283019] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-18T18:57:39.719601] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-09-18T18:57:40.086363] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-18T18:57:40.519589] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-09-18T18:57:40.616309] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-18T18:57:41.255679] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-18T18:57:41.319508] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-18T18:57:42.119506] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-18T18:57:42.450339] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-18T18:57:42.919555] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-18T18:57:43.133862] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T18:57:43.719562] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-18T18:57:43.886445] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-18T18:57:44.519577] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-18T18:57:44.955245] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T18:57:45.319563] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-18T18:57:45.976571] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T18:57:46.119542] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-18T18:57:46.842036] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T18:57:46.919569] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-18T18:57:47.434031] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-18T18:57:47.719542] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-18T18:57:48.476367] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-18T18:57:48.519499] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-18T18:57:48.984819] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-18T18:57:49.319597] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-18T18:57:49.932863] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-18T18:57:50.119518] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-18T18:57:50.367133] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-18T18:57:50.919568] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-18T18:57:51.091183] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-18T18:57:51.405028] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-18T18:57:51.719559] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-18T18:57:52.519559] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-18T18:57:52.969789] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T18:57:53.232766] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-18T18:57:53.319514] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-18T18:57:53.988918] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-18T18:57:54.119560] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-18T18:57:54.919543] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-18T18:57:55.457148] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-18T18:57:55.719566] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-18T18:57:56.049577] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T18:57:56.519546] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-18T18:57:56.905010] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-18T18:57:57.319557] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-18T18:57:57.493354] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-18T18:57:58.082391] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-18T18:57:58.119529] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-18T18:57:58.919568] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-18T18:57:59.090225] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-18T18:57:59.719565] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-18T18:57:59.926093] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T18:57:59.929078] [INFO ] [REMOTE ] FC: Full fetch complete (21474 records). [2025-09-18T18:57:59.929433] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-18T18:58:00.304600] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-09-18T18:58:00.304732] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-09-18T18:58:00.305183] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-09-18T18:58:00.305227] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-09-18T18:58:00.305895] [DEBUG] [LOCAL ] FC: Trimmed 21474 records to 15561 (keeping 200 days of data) [2025-09-18T18:58:00.410354] [DEBUG] [LOCAL ] FC: Primary data saved (15561 records). [2025-09-18T18:58:00.410524] [INFO ] [MAIN ] FC: Full history saved. [2025-09-18T18:58:00.410624] [INFO ] [MAIN ] Update Progress: 808/2372 symbols completed. FC took 38.6s. Estimated remaining: 3h 48m 19s. Rate: 6.9 symbols/min [2025-09-18T18:58:00.524740] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-18T18:58:00.591914] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:58:00.592256] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-18T18:58:00.592329] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-18T18:58:00.592486] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-18T18:58:00.592544] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-18T18:58:00.592615] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-18T18:58:00.592685] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-18T18:58:00.960979] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:58:01.115398] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-18T18:58:01.121312] [INFO ] [REMOTE ] FCPT: Full fetch complete (53089 records). [2025-09-18T18:58:01.121485] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-18T18:58:01.324752] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-11. [2025-09-18T18:58:01.650053] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-18T18:58:01.771132] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-18T18:58:01.811376] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-09-18T18:58:01.812204] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-09-18T18:58:01.813637] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-09-18T18:58:01.814090] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-09-18T18:58:01.813956] [INFO ] [REMOTE ] FCF: Full fetch complete (57856 records). [2025-09-18T18:58:01.814624] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-18T18:58:01.842216] [DEBUG] [LOCAL ] FCPT: Trimmed 53089 records to 37843 (keeping 200 days of data) [2025-09-18T18:58:02.122328] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-18T18:58:02.482936] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-09-18T18:58:02.483411] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-09-18T18:58:02.484871] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-09-18T18:58:02.485376] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-09-18T18:58:02.491952] [DEBUG] [LOCAL ] FCF: Trimmed 57856 records to 40259 (keeping 200 days of data) [2025-09-18T18:58:02.741238] [DEBUG] [LOCAL ] FCPT: Primary data saved (37843 records). [2025-09-18T18:58:02.742593] [INFO ] [MAIN ] FCPT: Full history saved. [2025-09-18T18:58:02.743053] [INFO ] [MAIN ] Update Progress: 809/2372 symbols completed. FCPT took 32.2s. Estimated remaining: 3h 47m 57s. Rate: 6.9 symbols/min [2025-09-18T18:58:02.926324] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-09-18T18:58:03.039534] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:58:03.061390] [DEBUG] [LOCAL ] FCT: Loaded 14380 existing records from primary storage. [2025-09-18T18:58:03.062291] [INFO ] [MAIN ] FCT: Loaded 14380 existing records. [2025-09-18T18:58:03.269474] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:58:03.271290] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-18T18:58:03.272522] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-18T18:58:03.277386] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-18T18:58:03.280868] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-18T18:58:03.323745] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-18T18:58:03.414073] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-18T18:58:03.496368] [DEBUG] [LOCAL ] FCF: Primary data saved (40259 records). [2025-09-18T18:58:03.541230] [INFO ] [MAIN ] FCF: Full history saved. [2025-09-18T18:58:03.573804] [INFO ] [MAIN ] Update Progress: 810/2372 symbols completed. FCF took 38.5s. Estimated remaining: 3h 47m 33s. Rate: 6.9 symbols/min [2025-09-18T18:58:03.719955] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-18T18:58:03.809888] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:58:03.880039] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:58:03.934585] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-09-18T18:58:03.934823] [INFO ] [MAIN ] FCX: Loaded 53700 existing records. [2025-09-18T18:58:04.130943] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:58:04.131241] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-18T18:58:04.131318] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-18T18:58:04.132551] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-09-18T18:58:04.132612] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-18T18:58:04.500947] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:58:04.519491] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-11. [2025-09-18T18:58:04.752933] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-18T18:58:04.756553] [INFO ] [REMOTE ] FCN: Full fetch complete (35375 records). [2025-09-18T18:58:04.756766] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-18T18:58:05.132151] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-09-18T18:58:05.132251] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-09-18T18:58:05.132855] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-09-18T18:58:05.132923] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-09-18T18:58:05.134706] [DEBUG] [LOCAL ] FCN: Trimmed 35375 records to 26543 (keeping 200 days of data) [2025-09-18T18:58:05.295491] [DEBUG] [LOCAL ] FCN: Primary data saved (26543 records). [2025-09-18T18:58:05.295662] [INFO ] [MAIN ] FCN: Full history saved. [2025-09-18T18:58:05.295777] [INFO ] [MAIN ] Update Progress: 811/2372 symbols completed. FCN took 36.7s. Estimated remaining: 3h 47m 11s. Rate: 6.9 symbols/min [2025-09-18T18:58:05.325684] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-09-18T18:58:05.513868] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:58:05.546084] [DEBUG] [LOCAL ] FDP: Loaded 30436 existing records from primary storage. [2025-09-18T18:58:05.546293] [INFO ] [MAIN ] FDP: Loaded 30436 existing records. [2025-09-18T18:58:05.723077] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:58:05.723341] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-18T18:58:05.723410] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-18T18:58:05.724363] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-09-18T18:58:05.724429] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-18T18:58:05.836389] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-18T18:58:06.089997] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:58:06.119505] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-11. [2025-09-18T18:58:06.321853] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-18T18:58:06.919544] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-09-18T18:58:07.138392] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-18T18:58:07.719550] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-11. [2025-09-18T18:58:08.304110] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-18T18:58:08.509083] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-18T18:58:08.520779] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-18T18:58:09.013610] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-18T18:58:09.319556] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-18T18:58:09.586855] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-18T18:58:10.119558] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-18T18:58:10.454176] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-18T18:58:10.919573] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-09-18T18:58:11.719564] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-09-18T18:58:12.132328] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-18T18:58:12.519625] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-09-18T18:58:13.319562] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-18T18:58:13.426872] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-18T18:58:13.535120] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-09-18T18:58:13.548029] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-18T18:58:14.119560] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-18T18:58:14.531753] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-18T18:58:14.919545] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-18T18:58:15.253752] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-18T18:58:15.719552] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-09-18T18:58:16.505731] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-18T18:58:16.519507] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-18T18:58:17.286265] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-18T18:58:17.319491] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-18T18:58:18.119553] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-18T18:58:18.233027] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-18T18:58:18.919556] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-18T18:58:19.628484] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-18T18:58:19.719547] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-18T18:58:19.965172] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-18T18:58:20.255456] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-18T18:58:20.519555] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-18T18:58:21.319554] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-09-18T18:58:21.512222] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-18T18:58:22.119515] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-18T18:58:22.202102] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-18T18:58:22.919542] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-18T18:58:23.177625] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-18T18:58:23.719540] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-18T18:58:24.195902] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-18T18:58:24.356528] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-18T18:58:24.519590] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-18T18:58:25.307978] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T18:58:25.319509] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-18T18:58:25.931217] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-18T18:58:25.932134] [INFO ] [REMOTE ] FCRX: Full fetch complete (1645 records). [2025-09-18T18:58:25.932227] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-18T18:58:26.108715] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-18T18:58:26.108945] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:58:26.109018] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:58:26.109108] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-18T18:58:26.109211] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-18T18:58:26.109268] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-18T18:58:26.109314] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-18T18:58:26.109391] [INFO ] [MAIN ] Update Progress: 812/2372 symbols completed. FCRX took 25.7s. Estimated remaining: 3h 47m 26s. Rate: 6.9 symbols/min [2025-09-18T18:58:26.125875] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-18T18:58:26.331586] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:58:26.362033] [DEBUG] [LOCAL ] FDS: Loaded 25522 existing records from primary storage. [2025-09-18T18:58:26.362163] [INFO ] [MAIN ] FDS: Loaded 25522 existing records. [2025-09-18T18:58:26.540198] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:58:26.540455] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-18T18:58:26.540504] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-18T18:58:26.541321] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-18T18:58:26.541384] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-18T18:58:26.890625] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:58:26.919492] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-11. [2025-09-18T18:58:27.447878] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-18T18:58:27.719553] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-18T18:58:27.959394] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-18T18:58:28.519557] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-18T18:58:28.843013] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T18:58:28.846113] [INFO ] [REMOTE ] FCT: Full fetch complete (21216 records). [2025-09-18T18:58:28.846191] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-18T18:58:29.250668] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-18T18:58:29.250758] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-18T18:58:29.251185] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-18T18:58:29.251226] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-18T18:58:29.251850] [DEBUG] [LOCAL ] FCT: Trimmed 21216 records to 14486 (keeping 200 days of data) [2025-09-18T18:58:29.324147] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-18T18:58:29.349268] [DEBUG] [LOCAL ] FCT: Primary data saved (14486 records). [2025-09-18T18:58:29.349829] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-18T18:58:29.349939] [INFO ] [MAIN ] Update Progress: 813/2372 symbols completed. FCT took 26.6s. Estimated remaining: 3h 47m 6s. Rate: 6.9 symbols/min [2025-09-18T18:58:29.541306] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:58:29.604937] [DEBUG] [LOCAL ] FDX: Loaded 51558 existing records from primary storage. [2025-09-18T18:58:29.605107] [INFO ] [MAIN ] FDX: Loaded 51558 existing records. [2025-09-18T18:58:29.797834] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:58:29.798266] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-18T18:58:29.798343] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-18T18:58:29.799791] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-09-18T18:58:29.799866] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-18T18:58:30.127784] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-09-18T18:58:30.159243] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:58:30.452414] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-18T18:58:30.760404] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-18T18:58:30.919526] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-18T18:58:30.991418] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-18T18:58:31.719566] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-11. [2025-09-18T18:58:32.030777] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-18T18:58:32.519590] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-09-18T18:58:33.143793] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T18:58:33.319514] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-09-18T18:58:33.729877] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-18T18:58:34.119603] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-18T18:58:34.919545] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-18T18:58:35.049827] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-18T18:58:35.075636] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-18T18:58:35.719556] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-09-18T18:58:35.887605] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-18T18:58:36.519591] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-18T18:58:37.319508] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-18T18:58:37.398141] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-18T18:58:37.436835] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T18:58:38.119502] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-18T18:58:38.258059] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T18:58:38.919569] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-18T18:58:39.719563] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-18T18:58:40.114223] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-18T18:58:40.143985] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-18T18:58:40.519606] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-18T18:58:41.178806] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-18T18:58:41.319520] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-18T18:58:42.119577] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-18T18:58:42.502835] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-18T18:58:42.745998] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-18T18:58:42.913213] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T18:58:42.919663] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-18T18:58:43.719545] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-18T18:58:44.519566] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-18T18:58:44.871595] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-18T18:58:45.319508] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-18T18:58:45.353056] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-18T18:58:45.507779] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-18T18:58:46.119547] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-18T18:58:46.919564] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-18T18:58:47.009565] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-18T18:58:47.719710] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-18T18:58:47.754234] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-18T18:58:48.066771] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-18T18:58:48.519564] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-18T18:58:48.732398] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T18:58:48.738915] [INFO ] [REMOTE ] FDP: Full fetch complete (42649 records). [2025-09-18T18:58:48.739090] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-18T18:58:49.133939] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-09-18T18:58:49.134031] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-09-18T18:58:49.134592] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-09-18T18:58:49.134700] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-09-18T18:58:49.135934] [DEBUG] [LOCAL ] FDP: Trimmed 42649 records to 30690 (keeping 200 days of data) [2025-09-18T18:58:49.330064] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-18T18:58:49.349681] [DEBUG] [LOCAL ] FDP: Primary data saved (30690 records). [2025-09-18T18:58:49.349827] [INFO ] [MAIN ] FDP: Full history saved. [2025-09-18T18:58:49.349958] [INFO ] [MAIN ] Update Progress: 814/2372 symbols completed. FDP took 44.1s. Estimated remaining: 3h 47m 19s. Rate: 6.9 symbols/min [2025-09-18T18:58:49.525791] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:58:49.581564] [DEBUG] [LOCAL ] FE: Loaded 53448 existing records from primary storage. [2025-09-18T18:58:49.581770] [INFO ] [MAIN ] FE: Loaded 53448 existing records. [2025-09-18T18:58:49.759237] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:58:49.759769] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-18T18:58:49.759889] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-18T18:58:49.766634] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-18T18:58:49.776088] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-18T18:58:49.841615] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-18T18:58:50.125035] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-18T18:58:50.137957] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:58:50.919513] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-11. [2025-09-18T18:58:51.070866] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-18T18:58:51.225684] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-18T18:58:51.719560] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-18T18:58:52.519603] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-18T18:58:52.700996] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-18T18:58:53.237035] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-18T18:58:53.319502] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-18T18:58:53.419798] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-18T18:58:54.119577] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-18T18:58:54.863022] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-18T18:58:54.919602] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-18T18:58:55.601687] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-18T18:58:55.610454] [INFO ] [REMOTE ] FDS: Full fetch complete (36051 records). [2025-09-18T18:58:55.610688] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-18T18:58:55.723171] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-09-18T18:58:56.028246] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-18T18:58:56.028332] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-18T18:58:56.028859] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-18T18:58:56.028923] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-18T18:58:56.029828] [DEBUG] [LOCAL ] FDS: Trimmed 36051 records to 25899 (keeping 200 days of data) [2025-09-18T18:58:56.205922] [DEBUG] [LOCAL ] FDS: Primary data saved (25899 records). [2025-09-18T18:58:56.206064] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-18T18:58:56.206183] [INFO ] [MAIN ] Update Progress: 815/2372 symbols completed. FDS took 30.1s. Estimated remaining: 3h 47m 7s. Rate: 6.9 symbols/min [2025-09-18T18:58:56.375206] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:58:56.375407] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-18T18:58:56.375464] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-18T18:58:56.375611] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-18T18:58:56.375683] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-18T18:58:56.375791] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-18T18:58:56.375832] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-18T18:58:56.525123] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-18T18:58:56.741231] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:58:56.772544] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-18T18:58:56.780619] [INFO ] [REMOTE ] FCX: Full fetch complete (77652 records). [2025-09-18T18:58:56.780799] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-18T18:58:57.181172] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-09-18T18:58:57.181422] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-09-18T18:58:57.182395] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-09-18T18:58:57.182626] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-09-18T18:58:57.185123] [DEBUG] [LOCAL ] FCX: Trimmed 77652 records to 54090 (keeping 200 days of data) [2025-09-18T18:58:57.325257] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-18T18:58:57.323041] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-11. [2025-09-18T18:58:57.577203] [DEBUG] [LOCAL ] FCX: Primary data saved (54090 records). [2025-09-18T18:58:57.577363] [INFO ] [MAIN ] FCX: Full history saved. [2025-09-18T18:58:57.577478] [INFO ] [MAIN ] Update Progress: 816/2372 symbols completed. FCX took 54.0s. Estimated remaining: 3h 46m 44s. Rate: 6.9 symbols/min [2025-09-18T18:58:57.747225] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:58:57.800138] [DEBUG] [LOCAL ] FERG: Loaded 49048 existing records from primary storage. [2025-09-18T18:58:57.800286] [INFO ] [MAIN ] FERG: Loaded 49048 existing records. [2025-09-18T18:58:57.895741] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-18T18:58:57.984257] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:58:57.984537] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-18T18:58:57.984587] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-18T18:58:57.985812] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-09-18T18:58:57.985874] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-18T18:58:58.130186] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-09-18T18:58:58.375588] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:58:58.406499] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-18T18:58:58.415392] [INFO ] [REMOTE ] FDX: Full fetch complete (74235 records). [2025-09-18T18:58:58.415590] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-18T18:58:58.514603] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-18T18:58:58.842961] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-09-18T18:58:58.843043] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-09-18T18:58:58.843869] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-09-18T18:58:58.843934] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-09-18T18:58:58.846033] [DEBUG] [LOCAL ] FDX: Trimmed 74235 records to 51948 (keeping 200 days of data) [2025-09-18T18:58:58.919556] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-09-18T18:58:59.177906] [DEBUG] [LOCAL ] FDX: Primary data saved (51948 records). [2025-09-18T18:58:59.178045] [INFO ] [MAIN ] FDX: Full history saved. [2025-09-18T18:58:59.178172] [INFO ] [MAIN ] Update Progress: 817/2372 symbols completed. FDX took 29.8s. Estimated remaining: 3h 46m 22s. Rate: 6.9 symbols/min [2025-09-18T18:58:59.284201] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-18T18:58:59.353141] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:58:59.367842] [DEBUG] [LOCAL ] FET: Loaded 12646 existing records from primary storage. [2025-09-18T18:58:59.367968] [INFO ] [MAIN ] FET: Loaded 12646 existing records. [2025-09-18T18:58:59.549573] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:58:59.550217] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-18T18:58:59.550275] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-18T18:58:59.551162] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-18T18:58:59.551223] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-18T18:58:59.723846] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-11. [2025-09-18T18:58:59.907520] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:59:00.519603] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-11. [2025-09-18T18:59:01.078631] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-18T18:59:01.204200] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-18T18:59:01.319572] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-09-18T18:59:02.119588] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-18T18:59:02.571983] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-18T18:59:02.783334] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-18T18:59:02.919562] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-18T18:59:03.343475] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-18T18:59:03.719581] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-09-18T18:59:04.519562] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-09-18T18:59:05.144039] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-18T18:59:05.319572] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-18T18:59:05.335667] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-18T18:59:05.718998] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-18T18:59:06.119552] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-18T18:59:06.442207] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-18T18:59:06.919544] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-18T18:59:07.264247] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-18T18:59:07.719553] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-18T18:59:08.519563] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-18T18:59:08.790793] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-18T18:59:09.151625] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T18:59:09.319555] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-09-18T18:59:10.119566] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-09-18T18:59:10.162820] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T18:59:10.919585] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-18T18:59:11.596859] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-18T18:59:11.720194] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-18T18:59:11.721175] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-18T18:59:12.006544] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-18T18:59:12.519578] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-18T18:59:13.319550] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-18T18:59:13.416512] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-18T18:59:14.119544] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-18T18:59:14.824088] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-18T18:59:14.919562] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-18T18:59:15.717362] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-18T18:59:15.727729] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-18T18:59:15.798493] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-18T18:59:16.355278] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-18T18:59:16.356201] [INFO ] [REMOTE ] FENG: Full fetch complete (2131 records). [2025-09-18T18:59:16.356272] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-18T18:59:16.519851] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-18T18:59:16.541107] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-18T18:59:16.542506] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-18T18:59:16.542618] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-18T18:59:16.542717] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-18T18:59:16.542783] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-18T18:59:16.542835] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-18T18:59:16.542903] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-18T18:59:16.542984] [INFO ] [MAIN ] Update Progress: 818/2372 symbols completed. FENG took 20.3s. Estimated remaining: 3h 46m 29s. Rate: 6.9 symbols/min [2025-09-18T18:59:16.714814] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:59:16.740864] [DEBUG] [LOCAL ] FF: Loaded 25939 existing records from primary storage. [2025-09-18T18:59:16.741004] [INFO ] [MAIN ] FF: Loaded 25939 existing records. [2025-09-18T18:59:16.918267] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:59:16.918523] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-18T18:59:16.918571] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-18T18:59:16.919303] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-09-18T18:59:16.919362] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-18T18:59:17.326556] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:59:17.322416] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-18T18:59:17.867547] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-18T18:59:18.119577] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-18T18:59:18.416707] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-18T18:59:18.662037] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-18T18:59:18.919539] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-18T18:59:19.584412] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-18T18:59:19.719581] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-18T18:59:20.519555] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-18T18:59:21.319578] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-11. [2025-09-18T18:59:21.471230] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-18T18:59:21.926856] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-18T18:59:22.119501] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-18T18:59:22.306354] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-18T18:59:22.919546] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-18T18:59:23.558749] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-18T18:59:23.719599] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-18T18:59:24.519591] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-09-18T18:59:24.655277] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-18T18:59:24.676678] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-18T18:59:25.319576] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-18T18:59:25.466565] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-18T18:59:26.119597] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-18T18:59:26.267458] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-18T18:59:26.270375] [INFO ] [REMOTE ] FET: Full fetch complete (18059 records). [2025-09-18T18:59:26.270492] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-18T18:59:26.644506] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-18T18:59:26.644613] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-18T18:59:26.645024] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-18T18:59:26.645098] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-18T18:59:26.645755] [DEBUG] [LOCAL ] FET: Trimmed 18059 records to 12836 (keeping 200 days of data) [2025-09-18T18:59:26.722210] [DEBUG] [LOCAL ] FET: Primary data saved (12836 records). [2025-09-18T18:59:26.722383] [INFO ] [MAIN ] FET: Full history saved. [2025-09-18T18:59:26.722479] [INFO ] [MAIN ] Update Progress: 819/2372 symbols completed. FET took 27.5s. Estimated remaining: 3h 46m 23s. Rate: 6.9 symbols/min [2025-09-18T18:59:26.890617] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:59:26.900537] [DEBUG] [LOCAL ] FFA: Loaded 5597 existing records from primary storage. [2025-09-18T18:59:26.900704] [INFO ] [MAIN ] FFA: Loaded 5597 existing records. [2025-09-18T18:59:26.924730] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-09-18T18:59:27.091702] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:59:27.091999] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-18T18:59:27.092055] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-18T18:59:27.092418] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-09-18T18:59:27.092476] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-18T18:59:27.453740] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:59:27.719518] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-18T18:59:27.766409] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-18T18:59:28.167771] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-18T18:59:28.519590] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-18T18:59:29.136316] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-18T18:59:29.187409] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-18T18:59:29.319550] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-18T18:59:30.119548] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-11. [2025-09-18T18:59:30.666076] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-18T18:59:30.810741] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-18T18:59:30.919504] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-09-18T18:59:31.489237] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-18T18:59:31.719558] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-09-18T18:59:32.470084] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-18T18:59:32.519514] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-18T18:59:33.157689] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-18T18:59:33.319512] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-18T18:59:34.119571] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-18T18:59:34.919566] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-18T18:59:35.060202] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-18T18:59:35.639145] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-18T18:59:35.719509] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-18T18:59:35.858972] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T18:59:36.519569] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-18T18:59:37.066052] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-18T18:59:37.095941] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-18T18:59:37.319553] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-18T18:59:38.119550] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-18T18:59:38.451207] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-18T18:59:38.919600] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-18T18:59:39.719564] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-18T18:59:39.899012] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-18T18:59:39.906313] [INFO ] [REMOTE ] FE: Full fetch complete (77022 records). [2025-09-18T18:59:39.906439] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-18T18:59:40.229057] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-18T18:59:40.327998] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-18T18:59:40.328123] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-18T18:59:40.328996] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-18T18:59:40.329070] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-18T18:59:40.330917] [DEBUG] [LOCAL ] FE: Trimmed 77022 records to 53831 (keeping 200 days of data) [2025-09-18T18:59:40.538694] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-18T18:59:40.655911] [DEBUG] [LOCAL ] FE: Primary data saved (53831 records). [2025-09-18T18:59:40.656064] [INFO ] [MAIN ] FE: Full history saved. [2025-09-18T18:59:40.656151] [INFO ] [MAIN ] Update Progress: 820/2372 symbols completed. FE took 51.3s. Estimated remaining: 3h 46m 24s. Rate: 6.9 symbols/min [2025-09-18T18:59:40.825537] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:59:40.843778] [DEBUG] [LOCAL ] FFC: Loaded 16631 existing records from primary storage. [2025-09-18T18:59:40.843934] [INFO ] [MAIN ] FFC: Loaded 16631 existing records. [2025-09-18T18:59:41.025034] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:59:41.025323] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-18T18:59:41.025389] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-18T18:59:41.026017] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-09-18T18:59:41.026083] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-18T18:59:41.324168] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-18T18:59:41.408475] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:59:41.425942] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T18:59:41.454302] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-18T18:59:41.461870] [INFO ] [REMOTE ] FERG: Full fetch complete (70856 records). [2025-09-18T18:59:41.461999] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-18T18:59:41.868944] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-09-18T18:59:41.869047] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-09-18T18:59:41.869865] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-09-18T18:59:41.869932] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-09-18T18:59:41.871335] [DEBUG] [LOCAL ] FERG: Trimmed 70856 records to 49429 (keeping 200 days of data) [2025-09-18T18:59:42.120050] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-11. [2025-09-18T18:59:42.179774] [DEBUG] [LOCAL ] FERG: Primary data saved (49429 records). [2025-09-18T18:59:42.180036] [INFO ] [MAIN ] FERG: Full history saved. [2025-09-18T18:59:42.180171] [INFO ] [MAIN ] Update Progress: 821/2372 symbols completed. FERG took 44.6s. Estimated remaining: 3h 46m 2s. Rate: 6.9 symbols/min [2025-09-18T18:59:42.217998] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-18T18:59:42.372740] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:59:42.408639] [DEBUG] [LOCAL ] FFWM: Loaded 36246 existing records from primary storage. [2025-09-18T18:59:42.408821] [INFO ] [MAIN ] FFWM: Loaded 36246 existing records. [2025-09-18T18:59:42.613130] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:59:42.613398] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-18T18:59:42.613449] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-18T18:59:42.614506] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-09-18T18:59:42.614570] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-18T18:59:42.924637] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-18T18:59:42.998184] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:59:43.237177] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T18:59:43.476431] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-18T18:59:43.719547] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-18T18:59:44.359783] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-18T18:59:44.519597] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-11. [2025-09-18T18:59:45.319562] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-18T18:59:45.662034] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-18T18:59:46.083319] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-18T18:59:46.119544] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-18T18:59:46.712870] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-18T18:59:46.919538] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-18T18:59:47.354726] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-18T18:59:47.719577] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-18T18:59:48.519519] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-18T18:59:48.669191] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-18T18:59:48.954581] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-18T18:59:48.956479] [INFO ] [REMOTE ] FFA: Full fetch complete (8125 records). [2025-09-18T18:59:48.956584] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-18T18:59:49.329246] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-09-18T18:59:49.338696] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-09-18T18:59:49.338822] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-09-18T18:59:49.339170] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-09-18T18:59:49.339230] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-09-18T18:59:49.340166] [DEBUG] [LOCAL ] FFA: Trimmed 8125 records to 5628 (keeping 200 days of data) [2025-09-18T18:59:49.375271] [DEBUG] [LOCAL ] FFA: Primary data saved (5628 records). [2025-09-18T18:59:49.375392] [INFO ] [MAIN ] FFA: Full history saved. [2025-09-18T18:59:49.375478] [INFO ] [MAIN ] Update Progress: 822/2372 symbols completed. FFA took 22.7s. Estimated remaining: 3h 45m 50s. Rate: 6.9 symbols/min [2025-09-18T18:59:49.552330] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:59:49.576547] [DEBUG] [LOCAL ] FG: Loaded 22201 existing records from primary storage. [2025-09-18T18:59:49.576735] [INFO ] [MAIN ] FG: Loaded 22201 existing records. [2025-09-18T18:59:49.770179] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:59:49.770478] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-18T18:59:49.770544] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-18T18:59:49.771336] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-09-18T18:59:49.771401] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-18T18:59:50.133537] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:59:50.127715] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-18T18:59:50.455194] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-18T18:59:50.919551] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-11. [2025-09-18T18:59:50.934317] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-18T18:59:50.937780] [INFO ] [REMOTE ] FF: Full fetch complete (37324 records). [2025-09-18T18:59:50.937863] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-18T18:59:51.326168] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-09-18T18:59:51.326275] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-09-18T18:59:51.326957] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-09-18T18:59:51.327022] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-09-18T18:59:51.328135] [DEBUG] [LOCAL ] FF: Trimmed 37324 records to 26065 (keeping 200 days of data) [2025-09-18T18:59:51.491826] [DEBUG] [LOCAL ] FF: Primary data saved (26065 records). [2025-09-18T18:59:51.498513] [INFO ] [MAIN ] FF: Full history saved. [2025-09-18T18:59:51.498707] [INFO ] [MAIN ] Update Progress: 823/2372 symbols completed. FF took 35.0s. Estimated remaining: 3h 45m 29s. Rate: 6.9 symbols/min [2025-09-18T18:59:51.532348] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-18T18:59:51.677272] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T18:59:51.683350] [DEBUG] [LOCAL ] FGN: Loaded 4061 existing records from primary storage. [2025-09-18T18:59:51.683450] [INFO ] [MAIN ] FGN: Loaded 4061 existing records. [2025-09-18T18:59:51.724712] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-09-18T18:59:51.871150] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T18:59:51.871424] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-18T18:59:51.871473] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-18T18:59:51.871745] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-18T18:59:51.871804] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-18T18:59:52.231315] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T18:59:52.519546] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-09-18T18:59:52.998018] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-18T18:59:53.319529] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-09-18T18:59:53.530434] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-18T18:59:54.119509] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-18T18:59:54.331715] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-18T18:59:54.919569] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-09-18T18:59:55.124149] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-18T18:59:55.481713] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-18T18:59:55.719552] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-11. [2025-09-18T18:59:56.280446] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-18T18:59:56.519550] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-09-18T18:59:57.319368] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-18T18:59:57.321848] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-18T18:59:58.119544] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-18T18:59:58.256999] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T18:59:58.702290] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-18T18:59:58.919530] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-18T18:59:59.719577] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-18T19:00:00.094783] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-18T19:00:00.519570] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-09-18T19:00:00.617030] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-18T19:00:01.121185] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-18T19:00:01.319604] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-09-18T19:00:02.119604] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-18T19:00:02.703616] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T19:00:02.919549] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-18T19:00:03.719544] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-18T19:00:04.519596] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-18T19:00:04.731128] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-09-18T19:00:04.837721] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-18T19:00:04.929782] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-18T19:00:05.319628] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-18T19:00:05.837187] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T19:00:06.119688] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-18T19:00:06.634508] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-18T19:00:06.919554] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-18T19:00:07.457672] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-18T19:00:07.719548] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-18T19:00:07.910735] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-18T19:00:08.505244] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-18T19:00:08.519509] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-18T19:00:09.319542] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-18T19:00:09.363390] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-18T19:00:10.119517] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-18T19:00:10.275407] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-18T19:00:10.726850] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-18T19:00:10.919536] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-18T19:00:11.535016] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-18T19:00:11.719571] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-18T19:00:12.519574] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-18T19:00:13.166863] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T19:00:13.325184] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-18T19:00:13.327388] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-18T19:00:13.330549] [INFO ] [REMOTE ] FFC: Full fetch complete (24839 records). [2025-09-18T19:00:13.330639] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-18T19:00:13.728590] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-09-18T19:00:13.728856] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-09-18T19:00:13.729348] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-09-18T19:00:13.729395] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-09-18T19:00:13.730380] [DEBUG] [LOCAL ] FFC: Trimmed 24839 records to 16790 (keeping 200 days of data) [2025-09-18T19:00:13.836726] [DEBUG] [LOCAL ] FFC: Primary data saved (16790 records). [2025-09-18T19:00:13.836907] [INFO ] [MAIN ] FFC: Full history saved. [2025-09-18T19:00:13.837008] [INFO ] [MAIN ] Update Progress: 824/2372 symbols completed. FFC took 33.2s. Estimated remaining: 3h 45m 46s. Rate: 6.9 symbols/min [2025-09-18T19:00:14.029956] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:00:14.030198] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-09-18T19:00:14.030248] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-09-18T19:00:14.030413] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-18T19:00:14.030458] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-18T19:00:14.030502] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-18T19:00:14.030536] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-18T19:00:14.128944] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-18T19:00:14.406989] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:00:14.851505] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-18T19:00:14.919543] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-18T19:00:15.160431] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-18T19:00:15.719567] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-11. [2025-09-18T19:00:15.915871] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-18T19:00:16.519548] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-18T19:00:16.717776] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:00:16.718170] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-11 [2025-09-18T19:00:17.319559] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-18T19:00:17.422606] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-18T19:00:18.119565] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-18T19:00:18.499292] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-18T19:00:18.919556] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-18T19:00:19.233897] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-18T19:00:19.719564] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-18T19:00:20.519578] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-09-18T19:00:20.664636] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-18T19:00:20.731021] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:00:20.731344] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-09-18T19:00:21.319535] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-18T19:00:22.086995] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-18T19:00:22.119540] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-18T19:00:22.560436] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-18T19:00:22.919585] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-09-18T19:00:23.715946] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-18T19:00:23.719482] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-09-18T19:00:24.321720] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-18T19:00:24.519514] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-18T19:00:24.682442] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (7.36 seconds). [2025-09-18T19:00:24.687460] [INFO ] [REMOTE ] FFWM: Full fetch complete (51604 records). [2025-09-18T19:00:24.687588] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-18T19:00:25.072379] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-18T19:00:25.075138] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-09-18T19:00:25.076356] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-09-18T19:00:25.077064] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-09-18T19:00:25.077176] [INFO ] [REMOTE ] FGN: Full fetch complete (5783 records). [2025-09-18T19:00:25.077321] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-18T19:00:25.077263] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-09-18T19:00:25.192499] [DEBUG] [LOCAL ] FFWM: Trimmed 51604 records to 36552 (keeping 200 days of data) [2025-09-18T19:00:25.349345] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-09-18T19:00:25.566532] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-09-18T19:00:25.569389] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-09-18T19:00:25.571543] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-09-18T19:00:25.572476] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-09-18T19:00:25.575336] [DEBUG] [LOCAL ] FGN: Trimmed 5783 records to 4071 (keeping 200 days of data) [2025-09-18T19:00:25.686290] [DEBUG] [LOCAL ] FGN: Primary data saved (4071 records). [2025-09-18T19:00:25.689433] [INFO ] [MAIN ] FGN: Full history saved. [2025-09-18T19:00:25.689910] [INFO ] [MAIN ] Update Progress: 825/2372 symbols completed. FGN took 34.2s. Estimated remaining: 3h 45m 43s. Rate: 6.9 symbols/min [2025-09-18T19:00:25.856507] [DEBUG] [LOCAL ] FFWM: Primary data saved (36552 records). [2025-09-18T19:00:25.873421] [INFO ] [MAIN ] FFWM: Full history saved. [2025-09-18T19:00:25.876706] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:00:25.882352] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-18T19:00:25.881532] [INFO ] [MAIN ] Update Progress: 826/2372 symbols completed. FFWM took 43.7s. Estimated remaining: 3h 45m 18s. Rate: 6.9 symbols/min [2025-09-18T19:00:26.066552] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:00:26.076109] [DEBUG] [LOCAL ] FHN: No existing data file found in primary storage. [2025-09-18T19:00:26.076250] [WARN ] [MAIN ] FHN: No existing data found, performing full refresh instead. [2025-09-18T19:00:26.076418] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-18T19:00:26.076463] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-18T19:00:26.076507] [DEBUG] [LOCAL ] FHN: No primary data file found to delete. [2025-09-18T19:00:26.076541] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-18T19:00:26.120695] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-09-18T19:00:26.255865] [DEBUG] [LOCAL ] FHI: Loaded 40835 existing records from primary storage. [2025-09-18T19:00:26.259136] [INFO ] [MAIN ] FHI: Loaded 40835 existing records. [2025-09-18T19:00:26.649412] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:00:26.672758] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:00:26.673313] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-18T19:00:26.673379] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-18T19:00:26.675063] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-09-18T19:00:26.675125] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-18T19:00:26.923590] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-11. [2025-09-18T19:00:26.936264] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-18T19:00:27.056254] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:00:27.719545] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-09-18T19:00:28.260557] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-18T19:00:28.407935] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-18T19:00:28.519601] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-11. [2025-09-18T19:00:29.319588] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-09-18T19:00:29.893767] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-18T19:00:30.119553] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-09-18T19:00:30.793260] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-18T19:00:30.919605] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-09-18T19:00:31.478720] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-18T19:00:31.504794] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T19:00:31.719622] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-09-18T19:00:32.250128] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-18T19:00:32.519554] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-09-18T19:00:33.319559] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-18T19:00:34.017114] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-18T19:00:34.124110] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-09-18T19:00:34.127678] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-18T19:00:34.919542] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-18T19:00:35.719587] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-18T19:00:35.823744] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-18T19:00:35.826933] [INFO ] [REMOTE ] FG: Full fetch complete (26905 records). [2025-09-18T19:00:35.827043] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-18T19:00:36.221008] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-18T19:00:36.318735] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-09-18T19:00:36.318870] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-09-18T19:00:36.319369] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-18T19:00:36.319414] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-09-18T19:00:36.320312] [DEBUG] [LOCAL ] FG: Trimmed 26905 records to 22428 (keeping 200 days of data) [2025-09-18T19:00:36.457091] [DEBUG] [LOCAL ] FG: Primary data saved (22428 records). [2025-09-18T19:00:36.457224] [INFO ] [MAIN ] FG: Full history saved. [2025-09-18T19:00:36.457306] [INFO ] [MAIN ] Update Progress: 827/2372 symbols completed. FG took 47.1s. Estimated remaining: 3h 45m 13s. Rate: 6.9 symbols/min [2025-09-18T19:00:36.524806] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-09-18T19:00:36.660257] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:00:36.691415] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-18T19:00:36.745627] [DEBUG] [LOCAL ] FI: Loaded 53498 existing records from primary storage. [2025-09-18T19:00:36.745843] [INFO ] [MAIN ] FI: Loaded 53498 existing records. [2025-09-18T19:00:36.927141] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:00:36.927383] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-18T19:00:36.927431] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-18T19:00:36.929499] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-18T19:00:36.929561] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-18T19:00:37.210200] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-18T19:00:37.301707] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:00:37.319511] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-11. [2025-09-18T19:00:38.119615] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-09-18T19:00:38.577499] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-18T19:00:38.578809] [INFO ] [REMOTE ] FGSN: Full fetch complete (7457 records). [2025-09-18T19:00:38.578899] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-09-18T19:00:38.762992] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 167 unique days, need 200 days [2025-09-18T19:00:38.763301] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:00:38.763394] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:00:38.763490] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-18T19:00:38.763632] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-18T19:00:38.763760] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-09-18T19:00:38.763860] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-09-18T19:00:38.763969] [INFO ] [MAIN ] Update Progress: 828/2372 symbols completed. FGSN took 24.9s. Estimated remaining: 3h 44m 52s. Rate: 6.9 symbols/min [2025-09-18T19:00:38.919801] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-18T19:00:38.941173] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:00:38.967439] [DEBUG] [LOCAL ] FICO: Loaded 20419 existing records from primary storage. [2025-09-18T19:00:38.967610] [INFO ] [MAIN ] FICO: Loaded 20419 existing records. [2025-09-18T19:00:39.150921] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:00:39.151462] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-18T19:00:39.151536] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-18T19:00:39.161265] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-18T19:00:39.177361] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-18T19:00:39.211124] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-18T19:00:39.553208] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:00:39.719586] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-18T19:00:40.519570] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-09-18T19:00:40.570023] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-18T19:00:40.962688] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T19:00:41.319577] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-11. [2025-09-18T19:00:42.119522] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-18T19:00:42.207509] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-18T19:00:42.239127] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-18T19:00:42.919546] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-09-18T19:00:43.514933] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-18T19:00:43.719576] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-18T19:00:44.519548] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-09-18T19:00:44.629703] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-18T19:00:45.283248] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-18T19:00:45.324772] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-18T19:00:45.341092] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-18T19:00:46.119560] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-18T19:00:46.919699] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-09-18T19:00:47.107843] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-18T19:00:47.396392] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-18T19:00:47.653879] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-18T19:00:47.719561] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-18T19:00:48.519570] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-18T19:00:48.958572] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-18T19:00:49.319561] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-18T19:00:49.639531] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-18T19:00:50.119550] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-18T19:00:50.382321] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-18T19:00:50.919573] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-18T19:00:51.362598] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-18T19:00:51.719607] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-18T19:00:52.492686] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T19:00:52.519507] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-18T19:00:52.880863] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-18T19:00:53.319586] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-18T19:00:53.924416] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-18T19:00:54.119566] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-18T19:00:54.783446] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-18T19:00:54.919571] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-18T19:00:55.531891] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-18T19:00:55.719596] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-18T19:00:56.091074] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-18T19:00:56.096225] [INFO ] [REMOTE ] FHI: Full fetch complete (57583 records). [2025-09-18T19:00:56.096367] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-18T19:00:56.482410] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-09-18T19:00:56.482546] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-09-18T19:00:56.483273] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-18T19:00:56.483357] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-09-18T19:00:56.485254] [DEBUG] [LOCAL ] FHI: Trimmed 57583 records to 41135 (keeping 200 days of data) [2025-09-18T19:00:56.539837] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-18T19:00:56.743816] [DEBUG] [LOCAL ] FHI: Primary data saved (41135 records). [2025-09-18T19:00:56.743959] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-18T19:00:56.745734] [INFO ] [MAIN ] Update Progress: 829/2372 symbols completed. FHI took 31.1s. Estimated remaining: 3h 45m 0s. Rate: 6.9 symbols/min [2025-09-18T19:00:56.927873] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:00:56.928123] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-18T19:00:56.928184] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-18T19:00:56.928336] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-18T19:00:56.928381] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-18T19:00:56.928424] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-18T19:00:56.928458] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-18T19:00:57.319793] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-18T19:00:57.325155] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:00:57.361610] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T19:00:58.119619] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-18T19:00:58.285066] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-18T19:00:58.516718] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-18T19:00:58.919556] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-18T19:00:59.618898] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-18T19:00:59.626835] [INFO ] [REMOTE ] FHN: Full fetch complete (77103 records). [2025-09-18T19:00:59.627017] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-18T19:00:59.724699] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-11. [2025-09-18T19:01:00.034689] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-09-18T19:01:00.037563] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-09-18T19:01:00.038718] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-18T19:01:00.037714] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-11 (0.31 seconds). [2025-09-18T19:01:00.038891] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-09-18T19:01:00.041638] [DEBUG] [LOCAL ] FHN: Trimmed 77103 records to 53758 (keeping 200 days of data) [2025-09-18T19:01:00.371059] [DEBUG] [LOCAL ] FHN: Primary data saved (53758 records). [2025-09-18T19:01:00.371219] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-18T19:01:00.371302] [INFO ] [MAIN ] Update Progress: 830/2372 symbols completed. FHN took 34.5s. Estimated remaining: 3h 44m 42s. Rate: 6.9 symbols/min [2025-09-18T19:01:00.529069] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-18T19:01:00.558224] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:01:00.603715] [DEBUG] [LOCAL ] FIGS: Loaded 49098 existing records from primary storage. [2025-09-18T19:01:00.603888] [INFO ] [MAIN ] FIGS: Loaded 49098 existing records. [2025-09-18T19:01:00.796279] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:01:00.796550] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-18T19:01:00.796615] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-18T19:01:00.797623] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-18T19:01:00.797724] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-18T19:01:01.183896] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:01:01.221423] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-18T19:01:01.319500] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-18T19:01:01.464124] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-18T19:01:02.119580] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-11. [2025-09-18T19:01:02.919604] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-18T19:01:03.275551] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-18T19:01:03.553931] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T19:01:03.643763] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T19:01:03.719552] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-09-18T19:01:04.034393] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-18T19:01:04.519566] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-18T19:01:05.319567] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-09-18T19:01:05.599132] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-18T19:01:06.119571] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-09-18T19:01:06.458613] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-18T19:01:06.919553] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-18T19:01:07.525261] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-18T19:01:07.719548] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-09-18T19:01:08.519560] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-18T19:01:08.749169] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-18T19:01:08.763918] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-18T19:01:09.116424] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-18T19:01:09.319516] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-18T19:01:09.523824] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-18T19:01:10.119610] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-18T19:01:10.919552] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-18T19:01:11.719637] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-18T19:01:12.144064] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-18T19:01:12.183361] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-18T19:01:12.519539] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-18T19:01:12.691993] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-18T19:01:13.319561] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-18T19:01:13.574554] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-09-18T19:01:14.119533] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-18T19:01:14.326760] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-18T19:01:14.334178] [INFO ] [REMOTE ] FI: Full fetch complete (76996 records). [2025-09-18T19:01:14.334353] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-18T19:01:14.724801] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-18T19:01:14.724888] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-18T19:01:14.725771] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-18T19:01:14.725863] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-18T19:01:14.728914] [DEBUG] [LOCAL ] FI: Trimmed 76996 records to 53888 (keeping 200 days of data) [2025-09-18T19:01:14.940562] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-18T19:01:15.075740] [DEBUG] [LOCAL ] FI: Primary data saved (53888 records). [2025-09-18T19:01:15.075914] [INFO ] [MAIN ] FI: Full history saved. [2025-09-18T19:01:15.076122] [INFO ] [MAIN ] Update Progress: 831/2372 symbols completed. FI took 38.6s. Estimated remaining: 3h 44m 45s. Rate: 6.9 symbols/min [2025-09-18T19:01:15.250860] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:01:15.268606] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-18T19:01:15.315627] [DEBUG] [LOCAL ] FIHL: Loaded 40536 existing records from primary storage. [2025-09-18T19:01:15.315788] [INFO ] [MAIN ] FIHL: Loaded 40536 existing records. [2025-09-18T19:01:15.490294] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:01:15.490552] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-18T19:01:15.490599] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-18T19:01:15.491820] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-18T19:01:15.491890] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-18T19:01:15.727402] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-18T19:01:15.856962] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:01:16.517495] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-18T19:01:16.519508] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-11. [2025-09-18T19:01:16.559733] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-18T19:01:17.319548] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-18T19:01:17.750421] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-18T19:01:18.119608] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-18T19:01:18.924633] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-18T19:01:18.940482] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-18T19:01:19.102025] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:01:19.102375] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-18T19:01:19.172284] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-18T19:01:19.175452] [INFO ] [REMOTE ] FICO: Full fetch complete (28178 records). [2025-09-18T19:01:19.175548] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-18T19:01:19.548109] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-18T19:01:19.548217] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-18T19:01:19.548703] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-18T19:01:19.548778] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-18T19:01:19.549813] [DEBUG] [LOCAL ] FICO: Trimmed 28178 records to 20603 (keeping 200 days of data) [2025-09-18T19:01:19.700100] [DEBUG] [LOCAL ] FICO: Primary data saved (20603 records). [2025-09-18T19:01:19.700234] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-18T19:01:19.700355] [INFO ] [MAIN ] Update Progress: 832/2372 symbols completed. FICO took 40.9s. Estimated remaining: 3h 44m 28s. Rate: 6.9 symbols/min [2025-09-18T19:01:19.724591] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-07. [2025-09-18T19:01:19.873360] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:01:19.887825] [DEBUG] [LOCAL ] FINS: Loaded 8196 existing records from primary storage. [2025-09-18T19:01:19.887941] [INFO ] [MAIN ] FINS: Loaded 8196 existing records. [2025-09-18T19:01:20.076919] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:01:20.077340] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-18T19:01:20.077407] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-18T19:01:20.077974] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-18T19:01:20.078036] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-18T19:01:20.172485] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-18T19:01:20.434314] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:01:20.519489] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-11. [2025-09-18T19:01:21.319575] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-09-18T19:01:21.355392] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-18T19:01:22.119629] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-18T19:01:22.547997] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T19:01:22.919713] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-08. [2025-09-18T19:01:23.456591] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-18T19:01:23.719554] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-18T19:01:24.519619] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-09-18T19:01:25.319588] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-09-18T19:01:25.402585] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-18T19:01:25.451076] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-18T19:01:25.532286] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-18T19:01:26.119625] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-09. [2025-09-18T19:01:26.251831] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-18T19:01:26.919586] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-18T19:01:27.719622] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-09-18T19:01:28.244286] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-18T19:01:28.519563] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-18T19:01:28.721436] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-18T19:01:29.101606] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-09 (2.98 seconds). [2025-09-18T19:01:29.110261] [INFO ] [REMOTE ] FIG: Full fetch complete (13861 records). [2025-09-18T19:01:29.110385] [DEBUG] [VALIDATOR ] FIG: Validating primary data. [2025-09-18T19:01:29.291838] [WARN ] [VALIDATOR ] FIG: Validation failed - insufficient historical data. Have 145 unique days, need 200 days [2025-09-18T19:01:29.292159] [FATAL] [MAIN ] FIG: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:01:29.292253] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:01:29.292329] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-18T19:01:29.292398] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-18T19:01:29.292448] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-18T19:01:29.292530] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-18T19:01:29.292617] [INFO ] [MAIN ] Update Progress: 833/2372 symbols completed. FIG took 32.5s. Estimated remaining: 3h 44m 21s. Rate: 6.9 symbols/min [2025-09-18T19:01:29.324688] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-18T19:01:29.478594] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:01:29.509016] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-18T19:01:29.573866] [DEBUG] [LOCAL ] FINV: Loaded 44930 existing records from primary storage. [2025-09-18T19:01:29.574075] [INFO ] [MAIN ] FINV: Loaded 44930 existing records. [2025-09-18T19:01:29.774186] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:01:29.774471] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-18T19:01:29.774521] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-18T19:01:29.775560] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-18T19:01:29.775634] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-18T19:01:30.053417] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-18T19:01:30.127746] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-18T19:01:30.169273] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:01:30.597085] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-18T19:01:30.919567] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-11. [2025-09-18T19:01:31.719616] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-18T19:01:32.375086] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-18T19:01:32.519589] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-18T19:01:33.042703] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T19:01:33.319565] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-18T19:01:33.718702] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-18T19:01:34.119599] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-18T19:01:34.913596] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-18T19:01:34.925263] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-18T19:01:34.941556] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-18T19:01:35.719608] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-18T19:01:35.842932] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-18T19:01:36.519554] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-18T19:01:36.900036] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-18T19:01:37.128795] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-18T19:01:37.319547] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-18T19:01:38.119600] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-18T19:01:38.919615] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-18T19:01:39.071239] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-18T19:01:39.079048] [INFO ] [REMOTE ] FIGS: Full fetch complete (70978 records). [2025-09-18T19:01:39.079178] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-18T19:01:39.478419] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-18T19:01:39.521365] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-18T19:01:39.525158] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-18T19:01:39.526225] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-18T19:01:39.526353] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-18T19:01:39.528307] [DEBUG] [LOCAL ] FIGS: Trimmed 70978 records to 49441 (keeping 200 days of data) [2025-09-18T19:01:39.654069] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-18T19:01:39.745796] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-18T19:01:39.881043] [DEBUG] [LOCAL ] FIGS: Primary data saved (49441 records). [2025-09-18T19:01:39.881238] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-18T19:01:39.881356] [INFO ] [MAIN ] Update Progress: 834/2372 symbols completed. FIGS took 39.5s. Estimated remaining: 3h 44m 16s. Rate: 6.9 symbols/min [2025-09-18T19:01:40.055887] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:01:40.109328] [DEBUG] [LOCAL ] FIS: Loaded 53372 existing records from primary storage. [2025-09-18T19:01:40.109507] [INFO ] [MAIN ] FIS: Loaded 53372 existing records. [2025-09-18T19:01:40.326809] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:01:40.327126] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-18T19:01:40.327210] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-18T19:01:40.328524] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-18T19:01:40.328587] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-18T19:01:40.527356] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-18T19:01:40.698721] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:01:41.175285] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-18T19:01:41.260102] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-18T19:01:41.319568] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-18T19:01:42.059619] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T19:01:42.061273] [INFO ] [REMOTE ] FINS: Full fetch complete (12836 records). [2025-09-18T19:01:42.061430] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-18T19:01:42.125592] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-18T19:01:42.454894] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-18T19:01:42.454976] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-18T19:01:42.455271] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-18T19:01:42.455310] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-18T19:01:42.455823] [DEBUG] [LOCAL ] FINS: Trimmed 12836 records to 8252 (keeping 200 days of data) [2025-09-18T19:01:42.514180] [DEBUG] [LOCAL ] FINS: Primary data saved (8252 records). [2025-09-18T19:01:42.514346] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-18T19:01:42.514443] [INFO ] [MAIN ] Update Progress: 835/2372 symbols completed. FINS took 22.8s. Estimated remaining: 3h 43m 56s. Rate: 6.9 symbols/min [2025-09-18T19:01:42.697634] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:01:42.742114] [DEBUG] [LOCAL ] FIX: Loaded 30992 existing records from primary storage. [2025-09-18T19:01:42.742266] [INFO ] [MAIN ] FIX: Loaded 30992 existing records. [2025-09-18T19:01:42.928571] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-09-18T19:01:42.937164] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:01:42.938574] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-18T19:01:42.938721] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-18T19:01:42.939752] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-18T19:01:42.940035] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-18T19:01:43.326317] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:01:43.421934] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T19:01:43.719527] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-18T19:01:44.433916] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-18T19:01:44.519541] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-09-18T19:01:45.212841] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T19:01:45.218925] [INFO ] [REMOTE ] FIHL: Full fetch complete (55577 records). [2025-09-18T19:01:45.219097] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-18T19:01:45.325908] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-11. [2025-09-18T19:01:45.610818] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-18T19:01:45.610906] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-18T19:01:45.611592] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-18T19:01:45.611694] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-18T19:01:45.613002] [DEBUG] [LOCAL ] FIHL: Trimmed 55577 records to 40851 (keeping 200 days of data) [2025-09-18T19:01:45.866716] [DEBUG] [LOCAL ] FIHL: Primary data saved (40851 records). [2025-09-18T19:01:45.866851] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-18T19:01:45.866947] [INFO ] [MAIN ] Update Progress: 836/2372 symbols completed. FIHL took 30.8s. Estimated remaining: 3h 43m 37s. Rate: 6.9 symbols/min [2025-09-18T19:01:46.051132] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:01:46.051517] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-18T19:01:46.051628] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-18T19:01:46.052059] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-18T19:01:46.052145] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-18T19:01:46.052362] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-18T19:01:46.052615] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-18T19:01:46.119722] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-11. [2025-09-18T19:01:46.277058] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-18T19:01:46.462432] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:01:46.767564] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-18T19:01:46.919560] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-18T19:01:47.210902] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T19:01:47.719570] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-09-18T19:01:48.183752] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-18T19:01:48.519584] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-11. [2025-09-18T19:01:48.785830] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:01:48.786157] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-11 [2025-09-18T19:01:49.030461] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T19:01:49.319592] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-09-18T19:01:50.119560] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-09-18T19:01:50.331078] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:01:50.331473] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-09-18T19:01:50.919572] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-18T19:01:51.035296] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-18T19:01:51.719577] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-09-18T19:01:52.396907] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T19:01:52.519556] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-18T19:01:52.924418] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T19:01:53.319597] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-09-18T19:01:53.752057] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-18T19:01:54.119583] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-09-18T19:01:54.279415] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:01:54.279839] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-09-18T19:01:54.919931] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-18T19:01:54.925794] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T19:01:55.719550] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-18T19:01:56.460605] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-18T19:01:56.519595] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-02. [2025-09-18T19:01:56.699961] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:01:56.700275] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-02 [2025-09-18T19:01:57.157303] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-18T19:01:57.319549] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-18T19:01:58.119550] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-18T19:01:58.822252] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-18T19:01:58.919554] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-03. [2025-09-18T19:01:59.076580] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:01:59.077139] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-03 [2025-09-18T19:01:59.336582] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-18T19:01:59.719559] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-04. [2025-09-18T19:01:59.971910] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:01:59.972482] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-04 [2025-09-18T19:02:00.519611] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-05. [2025-09-18T19:02:00.779306] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:02:00.779677] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-05 [2025-09-18T19:02:01.319563] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-18T19:02:02.119565] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-18T19:02:02.710707] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T19:02:02.919605] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-18T19:02:03.719559] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-18T19:02:04.080571] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-18T19:02:04.115906] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-18T19:02:04.519571] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-18T19:02:04.807151] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-18T19:02:05.319549] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-18T19:02:05.524026] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-18T19:02:06.119526] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-18T19:02:06.451497] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-18T19:02:06.919561] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-06. [2025-09-18T19:02:07.195248] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-18T19:02:07.473459] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-18T19:02:07.719539] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-18T19:02:08.519547] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-18T19:02:09.160051] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T19:02:09.319560] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-18T19:02:09.910877] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-18T19:02:10.119545] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-18T19:02:10.889350] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-18T19:02:10.919574] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-18T19:02:11.719544] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-18T19:02:11.782159] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-18T19:02:12.519703] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-18T19:02:12.526047] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-18T19:02:13.124967] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-18T19:02:13.319548] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-18T19:02:14.119530] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-07. [2025-09-18T19:02:14.316519] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-18T19:02:14.454693] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-18T19:02:14.919540] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-08. [2025-09-18T19:02:15.041357] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-18T19:02:15.048765] [INFO ] [REMOTE ] FIS: Full fetch complete (76998 records). [2025-09-18T19:02:15.048916] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-18T19:02:15.464409] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-18T19:02:15.467710] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-18T19:02:15.467561] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-18T19:02:15.470041] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-18T19:02:15.470112] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-18T19:02:15.471558] [DEBUG] [LOCAL ] FIS: Trimmed 76998 records to 53758 (keeping 200 days of data) [2025-09-18T19:02:15.719682] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-09. [2025-09-18T19:02:15.811745] [DEBUG] [LOCAL ] FIS: Primary data saved (53758 records). [2025-09-18T19:02:15.811887] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-18T19:02:15.811973] [INFO ] [MAIN ] Update Progress: 837/2372 symbols completed. FIS took 35.9s. Estimated remaining: 3h 44m 7s. Rate: 6.8 symbols/min [2025-09-18T19:02:16.366464] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-18T19:02:16.367433] [INFO ] [REMOTE ] FIXT: Full fetch complete (1674 records). [2025-09-18T19:02:16.367502] [DEBUG] [VALIDATOR ] FIXT: Validating primary data. [2025-09-18T19:02:16.523901] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-18T19:02:16.557040] [WARN ] [VALIDATOR ] FIXT: Validation failed - insufficient historical data. Have 66 unique days, need 200 days [2025-09-18T19:02:16.557305] [FATAL] [MAIN ] FIXT: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:02:16.557432] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:02:16.557506] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-18T19:02:16.557589] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-18T19:02:16.557666] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-18T19:02:16.557735] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-18T19:02:16.557811] [INFO ] [MAIN ] Update Progress: 838/2372 symbols completed. FIXT took 30.7s. Estimated remaining: 3h 43m 44s. Rate: 6.9 symbols/min [2025-09-18T19:02:17.319499] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-18T19:02:18.167200] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-18T19:02:18.173202] [INFO ] [REMOTE ] FIX: Full fetch complete (45646 records). [2025-09-18T19:02:18.173414] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-18T19:02:18.577467] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-18T19:02:18.577582] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-18T19:02:18.578239] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-18T19:02:18.578306] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-18T19:02:18.579560] [DEBUG] [LOCAL ] FIX: Trimmed 45646 records to 31219 (keeping 200 days of data) [2025-09-18T19:02:18.743893] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-18T19:02:18.799847] [INFO ] [REMOTE ] FINV: Full fetch complete (63406 records). [2025-09-18T19:02:18.815430] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-18T19:02:19.032031] [DEBUG] [LOCAL ] FIX: Primary data saved (31219 records). [2025-09-18T19:02:19.051529] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-18T19:02:19.056244] [INFO ] [MAIN ] Update Progress: 839/2372 symbols completed. FIX took 36.5s. Estimated remaining: 3h 43m 23s. Rate: 6.9 symbols/min [2025-09-18T19:02:19.287778] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-18T19:02:19.287871] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-18T19:02:19.288684] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-18T19:02:19.288750] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-18T19:02:19.290188] [DEBUG] [LOCAL ] FINV: Trimmed 63406 records to 45289 (keeping 200 days of data) [2025-09-18T19:02:19.573799] [DEBUG] [LOCAL ] FINV: Primary data saved (45289 records). [2025-09-18T19:02:19.573948] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-18T19:02:19.574929] [INFO ] [MAIN ] Update Progress: 840/2372 symbols completed. FINV took 50.3s. Estimated remaining: 3h 42m 60s. Rate: 6.9 symbols/min [2025-09-18T19:02:20.135476] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:02:20.274805] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:02:20.315669] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:02:20.373036] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:02:20.377041] [DEBUG] [LOCAL ] FLC: Loaded 5754 existing records from primary storage. [2025-09-18T19:02:20.377776] [INFO ] [MAIN ] FLC: Loaded 5754 existing records. [2025-09-18T19:02:20.638485] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:02:20.649791] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-18T19:02:20.649902] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-18T19:02:20.650809] [DEBUG] [LOCAL ] FLNG: Loaded 34240 existing records from primary storage. [2025-09-18T19:02:20.651782] [INFO ] [MAIN ] FLNG: Loaded 34240 existing records. [2025-09-18T19:02:20.657023] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-18T19:02:20.683241] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-18T19:02:20.790843] [DEBUG] [LOCAL ] FLG: Loaded 53341 existing records from primary storage. [2025-09-18T19:02:20.831700] [INFO ] [MAIN ] FLG: Loaded 53341 existing records. [2025-09-18T19:02:20.909246] [DEBUG] [LOCAL ] FLO: Loaded 51858 existing records from primary storage. [2025-09-18T19:02:20.955502] [INFO ] [MAIN ] FLO: Loaded 51858 existing records. [2025-09-18T19:02:21.265706] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:02:21.372333] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-18T19:02:21.454357] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-18T19:02:21.516398] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-18T19:02:21.536681] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-18T19:02:21.536858] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:02:21.622279] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:02:21.641830] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-18T19:02:21.680897] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-18T19:02:21.680961] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-18T19:02:21.742101] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-18T19:02:21.795016] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:02:21.759636] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-18T19:02:21.795461] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-18T19:02:21.795392] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-11. [2025-09-18T19:02:21.853420] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-18T19:02:21.885020] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-18T19:02:22.576061] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:02:22.603285] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-11. [2025-09-18T19:02:22.625862] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-18T19:02:22.634892] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-09-18T19:02:22.777215] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:02:22.789516] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-11. [2025-09-18T19:02:22.872195] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:02:22.872555] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-11. [2025-09-18T19:02:23.304128] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-18T19:02:23.306123] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-09-18T19:02:23.970722] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-18T19:02:23.972548] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-18T19:02:24.147354] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-18T19:02:24.154625] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-09-18T19:02:24.197813] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-18T19:02:24.261753] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T19:02:24.300728] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-18T19:02:24.519548] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-09-18T19:02:25.307109] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-18T19:02:25.319499] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-09-18T19:02:26.119564] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-09-18T19:02:26.214973] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-18T19:02:26.589830] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-18T19:02:26.919539] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-09-18T19:02:27.580388] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-18T19:02:27.719593] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-09-18T19:02:28.156036] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-18T19:02:28.519566] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-18T19:02:28.996164] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-18T19:02:29.319589] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-18T19:02:29.601224] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-18T19:02:30.119589] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-18T19:02:30.532859] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-18T19:02:30.562668] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-18T19:02:30.919539] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-18T19:02:31.374624] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-18T19:02:31.719600] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-18T19:02:32.519566] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-18T19:02:32.946066] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-18T19:02:33.319563] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-18T19:02:33.465046] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-18T19:02:33.772685] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-18T19:02:34.119547] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-18T19:02:34.919556] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-18T19:02:35.546198] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T19:02:35.585974] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-18T19:02:35.719555] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-18T19:02:36.519608] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-18T19:02:37.319544] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-18T19:02:37.427196] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-18T19:02:37.729352] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-18T19:02:38.119592] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-18T19:02:38.756637] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-18T19:02:38.919564] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-18T19:02:39.502188] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-18T19:02:39.624176] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-18T19:02:39.625549] [INFO ] [REMOTE ] FLC: Full fetch complete (8142 records). [2025-09-18T19:02:39.625691] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-18T19:02:39.724717] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-18T19:02:40.051444] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-18T19:02:40.051524] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-18T19:02:40.051780] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-18T19:02:40.051855] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-18T19:02:40.052431] [DEBUG] [LOCAL ] FLC: Trimmed 8142 records to 5787 (keeping 200 days of data) [2025-09-18T19:02:40.089624] [DEBUG] [LOCAL ] FLC: Primary data saved (5787 records). [2025-09-18T19:02:40.089807] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-18T19:02:40.089900] [INFO ] [MAIN ] Update Progress: 841/2372 symbols completed. FLC took 20.5s. Estimated remaining: 3h 43m 12s. Rate: 6.9 symbols/min [2025-09-18T19:02:40.280399] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:02:40.280601] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-09-18T19:02:40.280689] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-09-18T19:02:40.280847] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-18T19:02:40.280891] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-18T19:02:40.280934] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-18T19:02:40.280967] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-18T19:02:40.524678] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-18T19:02:40.698591] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:02:41.267008] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T19:02:41.319506] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-18T19:02:41.954223] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-18T19:02:42.119569] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-18T19:02:42.782018] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-18T19:02:42.919560] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-11. [2025-09-18T19:02:43.181434] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:02:43.181790] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-11 [2025-09-18T19:02:43.272992] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-18T19:02:43.719604] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-18T19:02:44.519627] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-18T19:02:45.319548] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-18T19:02:45.699711] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-18T19:02:45.736816] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-18T19:02:46.119583] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-09-18T19:02:46.314241] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:02:46.314569] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-09-18T19:02:46.709996] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-18T19:02:46.919563] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-18T19:02:47.719567] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-18T19:02:48.311169] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T19:02:48.519552] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-09-18T19:02:49.308441] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-18T19:02:49.319767] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-18T19:02:49.348379] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-18T19:02:50.119564] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-18T19:02:50.604889] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-18T19:02:50.610776] [INFO ] [REMOTE ] FLNG: Full fetch complete (50863 records). [2025-09-18T19:02:50.610894] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-18T19:02:50.924707] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-09-18T19:02:51.012617] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-18T19:02:51.012749] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-18T19:02:51.013583] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-18T19:02:51.013687] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-18T19:02:51.015128] [DEBUG] [LOCAL ] FLNG: Trimmed 50863 records to 34505 (keeping 200 days of data) [2025-09-18T19:02:51.240265] [DEBUG] [LOCAL ] FLNG: Primary data saved (34505 records). [2025-09-18T19:02:51.240426] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-18T19:02:51.240516] [INFO ] [MAIN ] Update Progress: 842/2372 symbols completed. FLNG took 31.7s. Estimated remaining: 3h 43m 8s. Rate: 6.9 symbols/min [2025-09-18T19:02:51.426245] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:02:51.483220] [DEBUG] [LOCAL ] FLR: Loaded 53121 existing records from primary storage. [2025-09-18T19:02:51.483410] [INFO ] [MAIN ] FLR: Loaded 53121 existing records. [2025-09-18T19:02:51.682624] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:02:51.682944] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-18T19:02:51.683009] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-18T19:02:51.684237] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-09-18T19:02:51.684302] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-18T19:02:51.727455] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-18T19:02:52.125094] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:02:52.165631] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-18T19:02:52.197060] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-18T19:02:52.519549] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-09-18T19:02:53.319541] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-11. [2025-09-18T19:02:53.404660] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-18T19:02:53.576047] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-18T19:02:54.119609] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-18T19:02:54.733882] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-18T19:02:54.919546] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-09-18T19:02:55.719626] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-18T19:02:55.910912] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-18T19:02:55.972175] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-18T19:02:56.519601] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-09-18T19:02:57.270689] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-18T19:02:57.278914] [INFO ] [REMOTE ] FLO: Full fetch complete (74623 records). [2025-09-18T19:02:57.279253] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-18T19:02:57.324849] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-09-18T19:02:57.716976] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-09-18T19:02:57.717084] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-09-18T19:02:57.718005] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-09-18T19:02:57.718085] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-09-18T19:02:57.719755] [DEBUG] [LOCAL ] FLO: Trimmed 74623 records to 52245 (keeping 200 days of data) [2025-09-18T19:02:57.966502] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T19:02:58.098684] [DEBUG] [LOCAL ] FLO: Primary data saved (52245 records). [2025-09-18T19:02:58.098993] [INFO ] [MAIN ] FLO: Full history saved. [2025-09-18T19:02:58.099140] [INFO ] [MAIN ] Update Progress: 843/2372 symbols completed. FLO took 38.5s. Estimated remaining: 3h 42m 56s. Rate: 6.9 symbols/min [2025-09-18T19:02:58.124680] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-09-18T19:02:58.285416] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:02:58.341062] [DEBUG] [LOCAL ] FLS: Loaded 50150 existing records from primary storage. [2025-09-18T19:02:58.341266] [INFO ] [MAIN ] FLS: Loaded 50150 existing records. [2025-09-18T19:02:58.518147] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:02:58.518426] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-18T19:02:58.518476] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-18T19:02:58.519970] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-18T19:02:58.520033] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-18T19:02:58.926235] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-18T19:02:58.934050] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:02:58.986017] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-18T19:02:59.158203] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-18T19:02:59.719558] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-11. [2025-09-18T19:03:00.462290] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-18T19:03:00.519526] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-18T19:03:00.878840] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-18T19:03:01.319573] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-09-18T19:03:02.119559] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-09-18T19:03:02.919579] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-09-18T19:03:03.189707] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-18T19:03:03.719551] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-18T19:03:03.775610] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-18T19:03:04.519604] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-18T19:03:04.631679] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-18T19:03:05.319570] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-09-18T19:03:05.405476] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-18T19:03:05.413829] [INFO ] [REMOTE ] FLG: Full fetch complete (77149 records). [2025-09-18T19:03:05.414016] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-18T19:03:05.911290] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-18T19:03:05.922685] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-18T19:03:05.923961] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-18T19:03:05.924444] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-18T19:03:05.927132] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (3.81 seconds). [2025-09-18T19:03:05.939064] [DEBUG] [LOCAL ] FLG: Trimmed 77149 records to 53725 (keeping 200 days of data) [2025-09-18T19:03:06.099432] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-18T19:03:06.163809] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-09-18T19:03:06.244281] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-18T19:03:06.362181] [DEBUG] [LOCAL ] FLG: Primary data saved (53725 records). [2025-09-18T19:03:06.362353] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-18T19:03:06.362510] [INFO ] [MAIN ] Update Progress: 844/2372 symbols completed. FLG took 46.8s. Estimated remaining: 3h 42m 46s. Rate: 6.9 symbols/min [2025-09-18T19:03:06.556162] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:03:06.613497] [DEBUG] [LOCAL ] FLUT: Loaded 51037 existing records from primary storage. [2025-09-18T19:03:06.613693] [INFO ] [MAIN ] FLUT: Loaded 51037 existing records. [2025-09-18T19:03:06.801277] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:03:06.801544] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-18T19:03:06.801599] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-18T19:03:06.803105] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-18T19:03:06.803169] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-18T19:03:06.924693] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-18T19:03:07.190010] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:03:07.719565] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-09-18T19:03:07.827381] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-18T19:03:08.519606] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-18T19:03:08.596352] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-18T19:03:08.626431] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-18T19:03:08.630417] [INFO ] [REMOTE ] FLOC: Full fetch complete (36528 records). [2025-09-18T19:03:08.630506] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-09-18T19:03:08.824981] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-18T19:03:08.825455] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:03:08.825529] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:03:08.825603] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-18T19:03:08.825746] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-18T19:03:08.825802] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-09-18T19:03:08.826053] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-09-18T19:03:08.826141] [INFO ] [MAIN ] Update Progress: 845/2372 symbols completed. FLOC took 28.7s. Estimated remaining: 3h 42m 26s. Rate: 6.9 symbols/min [2025-09-18T19:03:09.017527] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:03:09.041118] [DEBUG] [LOCAL ] FLXR: Loaded 19568 existing records from primary storage. [2025-09-18T19:03:09.041258] [INFO ] [MAIN ] FLXR: Loaded 19568 existing records. [2025-09-18T19:03:09.240555] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:03:09.240955] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-18T19:03:09.241025] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-18T19:03:09.242153] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-18T19:03:09.242231] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-18T19:03:09.324694] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-18T19:03:09.626373] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:03:10.023304] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-18T19:03:10.119504] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-18T19:03:10.805559] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-18T19:03:10.919539] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-18T19:03:11.708762] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T19:03:11.719576] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-11. [2025-09-18T19:03:12.516136] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-18T19:03:12.519479] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-09-18T19:03:12.881248] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-18T19:03:13.319547] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-11. [2025-09-18T19:03:13.819472] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-18T19:03:14.119581] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-18T19:03:14.919579] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-09-18T19:03:15.602974] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-11 (2.28 seconds). [2025-09-18T19:03:15.666597] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-18T19:03:15.719524] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-18T19:03:15.941430] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-18T19:03:16.334675] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-18T19:03:16.519548] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-09-18T19:03:17.319591] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-18T19:03:18.119571] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-18T19:03:18.244266] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-18T19:03:18.498144] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-18T19:03:18.919536] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-09-18T19:03:19.605663] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-18T19:03:19.719558] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-18T19:03:20.145316] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-18T19:03:20.335012] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-18T19:03:20.519555] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-18T19:03:21.306799] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-18T19:03:21.319502] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-18T19:03:22.126834] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-18T19:03:22.130232] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-18T19:03:22.919532] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-18T19:03:23.719572] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-18T19:03:24.053867] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-18T19:03:24.181494] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-18T19:03:24.519545] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-18T19:03:25.271637] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-18T19:03:25.319506] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-18T19:03:25.968682] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-18T19:03:26.119546] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-18T19:03:26.919540] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-18T19:03:27.115975] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-18T19:03:27.698804] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T19:03:27.719494] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-18T19:03:28.412864] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T19:03:28.519499] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-18T19:03:29.319579] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-18T19:03:29.589409] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-18T19:03:29.969690] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T19:03:29.977395] [INFO ] [REMOTE ] FLR: Full fetch complete (76070 records). [2025-09-18T19:03:29.977608] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-18T19:03:30.047279] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-18T19:03:30.124605] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-18T19:03:30.401704] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-09-18T19:03:30.401798] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-09-18T19:03:30.402633] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-09-18T19:03:30.402716] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-09-18T19:03:30.404199] [DEBUG] [LOCAL ] FLR: Trimmed 76070 records to 53510 (keeping 200 days of data) [2025-09-18T19:03:30.729135] [DEBUG] [LOCAL ] FLR: Primary data saved (53510 records). [2025-09-18T19:03:30.729288] [INFO ] [MAIN ] FLR: Full history saved. [2025-09-18T19:03:30.729392] [INFO ] [MAIN ] Update Progress: 846/2372 symbols completed. FLR took 39.5s. Estimated remaining: 3h 42m 41s. Rate: 6.9 symbols/min [2025-09-18T19:03:30.902809] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:03:30.919591] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-18T19:03:30.964582] [DEBUG] [LOCAL ] FMC: Loaded 51832 existing records from primary storage. [2025-09-18T19:03:30.964817] [INFO ] [MAIN ] FMC: Loaded 51832 existing records. [2025-09-18T19:03:31.146004] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:03:31.146243] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-18T19:03:31.146293] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-18T19:03:31.147635] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-09-18T19:03:31.147720] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-18T19:03:31.501016] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:03:31.719522] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-18T19:03:32.039369] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-18T19:03:32.477306] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-18T19:03:32.478386] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-18T19:03:32.519523] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-18T19:03:33.319635] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-18T19:03:33.613618] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-18T19:03:34.119784] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-18T19:03:34.919605] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-18T19:03:34.960101] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-18T19:03:34.970255] [INFO ] [REMOTE ] FLS: Full fetch complete (71015 records). [2025-09-18T19:03:34.970386] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-18T19:03:35.366873] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-18T19:03:35.366957] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-18T19:03:35.367782] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-18T19:03:35.367873] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-18T19:03:35.369480] [DEBUG] [LOCAL ] FLS: Trimmed 71015 records to 50538 (keeping 200 days of data) [2025-09-18T19:03:35.699412] [DEBUG] [LOCAL ] FLS: Primary data saved (50538 records). [2025-09-18T19:03:35.699590] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-18T19:03:35.701743] [INFO ] [MAIN ] Update Progress: 847/2372 symbols completed. FLS took 37.6s. Estimated remaining: 3h 42m 26s. Rate: 6.9 symbols/min [2025-09-18T19:03:35.724755] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-11. [2025-09-18T19:03:35.880044] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:03:35.896284] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-18T19:03:35.903388] [DEBUG] [LOCAL ] FMN: Loaded 6213 existing records from primary storage. [2025-09-18T19:03:35.903471] [INFO ] [MAIN ] FMN: Loaded 6213 existing records. [2025-09-18T19:03:35.938931] [INFO ] [REMOTE ] FLXR: Full fetch complete (24324 records). [2025-09-18T19:03:35.988990] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-18T19:03:36.210622] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:03:36.232636] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-18T19:03:36.253354] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-18T19:03:36.326631] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-18T19:03:36.359469] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-18T19:03:36.359282] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-18T19:03:36.523329] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-18T19:03:36.828937] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-18T19:03:36.867867] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-18T19:03:36.893707] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-18T19:03:36.896345] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-18T19:03:36.950164] [DEBUG] [LOCAL ] FLXR: Trimmed 24324 records to 19746 (keeping 200 days of data) [2025-09-18T19:03:36.985118] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:03:37.134504] [DEBUG] [LOCAL ] FLXR: Primary data saved (19746 records). [2025-09-18T19:03:37.134684] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-18T19:03:37.134792] [INFO ] [MAIN ] Update Progress: 848/2372 symbols completed. FLXR took 28.3s. Estimated remaining: 3h 42m 4s. Rate: 6.9 symbols/min [2025-09-18T19:03:37.315003] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:03:37.319507] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-11. [2025-09-18T19:03:37.371028] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T19:03:37.392164] [DEBUG] [LOCAL ] FMS: Loaded 30559 existing records from primary storage. [2025-09-18T19:03:37.392311] [INFO ] [MAIN ] FMS: Loaded 30559 existing records. [2025-09-18T19:03:37.574755] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:03:37.574977] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-18T19:03:37.575024] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-18T19:03:37.575825] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-18T19:03:37.575886] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-18T19:03:37.945756] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:03:38.081299] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-18T19:03:38.098723] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-18T19:03:38.119486] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-09-18T19:03:38.630207] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-18T19:03:38.919540] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-18T19:03:39.719622] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-11. [2025-09-18T19:03:40.519581] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-09-18T19:03:40.761324] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-18T19:03:40.769242] [INFO ] [REMOTE ] FLUT: Full fetch complete (72610 records). [2025-09-18T19:03:40.769383] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-18T19:03:41.175945] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-18T19:03:41.213411] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-18T19:03:41.213803] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-18T19:03:41.213963] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-18T19:03:41.217226] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-18T19:03:41.217987] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-18T19:03:41.222508] [DEBUG] [LOCAL ] FLUT: Trimmed 72610 records to 51391 (keeping 200 days of data) [2025-09-18T19:03:41.331927] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-09-18T19:03:41.571020] [DEBUG] [LOCAL ] FLUT: Primary data saved (51391 records). [2025-09-18T19:03:41.571174] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-18T19:03:41.571281] [INFO ] [MAIN ] Update Progress: 849/2372 symbols completed. FLUT took 35.2s. Estimated remaining: 3h 41m 47s. Rate: 6.9 symbols/min [2025-09-18T19:03:41.753010] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:03:41.793971] [DEBUG] [LOCAL ] FMX: Loaded 40729 existing records from primary storage. [2025-09-18T19:03:41.794140] [INFO ] [MAIN ] FMX: Loaded 40729 existing records. [2025-09-18T19:03:41.972164] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:03:41.972438] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-18T19:03:41.972487] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-18T19:03:41.973775] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-09-18T19:03:41.973847] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-18T19:03:42.124710] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-18T19:03:42.341447] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:03:42.583369] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-18T19:03:42.658188] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-18T19:03:42.919534] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-18T19:03:43.719547] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-09-18T19:03:43.777521] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-18T19:03:44.519590] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-11. [2025-09-18T19:03:44.705216] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-18T19:03:45.319542] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-18T19:03:45.809992] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-18T19:03:46.119528] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-09-18T19:03:46.494082] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-18T19:03:46.919535] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-18T19:03:47.448683] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-18T19:03:47.507303] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T19:03:47.719562] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-18T19:03:48.373435] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-18T19:03:48.519579] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-18T19:03:49.120208] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-18T19:03:49.319579] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-18T19:03:49.994185] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-18T19:03:50.119556] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-09-18T19:03:50.919530] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-18T19:03:51.281965] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-18T19:03:51.719581] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-09-18T19:03:52.324279] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-18T19:03:52.519548] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-18T19:03:53.223033] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T19:03:53.319564] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-09-18T19:03:53.468791] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-18T19:03:54.119548] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-18T19:03:54.739743] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-18T19:03:54.919570] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-18T19:03:55.192458] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-18T19:03:55.719610] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-18T19:03:56.511456] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-18T19:03:56.520861] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-18T19:03:56.785281] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-18T19:03:57.319599] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-18T19:03:57.921516] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-18T19:03:58.119547] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-18T19:03:58.531143] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-18T19:03:58.565719] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-18T19:03:58.919552] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-18T19:03:59.631423] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-18T19:03:59.632856] [INFO ] [REMOTE ] FMN: Full fetch complete (10291 records). [2025-09-18T19:03:59.632929] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-18T19:03:59.724730] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-18T19:04:00.014339] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-18T19:04:00.014458] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-18T19:04:00.014762] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-18T19:04:00.014849] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-18T19:04:00.015599] [DEBUG] [LOCAL ] FMN: Trimmed 10291 records to 6239 (keeping 200 days of data) [2025-09-18T19:04:00.057631] [DEBUG] [LOCAL ] FMN: Primary data saved (6239 records). [2025-09-18T19:04:00.057823] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-18T19:04:00.057937] [INFO ] [MAIN ] Update Progress: 850/2372 symbols completed. FMN took 24.4s. Estimated remaining: 3h 41m 56s. Rate: 6.9 symbols/min [2025-09-18T19:04:00.245977] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:04:00.249917] [DEBUG] [LOCAL ] FMY: Loaded 1348 existing records from primary storage. [2025-09-18T19:04:00.249995] [INFO ] [MAIN ] FMY: Loaded 1348 existing records. [2025-09-18T19:04:00.426002] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:04:00.426262] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-18T19:04:00.426311] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-18T19:04:00.426546] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-18T19:04:00.426616] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-18T19:04:00.524727] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-18T19:04:00.790427] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:04:01.319552] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-18T19:04:01.633905] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-18T19:04:02.131879] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-18T19:04:02.155895] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-18T19:04:02.244970] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T19:04:02.919548] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-11. [2025-09-18T19:04:03.182174] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-11 (0.26 seconds). [2025-09-18T19:04:03.719519] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-09-18T19:04:03.758633] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-18T19:04:04.101031] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-18T19:04:04.519593] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-18T19:04:05.319585] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-18T19:04:05.790680] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-18T19:04:06.119578] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-18T19:04:06.646988] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-18T19:04:06.919536] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-18T19:04:07.199396] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-18T19:04:07.719545] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-18T19:04:08.481037] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T19:04:08.519567] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-09-18T19:04:08.589565] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-18T19:04:08.595123] [INFO ] [REMOTE ] FMS: Full fetch complete (42437 records). [2025-09-18T19:04:08.595320] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-18T19:04:08.821793] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-18T19:04:09.022946] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-18T19:04:09.023078] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-18T19:04:09.023919] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-18T19:04:09.023993] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-18T19:04:09.025700] [DEBUG] [LOCAL ] FMS: Trimmed 42437 records to 30776 (keeping 200 days of data) [2025-09-18T19:04:09.217587] [DEBUG] [LOCAL ] FMS: Primary data saved (30776 records). [2025-09-18T19:04:09.217829] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-18T19:04:09.217969] [INFO ] [MAIN ] Update Progress: 851/2372 symbols completed. FMS took 32.1s. Estimated remaining: 3h 41m 48s. Rate: 6.9 symbols/min [2025-09-18T19:04:09.321047] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-18T19:04:09.397212] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:04:09.440844] [DEBUG] [LOCAL ] FN: Loaded 39736 existing records from primary storage. [2025-09-18T19:04:09.441087] [INFO ] [MAIN ] FN: Loaded 39736 existing records. [2025-09-18T19:04:09.636165] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:04:09.636568] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-18T19:04:09.636669] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-18T19:04:09.637879] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-09-18T19:04:09.637946] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-18T19:04:09.720776] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-18T19:04:10.017695] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:04:10.119544] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-18T19:04:10.380266] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-09-18T19:04:10.919532] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-18T19:04:11.719558] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-18T19:04:12.517206] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-18T19:04:12.525788] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-11. [2025-09-18T19:04:13.305202] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T19:04:13.319488] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-18T19:04:13.618417] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T19:04:14.119573] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-18T19:04:14.553977] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-18T19:04:14.919517] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-18T19:04:14.965466] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-18T19:04:15.411949] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-18T19:04:15.719581] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-18T19:04:15.994754] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-18T19:04:16.519557] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-09-18T19:04:17.319607] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-18T19:04:17.599263] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-18T19:04:17.756382] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-18T19:04:18.119550] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-18T19:04:18.919534] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-18T19:04:19.679324] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-18T19:04:19.719525] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-09-18T19:04:20.308676] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T19:04:20.519548] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-18T19:04:20.796551] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-18T19:04:20.858431] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-18T19:04:21.319549] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-18T19:04:22.119572] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-18T19:04:22.485636] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-18T19:04:22.486439] [INFO ] [REMOTE ] FMY: Full fetch complete (1918 records). [2025-09-18T19:04:22.486514] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-18T19:04:22.864579] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-09-18T19:04:22.864686] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-09-18T19:04:22.864794] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-09-18T19:04:22.864872] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-09-18T19:04:22.865218] [DEBUG] [LOCAL ] FMY: Trimmed 1918 records to 1360 (keeping 200 days of data) [2025-09-18T19:04:22.873969] [DEBUG] [LOCAL ] FMY: Primary data saved (1360 records). [2025-09-18T19:04:22.874030] [INFO ] [MAIN ] FMY: Full history saved. [2025-09-18T19:04:22.874114] [INFO ] [MAIN ] Update Progress: 852/2372 symbols completed. FMY took 22.8s. Estimated remaining: 3h 41m 48s. Rate: 6.9 symbols/min [2025-09-18T19:04:22.924735] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-18T19:04:23.058169] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:04:23.126475] [DEBUG] [LOCAL ] FNB: Loaded 52454 existing records from primary storage. [2025-09-18T19:04:23.126676] [INFO ] [MAIN ] FNB: Loaded 52454 existing records. [2025-09-18T19:04:23.246328] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-18T19:04:23.276128] [INFO ] [REMOTE ] FMC: Full fetch complete (74643 records). [2025-09-18T19:04:23.291622] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-18T19:04:23.427012] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:04:23.466424] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-18T19:04:23.466582] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-18T19:04:23.473125] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-09-18T19:04:23.483494] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-18T19:04:23.724701] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-18T19:04:24.173388] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-09-18T19:04:24.173091] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:04:24.173601] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-09-18T19:04:24.174770] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-09-18T19:04:24.175202] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-09-18T19:04:24.177000] [DEBUG] [LOCAL ] FMC: Trimmed 74643 records to 52192 (keeping 200 days of data) [2025-09-18T19:04:24.318802] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-18T19:04:24.529029] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-11. [2025-09-18T19:04:24.551398] [DEBUG] [LOCAL ] FMC: Primary data saved (52192 records). [2025-09-18T19:04:24.551593] [INFO ] [MAIN ] FMC: Full history saved. [2025-09-18T19:04:24.551771] [INFO ] [MAIN ] Update Progress: 853/2372 symbols completed. FMC took 53.8s. Estimated remaining: 3h 41m 27s. Rate: 6.9 symbols/min [2025-09-18T19:04:24.747534] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:04:24.806268] [DEBUG] [LOCAL ] FND: Loaded 52174 existing records from primary storage. [2025-09-18T19:04:24.806428] [INFO ] [MAIN ] FND: Loaded 52174 existing records. [2025-09-18T19:04:24.988758] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:04:24.989057] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-18T19:04:24.989114] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-18T19:04:24.990304] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-18T19:04:24.990371] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-18T19:04:25.322359] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-18T19:04:25.347069] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:04:25.469964] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-18T19:04:25.476988] [INFO ] [REMOTE ] FMX: Full fetch complete (57597 records). [2025-09-18T19:04:25.477160] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-18T19:04:25.904353] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-09-18T19:04:25.904469] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-09-18T19:04:25.905418] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-09-18T19:04:25.905509] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-09-18T19:04:25.907330] [DEBUG] [LOCAL ] FMX: Trimmed 57597 records to 41086 (keeping 200 days of data) [2025-09-18T19:04:26.120434] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-11. [2025-09-18T19:04:26.176828] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T19:04:26.220157] [DEBUG] [LOCAL ] FMX: Primary data saved (41086 records). [2025-09-18T19:04:26.220298] [INFO ] [MAIN ] FMX: Full history saved. [2025-09-18T19:04:26.220390] [INFO ] [MAIN ] Update Progress: 854/2372 symbols completed. FMX took 44.6s. Estimated remaining: 3h 41m 5s. Rate: 6.9 symbols/min [2025-09-18T19:04:26.416823] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:04:26.466759] [DEBUG] [LOCAL ] FNF: Loaded 49332 existing records from primary storage. [2025-09-18T19:04:26.466944] [INFO ] [MAIN ] FNF: Loaded 49332 existing records. [2025-09-18T19:04:26.711521] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:04:26.712021] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-18T19:04:26.712296] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-18T19:04:26.713636] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-18T19:04:26.713759] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-18T19:04:26.926945] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-09-18T19:04:27.080750] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-18T19:04:27.161903] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:04:27.541528] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T19:04:27.719617] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-09-18T19:04:28.426703] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T19:04:28.519576] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-18T19:04:29.170816] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-18T19:04:29.319562] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-09-18T19:04:30.119604] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-11. [2025-09-18T19:04:30.174049] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-18T19:04:30.529573] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-18T19:04:30.919577] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-18T19:04:31.669976] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-18T19:04:31.719501] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-09-18T19:04:32.123616] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-18T19:04:32.519608] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-18T19:04:33.320733] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-18T19:04:33.320820] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-18T19:04:33.788010] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-18T19:04:34.119562] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-09-18T19:04:34.705715] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T19:04:34.919578] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-09-18T19:04:35.577458] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-18T19:04:35.719580] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-18T19:04:36.097779] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-18T19:04:36.519598] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-18T19:04:36.901163] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-18T19:04:37.319545] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-18T19:04:38.119567] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-18T19:04:38.329596] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-18T19:04:38.594723] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-18T19:04:38.919556] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-18T19:04:39.336847] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T19:04:39.719559] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-18T19:04:40.519586] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-18T19:04:40.610929] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-18T19:04:40.616591] [INFO ] [REMOTE ] FN: Full fetch complete (56451 records). [2025-09-18T19:04:40.616753] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-18T19:04:40.998545] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-09-18T19:04:40.998706] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-09-18T19:04:40.999512] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-09-18T19:04:40.999577] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-09-18T19:04:41.000962] [DEBUG] [LOCAL ] FN: Trimmed 56451 records to 40044 (keeping 200 days of data) [2025-09-18T19:04:41.240860] [DEBUG] [LOCAL ] FN: Primary data saved (40044 records). [2025-09-18T19:04:41.240991] [INFO ] [MAIN ] FN: Full history saved. [2025-09-18T19:04:41.241072] [INFO ] [MAIN ] Update Progress: 855/2372 symbols completed. FN took 32.0s. Estimated remaining: 3h 41m 8s. Rate: 6.9 symbols/min [2025-09-18T19:04:41.331304] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-18T19:04:41.454309] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:04:41.485929] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-18T19:04:41.531165] [DEBUG] [LOCAL ] FNV: Loaded 46493 existing records from primary storage. [2025-09-18T19:04:41.531309] [INFO ] [MAIN ] FNV: Loaded 46493 existing records. [2025-09-18T19:04:41.706748] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:04:41.707035] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-18T19:04:41.707086] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-18T19:04:41.708567] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-09-18T19:04:41.708630] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-18T19:04:42.067256] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:04:42.107831] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T19:04:42.119502] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-18T19:04:42.788639] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T19:04:42.919517] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-18T19:04:43.719615] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-18T19:04:43.792153] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-18T19:04:44.342482] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-18T19:04:44.519571] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-11. [2025-09-18T19:04:44.970288] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-18T19:04:45.319556] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-18T19:04:45.711975] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-18T19:04:46.119567] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-18T19:04:46.919564] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-18T19:04:47.126412] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-18T19:04:47.719608] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-18T19:04:48.519723] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-09-18T19:04:49.598692] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (3.48 seconds). [2025-09-18T19:04:49.611483] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-18T19:04:49.783034] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-18T19:04:49.856486] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-09-18T19:04:50.127045] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-18T19:04:50.142726] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-18T19:04:50.919515] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-09-18T19:04:51.000549] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-18T19:04:51.486638] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-18T19:04:51.719552] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-18T19:04:52.519530] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-18T19:04:52.556344] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-18T19:04:53.102226] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-18T19:04:53.109539] [INFO ] [REMOTE ] FND: Full fetch complete (74184 records). [2025-09-18T19:04:53.109689] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-18T19:04:53.324760] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-18T19:04:53.499417] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-18T19:04:53.499499] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-18T19:04:53.500326] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-18T19:04:53.500392] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-18T19:04:53.501903] [DEBUG] [LOCAL ] FND: Trimmed 74184 records to 52560 (keeping 200 days of data) [2025-09-18T19:04:53.855978] [DEBUG] [LOCAL ] FND: Primary data saved (52560 records). [2025-09-18T19:04:53.856205] [INFO ] [MAIN ] FND: Full history saved. [2025-09-18T19:04:53.856377] [INFO ] [MAIN ] Update Progress: 856/2372 symbols completed. FND took 29.3s. Estimated remaining: 3h 41m 6s. Rate: 6.9 symbols/min [2025-09-18T19:04:54.065369] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:04:54.065587] [DEBUG] [LOCAL ] FOA: No existing data file found in primary storage. [2025-09-18T19:04:54.065740] [WARN ] [MAIN ] FOA: No existing data found, performing full refresh instead. [2025-09-18T19:04:54.066066] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-18T19:04:54.066142] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-18T19:04:54.066204] [DEBUG] [LOCAL ] FOA: No primary data file found to delete. [2025-09-18T19:04:54.066305] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-18T19:04:54.129602] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-18T19:04:54.432305] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:04:54.467620] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-18T19:04:54.919557] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-18T19:04:54.978040] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-18T19:04:55.424606] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-18T19:04:55.719561] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-11. [2025-09-18T19:04:56.178161] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-18T19:04:56.268247] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-18T19:04:56.519549] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-09-18T19:04:57.319533] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-18T19:04:57.431975] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-18T19:04:58.119555] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-18T19:04:58.919553] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-18T19:04:59.719543] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-09-18T19:04:59.818873] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-18T19:05:00.297715] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-18T19:05:00.304732] [INFO ] [REMOTE ] FNF: Full fetch complete (69313 records). [2025-09-18T19:05:00.304873] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-18T19:05:00.535549] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-18T19:05:00.699848] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-18T19:05:00.699935] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-18T19:05:00.700745] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-18T19:05:00.700813] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-18T19:05:00.702201] [DEBUG] [LOCAL ] FNF: Trimmed 69313 records to 49675 (keeping 200 days of data) [2025-09-18T19:05:01.016415] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-18T19:05:01.028778] [DEBUG] [LOCAL ] FNF: Primary data saved (49675 records). [2025-09-18T19:05:01.028898] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-18T19:05:01.028978] [INFO ] [MAIN ] Update Progress: 857/2372 symbols completed. FNF took 34.8s. Estimated remaining: 3h 40m 54s. Rate: 6.9 symbols/min [2025-09-18T19:05:01.206382] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:05:01.242891] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-18T19:05:01.247004] [DEBUG] [LOCAL ] FOF: Loaded 8360 existing records from primary storage. [2025-09-18T19:05:01.257055] [INFO ] [MAIN ] FOF: Loaded 8360 existing records. [2025-09-18T19:05:01.324736] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-18T19:05:01.453839] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:05:01.454145] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-18T19:05:01.454201] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-18T19:05:01.454583] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-18T19:05:01.454680] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-18T19:05:01.823268] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:05:02.119512] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-11. [2025-09-18T19:05:02.311759] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-18T19:05:02.728795] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-18T19:05:02.919544] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-18T19:05:02.991334] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-18T19:05:03.719551] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-18T19:05:04.519546] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-09-18T19:05:04.747661] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-18T19:05:04.790704] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-18T19:05:04.969538] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-18T19:05:05.319550] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-09-18T19:05:06.071959] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-18T19:05:06.119512] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-18T19:05:06.692333] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-18T19:05:06.919553] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-18T19:05:07.719547] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-18T19:05:08.519556] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-18T19:05:08.650866] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-18T19:05:08.671530] [INFO ] [REMOTE ] FNB: Full fetch complete (75393 records). [2025-09-18T19:05:08.672615] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-18T19:05:08.674736] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-18T19:05:09.137166] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-09-18T19:05:09.137345] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-09-18T19:05:09.138266] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-09-18T19:05:09.138427] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-09-18T19:05:09.146064] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-18T19:05:09.149804] [DEBUG] [LOCAL ] FNB: Trimmed 75393 records to 52843 (keeping 200 days of data) [2025-09-18T19:05:09.330364] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-18T19:05:09.481989] [DEBUG] [LOCAL ] FNB: Primary data saved (52843 records). [2025-09-18T19:05:09.482141] [INFO ] [MAIN ] FNB: Full history saved. [2025-09-18T19:05:09.482903] [INFO ] [MAIN ] Update Progress: 858/2372 symbols completed. FNB took 46.6s. Estimated remaining: 3h 40m 45s. Rate: 6.9 symbols/min [2025-09-18T19:05:09.651938] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:05:09.674571] [DEBUG] [LOCAL ] FOR: Loaded 20288 existing records from primary storage. [2025-09-18T19:05:09.674744] [INFO ] [MAIN ] FOR: Loaded 20288 existing records. [2025-09-18T19:05:09.852090] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:05:09.852370] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-18T19:05:09.852433] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-18T19:05:09.852994] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-18T19:05:09.853053] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-18T19:05:10.128508] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-18T19:05:10.220298] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:05:10.919547] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-11. [2025-09-18T19:05:11.009313] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-18T19:05:11.027851] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-18T19:05:11.558682] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-18T19:05:11.719576] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-18T19:05:12.519580] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-18T19:05:12.637935] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-18T19:05:13.138957] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-18T19:05:13.319553] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-18T19:05:13.931545] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-18T19:05:14.119561] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-09-18T19:05:14.823559] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-18T19:05:14.919536] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-09-18T19:05:15.719588] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-18T19:05:16.114079] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-18T19:05:16.519584] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-18T19:05:17.077932] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-18T19:05:17.319599] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-18T19:05:17.367435] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-18T19:05:18.060044] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-18T19:05:18.119557] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-18T19:05:18.673602] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-18T19:05:18.919549] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-18T19:05:19.719524] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-18T19:05:20.039249] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-18T19:05:20.519560] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-18T19:05:21.123593] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-18T19:05:21.232804] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-18T19:05:21.319580] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-18T19:05:22.119551] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-18T19:05:22.919584] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-18T19:05:22.981419] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-18T19:05:23.219569] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-18T19:05:23.568620] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-18T19:05:23.719530] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-18T19:05:24.336392] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-18T19:05:24.519525] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-18T19:05:25.319548] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-18T19:05:25.560965] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-18T19:05:25.900513] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-18T19:05:26.119524] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-18T19:05:26.877706] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-18T19:05:26.919538] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-18T19:05:27.719511] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-18T19:05:28.030419] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-18T19:05:28.293186] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-18T19:05:28.519539] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-18T19:05:29.319518] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-18T19:05:29.536541] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-18T19:05:29.539735] [INFO ] [REMOTE ] FOA: Full fetch complete (22419 records). [2025-09-18T19:05:29.539840] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-18T19:05:29.905400] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-09-18T19:05:29.905486] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-09-18T19:05:29.905913] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-09-18T19:05:29.905985] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-09-18T19:05:29.906771] [DEBUG] [LOCAL ] FOA: Trimmed 22419 records to 13267 (keeping 200 days of data) [2025-09-18T19:05:29.983634] [DEBUG] [LOCAL ] FOA: Primary data saved (13267 records). [2025-09-18T19:05:29.983841] [INFO ] [MAIN ] FOA: Full history saved. [2025-09-18T19:05:29.983937] [INFO ] [MAIN ] Update Progress: 859/2372 symbols completed. FOA took 36.1s. Estimated remaining: 3h 40m 57s. Rate: 6.8 symbols/min [2025-09-18T19:05:30.124974] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-18T19:05:30.159285] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:05:30.207671] [DEBUG] [LOCAL ] FOUR: Loaded 49528 existing records from primary storage. [2025-09-18T19:05:30.207814] [INFO ] [MAIN ] FOUR: Loaded 49528 existing records. [2025-09-18T19:05:30.387238] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:05:30.387511] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-18T19:05:30.387569] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-18T19:05:30.389165] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-18T19:05:30.389225] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-18T19:05:30.743177] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:05:30.824251] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-18T19:05:30.831531] [INFO ] [REMOTE ] FNV: Full fetch complete (65739 records). [2025-09-18T19:05:30.831662] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-18T19:05:30.924687] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-11. [2025-09-18T19:05:31.219352] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-09-18T19:05:31.219479] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-09-18T19:05:31.220342] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-09-18T19:05:31.220485] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-09-18T19:05:31.229127] [DEBUG] [LOCAL ] FNV: Trimmed 65739 records to 46795 (keeping 200 days of data) [2025-09-18T19:05:31.229020] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-18T19:05:31.232568] [INFO ] [REMOTE ] FOR: Full fetch complete (29647 records). [2025-09-18T19:05:31.232744] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-18T19:05:31.730259] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-18T19:05:31.749863] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-18T19:05:31.750212] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-18T19:05:31.751798] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-18T19:05:31.752258] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-18T19:05:31.756790] [DEBUG] [LOCAL ] FOR: Trimmed 29647 records to 20451 (keeping 200 days of data) [2025-09-18T19:05:32.031230] [DEBUG] [LOCAL ] FOR: Primary data saved (20451 records). [2025-09-18T19:05:32.032086] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-18T19:05:32.032216] [INFO ] [MAIN ] Update Progress: 860/2372 symbols completed. FOR took 22.5s. Estimated remaining: 3h 40m 36s. Rate: 6.9 symbols/min [2025-09-18T19:05:32.221710] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:05:32.246810] [DEBUG] [LOCAL ] FPF: Loaded 17669 existing records from primary storage. [2025-09-18T19:05:32.247776] [INFO ] [MAIN ] FPF: Loaded 17669 existing records. [2025-09-18T19:05:32.441527] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:05:32.442525] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-18T19:05:32.442923] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-18T19:05:32.444756] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-18T19:05:32.445086] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-18T19:05:32.561411] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-18T19:05:32.565349] [INFO ] [REMOTE ] FOF: Full fetch complete (11809 records). [2025-09-18T19:05:32.608453] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-18T19:05:32.936223] [DEBUG] [LOCAL ] FNV: Primary data saved (46795 records). [2025-09-18T19:05:33.014982] [INFO ] [MAIN ] FNV: Full history saved. [2025-09-18T19:05:33.106832] [INFO ] [MAIN ] Update Progress: 861/2372 symbols completed. FNV took 51.9s. Estimated remaining: 3h 40m 14s. Rate: 6.9 symbols/min [2025-09-18T19:05:33.225782] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:05:33.302523] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-11. [2025-09-18T19:05:33.502355] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-18T19:05:33.502524] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-18T19:05:33.502911] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-18T19:05:33.503070] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-18T19:05:33.599190] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:05:33.550808] [DEBUG] [LOCAL ] FOF: Trimmed 11809 records to 8432 (keeping 200 days of data) [2025-09-18T19:05:33.682826] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-11 (2.76 seconds). [2025-09-18T19:05:33.703345] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-09-18T19:05:33.710819] [DEBUG] [LOCAL ] FOF: Primary data saved (8432 records). [2025-09-18T19:05:33.711867] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-18T19:05:33.712058] [INFO ] [MAIN ] Update Progress: 862/2372 symbols completed. FOF took 32.7s. Estimated remaining: 3h 39m 51s. Rate: 6.9 symbols/min [2025-09-18T19:05:33.781535] [DEBUG] [LOCAL ] FPH: Loaded 19832 existing records from primary storage. [2025-09-18T19:05:33.796672] [INFO ] [MAIN ] FPH: Loaded 19832 existing records. [2025-09-18T19:05:34.083355] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:05:34.106051] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:05:34.106345] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-18T19:05:34.106394] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-18T19:05:34.107086] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-18T19:05:34.107149] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-18T19:05:34.391883] [DEBUG] [LOCAL ] FPI: Loaded 31251 existing records from primary storage. [2025-09-18T19:05:34.416753] [INFO ] [MAIN ] FPI: Loaded 31251 existing records. [2025-09-18T19:05:34.604701] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:05:34.605382] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-11. [2025-09-18T19:05:34.704720] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-18T19:05:34.704109] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:05:34.709900] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-18T19:05:34.709967] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-18T19:05:34.710980] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-09-18T19:05:34.711041] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-18T19:05:34.932787] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-09-18T19:05:35.075177] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:05:35.482180] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-18T19:05:35.504973] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-18T19:05:35.719563] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-11. [2025-09-18T19:05:36.126184] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-18T19:05:36.519561] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-09-18T19:05:36.725168] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T19:05:37.135706] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-18T19:05:37.319549] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-09-18T19:05:38.119558] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-09-18T19:05:38.453890] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-18T19:05:38.919570] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-18T19:05:39.519928] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-18T19:05:39.539910] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-18T19:05:39.719553] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-18T19:05:40.478054] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-18T19:05:40.519630] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-18T19:05:41.319829] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-09-18T19:05:42.119706] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-18T19:05:42.261787] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-18T19:05:42.396611] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-18T19:05:42.886980] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-18T19:05:42.919496] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-18T19:05:43.719623] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-09-18T19:05:43.856031] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-18T19:05:44.519610] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-18T19:05:44.744835] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-18T19:05:45.273276] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-18T19:05:45.319493] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-18T19:05:46.119573] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-09-18T19:05:46.301124] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-18T19:05:46.919555] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-18T19:05:47.197604] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-18T19:05:47.719596] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-18T19:05:48.163596] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-18T19:05:48.519559] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-18T19:05:48.619543] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-18T19:05:49.319554] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-18T19:05:49.991392] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-18T19:05:50.013235] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-18T19:05:50.119547] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-18T19:05:50.900558] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-18T19:05:50.903728] [INFO ] [REMOTE ] FPF: Full fetch complete (26328 records). [2025-09-18T19:05:50.903847] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-18T19:05:50.924699] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-18T19:05:51.272132] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-18T19:05:51.272240] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-18T19:05:51.272726] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-18T19:05:51.272790] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-18T19:05:51.273479] [DEBUG] [LOCAL ] FPF: Trimmed 26328 records to 17789 (keeping 200 days of data) [2025-09-18T19:05:51.384229] [DEBUG] [LOCAL ] FPF: Primary data saved (17789 records). [2025-09-18T19:05:51.384391] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-18T19:05:51.384502] [INFO ] [MAIN ] Update Progress: 863/2372 symbols completed. FPF took 19.4s. Estimated remaining: 3h 39m 58s. Rate: 6.9 symbols/min [2025-09-18T19:05:51.560379] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:05:51.624552] [DEBUG] [LOCAL ] FR: Loaded 46824 existing records from primary storage. [2025-09-18T19:05:51.624736] [INFO ] [MAIN ] FR: Loaded 46824 existing records. [2025-09-18T19:05:51.725855] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-18T19:05:51.809458] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:05:51.810277] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-18T19:05:51.810388] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-18T19:05:51.817907] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-18T19:05:51.827241] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-18T19:05:51.834718] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-18T19:05:52.268041] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:05:52.519551] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-18T19:05:52.748301] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-18T19:05:53.319613] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-18T19:05:53.906862] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T19:05:54.119550] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-18T19:05:54.919542] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-11. [2025-09-18T19:05:54.979095] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T19:05:55.002307] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-18T19:05:55.719552] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-18T19:05:56.137331] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-18T19:05:56.519529] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-18T19:05:57.319546] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-09-18T19:05:57.404057] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-18T19:05:58.042807] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T19:05:58.119542] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-18T19:05:58.919552] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-18T19:05:58.975283] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-18T19:05:59.711476] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-18T19:05:59.719488] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-18T19:06:00.462216] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T19:06:00.519490] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-18T19:06:01.319573] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-18T19:06:01.431207] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-18T19:06:02.119573] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-09-18T19:06:02.313136] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-18T19:06:02.919573] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-18T19:06:03.282093] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-18T19:06:03.719563] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-18T19:06:04.519587] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-18T19:06:04.895778] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (2.78 seconds). [2025-09-18T19:06:05.017124] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-18T19:06:05.319571] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-18T19:06:05.498422] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-18T19:06:06.119510] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-18T19:06:06.321724] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-18T19:06:06.362373] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-18T19:06:06.919555] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-18T19:06:07.443451] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-18T19:06:07.719545] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-18T19:06:08.470334] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-18T19:06:08.477367] [INFO ] [REMOTE ] FOUR: Full fetch complete (71741 records). [2025-09-18T19:06:08.477536] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-18T19:06:08.521159] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-18T19:06:08.897316] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-18T19:06:08.927687] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-18T19:06:08.928286] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-18T19:06:08.929375] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-18T19:06:08.929470] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-18T19:06:08.931503] [DEBUG] [LOCAL ] FOUR: Trimmed 71741 records to 49899 (keeping 200 days of data) [2025-09-18T19:06:09.231016] [DEBUG] [LOCAL ] FOUR: Primary data saved (49899 records). [2025-09-18T19:06:09.231198] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-18T19:06:09.231345] [INFO ] [MAIN ] Update Progress: 864/2372 symbols completed. FOUR took 39.2s. Estimated remaining: 3h 40m 5s. Rate: 6.9 symbols/min [2025-09-18T19:06:09.325394] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-18T19:06:09.419124] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:06:09.437265] [DEBUG] [LOCAL ] FRA: Loaded 14810 existing records from primary storage. [2025-09-18T19:06:09.437446] [INFO ] [MAIN ] FRA: Loaded 14810 existing records. [2025-09-18T19:06:09.621362] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:06:09.621606] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-18T19:06:09.621685] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-18T19:06:09.622229] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-18T19:06:09.622301] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-18T19:06:09.780803] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-18T19:06:09.807683] [INFO ] [REMOTE ] FPH: Full fetch complete (31676 records). [2025-09-18T19:06:09.824475] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-18T19:06:10.120778] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-18T19:06:10.175035] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:06:10.428119] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-18T19:06:10.428200] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-18T19:06:10.428703] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-18T19:06:10.428765] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-18T19:06:10.429683] [DEBUG] [LOCAL ] FPH: Trimmed 31676 records to 19970 (keeping 200 days of data) [2025-09-18T19:06:10.558318] [DEBUG] [LOCAL ] FPH: Primary data saved (19970 records). [2025-09-18T19:06:10.558483] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-18T19:06:10.558616] [INFO ] [MAIN ] Update Progress: 865/2372 symbols completed. FPH took 37.4s. Estimated remaining: 3h 39m 43s. Rate: 6.9 symbols/min [2025-09-18T19:06:10.737021] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:06:10.760011] [DEBUG] [LOCAL ] FRGE: Loaded 19024 existing records from primary storage. [2025-09-18T19:06:10.760167] [INFO ] [MAIN ] FRGE: Loaded 19024 existing records. [2025-09-18T19:06:10.940996] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-11. [2025-09-18T19:06:10.947097] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:06:10.950280] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-18T19:06:10.950612] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-18T19:06:10.951746] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-09-18T19:06:10.951851] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-18T19:06:11.097626] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-18T19:06:11.340006] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-18T19:06:11.406467] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:06:11.406706] [INFO ] [REMOTE ] FPI: Full fetch complete (44027 records). [2025-09-18T19:06:11.407101] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-18T19:06:11.686089] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-18T19:06:11.725154] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-09-18T19:06:11.846950] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-09-18T19:06:11.847040] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-09-18T19:06:11.847711] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-09-18T19:06:11.847776] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-09-18T19:06:11.849491] [DEBUG] [LOCAL ] FPI: Trimmed 44027 records to 31537 (keeping 200 days of data) [2025-09-18T19:06:12.062996] [DEBUG] [LOCAL ] FPI: Primary data saved (31537 records). [2025-09-18T19:06:12.063149] [INFO ] [MAIN ] FPI: Full history saved. [2025-09-18T19:06:12.063307] [INFO ] [MAIN ] Update Progress: 866/2372 symbols completed. FPI took 38.4s. Estimated remaining: 3h 39m 22s. Rate: 6.9 symbols/min [2025-09-18T19:06:12.244207] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:06:12.301876] [DEBUG] [LOCAL ] FRO: Loaded 51944 existing records from primary storage. [2025-09-18T19:06:12.302055] [INFO ] [MAIN ] FRO: Loaded 51944 existing records. [2025-09-18T19:06:12.481387] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:06:12.481631] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-18T19:06:12.481716] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-18T19:06:12.483021] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-18T19:06:12.483083] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-18T19:06:12.525195] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-11. [2025-09-18T19:06:12.855921] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:06:12.874909] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-18T19:06:13.319560] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-11. [2025-09-18T19:06:14.119548] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-09-18T19:06:14.898155] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-11 (2.37 seconds). [2025-09-18T19:06:14.919490] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-09-18T19:06:15.719710] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-18T19:06:15.868606] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-18T19:06:16.071153] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-18T19:06:16.179701] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-11 (2.86 seconds). [2025-09-18T19:06:16.519562] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-18T19:06:17.173545] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T19:06:17.256470] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-18T19:06:17.319534] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-18T19:06:18.044163] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-18T19:06:18.119585] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-09-18T19:06:18.919594] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-18T19:06:19.719592] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-18T19:06:19.752197] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-18T19:06:20.090557] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-18T19:06:20.519567] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-18T19:06:21.055549] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-18T19:06:21.319557] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-18T19:06:21.449717] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-18T19:06:22.119563] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-18T19:06:22.725451] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-18T19:06:22.911486] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-18T19:06:22.919482] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-18T19:06:23.719600] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-18T19:06:23.834522] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-18T19:06:24.519610] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-18T19:06:25.319541] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-09-18T19:06:25.405510] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-18T19:06:25.413383] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-18T19:06:26.119564] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-18T19:06:26.923461] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-18T19:06:26.930011] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T19:06:27.124931] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T19:06:27.127610] [INFO ] [REMOTE ] FRA: Full fetch complete (24385 records). [2025-09-18T19:06:27.127738] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-18T19:06:27.499318] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-18T19:06:27.499407] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-18T19:06:27.499905] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-18T19:06:27.499971] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-18T19:06:27.500720] [DEBUG] [LOCAL ] FRA: Trimmed 24385 records to 14867 (keeping 200 days of data) [2025-09-18T19:06:27.603515] [DEBUG] [LOCAL ] FRA: Primary data saved (14867 records). [2025-09-18T19:06:27.604124] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-18T19:06:27.604393] [INFO ] [MAIN ] Update Progress: 867/2372 symbols completed. FRA took 18.4s. Estimated remaining: 3h 39m 25s. Rate: 6.9 symbols/min [2025-09-18T19:06:27.724764] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-18T19:06:27.778672] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:06:27.832169] [DEBUG] [LOCAL ] FRT: Loaded 42429 existing records from primary storage. [2025-09-18T19:06:27.832334] [INFO ] [MAIN ] FRT: Loaded 42429 existing records. [2025-09-18T19:06:28.018256] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:06:28.018597] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-18T19:06:28.018681] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-18T19:06:28.019900] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-09-18T19:06:28.019973] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-18T19:06:28.393296] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:06:28.419637] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-18T19:06:28.519498] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-18T19:06:29.324693] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-09-18T19:06:29.341174] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-18T19:06:30.119557] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-11. [2025-09-18T19:06:30.464472] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-18T19:06:30.474751] [INFO ] [REMOTE ] FR: Full fetch complete (66483 records). [2025-09-18T19:06:30.474925] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-18T19:06:30.897334] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-18T19:06:30.897856] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-18T19:06:30.898748] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-18T19:06:30.911148] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-18T19:06:30.920128] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-18T19:06:30.921923] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-18T19:06:30.932927] [DEBUG] [LOCAL ] FR: Trimmed 66483 records to 47153 (keeping 200 days of data) [2025-09-18T19:06:31.233993] [DEBUG] [LOCAL ] FR: Primary data saved (47153 records). [2025-09-18T19:06:31.234133] [INFO ] [MAIN ] FR: Full history saved. [2025-09-18T19:06:31.235415] [INFO ] [MAIN ] Update Progress: 868/2372 symbols completed. FR took 39.9s. Estimated remaining: 3h 39m 8s. Rate: 6.9 symbols/min [2025-09-18T19:06:31.409961] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:06:31.443212] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-18T19:06:31.485996] [DEBUG] [LOCAL ] FSCO: Loaded 36795 existing records from primary storage. [2025-09-18T19:06:31.486161] [INFO ] [MAIN ] FSCO: Loaded 36795 existing records. [2025-09-18T19:06:31.662221] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:06:31.662544] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-18T19:06:31.662594] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-18T19:06:31.663840] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-09-18T19:06:31.663903] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-18T19:06:31.726286] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-18T19:06:32.020439] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:06:32.531563] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-09-18T19:06:32.533485] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T19:06:32.749404] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-18T19:06:33.319598] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-18T19:06:34.046780] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-18T19:06:34.119745] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-09-18T19:06:34.909981] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-18T19:06:34.920691] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-11. [2025-09-18T19:06:35.402519] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-18T19:06:35.719543] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-18T19:06:36.183739] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-18T19:06:36.519551] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-18T19:06:37.279406] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T19:06:37.319586] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-18T19:06:37.662302] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T19:06:38.119546] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-18T19:06:38.853904] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-18T19:06:38.919573] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-09-18T19:06:38.997852] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-18T19:06:39.719566] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-18T19:06:40.318039] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-18T19:06:40.519553] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-09-18T19:06:40.986925] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-18T19:06:41.319546] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-18T19:06:41.674196] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T19:06:42.119572] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-18T19:06:42.846138] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T19:06:42.919561] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-18T19:06:43.439365] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-18T19:06:43.719573] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-18T19:06:44.331444] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-18T19:06:44.519550] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-18T19:06:45.192153] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T19:06:45.319553] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-18T19:06:46.026385] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-18T19:06:46.119541] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-18T19:06:46.919539] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-18T19:06:46.974722] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-18T19:06:46.982097] [INFO ] [REMOTE ] FRO: Full fetch complete (75381 records). [2025-09-18T19:06:46.982252] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-18T19:06:47.405491] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-18T19:06:47.405622] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-18T19:06:47.406726] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-18T19:06:47.406841] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-18T19:06:47.429592] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-18T19:06:47.437472] [DEBUG] [LOCAL ] FRO: Trimmed 75381 records to 52317 (keeping 200 days of data) [2025-09-18T19:06:47.724282] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-18T19:06:47.764998] [DEBUG] [LOCAL ] FRO: Primary data saved (52317 records). [2025-09-18T19:06:47.765152] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-18T19:06:47.765241] [INFO ] [MAIN ] Update Progress: 869/2372 symbols completed. FRO took 35.7s. Estimated remaining: 3h 39m 12s. Rate: 6.9 symbols/min [2025-09-18T19:06:47.942546] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:06:47.960519] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-18T19:06:48.014152] [DEBUG] [LOCAL ] FSK: Loaded 49334 existing records from primary storage. [2025-09-18T19:06:48.014349] [INFO ] [MAIN ] FSK: Loaded 49334 existing records. [2025-09-18T19:06:48.191936] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:06:48.192219] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-18T19:06:48.192276] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-18T19:06:48.193433] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-18T19:06:48.193494] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-18T19:06:48.526676] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-18T19:06:48.547551] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:06:48.913056] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-18T19:06:49.319559] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-11. [2025-09-18T19:06:50.124979] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-18T19:06:50.127572] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-18T19:06:50.586039] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T19:06:50.689810] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-18T19:06:50.919537] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-18T19:06:51.719555] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-18T19:06:52.430112] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-18T19:06:52.519548] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-18T19:06:52.964668] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-18T19:06:53.319559] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-18T19:06:53.720582] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-18T19:06:53.730152] [INFO ] [REMOTE ] FRT: Full fetch complete (60167 records). [2025-09-18T19:06:53.730314] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-18T19:06:54.112207] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-09-18T19:06:54.112297] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-09-18T19:06:54.113029] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-09-18T19:06:54.113096] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-09-18T19:06:54.114411] [DEBUG] [LOCAL ] FRT: Trimmed 60167 records to 42722 (keeping 200 days of data) [2025-09-18T19:06:54.171340] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-18T19:06:54.402457] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-18T19:06:54.415012] [DEBUG] [LOCAL ] FRT: Primary data saved (42722 records). [2025-09-18T19:06:54.415136] [INFO ] [MAIN ] FRT: Full history saved. [2025-09-18T19:06:54.415256] [INFO ] [MAIN ] Update Progress: 870/2372 symbols completed. FRT took 26.8s. Estimated remaining: 3h 38m 60s. Rate: 6.9 symbols/min [2025-09-18T19:06:54.596268] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:06:54.643211] [DEBUG] [LOCAL ] FSLY: Loaded 51273 existing records from primary storage. [2025-09-18T19:06:54.643357] [INFO ] [MAIN ] FSLY: Loaded 51273 existing records. [2025-09-18T19:06:54.818742] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:06:54.818962] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-18T19:06:54.819009] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-18T19:06:54.819977] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-18T19:06:54.820040] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-18T19:06:54.921047] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-18T19:06:55.017555] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-18T19:06:55.192178] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:06:55.719569] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-18T19:06:56.287350] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-18T19:06:56.304143] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-18T19:06:56.519584] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-18T19:06:57.262221] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-18T19:06:57.319575] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-18T19:06:58.119601] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-18T19:06:58.303213] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-18T19:06:58.305879] [INFO ] [REMOTE ] FRGE: Full fetch complete (34629 records). [2025-09-18T19:06:58.305985] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-18T19:06:58.687986] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-09-18T19:06:58.688080] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-09-18T19:06:58.688587] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-09-18T19:06:58.688631] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-09-18T19:06:58.689546] [DEBUG] [LOCAL ] FRGE: Trimmed 34629 records to 19155 (keeping 200 days of data) [2025-09-18T19:06:58.800511] [DEBUG] [LOCAL ] FRGE: Primary data saved (19155 records). [2025-09-18T19:06:58.800704] [INFO ] [MAIN ] FRGE: Full history saved. [2025-09-18T19:06:58.800810] [INFO ] [MAIN ] Update Progress: 871/2372 symbols completed. FRGE took 48.2s. Estimated remaining: 3h 38m 44s. Rate: 6.9 symbols/min [2025-09-18T19:06:58.924639] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-11. [2025-09-18T19:06:58.978351] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:06:59.037763] [DEBUG] [LOCAL ] FSM: Loaded 53281 existing records from primary storage. [2025-09-18T19:06:59.037926] [INFO ] [MAIN ] FSM: Loaded 53281 existing records. [2025-09-18T19:06:59.223189] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:06:59.223486] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-18T19:06:59.223534] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-18T19:06:59.224580] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-18T19:06:59.224672] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-18T19:06:59.614704] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:06:59.617002] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-18T19:06:59.719536] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-18T19:07:00.519601] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-09-18T19:07:00.769429] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-18T19:07:01.129018] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-18T19:07:01.319560] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-18T19:07:02.119597] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-11. [2025-09-18T19:07:02.213286] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-18T19:07:02.809212] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T19:07:02.814892] [INFO ] [REMOTE ] FSCO: Full fetch complete (53792 records). [2025-09-18T19:07:02.815015] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-18T19:07:02.919635] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-09-18T19:07:03.256066] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-09-18T19:07:03.256155] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-09-18T19:07:03.256814] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-09-18T19:07:03.256877] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-09-18T19:07:03.257999] [DEBUG] [LOCAL ] FSCO: Trimmed 53792 records to 37079 (keeping 200 days of data) [2025-09-18T19:07:03.484381] [DEBUG] [LOCAL ] FSCO: Primary data saved (37079 records). [2025-09-18T19:07:03.484548] [INFO ] [MAIN ] FSCO: Full history saved. [2025-09-18T19:07:03.485273] [INFO ] [MAIN ] Update Progress: 872/2372 symbols completed. FSCO took 32.2s. Estimated remaining: 3h 38m 28s. Rate: 6.9 symbols/min [2025-09-18T19:07:03.667545] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:07:03.710538] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-18T19:07:03.728831] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-09-18T19:07:03.743886] [DEBUG] [LOCAL ] FSS: Loaded 34976 existing records from primary storage. [2025-09-18T19:07:03.744034] [INFO ] [MAIN ] FSS: Loaded 34976 existing records. [2025-09-18T19:07:03.937535] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:07:03.937806] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-18T19:07:03.937857] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-18T19:07:03.938672] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-09-18T19:07:03.938733] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-18T19:07:04.302921] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:07:04.519516] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-09-18T19:07:04.604679] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-18T19:07:05.319559] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-18T19:07:05.768619] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-18T19:07:05.992058] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-18T19:07:06.119552] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-09-18T19:07:06.535305] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T19:07:06.919564] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-09-18T19:07:07.719541] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-18T19:07:07.819139] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-18T19:07:08.404317] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-18T19:07:08.519558] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-18T19:07:09.097194] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-18T19:07:09.319553] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-18T19:07:09.767490] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T19:07:10.119550] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-18T19:07:10.919579] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-11. [2025-09-18T19:07:11.071273] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-18T19:07:11.501945] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-18T19:07:11.719555] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-18T19:07:11.839518] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-18T19:07:12.519558] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-18T19:07:13.228128] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-18T19:07:13.319491] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-18T19:07:14.119513] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-18T19:07:14.294413] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-18T19:07:14.919625] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-09-18T19:07:15.172383] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-18T19:07:15.372517] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-18T19:07:15.719620] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-18T19:07:15.827525] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-18T19:07:16.519605] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-18T19:07:17.146714] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T19:07:17.319511] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-18T19:07:18.050102] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-18T19:07:18.119510] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-18T19:07:18.772720] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T19:07:18.919513] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-18T19:07:19.720624] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-09-18T19:07:19.726576] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-18T19:07:20.351523] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T19:07:20.525129] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-18T19:07:20.534242] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-18T19:07:21.319556] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-18T19:07:22.119598] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-18T19:07:22.253967] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-18T19:07:22.919616] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-18T19:07:23.066010] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-18T19:07:23.172851] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-18T19:07:23.719599] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-18T19:07:24.519570] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-18T19:07:24.693621] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-18T19:07:25.170305] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T19:07:25.177570] [INFO ] [REMOTE ] FSK: Full fetch complete (71199 records). [2025-09-18T19:07:25.177730] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-18T19:07:25.324628] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-18T19:07:25.577680] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-18T19:07:25.577802] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-18T19:07:25.578795] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-18T19:07:25.578875] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-18T19:07:25.580764] [DEBUG] [LOCAL ] FSK: Trimmed 71199 records to 49724 (keeping 200 days of data) [2025-09-18T19:07:25.695175] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-18T19:07:25.930985] [DEBUG] [LOCAL ] FSK: Primary data saved (49724 records). [2025-09-18T19:07:25.931173] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-18T19:07:25.931295] [INFO ] [MAIN ] Update Progress: 873/2372 symbols completed. FSK took 38.2s. Estimated remaining: 3h 38m 43s. Rate: 6.9 symbols/min [2025-09-18T19:07:26.103226] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:07:26.112779] [DEBUG] [LOCAL ] FT: Loaded 6339 existing records from primary storage. [2025-09-18T19:07:26.112918] [INFO ] [MAIN ] FT: Loaded 6339 existing records. [2025-09-18T19:07:26.125722] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-18T19:07:26.292565] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:07:26.292822] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-18T19:07:26.292873] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-18T19:07:26.293180] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-18T19:07:26.293238] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-18T19:07:26.651357] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:07:26.884883] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-18T19:07:26.892136] [INFO ] [REMOTE ] FSLY: Full fetch complete (74867 records). [2025-09-18T19:07:26.892258] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-18T19:07:26.924625] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-18T19:07:27.291353] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-18T19:07:27.291439] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-18T19:07:27.292366] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-18T19:07:27.292434] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-18T19:07:27.294006] [DEBUG] [LOCAL ] FSLY: Trimmed 74867 records to 51658 (keeping 200 days of data) [2025-09-18T19:07:27.579093] [DEBUG] [LOCAL ] FSLY: Primary data saved (51658 records). [2025-09-18T19:07:27.579233] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-18T19:07:27.579317] [INFO ] [MAIN ] Update Progress: 874/2372 symbols completed. FSLY took 33.2s. Estimated remaining: 3h 38m 22s. Rate: 6.9 symbols/min [2025-09-18T19:07:27.726057] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-11. [2025-09-18T19:07:27.761110] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:07:27.774934] [DEBUG] [LOCAL ] FTHY: Loaded 11739 existing records from primary storage. [2025-09-18T19:07:27.775062] [INFO ] [MAIN ] FTHY: Loaded 11739 existing records. [2025-09-18T19:07:27.959346] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:07:27.959918] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-18T19:07:27.960061] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-18T19:07:27.960532] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-18T19:07:27.960594] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-18T19:07:28.269490] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-18T19:07:28.308979] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-18T19:07:28.390634] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:07:28.436775] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-18T19:07:28.519507] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-18T19:07:29.319557] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-09-18T19:07:29.705550] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-18T19:07:29.948309] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-18T19:07:30.119594] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-11. [2025-09-18T19:07:30.888534] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-18T19:07:30.919496] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-09-18T19:07:31.719580] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-09-18T19:07:31.926598] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-18T19:07:32.255631] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-18T19:07:32.519584] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-18T19:07:33.319563] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-18T19:07:33.924886] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-18T19:07:34.119548] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-09-18T19:07:34.270538] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-18T19:07:34.656584] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-18T19:07:34.919560] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-18T19:07:35.719586] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-18T19:07:36.326373] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-18T19:07:36.519550] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-18T19:07:37.078183] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-18T19:07:37.212309] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-18T19:07:37.319506] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-18T19:07:38.119570] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-18T19:07:38.810521] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T19:07:38.919579] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-18T19:07:39.439450] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T19:07:39.719550] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-18T19:07:40.236558] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-18T19:07:40.519554] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-18T19:07:40.812143] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-18T19:07:40.822472] [INFO ] [REMOTE ] FSM: Full fetch complete (76503 records). [2025-09-18T19:07:40.822612] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-18T19:07:41.254783] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-18T19:07:41.254877] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-18T19:07:41.255885] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-18T19:07:41.255958] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-18T19:07:41.257706] [DEBUG] [LOCAL ] FSM: Trimmed 76503 records to 53671 (keeping 200 days of data) [2025-09-18T19:07:41.345578] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-18T19:07:41.366175] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-18T19:07:41.602863] [DEBUG] [LOCAL ] FSM: Primary data saved (53671 records). [2025-09-18T19:07:41.603025] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-18T19:07:41.603120] [INFO ] [MAIN ] Update Progress: 875/2372 symbols completed. FSM took 42.8s. Estimated remaining: 3h 38m 22s. Rate: 6.9 symbols/min [2025-09-18T19:07:41.789698] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:07:41.844195] [DEBUG] [LOCAL ] FTI: Loaded 53305 existing records from primary storage. [2025-09-18T19:07:41.844375] [INFO ] [MAIN ] FTI: Loaded 53305 existing records. [2025-09-18T19:07:42.021856] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:07:42.022119] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-18T19:07:42.022178] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-18T19:07:42.023306] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-09-18T19:07:42.023366] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-18T19:07:42.122600] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-18T19:07:42.386531] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:07:42.783346] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-18T19:07:42.802452] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-18T19:07:42.919502] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-18T19:07:43.719598] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-18T19:07:44.314978] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-18T19:07:44.368432] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T19:07:44.372979] [INFO ] [REMOTE ] FSS: Full fetch complete (47952 records). [2025-09-18T19:07:44.373109] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-18T19:07:44.524733] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-18T19:07:44.846280] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-09-18T19:07:44.846418] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-09-18T19:07:44.847276] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-18T19:07:44.847350] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-09-18T19:07:44.848805] [DEBUG] [LOCAL ] FSS: Trimmed 47952 records to 35240 (keeping 200 days of data) [2025-09-18T19:07:45.170898] [DEBUG] [LOCAL ] FSS: Primary data saved (35240 records). [2025-09-18T19:07:45.171105] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-18T19:07:45.172581] [INFO ] [MAIN ] Update Progress: 876/2372 symbols completed. FSS took 41.7s. Estimated remaining: 3h 38m 4s. Rate: 6.9 symbols/min [2025-09-18T19:07:45.324806] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-11. [2025-09-18T19:07:45.357817] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-18T19:07:45.450360] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:07:45.489817] [DEBUG] [LOCAL ] FTK: Loaded 31916 existing records from primary storage. [2025-09-18T19:07:45.489984] [INFO ] [MAIN ] FTK: Loaded 31916 existing records. [2025-09-18T19:07:45.700736] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:07:45.701327] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-18T19:07:45.701392] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-18T19:07:45.702602] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-09-18T19:07:45.702701] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-18T19:07:46.093760] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:07:46.119510] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-11. [2025-09-18T19:07:46.812884] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-18T19:07:46.919506] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-09-18T19:07:47.204355] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-18T19:07:47.719552] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-18T19:07:48.336818] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-18T19:07:48.532246] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-09-18T19:07:48.536256] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-18T19:07:49.319552] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-18T19:07:49.398085] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-18T19:07:49.719793] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-18T19:07:50.119528] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-09-18T19:07:50.919523] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-18T19:07:51.286487] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T19:07:51.361608] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-18T19:07:51.719564] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-18T19:07:52.519606] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-18T19:07:52.719213] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-18T19:07:53.319511] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-18T19:07:53.360872] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-18T19:07:53.727704] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-18T19:07:54.119544] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-18T19:07:54.919528] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-18T19:07:55.046205] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-18T19:07:55.693405] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-18T19:07:55.719563] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-09-18T19:07:56.519561] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-18T19:07:57.314491] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-18T19:07:57.324747] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-18T19:07:57.652373] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-18T19:07:58.077033] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-18T19:07:58.080175] [INFO ] [REMOTE ] FTHY: Full fetch complete (17647 records). [2025-09-18T19:07:58.080249] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-18T19:07:58.124696] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-18T19:07:58.455850] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-18T19:07:58.455930] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-18T19:07:58.456362] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-18T19:07:58.456403] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-18T19:07:58.456950] [DEBUG] [LOCAL ] FTHY: Trimmed 17647 records to 11796 (keeping 200 days of data) [2025-09-18T19:07:58.531008] [DEBUG] [LOCAL ] FTHY: Primary data saved (11796 records). [2025-09-18T19:07:58.531185] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-18T19:07:58.531321] [INFO ] [MAIN ] Update Progress: 877/2372 symbols completed. FTHY took 31.0s. Estimated remaining: 3h 38m 4s. Rate: 6.9 symbols/min [2025-09-18T19:07:58.919702] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-18T19:07:59.598799] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-18T19:07:59.600098] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-18T19:07:59.719567] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-18T19:08:00.452590] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-18T19:08:00.454576] [INFO ] [REMOTE ] FT: Full fetch complete (9029 records). [2025-09-18T19:08:00.454719] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-18T19:08:00.524742] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-18T19:08:00.842490] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-18T19:08:00.842578] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-18T19:08:00.842868] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-18T19:08:00.842940] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-18T19:08:00.843395] [DEBUG] [LOCAL ] FT: Trimmed 9029 records to 6372 (keeping 200 days of data) [2025-09-18T19:08:00.883857] [DEBUG] [LOCAL ] FT: Primary data saved (6372 records). [2025-09-18T19:08:00.883980] [INFO ] [MAIN ] FT: Full history saved. [2025-09-18T19:08:00.884090] [INFO ] [MAIN ] Update Progress: 878/2372 symbols completed. FT took 35.0s. Estimated remaining: 3h 37m 44s. Rate: 6.9 symbols/min [2025-09-18T19:08:01.319546] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-18T19:08:02.070973] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-18T19:08:02.119545] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-18T19:08:02.889564] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T19:08:02.919498] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-18T19:08:03.346543] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-18T19:08:03.719577] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-18T19:08:04.350483] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T19:08:04.519547] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-18T19:08:05.135847] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-18T19:08:05.319561] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-18T19:08:06.060386] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-18T19:08:06.119503] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-18T19:08:06.743927] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-18T19:08:06.919550] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-18T19:08:07.675961] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-18T19:08:07.719510] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-18T19:08:08.273764] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-18T19:08:08.278497] [INFO ] [REMOTE ] FTK: Full fetch complete (42107 records). [2025-09-18T19:08:08.278620] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-18T19:08:08.689211] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-09-18T19:08:08.689304] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-09-18T19:08:08.690403] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-09-18T19:08:08.690467] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-09-18T19:08:08.691911] [DEBUG] [LOCAL ] FTK: Trimmed 42107 records to 32184 (keeping 200 days of data) [2025-09-18T19:08:08.874744] [DEBUG] [LOCAL ] FTK: Primary data saved (32184 records). [2025-09-18T19:08:08.874891] [INFO ] [MAIN ] FTK: Full history saved. [2025-09-18T19:08:08.875049] [INFO ] [MAIN ] Update Progress: 879/2372 symbols completed. FTK took 23.7s. Estimated remaining: 3h 37m 34s. Rate: 6.9 symbols/min [2025-09-18T19:08:09.476863] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-18T19:08:09.488534] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-18T19:08:11.507219] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-18T19:08:11.518637] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-18T19:08:13.079185] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-18T19:08:13.086492] [INFO ] [REMOTE ] FTI: Full fetch complete (76953 records). [2025-09-18T19:08:13.086622] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-18T19:08:13.497595] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-09-18T19:08:13.497703] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-09-18T19:08:13.498548] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-09-18T19:08:13.498591] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-09-18T19:08:13.500104] [DEBUG] [LOCAL ] FTI: Trimmed 76953 records to 53693 (keeping 200 days of data) [2025-09-18T19:08:13.856944] [DEBUG] [LOCAL ] FTI: Primary data saved (53693 records). [2025-09-18T19:08:13.857096] [INFO ] [MAIN ] FTI: Full history saved. [2025-09-18T19:08:13.857289] [INFO ] [MAIN ] Update Progress: 880/2372 symbols completed. FTI took 32.3s. Estimated remaining: 3h 37m 19s. Rate: 6.9 symbols/min [2025-09-18T19:08:14.484604] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:08:14.522524] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:08:14.532570] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:08:14.607163] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:08:14.611553] [DEBUG] [LOCAL ] FTWO: Loaded 1788 existing records from primary storage. [2025-09-18T19:08:14.611845] [INFO ] [MAIN ] FTWO: Loaded 1788 existing records. [2025-09-18T19:08:14.832077] [DEBUG] [LOCAL ] FTS: Loaded 42176 existing records from primary storage. [2025-09-18T19:08:14.856992] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:08:14.870625] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-18T19:08:14.853444] [INFO ] [MAIN ] FTS: Loaded 42176 existing records. [2025-09-18T19:08:14.882335] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-18T19:08:14.951992] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-09-18T19:08:14.957364] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-18T19:08:15.114390] [DEBUG] [LOCAL ] FUBO: Loaded 53699 existing records from primary storage. [2025-09-18T19:08:15.162374] [INFO ] [MAIN ] FUBO: Loaded 53699 existing records. [2025-09-18T19:08:15.217762] [DEBUG] [LOCAL ] FTV: Loaded 52896 existing records from primary storage. [2025-09-18T19:08:15.282377] [INFO ] [MAIN ] FTV: Loaded 52896 existing records. [2025-09-18T19:08:15.282269] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:08:15.481419] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-18T19:08:15.611899] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-18T19:08:15.722853] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-18T19:08:15.741945] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-18T19:08:15.812183] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:08:15.923894] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:08:15.945207] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-18T19:08:15.985502] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-18T19:08:15.985415] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-18T19:08:15.995954] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-18T19:08:16.052346] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-18T19:08:16.095672] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-18T19:08:16.073345] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-18T19:08:16.127673] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:08:16.156185] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-11. [2025-09-18T19:08:16.119422] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-18T19:08:16.834067] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:08:16.877098] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-11. [2025-09-18T19:08:17.022719] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:08:17.034133] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-18T19:08:17.033825] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-11. [2025-09-18T19:08:17.036070] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-09-18T19:08:17.118726] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:08:17.119031] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-11. [2025-09-18T19:08:17.638791] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-18T19:08:17.640442] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-09-18T19:08:18.078684] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-18T19:08:18.080472] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-18T19:08:18.340068] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-18T19:08:18.348891] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-09-18T19:08:18.437056] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-18T19:08:18.436913] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-18T19:08:18.438553] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-18T19:08:18.449833] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-09-18T19:08:18.740528] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-18T19:08:18.742293] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-18T19:08:18.743777] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-18T19:08:18.919550] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-09-18T19:08:19.064312] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-18T19:08:19.480482] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-18T19:08:19.719540] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-18T19:08:19.869030] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-18T19:08:20.054743] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-18T19:08:20.471333] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-18T19:08:20.519504] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-09-18T19:08:21.319560] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-09-18T19:08:22.119546] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-18T19:08:22.443877] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-18T19:08:22.628061] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-18T19:08:22.919549] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-18T19:08:23.097255] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-18T19:08:23.719565] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-18T19:08:24.053830] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-18T19:08:24.519584] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-18T19:08:25.013706] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-18T19:08:25.319561] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-18T19:08:25.764984] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-18T19:08:26.119512] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-18T19:08:26.177283] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-18T19:08:26.525392] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-18T19:08:26.526334] [INFO ] [REMOTE ] FTWO: Full fetch complete (3508 records). [2025-09-18T19:08:26.526448] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-18T19:08:26.898720] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-09-18T19:08:26.898806] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-09-18T19:08:26.898930] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-09-18T19:08:26.898969] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-09-18T19:08:26.899316] [DEBUG] [LOCAL ] FTWO: Trimmed 3508 records to 1804 (keeping 200 days of data) [2025-09-18T19:08:26.910740] [DEBUG] [LOCAL ] FTWO: Primary data saved (1804 records). [2025-09-18T19:08:26.910811] [INFO ] [MAIN ] FTWO: Full history saved. [2025-09-18T19:08:26.910957] [INFO ] [MAIN ] Update Progress: 881/2372 symbols completed. FTWO took 13.0s. Estimated remaining: 3h 37m 17s. Rate: 6.9 symbols/min [2025-09-18T19:08:26.924783] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-18T19:08:27.096720] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:08:27.157593] [DEBUG] [LOCAL ] FUL: Loaded 33020 existing records from primary storage. [2025-09-18T19:08:27.157803] [INFO ] [MAIN ] FUL: Loaded 33020 existing records. [2025-09-18T19:08:27.342482] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:08:27.342826] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-18T19:08:27.342893] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-18T19:08:27.344238] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-09-18T19:08:27.344334] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-18T19:08:27.704996] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:08:27.719548] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-11. [2025-09-18T19:08:28.519507] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-09-18T19:08:28.908510] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-18T19:08:29.088689] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-18T19:08:29.319603] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-09-18T19:08:29.681117] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-18T19:08:30.052762] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-18T19:08:30.119536] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-09-18T19:08:30.919567] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-18T19:08:31.513802] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-18T19:08:31.719555] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-18T19:08:32.383099] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T19:08:32.519577] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-18T19:08:32.774896] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-18T19:08:33.319568] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-18T19:08:33.883347] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-18T19:08:34.119547] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-18T19:08:34.359568] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-18T19:08:34.919553] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-18T19:08:35.466056] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T19:08:35.719604] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-18T19:08:36.448719] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T19:08:36.519570] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-18T19:08:37.080566] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T19:08:37.319555] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-18T19:08:38.012371] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-18T19:08:38.119788] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-18T19:08:38.701596] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-18T19:08:38.919627] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-18T19:08:39.719567] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-18T19:08:40.050608] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-18T19:08:40.101822] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-18T19:08:40.519638] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-18T19:08:40.958390] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-18T19:08:41.319554] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-18T19:08:42.078456] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-18T19:08:42.119566] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-18T19:08:42.328677] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-18T19:08:42.919588] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-18T19:08:43.719568] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-18T19:08:44.350903] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-18T19:08:44.424288] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T19:08:44.519516] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-18T19:08:45.128173] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-18T19:08:45.319575] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-18T19:08:45.833479] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-18T19:08:46.119555] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-18T19:08:46.925256] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-18T19:08:46.944669] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-18T19:08:47.593091] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T19:08:47.719591] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-18T19:08:48.332673] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-18T19:08:48.519548] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-18T19:08:48.655045] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-18T19:08:49.319554] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-18T19:08:49.961708] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-18T19:08:49.969855] [INFO ] [REMOTE ] FTV: Full fetch complete (76050 records). [2025-09-18T19:08:49.970000] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-18T19:08:50.124698] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-18T19:08:50.387948] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-18T19:08:50.388299] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-18T19:08:50.389397] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-18T19:08:50.389466] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-18T19:08:50.394011] [DEBUG] [LOCAL ] FTV: Trimmed 76050 records to 53286 (keeping 200 days of data) [2025-09-18T19:08:50.655376] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-18T19:08:50.772566] [DEBUG] [LOCAL ] FTV: Primary data saved (53286 records). [2025-09-18T19:08:50.772746] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-18T19:08:50.772901] [INFO ] [MAIN ] Update Progress: 882/2372 symbols completed. FTV took 36.9s. Estimated remaining: 3h 37m 34s. Rate: 6.8 symbols/min [2025-09-18T19:08:50.928709] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-18T19:08:50.949147] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:08:51.005521] [DEBUG] [LOCAL ] FUN: Loaded 51534 existing records from primary storage. [2025-09-18T19:08:51.005736] [INFO ] [MAIN ] FUN: Loaded 51534 existing records. [2025-09-18T19:08:51.189790] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:08:51.190107] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-18T19:08:51.190156] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-18T19:08:51.191591] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-18T19:08:51.191682] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-18T19:08:51.563067] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:08:51.586803] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T19:08:51.592693] [INFO ] [REMOTE ] FTS: Full fetch complete (59968 records). [2025-09-18T19:08:51.592891] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-18T19:08:51.724748] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-11. [2025-09-18T19:08:51.982330] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-18T19:08:51.982412] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-18T19:08:51.983120] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-18T19:08:51.983183] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-18T19:08:51.984465] [DEBUG] [LOCAL ] FTS: Trimmed 59968 records to 42466 (keeping 200 days of data) [2025-09-18T19:08:52.194144] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-18T19:08:52.227602] [INFO ] [REMOTE ] FUL: Full fetch complete (46462 records). [2025-09-18T19:08:52.231062] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-18T19:08:52.449346] [DEBUG] [LOCAL ] FTS: Primary data saved (42466 records). [2025-09-18T19:08:52.454434] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-18T19:08:52.469293] [INFO ] [MAIN ] Update Progress: 883/2372 symbols completed. FTS took 38.6s. Estimated remaining: 3h 37m 13s. Rate: 6.9 symbols/min [2025-09-18T19:08:52.527448] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-18T19:08:52.831816] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:08:52.864148] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-09-18T19:08:52.864552] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-09-18T19:08:52.865854] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-09-18T19:08:52.866236] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-09-18T19:08:52.868394] [DEBUG] [LOCAL ] FUL: Trimmed 46462 records to 33281 (keeping 200 days of data) [2025-09-18T19:08:52.986947] [DEBUG] [LOCAL ] FVR: Loaded 21936 existing records from primary storage. [2025-09-18T19:08:52.993881] [INFO ] [MAIN ] FVR: Loaded 21936 existing records. [2025-09-18T19:08:53.187372] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-18T19:08:53.286491] [DEBUG] [LOCAL ] FUL: Primary data saved (33281 records). [2025-09-18T19:08:53.306625] [INFO ] [MAIN ] FUL: Full history saved. [2025-09-18T19:08:53.307873] [INFO ] [MAIN ] Update Progress: 884/2372 symbols completed. FUL took 26.4s. Estimated remaining: 3h 36m 51s. Rate: 6.9 symbols/min [2025-09-18T19:08:53.324823] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-09-18T19:08:53.329667] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:08:53.352233] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-18T19:08:53.367729] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-18T19:08:53.414693] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-09-18T19:08:53.433453] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-18T19:08:53.648310] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:08:53.915705] [DEBUG] [LOCAL ] FVRR: Loaded 40164 existing records from primary storage. [2025-09-18T19:08:53.944500] [INFO ] [MAIN ] FVRR: Loaded 40164 existing records. [2025-09-18T19:08:54.029587] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:08:54.127608] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-11. [2025-09-18T19:08:54.170137] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:08:54.170458] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-18T19:08:54.170527] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-18T19:08:54.171471] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-18T19:08:54.171532] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-18T19:08:54.536087] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:08:54.570075] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-18T19:08:54.640997] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-18T19:08:54.788067] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-18T19:08:54.919564] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-09-18T19:08:55.719549] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-09-18T19:08:56.159276] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-18T19:08:56.519547] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-18T19:08:56.822242] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-18T19:08:57.319554] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-18T19:08:58.119625] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-11. [2025-09-18T19:08:58.919634] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-09-18T19:08:59.261550] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-18T19:08:59.304414] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-18T19:08:59.719555] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-18T19:09:00.519544] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-18T19:09:01.289983] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-11 (3.17 seconds). [2025-09-18T19:09:01.317759] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-09-18T19:09:01.321347] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-09-18T19:09:01.414436] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-18T19:09:02.119550] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-18T19:09:02.820315] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T19:09:02.919549] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-18T19:09:03.292293] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-09-18T19:09:03.300870] [INFO ] [REMOTE ] FUBO: Full fetch complete (77693 records). [2025-09-18T19:09:03.301030] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-18T19:09:03.664085] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-18T19:09:03.718599] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-18T19:09:03.719308] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-18T19:09:03.720325] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-18T19:09:03.720578] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-18T19:09:03.720436] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-18T19:09:03.723345] [DEBUG] [LOCAL ] FUBO: Trimmed 77693 records to 54089 (keeping 200 days of data) [2025-09-18T19:09:04.050674] [DEBUG] [LOCAL ] FUBO: Primary data saved (54089 records). [2025-09-18T19:09:04.050841] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-18T19:09:04.050951] [INFO ] [MAIN ] Update Progress: 885/2372 symbols completed. FUBO took 50.2s. Estimated remaining: 3h 36m 46s. Rate: 6.9 symbols/min [2025-09-18T19:09:04.221599] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:09:04.224745] [DEBUG] [LOCAL ] FXED: Loaded 1206 existing records from primary storage. [2025-09-18T19:09:04.224825] [INFO ] [MAIN ] FXED: Loaded 1206 existing records. [2025-09-18T19:09:04.421367] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:09:04.421637] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-18T19:09:04.421722] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-18T19:09:04.421981] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-09-18T19:09:04.422040] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-18T19:09:04.526166] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-09-18T19:09:04.795395] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:09:05.319612] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-11. [2025-09-18T19:09:05.693060] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-11 (0.37 seconds). [2025-09-18T19:09:05.756085] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (2.84 seconds). [2025-09-18T19:09:05.943349] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-18T19:09:06.119502] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-09-18T19:09:06.207752] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-18T19:09:06.369266] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-09-18T19:09:06.919551] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-09-18T19:09:07.341453] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-18T19:09:07.719553] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-18T19:09:08.519549] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-18T19:09:09.231975] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-18T19:09:09.289401] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-18T19:09:09.319500] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-18T19:09:10.119551] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-18T19:09:10.164071] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-18T19:09:10.919564] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-18T19:09:11.693216] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T19:09:11.719505] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-18T19:09:12.481638] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T19:09:12.519509] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-18T19:09:13.319598] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-18T19:09:13.395146] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-18T19:09:13.731824] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-18T19:09:14.119588] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-18T19:09:14.402965] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-18T19:09:14.919581] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-18T19:09:15.267356] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-18T19:09:15.294353] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-18T19:09:15.719550] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-18T19:09:16.519601] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-18T19:09:17.319528] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-18T19:09:17.443154] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T19:09:17.480942] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-18T19:09:18.119606] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-18T19:09:18.426162] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-18T19:09:18.462175] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-18T19:09:18.919560] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-18T19:09:19.201485] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-18T19:09:19.719590] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-18T19:09:20.519581] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-18T19:09:21.319628] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-18T19:09:21.385164] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-18T19:09:21.727838] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-18T19:09:21.920316] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-18T19:09:22.119534] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-18T19:09:22.919605] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-18T19:09:23.376146] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-18T19:09:23.719596] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-18T19:09:23.830960] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-18T19:09:23.838388] [INFO ] [REMOTE ] FUN: Full fetch complete (72063 records). [2025-09-18T19:09:23.838577] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-18T19:09:24.097199] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-18T19:09:24.255944] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-18T19:09:24.256051] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-18T19:09:24.256947] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-18T19:09:24.257017] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-18T19:09:24.258575] [DEBUG] [LOCAL ] FUN: Trimmed 72063 records to 51913 (keeping 200 days of data) [2025-09-18T19:09:24.522706] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-18T19:09:24.567776] [DEBUG] [LOCAL ] FUN: Primary data saved (51913 records). [2025-09-18T19:09:24.567950] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-18T19:09:24.568063] [INFO ] [MAIN ] Update Progress: 886/2372 symbols completed. FUN took 33.8s. Estimated remaining: 3h 36m 57s. Rate: 6.8 symbols/min [2025-09-18T19:09:24.743992] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:09:24.791347] [DEBUG] [LOCAL ] G: Loaded 49757 existing records from primary storage. [2025-09-18T19:09:24.791581] [INFO ] [MAIN ] G: Loaded 49757 existing records. [2025-09-18T19:09:24.977040] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:09:24.977360] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-18T19:09:24.977414] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-18T19:09:24.978847] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-18T19:09:24.978910] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-18T19:09:25.084350] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-18T19:09:25.091345] [INFO ] [REMOTE ] FXED: Full fetch complete (1757 records). [2025-09-18T19:09:25.101789] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-18T19:09:25.319765] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-18T19:09:25.790708] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:09:25.812288] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-09-18T19:09:25.812370] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-09-18T19:09:25.812472] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-09-18T19:09:25.812512] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-09-18T19:09:25.812882] [DEBUG] [LOCAL ] FXED: Trimmed 1757 records to 1218 (keeping 200 days of data) [2025-09-18T19:09:25.821170] [DEBUG] [LOCAL ] FXED: Primary data saved (1218 records). [2025-09-18T19:09:25.821237] [INFO ] [MAIN ] FXED: Full history saved. [2025-09-18T19:09:25.821313] [INFO ] [MAIN ] Update Progress: 887/2372 symbols completed. FXED took 21.8s. Estimated remaining: 3h 36m 36s. Rate: 6.9 symbols/min [2025-09-18T19:09:25.992542] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:09:26.021026] [DEBUG] [LOCAL ] GAB: Loaded 27752 existing records from primary storage. [2025-09-18T19:09:26.021193] [INFO ] [MAIN ] GAB: Loaded 27752 existing records. [2025-09-18T19:09:26.125300] [INFO ] [REMOTE ] G: Fetching primary data for 2024-11. [2025-09-18T19:09:26.220479] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:09:26.220745] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-18T19:09:26.220801] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-18T19:09:26.221456] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-18T19:09:26.221522] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-18T19:09:26.580217] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:09:26.919624] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-11. [2025-09-18T19:09:26.980985] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-18T19:09:27.576306] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-18T19:09:27.719508] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-18T19:09:28.111567] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-18T19:09:28.519600] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-09-18T19:09:29.041868] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-18T19:09:29.047533] [INFO ] [REMOTE ] FVRR: Full fetch complete (58724 records). [2025-09-18T19:09:29.047638] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-18T19:09:29.324759] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-09-18T19:09:29.435791] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-18T19:09:29.435874] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-18T19:09:29.436752] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-18T19:09:29.436817] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-18T19:09:29.438563] [DEBUG] [LOCAL ] FVRR: Trimmed 58724 records to 40480 (keeping 200 days of data) [2025-09-18T19:09:29.559165] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-18T19:09:29.707774] [DEBUG] [LOCAL ] FVRR: Primary data saved (40480 records). [2025-09-18T19:09:29.707905] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-18T19:09:29.708021] [INFO ] [MAIN ] Update Progress: 888/2372 symbols completed. FVRR took 36.4s. Estimated remaining: 3h 36m 19s. Rate: 6.9 symbols/min [2025-09-18T19:09:29.880727] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:09:29.887528] [DEBUG] [LOCAL ] GAM: Loaded 4375 existing records from primary storage. [2025-09-18T19:09:29.887667] [INFO ] [MAIN ] GAM: Loaded 4375 existing records. [2025-09-18T19:09:30.065427] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:09:30.065722] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-18T19:09:30.065777] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-18T19:09:30.066040] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-18T19:09:30.066099] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-18T19:09:30.128987] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-18T19:09:30.432794] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:09:30.791305] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-18T19:09:30.919615] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-11. [2025-09-18T19:09:31.055561] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T19:09:31.362712] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-18T19:09:31.719569] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-09-18T19:09:32.519601] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-18T19:09:32.527339] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-18T19:09:33.319624] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-09-18T19:09:33.373876] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-18T19:09:34.119558] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-09-18T19:09:34.564095] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-18T19:09:34.919582] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-09-18T19:09:35.255774] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-18T19:09:35.388328] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-18T19:09:35.719600] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-18T19:09:36.519594] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-18T19:09:37.319575] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-18T19:09:37.350719] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-18T19:09:37.381229] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-18T19:09:37.897594] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-18T19:09:38.119560] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-18T19:09:38.919553] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-18T19:09:39.070840] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-18T19:09:39.073961] [INFO ] [REMOTE ] FVR: Full fetch complete (30672 records). [2025-09-18T19:09:39.074049] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-18T19:09:39.452814] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-09-18T19:09:39.452901] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-09-18T19:09:39.453446] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-09-18T19:09:39.453488] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-09-18T19:09:39.454383] [DEBUG] [LOCAL ] FVR: Trimmed 30672 records to 22106 (keeping 200 days of data) [2025-09-18T19:09:39.589103] [DEBUG] [LOCAL ] FVR: Primary data saved (22106 records). [2025-09-18T19:09:39.589246] [INFO ] [MAIN ] FVR: Full history saved. [2025-09-18T19:09:39.589337] [INFO ] [MAIN ] Update Progress: 889/2372 symbols completed. FVR took 47.1s. Estimated remaining: 3h 36m 12s. Rate: 6.9 symbols/min [2025-09-18T19:09:39.731771] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-18T19:09:39.765899] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:09:39.824601] [DEBUG] [LOCAL ] GAP: Loaded 53655 existing records from primary storage. [2025-09-18T19:09:39.824811] [INFO ] [MAIN ] GAP: Loaded 53655 existing records. [2025-09-18T19:09:40.007866] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:09:40.008172] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-18T19:09:40.008229] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-18T19:09:40.009939] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-18T19:09:40.010003] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-18T19:09:40.393742] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:09:40.461139] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-18T19:09:40.491675] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-18T19:09:40.519528] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-18T19:09:41.319609] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-18T19:09:42.119592] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-18T19:09:42.227708] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-18T19:09:42.362501] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-18T19:09:42.681167] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-18T19:09:42.919547] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-18T19:09:43.719586] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-18T19:09:43.949718] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-18T19:09:44.519552] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-18T19:09:45.086583] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-18T19:09:45.319549] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-18T19:09:45.426333] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-18T19:09:45.714402] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-18T19:09:46.119560] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-11. [2025-09-18T19:09:46.919557] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-18T19:09:47.622137] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-18T19:09:47.719582] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-18T19:09:47.952044] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-18T19:09:48.519530] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-09-18T19:09:48.618061] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-18T19:09:49.319548] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-18T19:09:49.803310] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-18T19:09:50.119581] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-18T19:09:50.562470] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-18T19:09:50.565132] [INFO ] [REMOTE ] GAM: Full fetch complete (6949 records). [2025-09-18T19:09:50.565512] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-18T19:09:50.664924] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-18T19:09:50.928300] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-18T19:09:51.027331] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-18T19:09:51.027447] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-18T19:09:51.027712] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-18T19:09:51.027778] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-18T19:09:51.028506] [DEBUG] [LOCAL ] GAM: Trimmed 6949 records to 4390 (keeping 200 days of data) [2025-09-18T19:09:51.061753] [DEBUG] [LOCAL ] GAM: Primary data saved (4390 records). [2025-09-18T19:09:51.061937] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-18T19:09:51.062068] [INFO ] [MAIN ] Update Progress: 890/2372 symbols completed. GAM took 21.4s. Estimated remaining: 3h 36m 8s. Rate: 6.9 symbols/min [2025-09-18T19:09:51.229583] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:09:51.249922] [DEBUG] [LOCAL ] GATX: Loaded 17983 existing records from primary storage. [2025-09-18T19:09:51.250063] [INFO ] [MAIN ] GATX: Loaded 17983 existing records. [2025-09-18T19:09:51.426283] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:09:51.426567] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-18T19:09:51.426617] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-18T19:09:51.427180] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-09-18T19:09:51.427242] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-18T19:09:51.724721] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-18T19:09:51.792575] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:09:52.223252] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-18T19:09:52.519541] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-11. [2025-09-18T19:09:53.068008] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T19:09:53.091074] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-18T19:09:53.319547] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-18T19:09:54.119543] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-09-18T19:09:54.539952] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-18T19:09:54.919547] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-09-18T19:09:55.719548] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-18T19:09:55.946319] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-18T19:09:55.970061] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T19:09:56.519552] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-18T19:09:57.074835] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-18T19:09:57.319584] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-09-18T19:09:58.038154] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-18T19:09:58.084829] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-18T19:09:58.119516] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-18T19:09:58.764124] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-18T19:09:58.919541] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-18T19:09:59.719588] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-18T19:09:59.746497] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-18T19:10:00.519562] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-18T19:10:00.995605] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-18T19:10:01.319607] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-18T19:10:02.004169] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-18T19:10:02.011851] [INFO ] [REMOTE ] G: Full fetch complete (71357 records). [2025-09-18T19:10:02.012051] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-18T19:10:02.124795] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-18T19:10:02.455570] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-18T19:10:02.454237] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-18T19:10:02.461110] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-18T19:10:02.462988] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-18T19:10:02.463571] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-18T19:10:02.465529] [DEBUG] [LOCAL ] G: Trimmed 71357 records to 50126 (keeping 200 days of data) [2025-09-18T19:10:02.784162] [DEBUG] [LOCAL ] G: Primary data saved (50126 records). [2025-09-18T19:10:02.784308] [INFO ] [MAIN ] G: Full history saved. [2025-09-18T19:10:02.784408] [INFO ] [MAIN ] Update Progress: 891/2372 symbols completed. G took 38.2s. Estimated remaining: 3h 36m 4s. Rate: 6.9 symbols/min [2025-09-18T19:10:02.926911] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-18T19:10:02.960820] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:10:02.977006] [DEBUG] [LOCAL ] GBAB: Loaded 13082 existing records from primary storage. [2025-09-18T19:10:02.977170] [INFO ] [MAIN ] GBAB: Loaded 13082 existing records. [2025-09-18T19:10:03.154956] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:10:03.155243] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-18T19:10:03.155308] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-18T19:10:03.155811] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-09-18T19:10:03.155880] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-18T19:10:03.550660] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:10:03.719516] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-11. [2025-09-18T19:10:04.111130] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-18T19:10:04.136430] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T19:10:04.509036] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-18T19:10:04.519490] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-09-18T19:10:05.319742] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-18T19:10:05.319544] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-18T19:10:06.119542] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-18T19:10:06.149588] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-18T19:10:06.919550] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-18T19:10:07.719586] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-09-18T19:10:08.137805] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-18T19:10:08.161390] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T19:10:08.380459] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-18T19:10:08.519613] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-18T19:10:09.319593] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-18T19:10:09.529323] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-18T19:10:10.119591] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-18T19:10:10.390333] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-18T19:10:10.394528] [INFO ] [REMOTE ] GAB: Full fetch complete (39159 records). [2025-09-18T19:10:10.394610] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-18T19:10:10.771587] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-18T19:10:10.771697] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-18T19:10:10.772263] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-18T19:10:10.772318] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-18T19:10:10.773237] [DEBUG] [LOCAL ] GAB: Trimmed 39159 records to 27996 (keeping 200 days of data) [2025-09-18T19:10:10.893543] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-18T19:10:10.926262] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-18T19:10:10.958220] [DEBUG] [LOCAL ] GAB: Primary data saved (27996 records). [2025-09-18T19:10:10.958431] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-18T19:10:10.958570] [INFO ] [MAIN ] Update Progress: 892/2372 symbols completed. GAB took 45.1s. Estimated remaining: 3h 35m 54s. Rate: 6.9 symbols/min [2025-09-18T19:10:11.137620] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:10:11.180813] [DEBUG] [LOCAL ] GBCI: Loaded 40027 existing records from primary storage. [2025-09-18T19:10:11.181041] [INFO ] [MAIN ] GBCI: Loaded 40027 existing records. [2025-09-18T19:10:11.372114] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:10:11.372425] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-18T19:10:11.372476] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-18T19:10:11.373558] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-09-18T19:10:11.373619] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-18T19:10:11.731101] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-18T19:10:11.751555] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:10:12.097146] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-18T19:10:12.100428] [INFO ] [REMOTE ] GATX: Full fetch complete (25214 records). [2025-09-18T19:10:12.100528] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-18T19:10:12.476918] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-09-18T19:10:12.476997] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-09-18T19:10:12.477419] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-09-18T19:10:12.477459] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-09-18T19:10:12.478136] [DEBUG] [LOCAL ] GATX: Trimmed 25214 records to 18177 (keeping 200 days of data) [2025-09-18T19:10:12.528197] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-11. [2025-09-18T19:10:12.595705] [DEBUG] [LOCAL ] GATX: Primary data saved (18177 records). [2025-09-18T19:10:12.595882] [INFO ] [MAIN ] GATX: Full history saved. [2025-09-18T19:10:12.595983] [INFO ] [MAIN ] Update Progress: 893/2372 symbols completed. GATX took 21.5s. Estimated remaining: 3h 35m 34s. Rate: 6.9 symbols/min [2025-09-18T19:10:12.768164] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:10:12.768406] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-18T19:10:12.768463] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-18T19:10:12.768615] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-18T19:10:12.768824] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-18T19:10:12.768892] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-18T19:10:12.768972] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-18T19:10:13.180418] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:10:13.319556] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-11. [2025-09-18T19:10:13.441528] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-18T19:10:13.586150] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-11 (0.27 seconds). [2025-09-18T19:10:13.588411] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-18T19:10:14.119567] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-09-18T19:10:14.919584] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-18T19:10:15.569354] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-18T19:10:15.719589] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-09-18T19:10:16.519613] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-09-18T19:10:16.723068] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-18T19:10:16.861629] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-18T19:10:16.902128] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-18T19:10:17.319563] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-18T19:10:17.649415] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-18T19:10:18.119569] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-18T19:10:18.344482] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-09-18T19:10:18.919587] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-18T19:10:19.719543] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-18T19:10:20.337290] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T19:10:20.519566] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-18T19:10:21.319617] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-18T19:10:21.495130] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-18T19:10:21.880234] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T19:10:21.982551] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-18T19:10:22.119566] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-18T19:10:22.919613] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-18T19:10:23.654269] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-18T19:10:23.719551] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-18T19:10:24.320447] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-18T19:10:24.489923] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-18T19:10:24.519631] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-18T19:10:25.319568] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-18T19:10:25.454014] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-18T19:10:26.119595] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-18T19:10:26.919549] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-18T19:10:26.963056] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-18T19:10:27.279999] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-18T19:10:27.289132] [INFO ] [REMOTE ] GAP: Full fetch complete (77493 records). [2025-09-18T19:10:27.289341] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-18T19:10:27.724379] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-18T19:10:27.744611] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-09-18T19:10:27.744731] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-09-18T19:10:27.745830] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-09-18T19:10:27.745918] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-09-18T19:10:27.747456] [DEBUG] [LOCAL ] GAP: Trimmed 77493 records to 54045 (keeping 200 days of data) [2025-09-18T19:10:28.097845] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-18T19:10:28.112690] [DEBUG] [LOCAL ] GAP: Primary data saved (54045 records). [2025-09-18T19:10:28.112806] [INFO ] [MAIN ] GAP: Full history saved. [2025-09-18T19:10:28.112912] [INFO ] [MAIN ] Update Progress: 894/2372 symbols completed. GAP took 48.5s. Estimated remaining: 3h 35m 36s. Rate: 6.9 symbols/min [2025-09-18T19:10:28.288186] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:10:28.332804] [DEBUG] [LOCAL ] GBTG: Loaded 40710 existing records from primary storage. [2025-09-18T19:10:28.333055] [INFO ] [MAIN ] GBTG: Loaded 40710 existing records. [2025-09-18T19:10:28.446696] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T19:10:28.524673] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-18T19:10:28.530044] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:10:28.530207] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-18T19:10:28.530255] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-18T19:10:28.531275] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-18T19:10:28.531337] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-18T19:10:28.888730] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:10:28.917568] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-18T19:10:29.319698] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-18T19:10:29.603085] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-18T19:10:30.119597] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-18T19:10:30.391602] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-18T19:10:30.919549] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-18T19:10:31.719543] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-18T19:10:31.917690] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-18T19:10:31.944213] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-09-18T19:10:32.519594] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-11. [2025-09-18T19:10:33.319614] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-18T19:10:33.691422] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-18T19:10:34.119611] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-09-18T19:10:34.696459] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T19:10:34.919545] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-18T19:10:35.181882] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-18T19:10:35.719564] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-09-18T19:10:36.142632] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-18T19:10:36.519562] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-18T19:10:36.844491] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-18T19:10:36.874360] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T19:10:37.319559] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-18T19:10:37.863449] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-18T19:10:38.119596] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-18T19:10:38.919602] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-18T19:10:39.240827] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-18T19:10:39.600396] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-18T19:10:39.719553] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-18T19:10:40.519566] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-18T19:10:40.607614] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-18T19:10:40.610386] [INFO ] [REMOTE ] GBAB: Full fetch complete (20665 records). [2025-09-18T19:10:40.610496] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-18T19:10:41.000405] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-09-18T19:10:41.000508] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-09-18T19:10:41.001106] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-09-18T19:10:41.001217] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-09-18T19:10:41.003030] [DEBUG] [LOCAL ] GBAB: Trimmed 20665 records to 13156 (keeping 200 days of data) [2025-09-18T19:10:41.106025] [DEBUG] [LOCAL ] GBAB: Primary data saved (13156 records). [2025-09-18T19:10:41.106188] [INFO ] [MAIN ] GBAB: Full history saved. [2025-09-18T19:10:41.106348] [INFO ] [MAIN ] Update Progress: 895/2372 symbols completed. GBAB took 38.3s. Estimated remaining: 3h 35m 34s. Rate: 6.9 symbols/min [2025-09-18T19:10:41.284418] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:10:41.324684] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-18T19:10:41.327130] [DEBUG] [LOCAL ] GBX: Loaded 29517 existing records from primary storage. [2025-09-18T19:10:41.327226] [INFO ] [MAIN ] GBX: Loaded 29517 existing records. [2025-09-18T19:10:41.523512] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:10:41.523824] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-18T19:10:41.523891] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-18T19:10:41.524675] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-18T19:10:41.524755] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-18T19:10:41.894436] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:10:41.894858] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-18T19:10:41.897556] [INFO ] [REMOTE ] GBLI: Full fetch complete (1427 records). [2025-09-18T19:10:41.897812] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-18T19:10:42.058399] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-18T19:10:42.101838] [INFO ] [REMOTE ] GBCI: Full fetch complete (57478 records). [2025-09-18T19:10:42.103815] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-18T19:10:42.124441] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-09-18T19:10:42.120814] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-11. [2025-09-18T19:10:42.130287] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:10:42.169786] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:10:42.190259] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-18T19:10:42.207795] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-18T19:10:42.226597] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-18T19:10:42.230310] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-18T19:10:42.230423] [INFO ] [MAIN ] Update Progress: 896/2372 symbols completed. GBLI took 29.6s. Estimated remaining: 3h 35m 13s. Rate: 6.9 symbols/min [2025-09-18T19:10:42.640603] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:10:42.736213] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-09-18T19:10:42.736295] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-09-18T19:10:42.737001] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-09-18T19:10:42.737064] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-09-18T19:10:42.738784] [DEBUG] [LOCAL ] GBCI: Trimmed 57478 records to 40386 (keeping 200 days of data) [2025-09-18T19:10:42.904006] [DEBUG] [LOCAL ] GCI: Loaded 44264 existing records from primary storage. [2025-09-18T19:10:42.906089] [INFO ] [MAIN ] GCI: Loaded 44264 existing records. [2025-09-18T19:10:42.924800] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-18T19:10:43.126710] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:10:43.128637] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-18T19:10:43.129210] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-18T19:10:43.131318] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-09-18T19:10:43.135330] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-18T19:10:43.408801] [DEBUG] [LOCAL ] GBCI: Primary data saved (40386 records). [2025-09-18T19:10:43.417761] [INFO ] [MAIN ] GBCI: Full history saved. [2025-09-18T19:10:43.436942] [INFO ] [MAIN ] Update Progress: 897/2372 symbols completed. GBCI took 32.5s. Estimated remaining: 3h 34m 52s. Rate: 6.9 symbols/min [2025-09-18T19:10:43.785041] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:10:43.810785] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-11. [2025-09-18T19:10:43.813980] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:10:43.831161] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-18T19:10:43.861303] [DEBUG] [LOCAL ] GCO: Loaded 25980 existing records from primary storage. [2025-09-18T19:10:43.861447] [INFO ] [MAIN ] GCO: Loaded 25980 existing records. [2025-09-18T19:10:44.041568] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:10:44.042249] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-18T19:10:44.042341] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-18T19:10:44.049770] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-18T19:10:44.061492] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-18T19:10:44.131819] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-18T19:10:44.526722] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-18T19:10:44.526561] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:10:45.319568] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-11. [2025-09-18T19:10:45.354382] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-18T19:10:45.844953] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T19:10:45.960793] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-18T19:10:46.119557] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-09-18T19:10:46.919619] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-18T19:10:47.000088] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T19:10:47.719585] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-09-18T19:10:48.492874] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-18T19:10:48.519498] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-18T19:10:48.956849] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-18T19:10:49.319546] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-18T19:10:49.662610] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-18T19:10:50.119547] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-18T19:10:50.227949] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-18T19:10:50.919550] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-09-18T19:10:51.137320] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-18T19:10:51.719546] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-09-18T19:10:51.982991] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-18T19:10:52.519545] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-18T19:10:52.935545] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-18T19:10:53.319517] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-09-18T19:10:53.536882] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-18T19:10:54.119549] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-18T19:10:54.449036] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-18T19:10:54.919561] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-18T19:10:55.069149] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-18T19:10:55.719570] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-09-18T19:10:56.133302] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-18T19:10:56.519538] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-18T19:10:56.843712] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-18T19:10:57.319558] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-18T19:10:58.119575] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-18T19:10:58.177985] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T19:10:58.409545] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-18T19:10:58.919632] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-18T19:10:59.576122] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T19:10:59.582061] [INFO ] [REMOTE ] GBTG: Full fetch complete (56647 records). [2025-09-18T19:10:59.582181] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-18T19:10:59.724605] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-18T19:10:59.992121] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-18T19:11:00.001720] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-18T19:11:00.002683] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-18T19:11:00.003092] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-18T19:11:00.005031] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-18T19:11:00.013250] [DEBUG] [LOCAL ] GBTG: Trimmed 56647 records to 41003 (keeping 200 days of data) [2025-09-18T19:11:00.253474] [DEBUG] [LOCAL ] GBTG: Primary data saved (41003 records). [2025-09-18T19:11:00.253624] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-18T19:11:00.253777] [INFO ] [MAIN ] Update Progress: 898/2372 symbols completed. GBTG took 32.1s. Estimated remaining: 3h 34m 56s. Rate: 6.9 symbols/min [2025-09-18T19:11:00.436312] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:11:00.456684] [DEBUG] [LOCAL ] GCTS: Loaded 19389 existing records from primary storage. [2025-09-18T19:11:00.456840] [INFO ] [MAIN ] GCTS: Loaded 19389 existing records. [2025-09-18T19:11:00.524805] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-18T19:11:00.641052] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:11:00.641357] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-18T19:11:00.641407] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-18T19:11:00.642134] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-09-18T19:11:00.642198] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-18T19:11:01.022916] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:11:01.319511] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-18T19:11:01.400799] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-18T19:11:01.475247] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-18T19:11:02.119561] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-18T19:11:02.587169] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-18T19:11:02.919572] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-11. [2025-09-18T19:11:03.203210] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-18T19:11:03.719516] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-18T19:11:04.044530] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T19:11:04.519551] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-18T19:11:04.630806] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-18T19:11:05.319565] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-09-18T19:11:06.102497] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-18T19:11:06.119556] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-18T19:11:06.168361] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-18T19:11:06.919567] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-09-18T19:11:07.135201] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-18T19:11:07.719516] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-18T19:11:07.894288] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-18T19:11:08.519557] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-18T19:11:09.083298] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-18T19:11:09.319554] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-18T19:11:09.998207] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-18T19:11:10.078085] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-18T19:11:10.119503] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-18T19:11:10.919536] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-18T19:11:11.213153] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-18T19:11:11.662241] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-18T19:11:11.719494] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-18T19:11:12.519562] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-18T19:11:12.753831] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-18T19:11:13.257206] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-18T19:11:13.319494] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-18T19:11:14.119514] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-18T19:11:14.383255] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-18T19:11:14.919508] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-18T19:11:15.011445] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-18T19:11:15.015413] [INFO ] [REMOTE ] GCO: Full fetch complete (36064 records). [2025-09-18T19:11:15.015499] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-18T19:11:15.388673] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-18T19:11:15.388769] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-18T19:11:15.389299] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-18T19:11:15.389370] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-18T19:11:15.390295] [DEBUG] [LOCAL ] GCO: Trimmed 36064 records to 26118 (keeping 200 days of data) [2025-09-18T19:11:15.545411] [DEBUG] [LOCAL ] GCO: Primary data saved (26118 records). [2025-09-18T19:11:15.545559] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-18T19:11:15.545669] [INFO ] [MAIN ] Update Progress: 899/2372 symbols completed. GCO took 32.1s. Estimated remaining: 3h 34m 58s. Rate: 6.9 symbols/min [2025-09-18T19:11:15.715529] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:11:15.720268] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-18T19:11:15.725170] [DEBUG] [LOCAL ] GCV: Loaded 7064 existing records from primary storage. [2025-09-18T19:11:15.725265] [INFO ] [MAIN ] GCV: Loaded 7064 existing records. [2025-09-18T19:11:15.908905] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:11:15.909166] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-18T19:11:15.909214] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-18T19:11:15.909566] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-09-18T19:11:15.909627] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-18T19:11:16.274517] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:11:16.298789] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-18T19:11:16.519572] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-18T19:11:16.702263] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-18T19:11:16.706746] [INFO ] [REMOTE ] GBX: Full fetch complete (42633 records). [2025-09-18T19:11:16.706889] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-18T19:11:17.101969] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-18T19:11:17.102061] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-18T19:11:17.102665] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-18T19:11:17.102728] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-18T19:11:17.105480] [DEBUG] [LOCAL ] GBX: Trimmed 42633 records to 29724 (keeping 200 days of data) [2025-09-18T19:11:17.291096] [DEBUG] [LOCAL ] GBX: Primary data saved (29724 records). [2025-09-18T19:11:17.291297] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-18T19:11:17.291426] [INFO ] [MAIN ] Update Progress: 900/2372 symbols completed. GBX took 36.2s. Estimated remaining: 3h 34m 38s. Rate: 6.9 symbols/min [2025-09-18T19:11:17.324726] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-18T19:11:17.480685] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:11:17.534864] [DEBUG] [LOCAL ] GD: Loaded 47504 existing records from primary storage. [2025-09-18T19:11:17.535046] [INFO ] [MAIN ] GD: Loaded 47504 existing records. [2025-09-18T19:11:17.731915] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:11:17.732430] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-18T19:11:17.732557] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-18T19:11:17.742607] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-18T19:11:17.756893] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-18T19:11:17.828420] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-18T19:11:18.130987] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-11. [2025-09-18T19:11:18.160479] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:11:18.580504] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-18T19:11:18.675964] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-18T19:11:18.919573] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-09-18T19:11:19.522939] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-18T19:11:19.719694] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-11. [2025-09-18T19:11:20.519616] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-18T19:11:21.104798] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T19:11:21.319628] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-09-18T19:11:21.747631] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-18T19:11:22.119572] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-09-18T19:11:22.719267] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-18T19:11:22.919539] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-18T19:11:23.063191] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-18T19:11:23.719566] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-09-18T19:11:24.288208] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-18T19:11:24.519563] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-18T19:11:25.244205] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T19:11:25.319577] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-18T19:11:25.863133] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-18T19:11:25.869319] [INFO ] [REMOTE ] GCI: Full fetch complete (62950 records). [2025-09-18T19:11:25.869458] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-18T19:11:26.126045] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-18T19:11:26.259848] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-09-18T19:11:26.259941] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-09-18T19:11:26.260703] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-09-18T19:11:26.260771] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-09-18T19:11:26.262117] [DEBUG] [LOCAL ] GCI: Trimmed 62950 records to 44615 (keeping 200 days of data) [2025-09-18T19:11:26.514601] [DEBUG] [LOCAL ] GCI: Primary data saved (44615 records). [2025-09-18T19:11:26.514769] [INFO ] [MAIN ] GCI: Full history saved. [2025-09-18T19:11:26.516418] [INFO ] [MAIN ] Update Progress: 901/2372 symbols completed. GCI took 44.3s. Estimated remaining: 3h 34m 30s. Rate: 6.9 symbols/min [2025-09-18T19:11:26.690715] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:11:26.745385] [DEBUG] [LOCAL ] GDDY: Loaded 49844 existing records from primary storage. [2025-09-18T19:11:26.745550] [INFO ] [MAIN ] GDDY: Loaded 49844 existing records. [2025-09-18T19:11:26.921100] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-18T19:11:26.925289] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:11:26.926764] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-18T19:11:26.926839] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-18T19:11:26.928208] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-18T19:11:26.928272] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-18T19:11:27.059361] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-18T19:11:27.309306] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:11:27.335952] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-18T19:11:27.719583] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-11. [2025-09-18T19:11:28.502447] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-18T19:11:28.519496] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-18T19:11:29.093888] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-18T19:11:29.319582] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-18T19:11:29.363423] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-18T19:11:30.119599] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-18T19:11:30.710142] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-18T19:11:30.906308] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T19:11:30.919499] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-18T19:11:31.719583] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-18T19:11:32.286756] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-18T19:11:32.519523] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-09-18T19:11:32.609935] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-18T19:11:33.319578] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-18T19:11:33.773377] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-18T19:11:34.119585] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-18T19:11:34.177048] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-18T19:11:34.919591] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-09-18T19:11:35.719563] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-18T19:11:35.915544] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-18T19:11:36.079948] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-18T19:11:36.195383] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-18T19:11:36.519556] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-18T19:11:37.222924] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-18T19:11:37.319606] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-18T19:11:37.893115] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-18T19:11:38.119613] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-18T19:11:38.919573] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-18T19:11:39.119433] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-18T19:11:39.606267] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-18T19:11:39.608130] [INFO ] [REMOTE ] GCV: Full fetch complete (9280 records). [2025-09-18T19:11:39.608201] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-18T19:11:39.724731] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-18T19:11:40.002214] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-09-18T19:11:40.002297] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-09-18T19:11:40.002516] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-09-18T19:11:40.002555] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-09-18T19:11:40.003095] [DEBUG] [LOCAL ] GCV: Trimmed 9280 records to 7097 (keeping 200 days of data) [2025-09-18T19:11:40.045115] [DEBUG] [LOCAL ] GCV: Primary data saved (7097 records). [2025-09-18T19:11:40.045237] [INFO ] [MAIN ] GCV: Full history saved. [2025-09-18T19:11:40.045320] [INFO ] [MAIN ] Update Progress: 902/2372 symbols completed. GCV took 24.5s. Estimated remaining: 3h 34m 29s. Rate: 6.9 symbols/min [2025-09-18T19:11:40.223142] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:11:40.229532] [DEBUG] [LOCAL ] GDIV: Loaded 3778 existing records from primary storage. [2025-09-18T19:11:40.229671] [INFO ] [MAIN ] GDIV: Loaded 3778 existing records. [2025-09-18T19:11:40.421883] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:11:40.422169] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-18T19:11:40.422258] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-18T19:11:40.422531] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-18T19:11:40.422592] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-18T19:11:40.528726] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-18T19:11:40.809217] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:11:40.933045] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-18T19:11:40.936346] [INFO ] [REMOTE ] GCTS: Full fetch complete (26771 records). [2025-09-18T19:11:40.936422] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-18T19:11:41.304046] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-09-18T19:11:41.304153] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-09-18T19:11:41.304617] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-09-18T19:11:41.304701] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-09-18T19:11:41.305738] [DEBUG] [LOCAL ] GCTS: Trimmed 26771 records to 19626 (keeping 200 days of data) [2025-09-18T19:11:41.348714] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-18T19:11:41.415583] [DEBUG] [LOCAL ] GCTS: Primary data saved (19626 records). [2025-09-18T19:11:41.415761] [INFO ] [MAIN ] GCTS: Full history saved. [2025-09-18T19:11:41.415870] [INFO ] [MAIN ] Update Progress: 903/2372 symbols completed. GCTS took 41.2s. Estimated remaining: 3h 34m 8s. Rate: 6.9 symbols/min [2025-09-18T19:11:41.585737] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:11:41.585918] [DEBUG] [LOCAL ] GDL: No existing data file found in primary storage. [2025-09-18T19:11:41.585974] [WARN ] [MAIN ] GDL: No existing data found, performing full refresh instead. [2025-09-18T19:11:41.586133] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-18T19:11:41.586177] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-18T19:11:41.586218] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-09-18T19:11:41.586250] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-18T19:11:41.949103] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:11:41.991364] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T19:11:42.119516] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-11. [2025-09-18T19:11:42.575348] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-18T19:11:42.833366] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-18T19:11:42.919504] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-18T19:11:43.719551] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-11. [2025-09-18T19:11:44.070509] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-11 (0.35 seconds). [2025-09-18T19:11:44.519561] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-09-18T19:11:44.841383] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-18T19:11:44.868259] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-18T19:11:45.319554] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-18T19:11:46.119555] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-18T19:11:46.919559] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-09-18T19:11:47.031631] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-18T19:11:47.240384] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-18T19:11:47.684207] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-18T19:11:47.719514] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-18T19:11:48.519575] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-09-18T19:11:48.863976] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-18T19:11:49.319559] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-18T19:11:49.436864] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-18T19:11:49.601188] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-18T19:11:50.119567] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-18T19:11:50.579966] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-18T19:11:50.919551] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-18T19:11:51.719559] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-18T19:11:52.215376] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-18T19:11:52.406349] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T19:11:52.519494] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-09-18T19:11:53.140485] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-18T19:11:53.319529] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-18T19:11:54.119608] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-18T19:11:54.582366] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-18T19:11:54.919553] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-18T19:11:54.967743] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-18T19:11:54.974080] [INFO ] [REMOTE ] GD: Full fetch complete (70471 records). [2025-09-18T19:11:54.974239] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-18T19:11:55.271302] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-18T19:11:55.397235] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-18T19:11:55.397383] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-18T19:11:55.398317] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-18T19:11:55.398387] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-18T19:11:55.400547] [DEBUG] [LOCAL ] GD: Trimmed 70471 records to 47822 (keeping 200 days of data) [2025-09-18T19:11:55.703227] [DEBUG] [LOCAL ] GD: Primary data saved (47822 records). [2025-09-18T19:11:55.703364] [INFO ] [MAIN ] GD: Full history saved. [2025-09-18T19:11:55.703450] [INFO ] [MAIN ] Update Progress: 904/2372 symbols completed. GD took 38.4s. Estimated remaining: 3h 34m 9s. Rate: 6.9 symbols/min [2025-09-18T19:11:55.724622] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-18T19:11:55.879524] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:11:55.888529] [DEBUG] [LOCAL ] GDO: Loaded 6050 existing records from primary storage. [2025-09-18T19:11:55.888692] [INFO ] [MAIN ] GDO: Loaded 6050 existing records. [2025-09-18T19:11:56.067281] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:11:56.067539] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-18T19:11:56.067634] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-18T19:11:56.067966] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-09-18T19:11:56.068025] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-18T19:11:56.326363] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-18T19:11:56.437896] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:11:56.519498] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-11. [2025-09-18T19:11:57.193892] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-18T19:11:57.319559] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-18T19:11:57.958015] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-18T19:11:58.119567] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-18T19:11:58.629315] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-18T19:11:58.919571] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-18T19:11:59.383110] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-18T19:11:59.719577] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-09-18T19:12:00.286684] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-18T19:12:00.519613] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-18T19:12:01.135818] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-18T19:12:01.319606] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-18T19:12:02.119573] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-18T19:12:02.919611] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-09-18T19:12:03.719574] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-18T19:12:04.155866] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (2.84 seconds). [2025-09-18T19:12:04.519628] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-18T19:12:04.771803] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-18T19:12:05.197276] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-18T19:12:05.319554] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-18T19:12:05.337882] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-18T19:12:05.964459] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-18T19:12:06.119593] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-18T19:12:06.692553] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-18T19:12:06.692908] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-18T19:12:06.919556] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-18T19:12:07.478313] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-18T19:12:07.719571] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-18T19:12:08.201019] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-18T19:12:08.519558] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-18T19:12:09.319601] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-18T19:12:09.955235] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-18T19:12:10.077276] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-18T19:12:10.119543] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-18T19:12:10.919585] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-18T19:12:11.391487] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-18T19:12:11.504966] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-18T19:12:11.512108] [INFO ] [REMOTE ] GDDY: Full fetch complete (71100 records). [2025-09-18T19:12:11.512234] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-18T19:12:11.728921] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-18T19:12:11.939332] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-18T19:12:11.939422] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-18T19:12:11.940352] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-18T19:12:11.940422] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-18T19:12:11.942108] [DEBUG] [LOCAL ] GDDY: Trimmed 71100 records to 50203 (keeping 200 days of data) [2025-09-18T19:12:12.252241] [DEBUG] [LOCAL ] GDDY: Primary data saved (50203 records). [2025-09-18T19:12:12.252431] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-18T19:12:12.253150] [INFO ] [MAIN ] Update Progress: 905/2372 symbols completed. GDDY took 45.7s. Estimated remaining: 3h 34m 13s. Rate: 6.8 symbols/min [2025-09-18T19:12:12.353196] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T19:12:12.365914] [INFO ] [REMOTE ] GDL: Full fetch complete (3553 records). [2025-09-18T19:12:12.366084] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-18T19:12:12.521500] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-18T19:12:12.557012] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:12:12.639135] [WARN ] [VALIDATOR ] GDL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-18T19:12:12.639429] [FATAL] [MAIN ] GDL: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:12:12.639493] [WARN ] [MAIN ] GDL: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:12:12.639548] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-18T19:12:12.639666] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-09-18T19:12:12.639816] [INFO ] [LOCAL ] GDL: Starting deletion of derivative data. [2025-09-18T19:12:12.639886] [DEBUG] [LOCAL ] GDL: No derivative data file found to delete. [2025-09-18T19:12:12.639971] [INFO ] [MAIN ] Update Progress: 906/2372 symbols completed. GDL took 31.2s. Estimated remaining: 3h 33m 50s. Rate: 6.9 symbols/min [2025-09-18T19:12:12.846195] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:12:12.847762] [DEBUG] [LOCAL ] GDOT: Loaded 38613 existing records from primary storage. [2025-09-18T19:12:12.847948] [INFO ] [MAIN ] GDOT: Loaded 38613 existing records. [2025-09-18T19:12:13.043051] [DEBUG] [LOCAL ] GDV: Loaded 20008 existing records from primary storage. [2025-09-18T19:12:13.043408] [INFO ] [MAIN ] GDV: Loaded 20008 existing records. [2025-09-18T19:12:13.043197] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:12:13.110440] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-18T19:12:13.123025] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-18T19:12:13.141471] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-09-18T19:12:13.141568] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-18T19:12:13.322290] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-18T19:12:13.373380] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:12:13.404912] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-18T19:12:13.417063] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-18T19:12:13.442208] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-18T19:12:13.481294] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-18T19:12:13.760062] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T19:12:13.790823] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:12:14.011840] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:12:14.119506] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-11. [2025-09-18T19:12:14.484801] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-18T19:12:14.919573] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-11. [2025-09-18T19:12:15.367754] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-18T19:12:15.719564] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-09-18T19:12:16.299014] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-18T19:12:16.445391] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-18T19:12:16.519549] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-09-18T19:12:17.319552] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-18T19:12:17.586127] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-18T19:12:17.744664] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-18T19:12:18.119547] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-18T19:12:18.720041] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-18T19:12:18.721191] [INFO ] [REMOTE ] GDIV: Full fetch complete (5431 records). [2025-09-18T19:12:18.721265] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-18T19:12:18.924634] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-18T19:12:19.117210] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-18T19:12:19.117300] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-18T19:12:19.117470] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-18T19:12:19.117512] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-18T19:12:19.117987] [DEBUG] [LOCAL ] GDIV: Trimmed 5431 records to 3803 (keeping 200 days of data) [2025-09-18T19:12:19.143289] [DEBUG] [LOCAL ] GDIV: Primary data saved (3803 records). [2025-09-18T19:12:19.143468] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-18T19:12:19.143580] [INFO ] [MAIN ] Update Progress: 907/2372 symbols completed. GDIV took 39.1s. Estimated remaining: 3h 33m 38s. Rate: 6.9 symbols/min [2025-09-18T19:12:19.317349] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:12:19.379258] [DEBUG] [LOCAL ] GE: Loaded 53715 existing records from primary storage. [2025-09-18T19:12:19.379412] [INFO ] [MAIN ] GE: Loaded 53715 existing records. [2025-09-18T19:12:19.562812] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:12:19.563105] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-18T19:12:19.563160] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-18T19:12:19.565231] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-09-18T19:12:19.565292] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-18T19:12:19.722046] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-18T19:12:19.826524] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-18T19:12:19.855610] [INFO ] [REMOTE ] GDO: Full fetch complete (9578 records). [2025-09-18T19:12:19.866535] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-18T19:12:20.045944] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:12:20.331598] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-09-18T19:12:20.331702] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-09-18T19:12:20.331965] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-09-18T19:12:20.332006] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-09-18T19:12:20.332431] [DEBUG] [LOCAL ] GDO: Trimmed 9578 records to 6087 (keeping 200 days of data) [2025-09-18T19:12:20.369807] [DEBUG] [LOCAL ] GDO: Primary data saved (6087 records). [2025-09-18T19:12:20.369923] [INFO ] [MAIN ] GDO: Full history saved. [2025-09-18T19:12:20.370054] [INFO ] [MAIN ] Update Progress: 908/2372 symbols completed. GDO took 24.7s. Estimated remaining: 3h 33m 17s. Rate: 6.9 symbols/min [2025-09-18T19:12:20.524675] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-09-18T19:12:20.551298] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:12:20.551444] [DEBUG] [LOCAL ] GEF: No existing data file found in primary storage. [2025-09-18T19:12:20.551488] [WARN ] [MAIN ] GEF: No existing data found, performing full refresh instead. [2025-09-18T19:12:20.551629] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-18T19:12:20.551746] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-18T19:12:20.551799] [DEBUG] [LOCAL ] GEF: No primary data file found to delete. [2025-09-18T19:12:20.551832] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-18T19:12:20.917508] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-18T19:12:20.923189] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:12:21.319573] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-11. [2025-09-18T19:12:21.735008] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-18T19:12:22.119552] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-18T19:12:22.333077] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T19:12:22.919594] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-11. [2025-09-18T19:12:23.143494] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-18T19:12:23.719577] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-18T19:12:24.519634] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-09-18T19:12:24.635217] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-18T19:12:24.788121] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-18T19:12:25.319588] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-09-18T19:12:25.600290] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-18T19:12:26.119525] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-18T19:12:26.215680] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-18T19:12:26.886257] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-18T19:12:26.919514] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-18T19:12:27.659524] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-18T19:12:27.719556] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-18T19:12:28.519568] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-09-18T19:12:28.898783] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-18T19:12:29.314150] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-18T19:12:29.319487] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-18T19:12:30.119614] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-09-18T19:12:30.157030] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-18T19:12:30.919604] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-18T19:12:31.719607] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-18T19:12:31.935682] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-18T19:12:32.125590] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-18T19:12:32.519510] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-18T19:12:32.679187] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-18T19:12:33.319597] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-18T19:12:33.547987] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-18T19:12:33.550687] [INFO ] [REMOTE ] GDV: Full fetch complete (28864 records). [2025-09-18T19:12:33.550813] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-18T19:12:33.947022] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-18T19:12:33.947153] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-18T19:12:33.947717] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-18T19:12:33.947817] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-18T19:12:33.948907] [DEBUG] [LOCAL ] GDV: Trimmed 28864 records to 20129 (keeping 200 days of data) [2025-09-18T19:12:34.080833] [DEBUG] [LOCAL ] GDV: Primary data saved (20129 records). [2025-09-18T19:12:34.081184] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-18T19:12:34.081411] [INFO ] [MAIN ] Update Progress: 909/2372 symbols completed. GDV took 21.4s. Estimated remaining: 3h 33m 16s. Rate: 6.9 symbols/min [2025-09-18T19:12:34.124805] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-09-18T19:12:34.270702] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:12:34.284048] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-18T19:12:34.331835] [DEBUG] [LOCAL ] GEL: Loaded 34632 existing records from primary storage. [2025-09-18T19:12:34.332009] [INFO ] [MAIN ] GEL: Loaded 34632 existing records. [2025-09-18T19:12:34.512848] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:12:34.513126] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-18T19:12:34.513178] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-18T19:12:34.514378] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-18T19:12:34.514440] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-18T19:12:34.877470] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:12:34.919516] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-11. [2025-09-18T19:12:35.719513] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-18T19:12:35.900261] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-18T19:12:35.931779] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T19:12:36.345379] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-18T19:12:36.519561] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-18T19:12:37.319549] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-18T19:12:38.119521] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-09-18T19:12:38.168427] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-18T19:12:38.919531] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-18T19:12:38.923795] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-18T19:12:38.971158] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-18T19:12:39.719547] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-18T19:12:39.765231] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-18T19:12:40.519558] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-18T19:12:41.196739] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-18T19:12:41.319550] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-18T19:12:42.127329] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-18T19:12:42.130898] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T19:12:42.168051] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-18T19:12:42.919544] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-18T19:12:43.523566] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-18T19:12:43.719542] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-09-18T19:12:44.519564] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-18T19:12:44.707122] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-18T19:12:44.820620] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-18T19:12:45.319553] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-18T19:12:45.381183] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-18T19:12:46.119591] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-18T19:12:46.664109] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T19:12:46.919537] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-18T19:12:47.037843] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-18T19:12:47.719547] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-18T19:12:48.272739] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-18T19:12:48.519536] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-18T19:12:48.867822] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-18T19:12:49.319549] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-18T19:12:49.739636] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-18T19:12:50.119565] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-18T19:12:50.825153] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-18T19:12:50.919498] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-18T19:12:51.033795] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-18T19:12:51.719535] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-18T19:12:52.187584] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-18T19:12:52.191383] [INFO ] [REMOTE ] GEF: Full fetch complete (29325 records). [2025-09-18T19:12:52.191469] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-18T19:12:52.529371] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-18T19:12:52.579558] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-09-18T19:12:52.579664] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-09-18T19:12:52.580378] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-09-18T19:12:52.580441] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-09-18T19:12:52.581890] [DEBUG] [LOCAL ] GEF: Trimmed 29325 records to 20905 (keeping 200 days of data) [2025-09-18T19:12:52.719307] [DEBUG] [LOCAL ] GEF: Primary data saved (20905 records). [2025-09-18T19:12:52.719446] [INFO ] [MAIN ] GEF: Full history saved. [2025-09-18T19:12:52.719519] [INFO ] [MAIN ] Update Progress: 910/2372 symbols completed. GEF took 32.3s. Estimated remaining: 3h 33m 23s. Rate: 6.9 symbols/min [2025-09-18T19:12:52.890384] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:12:52.948588] [DEBUG] [LOCAL ] GENI: Loaded 52914 existing records from primary storage. [2025-09-18T19:12:52.948768] [INFO ] [MAIN ] GENI: Loaded 52914 existing records. [2025-09-18T19:12:53.135601] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:12:53.136158] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-18T19:12:53.136235] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-18T19:12:53.144254] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-18T19:12:53.156694] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-18T19:12:53.231576] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T19:12:53.282473] [INFO ] [REMOTE ] GDOT: Full fetch complete (52149 records). [2025-09-18T19:12:53.292948] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-18T19:12:53.322102] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-18T19:12:53.905969] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:12:54.066638] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T19:12:54.116139] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-09-18T19:12:54.116459] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-09-18T19:12:54.117218] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-09-18T19:12:54.117301] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-09-18T19:12:54.118836] [DEBUG] [LOCAL ] GDOT: Trimmed 52149 records to 38970 (keeping 200 days of data) [2025-09-18T19:12:54.119554] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-18T19:12:54.368488] [DEBUG] [LOCAL ] GDOT: Primary data saved (38970 records). [2025-09-18T19:12:54.368695] [INFO ] [MAIN ] GDOT: Full history saved. [2025-09-18T19:12:54.368891] [INFO ] [MAIN ] Update Progress: 911/2372 symbols completed. GDOT took 42.1s. Estimated remaining: 3h 33m 3s. Rate: 6.9 symbols/min [2025-09-18T19:12:54.539359] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:12:54.607536] [DEBUG] [LOCAL ] GEO: Loaded 52241 existing records from primary storage. [2025-09-18T19:12:54.607781] [INFO ] [MAIN ] GEO: Loaded 52241 existing records. [2025-09-18T19:12:54.783542] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:12:54.783835] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-18T19:12:54.783885] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-18T19:12:54.784964] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-18T19:12:54.785024] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-18T19:12:54.924717] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-11. [2025-09-18T19:12:55.142940] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:12:55.331507] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-18T19:12:55.449706] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T19:12:55.719574] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-11. [2025-09-18T19:12:56.406524] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-18T19:12:56.519582] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-09-18T19:12:57.319552] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-18T19:12:57.418964] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-18T19:12:58.119740] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-09-18T19:12:58.224817] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-18T19:12:58.919553] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-18T19:12:59.472748] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-18T19:12:59.719577] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-18T19:12:59.804231] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-18T19:12:59.970950] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-18T19:13:00.519588] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-09-18T19:13:01.319576] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-09-18T19:13:01.598149] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-18T19:13:02.119588] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-18T19:13:02.211745] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-18T19:13:02.823706] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-18T19:13:02.919523] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-18T19:13:03.719527] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-18T19:13:03.845341] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-18T19:13:03.853535] [INFO ] [REMOTE ] GE: Full fetch complete (77670 records). [2025-09-18T19:13:03.853742] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-18T19:13:04.255009] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-09-18T19:13:04.255175] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-09-18T19:13:04.256124] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-09-18T19:13:04.256237] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-09-18T19:13:04.258922] [DEBUG] [LOCAL ] GE: Trimmed 77670 records to 54103 (keeping 200 days of data) [2025-09-18T19:13:04.353566] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T19:13:04.522493] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-18T19:13:04.662257] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-18T19:13:04.677481] [DEBUG] [LOCAL ] GE: Primary data saved (54103 records). [2025-09-18T19:13:04.677596] [INFO ] [MAIN ] GE: Full history saved. [2025-09-18T19:13:04.677740] [INFO ] [MAIN ] Update Progress: 912/2372 symbols completed. GE took 45.5s. Estimated remaining: 3h 32m 57s. Rate: 6.9 symbols/min [2025-09-18T19:13:04.857312] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:13:04.899403] [DEBUG] [LOCAL ] GES: Loaded 40626 existing records from primary storage. [2025-09-18T19:13:04.899559] [INFO ] [MAIN ] GES: Loaded 40626 existing records. [2025-09-18T19:13:05.095615] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:13:05.096165] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-18T19:13:05.096234] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-18T19:13:05.097321] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-18T19:13:05.097384] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-18T19:13:05.329192] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-18T19:13:05.468617] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:13:06.119535] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-11. [2025-09-18T19:13:06.338400] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-18T19:13:06.919569] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-18T19:13:07.025536] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-18T19:13:07.295476] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-18T19:13:07.719593] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-09-18T19:13:08.519583] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-18T19:13:08.711403] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-18T19:13:09.150110] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-18T19:13:09.319551] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-09-18T19:13:09.868440] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-18T19:13:10.119563] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-18T19:13:10.447785] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-18T19:13:10.919545] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-18T19:13:11.522627] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-18T19:13:11.719568] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-18T19:13:12.369142] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T19:13:12.519561] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-18T19:13:12.816012] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-18T19:13:13.319612] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-18T19:13:13.640245] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T19:13:13.644346] [INFO ] [REMOTE ] GEL: Full fetch complete (48625 records). [2025-09-18T19:13:13.644445] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-18T19:13:14.046407] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-18T19:13:14.046765] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-18T19:13:14.047424] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-18T19:13:14.047486] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-18T19:13:14.050589] [DEBUG] [LOCAL ] GEL: Trimmed 48625 records to 34789 (keeping 200 days of data) [2025-09-18T19:13:14.127477] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-18T19:13:14.275059] [DEBUG] [LOCAL ] GEL: Primary data saved (34789 records). [2025-09-18T19:13:14.275200] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-18T19:13:14.275333] [INFO ] [MAIN ] Update Progress: 913/2372 symbols completed. GEL took 40.2s. Estimated remaining: 3h 32m 50s. Rate: 6.9 symbols/min [2025-09-18T19:13:14.444362] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:13:14.484554] [DEBUG] [LOCAL ] GETY: Loaded 36392 existing records from primary storage. [2025-09-18T19:13:14.484726] [INFO ] [MAIN ] GETY: Loaded 36392 existing records. [2025-09-18T19:13:14.667286] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:13:14.667787] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-18T19:13:14.667903] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-18T19:13:14.669081] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-09-18T19:13:14.669144] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-18T19:13:14.924274] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-18T19:13:15.064760] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-18T19:13:15.077925] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:13:15.668536] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-18T19:13:15.719500] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-18T19:13:16.519515] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-18T19:13:16.616542] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-18T19:13:17.016798] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T19:13:17.319580] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-11. [2025-09-18T19:13:17.990100] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-18T19:13:18.119521] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-18T19:13:18.218708] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-18T19:13:18.919554] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-18T19:13:19.554800] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-18T19:13:19.719561] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-18T19:13:20.281723] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T19:13:20.519553] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-18T19:13:21.031513] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-18T19:13:21.319557] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-09-18T19:13:22.025711] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-18T19:13:22.119607] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-18T19:13:22.250903] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-18T19:13:22.919605] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-09-18T19:13:23.719576] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-18T19:13:23.962533] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-18T19:13:23.969913] [INFO ] [REMOTE ] GENI: Full fetch complete (75253 records). [2025-09-18T19:13:23.970112] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-18T19:13:24.377959] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-18T19:13:24.378056] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-18T19:13:24.378912] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-18T19:13:24.378979] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-18T19:13:24.382677] [DEBUG] [LOCAL ] GENI: Trimmed 75253 records to 53304 (keeping 200 days of data) [2025-09-18T19:13:24.519618] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-18T19:13:24.661605] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-18T19:13:24.758276] [DEBUG] [LOCAL ] GENI: Primary data saved (53304 records). [2025-09-18T19:13:24.758435] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-18T19:13:24.758553] [INFO ] [MAIN ] Update Progress: 914/2372 symbols completed. GENI took 32.0s. Estimated remaining: 3h 32m 44s. Rate: 6.9 symbols/min [2025-09-18T19:13:24.930781] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:13:24.985455] [DEBUG] [LOCAL ] GEV: Loaded 53169 existing records from primary storage. [2025-09-18T19:13:24.985603] [INFO ] [MAIN ] GEV: Loaded 53169 existing records. [2025-09-18T19:13:25.170902] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:13:25.171207] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-18T19:13:25.171382] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-18T19:13:25.181983] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-09-18T19:13:25.195192] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-18T19:13:25.275276] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-18T19:13:25.324618] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-18T19:13:25.581872] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:13:25.931637] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-18T19:13:25.939193] [INFO ] [REMOTE ] GEO: Full fetch complete (75536 records). [2025-09-18T19:13:25.939354] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-18T19:13:26.122596] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-11. [2025-09-18T19:13:26.371419] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-18T19:13:26.371518] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-18T19:13:26.372512] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-18T19:13:26.372598] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-18T19:13:26.374539] [DEBUG] [LOCAL ] GEO: Trimmed 75536 records to 52604 (keeping 200 days of data) [2025-09-18T19:13:26.696243] [DEBUG] [LOCAL ] GEO: Primary data saved (52604 records). [2025-09-18T19:13:26.696390] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-18T19:13:26.697668] [INFO ] [MAIN ] Update Progress: 915/2372 symbols completed. GEO took 32.3s. Estimated remaining: 3h 32m 24s. Rate: 6.9 symbols/min [2025-09-18T19:13:26.868776] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:13:26.894754] [DEBUG] [LOCAL ] GF: Loaded 3513 existing records from primary storage. [2025-09-18T19:13:26.896194] [INFO ] [MAIN ] GF: Loaded 3513 existing records. [2025-09-18T19:13:26.896096] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T19:13:26.926889] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-18T19:13:27.085465] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:13:27.085751] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-18T19:13:27.085808] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-18T19:13:27.086170] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-18T19:13:27.086229] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-18T19:13:27.438092] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:13:27.719541] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-11. [2025-09-18T19:13:28.087587] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-11 (0.37 seconds). [2025-09-18T19:13:28.129198] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-11 (2.01 seconds). [2025-09-18T19:13:28.201889] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-18T19:13:28.519558] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-09-18T19:13:29.319558] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-09-18T19:13:29.736686] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-18T19:13:30.071479] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-18T19:13:30.119493] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-09-18T19:13:30.628615] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-18T19:13:30.919528] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-18T19:13:31.719552] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-18T19:13:32.135673] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-18T19:13:32.519561] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-18T19:13:32.996385] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-18T19:13:33.319559] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-18T19:13:33.573607] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-18T19:13:34.119550] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-18T19:13:34.665576] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-18T19:13:34.893248] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-18T19:13:34.919554] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-18T19:13:35.549403] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-18T19:13:35.719534] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-18T19:13:36.335247] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-18T19:13:36.519546] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-18T19:13:36.957178] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-18T19:13:37.319530] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-18T19:13:37.804403] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-18T19:13:38.119545] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-18T19:13:38.919546] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-18T19:13:39.361221] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-18T19:13:39.706117] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T19:13:39.719493] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-18T19:13:40.519552] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-18T19:13:41.054494] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T19:13:41.059923] [INFO ] [REMOTE ] GES: Full fetch complete (60267 records). [2025-09-18T19:13:41.060034] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-18T19:13:41.330351] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-09-18T19:13:41.464781] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-18T19:13:41.464858] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-18T19:13:41.465600] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-18T19:13:41.465688] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-18T19:13:41.466928] [DEBUG] [LOCAL ] GES: Trimmed 60267 records to 40812 (keeping 200 days of data) [2025-09-18T19:13:41.713741] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-18T19:13:41.744369] [DEBUG] [LOCAL ] GES: Primary data saved (40812 records). [2025-09-18T19:13:41.744513] [INFO ] [MAIN ] GES: Full history saved. [2025-09-18T19:13:41.744598] [INFO ] [MAIN ] Update Progress: 916/2372 symbols completed. GES took 37.1s. Estimated remaining: 3h 32m 25s. Rate: 6.9 symbols/min [2025-09-18T19:13:41.912878] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:13:41.943337] [DEBUG] [LOCAL ] GFF: Loaded 31214 existing records from primary storage. [2025-09-18T19:13:41.943490] [INFO ] [MAIN ] GFF: Loaded 31214 existing records. [2025-09-18T19:13:42.126198] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-18T19:13:42.126616] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:13:42.127877] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-18T19:13:42.127957] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-18T19:13:42.129413] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-09-18T19:13:42.129511] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-18T19:13:42.504405] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:13:42.919554] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-18T19:13:43.395173] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-18T19:13:43.395315] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-18T19:13:43.560583] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T19:13:43.719560] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-18T19:13:44.519540] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-18T19:13:44.976496] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-18T19:13:44.977347] [INFO ] [REMOTE ] GF: Full fetch complete (5408 records). [2025-09-18T19:13:44.977418] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-18T19:13:45.334841] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-18T19:13:45.343127] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-18T19:13:45.343417] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-18T19:13:45.364710] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-18T19:13:45.366389] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-18T19:13:45.365599] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-18T19:13:45.375071] [DEBUG] [LOCAL ] GF: Trimmed 5408 records to 3516 (keeping 200 days of data) [2025-09-18T19:13:45.396248] [DEBUG] [LOCAL ] GF: Primary data saved (3516 records). [2025-09-18T19:13:45.396326] [INFO ] [MAIN ] GF: Full history saved. [2025-09-18T19:13:45.396404] [INFO ] [MAIN ] Update Progress: 917/2372 symbols completed. GF took 18.7s. Estimated remaining: 3h 32m 8s. Rate: 6.9 symbols/min [2025-09-18T19:13:46.119547] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-11. [2025-09-18T19:13:46.919508] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-18T19:13:47.234189] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-18T19:13:47.264792] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-18T19:13:47.719552] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-18T19:13:48.057064] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T19:13:48.519582] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-09-18T19:13:49.319582] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-18T19:13:49.400530] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T19:13:49.504011] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-18T19:13:50.119557] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-18T19:13:50.361228] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-18T19:13:50.366299] [INFO ] [REMOTE ] GETY: Full fetch complete (55744 records). [2025-09-18T19:13:50.366428] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-18T19:13:50.750813] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-09-18T19:13:50.750942] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-09-18T19:13:50.751705] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-09-18T19:13:50.751772] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-09-18T19:13:50.753223] [DEBUG] [LOCAL ] GETY: Trimmed 55744 records to 36644 (keeping 200 days of data) [2025-09-18T19:13:50.930934] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-09-18T19:13:50.964152] [DEBUG] [LOCAL ] GETY: Primary data saved (36644 records). [2025-09-18T19:13:50.964315] [INFO ] [MAIN ] GETY: Full history saved. [2025-09-18T19:13:50.964422] [INFO ] [MAIN ] Update Progress: 918/2372 symbols completed. GETY took 36.7s. Estimated remaining: 3h 31m 55s. Rate: 6.9 symbols/min [2025-09-18T19:13:51.818299] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-18T19:13:51.824850] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-18T19:13:52.080881] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-18T19:13:52.519556] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-18T19:13:53.064431] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-18T19:13:53.319546] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-18T19:13:54.603322] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-18T19:13:54.611187] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-18T19:13:54.728499] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-18T19:13:54.919605] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-18T19:13:56.000392] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T19:13:56.008471] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-18T19:13:56.753302] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-18T19:13:56.764665] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-18T19:13:57.167766] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-18T19:13:57.319606] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-18T19:13:58.447581] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-18T19:13:58.453868] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-18T19:13:58.931958] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-18T19:13:58.943978] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-18T19:13:59.344284] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-18T19:13:59.719564] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-18T19:14:00.851841] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-18T19:14:00.860229] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-18T19:14:01.155417] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-18T19:14:01.319582] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-18T19:14:01.935067] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-18T19:14:01.939628] [INFO ] [REMOTE ] GFF: Full fetch complete (44264 records). [2025-09-18T19:14:01.939842] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-18T19:14:02.373043] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-09-18T19:14:02.373152] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-09-18T19:14:02.374029] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-09-18T19:14:02.374097] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-09-18T19:14:02.375406] [DEBUG] [LOCAL ] GFF: Trimmed 44264 records to 31421 (keeping 200 days of data) [2025-09-18T19:14:02.596399] [DEBUG] [LOCAL ] GFF: Primary data saved (31421 records). [2025-09-18T19:14:02.596616] [INFO ] [MAIN ] GFF: Full history saved. [2025-09-18T19:14:02.596767] [INFO ] [MAIN ] Update Progress: 919/2372 symbols completed. GFF took 20.9s. Estimated remaining: 3h 31m 50s. Rate: 6.9 symbols/min [2025-09-18T19:14:03.622307] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-18T19:14:03.630610] [INFO ] [REMOTE ] GEV: Full fetch complete (76885 records). [2025-09-18T19:14:03.630905] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-18T19:14:04.051175] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-09-18T19:14:04.051313] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-09-18T19:14:04.052626] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-09-18T19:14:04.052726] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-09-18T19:14:04.055048] [DEBUG] [LOCAL ] GEV: Trimmed 76885 records to 53548 (keeping 200 days of data) [2025-09-18T19:14:04.423094] [DEBUG] [LOCAL ] GEV: Primary data saved (53548 records). [2025-09-18T19:14:04.423386] [INFO ] [MAIN ] GEV: Full history saved. [2025-09-18T19:14:04.425243] [INFO ] [MAIN ] Update Progress: 920/2372 symbols completed. GEV took 39.7s. Estimated remaining: 3h 31m 31s. Rate: 6.9 symbols/min [2025-09-18T19:14:05.112005] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:14:05.253255] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:14:05.248847] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:14:05.275961] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:14:05.290037] [DEBUG] [LOCAL ] GFR: Loaded 8558 existing records from primary storage. [2025-09-18T19:14:05.290458] [INFO ] [MAIN ] GFR: Loaded 8558 existing records. [2025-09-18T19:14:05.533403] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:14:05.534791] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-18T19:14:05.534907] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-18T19:14:05.535275] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-09-18T19:14:05.535374] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-18T19:14:05.671231] [DEBUG] [LOCAL ] GGB: Loaded 50997 existing records from primary storage. [2025-09-18T19:14:05.711751] [DEBUG] [LOCAL ] GFI: Loaded 53094 existing records from primary storage. [2025-09-18T19:14:05.705347] [INFO ] [MAIN ] GGB: Loaded 50997 existing records. [2025-09-18T19:14:05.729317] [INFO ] [MAIN ] GFI: Loaded 53094 existing records. [2025-09-18T19:14:05.718465] [DEBUG] [LOCAL ] GFL: Loaded 48221 existing records from primary storage. [2025-09-18T19:14:05.829811] [INFO ] [MAIN ] GFL: Loaded 48221 existing records. [2025-09-18T19:14:06.603175] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:14:06.608374] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:14:06.632636] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-18T19:14:06.631155] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-11. [2025-09-18T19:14:06.607424] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:14:06.637029] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:14:06.638592] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-18T19:14:06.639418] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-18T19:14:06.639707] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-18T19:14:06.639916] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-18T19:14:06.640174] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-18T19:14:06.641181] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-18T19:14:06.641290] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-18T19:14:06.654116] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-18T19:14:06.654267] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-18T19:14:06.671993] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-18T19:14:06.678037] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-18T19:14:07.698302] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:14:07.719251] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-11. [2025-09-18T19:14:07.822218] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:14:07.846576] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-11. [2025-09-18T19:14:07.846045] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:14:07.848454] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-11. [2025-09-18T19:14:07.861080] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-18T19:14:07.865154] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-09-18T19:14:08.762152] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-18T19:14:08.767306] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-09-18T19:14:09.010898] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-18T19:14:09.020107] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-09-18T19:14:09.165606] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-18T19:14:09.175617] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-09-18T19:14:09.282301] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-18T19:14:09.285089] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-18T19:14:09.434458] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-18T19:14:09.445062] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-09-18T19:14:09.726595] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-18T19:14:10.119567] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-18T19:14:10.164972] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-18T19:14:10.674422] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T19:14:10.883374] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-18T19:14:10.900794] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-18T19:14:10.919488] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-09-18T19:14:11.719551] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-18T19:14:12.519611] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-09-18T19:14:12.552907] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-18T19:14:12.802441] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-18T19:14:13.319541] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-18T19:14:13.786325] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-18T19:14:14.119553] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-18T19:14:14.715090] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-18T19:14:14.920469] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-18T19:14:14.931705] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-18T19:14:15.398334] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-18T19:14:15.719595] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-18T19:14:16.519567] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-18T19:14:17.319599] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-09-18T19:14:17.800197] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-18T19:14:17.880410] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-18T19:14:18.119542] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-18T19:14:18.875504] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-18T19:14:18.919492] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-18T19:14:19.719725] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-18T19:14:19.912378] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-18T19:14:20.164126] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-18T19:14:20.266893] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T19:14:20.519545] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-18T19:14:21.104469] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-18T19:14:21.319553] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-18T19:14:22.119593] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-18T19:14:22.919513] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-18T19:14:23.108530] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-18T19:14:23.295113] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-18T19:14:23.719800] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-18T19:14:24.519544] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-18T19:14:24.696572] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-18T19:14:25.002754] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-18T19:14:25.004269] [INFO ] [REMOTE ] GFR: Full fetch complete (13095 records). [2025-09-18T19:14:25.004345] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-18T19:14:25.333518] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-18T19:14:25.378478] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-09-18T19:14:25.378588] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-09-18T19:14:25.379030] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-09-18T19:14:25.379172] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-09-18T19:14:25.380025] [DEBUG] [LOCAL ] GFR: Trimmed 13095 records to 8593 (keeping 200 days of data) [2025-09-18T19:14:25.428293] [DEBUG] [LOCAL ] GFR: Primary data saved (8593 records). [2025-09-18T19:14:25.428517] [INFO ] [MAIN ] GFR: Full history saved. [2025-09-18T19:14:25.428702] [INFO ] [MAIN ] Update Progress: 921/2372 symbols completed. GFR took 21.0s. Estimated remaining: 3h 31m 41s. Rate: 6.9 symbols/min [2025-09-18T19:14:25.632123] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-18T19:14:25.634634] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:14:25.692128] [DEBUG] [LOCAL ] GGG: Loaded 41146 existing records from primary storage. [2025-09-18T19:14:25.692271] [INFO ] [MAIN ] GGG: Loaded 41146 existing records. [2025-09-18T19:14:25.888359] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:14:25.888718] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-18T19:14:25.888791] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-18T19:14:25.889747] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-18T19:14:25.889813] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-18T19:14:26.124672] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-18T19:14:26.269962] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:14:26.919543] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-11. [2025-09-18T19:14:27.030859] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-18T19:14:27.497357] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T19:14:27.719551] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-18T19:14:28.083280] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-18T19:14:28.519551] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-18T19:14:29.319615] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-09-18T19:14:29.438110] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-18T19:14:30.027535] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-18T19:14:30.119532] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-18T19:14:30.511223] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-18T19:14:30.919565] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-18T19:14:31.719591] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-18T19:14:32.027227] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-18T19:14:32.483193] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-18T19:14:32.519507] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-18T19:14:33.062870] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T19:14:33.319547] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-18T19:14:33.707352] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-18T19:14:34.119539] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-09-18T19:14:34.919562] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-18T19:14:35.220044] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-18T19:14:35.286690] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T19:14:35.719563] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-18T19:14:36.519554] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-18T19:14:36.717610] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-18T19:14:37.319553] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-18T19:14:37.373910] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-18T19:14:37.469529] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-18T19:14:38.119540] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-18T19:14:38.919565] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-18T19:14:39.115631] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-18T19:14:39.122918] [INFO ] [REMOTE ] GFI: Full fetch complete (76070 records). [2025-09-18T19:14:39.123060] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-18T19:14:39.470599] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-18T19:14:39.510120] [INFO ] [REMOTE ] GGB: Full fetch complete (73812 records). [2025-09-18T19:14:39.525524] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-18T19:14:39.583479] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-18T19:14:39.595353] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-18T19:14:39.630203] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-18T19:14:39.646950] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-18T19:14:39.685381] [DEBUG] [LOCAL ] GFI: Trimmed 76070 records to 53483 (keeping 200 days of data) [2025-09-18T19:14:39.719995] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-18T19:14:40.073617] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-18T19:14:40.074667] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-18T19:14:40.080252] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-18T19:14:40.080361] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-18T19:14:40.086776] [DEBUG] [LOCAL ] GGB: Trimmed 73812 records to 51382 (keeping 200 days of data) [2025-09-18T19:14:40.334141] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-18T19:14:40.521410] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-18T19:14:40.682619] [DEBUG] [LOCAL ] GFI: Primary data saved (53483 records). [2025-09-18T19:14:40.683723] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-18T19:14:40.683922] [INFO ] [MAIN ] Update Progress: 922/2372 symbols completed. GFI took 36.3s. Estimated remaining: 3h 31m 43s. Rate: 6.8 symbols/min [2025-09-18T19:14:40.802153] [DEBUG] [LOCAL ] GGB: Primary data saved (51382 records). [2025-09-18T19:14:40.802669] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-18T19:14:40.808255] [INFO ] [MAIN ] Update Progress: 923/2372 symbols completed. GGB took 36.4s. Estimated remaining: 3h 31m 21s. Rate: 6.9 symbols/min [2025-09-18T19:14:40.982826] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:14:41.059848] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:14:41.065308] [DEBUG] [LOCAL ] GGT: Loaded 14143 existing records from primary storage. [2025-09-18T19:14:41.065761] [INFO ] [MAIN ] GGT: Loaded 14143 existing records. [2025-09-18T19:14:41.161749] [DEBUG] [LOCAL ] GGZ: Loaded 2481 existing records from primary storage. [2025-09-18T19:14:41.172881] [INFO ] [MAIN ] GGZ: Loaded 2481 existing records. [2025-09-18T19:14:41.395460] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:14:41.430786] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-18T19:14:41.455435] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:14:41.455789] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-18T19:14:41.456175] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-18T19:14:41.456279] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-18T19:14:41.456606] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-18T19:14:41.456700] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-18T19:14:41.456734] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-09-18T19:14:41.468055] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-18T19:14:41.840804] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-18T19:14:41.983504] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-18T19:14:42.195894] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:14:42.211022] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-11. [2025-09-18T19:14:42.281916] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:14:42.310046] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-18T19:14:42.687206] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-18T19:14:42.919544] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-18T19:14:43.719511] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-09-18T19:14:43.750199] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-18T19:14:43.758797] [INFO ] [REMOTE ] GFL: Full fetch complete (68510 records). [2025-09-18T19:14:43.758920] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-18T19:14:44.171262] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-18T19:14:44.172016] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-18T19:14:44.171877] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-18T19:14:44.174963] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-18T19:14:44.175064] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-18T19:14:44.176509] [DEBUG] [LOCAL ] GFL: Trimmed 68510 records to 48534 (keeping 200 days of data) [2025-09-18T19:14:44.291980] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T19:14:44.522594] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-09-18T19:14:44.525945] [DEBUG] [LOCAL ] GFL: Primary data saved (48534 records). [2025-09-18T19:14:44.526023] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-18T19:14:44.526114] [INFO ] [MAIN ] Update Progress: 924/2372 symbols completed. GFL took 40.1s. Estimated remaining: 3h 31m 4s. Rate: 6.9 symbols/min [2025-09-18T19:14:44.701341] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:14:44.705740] [DEBUG] [LOCAL ] GHC: Loaded 2583 existing records from primary storage. [2025-09-18T19:14:44.705820] [INFO ] [MAIN ] GHC: Loaded 2583 existing records. [2025-09-18T19:14:44.881343] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:14:44.881563] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-18T19:14:44.881610] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-18T19:14:44.881902] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-09-18T19:14:44.881963] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-18T19:14:45.165409] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-18T19:14:45.246683] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:14:45.319525] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-11. [2025-09-18T19:14:45.634245] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-11 (0.31 seconds). [2025-09-18T19:14:46.119527] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-18T19:14:46.467679] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-18T19:14:46.919535] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-09-18T19:14:47.347798] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-18T19:14:47.719538] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-18T19:14:48.176373] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-18T19:14:48.519525] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-09-18T19:14:48.956704] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-18T19:14:49.319604] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-11. [2025-09-18T19:14:49.741677] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-18T19:14:50.119594] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-09-18T19:14:50.660671] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-18T19:14:50.919577] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-09-18T19:14:51.564362] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-18T19:14:51.719560] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-18T19:14:52.305108] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-18T19:14:52.519532] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-18T19:14:53.319546] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-18T19:14:53.729557] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-18T19:14:53.888319] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-18T19:14:54.119596] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-18T19:14:54.806563] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-18T19:14:54.919558] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-18T19:14:55.333397] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-18T19:14:55.719570] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-18T19:14:56.519574] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-18T19:14:56.940366] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-18T19:14:57.100766] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-18T19:14:57.319545] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-18T19:14:58.119623] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-18T19:14:58.330733] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-18T19:14:58.555302] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-18T19:14:58.919577] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-18T19:14:59.719559] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-18T19:15:00.380872] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T19:15:00.386911] [INFO ] [REMOTE ] GGG: Full fetch complete (59180 records). [2025-09-18T19:15:00.387107] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-18T19:15:00.524632] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-18T19:15:00.828739] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-09-18T19:15:00.828491] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-18T19:15:00.829043] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-09-18T19:15:00.830882] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-09-18T19:15:00.835905] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-09-18T19:15:00.837992] [DEBUG] [LOCAL ] GGG: Trimmed 59180 records to 41430 (keeping 200 days of data) [2025-09-18T19:15:01.083138] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-18T19:15:01.116191] [DEBUG] [LOCAL ] GGG: Primary data saved (41430 records). [2025-09-18T19:15:01.116365] [INFO ] [MAIN ] GGG: Full history saved. [2025-09-18T19:15:01.116606] [INFO ] [MAIN ] Update Progress: 925/2372 symbols completed. GGG took 35.7s. Estimated remaining: 3h 31m 7s. Rate: 6.9 symbols/min [2025-09-18T19:15:01.310361] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:15:01.315864] [DEBUG] [LOCAL ] GHG: Loaded 3138 existing records from primary storage. [2025-09-18T19:15:01.316003] [INFO ] [MAIN ] GHG: Loaded 3138 existing records. [2025-09-18T19:15:01.327299] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-18T19:15:01.515853] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:15:01.516114] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-18T19:15:01.516164] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-18T19:15:01.516399] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-09-18T19:15:01.516471] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-18T19:15:01.930265] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:15:02.119573] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-18T19:15:02.585045] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-18T19:15:02.919574] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-18T19:15:03.719584] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-11. [2025-09-18T19:15:04.214208] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-18T19:15:04.519578] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-18T19:15:05.034048] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-18T19:15:05.060705] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-18T19:15:05.134446] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-18T19:15:05.319572] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-18T19:15:05.911787] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-18T19:15:06.119570] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-18T19:15:06.644979] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-18T19:15:06.919549] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-18T19:15:07.376262] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-18T19:15:07.719559] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-09-18T19:15:08.255609] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-18T19:15:08.519541] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-09-18T19:15:08.913308] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-18T19:15:09.319615] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-18T19:15:09.617690] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-18T19:15:10.119534] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-18T19:15:10.598116] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-18T19:15:10.919563] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-18T19:15:11.719577] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-18T19:15:12.076588] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-18T19:15:12.464233] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T19:15:12.465258] [INFO ] [REMOTE ] GGZ: Full fetch complete (4126 records). [2025-09-18T19:15:12.465389] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-18T19:15:12.530008] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-18T19:15:12.869349] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-18T19:15:12.869436] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-18T19:15:12.869679] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-18T19:15:12.869742] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-18T19:15:12.870516] [DEBUG] [LOCAL ] GGZ: Trimmed 4126 records to 2499 (keeping 200 days of data) [2025-09-18T19:15:12.889370] [DEBUG] [LOCAL ] GGZ: Primary data saved (2499 records). [2025-09-18T19:15:12.889536] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-18T19:15:12.889760] [INFO ] [MAIN ] Update Progress: 926/2372 symbols completed. GGZ took 32.1s. Estimated remaining: 3h 31m 3s. Rate: 6.9 symbols/min [2025-09-18T19:15:13.069946] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:15:13.086663] [DEBUG] [LOCAL ] GHI: Loaded 6993 existing records from primary storage. [2025-09-18T19:15:13.086820] [INFO ] [MAIN ] GHI: Loaded 6993 existing records. [2025-09-18T19:15:13.273924] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:15:13.274189] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-18T19:15:13.274250] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-18T19:15:13.274611] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-18T19:15:13.274708] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-18T19:15:13.324886] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-09-18T19:15:13.593067] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-18T19:15:13.673073] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:15:14.119572] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-18T19:15:14.471057] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-18T19:15:14.614895] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-18T19:15:14.919566] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-18T19:15:15.589985] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-18T19:15:15.591113] [INFO ] [REMOTE ] GHC: Full fetch complete (3215 records). [2025-09-18T19:15:15.591193] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-18T19:15:15.724707] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-09-18T19:15:15.959348] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-09-18T19:15:15.959426] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-09-18T19:15:15.959537] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-09-18T19:15:15.959614] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-09-18T19:15:15.960192] [DEBUG] [LOCAL ] GHC: Trimmed 3215 records to 2622 (keeping 200 days of data) [2025-09-18T19:15:15.977442] [DEBUG] [LOCAL ] GHC: Primary data saved (2622 records). [2025-09-18T19:15:15.977516] [INFO ] [MAIN ] GHC: Full history saved. [2025-09-18T19:15:15.977627] [INFO ] [MAIN ] Update Progress: 927/2372 symbols completed. GHC took 31.5s. Estimated remaining: 3h 30m 46s. Rate: 6.9 symbols/min [2025-09-18T19:15:16.145691] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:15:16.157702] [DEBUG] [LOCAL ] GHLD: Loaded 4031 existing records from primary storage. [2025-09-18T19:15:16.157805] [INFO ] [MAIN ] GHLD: Loaded 4031 existing records. [2025-09-18T19:15:16.346755] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:15:16.347294] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-18T19:15:16.347354] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-18T19:15:16.347764] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-18T19:15:16.347836] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-18T19:15:16.525911] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-11. [2025-09-18T19:15:16.726141] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:15:16.735635] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-18T19:15:17.319557] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-11. [2025-09-18T19:15:17.330687] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-18T19:15:17.709125] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-11 (0.39 seconds). [2025-09-18T19:15:18.119544] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-09-18T19:15:18.426009] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-18T19:15:18.919548] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-18T19:15:19.719582] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-09-18T19:15:19.780017] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-18T19:15:19.783135] [INFO ] [REMOTE ] GGT: Full fetch complete (18606 records). [2025-09-18T19:15:19.783273] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-09-18T19:15:20.198392] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-09-18T19:15:20.198486] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-09-18T19:15:20.198964] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-09-18T19:15:20.199028] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-09-18T19:15:20.199705] [DEBUG] [LOCAL ] GGT: Trimmed 18606 records to 14214 (keeping 200 days of data) [2025-09-18T19:15:20.295477] [DEBUG] [LOCAL ] GGT: Primary data saved (14214 records). [2025-09-18T19:15:20.295614] [INFO ] [MAIN ] GGT: Full history saved. [2025-09-18T19:15:20.295738] [INFO ] [MAIN ] Update Progress: 928/2372 symbols completed. GGT took 39.6s. Estimated remaining: 3h 30m 30s. Rate: 6.9 symbols/min [2025-09-18T19:15:20.479976] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:15:20.498726] [DEBUG] [LOCAL ] GHM: Loaded 14280 existing records from primary storage. [2025-09-18T19:15:20.498870] [INFO ] [MAIN ] GHM: Loaded 14280 existing records. [2025-09-18T19:15:20.530810] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-09-18T19:15:20.694800] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:15:20.695490] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-18T19:15:20.695668] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-18T19:15:20.703883] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-18T19:15:20.706211] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-18T19:15:20.706547] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-18T19:15:21.059346] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-18T19:15:21.094427] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:15:21.319547] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-11. [2025-09-18T19:15:22.016937] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-18T19:15:22.119580] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-18T19:15:22.542217] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-18T19:15:22.919555] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-18T19:15:23.354744] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-18T19:15:23.719588] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-18T19:15:24.123780] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-18T19:15:24.519616] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-18T19:15:25.074385] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-18T19:15:25.319556] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-18T19:15:25.785956] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-18T19:15:26.119598] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-18T19:15:26.561038] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-18T19:15:26.919598] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-18T19:15:27.413861] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-18T19:15:27.719541] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-09-18T19:15:28.383626] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-18T19:15:28.519531] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-09-18T19:15:29.152304] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-18T19:15:29.319557] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-09-18T19:15:29.886147] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-18T19:15:30.119542] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-18T19:15:30.887562] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-18T19:15:30.919568] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-18T19:15:31.560174] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-18T19:15:31.719580] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-18T19:15:32.398531] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-18T19:15:32.400216] [INFO ] [REMOTE ] GHG: Full fetch complete (3945 records). [2025-09-18T19:15:32.400524] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-18T19:15:32.524751] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-18T19:15:32.845429] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-09-18T19:15:32.845543] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-09-18T19:15:32.845773] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-09-18T19:15:32.845857] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-09-18T19:15:32.846302] [DEBUG] [LOCAL ] GHG: Trimmed 3945 records to 3161 (keeping 200 days of data) [2025-09-18T19:15:32.865313] [DEBUG] [LOCAL ] GHG: Primary data saved (3161 records). [2025-09-18T19:15:32.865446] [INFO ] [MAIN ] GHG: Full history saved. [2025-09-18T19:15:32.865669] [INFO ] [MAIN ] Update Progress: 929/2372 symbols completed. GHG took 31.7s. Estimated remaining: 3h 30m 27s. Rate: 6.9 symbols/min [2025-09-18T19:15:33.049163] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:15:33.076437] [DEBUG] [LOCAL ] GHY: Loaded 21197 existing records from primary storage. [2025-09-18T19:15:33.076573] [INFO ] [MAIN ] GHY: Loaded 21197 existing records. [2025-09-18T19:15:33.262793] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:15:33.263794] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-18T19:15:33.266612] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-18T19:15:33.266714] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-18T19:15:33.267596] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-18T19:15:33.267681] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-18T19:15:33.329021] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-18T19:15:33.633253] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:15:33.902163] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-18T19:15:34.119606] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-18T19:15:34.830112] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-18T19:15:34.919550] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-18T19:15:35.404261] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-18T19:15:35.719566] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-18T19:15:36.519541] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-18T19:15:36.813978] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-18T19:15:37.076175] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-18T19:15:37.319549] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-18T19:15:37.756747] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-18T19:15:38.119568] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-18T19:15:38.919560] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-18T19:15:38.946278] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-18T19:15:39.404906] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-18T19:15:39.719571] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-18T19:15:40.260496] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-18T19:15:40.519544] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-18T19:15:41.124741] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-18T19:15:41.319556] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-18T19:15:42.100597] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-18T19:15:42.119525] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-18T19:15:42.919541] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-18T19:15:43.198833] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-18T19:15:43.508821] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-18T19:15:43.510226] [INFO ] [REMOTE ] GHI: Full fetch complete (11793 records). [2025-09-18T19:15:43.510313] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-18T19:15:43.725810] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-18T19:15:43.890118] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-18T19:15:43.890226] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-18T19:15:43.890571] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-18T19:15:43.890635] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-18T19:15:43.891136] [DEBUG] [LOCAL ] GHI: Trimmed 11793 records to 7029 (keeping 200 days of data) [2025-09-18T19:15:43.937714] [DEBUG] [LOCAL ] GHI: Primary data saved (7029 records). [2025-09-18T19:15:43.937848] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-18T19:15:43.937940] [INFO ] [MAIN ] Update Progress: 930/2372 symbols completed. GHI took 31.0s. Estimated remaining: 3h 30m 22s. Rate: 6.9 symbols/min [2025-09-18T19:15:44.110586] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:15:44.159839] [DEBUG] [LOCAL ] GIB: Loaded 32454 existing records from primary storage. [2025-09-18T19:15:44.159990] [INFO ] [MAIN ] GIB: Loaded 32454 existing records. [2025-09-18T19:15:44.341291] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:15:44.341538] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-18T19:15:44.341587] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-18T19:15:44.342822] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-18T19:15:44.342884] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-18T19:15:44.533309] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-18T19:15:44.582811] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-18T19:15:44.733182] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:15:45.319515] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-11. [2025-09-18T19:15:45.592100] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-18T19:15:46.107266] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-18T19:15:46.119485] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-09-18T19:15:46.919578] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-18T19:15:47.120339] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-18T19:15:47.449432] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-18T19:15:47.450738] [INFO ] [REMOTE ] GHLD: Full fetch complete (4647 records). [2025-09-18T19:15:47.450809] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-18T19:15:47.726387] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-11. [2025-09-18T19:15:47.811871] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-18T19:15:47.811946] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-18T19:15:47.812094] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-18T19:15:47.812172] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-18T19:15:47.812553] [DEBUG] [LOCAL ] GHLD: Trimmed 4647 records to 4056 (keeping 200 days of data) [2025-09-18T19:15:47.837242] [DEBUG] [LOCAL ] GHLD: Primary data saved (4056 records). [2025-09-18T19:15:47.837310] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-18T19:15:47.837399] [INFO ] [MAIN ] Update Progress: 931/2372 symbols completed. GHLD took 31.9s. Estimated remaining: 3h 30m 6s. Rate: 6.9 symbols/min [2025-09-18T19:15:48.009530] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:15:48.027385] [DEBUG] [LOCAL ] GIC: Loaded 13876 existing records from primary storage. [2025-09-18T19:15:48.027525] [INFO ] [MAIN ] GIC: Loaded 13876 existing records. [2025-09-18T19:15:48.205220] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:15:48.205459] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-18T19:15:48.205516] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-18T19:15:48.206096] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-09-18T19:15:48.206156] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-18T19:15:48.524640] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-18T19:15:48.565020] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:15:48.635891] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-18T19:15:49.319578] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-11. [2025-09-18T19:15:49.493420] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-18T19:15:49.924612] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-18T19:15:50.119542] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-18T19:15:50.919617] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-09-18T19:15:51.049122] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-18T19:15:51.052228] [INFO ] [REMOTE ] GHM: Full fetch complete (21442 records). [2025-09-18T19:15:51.052534] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-18T19:15:51.427432] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-18T19:15:51.427521] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-18T19:15:51.428028] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-18T19:15:51.428093] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-18T19:15:51.428788] [DEBUG] [LOCAL ] GHM: Trimmed 21442 records to 14400 (keeping 200 days of data) [2025-09-18T19:15:51.513342] [DEBUG] [LOCAL ] GHM: Primary data saved (14400 records). [2025-09-18T19:15:51.513494] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-18T19:15:51.513600] [INFO ] [MAIN ] Update Progress: 932/2372 symbols completed. GHM took 31.2s. Estimated remaining: 3h 29m 49s. Rate: 6.9 symbols/min [2025-09-18T19:15:51.695170] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:15:51.719583] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-09-18T19:15:51.755838] [DEBUG] [LOCAL ] GIL: Loaded 43027 existing records from primary storage. [2025-09-18T19:15:51.755985] [INFO ] [MAIN ] GIL: Loaded 43027 existing records. [2025-09-18T19:15:51.945332] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:15:51.945774] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-18T19:15:51.945883] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-18T19:15:51.953038] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-18T19:15:51.962788] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-18T19:15:51.998887] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-18T19:15:52.366966] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:15:52.519507] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-09-18T19:15:52.700452] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-18T19:15:53.319597] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-18T19:15:53.873518] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-18T19:15:53.943892] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-18T19:15:54.119588] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-18T19:15:54.919590] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-11. [2025-09-18T19:15:55.195190] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-18T19:15:55.719570] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-18T19:15:56.162789] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-18T19:15:56.519555] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-09-18T19:15:57.015140] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-18T19:15:57.319585] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-18T19:15:57.714869] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-18T19:15:58.054483] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-18T19:15:58.119503] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-18T19:15:58.887685] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-18T19:15:58.919510] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-18T19:15:59.719575] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-09-18T19:15:59.860802] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-18T19:16:00.476554] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-18T19:16:00.519555] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-18T19:16:01.319581] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-18T19:16:01.494063] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-18T19:16:02.119548] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-18T19:16:02.813997] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-18T19:16:02.873047] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-18T19:16:02.919545] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-18T19:16:03.719604] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-18T19:16:03.771559] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-18T19:16:03.774411] [INFO ] [REMOTE ] GHY: Full fetch complete (31895 records). [2025-09-18T19:16:03.774536] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-18T19:16:04.158881] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-18T19:16:04.158983] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-18T19:16:04.159566] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-18T19:16:04.159612] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-18T19:16:04.160624] [DEBUG] [LOCAL ] GHY: Trimmed 31895 records to 21293 (keeping 200 days of data) [2025-09-18T19:16:04.299524] [DEBUG] [LOCAL ] GHY: Primary data saved (21293 records). [2025-09-18T19:16:04.299692] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-18T19:16:04.299806] [INFO ] [MAIN ] Update Progress: 933/2372 symbols completed. GHY took 31.4s. Estimated remaining: 3h 29m 47s. Rate: 6.9 symbols/min [2025-09-18T19:16:04.470825] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:16:04.524041] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-09-18T19:16:04.526216] [DEBUG] [LOCAL ] GIS: Loaded 53674 existing records from primary storage. [2025-09-18T19:16:04.526485] [INFO ] [MAIN ] GIS: Loaded 53674 existing records. [2025-09-18T19:16:04.709428] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:16:04.709724] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-18T19:16:04.709781] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-18T19:16:04.711265] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-18T19:16:04.711328] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-18T19:16:05.102762] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:16:05.304034] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T19:16:05.319495] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-11. [2025-09-18T19:16:05.361403] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T19:16:06.119561] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-18T19:16:06.824335] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-18T19:16:06.826197] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-18T19:16:06.919557] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-18T19:16:07.719586] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-09-18T19:16:07.910930] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-18T19:16:08.519561] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-09-18T19:16:09.327365] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-09-18T19:16:09.356512] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-18T19:16:09.722897] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T19:16:10.119530] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-09-18T19:16:10.419459] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-18T19:16:10.919570] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-18T19:16:11.500352] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T19:16:11.719555] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-18T19:16:12.048608] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-18T19:16:12.519602] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-18T19:16:13.193477] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-18T19:16:13.319563] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-18T19:16:13.901993] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T19:16:14.119575] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-18T19:16:14.919507] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-18T19:16:15.058187] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-18T19:16:15.135346] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-18T19:16:15.719548] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-18T19:16:16.197124] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-18T19:16:16.519565] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-18T19:16:16.580951] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-18T19:16:17.319583] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-09-18T19:16:17.943921] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-18T19:16:18.121399] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-09-18T19:16:18.127030] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-18T19:16:18.919555] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-18T19:16:18.990327] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-18T19:16:19.719618] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-09-18T19:16:20.519601] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-18T19:16:20.555965] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-18T19:16:20.761560] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-18T19:16:21.319558] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-18T19:16:21.915038] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T19:16:22.119584] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-09-18T19:16:22.465742] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-18T19:16:22.919593] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-18T19:16:22.950639] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-18T19:16:23.719585] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-09-18T19:16:24.505600] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T19:16:24.521364] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-18T19:16:24.524564] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-18T19:16:24.528583] [INFO ] [REMOTE ] GIC: Full fetch complete (20268 records). [2025-09-18T19:16:24.528700] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-09-18T19:16:24.916865] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-09-18T19:16:24.916957] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-09-18T19:16:24.917432] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-09-18T19:16:24.917475] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-09-18T19:16:24.918133] [DEBUG] [LOCAL ] GIC: Trimmed 20268 records to 13973 (keeping 200 days of data) [2025-09-18T19:16:25.010303] [DEBUG] [LOCAL ] GIC: Primary data saved (13973 records). [2025-09-18T19:16:25.010449] [INFO ] [MAIN ] GIC: Full history saved. [2025-09-18T19:16:25.010543] [INFO ] [MAIN ] Update Progress: 934/2372 symbols completed. GIC took 37.2s. Estimated remaining: 3h 29m 56s. Rate: 6.8 symbols/min [2025-09-18T19:16:25.181530] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:16:25.229986] [DEBUG] [LOCAL ] GKOS: Loaded 43146 existing records from primary storage. [2025-09-18T19:16:25.230135] [INFO ] [MAIN ] GKOS: Loaded 43146 existing records. [2025-09-18T19:16:25.324686] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-18T19:16:25.430751] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:16:25.431042] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-18T19:16:25.431131] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-18T19:16:25.432357] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-18T19:16:25.432418] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-18T19:16:25.821481] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:16:25.817552] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-18T19:16:25.826353] [INFO ] [REMOTE ] GIB: Full fetch complete (44836 records). [2025-09-18T19:16:25.826441] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-18T19:16:26.119544] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-11. [2025-09-18T19:16:26.211082] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-18T19:16:26.211163] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-18T19:16:26.211815] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-18T19:16:26.211879] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-18T19:16:26.213060] [DEBUG] [LOCAL ] GIB: Trimmed 44836 records to 32695 (keeping 200 days of data) [2025-09-18T19:16:26.429142] [DEBUG] [LOCAL ] GIB: Primary data saved (32695 records). [2025-09-18T19:16:26.429294] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-18T19:16:26.429381] [INFO ] [MAIN ] Update Progress: 935/2372 symbols completed. GIB took 42.5s. Estimated remaining: 3h 29m 36s. Rate: 6.9 symbols/min [2025-09-18T19:16:26.599703] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:16:26.646017] [DEBUG] [LOCAL ] GL: Loaded 38287 existing records from primary storage. [2025-09-18T19:16:26.646185] [INFO ] [MAIN ] GL: Loaded 38287 existing records. [2025-09-18T19:16:26.831022] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:16:26.831261] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-18T19:16:26.831320] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-18T19:16:26.832545] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-18T19:16:26.832608] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-18T19:16:26.931774] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-18T19:16:27.219624] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:16:27.271407] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-18T19:16:27.303563] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-18T19:16:27.719554] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-18T19:16:28.107496] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-18T19:16:28.519552] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-18T19:16:29.319524] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-09-18T19:16:29.354991] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T19:16:29.537680] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-18T19:16:30.119535] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-11. [2025-09-18T19:16:30.367519] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T19:16:30.919551] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-09-18T19:16:31.652684] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-18T19:16:31.719543] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-09-18T19:16:32.029084] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-18T19:16:32.519567] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-18T19:16:32.981243] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-18T19:16:33.319551] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-18T19:16:33.475559] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-18T19:16:34.119555] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-18T19:16:34.919555] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-18T19:16:35.067414] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-18T19:16:35.075602] [INFO ] [REMOTE ] GIS: Full fetch complete (77495 records). [2025-09-18T19:16:35.075830] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-18T19:16:35.578193] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-18T19:16:35.578378] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-18T19:16:35.579592] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-18T19:16:35.580534] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-18T19:16:35.582713] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-18T19:16:35.593893] [DEBUG] [LOCAL ] GIS: Trimmed 77495 records to 54064 (keeping 200 days of data) [2025-09-18T19:16:35.719757] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-09-18T19:16:35.936240] [DEBUG] [LOCAL ] GIS: Primary data saved (54064 records). [2025-09-18T19:16:35.936410] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-18T19:16:35.936525] [INFO ] [MAIN ] Update Progress: 936/2372 symbols completed. GIS took 31.6s. Estimated remaining: 3h 29m 29s. Rate: 6.9 symbols/min [2025-09-18T19:16:36.115145] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:16:36.151005] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T19:16:36.190586] [DEBUG] [LOCAL ] GLOB: Loaded 47160 existing records from primary storage. [2025-09-18T19:16:36.190798] [INFO ] [MAIN ] GLOB: Loaded 47160 existing records. [2025-09-18T19:16:36.373410] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:16:36.373797] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-18T19:16:36.373857] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-18T19:16:36.375038] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-18T19:16:36.375100] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-18T19:16:36.524728] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-18T19:16:36.739784] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:16:36.767904] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-18T19:16:37.319553] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-11. [2025-09-18T19:16:38.119562] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-18T19:16:38.239707] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-18T19:16:38.412797] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T19:16:38.919556] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-18T19:16:39.538336] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-18T19:16:39.719557] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-18T19:16:40.120509] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-18T19:16:40.519615] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-09-18T19:16:40.829282] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-18T19:16:40.835796] [INFO ] [REMOTE ] GIL: Full fetch complete (60981 records). [2025-09-18T19:16:40.835935] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-18T19:16:41.234980] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-18T19:16:41.235110] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-18T19:16:41.235942] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-18T19:16:41.236009] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-18T19:16:41.237903] [DEBUG] [LOCAL ] GIL: Trimmed 60981 records to 43347 (keeping 200 days of data) [2025-09-18T19:16:41.330373] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-18T19:16:41.510956] [DEBUG] [LOCAL ] GIL: Primary data saved (43347 records). [2025-09-18T19:16:41.511102] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-18T19:16:41.512197] [INFO ] [MAIN ] Update Progress: 937/2372 symbols completed. GIL took 50.0s. Estimated remaining: 3h 29m 15s. Rate: 6.9 symbols/min [2025-09-18T19:16:41.690502] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:16:41.702474] [DEBUG] [LOCAL ] GLP: Loaded 9580 existing records from primary storage. [2025-09-18T19:16:41.702602] [INFO ] [MAIN ] GLP: Loaded 9580 existing records. [2025-09-18T19:16:41.895062] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-18T19:16:41.908680] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:16:41.916069] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-18T19:16:41.916176] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-18T19:16:41.916707] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-09-18T19:16:41.916773] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-18T19:16:42.126097] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-09-18T19:16:42.300238] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:16:42.843674] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T19:16:42.919549] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-18T19:16:43.373567] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T19:16:43.719547] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-11. [2025-09-18T19:16:44.233891] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-18T19:16:44.491522] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-18T19:16:44.519495] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-09-18T19:16:45.090611] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-18T19:16:45.319639] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-09-18T19:16:46.114440] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-18T19:16:46.119489] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-18T19:16:46.919571] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-18T19:16:46.975623] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-18T19:16:47.719609] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-18T19:16:48.255461] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-18T19:16:48.285854] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T19:16:48.519551] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-18T19:16:49.021989] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-18T19:16:49.319551] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-18T19:16:50.119537] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-18T19:16:50.133496] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-18T19:16:50.919574] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-18T19:16:51.460709] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-18T19:16:51.719551] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-18T19:16:52.318591] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-18T19:16:52.449566] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-18T19:16:52.519545] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-18T19:16:53.319588] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-18T19:16:53.838318] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-18T19:16:54.073130] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-18T19:16:54.119524] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-18T19:16:54.919546] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-18T19:16:55.651923] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T19:16:55.669284] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-18T19:16:55.719502] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-18T19:16:56.519592] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-18T19:16:57.096393] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T19:16:57.113125] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-18T19:16:57.115796] [INFO ] [REMOTE ] GLP: Full fetch complete (14377 records). [2025-09-18T19:16:57.115873] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-18T19:16:57.324776] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-18T19:16:57.490625] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-09-18T19:16:57.490740] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-09-18T19:16:57.491092] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-09-18T19:16:57.491153] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-09-18T19:16:57.491712] [DEBUG] [LOCAL ] GLP: Trimmed 14377 records to 9662 (keeping 200 days of data) [2025-09-18T19:16:57.550863] [DEBUG] [LOCAL ] GLP: Primary data saved (9662 records). [2025-09-18T19:16:57.551015] [INFO ] [MAIN ] GLP: Full history saved. [2025-09-18T19:16:57.551118] [INFO ] [MAIN ] Update Progress: 938/2372 symbols completed. GLP took 16.0s. Estimated remaining: 3h 29m 18s. Rate: 6.9 symbols/min [2025-09-18T19:16:57.729004] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:16:57.783747] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-09-18T19:16:57.784017] [INFO ] [MAIN ] GLW: Loaded 53635 existing records. [2025-09-18T19:16:57.960828] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:16:57.961070] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-18T19:16:57.961119] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-18T19:16:57.962471] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-18T19:16:57.962532] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-18T19:16:58.126615] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-18T19:16:58.327401] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:16:58.675081] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-18T19:16:58.919567] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-18T19:16:59.719598] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-11. [2025-09-18T19:16:59.775127] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-18T19:17:00.044500] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T19:17:00.051833] [INFO ] [REMOTE ] GL: Full fetch complete (55669 records). [2025-09-18T19:17:00.052055] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-18T19:17:00.444142] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-18T19:17:00.444235] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-18T19:17:00.444963] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-18T19:17:00.445028] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-18T19:17:00.446310] [DEBUG] [LOCAL ] GL: Trimmed 55669 records to 38494 (keeping 200 days of data) [2025-09-18T19:17:00.540885] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-18T19:17:00.712635] [DEBUG] [LOCAL ] GL: Primary data saved (38494 records). [2025-09-18T19:17:00.712916] [INFO ] [MAIN ] GL: Full history saved. [2025-09-18T19:17:00.713038] [INFO ] [MAIN ] Update Progress: 939/2372 symbols completed. GL took 34.3s. Estimated remaining: 3h 29m 0s. Rate: 6.9 symbols/min [2025-09-18T19:17:00.885521] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:17:00.945355] [DEBUG] [LOCAL ] GM: Loaded 53728 existing records from primary storage. [2025-09-18T19:17:00.945575] [INFO ] [MAIN ] GM: Loaded 53728 existing records. [2025-09-18T19:17:01.134870] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:17:01.135224] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-18T19:17:01.135303] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-18T19:17:01.136683] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-18T19:17:01.136749] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-18T19:17:01.323739] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-18T19:17:01.516851] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:17:01.550557] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-18T19:17:01.781674] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T19:17:02.119591] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-09-18T19:17:02.919552] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-11. [2025-09-18T19:17:03.700315] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-18T19:17:03.724604] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-18T19:17:03.740671] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-18T19:17:04.519544] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-09-18T19:17:04.805578] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-18T19:17:05.033874] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-18T19:17:05.319584] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-09-18T19:17:06.121195] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-18T19:17:06.127184] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T19:17:06.919610] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-18T19:17:06.988700] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-18T19:17:07.351262] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-18T19:17:07.719716] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-09-18T19:17:08.170810] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T19:17:08.519591] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-18T19:17:09.319607] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-18T19:17:09.645373] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-18T19:17:09.797109] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-18T19:17:10.119554] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-18T19:17:10.891143] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T19:17:10.919508] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-18T19:17:11.719514] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-18T19:17:12.204898] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-18T19:17:12.463208] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T19:17:12.519811] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-18T19:17:12.763134] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-18T19:17:12.773224] [INFO ] [REMOTE ] GKOS: Full fetch complete (59578 records). [2025-09-18T19:17:12.773485] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-18T19:17:13.327254] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-18T19:17:13.397958] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-18T19:17:13.398169] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-18T19:17:13.399150] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-18T19:17:13.399240] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-18T19:17:13.401069] [DEBUG] [LOCAL ] GKOS: Trimmed 59578 records to 43478 (keeping 200 days of data) [2025-09-18T19:17:13.690429] [DEBUG] [LOCAL ] GKOS: Primary data saved (43478 records). [2025-09-18T19:17:13.690588] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-18T19:17:13.690742] [INFO ] [MAIN ] Update Progress: 940/2372 symbols completed. GKOS took 48.7s. Estimated remaining: 3h 28m 58s. Rate: 6.9 symbols/min [2025-09-18T19:17:13.874536] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:17:13.932962] [DEBUG] [LOCAL ] GME: Loaded 53761 existing records from primary storage. [2025-09-18T19:17:13.933135] [INFO ] [MAIN ] GME: Loaded 53761 existing records. [2025-09-18T19:17:14.115118] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:17:14.115409] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-18T19:17:14.115542] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-18T19:17:14.116751] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-18T19:17:14.116815] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-18T19:17:14.148490] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-18T19:17:14.500535] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:17:14.563896] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-18T19:17:14.919555] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-11. [2025-09-18T19:17:15.145294] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-18T19:17:15.719555] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-18T19:17:15.722356] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-18T19:17:16.519578] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-18T19:17:16.886907] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-18T19:17:17.319550] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-18T19:17:17.556515] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-18T19:17:17.960832] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-18T19:17:18.119599] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-18T19:17:18.919621] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-18T19:17:19.086240] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-18T19:17:19.308725] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-18T19:17:19.318544] [INFO ] [REMOTE ] GLOB: Full fetch complete (62716 records). [2025-09-18T19:17:19.318886] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-18T19:17:19.725273] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-18T19:17:19.726541] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-18T19:17:19.727771] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-18T19:17:19.728694] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-18T19:17:19.728777] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-18T19:17:19.730173] [DEBUG] [LOCAL ] GLOB: Trimmed 62716 records to 47525 (keeping 200 days of data) [2025-09-18T19:17:20.011459] [DEBUG] [LOCAL ] GLOB: Primary data saved (47525 records). [2025-09-18T19:17:20.011601] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-18T19:17:20.011724] [INFO ] [MAIN ] Update Progress: 941/2372 symbols completed. GLOB took 44.1s. Estimated remaining: 3h 28m 46s. Rate: 6.9 symbols/min [2025-09-18T19:17:20.183727] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:17:20.229174] [DEBUG] [LOCAL ] GMED: Loaded 48260 existing records from primary storage. [2025-09-18T19:17:20.229331] [INFO ] [MAIN ] GMED: Loaded 48260 existing records. [2025-09-18T19:17:20.420557] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:17:20.420847] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-18T19:17:20.420914] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-18T19:17:20.421994] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-18T19:17:20.422054] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-18T19:17:20.523317] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-09-18T19:17:20.795524] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:17:20.830776] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-18T19:17:21.324794] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-11. [2025-09-18T19:17:21.338681] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-18T19:17:22.119551] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-18T19:17:22.600709] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-18T19:17:22.830006] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-18T19:17:22.919553] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-09-18T19:17:23.719576] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-09-18T19:17:24.168322] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-18T19:17:24.519569] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-18T19:17:24.958453] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-18T19:17:25.002788] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-18T19:17:25.319572] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-18T19:17:26.119588] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-18T19:17:26.605617] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-18T19:17:26.919544] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-18T19:17:27.407318] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-18T19:17:27.719522] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-18T19:17:27.916275] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-18T19:17:28.515456] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-18T19:17:28.526297] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-09-18T19:17:29.319583] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-18T19:17:29.912114] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-18T19:17:29.957422] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T19:17:30.119575] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-18T19:17:30.919570] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-18T19:17:30.986139] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-18T19:17:30.996676] [INFO ] [REMOTE ] GLW: Full fetch complete (77480 records). [2025-09-18T19:17:30.996892] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-18T19:17:31.409452] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-18T19:17:31.409563] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-18T19:17:31.410485] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-18T19:17:31.410597] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-18T19:17:31.414561] [DEBUG] [LOCAL ] GLW: Trimmed 77480 records to 54025 (keeping 200 days of data) [2025-09-18T19:17:31.552170] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T19:17:31.741712] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-18T19:17:31.793510] [DEBUG] [LOCAL ] GLW: Primary data saved (54025 records). [2025-09-18T19:17:31.793675] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-18T19:17:31.794842] [INFO ] [MAIN ] Update Progress: 942/2372 symbols completed. GLW took 34.2s. Estimated remaining: 3h 28m 41s. Rate: 6.9 symbols/min [2025-09-18T19:17:31.975092] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:17:32.020436] [DEBUG] [LOCAL ] GMRE: Loaded 37641 existing records from primary storage. [2025-09-18T19:17:32.020626] [INFO ] [MAIN ] GMRE: Loaded 37641 existing records. [2025-09-18T19:17:32.206525] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:17:32.206923] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-18T19:17:32.207013] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-18T19:17:32.207866] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-09-18T19:17:32.207937] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-18T19:17:32.536147] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-18T19:17:32.575787] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:17:32.605018] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-18T19:17:32.613276] [INFO ] [REMOTE ] GM: Full fetch complete (77793 records). [2025-09-18T19:17:32.613417] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-18T19:17:33.033589] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-18T19:17:33.033776] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-18T19:17:33.034844] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-18T19:17:33.035020] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-18T19:17:33.040846] [DEBUG] [LOCAL ] GM: Trimmed 77793 records to 54118 (keeping 200 days of data) [2025-09-18T19:17:33.179638] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-18T19:17:33.320298] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-18T19:17:33.439544] [DEBUG] [LOCAL ] GM: Primary data saved (54118 records). [2025-09-18T19:17:33.439733] [INFO ] [MAIN ] GM: Full history saved. [2025-09-18T19:17:33.439850] [INFO ] [MAIN ] Update Progress: 943/2372 symbols completed. GM took 32.7s. Estimated remaining: 3h 28m 22s. Rate: 6.9 symbols/min [2025-09-18T19:17:33.620773] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:17:33.641576] [DEBUG] [LOCAL ] GNE: Loaded 17363 existing records from primary storage. [2025-09-18T19:17:33.641743] [INFO ] [MAIN ] GNE: Loaded 17363 existing records. [2025-09-18T19:17:33.850075] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:17:33.850463] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-18T19:17:33.850522] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-18T19:17:33.851410] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-18T19:17:33.851496] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-18T19:17:34.124755] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-11. [2025-09-18T19:17:34.240193] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:17:34.864433] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T19:17:34.920675] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-18T19:17:34.923514] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-18T19:17:35.549877] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T19:17:35.719558] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-18T19:17:36.445877] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T19:17:36.519554] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-11. [2025-09-18T19:17:37.012116] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-18T19:17:37.319548] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-09-18T19:17:38.043623] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-18T19:17:38.119501] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-18T19:17:38.384121] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-18T19:17:38.919541] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-09-18T19:17:39.719573] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-09-18T19:17:40.058569] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-18T19:17:40.192727] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-18T19:17:40.406873] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-18T19:17:40.519579] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-09-18T19:17:41.313878] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-18T19:17:41.319485] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-18T19:17:41.879220] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-18T19:17:42.119560] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-18T19:17:42.919579] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-18T19:17:43.082033] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-18T19:17:43.719553] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-18T19:17:44.381988] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-18T19:17:44.418922] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T19:17:44.519592] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-18T19:17:45.319561] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-18T19:17:46.029427] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-18T19:17:46.119524] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-18T19:17:46.919561] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-18T19:17:47.203124] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-18T19:17:47.230739] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-18T19:17:47.719587] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-18T19:17:47.926336] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T19:17:48.519552] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-18T19:17:49.229703] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-18T19:17:49.319539] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-18T19:17:49.636612] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-18T19:17:50.119541] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-18T19:17:50.685875] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-18T19:17:50.919556] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-18T19:17:51.719584] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-18T19:17:52.519558] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-18T19:17:52.541794] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-18T19:17:52.548132] [INFO ] [REMOTE ] GMED: Full fetch complete (68855 records). [2025-09-18T19:17:52.548243] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-18T19:17:52.955217] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-18T19:17:52.955789] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-18T19:17:52.956787] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-18T19:17:52.956936] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-18T19:17:52.988208] [DEBUG] [LOCAL ] GMED: Trimmed 68855 records to 48614 (keeping 200 days of data) [2025-09-18T19:17:53.009661] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-09-18T19:17:53.011398] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-18T19:17:53.312885] [DEBUG] [LOCAL ] GMED: Primary data saved (48614 records). [2025-09-18T19:17:53.313054] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-18T19:17:53.313176] [INFO ] [MAIN ] Update Progress: 944/2372 symbols completed. GMED took 33.3s. Estimated remaining: 3h 28m 30s. Rate: 6.8 symbols/min [2025-09-18T19:17:53.319707] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-18T19:17:53.455638] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-18T19:17:53.510165] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:17:53.553856] [DEBUG] [LOCAL ] GNK: Loaded 40939 existing records from primary storage. [2025-09-18T19:17:53.554049] [INFO ] [MAIN ] GNK: Loaded 40939 existing records. [2025-09-18T19:17:53.734841] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:17:53.735186] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-18T19:17:53.735266] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-18T19:17:53.736583] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-18T19:17:53.736680] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-18T19:17:54.111741] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:17:54.119493] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-11. [2025-09-18T19:17:54.919588] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-18T19:17:55.368082] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-18T19:17:55.572405] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-18T19:17:55.581242] [INFO ] [REMOTE ] GME: Full fetch complete (77918 records). [2025-09-18T19:17:55.581369] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-18T19:17:55.724617] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-18T19:17:56.043970] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-18T19:17:56.044085] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-18T19:17:56.045038] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-18T19:17:56.045129] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-18T19:17:56.046841] [DEBUG] [LOCAL ] GME: Trimmed 77918 records to 54149 (keeping 200 days of data) [2025-09-18T19:17:56.135099] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-18T19:17:56.406110] [DEBUG] [LOCAL ] GME: Primary data saved (54149 records). [2025-09-18T19:17:56.406261] [INFO ] [MAIN ] GME: Full history saved. [2025-09-18T19:17:56.406366] [INFO ] [MAIN ] Update Progress: 945/2372 symbols completed. GME took 42.7s. Estimated remaining: 3h 28m 13s. Rate: 6.9 symbols/min [2025-09-18T19:17:56.524722] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-09-18T19:17:56.579132] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:17:56.620759] [DEBUG] [LOCAL ] GNL: Loaded 47570 existing records from primary storage. [2025-09-18T19:17:56.620928] [INFO ] [MAIN ] GNL: Loaded 47570 existing records. [2025-09-18T19:17:56.798210] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:17:56.798472] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-18T19:17:56.798527] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-18T19:17:56.799533] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-09-18T19:17:56.799592] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-18T19:17:56.934948] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-18T19:17:56.980146] [INFO ] [REMOTE ] GNE: Full fetch complete (22032 records). [2025-09-18T19:17:56.981102] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-18T19:17:57.377341] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:17:57.372039] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-18T19:17:57.572025] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-18T19:17:57.572105] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-18T19:17:57.572537] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-18T19:17:57.572576] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-18T19:17:57.573264] [DEBUG] [LOCAL ] GNE: Trimmed 22032 records to 17483 (keeping 200 days of data) [2025-09-18T19:17:57.678516] [DEBUG] [LOCAL ] GNE: Primary data saved (17483 records). [2025-09-18T19:17:57.678691] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-18T19:17:57.678793] [INFO ] [MAIN ] Update Progress: 946/2372 symbols completed. GNE took 24.2s. Estimated remaining: 3h 27m 53s. Rate: 6.9 symbols/min [2025-09-18T19:17:57.849991] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:17:57.894261] [DEBUG] [LOCAL ] GNRC: Loaded 45119 existing records from primary storage. [2025-09-18T19:17:57.894411] [INFO ] [MAIN ] GNRC: Loaded 45119 existing records. [2025-09-18T19:17:58.077046] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:17:58.077400] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-18T19:17:58.077474] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-18T19:17:58.084904] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-18T19:17:58.096708] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-18T19:17:58.152259] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-11. [2025-09-18T19:17:58.167970] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-18T19:17:58.467784] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:17:58.646237] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-18T19:17:58.919601] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-11. [2025-09-18T19:17:59.473243] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-18T19:17:59.719605] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-09-18T19:18:00.431917] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-18T19:18:00.519551] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-09-18T19:18:01.008567] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-18T19:18:01.319565] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-18T19:18:02.119614] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-09-18T19:18:02.728397] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-18T19:18:02.919555] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-18T19:18:03.596253] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-18T19:18:03.719530] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-18T19:18:04.519600] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-09-18T19:18:05.079089] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-18T19:18:05.129096] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (3.01 seconds). [2025-09-18T19:18:05.319614] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-09-18T19:18:05.877487] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-18T19:18:06.119612] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-18T19:18:06.216848] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-18T19:18:06.492360] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T19:18:06.919555] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-18T19:18:07.395804] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-18T19:18:07.719546] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-18T19:18:07.825682] [DEBUG] [REMOTE ] GNL: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-18T19:18:07.826026] [WARN ] [REMOTE ] GNL: No data returned for month 2025-02 [2025-09-18T19:18:08.040320] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-18T19:18:08.519601] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-18T19:18:09.319609] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-18T19:18:10.119541] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-18T19:18:10.166931] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-18T19:18:10.765153] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-18T19:18:10.919614] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-18T19:18:11.619894] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-18T19:18:11.625322] [INFO ] [REMOTE ] GMRE: Full fetch complete (53278 records). [2025-09-18T19:18:11.625433] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-18T19:18:11.729284] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-18T19:18:12.046247] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-09-18T19:18:12.046339] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-09-18T19:18:12.047123] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-09-18T19:18:12.047205] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-09-18T19:18:12.048460] [DEBUG] [LOCAL ] GMRE: Trimmed 53278 records to 37946 (keeping 200 days of data) [2025-09-18T19:18:12.272754] [DEBUG] [LOCAL ] GMRE: Primary data saved (37946 records). [2025-09-18T19:18:12.272939] [INFO ] [MAIN ] GMRE: Full history saved. [2025-09-18T19:18:12.273959] [INFO ] [MAIN ] Update Progress: 947/2372 symbols completed. GMRE took 40.5s. Estimated remaining: 3h 27m 53s. Rate: 6.9 symbols/min [2025-09-18T19:18:12.448542] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:18:12.458778] [DEBUG] [LOCAL ] GNT: Loaded 7821 existing records from primary storage. [2025-09-18T19:18:12.458917] [INFO ] [MAIN ] GNT: Loaded 7821 existing records. [2025-09-18T19:18:12.535368] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-18T19:18:12.688362] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:18:12.691723] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-18T19:18:12.692609] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-18T19:18:12.692674] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-18T19:18:12.701348] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-18T19:18:12.701847] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-18T19:18:13.077555] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:18:13.111409] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-18T19:18:13.319549] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-11. [2025-09-18T19:18:13.853074] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-18T19:18:14.110632] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T19:18:14.119598] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-09-18T19:18:14.876283] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-18T19:18:14.919493] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-18T19:18:15.719591] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-09-18T19:18:16.519514] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-18T19:18:16.562593] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T19:18:17.225480] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-18T19:18:17.319576] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-18T19:18:18.119543] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-18T19:18:18.298873] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-18T19:18:18.615153] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-18T19:18:18.614944] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-18T19:18:18.919571] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-18T19:18:19.719623] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-18T19:18:20.491945] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-18T19:18:20.526949] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-18T19:18:20.530365] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-18T19:18:21.319568] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-18T19:18:21.760129] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-18T19:18:22.119604] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-18T19:18:22.919570] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-18T19:18:23.042934] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-18T19:18:23.240059] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-18T19:18:23.378479] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-18T19:18:23.719557] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-18T19:18:24.519575] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-18T19:18:25.222889] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-18T19:18:25.319497] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-18T19:18:26.119551] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-18T19:18:26.426358] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-18T19:18:26.919541] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-18T19:18:27.044777] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-18T19:18:27.719563] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-18T19:18:28.013891] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-18T19:18:28.029121] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-18T19:18:28.519546] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-18T19:18:29.167022] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T19:18:29.173248] [INFO ] [REMOTE ] GNL: Full fetch complete (62232 records). [2025-09-18T19:18:29.173369] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-18T19:18:29.327704] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-18T19:18:29.383267] [WARN ] [VALIDATOR ] GNL: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-18T19:18:29.384611] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-18T19:18:29.387770] [FATAL] [MAIN ] GNL: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:18:29.391518] [WARN ] [MAIN ] GNL: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:18:29.392147] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-18T19:18:29.392248] [DEBUG] [LOCAL ] GNL: No primary data file found to delete. [2025-09-18T19:18:29.392294] [INFO ] [LOCAL ] GNL: Starting deletion of derivative data. [2025-09-18T19:18:29.392932] [DEBUG] [LOCAL ] GNL: Deleted derivative data file. [2025-09-18T19:18:29.393095] [INFO ] [MAIN ] Update Progress: 948/2372 symbols completed. GNL took 33.0s. Estimated remaining: 3h 27m 56s. Rate: 6.8 symbols/min [2025-09-18T19:18:29.570159] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:18:29.580013] [DEBUG] [LOCAL ] GNTY: Loaded 6954 existing records from primary storage. [2025-09-18T19:18:29.580144] [INFO ] [MAIN ] GNTY: Loaded 6954 existing records. [2025-09-18T19:18:29.756887] [WARN ] [MAIN ] GNTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:18:29.757169] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-18T19:18:29.757220] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-18T19:18:29.757581] [DEBUG] [LOCAL ] GNTY: Deleted primary data file. [2025-09-18T19:18:29.757677] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-18T19:18:30.110198] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:18:30.119503] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2024-11. [2025-09-18T19:18:30.459823] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2024-11 (0.34 seconds). [2025-09-18T19:18:30.576988] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-18T19:18:30.582705] [INFO ] [REMOTE ] GNK: Full fetch complete (56916 records). [2025-09-18T19:18:30.582836] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-18T19:18:30.926962] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2024-12. [2025-09-18T19:18:30.981055] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-18T19:18:30.981138] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-18T19:18:30.981889] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-18T19:18:30.981954] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-18T19:18:30.983207] [DEBUG] [LOCAL ] GNK: Trimmed 56916 records to 41207 (keeping 200 days of data) [2025-09-18T19:18:31.231436] [DEBUG] [LOCAL ] GNK: Primary data saved (41207 records). [2025-09-18T19:18:31.231569] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-18T19:18:31.231673] [INFO ] [MAIN ] Update Progress: 949/2372 symbols completed. GNK took 37.9s. Estimated remaining: 3h 27m 37s. Rate: 6.9 symbols/min [2025-09-18T19:18:31.407943] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:18:31.458117] [DEBUG] [LOCAL ] GNW: Loaded 51331 existing records from primary storage. [2025-09-18T19:18:31.458299] [INFO ] [MAIN ] GNW: Loaded 51331 existing records. [2025-09-18T19:18:31.639595] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:18:31.639903] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-18T19:18:31.639951] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-18T19:18:31.641173] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-09-18T19:18:31.641240] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-18T19:18:31.724120] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-18T19:18:31.794824] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-18T19:18:32.026965] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:18:32.519536] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-11. [2025-09-18T19:18:33.240809] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-18T19:18:33.319554] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-18T19:18:34.095700] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-18T19:18:34.119514] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-09-18T19:18:34.135537] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-18T19:18:34.919541] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-01. [2025-09-18T19:18:35.697335] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-18T19:18:35.728080] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-18T19:18:35.749398] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-18T19:18:36.356899] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-18T19:18:36.519552] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-18T19:18:37.143209] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-18T19:18:37.319548] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-18T19:18:38.119570] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-18T19:18:38.658576] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-18T19:18:38.919542] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-18T19:18:38.953512] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-18T19:18:39.610728] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-18T19:18:39.719558] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-18T19:18:40.366480] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-18T19:18:40.368723] [INFO ] [REMOTE ] GNT: Full fetch complete (10323 records). [2025-09-18T19:18:40.368801] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-18T19:18:40.529683] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-18T19:18:40.736802] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-18T19:18:40.736884] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-18T19:18:40.737177] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-18T19:18:40.737219] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-18T19:18:40.737734] [DEBUG] [LOCAL ] GNT: Trimmed 10323 records to 7870 (keeping 200 days of data) [2025-09-18T19:18:40.783779] [DEBUG] [LOCAL ] GNT: Primary data saved (7870 records). [2025-09-18T19:18:40.783928] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-18T19:18:40.784021] [INFO ] [MAIN ] Update Progress: 950/2372 symbols completed. GNT took 28.5s. Estimated remaining: 3h 27m 30s. Rate: 6.9 symbols/min [2025-09-18T19:18:40.952775] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:18:40.996303] [DEBUG] [LOCAL ] GOF: Loaded 43087 existing records from primary storage. [2025-09-18T19:18:40.996473] [INFO ] [MAIN ] GOF: Loaded 43087 existing records. [2025-09-18T19:18:41.186579] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:18:41.186889] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-18T19:18:41.186938] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-18T19:18:41.187946] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-09-18T19:18:41.188006] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-18T19:18:41.295911] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-18T19:18:41.323531] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-18T19:18:41.556864] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:18:42.119566] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-18T19:18:42.660043] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-18T19:18:42.919585] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-18T19:18:43.186345] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-18T19:18:43.192804] [INFO ] [REMOTE ] GNRC: Full fetch complete (64822 records). [2025-09-18T19:18:43.192956] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-18T19:18:43.601460] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-18T19:18:43.601607] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-18T19:18:43.602525] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-18T19:18:43.602635] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-18T19:18:43.611859] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-18T19:18:43.615820] [DEBUG] [LOCAL ] GNRC: Trimmed 64822 records to 45443 (keeping 200 days of data) [2025-09-18T19:18:43.719568] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-09-18T19:18:43.902855] [DEBUG] [LOCAL ] GNRC: Primary data saved (45443 records). [2025-09-18T19:18:43.903062] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-18T19:18:43.903217] [INFO ] [MAIN ] Update Progress: 951/2372 symbols completed. GNRC took 46.2s. Estimated remaining: 3h 27m 13s. Rate: 6.9 symbols/min [2025-09-18T19:18:44.083807] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:18:44.117020] [DEBUG] [LOCAL ] GOLF: Loaded 32073 existing records from primary storage. [2025-09-18T19:18:44.117186] [INFO ] [MAIN ] GOLF: Loaded 32073 existing records. [2025-09-18T19:18:44.296879] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:18:44.297135] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-18T19:18:44.297184] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-18T19:18:44.298028] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-09-18T19:18:44.298089] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-18T19:18:44.524692] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-11. [2025-09-18T19:18:44.670474] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:18:45.101824] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T19:18:45.319568] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-18T19:18:45.742813] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-18T19:18:46.119555] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-11. [2025-09-18T19:18:46.919572] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-18T19:18:46.990145] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T19:18:47.071368] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-18T19:18:47.413376] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-18T19:18:47.719545] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-18T19:18:48.333235] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-18T19:18:48.335266] [INFO ] [REMOTE ] GNTY: Full fetch complete (10087 records). [2025-09-18T19:18:48.335362] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-18T19:18:48.522328] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-18T19:18:48.758731] [DEBUG] [VALIDATOR ] GNTY: All expected trading days are present. [2025-09-18T19:18:48.758907] [DEBUG] [VALIDATOR ] GNTY: Primary data validation passed. [2025-09-18T19:18:48.759329] [INFO ] [MAIN ] GNTY: Fetched primary data is valid. [2025-09-18T19:18:48.759384] [DEBUG] [LOCAL ] GNTY: Saving primary data. [2025-09-18T19:18:48.760068] [DEBUG] [LOCAL ] GNTY: Trimmed 10087 records to 7043 (keeping 200 days of data) [2025-09-18T19:18:48.806954] [DEBUG] [LOCAL ] GNTY: Primary data saved (7043 records). [2025-09-18T19:18:48.807157] [INFO ] [MAIN ] GNTY: Full history saved. [2025-09-18T19:18:48.807297] [INFO ] [MAIN ] Update Progress: 952/2372 symbols completed. GNTY took 19.4s. Estimated remaining: 3h 26m 58s. Rate: 6.9 symbols/min [2025-09-18T19:18:48.984555] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:18:49.029632] [DEBUG] [LOCAL ] GOOS: Loaded 45905 existing records from primary storage. [2025-09-18T19:18:49.029846] [INFO ] [MAIN ] GOOS: Loaded 45905 existing records. [2025-09-18T19:18:49.212111] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:18:49.212393] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-18T19:18:49.212442] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-18T19:18:49.213420] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-09-18T19:18:49.213480] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-18T19:18:49.320997] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-09-18T19:18:49.587159] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:18:50.119566] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-09-18T19:18:50.315089] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-18T19:18:50.743854] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-18T19:18:50.792867] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-18T19:18:50.919542] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-09-18T19:18:51.719541] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-18T19:18:51.872225] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T19:18:52.519611] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-09-18T19:18:53.267562] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-18T19:18:53.319545] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-18T19:18:53.658680] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-18T19:18:54.119616] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-18T19:18:54.542861] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-18T19:18:54.919555] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-18T19:18:55.091037] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-18T19:18:55.719557] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-18T19:18:56.359568] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-18T19:18:56.519513] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-18T19:18:56.889794] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-18T19:18:57.319559] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-11. [2025-09-18T19:18:57.899471] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-18T19:18:58.119556] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-18T19:18:58.429596] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-18T19:18:58.919600] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-18T19:18:59.719546] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-18T19:18:59.912752] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-18T19:19:00.300311] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-18T19:19:00.519585] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-09-18T19:19:01.189307] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-18T19:19:01.319519] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-18T19:19:01.821979] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-18T19:19:02.119566] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-09-18T19:19:02.919571] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-18T19:19:03.027318] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-18T19:19:03.225850] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-18T19:19:03.719544] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-18T19:19:04.519592] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-18T19:19:04.768751] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-18T19:19:05.009219] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-18T19:19:05.319550] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-18T19:19:05.473301] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-18T19:19:06.119603] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-18T19:19:06.714148] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-18T19:19:06.919548] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-18T19:19:07.719542] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-18T19:19:07.837469] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-18T19:19:08.450001] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-18T19:19:08.519535] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-18T19:19:08.647612] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-18T19:19:09.319588] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-18T19:19:10.093287] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T19:19:10.119496] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-18T19:19:10.221954] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-18T19:19:10.919586] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-18T19:19:11.386006] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-18T19:19:11.719583] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-18T19:19:12.370455] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T19:19:12.379989] [INFO ] [REMOTE ] GNW: Full fetch complete (73232 records). [2025-09-18T19:19:12.380148] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-18T19:19:12.527206] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-18T19:19:12.782244] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-09-18T19:19:12.782478] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-09-18T19:19:12.783507] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-09-18T19:19:12.783602] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-09-18T19:19:12.802882] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-18T19:19:12.809428] [DEBUG] [LOCAL ] GNW: Trimmed 73232 records to 51708 (keeping 200 days of data) [2025-09-18T19:19:13.106291] [DEBUG] [LOCAL ] GNW: Primary data saved (51708 records). [2025-09-18T19:19:13.106525] [INFO ] [MAIN ] GNW: Full history saved. [2025-09-18T19:19:13.106667] [INFO ] [MAIN ] Update Progress: 953/2372 symbols completed. GNW took 41.9s. Estimated remaining: 3h 27m 13s. Rate: 6.8 symbols/min [2025-09-18T19:19:13.279972] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:19:13.317191] [DEBUG] [LOCAL ] GOTU: Loaded 39534 existing records from primary storage. [2025-09-18T19:19:13.317346] [INFO ] [MAIN ] GOTU: Loaded 39534 existing records. [2025-09-18T19:19:13.328827] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-18T19:19:13.505031] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:19:13.505330] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-18T19:19:13.505398] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-18T19:19:13.506302] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-18T19:19:13.506365] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-18T19:19:13.867827] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:19:14.119543] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-11. [2025-09-18T19:19:14.271101] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-18T19:19:14.515875] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-18T19:19:14.919542] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-18T19:19:15.287000] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-18T19:19:15.719547] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-09-18T19:19:15.935394] [DEBUG] [REMOTE ] GOF: Error fetching primary data for 2025-07: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [2025-09-18T19:19:15.935572] [WARN ] [REMOTE ] GOF: No data returned for month 2025-07 [2025-09-18T19:19:16.519621] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-18T19:19:17.324851] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-18T19:19:17.340452] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-18T19:19:17.839035] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-18T19:19:18.119547] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-18T19:19:18.919545] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-18T19:19:18.985891] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-18T19:19:19.415147] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-18T19:19:19.421305] [INFO ] [REMOTE ] GOOS: Full fetch complete (66147 records). [2025-09-18T19:19:19.421437] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-18T19:19:19.720465] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-09-18T19:19:19.820477] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-09-18T19:19:19.820619] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-09-18T19:19:19.821504] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-09-18T19:19:19.821602] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-09-18T19:19:19.833096] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-18T19:19:19.836949] [DEBUG] [LOCAL ] GOOS: Trimmed 66147 records to 46206 (keeping 200 days of data) [2025-09-18T19:19:19.837853] [INFO ] [REMOTE ] GOLF: Full fetch complete (44721 records). [2025-09-18T19:19:19.837938] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-18T19:19:20.343753] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-09-18T19:19:20.344529] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-09-18T19:19:20.345590] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-18T19:19:20.345697] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-09-18T19:19:20.351130] [DEBUG] [LOCAL ] GOLF: Trimmed 44721 records to 32291 (keeping 200 days of data) [2025-09-18T19:19:20.533466] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-18T19:19:20.636887] [DEBUG] [LOCAL ] GOOS: Primary data saved (46206 records). [2025-09-18T19:19:20.644143] [INFO ] [MAIN ] GOOS: Full history saved. [2025-09-18T19:19:20.644603] [INFO ] [MAIN ] Update Progress: 954/2372 symbols completed. GOOS took 31.8s. Estimated remaining: 3h 27m 2s. Rate: 6.8 symbols/min [2025-09-18T19:19:20.888476] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:19:20.931389] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-18T19:19:20.962893] [DEBUG] [LOCAL ] GOLF: Primary data saved (32291 records). [2025-09-18T19:19:20.963045] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-18T19:19:20.963134] [INFO ] [MAIN ] Update Progress: 955/2372 symbols completed. GOLF took 37.1s. Estimated remaining: 3h 26m 41s. Rate: 6.9 symbols/min [2025-09-18T19:19:21.081057] [DEBUG] [LOCAL ] GPC: Loaded 46846 existing records from primary storage. [2025-09-18T19:19:21.091700] [INFO ] [MAIN ] GPC: Loaded 46846 existing records. [2025-09-18T19:19:21.255177] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:19:21.333530] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-18T19:19:21.339638] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:19:21.340876] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-18T19:19:21.340941] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-18T19:19:21.342131] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-09-18T19:19:21.342195] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-18T19:19:21.461514] [DEBUG] [LOCAL ] GPI: Loaded 15189 existing records from primary storage. [2025-09-18T19:19:21.464135] [INFO ] [MAIN ] GPI: Loaded 15189 existing records. [2025-09-18T19:19:21.915155] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:19:21.965349] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-18T19:19:21.987876] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:19:21.983891] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-18T19:19:21.988969] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-09-18T19:19:21.989050] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-18T19:19:22.129698] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-11. [2025-09-18T19:19:22.374169] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:19:22.394076] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-18T19:19:22.402032] [INFO ] [REMOTE ] GOF: Full fetch complete (55524 records). [2025-09-18T19:19:22.402234] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-18T19:19:22.606931] [WARN ] [VALIDATOR ] GOF: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-18T19:19:22.607626] [FATAL] [MAIN ] GOF: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:19:22.607746] [WARN ] [MAIN ] GOF: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:19:22.607841] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-18T19:19:22.607945] [DEBUG] [LOCAL ] GOF: No primary data file found to delete. [2025-09-18T19:19:22.608009] [INFO ] [LOCAL ] GOF: Starting deletion of derivative data. [2025-09-18T19:19:22.608433] [DEBUG] [LOCAL ] GOF: Deleted derivative data file. [2025-09-18T19:19:22.609984] [INFO ] [MAIN ] Update Progress: 956/2372 symbols completed. GOF took 41.8s. Estimated remaining: 3h 26m 21s. Rate: 6.9 symbols/min [2025-09-18T19:19:22.793842] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:19:22.827275] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T19:19:22.830321] [DEBUG] [LOCAL ] GPJA: Loaded 4030 existing records from primary storage. [2025-09-18T19:19:22.839793] [INFO ] [MAIN ] GPJA: Loaded 4030 existing records. [2025-09-18T19:19:22.924624] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-11. [2025-09-18T19:19:23.028373] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:19:23.028668] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-18T19:19:23.028730] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-18T19:19:23.028979] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-18T19:19:23.029037] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-18T19:19:23.441158] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:19:23.719547] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-11. [2025-09-18T19:19:23.819726] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-18T19:19:23.870352] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-18T19:19:24.031201] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-11 (0.31 seconds). [2025-09-18T19:19:24.519559] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-09-18T19:19:25.006016] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-18T19:19:25.319568] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-09-18T19:19:26.119537] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-09-18T19:19:26.318042] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-18T19:19:26.919554] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-09-18T19:19:27.500426] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-18T19:19:27.642123] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-18T19:19:27.719518] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-09-18T19:19:28.519559] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-09-18T19:19:29.319612] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-18T19:19:29.511698] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-18T19:19:29.551880] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-18T19:19:30.119544] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-18T19:19:30.840431] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-18T19:19:30.866492] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-18T19:19:30.919556] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-18T19:19:31.465016] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-18T19:19:31.719559] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-18T19:19:32.175319] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-18T19:19:32.519548] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-18T19:19:33.319586] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-18T19:19:33.588187] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-18T19:19:33.654719] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-18T19:19:34.119552] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-18T19:19:34.527604] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-18T19:19:34.919541] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-18T19:19:35.410742] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-18T19:19:35.719547] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-18T19:19:36.143684] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-18T19:19:36.519569] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-18T19:19:37.095676] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-18T19:19:37.319557] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-18T19:19:38.097237] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-18T19:19:38.099064] [INFO ] [REMOTE ] GPJA: Full fetch complete (7278 records). [2025-09-18T19:19:38.099151] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-18T19:19:38.124779] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-18T19:19:38.490305] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-18T19:19:38.490454] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-18T19:19:38.490701] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-18T19:19:38.490793] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-18T19:19:38.491244] [DEBUG] [LOCAL ] GPJA: Trimmed 7278 records to 4052 (keeping 200 days of data) [2025-09-18T19:19:38.519270] [DEBUG] [LOCAL ] GPJA: Primary data saved (4052 records). [2025-09-18T19:19:38.519363] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-18T19:19:38.519557] [INFO ] [MAIN ] Update Progress: 957/2372 symbols completed. GPJA took 15.9s. Estimated remaining: 3h 26m 23s. Rate: 6.9 symbols/min [2025-09-18T19:19:38.919570] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-18T19:19:39.273913] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-18T19:19:39.607308] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-18T19:19:39.719580] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-18T19:19:40.519553] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-18T19:19:41.144774] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T19:19:41.319578] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-18T19:19:42.093560] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T19:19:42.119517] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-18T19:19:42.879377] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-18T19:19:42.919494] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-18T19:19:43.201980] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-18T19:19:43.719577] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-18T19:19:44.470298] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-18T19:19:44.519503] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-18T19:19:44.860723] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-18T19:19:45.128451] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-18T19:19:45.319551] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-18T19:19:46.119571] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-18T19:19:46.220763] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-18T19:19:46.919509] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-18T19:19:47.388782] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-18T19:19:47.719545] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-18T19:19:48.304147] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-18T19:19:48.519530] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-18T19:19:48.715796] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-18T19:19:49.319544] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-18T19:19:49.845705] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-18T19:19:50.119533] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-18T19:19:50.511597] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-18T19:19:50.517009] [INFO ] [REMOTE ] GOTU: Full fetch complete (59916 records). [2025-09-18T19:19:50.517107] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-18T19:19:50.910456] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-18T19:19:50.910546] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-18T19:19:50.911530] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-18T19:19:50.911595] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-18T19:19:50.913313] [DEBUG] [LOCAL ] GOTU: Trimmed 59916 records to 39755 (keeping 200 days of data) [2025-09-18T19:19:50.919589] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-18T19:19:51.153410] [DEBUG] [LOCAL ] GOTU: Primary data saved (39755 records). [2025-09-18T19:19:51.153549] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-18T19:19:51.153635] [INFO ] [MAIN ] Update Progress: 958/2372 symbols completed. GOTU took 38.0s. Estimated remaining: 3h 26m 20s. Rate: 6.9 symbols/min [2025-09-18T19:19:51.854283] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-18T19:19:51.864954] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-18T19:19:51.900492] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-18T19:19:52.519551] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-18T19:19:53.283834] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-18T19:19:53.286294] [INFO ] [REMOTE ] GPI: Full fetch complete (20833 records). [2025-09-18T19:19:53.286379] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-18T19:19:53.672635] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-09-18T19:19:53.672869] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-09-18T19:19:53.673459] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-09-18T19:19:53.673538] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-09-18T19:19:53.683488] [DEBUG] [LOCAL ] GPI: Trimmed 20833 records to 15301 (keeping 200 days of data) [2025-09-18T19:19:53.700473] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-18T19:19:53.714401] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-18T19:19:53.814566] [DEBUG] [LOCAL ] GPI: Primary data saved (15301 records). [2025-09-18T19:19:53.814759] [INFO ] [MAIN ] GPI: Full history saved. [2025-09-18T19:19:53.814878] [INFO ] [MAIN ] Update Progress: 959/2372 symbols completed. GPI took 32.9s. Estimated remaining: 3h 26m 2s. Rate: 6.9 symbols/min [2025-09-18T19:19:55.139143] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-18T19:19:55.148755] [INFO ] [REMOTE ] GPC: Full fetch complete (69059 records). [2025-09-18T19:19:55.148880] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-18T19:19:55.538884] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-09-18T19:19:55.538978] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-09-18T19:19:55.539816] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-09-18T19:19:55.539880] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-09-18T19:19:55.541342] [DEBUG] [LOCAL ] GPC: Trimmed 69059 records to 47187 (keeping 200 days of data) [2025-09-18T19:19:55.855157] [DEBUG] [LOCAL ] GPC: Primary data saved (47187 records). [2025-09-18T19:19:55.855291] [INFO ] [MAIN ] GPC: Full history saved. [2025-09-18T19:19:55.855380] [INFO ] [MAIN ] Update Progress: 960/2372 symbols completed. GPC took 35.2s. Estimated remaining: 3h 25m 44s. Rate: 6.9 symbols/min [2025-09-18T19:19:56.380571] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:19:56.593869] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:19:56.596038] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:19:56.601884] [DEBUG] [LOCAL ] GPN: No existing data file found in primary storage. [2025-09-18T19:19:56.627699] [WARN ] [MAIN ] GPN: No existing data found, performing full refresh instead. [2025-09-18T19:19:56.632097] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:19:56.632724] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-18T19:19:56.632833] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-18T19:19:56.633341] [DEBUG] [LOCAL ] GPN: No primary data file found to delete. [2025-09-18T19:19:56.633393] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-18T19:19:56.790203] [DEBUG] [LOCAL ] GPOR: Loaded 23033 existing records from primary storage. [2025-09-18T19:19:56.827135] [INFO ] [MAIN ] GPOR: Loaded 23033 existing records. [2025-09-18T19:19:56.961268] [DEBUG] [LOCAL ] GPMT: Loaded 26887 existing records from primary storage. [2025-09-18T19:19:56.999474] [INFO ] [MAIN ] GPMT: Loaded 26887 existing records. [2025-09-18T19:19:57.170344] [DEBUG] [LOCAL ] GPK: Loaded 52677 existing records from primary storage. [2025-09-18T19:19:57.196513] [INFO ] [MAIN ] GPK: Loaded 52677 existing records. [2025-09-18T19:19:57.421737] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:19:57.430913] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:19:57.457184] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-11. [2025-09-18T19:19:57.529014] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-18T19:19:57.554583] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-18T19:19:57.554830] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:19:57.560829] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-18T19:19:57.576398] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-18T19:19:57.616209] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-18T19:19:57.626782] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-18T19:19:57.724387] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:19:57.724192] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-18T19:19:57.743123] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-18T19:19:57.749344] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-18T19:19:57.767903] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-18T19:19:57.805110] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-18T19:19:57.822554] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-18T19:19:58.613586] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:19:58.706832] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-11. [2025-09-18T19:19:58.730155] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:19:58.742138] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-11. [2025-09-18T19:19:58.864818] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:19:58.865148] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-11. [2025-09-18T19:19:59.247674] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-18T19:19:59.258475] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-09-18T19:19:59.652093] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-18T19:19:59.659004] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-09-18T19:19:59.676913] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-18T19:19:59.682980] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-09-18T19:20:00.114533] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-18T19:20:00.124508] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-09-18T19:20:00.620541] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-18T19:20:00.641503] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-09-18T19:20:00.643672] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-18T19:20:00.690198] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-18T19:20:01.319588] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-09-18T19:20:01.599217] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-18T19:20:01.748292] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-18T19:20:02.119585] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-18T19:20:02.733462] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-18T19:20:02.919602] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-09-18T19:20:03.204336] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-18T19:20:03.719558] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-18T19:20:04.007188] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-18T19:20:04.519568] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-18T19:20:04.832698] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-18T19:20:05.319566] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-18T19:20:05.940962] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T19:20:06.119551] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-18T19:20:06.468027] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-18T19:20:06.919568] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-18T19:20:07.019592] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-18T19:20:07.719570] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-09-18T19:20:08.519589] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-18T19:20:08.675465] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-18T19:20:09.212856] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T19:20:09.319594] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-18T19:20:09.449567] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-18T19:20:10.119582] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-18T19:20:10.272881] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-18T19:20:10.919547] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-18T19:20:11.719580] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-18T19:20:11.880045] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-18T19:20:12.059767] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-18T19:20:12.519629] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-18T19:20:12.884046] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-18T19:20:13.319631] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-18T19:20:14.119527] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-18T19:20:14.175582] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-18T19:20:14.213970] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-18T19:20:14.919603] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-18T19:20:15.457238] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-18T19:20:15.719570] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-18T19:20:15.905375] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-18T19:20:16.519561] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-18T19:20:17.282414] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-18T19:20:17.319524] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-18T19:20:18.119540] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-18T19:20:18.434914] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-18T19:20:18.582662] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-18T19:20:18.892527] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-18T19:20:18.919501] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-18T19:20:19.719553] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-18T19:20:20.144703] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-18T19:20:20.519545] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-18T19:20:21.110825] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-18T19:20:21.319527] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-18T19:20:22.119592] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-18T19:20:22.369215] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-18T19:20:22.787956] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-18T19:20:22.813963] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-18T19:20:22.919511] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-18T19:20:23.719581] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-18T19:20:23.951994] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-18T19:20:24.519564] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-18T19:20:24.881214] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-18T19:20:24.885193] [INFO ] [REMOTE ] GPOR: Full fetch complete (34717 records). [2025-09-18T19:20:24.885277] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-18T19:20:25.281567] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-18T19:20:25.281778] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-18T19:20:25.282351] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-18T19:20:25.282551] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-18T19:20:25.290161] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-18T19:20:25.292670] [DEBUG] [LOCAL ] GPOR: Trimmed 34717 records to 23255 (keeping 200 days of data) [2025-09-18T19:20:25.293556] [INFO ] [REMOTE ] GPMT: Full fetch complete (38018 records). [2025-09-18T19:20:25.293633] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-18T19:20:25.374598] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-18T19:20:25.792211] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-18T19:20:25.792597] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-18T19:20:25.793530] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-18T19:20:25.793973] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-18T19:20:25.797282] [DEBUG] [LOCAL ] GPMT: Trimmed 38018 records to 27022 (keeping 200 days of data) [2025-09-18T19:20:25.935917] [DEBUG] [LOCAL ] GPOR: Primary data saved (23255 records). [2025-09-18T19:20:25.936552] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-18T19:20:25.936921] [INFO ] [MAIN ] Update Progress: 961/2372 symbols completed. GPOR took 30.1s. Estimated remaining: 3h 26m 6s. Rate: 6.8 symbols/min [2025-09-18T19:20:26.122237] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-18T19:20:26.122170] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:20:26.188771] [DEBUG] [LOCAL ] GPMT: Primary data saved (27022 records). [2025-09-18T19:20:26.198561] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-18T19:20:26.199719] [INFO ] [MAIN ] Update Progress: 962/2372 symbols completed. GPMT took 30.3s. Estimated remaining: 3h 25m 45s. Rate: 6.9 symbols/min [2025-09-18T19:20:26.236815] [DEBUG] [LOCAL ] GPRK: Loaded 39196 existing records from primary storage. [2025-09-18T19:20:26.269380] [INFO ] [MAIN ] GPRK: Loaded 39196 existing records. [2025-09-18T19:20:26.523082] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:20:26.566112] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:20:26.566457] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-18T19:20:26.566537] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-18T19:20:26.567778] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-18T19:20:26.567851] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-18T19:20:26.849753] [DEBUG] [LOCAL ] GRBK: Loaded 27273 existing records from primary storage. [2025-09-18T19:20:26.865941] [INFO ] [MAIN ] GRBK: Loaded 27273 existing records. [2025-09-18T19:20:27.084080] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:20:27.116894] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-11. [2025-09-18T19:20:27.148123] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:20:27.149013] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-18T19:20:27.149064] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-18T19:20:27.149968] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-18T19:20:27.150029] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-18T19:20:27.519138] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:20:27.549677] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-18T19:20:27.719523] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-11. [2025-09-18T19:20:27.814178] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-18T19:20:28.150723] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-18T19:20:28.519561] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-09-18T19:20:29.027686] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-18T19:20:29.319549] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-18T19:20:29.693996] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-18T19:20:30.119532] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-09-18T19:20:30.919543] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-18T19:20:31.150599] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-18T19:20:31.329153] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-18T19:20:31.719539] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-18T19:20:32.300144] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-18T19:20:32.307599] [INFO ] [REMOTE ] GPN: Full fetch complete (74628 records). [2025-09-18T19:20:32.307841] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-18T19:20:32.524698] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-18T19:20:32.724234] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-09-18T19:20:32.724379] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-09-18T19:20:32.725327] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-09-18T19:20:32.725405] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-09-18T19:20:32.727597] [DEBUG] [LOCAL ] GPN: Trimmed 74628 records to 52458 (keeping 200 days of data) [2025-09-18T19:20:33.075180] [DEBUG] [LOCAL ] GPN: Primary data saved (52458 records). [2025-09-18T19:20:33.075356] [INFO ] [MAIN ] GPN: Full history saved. [2025-09-18T19:20:33.075439] [INFO ] [MAIN ] Update Progress: 963/2372 symbols completed. GPN took 37.2s. Estimated remaining: 3h 25m 34s. Rate: 6.9 symbols/min [2025-09-18T19:20:33.252975] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:20:33.263446] [DEBUG] [LOCAL ] GRC: Loaded 8807 existing records from primary storage. [2025-09-18T19:20:33.263574] [INFO ] [MAIN ] GRC: Loaded 8807 existing records. [2025-09-18T19:20:33.325693] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-09-18T19:20:33.469314] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:20:33.469719] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-18T19:20:33.469877] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-18T19:20:33.470424] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-18T19:20:33.470566] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-18T19:20:33.666462] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-18T19:20:33.771454] [INFO ] [REMOTE ] GPK: Full fetch complete (75189 records). [2025-09-18T19:20:33.798176] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-18T19:20:34.011390] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:20:34.125801] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-11. [2025-09-18T19:20:34.251722] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-18T19:20:34.354368] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-18T19:20:34.354456] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-18T19:20:34.355434] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-18T19:20:34.355501] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-18T19:20:34.357006] [DEBUG] [LOCAL ] GPK: Trimmed 75189 records to 53057 (keeping 200 days of data) [2025-09-18T19:20:34.606071] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-18T19:20:34.736893] [DEBUG] [LOCAL ] GPK: Primary data saved (53057 records). [2025-09-18T19:20:34.737091] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-18T19:20:34.737229] [INFO ] [MAIN ] Update Progress: 964/2372 symbols completed. GPK took 38.9s. Estimated remaining: 3h 25m 15s. Rate: 6.9 symbols/min [2025-09-18T19:20:34.905218] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-18T19:20:34.921955] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-18T19:20:34.928872] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:20:34.948969] [DEBUG] [LOCAL ] GRDN: Loaded 19111 existing records from primary storage. [2025-09-18T19:20:34.949123] [INFO ] [MAIN ] GRDN: Loaded 19111 existing records. [2025-09-18T19:20:35.132292] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:20:35.132552] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-18T19:20:35.132602] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-18T19:20:35.133505] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-09-18T19:20:35.133565] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-18T19:20:35.494213] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:20:35.719550] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-09-18T19:20:36.373257] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-18T19:20:36.456277] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T19:20:36.519550] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-09-18T19:20:37.320019] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-11. [2025-09-18T19:20:37.320497] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-18T19:20:38.119554] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-18T19:20:38.276250] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-18T19:20:38.754328] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-18T19:20:38.919530] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-09-18T19:20:39.728634] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-09-18T19:20:39.729904] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-18T19:20:40.519550] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-18T19:20:40.854374] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-18T19:20:41.301093] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-18T19:20:41.319495] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-18T19:20:41.913212] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-18T19:20:42.119534] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-18T19:20:42.919557] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-18T19:20:43.719556] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-18T19:20:43.768506] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-18T19:20:43.815091] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-18T19:20:44.519539] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-09-18T19:20:44.579366] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-18T19:20:45.218710] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-18T19:20:45.319578] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-18T19:20:46.070805] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-18T19:20:46.119532] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-18T19:20:46.919530] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-18T19:20:47.108560] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-18T19:20:47.390183] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-18T19:20:47.719598] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-18T19:20:48.519592] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-18T19:20:49.133371] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-18T19:20:49.303903] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-18T19:20:49.319499] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-18T19:20:50.119539] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-18T19:20:50.156844] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-18T19:20:50.919561] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-18T19:20:50.963482] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-18T19:20:51.719611] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-18T19:20:52.082443] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-18T19:20:52.519564] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-18T19:20:52.842729] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-18T19:20:53.192835] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-18T19:20:53.319550] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-18T19:20:54.119532] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-18T19:20:54.631756] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-18T19:20:54.919559] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-18T19:20:55.008293] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-18T19:20:55.719551] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-18T19:20:56.175446] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-18T19:20:56.323928] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-18T19:20:56.325737] [INFO ] [REMOTE ] GRC: Full fetch complete (12896 records). [2025-09-18T19:20:56.325810] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-18T19:20:56.523082] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-18T19:20:56.728795] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-18T19:20:56.728880] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-18T19:20:56.729206] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-18T19:20:56.729269] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-18T19:20:56.729836] [DEBUG] [LOCAL ] GRC: Trimmed 12896 records to 8903 (keeping 200 days of data) [2025-09-18T19:20:56.785915] [DEBUG] [LOCAL ] GRC: Primary data saved (8903 records). [2025-09-18T19:20:56.786052] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-18T19:20:56.786139] [INFO ] [MAIN ] Update Progress: 965/2372 symbols completed. GRC took 23.7s. Estimated remaining: 3h 25m 25s. Rate: 6.8 symbols/min [2025-09-18T19:20:56.969432] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:20:57.016734] [DEBUG] [LOCAL ] GRMN: Loaded 41725 existing records from primary storage. [2025-09-18T19:20:57.016900] [INFO ] [MAIN ] GRMN: Loaded 41725 existing records. [2025-09-18T19:20:57.195371] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:20:57.195616] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-18T19:20:57.195747] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-18T19:20:57.197613] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-18T19:20:57.197698] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-18T19:20:57.324613] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-18T19:20:57.561498] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:20:57.576842] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-18T19:20:58.119523] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-18T19:20:58.640191] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-18T19:20:58.919574] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-18T19:20:59.169346] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-18T19:20:59.719601] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-18T19:21:00.343574] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-18T19:21:00.348811] [INFO ] [REMOTE ] GPRK: Full fetch complete (57133 records). [2025-09-18T19:21:00.348926] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-18T19:21:00.525864] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-11. [2025-09-18T19:21:00.771615] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-18T19:21:00.773716] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-18T19:21:00.773855] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-18T19:21:00.780925] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-18T19:21:00.781150] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-18T19:21:00.782489] [DEBUG] [LOCAL ] GPRK: Trimmed 57133 records to 39501 (keeping 200 days of data) [2025-09-18T19:21:01.008056] [DEBUG] [LOCAL ] GPRK: Primary data saved (39501 records). [2025-09-18T19:21:01.008212] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-18T19:21:01.008299] [INFO ] [MAIN ] Update Progress: 966/2372 symbols completed. GPRK took 35.1s. Estimated remaining: 3h 25m 10s. Rate: 6.9 symbols/min [2025-09-18T19:21:01.183099] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:21:01.230560] [DEBUG] [LOCAL ] GRND: Loaded 50183 existing records from primary storage. [2025-09-18T19:21:01.230742] [INFO ] [MAIN ] GRND: Loaded 50183 existing records. [2025-09-18T19:21:01.324718] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-18T19:21:01.416860] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:21:01.417141] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-18T19:21:01.417191] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-18T19:21:01.418573] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-18T19:21:01.418635] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-18T19:21:01.814019] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:21:02.119608] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-18T19:21:02.760480] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-11 (2.23 seconds). [2025-09-18T19:21:02.919680] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-09-18T19:21:03.719592] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-11. [2025-09-18T19:21:04.211815] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (2.89 seconds). [2025-09-18T19:21:04.215681] [INFO ] [REMOTE ] GRBK: Full fetch complete (40668 records). [2025-09-18T19:21:04.215779] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-18T19:21:04.649208] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-18T19:21:04.649415] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-18T19:21:04.650192] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-18T19:21:04.650315] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-18T19:21:04.670510] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-18T19:21:04.677415] [DEBUG] [LOCAL ] GRBK: Trimmed 40668 records to 27495 (keeping 200 days of data) [2025-09-18T19:21:04.679447] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-18T19:21:04.871666] [DEBUG] [LOCAL ] GRBK: Primary data saved (27495 records). [2025-09-18T19:21:04.871853] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-18T19:21:04.872000] [INFO ] [MAIN ] Update Progress: 967/2372 symbols completed. GRBK took 38.7s. Estimated remaining: 3h 24m 54s. Rate: 6.9 symbols/min [2025-09-18T19:21:05.074853] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:21:05.121920] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-18T19:21:05.147912] [DEBUG] [LOCAL ] GRNT: Loaded 33999 existing records from primary storage. [2025-09-18T19:21:05.148097] [INFO ] [MAIN ] GRNT: Loaded 33999 existing records. [2025-09-18T19:21:05.323690] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-09-18T19:21:05.350528] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:21:05.350842] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-18T19:21:05.350896] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-18T19:21:05.351960] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-18T19:21:05.352023] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-18T19:21:05.601292] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-18T19:21:05.795229] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:21:05.950107] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-11 (2.23 seconds). [2025-09-18T19:21:06.119554] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-09-18T19:21:06.586778] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-18T19:21:06.919560] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-18T19:21:07.254999] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-18T19:21:07.719595] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-09-18T19:21:07.780170] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-18T19:21:08.519562] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-18T19:21:08.866516] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T19:21:09.319566] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-18T19:21:09.813082] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-18T19:21:09.819103] [INFO ] [REMOTE ] GRDN: Full fetch complete (25638 records). [2025-09-18T19:21:09.819313] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-18T19:21:10.128332] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-18T19:21:10.219626] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-09-18T19:21:10.219749] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-09-18T19:21:10.220288] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-09-18T19:21:10.220349] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-09-18T19:21:10.221340] [DEBUG] [LOCAL ] GRDN: Trimmed 25638 records to 19403 (keeping 200 days of data) [2025-09-18T19:21:10.336384] [DEBUG] [LOCAL ] GRDN: Primary data saved (19403 records). [2025-09-18T19:21:10.336549] [INFO ] [MAIN ] GRDN: Full history saved. [2025-09-18T19:21:10.336688] [INFO ] [MAIN ] Update Progress: 968/2372 symbols completed. GRDN took 35.6s. Estimated remaining: 3h 24m 41s. Rate: 6.9 symbols/min [2025-09-18T19:21:10.507681] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:21:10.518766] [DEBUG] [LOCAL ] GROV: Loaded 9217 existing records from primary storage. [2025-09-18T19:21:10.518888] [INFO ] [MAIN ] GROV: Loaded 9217 existing records. [2025-09-18T19:21:10.734489] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T19:21:10.734616] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:21:10.743573] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-18T19:21:10.743800] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-18T19:21:10.744366] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-18T19:21:10.744427] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-18T19:21:10.924390] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-18T19:21:11.142698] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:21:11.396580] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-18T19:21:11.719541] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-18T19:21:12.519608] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-11. [2025-09-18T19:21:12.872827] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-18T19:21:12.993316] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-18T19:21:13.319576] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-11. [2025-09-18T19:21:13.659189] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-18T19:21:13.946568] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-18T19:21:14.119551] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-09-18T19:21:14.919546] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-18T19:21:15.170501] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T19:21:15.719546] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-09-18T19:21:16.519716] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-09-18T19:21:16.944950] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-18T19:21:17.319555] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-18T19:21:17.586494] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-18T19:21:17.648279] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-18T19:21:17.776552] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-18T19:21:18.119613] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-18T19:21:18.919545] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-18T19:21:19.719566] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-09-18T19:21:19.812967] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-18T19:21:19.845216] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-18T19:21:20.519591] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-18T19:21:20.706325] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-18T19:21:21.319587] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-18T19:21:21.868222] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-18T19:21:21.897806] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-18T19:21:22.119537] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-18T19:21:22.919763] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-18T19:21:23.517760] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-18T19:21:23.622400] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T19:21:23.719542] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-18T19:21:24.519586] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-18T19:21:25.232254] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-18T19:21:25.316545] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-18T19:21:25.324710] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-18T19:21:26.119554] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-18T19:21:26.881433] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T19:21:26.919541] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-18T19:21:27.715992] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-18T19:21:27.724117] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-18T19:21:28.363705] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T19:21:28.384239] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-18T19:21:28.519539] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-18T19:21:29.157633] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-18T19:21:29.319547] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-18T19:21:30.119544] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-18T19:21:30.790341] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-18T19:21:30.795968] [INFO ] [REMOTE ] GRMN: Full fetch complete (60170 records). [2025-09-18T19:21:30.796089] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-18T19:21:30.924678] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-18T19:21:31.194322] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-18T19:21:31.194425] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-18T19:21:31.195195] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-18T19:21:31.195268] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-18T19:21:31.196537] [DEBUG] [LOCAL ] GRMN: Trimmed 60170 records to 41972 (keeping 200 days of data) [2025-09-18T19:21:31.469199] [DEBUG] [LOCAL ] GRMN: Primary data saved (41972 records). [2025-09-18T19:21:31.469335] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-18T19:21:31.469525] [INFO ] [MAIN ] Update Progress: 969/2372 symbols completed. GRMN took 34.7s. Estimated remaining: 3h 24m 50s. Rate: 6.8 symbols/min [2025-09-18T19:21:31.643770] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:21:31.650921] [DEBUG] [LOCAL ] GRX: Loaded 4339 existing records from primary storage. [2025-09-18T19:21:31.651074] [INFO ] [MAIN ] GRX: Loaded 4339 existing records. [2025-09-18T19:21:31.727381] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-18T19:21:31.850486] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:21:31.850898] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-18T19:21:31.850972] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-18T19:21:31.851369] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-18T19:21:31.851430] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-18T19:21:32.167515] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-18T19:21:32.259263] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:21:32.295990] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-18T19:21:32.299225] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-18T19:21:32.301264] [INFO ] [REMOTE ] GROV: Full fetch complete (14865 records). [2025-09-18T19:21:32.312023] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-18T19:21:32.524780] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-18T19:21:32.698174] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-18T19:21:32.698258] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-18T19:21:32.698581] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-18T19:21:32.698619] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-18T19:21:32.699134] [DEBUG] [LOCAL ] GROV: Trimmed 14865 records to 9242 (keeping 200 days of data) [2025-09-18T19:21:32.750280] [DEBUG] [LOCAL ] GROV: Primary data saved (9242 records). [2025-09-18T19:21:32.750400] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-18T19:21:32.750487] [INFO ] [MAIN ] Update Progress: 970/2372 symbols completed. GROV took 22.4s. Estimated remaining: 3h 24m 30s. Rate: 6.9 symbols/min [2025-09-18T19:21:32.920207] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:21:32.975971] [DEBUG] [LOCAL ] GS: Loaded 52186 existing records from primary storage. [2025-09-18T19:21:32.976128] [INFO ] [MAIN ] GS: Loaded 52186 existing records. [2025-09-18T19:21:33.157510] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:21:33.157773] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-18T19:21:33.157827] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-18T19:21:33.159587] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-18T19:21:33.159676] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-18T19:21:33.319614] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-18T19:21:33.525567] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:21:33.962717] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-18T19:21:34.119598] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-11. [2025-09-18T19:21:34.797310] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T19:21:34.919531] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-18T19:21:35.719626] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-11. [2025-09-18T19:21:36.177009] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-18T19:21:36.229149] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-11 (2.11 seconds). [2025-09-18T19:21:36.382134] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T19:21:36.519565] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-09-18T19:21:37.319584] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-18T19:21:38.119556] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-09-18T19:21:38.287360] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-18T19:21:38.502545] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-18T19:21:38.509553] [INFO ] [REMOTE ] GRND: Full fetch complete (69966 records). [2025-09-18T19:21:38.509749] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-18T19:21:38.830315] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-18T19:21:38.918543] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-18T19:21:38.918698] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-18T19:21:38.919936] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-18T19:21:38.920315] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-18T19:21:38.920092] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-18T19:21:38.923703] [DEBUG] [LOCAL ] GRND: Trimmed 69966 records to 50546 (keeping 200 days of data) [2025-09-18T19:21:39.232451] [DEBUG] [LOCAL ] GRND: Primary data saved (50546 records). [2025-09-18T19:21:39.232608] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-18T19:21:39.232745] [INFO ] [MAIN ] Update Progress: 971/2372 symbols completed. GRND took 38.2s. Estimated remaining: 3h 24m 18s. Rate: 6.9 symbols/min [2025-09-18T19:21:39.425001] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:21:39.464811] [DEBUG] [LOCAL ] GSBD: Loaded 39249 existing records from primary storage. [2025-09-18T19:21:39.465009] [INFO ] [MAIN ] GSBD: Loaded 39249 existing records. [2025-09-18T19:21:39.649555] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:21:39.649819] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-18T19:21:39.649874] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-18T19:21:39.651143] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-09-18T19:21:39.651204] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-18T19:21:39.727443] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-09-18T19:21:40.030565] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:21:40.048192] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-18T19:21:40.519555] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-11. [2025-09-18T19:21:41.319569] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-09-18T19:21:41.906937] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-18T19:21:41.906750] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-18T19:21:41.945947] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T19:21:42.119577] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-09-18T19:21:42.919630] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-18T19:21:43.720104] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-18T19:21:43.724819] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-18T19:21:44.213915] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-18T19:21:44.519571] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-18T19:21:44.757699] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-18T19:21:45.319565] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-09-18T19:21:45.520316] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-18T19:21:46.119561] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-18T19:21:46.516925] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T19:21:46.673994] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-18T19:21:46.919584] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-18T19:21:47.719546] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-18T19:21:48.519556] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-18T19:21:49.144618] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T19:21:49.192960] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-18T19:21:49.263404] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-18T19:21:49.319539] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-18T19:21:50.119544] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-18T19:21:50.534899] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-18T19:21:50.919586] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-18T19:21:51.719532] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-18T19:21:51.878577] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-09-18T19:21:51.915603] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-18T19:21:52.519555] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-18T19:21:53.053911] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-18T19:21:53.319550] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-18T19:21:53.881593] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-18T19:21:54.119560] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-18T19:21:54.487976] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-18T19:21:54.919615] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-18T19:21:55.291571] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-18T19:21:55.719718] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-18T19:21:56.519568] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-18T19:21:56.578529] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T19:21:57.319590] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-18T19:21:57.437720] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-18T19:21:57.581628] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-18T19:21:57.587147] [INFO ] [REMOTE ] GRNT: Full fetch complete (48311 records). [2025-09-18T19:21:57.587305] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-18T19:21:57.927091] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-18T19:21:58.014225] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-18T19:21:58.014320] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-18T19:21:58.015080] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-18T19:21:58.015149] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-18T19:21:58.016361] [DEBUG] [LOCAL ] GRNT: Trimmed 48311 records to 34239 (keeping 200 days of data) [2025-09-18T19:21:58.119534] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-18T19:21:58.225879] [DEBUG] [LOCAL ] GRNT: Primary data saved (34239 records). [2025-09-18T19:21:58.226033] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-18T19:21:58.226191] [INFO ] [MAIN ] Update Progress: 972/2372 symbols completed. GRNT took 53.4s. Estimated remaining: 3h 24m 24s. Rate: 6.8 symbols/min [2025-09-18T19:21:58.399219] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:21:58.454484] [DEBUG] [LOCAL ] GSK: Loaded 53504 existing records from primary storage. [2025-09-18T19:21:58.454634] [INFO ] [MAIN ] GSK: Loaded 53504 existing records. [2025-09-18T19:21:58.643126] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:21:58.643369] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-18T19:21:58.643419] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-18T19:21:58.644716] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-18T19:21:58.644778] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-18T19:21:58.927613] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-18T19:21:59.035550] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:21:59.503078] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-18T19:21:59.719589] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-18T19:22:00.251282] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-18T19:22:00.519591] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-18T19:22:00.894208] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-18T19:22:01.319580] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-11. [2025-09-18T19:22:02.119565] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-18T19:22:02.622024] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-18T19:22:02.655070] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-18T19:22:02.656785] [INFO ] [REMOTE ] GRX: Full fetch complete (6473 records). [2025-09-18T19:22:02.656858] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-18T19:22:02.928418] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-18T19:22:03.045304] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-18T19:22:03.045628] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-18T19:22:03.045906] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-18T19:22:03.046101] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-18T19:22:03.064876] [DEBUG] [LOCAL ] GRX: Trimmed 6473 records to 4423 (keeping 200 days of data) [2025-09-18T19:22:03.091356] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-18T19:22:03.116221] [DEBUG] [LOCAL ] GRX: Primary data saved (4423 records). [2025-09-18T19:22:03.116307] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-18T19:22:03.116385] [INFO ] [MAIN ] Update Progress: 973/2372 symbols completed. GRX took 31.6s. Estimated remaining: 3h 24m 10s. Rate: 6.9 symbols/min [2025-09-18T19:22:03.292531] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:22:03.337465] [DEBUG] [LOCAL ] GSL: Loaded 33924 existing records from primary storage. [2025-09-18T19:22:03.337609] [INFO ] [MAIN ] GSL: Loaded 33924 existing records. [2025-09-18T19:22:03.540331] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:22:03.540734] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-18T19:22:03.540859] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-18T19:22:03.541859] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-18T19:22:03.541933] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-18T19:22:03.724796] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-18T19:22:03.923626] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:22:04.519575] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-11. [2025-09-18T19:22:05.039437] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-18T19:22:05.071158] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-18T19:22:05.079952] [INFO ] [REMOTE ] GS: Full fetch complete (75805 records). [2025-09-18T19:22:05.080153] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-18T19:22:05.325841] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-09-18T19:22:05.490418] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-18T19:22:05.490499] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-18T19:22:05.491793] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-18T19:22:05.491876] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-18T19:22:05.493352] [DEBUG] [LOCAL ] GS: Trimmed 75805 records to 52557 (keeping 200 days of data) [2025-09-18T19:22:05.725103] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-18T19:22:05.872158] [DEBUG] [LOCAL ] GS: Primary data saved (52557 records). [2025-09-18T19:22:05.872316] [INFO ] [MAIN ] GS: Full history saved. [2025-09-18T19:22:05.873815] [INFO ] [MAIN ] Update Progress: 974/2372 symbols completed. GS took 33.1s. Estimated remaining: 3h 23m 52s. Rate: 6.9 symbols/min [2025-09-18T19:22:06.044736] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:22:06.104336] [DEBUG] [LOCAL ] GTES: Loaded 50736 existing records from primary storage. [2025-09-18T19:22:06.104514] [INFO ] [MAIN ] GTES: Loaded 50736 existing records. [2025-09-18T19:22:06.125222] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-09-18T19:22:06.286756] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:22:06.287003] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-18T19:22:06.287051] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-18T19:22:06.288184] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-18T19:22:06.288245] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-18T19:22:06.646978] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:22:06.919779] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-11. [2025-09-18T19:22:07.011283] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-18T19:22:07.126852] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-18T19:22:07.719563] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-09-18T19:22:08.083332] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-18T19:22:08.519551] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-09-18T19:22:09.328360] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-09-18T19:22:09.353054] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-18T19:22:09.854800] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-18T19:22:10.119548] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-18T19:22:10.871467] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-18T19:22:10.919529] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-09-18T19:22:11.646387] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-18T19:22:11.719560] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-18T19:22:12.245270] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-18T19:22:12.519543] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-18T19:22:12.682982] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-18T19:22:13.319578] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-18T19:22:14.107303] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-18T19:22:14.119498] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-18T19:22:14.346617] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-18T19:22:14.919698] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-18T19:22:15.719568] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-18T19:22:15.752331] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-18T19:22:16.519537] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-18T19:22:16.548790] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-18T19:22:16.778447] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-18T19:22:17.319555] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-18T19:22:18.119557] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-18T19:22:18.254532] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-18T19:22:18.919606] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-18T19:22:19.069955] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-18T19:22:19.226539] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-18T19:22:19.719607] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-18T19:22:20.519549] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-18T19:22:20.675168] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-18T19:22:20.994421] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-18T19:22:21.319544] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-18T19:22:22.119560] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-18T19:22:22.215245] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-18T19:22:22.919541] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-18T19:22:23.713048] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-18T19:22:23.723191] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-18T19:22:24.006368] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-18T19:22:24.519559] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-18T19:22:24.953018] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-18T19:22:24.965156] [INFO ] [REMOTE ] GSBD: Full fetch complete (58298 records). [2025-09-18T19:22:24.965383] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-18T19:22:25.323572] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-18T19:22:25.400169] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-09-18T19:22:25.400473] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-09-18T19:22:25.401472] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-09-18T19:22:25.401622] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-09-18T19:22:25.403566] [DEBUG] [LOCAL ] GSBD: Trimmed 58298 records to 39568 (keeping 200 days of data) [2025-09-18T19:22:25.437837] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-18T19:22:25.696521] [DEBUG] [LOCAL ] GSBD: Primary data saved (39568 records). [2025-09-18T19:22:25.697090] [INFO ] [MAIN ] GSBD: Full history saved. [2025-09-18T19:22:25.697364] [INFO ] [MAIN ] Update Progress: 975/2372 symbols completed. GSBD took 46.5s. Estimated remaining: 3h 23m 60s. Rate: 6.8 symbols/min [2025-09-18T19:22:25.877801] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:22:25.925251] [DEBUG] [LOCAL ] GTLS: Loaded 43187 existing records from primary storage. [2025-09-18T19:22:25.925396] [INFO ] [MAIN ] GTLS: Loaded 43187 existing records. [2025-09-18T19:22:26.116712] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:22:26.117213] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-18T19:22:26.117395] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-18T19:22:26.118735] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-18T19:22:26.118802] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-18T19:22:26.131155] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-18T19:22:26.505254] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-18T19:22:26.587490] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:22:26.840494] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-18T19:22:26.919549] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-11. [2025-09-18T19:22:27.477087] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-18T19:22:27.719551] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-18T19:22:28.273676] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-18T19:22:28.519571] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-18T19:22:29.163605] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T19:22:29.319505] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-18T19:22:30.119538] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-18T19:22:30.431719] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-18T19:22:30.456680] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-18T19:22:30.461576] [INFO ] [REMOTE ] GSL: Full fetch complete (48206 records). [2025-09-18T19:22:30.461809] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-18T19:22:30.852542] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-18T19:22:30.852875] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-18T19:22:30.853557] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-18T19:22:30.853620] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-18T19:22:30.856330] [DEBUG] [LOCAL ] GSL: Trimmed 48206 records to 34128 (keeping 200 days of data) [2025-09-18T19:22:30.923046] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-09-18T19:22:31.083863] [DEBUG] [LOCAL ] GSL: Primary data saved (34128 records). [2025-09-18T19:22:31.084020] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-18T19:22:31.084145] [INFO ] [MAIN ] Update Progress: 976/2372 symbols completed. GSL took 28.0s. Estimated remaining: 3h 23m 46s. Rate: 6.9 symbols/min [2025-09-18T19:22:31.264201] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:22:31.313573] [DEBUG] [LOCAL ] GTN: Loaded 45848 existing records from primary storage. [2025-09-18T19:22:31.313828] [INFO ] [MAIN ] GTN: Loaded 45848 existing records. [2025-09-18T19:22:31.510310] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:22:31.510754] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-18T19:22:31.510861] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-18T19:22:31.512277] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-18T19:22:31.512343] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-18T19:22:31.680894] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-18T19:22:31.726017] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-18T19:22:31.940707] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:22:32.521958] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-18T19:22:32.525231] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-18T19:22:33.319538] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-09-18T19:22:34.061430] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-18T19:22:34.116865] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-18T19:22:34.123502] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-18T19:22:34.126798] [INFO ] [REMOTE ] GSK: Full fetch complete (77332 records). [2025-09-18T19:22:34.126942] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-18T19:22:34.547806] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-18T19:22:34.547892] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-18T19:22:34.548804] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-18T19:22:34.548871] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-18T19:22:34.550481] [DEBUG] [LOCAL ] GSK: Trimmed 77332 records to 53892 (keeping 200 days of data) [2025-09-18T19:22:34.804106] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-18T19:22:34.919617] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-11. [2025-09-18T19:22:34.938389] [DEBUG] [LOCAL ] GSK: Primary data saved (53892 records). [2025-09-18T19:22:34.938575] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-18T19:22:34.938729] [INFO ] [MAIN ] Update Progress: 977/2372 symbols completed. GSK took 36.7s. Estimated remaining: 3h 23m 30s. Rate: 6.9 symbols/min [2025-09-18T19:22:35.112764] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:22:35.146464] [DEBUG] [LOCAL ] GTY: Loaded 30408 existing records from primary storage. [2025-09-18T19:22:35.146633] [INFO ] [MAIN ] GTY: Loaded 30408 existing records. [2025-09-18T19:22:35.332699] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:22:35.333019] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-18T19:22:35.333089] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-18T19:22:35.333933] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-18T19:22:35.334007] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-18T19:22:35.721054] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-18T19:22:35.727178] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:22:35.749367] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-18T19:22:35.756995] [INFO ] [REMOTE ] GTES: Full fetch complete (73830 records). [2025-09-18T19:22:35.757145] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-18T19:22:36.149563] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-18T19:22:36.149675] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-18T19:22:36.150627] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-18T19:22:36.150732] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-18T19:22:36.152262] [DEBUG] [LOCAL ] GTES: Trimmed 73830 records to 51111 (keeping 200 days of data) [2025-09-18T19:22:36.460984] [DEBUG] [LOCAL ] GTES: Primary data saved (51111 records). [2025-09-18T19:22:36.461135] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-18T19:22:36.462166] [INFO ] [MAIN ] Update Progress: 978/2372 symbols completed. GTES took 30.6s. Estimated remaining: 3h 23m 11s. Rate: 6.9 symbols/min [2025-09-18T19:22:36.528022] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-11. [2025-09-18T19:22:36.639593] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:22:36.656375] [DEBUG] [LOCAL ] GUG: Loaded 12274 existing records from primary storage. [2025-09-18T19:22:36.656534] [INFO ] [MAIN ] GUG: Loaded 12274 existing records. [2025-09-18T19:22:36.850480] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:22:36.850793] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-18T19:22:36.850851] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-18T19:22:36.851328] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-18T19:22:36.851400] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-18T19:22:37.235908] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:22:37.319533] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-11. [2025-09-18T19:22:37.803323] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-11 (2.88 seconds). [2025-09-18T19:22:37.905606] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-18T19:22:37.926411] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-18T19:22:37.944803] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T19:22:38.119548] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-18T19:22:38.919550] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-09-18T19:22:39.525450] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-18T19:22:39.719574] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-18T19:22:40.257978] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T19:22:40.519550] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-09-18T19:22:40.976568] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-18T19:22:41.319559] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-09-18T19:22:41.580899] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-18T19:22:42.119611] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-09-18T19:22:42.760818] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-18T19:22:42.786951] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-18T19:22:42.919561] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-09-18T19:22:43.719614] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-18T19:22:44.236879] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-18T19:22:44.519546] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-18T19:22:44.832542] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-18T19:22:45.319546] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-18T19:22:45.931920] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T19:22:46.094317] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-18T19:22:46.119502] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-18T19:22:46.919548] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-18T19:22:47.022795] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-18T19:22:47.719554] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-09-18T19:22:48.313487] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-18T19:22:48.519542] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-18T19:22:49.288903] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-18T19:22:49.319498] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-18T19:22:49.775825] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-18T19:22:50.074979] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-18T19:22:50.119536] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-18T19:22:50.919602] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-18T19:22:51.280144] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-18T19:22:51.719566] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-18T19:22:52.349595] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-18T19:22:52.519575] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-18T19:22:53.319619] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-18T19:22:53.459691] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-18T19:22:53.621426] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-18T19:22:54.119609] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-18T19:22:54.292884] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-18T19:22:54.795954] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-18T19:22:54.919517] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-18T19:22:55.644349] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-18T19:22:55.719562] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-18T19:22:56.359572] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-18T19:22:56.519549] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-18T19:22:57.319560] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-18T19:22:57.847454] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T19:22:58.119559] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-18T19:22:58.281208] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-18T19:22:58.919567] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-18T19:22:59.637984] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-18T19:22:59.719516] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-18T19:23:00.357990] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-18T19:23:00.360291] [INFO ] [REMOTE ] GUG: Full fetch complete (19994 records). [2025-09-18T19:23:00.360368] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-18T19:23:00.523481] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-18T19:23:00.744718] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-18T19:23:00.744807] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-18T19:23:00.745270] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-18T19:23:00.745313] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-18T19:23:00.745934] [DEBUG] [LOCAL ] GUG: Trimmed 19994 records to 12397 (keeping 200 days of data) [2025-09-18T19:23:00.828274] [DEBUG] [LOCAL ] GUG: Primary data saved (12397 records). [2025-09-18T19:23:00.828443] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-18T19:23:00.828544] [INFO ] [MAIN ] Update Progress: 979/2372 symbols completed. GUG took 24.4s. Estimated remaining: 3h 23m 25s. Rate: 6.8 symbols/min [2025-09-18T19:23:00.998076] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:23:01.014391] [DEBUG] [LOCAL ] GUT: Loaded 15620 existing records from primary storage. [2025-09-18T19:23:01.014517] [INFO ] [MAIN ] GUT: Loaded 15620 existing records. [2025-09-18T19:23:01.195002] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:23:01.195277] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-18T19:23:01.195326] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-18T19:23:01.196183] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-09-18T19:23:01.196246] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-18T19:23:01.324602] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-18T19:23:01.586756] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:23:01.894547] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-18T19:23:02.119583] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-11. [2025-09-18T19:23:02.919545] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-18T19:23:04.372360] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T19:23:04.386269] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-18T19:23:04.441612] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (6.32 seconds). [2025-09-18T19:23:04.519707] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-18T19:23:05.016934] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-11 (2.90 seconds). [2025-09-18T19:23:05.094998] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (3.77 seconds). [2025-09-18T19:23:05.101701] [INFO ] [REMOTE ] GTLS: Full fetch complete (61369 records). [2025-09-18T19:23:05.101821] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-18T19:23:05.323693] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-09-18T19:23:05.574072] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-18T19:23:05.595058] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-18T19:23:05.595264] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-18T19:23:05.596158] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-18T19:23:05.596246] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-18T19:23:05.598680] [DEBUG] [LOCAL ] GTLS: Trimmed 61369 records to 43542 (keeping 200 days of data) [2025-09-18T19:23:05.841484] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-18T19:23:05.907733] [DEBUG] [LOCAL ] GTLS: Primary data saved (43542 records). [2025-09-18T19:23:05.907870] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-18T19:23:05.907958] [INFO ] [MAIN ] Update Progress: 980/2372 symbols completed. GTLS took 40.2s. Estimated remaining: 3h 23m 11s. Rate: 6.9 symbols/min [2025-09-18T19:23:06.077589] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:23:06.112206] [DEBUG] [LOCAL ] GVA: Loaded 34125 existing records from primary storage. [2025-09-18T19:23:06.112341] [INFO ] [MAIN ] GVA: Loaded 34125 existing records. [2025-09-18T19:23:06.124680] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-18T19:23:06.307919] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:23:06.308245] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-18T19:23:06.308312] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-18T19:23:06.309484] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-18T19:23:06.309551] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-18T19:23:06.672926] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-18T19:23:06.783723] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:23:06.919606] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-18T19:23:07.221588] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-18T19:23:07.719588] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-18T19:23:08.283786] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-18T19:23:08.290785] [INFO ] [REMOTE ] GTN: Full fetch complete (66248 records). [2025-09-18T19:23:08.290945] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-18T19:23:08.525729] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-09-18T19:23:08.687966] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-18T19:23:08.688144] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-18T19:23:08.689034] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-18T19:23:08.689113] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-18T19:23:08.715720] [DEBUG] [LOCAL ] GTN: Trimmed 66248 records to 46167 (keeping 200 days of data) [2025-09-18T19:23:08.717197] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-18T19:23:09.015516] [DEBUG] [LOCAL ] GTN: Primary data saved (46167 records). [2025-09-18T19:23:09.015699] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-18T19:23:09.015799] [INFO ] [MAIN ] Update Progress: 981/2372 symbols completed. GTN took 37.9s. Estimated remaining: 3h 22m 54s. Rate: 6.9 symbols/min [2025-09-18T19:23:09.193813] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:23:09.210693] [DEBUG] [LOCAL ] GWH: Loaded 15043 existing records from primary storage. [2025-09-18T19:23:09.210850] [INFO ] [MAIN ] GWH: Loaded 15043 existing records. [2025-09-18T19:23:09.325548] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-11. [2025-09-18T19:23:09.414359] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:23:09.414668] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-18T19:23:09.414732] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-18T19:23:09.415262] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-09-18T19:23:09.415323] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-18T19:23:09.733066] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-18T19:23:09.797722] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:23:10.119540] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-18T19:23:10.479144] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-18T19:23:10.627347] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-18T19:23:10.919569] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-11. [2025-09-18T19:23:10.989946] [DEBUG] [REMOTE ] GWH: Error fetching primary data for 2024-11: 'API call returned an empty response.' [2025-09-18T19:23:10.990278] [WARN ] [REMOTE ] GWH: No data returned for month 2024-11 [2025-09-18T19:23:11.719608] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-09-18T19:23:12.356915] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-18T19:23:12.519603] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-18T19:23:13.319603] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-09-18T19:23:13.397075] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-18T19:23:14.119571] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-09-18T19:23:14.400455] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-18T19:23:14.919549] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-18T19:23:14.977954] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-18T19:23:15.719561] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-09-18T19:23:15.909823] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-18T19:23:15.914078] [INFO ] [REMOTE ] GTY: Full fetch complete (42955 records). [2025-09-18T19:23:15.914182] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-18T19:23:16.313129] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-18T19:23:16.313221] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-18T19:23:16.313939] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-18T19:23:16.314007] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-18T19:23:16.315125] [DEBUG] [LOCAL ] GTY: Trimmed 42955 records to 30629 (keeping 200 days of data) [2025-09-18T19:23:16.520860] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-18T19:23:16.520683] [DEBUG] [LOCAL ] GTY: Primary data saved (30629 records). [2025-09-18T19:23:16.521608] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-18T19:23:16.522712] [INFO ] [MAIN ] Update Progress: 982/2372 symbols completed. GTY took 41.6s. Estimated remaining: 3h 22m 43s. Rate: 6.9 symbols/min [2025-09-18T19:23:16.717460] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:23:16.762474] [DEBUG] [LOCAL ] GWRE: Loaded 41449 existing records from primary storage. [2025-09-18T19:23:16.762628] [INFO ] [MAIN ] GWRE: Loaded 41449 existing records. [2025-09-18T19:23:16.952053] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:23:16.952350] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-18T19:23:16.952404] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-18T19:23:16.960990] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-18T19:23:16.973157] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-18T19:23:17.034617] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-18T19:23:17.324812] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-18T19:23:17.397728] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:23:17.409934] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-18T19:23:17.997061] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-18T19:23:18.119591] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-18T19:23:18.893261] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-18T19:23:18.919540] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-18T19:23:19.514621] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-18T19:23:19.719554] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-18T19:23:20.519559] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-18T19:23:20.640803] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-18T19:23:21.319552] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-18T19:23:21.496084] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-18T19:23:22.119557] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-11. [2025-09-18T19:23:22.487372] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-18T19:23:22.919598] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-18T19:23:23.351775] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-18T19:23:23.624459] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-18T19:23:23.719566] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-18T19:23:24.519569] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-09-18T19:23:25.187582] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-18T19:23:25.319564] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-18T19:23:25.794294] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-18T19:23:26.119598] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-09-18T19:23:26.627077] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-18T19:23:26.919560] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-18T19:23:27.673031] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-18T19:23:27.722214] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-18T19:23:27.727821] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T19:23:28.519589] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-18T19:23:28.790103] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-18T19:23:29.161185] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-18T19:23:29.319574] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-18T19:23:30.119561] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-18T19:23:30.921621] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-18T19:23:30.923269] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-18T19:23:31.115029] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-18T19:23:31.634559] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-18T19:23:31.719591] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-18T19:23:32.519567] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-18T19:23:32.730928] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-18T19:23:33.319570] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-18T19:23:33.836946] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T19:23:34.044421] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-18T19:23:34.048128] [INFO ] [REMOTE ] GWH: Full fetch complete (20348 records). [2025-09-18T19:23:34.048229] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-18T19:23:34.124638] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-18T19:23:34.285456] [WARN ] [VALIDATOR ] GWH: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-18T19:23:34.285892] [FATAL] [MAIN ] GWH: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:23:34.285965] [WARN ] [MAIN ] GWH: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:23:34.286038] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-18T19:23:34.286124] [DEBUG] [LOCAL ] GWH: No primary data file found to delete. [2025-09-18T19:23:34.286181] [INFO ] [LOCAL ] GWH: Starting deletion of derivative data. [2025-09-18T19:23:34.286732] [DEBUG] [LOCAL ] GWH: Deleted derivative data file. [2025-09-18T19:23:34.286847] [INFO ] [MAIN ] Update Progress: 983/2372 symbols completed. GWH took 25.3s. Estimated remaining: 3h 22m 47s. Rate: 6.8 symbols/min [2025-09-18T19:23:34.461733] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:23:34.483014] [DEBUG] [LOCAL ] GWW: Loaded 20089 existing records from primary storage. [2025-09-18T19:23:34.483169] [INFO ] [MAIN ] GWW: Loaded 20089 existing records. [2025-09-18T19:23:34.665565] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:23:34.665832] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-18T19:23:34.665882] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-18T19:23:34.666735] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-18T19:23:34.666797] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-18T19:23:34.924633] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-18T19:23:34.979820] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-18T19:23:35.035340] [INFO ] [REMOTE ] GUT: Full fetch complete (23119 records). [2025-09-18T19:23:35.043684] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-18T19:23:35.049629] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:23:35.420267] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-09-18T19:23:35.420349] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-09-18T19:23:35.420872] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-09-18T19:23:35.420939] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-09-18T19:23:35.421583] [DEBUG] [LOCAL ] GUT: Trimmed 23119 records to 15707 (keeping 200 days of data) [2025-09-18T19:23:35.515034] [DEBUG] [LOCAL ] GUT: Primary data saved (15707 records). [2025-09-18T19:23:35.515191] [INFO ] [MAIN ] GUT: Full history saved. [2025-09-18T19:23:35.515283] [INFO ] [MAIN ] Update Progress: 984/2372 symbols completed. GUT took 34.7s. Estimated remaining: 3h 22m 28s. Rate: 6.9 symbols/min [2025-09-18T19:23:35.686342] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:23:35.719557] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-11. [2025-09-18T19:23:35.737160] [DEBUG] [LOCAL ] GXO: Loaded 47860 existing records from primary storage. [2025-09-18T19:23:35.737308] [INFO ] [MAIN ] GXO: Loaded 47860 existing records. [2025-09-18T19:23:35.922367] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:23:35.922607] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-18T19:23:35.922705] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-18T19:23:35.923770] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-18T19:23:35.923832] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-18T19:23:36.288049] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:23:36.384948] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T19:23:36.519538] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-18T19:23:36.685297] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-18T19:23:37.319555] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-09-18T19:23:37.694267] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-18T19:23:38.052277] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-18T19:23:38.119513] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-09-18T19:23:38.919574] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-11. [2025-09-18T19:23:39.229335] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-18T19:23:39.719579] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-18T19:23:40.147355] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-18T19:23:40.519542] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-09-18T19:23:40.617354] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-18T19:23:41.319543] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-18T19:23:41.931425] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-18T19:23:42.089081] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-18T19:23:42.119503] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-18T19:23:42.919544] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-09-18T19:23:43.141585] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-18T19:23:43.719592] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-18T19:23:44.494747] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-18T19:23:44.524695] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-18T19:23:44.545733] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-18T19:23:45.319563] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-18T19:23:46.084131] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-18T19:23:46.119517] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-18T19:23:46.180170] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-18T19:23:46.912283] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-18T19:23:46.919486] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-18T19:23:47.719510] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-18T19:23:48.092085] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-18T19:23:48.519558] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-18T19:23:48.734058] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-18T19:23:49.319532] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-18T19:23:49.447833] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-18T19:23:49.451073] [INFO ] [REMOTE ] GWW: Full fetch complete (29068 records). [2025-09-18T19:23:49.451174] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-18T19:23:49.858826] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-18T19:23:49.858997] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-18T19:23:49.859566] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-18T19:23:49.859622] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-18T19:23:49.861009] [DEBUG] [LOCAL ] GWW: Trimmed 29068 records to 20219 (keeping 200 days of data) [2025-09-18T19:23:50.012796] [DEBUG] [LOCAL ] GWW: Primary data saved (20219 records). [2025-09-18T19:23:50.012928] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-18T19:23:50.013025] [INFO ] [MAIN ] Update Progress: 985/2372 symbols completed. GWW took 15.7s. Estimated remaining: 3h 22m 27s. Rate: 6.9 symbols/min [2025-09-18T19:23:50.124693] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-18T19:23:50.187211] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:23:50.191237] [DEBUG] [LOCAL ] GYLD: Loaded 1528 existing records from primary storage. [2025-09-18T19:23:50.191321] [INFO ] [MAIN ] GYLD: Loaded 1528 existing records. [2025-09-18T19:23:50.377828] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:23:50.378102] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-18T19:23:50.378150] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-18T19:23:50.378397] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-18T19:23:50.378468] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-18T19:23:50.746616] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:23:50.930989] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-11. [2025-09-18T19:23:50.937042] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-18T19:23:51.287389] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-11 (0.36 seconds). [2025-09-18T19:23:51.439950] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T19:23:51.719565] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-18T19:23:52.519581] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-18T19:23:53.072899] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-18T19:23:53.319539] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-18T19:23:53.867594] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-18T19:23:54.119573] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-18T19:23:54.775575] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-18T19:23:54.919540] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-09-18T19:23:55.142952] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-18T19:23:55.227988] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-18T19:23:55.719560] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-18T19:23:56.519589] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-18T19:23:57.319505] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-18T19:23:57.492463] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-18T19:23:57.881489] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-18T19:23:57.888138] [INFO ] [REMOTE ] GWRE: Full fetch complete (61698 records). [2025-09-18T19:23:57.888276] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-18T19:23:58.124826] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-18T19:23:58.321126] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-18T19:23:58.321219] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-18T19:23:58.322052] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-18T19:23:58.322116] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-18T19:23:58.323580] [DEBUG] [LOCAL ] GWRE: Trimmed 61698 records to 41721 (keeping 200 days of data) [2025-09-18T19:23:58.433075] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-18T19:23:58.439033] [INFO ] [REMOTE ] GVA: Full fetch complete (48784 records). [2025-09-18T19:23:58.439732] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-18T19:23:58.920692] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-09-18T19:23:58.990235] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-18T19:23:58.990986] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-18T19:23:58.992869] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-18T19:23:58.993300] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-18T19:23:58.997564] [DEBUG] [LOCAL ] GVA: Trimmed 48784 records to 34379 (keeping 200 days of data) [2025-09-18T19:23:59.147859] [DEBUG] [LOCAL ] GWRE: Primary data saved (41721 records). [2025-09-18T19:23:59.149761] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-18T19:23:59.150250] [INFO ] [MAIN ] Update Progress: 986/2372 symbols completed. GWRE took 42.6s. Estimated remaining: 3h 22m 19s. Rate: 6.9 symbols/min [2025-09-18T19:23:59.344935] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-18T19:23:59.399931] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:23:59.553955] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-18T19:23:59.598821] [DEBUG] [LOCAL ] H: Loaded 45097 existing records from primary storage. [2025-09-18T19:23:59.600590] [INFO ] [MAIN ] H: Loaded 45097 existing records. [2025-09-18T19:23:59.721449] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-18T19:23:59.775682] [DEBUG] [LOCAL ] GVA: Primary data saved (34379 records). [2025-09-18T19:23:59.791921] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-18T19:23:59.792200] [INFO ] [MAIN ] Update Progress: 987/2372 symbols completed. GVA took 53.9s. Estimated remaining: 3h 21m 59s. Rate: 6.9 symbols/min [2025-09-18T19:24:00.007068] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:24:00.024901] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-18T19:24:00.025055] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-18T19:24:00.032282] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-09-18T19:24:00.032750] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-18T19:24:00.215131] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-18T19:24:00.287863] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:24:00.534981] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-18T19:24:00.678381] [DEBUG] [LOCAL ] HAE: Loaded 39466 existing records from primary storage. [2025-09-18T19:24:00.689443] [INFO ] [MAIN ] HAE: Loaded 39466 existing records. [2025-09-18T19:24:00.754226] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:24:00.944951] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:24:00.945188] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-18T19:24:00.945239] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-18T19:24:00.946321] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-18T19:24:00.946382] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-18T19:24:01.031469] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-18T19:24:01.317771] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:24:01.319497] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-11. [2025-09-18T19:24:02.119545] [INFO ] [REMOTE ] H: Fetching primary data for 2024-11. [2025-09-18T19:24:02.919551] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-18T19:24:03.616913] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-11 (2.30 seconds). [2025-09-18T19:24:03.719546] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-09-18T19:24:04.398224] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-11 (2.28 seconds). [2025-09-18T19:24:04.519562] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-09-18T19:24:04.603310] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-18T19:24:04.985509] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-18T19:24:05.319550] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-09-18T19:24:06.011330] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T19:24:06.119579] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-18T19:24:06.327237] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-18T19:24:06.402493] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-18T19:24:06.919575] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-18T19:24:07.719564] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-09-18T19:24:08.318311] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T19:24:08.519563] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-18T19:24:08.728231] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-18T19:24:08.769730] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-09-18T19:24:09.319554] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-18T19:24:10.119545] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-18T19:24:10.890890] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T19:24:10.919520] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-18T19:24:11.458938] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-18T19:24:11.719542] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-18T19:24:11.875007] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-18T19:24:12.519548] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-18T19:24:13.319563] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-18T19:24:14.119523] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-18T19:24:14.288888] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-18T19:24:14.330579] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-18T19:24:14.372486] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-18T19:24:14.919557] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-18T19:24:15.329095] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-18T19:24:15.375853] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-18T19:24:15.719580] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-18T19:24:16.205752] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-18T19:24:16.519558] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-18T19:24:17.319550] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-18T19:24:17.546242] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-18T19:24:18.119554] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-18T19:24:18.552524] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-18T19:24:18.553449] [INFO ] [REMOTE ] GYLD: Full fetch complete (2004 records). [2025-09-18T19:24:18.553523] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-18T19:24:18.928122] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-18T19:24:18.932400] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-18T19:24:18.933846] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-18T19:24:18.933976] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-18T19:24:18.934050] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-18T19:24:18.934732] [DEBUG] [LOCAL ] GYLD: Trimmed 2004 records to 1538 (keeping 200 days of data) [2025-09-18T19:24:18.945864] [DEBUG] [LOCAL ] GYLD: Primary data saved (1538 records). [2025-09-18T19:24:18.945940] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-18T19:24:18.946075] [INFO ] [MAIN ] Update Progress: 988/2372 symbols completed. GYLD took 28.9s. Estimated remaining: 3h 22m 5s. Rate: 6.8 symbols/min [2025-09-18T19:24:19.129874] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:24:19.159624] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-18T19:24:19.206990] [DEBUG] [LOCAL ] HAFN: Loaded 43919 existing records from primary storage. [2025-09-18T19:24:19.207184] [INFO ] [MAIN ] HAFN: Loaded 43919 existing records. [2025-09-18T19:24:19.386893] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:24:19.387141] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-18T19:24:19.387190] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-18T19:24:19.388753] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-18T19:24:19.388817] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-18T19:24:19.728482] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-18T19:24:19.764985] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:24:20.519568] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-11. [2025-09-18T19:24:20.650297] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-18T19:24:20.657515] [INFO ] [REMOTE ] GXO: Full fetch complete (69870 records). [2025-09-18T19:24:20.657672] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-18T19:24:21.048188] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-18T19:24:21.048293] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-18T19:24:21.049231] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-18T19:24:21.049333] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-18T19:24:21.051080] [DEBUG] [LOCAL ] GXO: Trimmed 69870 records to 48164 (keeping 200 days of data) [2025-09-18T19:24:21.223060] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-18T19:24:21.324308] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-18T19:24:21.408145] [DEBUG] [LOCAL ] GXO: Primary data saved (48164 records). [2025-09-18T19:24:21.408284] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-18T19:24:21.410296] [INFO ] [MAIN ] Update Progress: 989/2372 symbols completed. GXO took 45.9s. Estimated remaining: 3h 21m 47s. Rate: 6.9 symbols/min [2025-09-18T19:24:21.581410] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:24:21.652621] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-09-18T19:24:21.652792] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-09-18T19:24:21.832367] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:24:21.832638] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-18T19:24:21.832732] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-18T19:24:21.833960] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-18T19:24:21.834026] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-18T19:24:22.138634] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-18T19:24:22.246295] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-18T19:24:22.261144] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:24:22.697592] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T19:24:22.919613] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-09-18T19:24:23.349844] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-18T19:24:23.719558] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-11. [2025-09-18T19:24:24.519537] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-18T19:24:24.790823] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-18T19:24:25.319605] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-18T19:24:25.477780] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-18T19:24:25.572436] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-18T19:24:26.119545] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-18T19:24:26.449984] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-18T19:24:26.919539] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-18T19:24:27.719531] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-09-18T19:24:27.747464] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-18T19:24:27.754490] [INFO ] [REMOTE ] HAE: Full fetch complete (57311 records). [2025-09-18T19:24:27.754784] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-18T19:24:28.196580] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-18T19:24:28.197095] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-18T19:24:28.198963] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-18T19:24:28.199181] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-18T19:24:28.206921] [DEBUG] [LOCAL ] HAE: Trimmed 57311 records to 39825 (keeping 200 days of data) [2025-09-18T19:24:28.339256] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-18T19:24:28.510635] [DEBUG] [LOCAL ] HAE: Primary data saved (39825 records). [2025-09-18T19:24:28.510821] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-18T19:24:28.510979] [INFO ] [MAIN ] Update Progress: 990/2372 symbols completed. HAE took 28.7s. Estimated remaining: 3h 21m 36s. Rate: 6.9 symbols/min [2025-09-18T19:24:28.524724] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-09-18T19:24:28.693088] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:24:28.741430] [DEBUG] [LOCAL ] HASI: Loaded 47267 existing records from primary storage. [2025-09-18T19:24:28.741579] [INFO ] [MAIN ] HASI: Loaded 47267 existing records. [2025-09-18T19:24:28.924794] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:24:28.925318] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-18T19:24:28.925384] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-18T19:24:28.926717] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-09-18T19:24:28.926780] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-18T19:24:29.282702] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:24:29.322179] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-18T19:24:29.337132] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-18T19:24:30.119549] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-09-18T19:24:30.315776] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-18T19:24:30.464209] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T19:24:30.919563] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-18T19:24:31.556080] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-18T19:24:31.719519] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-18T19:24:32.519547] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-18T19:24:32.614303] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-18T19:24:33.269080] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-18T19:24:33.319505] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-18T19:24:34.119555] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-11. [2025-09-18T19:24:34.397388] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-18T19:24:34.404050] [INFO ] [REMOTE ] H: Full fetch complete (61487 records). [2025-09-18T19:24:34.404181] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-18T19:24:34.820761] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-09-18T19:24:34.820860] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-09-18T19:24:34.821707] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-09-18T19:24:34.821777] [DEBUG] [LOCAL ] H: Saving primary data. [2025-09-18T19:24:34.823288] [DEBUG] [LOCAL ] H: Trimmed 61487 records to 45362 (keeping 200 days of data) [2025-09-18T19:24:34.931690] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-18T19:24:35.101501] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-18T19:24:35.177452] [DEBUG] [LOCAL ] H: Primary data saved (45362 records). [2025-09-18T19:24:35.177594] [INFO ] [MAIN ] H: Full history saved. [2025-09-18T19:24:35.177741] [INFO ] [MAIN ] Update Progress: 991/2372 symbols completed. H took 36.0s. Estimated remaining: 3h 21m 24s. Rate: 6.9 symbols/min [2025-09-18T19:24:35.360014] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:24:35.391475] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T19:24:35.443393] [DEBUG] [LOCAL ] HAYW: Loaded 48738 existing records from primary storage. [2025-09-18T19:24:35.443567] [INFO ] [MAIN ] HAYW: Loaded 48738 existing records. [2025-09-18T19:24:35.623623] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:24:35.623929] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-18T19:24:35.623980] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-18T19:24:35.625112] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-09-18T19:24:35.625175] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-18T19:24:35.724783] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-09-18T19:24:35.997529] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:24:36.519528] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-18T19:24:36.672501] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-18T19:24:37.035874] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T19:24:37.319611] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-09-18T19:24:38.119576] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-18T19:24:38.458482] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-18T19:24:38.531939] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-18T19:24:38.919570] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-18T19:24:39.530581] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-18T19:24:39.719557] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-18T19:24:40.519546] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-11. [2025-09-18T19:24:40.556957] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-18T19:24:41.275379] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T19:24:41.319501] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-18T19:24:41.825558] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-18T19:24:42.119679] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-18T19:24:42.543173] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T19:24:42.919567] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-09-18T19:24:43.211182] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-18T19:24:43.719545] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-18T19:24:44.519562] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-18T19:24:44.583705] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-18T19:24:45.041718] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T19:24:45.319581] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-09-18T19:24:46.118805] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-18T19:24:46.128403] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-18T19:24:46.889618] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-18T19:24:46.919495] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-18T19:24:47.373517] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-18T19:24:47.719607] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-18T19:24:48.128732] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-18T19:24:48.519607] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-18T19:24:48.932404] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-18T19:24:49.319539] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-18T19:24:50.119508] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-18T19:24:50.314822] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-18T19:24:50.919573] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-18T19:24:50.996516] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-18T19:24:51.235318] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T19:24:51.241777] [INFO ] [REMOTE ] HAFN: Full fetch complete (66099 records). [2025-09-18T19:24:51.241918] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-18T19:24:51.634480] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-18T19:24:51.634568] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-18T19:24:51.635393] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-18T19:24:51.635457] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-18T19:24:51.636830] [DEBUG] [LOCAL ] HAFN: Trimmed 66099 records to 44198 (keeping 200 days of data) [2025-09-18T19:24:51.733781] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-18T19:24:51.917708] [DEBUG] [LOCAL ] HAFN: Primary data saved (44198 records). [2025-09-18T19:24:51.917868] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-18T19:24:51.917994] [INFO ] [MAIN ] Update Progress: 992/2372 symbols completed. HAFN took 33.0s. Estimated remaining: 3h 21m 27s. Rate: 6.9 symbols/min [2025-09-18T19:24:52.121922] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:24:52.134067] [DEBUG] [LOCAL ] HBB: Loaded 6974 existing records from primary storage. [2025-09-18T19:24:52.134223] [INFO ] [MAIN ] HBB: Loaded 6974 existing records. [2025-09-18T19:24:52.439265] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:24:52.440617] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-18T19:24:52.444398] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-18T19:24:52.444908] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-18T19:24:52.459613] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-09-18T19:24:52.459747] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-18T19:24:52.525200] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-18T19:24:53.020155] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:24:53.116699] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-18T19:24:53.319584] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-18T19:24:53.881507] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-18T19:24:54.119562] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-18T19:24:54.919524] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-11. [2025-09-18T19:24:54.958030] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T19:24:55.361048] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-18T19:24:55.719544] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-18T19:24:55.761076] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-18T19:24:56.519545] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-09-18T19:24:57.252880] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-18T19:24:57.277725] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-18T19:24:57.285276] [INFO ] [REMOTE ] HAL: Full fetch complete (77631 records). [2025-09-18T19:24:57.285428] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-18T19:24:57.324778] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-09-18T19:24:57.704205] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-18T19:24:57.704334] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-18T19:24:57.705450] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-18T19:24:57.705544] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-18T19:24:57.707389] [DEBUG] [LOCAL ] HAL: Trimmed 77631 records to 54108 (keeping 200 days of data) [2025-09-18T19:24:57.939608] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-18T19:24:58.059666] [DEBUG] [LOCAL ] HAL: Primary data saved (54108 records). [2025-09-18T19:24:58.059834] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-18T19:24:58.060633] [INFO ] [MAIN ] Update Progress: 993/2372 symbols completed. HAL took 36.7s. Estimated remaining: 3h 21m 14s. Rate: 6.9 symbols/min [2025-09-18T19:24:58.124809] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-18T19:24:58.242815] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:24:58.296780] [DEBUG] [LOCAL ] HBI: Loaded 53042 existing records from primary storage. [2025-09-18T19:24:58.296956] [INFO ] [MAIN ] HBI: Loaded 53042 existing records. [2025-09-18T19:24:58.473977] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:24:58.474218] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-18T19:24:58.474267] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-18T19:24:58.475228] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-18T19:24:58.475288] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-18T19:24:58.773979] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-18T19:24:58.847421] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:24:58.919500] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-11. [2025-09-18T19:24:59.719562] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-18T19:25:00.519565] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-18T19:25:00.626212] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-18T19:25:00.943797] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-18T19:25:01.054316] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-18T19:25:01.319558] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-18T19:25:02.119567] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-18T19:25:02.831279] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-18T19:25:02.919521] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-18T19:25:03.034013] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-18T19:25:03.719551] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-18T19:25:04.225331] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-18T19:25:04.519590] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-18T19:25:05.295958] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-18T19:25:05.319493] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-18T19:25:05.339927] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-18T19:25:06.119563] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-18T19:25:06.919575] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-18T19:25:06.958445] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-18T19:25:07.388006] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-18T19:25:07.395862] [INFO ] [REMOTE ] HASI: Full fetch complete (67836 records). [2025-09-18T19:25:07.395984] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-18T19:25:07.520402] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-18T19:25:07.724660] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-09-18T19:25:07.805728] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-09-18T19:25:07.805813] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-09-18T19:25:07.806618] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-09-18T19:25:07.806693] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-09-18T19:25:07.810728] [DEBUG] [LOCAL ] HASI: Trimmed 67836 records to 47604 (keeping 200 days of data) [2025-09-18T19:25:08.094134] [DEBUG] [LOCAL ] HASI: Primary data saved (47604 records). [2025-09-18T19:25:08.094275] [INFO ] [MAIN ] HASI: Full history saved. [2025-09-18T19:25:08.094367] [INFO ] [MAIN ] Update Progress: 994/2372 symbols completed. HASI took 39.6s. Estimated remaining: 3h 21m 7s. Rate: 6.9 symbols/min [2025-09-18T19:25:08.279480] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:25:08.331129] [DEBUG] [LOCAL ] HBM: Loaded 52913 existing records from primary storage. [2025-09-18T19:25:08.331303] [INFO ] [MAIN ] HBM: Loaded 52913 existing records. [2025-09-18T19:25:08.510252] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:25:08.510520] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-18T19:25:08.510573] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-18T19:25:08.511675] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-18T19:25:08.511736] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-18T19:25:08.524613] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-18T19:25:08.887755] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:25:09.319599] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-18T19:25:09.513672] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-18T19:25:09.787495] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-18T19:25:09.929677] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-18T19:25:10.119535] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-18T19:25:10.838349] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-18T19:25:10.919501] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-18T19:25:11.448368] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-18T19:25:11.449461] [INFO ] [REMOTE ] HBB: Full fetch complete (10090 records). [2025-09-18T19:25:11.449533] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-18T19:25:11.724805] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-11. [2025-09-18T19:25:11.824130] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-09-18T19:25:11.824276] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-09-18T19:25:11.824565] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-09-18T19:25:11.824607] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-09-18T19:25:11.825287] [DEBUG] [LOCAL ] HBB: Trimmed 10090 records to 7008 (keeping 200 days of data) [2025-09-18T19:25:11.868738] [DEBUG] [LOCAL ] HBB: Primary data saved (7008 records). [2025-09-18T19:25:11.868865] [INFO ] [MAIN ] HBB: Full history saved. [2025-09-18T19:25:11.868951] [INFO ] [MAIN ] Update Progress: 995/2372 symbols completed. HBB took 20.0s. Estimated remaining: 3h 20m 52s. Rate: 6.9 symbols/min [2025-09-18T19:25:12.042155] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:25:12.095098] [DEBUG] [LOCAL ] HCA: Loaded 47402 existing records from primary storage. [2025-09-18T19:25:12.095253] [INFO ] [MAIN ] HCA: Loaded 47402 existing records. [2025-09-18T19:25:12.286379] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:25:12.286739] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-18T19:25:12.286799] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-18T19:25:12.287960] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-18T19:25:12.288023] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-18T19:25:12.524980] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-09-18T19:25:12.688115] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:25:13.148702] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T19:25:13.319536] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-09-18T19:25:13.857615] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-18T19:25:14.119569] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-18T19:25:14.547571] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T19:25:14.919548] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-09-18T19:25:15.566376] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T19:25:15.719566] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-18T19:25:16.151671] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-18T19:25:16.519560] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-18T19:25:17.108414] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-18T19:25:17.118730] [INFO ] [REMOTE ] HAYW: Full fetch complete (70868 records). [2025-09-18T19:25:17.118930] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-18T19:25:17.324691] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-11. [2025-09-18T19:25:17.522067] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-09-18T19:25:17.522174] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-09-18T19:25:17.523050] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-09-18T19:25:17.523119] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-09-18T19:25:17.524780] [DEBUG] [LOCAL ] HAYW: Trimmed 70868 records to 49112 (keeping 200 days of data) [2025-09-18T19:25:17.853847] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T19:25:17.868111] [DEBUG] [LOCAL ] HAYW: Primary data saved (49112 records). [2025-09-18T19:25:17.868242] [INFO ] [MAIN ] HAYW: Full history saved. [2025-09-18T19:25:17.868351] [INFO ] [MAIN ] Update Progress: 996/2372 symbols completed. HAYW took 42.7s. Estimated remaining: 3h 20m 39s. Rate: 6.9 symbols/min [2025-09-18T19:25:18.040412] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:25:18.082930] [DEBUG] [LOCAL ] HCC: Loaded 45426 existing records from primary storage. [2025-09-18T19:25:18.083106] [INFO ] [MAIN ] HCC: Loaded 45426 existing records. [2025-09-18T19:25:18.125527] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-18T19:25:18.267260] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:25:18.267548] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-18T19:25:18.267597] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-18T19:25:18.268857] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-18T19:25:18.268919] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-18T19:25:18.675279] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:25:18.721918] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-18T19:25:18.919540] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-11. [2025-09-18T19:25:19.354377] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T19:25:19.719555] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-18T19:25:20.519567] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-09-18T19:25:20.578872] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-18T19:25:21.270929] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-18T19:25:21.319505] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-18T19:25:21.827545] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T19:25:22.119565] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-09-18T19:25:22.919591] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-18T19:25:23.069395] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-18T19:25:23.489264] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-18T19:25:23.719544] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-18T19:25:24.217737] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-18T19:25:24.519541] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-18T19:25:25.035553] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-18T19:25:25.319541] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-18T19:25:26.119537] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-18T19:25:26.400316] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-18T19:25:26.870162] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-18T19:25:26.919491] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-18T19:25:27.727214] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-09-18T19:25:27.753685] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-18T19:25:28.519570] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-18T19:25:28.519498] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-18T19:25:28.825426] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-18T19:25:29.319578] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-09-18T19:25:29.780617] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-18T19:25:30.119561] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-18T19:25:30.851108] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-18T19:25:30.919539] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-18T19:25:31.599428] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-18T19:25:31.719546] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-18T19:25:32.519553] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-18T19:25:32.554161] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-18T19:25:33.025492] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-18T19:25:33.319561] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-18T19:25:33.896325] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-18T19:25:34.119587] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-18T19:25:34.899066] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-18T19:25:34.919505] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-18T19:25:35.719616] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-18T19:25:35.769993] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-18T19:25:36.206056] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-18T19:25:36.216535] [INFO ] [REMOTE ] HBI: Full fetch complete (76755 records). [2025-09-18T19:25:36.216773] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-18T19:25:36.526421] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-18T19:25:36.631923] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-18T19:25:36.632045] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-18T19:25:36.633017] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-18T19:25:36.633081] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-18T19:25:36.634664] [DEBUG] [LOCAL ] HBI: Trimmed 76755 records to 53417 (keeping 200 days of data) [2025-09-18T19:25:36.942167] [DEBUG] [LOCAL ] HBI: Primary data saved (53417 records). [2025-09-18T19:25:36.942321] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-18T19:25:36.943141] [INFO ] [MAIN ] Update Progress: 997/2372 symbols completed. HBI took 38.9s. Estimated remaining: 3h 20m 45s. Rate: 6.8 symbols/min [2025-09-18T19:25:37.068348] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-18T19:25:37.319574] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-18T19:25:38.013001] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T19:25:38.119577] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-18T19:25:38.705935] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T19:25:38.919587] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-18T19:25:39.564386] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-18T19:25:39.572037] [INFO ] [REMOTE ] HBM: Full fetch complete (75857 records). [2025-09-18T19:25:39.572226] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-18T19:25:39.724717] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-18T19:25:40.012064] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-18T19:25:40.012320] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-18T19:25:40.013288] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-18T19:25:40.013371] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-18T19:25:40.015261] [DEBUG] [LOCAL ] HBM: Trimmed 75857 records to 53302 (keeping 200 days of data) [2025-09-18T19:25:40.146225] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-18T19:25:40.372270] [DEBUG] [LOCAL ] HBM: Primary data saved (53302 records). [2025-09-18T19:25:40.372414] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-18T19:25:40.372501] [INFO ] [MAIN ] Update Progress: 998/2372 symbols completed. HBM took 32.3s. Estimated remaining: 3h 20m 29s. Rate: 6.9 symbols/min [2025-09-18T19:25:40.519605] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-18T19:25:41.019176] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-18T19:25:41.319622] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-18T19:25:41.941777] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-18T19:25:42.119543] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-18T19:25:42.523429] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-18T19:25:42.919555] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-18T19:25:43.666387] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-18T19:25:43.719496] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-18T19:25:44.069436] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-18T19:25:44.519553] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-18T19:25:45.140173] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-18T19:25:45.147052] [INFO ] [REMOTE ] HCA: Full fetch complete (69163 records). [2025-09-18T19:25:45.147247] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-18T19:25:45.748938] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-18T19:25:45.749190] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-18T19:25:45.750231] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-18T19:25:45.750375] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-18T19:25:45.752897] [DEBUG] [LOCAL ] HCA: Trimmed 69163 records to 47753 (keeping 200 days of data) [2025-09-18T19:25:45.942717] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-18T19:25:45.970980] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-18T19:25:46.235947] [DEBUG] [LOCAL ] HCA: Primary data saved (47753 records). [2025-09-18T19:25:46.236130] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-18T19:25:46.236263] [INFO ] [MAIN ] Update Progress: 999/2372 symbols completed. HCA took 34.4s. Estimated remaining: 3h 20m 16s. Rate: 6.9 symbols/min [2025-09-18T19:25:47.625886] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-18T19:25:47.632426] [INFO ] [REMOTE ] HCC: Full fetch complete (64003 records). [2025-09-18T19:25:47.632563] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-18T19:25:48.121152] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-18T19:25:48.121296] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-18T19:25:48.122184] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-18T19:25:48.122250] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-18T19:25:48.123795] [DEBUG] [LOCAL ] HCC: Trimmed 64003 records to 45777 (keeping 200 days of data) [2025-09-18T19:25:48.425299] [DEBUG] [LOCAL ] HCC: Primary data saved (45777 records). [2025-09-18T19:25:48.425525] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-18T19:25:48.425674] [INFO ] [MAIN ] Update Progress: 1000/2372 symbols completed. HCC took 30.6s. Estimated remaining: 3h 19m 58s. Rate: 6.9 symbols/min [2025-09-18T19:25:49.151338] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:25:49.145054] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:25:49.190995] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:25:49.195002] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:25:49.195834] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-18T19:25:49.196118] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-18T19:25:49.196415] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-18T19:25:49.196475] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-18T19:25:49.196522] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-18T19:25:49.196993] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-18T19:25:49.358969] [DEBUG] [LOCAL ] HCI: Loaded 13942 existing records from primary storage. [2025-09-18T19:25:49.375366] [INFO ] [MAIN ] HCI: Loaded 13942 existing records. [2025-09-18T19:25:49.726307] [DEBUG] [LOCAL ] HDB: Loaded 51931 existing records from primary storage. [2025-09-18T19:25:49.768616] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:25:49.775115] [INFO ] [MAIN ] HDB: Loaded 51931 existing records. [2025-09-18T19:25:49.790968] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-11. [2025-09-18T19:25:49.820357] [DEBUG] [LOCAL ] HD: Loaded 53521 existing records from primary storage. [2025-09-18T19:25:49.860950] [INFO ] [MAIN ] HD: Loaded 53521 existing records. [2025-09-18T19:25:49.943396] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:25:50.038523] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-18T19:25:50.051003] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-18T19:25:50.066986] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-09-18T19:25:50.067117] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-18T19:25:50.193697] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-11 (0.40 seconds). [2025-09-18T19:25:50.262921] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-09-18T19:25:50.273321] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:25:50.373208] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-18T19:25:50.381587] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-18T19:25:50.381449] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:25:50.382120] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-18T19:25:50.382556] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-18T19:25:50.388223] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-18T19:25:50.398693] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-18T19:25:50.398816] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-18T19:25:50.399051] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-18T19:25:50.690863] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-18T19:25:50.755099] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-09-18T19:25:51.201420] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-18T19:25:51.226553] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-18T19:25:51.290713] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:25:51.346585] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-11. [2025-09-18T19:25:51.496215] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:25:51.508238] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-11. [2025-09-18T19:25:51.547927] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:25:51.552455] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-18T19:25:51.552921] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-11. [2025-09-18T19:25:51.719570] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-18T19:25:51.960814] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-18T19:25:52.366067] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-18T19:25:52.519569] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-18T19:25:52.751568] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-09-18T19:25:52.934516] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T19:25:53.325409] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-09-18T19:25:53.332225] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-18T19:25:53.990154] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-18T19:25:54.119560] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-18T19:25:54.320843] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-09-18T19:25:54.919574] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-18T19:25:55.156555] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-18T19:25:55.719549] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-09-18T19:25:56.519592] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-09-18T19:25:56.537936] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T19:25:57.319558] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-09-18T19:25:58.119549] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-18T19:25:58.360426] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-18T19:25:58.888340] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-18T19:25:58.929381] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-18T19:25:58.935510] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-18T19:25:59.626971] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-18T19:25:59.719582] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-09-18T19:26:00.519557] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-18T19:26:00.872007] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-18T19:26:01.319517] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-18T19:26:01.556955] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-18T19:26:01.785966] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-18T19:26:01.786759] [INFO ] [REMOTE ] HCXY: Full fetch complete (602 records). [2025-09-18T19:26:01.786857] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-18T19:26:01.787309] [FATAL] [VALIDATOR ] HCXY: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T19:26:01.787398] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:26:01.787463] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:26:01.787555] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-18T19:26:01.787663] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-18T19:26:01.787739] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-18T19:26:01.787822] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-18T19:26:01.787918] [INFO ] [MAIN ] Update Progress: 1001/2372 symbols completed. HCXY took 13.4s. Estimated remaining: 3h 19m 56s. Rate: 6.9 symbols/min [2025-09-18T19:26:01.971074] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:26:02.030098] [DEBUG] [LOCAL ] HE: Loaded 49328 existing records from primary storage. [2025-09-18T19:26:02.030256] [INFO ] [MAIN ] HE: Loaded 49328 existing records. [2025-09-18T19:26:02.124672] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-09-18T19:26:02.221282] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:26:02.221505] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-18T19:26:02.221553] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-18T19:26:02.222925] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-18T19:26:02.222988] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-18T19:26:02.600933] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:26:02.919547] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-11. [2025-09-18T19:26:03.702439] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T19:26:03.719490] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-18T19:26:04.519554] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-18T19:26:04.877100] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-11 (1.96 seconds). [2025-09-18T19:26:04.934352] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-18T19:26:05.319557] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-09-18T19:26:06.119552] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-18T19:26:06.306806] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-18T19:26:06.919571] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-18T19:26:06.985127] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-18T19:26:07.044758] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-18T19:26:07.719576] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-18T19:26:08.519526] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-09-18T19:26:08.691259] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-18T19:26:09.167601] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-18T19:26:09.319549] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-18T19:26:10.035894] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T19:26:10.056574] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-18T19:26:10.119563] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-18T19:26:10.919545] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-18T19:26:11.064232] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-18T19:26:11.719557] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-18T19:26:12.519551] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-18T19:26:12.648668] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-18T19:26:13.217773] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-18T19:26:13.319539] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-18T19:26:13.594107] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-18T19:26:14.119601] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-18T19:26:14.681624] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-18T19:26:14.919545] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-18T19:26:15.719523] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-18T19:26:15.798726] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-18T19:26:16.519565] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-18T19:26:16.624537] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-18T19:26:16.646005] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T19:26:17.319549] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-18T19:26:17.814435] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-18T19:26:18.119561] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-18T19:26:18.208236] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-18T19:26:18.919560] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-18T19:26:19.457620] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T19:26:19.613107] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-18T19:26:19.615622] [INFO ] [REMOTE ] HCI: Full fetch complete (19551 records). [2025-09-18T19:26:19.615739] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-18T19:26:19.721059] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-18T19:26:20.001078] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-09-18T19:26:20.001170] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-09-18T19:26:20.001629] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-09-18T19:26:20.001736] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-09-18T19:26:20.002412] [DEBUG] [LOCAL ] HCI: Trimmed 19551 records to 14062 (keeping 200 days of data) [2025-09-18T19:26:20.104539] [DEBUG] [LOCAL ] HCI: Primary data saved (14062 records). [2025-09-18T19:26:20.104719] [INFO ] [MAIN ] HCI: Full history saved. [2025-09-18T19:26:20.104853] [INFO ] [MAIN ] Update Progress: 1002/2372 symbols completed. HCI took 31.7s. Estimated remaining: 3h 20m 0s. Rate: 6.8 symbols/min [2025-09-18T19:26:20.276334] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:26:20.332471] [DEBUG] [LOCAL ] HEI: Loaded 33027 existing records from primary storage. [2025-09-18T19:26:20.332613] [INFO ] [MAIN ] HEI: Loaded 33027 existing records. [2025-09-18T19:26:20.510975] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:26:20.511230] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-18T19:26:20.511285] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-18T19:26:20.512375] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-18T19:26:20.512444] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-18T19:26:20.525204] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-18T19:26:20.876906] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:26:21.319565] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-11. [2025-09-18T19:26:21.363792] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-18T19:26:22.119543] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-18T19:26:22.346114] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-18T19:26:22.380346] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-18T19:26:22.919546] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-09-18T19:26:23.411118] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-18T19:26:23.719538] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-18T19:26:23.878291] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-18T19:26:24.519539] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-18T19:26:25.290203] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-18T19:26:25.298555] [INFO ] [REMOTE ] HDB: Full fetch complete (75059 records). [2025-09-18T19:26:25.298744] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-18T19:26:25.331397] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-18T19:26:25.708491] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-18T19:26:25.708591] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-18T19:26:25.709566] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-18T19:26:25.709672] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-18T19:26:25.712696] [DEBUG] [LOCAL ] HDB: Trimmed 75059 records to 52320 (keeping 200 days of data) [2025-09-18T19:26:26.062421] [DEBUG] [LOCAL ] HDB: Primary data saved (52320 records). [2025-09-18T19:26:26.062750] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-18T19:26:26.063120] [INFO ] [MAIN ] Update Progress: 1003/2372 symbols completed. HDB took 37.6s. Estimated remaining: 3h 19m 47s. Rate: 6.9 symbols/min [2025-09-18T19:26:26.129795] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-09-18T19:26:26.246830] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:26:26.255874] [DEBUG] [LOCAL ] HEQ: Loaded 6138 existing records from primary storage. [2025-09-18T19:26:26.256097] [INFO ] [MAIN ] HEQ: Loaded 6138 existing records. [2025-09-18T19:26:26.441242] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:26:26.441722] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-18T19:26:26.441792] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-18T19:26:26.442170] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-18T19:26:26.442230] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-18T19:26:26.611543] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-18T19:26:26.886435] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:26:26.927871] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-18T19:26:26.934901] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-18T19:26:27.719599] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-18T19:26:27.750739] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-18T19:26:28.519505] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-18T19:26:28.731523] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-18T19:26:29.018693] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-18T19:26:29.319576] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-11. [2025-09-18T19:26:29.508490] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-18T19:26:29.811710] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-18T19:26:30.119548] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-09-18T19:26:30.721834] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-18T19:26:30.919558] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-09-18T19:26:31.372674] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-18T19:26:31.719545] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-18T19:26:32.519590] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-18T19:26:33.301033] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-18T19:26:33.323357] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-18T19:26:33.328795] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T19:26:34.119557] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-18T19:26:34.919564] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-18T19:26:35.119227] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-18T19:26:35.127124] [INFO ] [REMOTE ] HD: Full fetch complete (77341 records). [2025-09-18T19:26:35.127281] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-18T19:26:35.544756] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-18T19:26:35.547239] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-18T19:26:35.547372] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-18T19:26:35.548283] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-18T19:26:35.567323] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-18T19:26:35.588589] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-18T19:26:35.598943] [DEBUG] [LOCAL ] HD: Trimmed 77341 records to 53908 (keeping 200 days of data) [2025-09-18T19:26:35.721919] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-18T19:26:35.950744] [DEBUG] [LOCAL ] HD: Primary data saved (53908 records). [2025-09-18T19:26:35.950911] [INFO ] [MAIN ] HD: Full history saved. [2025-09-18T19:26:35.951058] [INFO ] [MAIN ] Update Progress: 1004/2372 symbols completed. HD took 47.5s. Estimated remaining: 3h 19m 40s. Rate: 6.9 symbols/min [2025-09-18T19:26:36.127355] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:26:36.173729] [DEBUG] [LOCAL ] HESM: Loaded 48152 existing records from primary storage. [2025-09-18T19:26:36.173931] [INFO ] [MAIN ] HESM: Loaded 48152 existing records. [2025-09-18T19:26:36.353325] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:26:36.353667] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-18T19:26:36.353732] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-18T19:26:36.355105] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-18T19:26:36.355168] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-18T19:26:36.539108] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-18T19:26:36.729075] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:26:37.319603] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-11. [2025-09-18T19:26:37.641231] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-18T19:26:37.722164] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-18T19:26:38.119546] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-18T19:26:38.515458] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-18T19:26:38.919629] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-18T19:26:39.621516] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-18T19:26:39.719559] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-18T19:26:40.284174] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-18T19:26:40.519565] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-18T19:26:40.820825] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-18T19:26:41.319601] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-09-18T19:26:41.804292] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-18T19:26:41.811334] [INFO ] [REMOTE ] HE: Full fetch complete (72390 records). [2025-09-18T19:26:41.811461] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-18T19:26:42.124774] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-18T19:26:42.213633] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-18T19:26:42.213769] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-18T19:26:42.214694] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-18T19:26:42.214761] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-18T19:26:42.217118] [DEBUG] [LOCAL ] HE: Trimmed 72390 records to 49698 (keeping 200 days of data) [2025-09-18T19:26:42.548749] [DEBUG] [LOCAL ] HE: Primary data saved (49698 records). [2025-09-18T19:26:42.558347] [INFO ] [MAIN ] HE: Full history saved. [2025-09-18T19:26:42.559282] [INFO ] [MAIN ] Update Progress: 1005/2372 symbols completed. HE took 40.8s. Estimated remaining: 3h 19m 29s. Rate: 6.9 symbols/min [2025-09-18T19:26:42.560144] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-18T19:26:42.739739] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:26:42.739941] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-18T19:26:42.739996] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-18T19:26:42.740186] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-18T19:26:42.740228] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-18T19:26:42.740269] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-18T19:26:42.740300] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-18T19:26:42.925781] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-18T19:26:43.102748] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:26:43.230886] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-18T19:26:43.641884] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-18T19:26:43.719519] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-18T19:26:44.519568] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-18T19:26:44.801485] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-18T19:26:45.084380] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-18T19:26:45.319602] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-09-18T19:26:46.119565] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-18T19:26:46.737536] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-18T19:26:46.919550] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-11. [2025-09-18T19:26:47.165342] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-11 (0.25 seconds). [2025-09-18T19:26:47.183923] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-18T19:26:47.188580] [INFO ] [REMOTE ] HEI: Full fetch complete (49200 records). [2025-09-18T19:26:47.188746] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-18T19:26:47.574454] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-18T19:26:47.574546] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-18T19:26:47.575298] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-18T19:26:47.575363] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-18T19:26:47.576512] [DEBUG] [LOCAL ] HEI: Trimmed 49200 records to 33217 (keeping 200 days of data) [2025-09-18T19:26:47.742286] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-09-18T19:26:47.794442] [DEBUG] [LOCAL ] HEI: Primary data saved (33217 records). [2025-09-18T19:26:47.794587] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-18T19:26:47.795623] [INFO ] [MAIN ] Update Progress: 1006/2372 symbols completed. HEI took 27.7s. Estimated remaining: 3h 19m 15s. Rate: 6.9 symbols/min [2025-09-18T19:26:47.963280] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:26:47.963468] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-18T19:26:47.963505] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-18T19:26:47.963701] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-18T19:26:47.963937] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-18T19:26:47.964024] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-18T19:26:47.964060] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-18T19:26:48.058697] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-18T19:26:48.356516] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:26:48.519566] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-09-18T19:26:48.783073] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-18T19:26:49.319620] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-18T19:26:50.119582] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-18T19:26:50.340800] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-09-18T19:26:50.872947] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-18T19:26:50.919539] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-18T19:26:51.719621] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-11. [2025-09-18T19:26:52.053513] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-18T19:26:52.234602] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T19:26:52.519553] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-18T19:26:53.001146] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-18T19:26:53.319690] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-09-18T19:26:53.748168] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-18T19:26:54.119552] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-09-18T19:26:54.365562] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-09-18T19:26:54.919546] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-18T19:26:55.232610] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-18T19:26:55.719548] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-18T19:26:56.519621] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-18T19:26:57.030050] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-18T19:26:57.199824] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-18T19:26:57.319605] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-18T19:26:57.580027] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-09-18T19:26:58.119547] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-18T19:26:58.539538] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-18T19:26:58.919621] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-18T19:26:59.314380] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-18T19:26:59.719607] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-18T19:27:00.519572] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-18T19:27:00.550157] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-18T19:27:00.552639] [INFO ] [REMOTE ] HEQ: Full fetch complete (8956 records). [2025-09-18T19:27:00.552788] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-18T19:27:00.828189] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-18T19:27:00.975173] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-18T19:27:00.975274] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-18T19:27:00.975503] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-18T19:27:00.975544] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-18T19:27:00.976023] [DEBUG] [LOCAL ] HEQ: Trimmed 8956 records to 6239 (keeping 200 days of data) [2025-09-18T19:27:01.012556] [DEBUG] [LOCAL ] HEQ: Primary data saved (6239 records). [2025-09-18T19:27:01.012691] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-18T19:27:01.012786] [INFO ] [MAIN ] Update Progress: 1007/2372 symbols completed. HEQ took 34.9s. Estimated remaining: 3h 19m 12s. Rate: 6.9 symbols/min [2025-09-18T19:27:01.182905] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:27:01.200502] [DEBUG] [LOCAL ] HFRO: Loaded 17516 existing records from primary storage. [2025-09-18T19:27:01.200630] [INFO ] [MAIN ] HFRO: Loaded 17516 existing records. [2025-09-18T19:27:01.324689] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-18T19:27:01.387895] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:27:01.388092] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-18T19:27:01.388141] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-18T19:27:01.389031] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-18T19:27:01.389094] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-18T19:27:01.766265] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:27:01.944628] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-18T19:27:02.119597] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-18T19:27:02.919549] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-18T19:27:03.719575] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-11. [2025-09-18T19:27:03.947328] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-18T19:27:04.519559] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-18T19:27:04.896318] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-18T19:27:05.279489] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-18T19:27:05.319508] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-18T19:27:05.632525] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-18T19:27:06.119567] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-18T19:27:06.371363] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-18T19:27:06.684405] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-18T19:27:06.919593] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-09-18T19:27:07.719610] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-18T19:27:08.015265] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-18T19:27:08.183019] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-18T19:27:08.519551] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-09-18T19:27:09.319573] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-18T19:27:09.626458] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-18T19:27:10.119601] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-18T19:27:10.357472] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-18T19:27:10.691593] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-18T19:27:10.919555] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-18T19:27:11.719547] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-18T19:27:11.977185] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-18T19:27:12.526305] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-18T19:27:12.535214] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-18T19:27:12.732349] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-09-18T19:27:13.319546] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-18T19:27:14.090997] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-18T19:27:14.119534] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-18T19:27:14.919552] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-18T19:27:15.253025] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-18T19:27:15.719560] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-18T19:27:15.768141] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-18T19:27:15.775184] [INFO ] [REMOTE ] HESM: Full fetch complete (68366 records). [2025-09-18T19:27:15.775314] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-18T19:27:16.185033] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-18T19:27:16.185138] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-18T19:27:16.185981] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-18T19:27:16.186048] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-18T19:27:16.187550] [DEBUG] [LOCAL ] HESM: Trimmed 68366 records to 48477 (keeping 200 days of data) [2025-09-18T19:27:16.244393] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-18T19:27:16.254707] [INFO ] [REMOTE ] HFND: Full fetch complete (1802 records). [2025-09-18T19:27:16.283131] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-18T19:27:16.488839] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-18T19:27:16.491608] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:27:16.497300] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:27:16.504473] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-18T19:27:16.505122] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-18T19:27:16.505423] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-18T19:27:16.505855] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-18T19:27:16.506193] [INFO ] [MAIN ] Update Progress: 1008/2372 symbols completed. HFND took 28.7s. Estimated remaining: 3h 19m 13s. Rate: 6.8 symbols/min [2025-09-18T19:27:16.527703] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-18T19:27:16.789600] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:27:16.859106] [DEBUG] [LOCAL ] HGER: Loaded 12589 existing records from primary storage. [2025-09-18T19:27:16.860685] [INFO ] [MAIN ] HGER: Loaded 12589 existing records. [2025-09-18T19:27:17.060418] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:27:17.063043] [DEBUG] [LOCAL ] HESM: Primary data saved (48477 records). [2025-09-18T19:27:17.063190] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-18T19:27:17.063394] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-18T19:27:17.063486] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-18T19:27:17.063611] [INFO ] [MAIN ] Update Progress: 1009/2372 symbols completed. HESM took 41.1s. Estimated remaining: 3h 18m 53s. Rate: 6.9 symbols/min [2025-09-18T19:27:17.075614] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-18T19:27:17.107402] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-18T19:27:17.345600] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-18T19:27:17.409294] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:27:17.545367] [DEBUG] [LOCAL ] HGLB: Loaded 9738 existing records from primary storage. [2025-09-18T19:27:17.554715] [INFO ] [MAIN ] HGLB: Loaded 9738 existing records. [2025-09-18T19:27:17.795552] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:27:17.826796] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:27:17.827051] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-18T19:27:17.827100] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-18T19:27:17.827483] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-09-18T19:27:17.827545] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-18T19:27:18.017329] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T19:27:18.056813] [INFO ] [REMOTE ] HF: Full fetch complete (511 records). [2025-09-18T19:27:18.084452] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-18T19:27:18.126605] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-11. [2025-09-18T19:27:18.383516] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:27:18.379934] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 149 unique days, need 200 days [2025-09-18T19:27:18.383981] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:27:18.384087] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:27:18.384162] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-18T19:27:18.384229] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-18T19:27:18.384266] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-18T19:27:18.384321] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-18T19:27:18.384405] [INFO ] [MAIN ] Update Progress: 1010/2372 symbols completed. HF took 35.8s. Estimated remaining: 3h 18m 34s. Rate: 6.9 symbols/min [2025-09-18T19:27:18.557336] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:27:18.572630] [DEBUG] [LOCAL ] HGTY: Loaded 12830 existing records from primary storage. [2025-09-18T19:27:18.572805] [INFO ] [MAIN ] HGTY: Loaded 12830 existing records. [2025-09-18T19:27:18.750600] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-18T19:27:18.775342] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:27:18.775552] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-18T19:27:18.775837] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-18T19:27:18.781416] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-09-18T19:27:18.788369] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-18T19:27:18.836442] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-18T19:27:18.924616] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-18T19:27:19.158433] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:27:19.710848] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-18T19:27:19.719498] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-11. [2025-09-18T19:27:20.429524] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-18T19:27:20.519555] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-18T19:27:21.189457] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-18T19:27:21.319547] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-18T19:27:22.119548] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-11. [2025-09-18T19:27:22.237441] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T19:27:22.730869] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-18T19:27:22.919568] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-18T19:27:23.719581] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-09-18T19:27:23.956073] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-18T19:27:24.341176] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-18T19:27:24.519681] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-09-18T19:27:25.010000] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-18T19:27:25.319635] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-18T19:27:26.119581] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-09-18T19:27:26.278708] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-18T19:27:26.598989] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-18T19:27:26.919588] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-18T19:27:27.619561] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-18T19:27:27.719561] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-18T19:27:28.296400] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-18T19:27:28.519604] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-09-18T19:27:29.250346] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-18T19:27:29.319509] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-09-18T19:27:30.109460] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-18T19:27:30.119488] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-18T19:27:30.671057] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-18T19:27:30.919544] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-18T19:27:31.700875] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-18T19:27:31.719520] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-18T19:27:32.261264] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-18T19:27:32.519581] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-18T19:27:33.256563] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T19:27:33.259473] [INFO ] [REMOTE ] HFRO: Full fetch complete (28854 records). [2025-09-18T19:27:33.259570] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-18T19:27:33.324773] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-18T19:27:33.635051] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-18T19:27:33.635141] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-18T19:27:33.635748] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-18T19:27:33.635816] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-18T19:27:33.636801] [DEBUG] [LOCAL ] HFRO: Trimmed 28854 records to 17680 (keeping 200 days of data) [2025-09-18T19:27:33.741059] [DEBUG] [LOCAL ] HFRO: Primary data saved (17680 records). [2025-09-18T19:27:33.741203] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-18T19:27:33.741288] [INFO ] [MAIN ] Update Progress: 1011/2372 symbols completed. HFRO took 32.7s. Estimated remaining: 3h 18m 34s. Rate: 6.9 symbols/min [2025-09-18T19:27:33.921754] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:27:33.967709] [DEBUG] [LOCAL ] HGV: Loaded 47129 existing records from primary storage. [2025-09-18T19:27:33.967863] [INFO ] [MAIN ] HGV: Loaded 47129 existing records. [2025-09-18T19:27:34.124635] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-18T19:27:34.156825] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:27:34.158245] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-18T19:27:34.158479] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-18T19:27:34.163993] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-18T19:27:34.165657] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-18T19:27:34.187782] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-18T19:27:34.546415] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:27:34.919567] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-18T19:27:35.098709] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-18T19:27:35.621978] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-18T19:27:35.719588] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-18T19:27:36.519561] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-18T19:27:36.745690] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-18T19:27:37.103389] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-18T19:27:37.319547] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-18T19:27:37.817962] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-18T19:27:38.119603] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-18T19:27:38.919585] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-18T19:27:39.272787] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-18T19:27:39.278058] [INFO ] [REMOTE ] HGTY: Full fetch complete (16980 records). [2025-09-18T19:27:39.278164] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-18T19:27:39.530930] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-18T19:27:39.680443] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-09-18T19:27:39.680533] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-09-18T19:27:39.681017] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-09-18T19:27:39.681083] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-09-18T19:27:39.681751] [DEBUG] [LOCAL ] HGTY: Trimmed 16980 records to 12987 (keeping 200 days of data) [2025-09-18T19:27:39.720032] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-18T19:27:39.762046] [DEBUG] [LOCAL ] HGTY: Primary data saved (12987 records). [2025-09-18T19:27:39.762217] [INFO ] [MAIN ] HGTY: Full history saved. [2025-09-18T19:27:39.762335] [INFO ] [MAIN ] Update Progress: 1012/2372 symbols completed. HGTY took 21.4s. Estimated remaining: 3h 18m 22s. Rate: 6.9 symbols/min [2025-09-18T19:27:39.933312] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:27:39.970011] [DEBUG] [LOCAL ] HHH: Loaded 32891 existing records from primary storage. [2025-09-18T19:27:39.970175] [INFO ] [MAIN ] HHH: Loaded 32891 existing records. [2025-09-18T19:27:40.146457] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:27:40.146768] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-18T19:27:40.146824] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-18T19:27:40.147852] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-18T19:27:40.147913] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-18T19:27:40.501990] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:27:40.519502] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-11. [2025-09-18T19:27:40.560317] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-18T19:27:41.319619] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-09-18T19:27:41.345568] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-18T19:27:42.027343] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-18T19:27:42.119617] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-18T19:27:42.625744] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-18T19:27:42.919571] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-11. [2025-09-18T19:27:43.719554] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-18T19:27:44.084615] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-18T19:27:44.201116] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-18T19:27:44.203380] [INFO ] [REMOTE ] HGLB: Full fetch complete (14241 records). [2025-09-18T19:27:44.203457] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-18T19:27:44.524457] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-18T19:27:44.625732] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-09-18T19:27:44.625823] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-09-18T19:27:44.626161] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-09-18T19:27:44.626226] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-09-18T19:27:44.626844] [DEBUG] [LOCAL ] HGLB: Trimmed 14241 records to 9804 (keeping 200 days of data) [2025-09-18T19:27:44.686432] [DEBUG] [LOCAL ] HGLB: Primary data saved (9804 records). [2025-09-18T19:27:44.686582] [INFO ] [MAIN ] HGLB: Full history saved. [2025-09-18T19:27:44.686695] [INFO ] [MAIN ] Update Progress: 1013/2372 symbols completed. HGLB took 27.6s. Estimated remaining: 3h 18m 8s. Rate: 6.9 symbols/min [2025-09-18T19:27:44.866027] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:27:44.902192] [DEBUG] [LOCAL ] HI: Loaded 35077 existing records from primary storage. [2025-09-18T19:27:44.902352] [INFO ] [MAIN ] HI: Loaded 35077 existing records. [2025-09-18T19:27:45.099633] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:27:45.099950] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-18T19:27:45.100007] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-18T19:27:45.101104] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-18T19:27:45.101166] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-18T19:27:45.249850] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-18T19:27:45.324707] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-09-18T19:27:45.475495] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:27:46.119568] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-11. [2025-09-18T19:27:46.571439] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-18T19:27:46.919602] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-09-18T19:27:47.424379] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-18T19:27:47.719547] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-09-18T19:27:48.063577] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-18T19:27:48.519579] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-18T19:27:48.934858] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-18T19:27:49.319626] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-09-18T19:27:49.768113] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T19:27:50.119549] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-18T19:27:50.332160] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-18T19:27:50.919546] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-09-18T19:27:51.454817] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-18T19:27:51.719507] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-09-18T19:27:51.745510] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-18T19:27:52.519619] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-18T19:27:52.863609] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-18T19:27:53.319605] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-18T19:27:53.829726] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-18T19:27:54.119590] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-18T19:27:54.746682] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T19:27:54.919689] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-18T19:27:55.214060] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-18T19:27:55.700957] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-18T19:27:55.719485] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-18T19:27:56.334738] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-18T19:27:56.519603] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-18T19:27:57.319611] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-18T19:27:57.519532] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-18T19:27:58.119551] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-18T19:27:58.452789] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-18T19:27:58.620525] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-18T19:27:58.919590] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-18T19:27:59.719563] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-18T19:28:00.495809] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T19:28:00.519583] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-18T19:28:00.745407] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-18T19:28:01.319597] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-18T19:28:01.616345] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-18T19:28:02.119592] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-18T19:28:02.659986] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-18T19:28:02.919569] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-18T19:28:03.556512] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-18T19:28:03.719584] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-18T19:28:04.111043] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-18T19:28:04.297031] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-18T19:28:04.519582] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-18T19:28:05.319583] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-18T19:28:05.635401] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-18T19:28:06.119599] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-18T19:28:06.331677] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-18T19:28:06.919585] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-18T19:28:07.514494] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T19:28:07.719558] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-18T19:28:07.850139] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-18T19:28:08.519575] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-18T19:28:08.896737] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-18T19:28:09.319593] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-18T19:28:09.766486] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-18T19:28:09.773913] [INFO ] [REMOTE ] HGV: Full fetch complete (65632 records). [2025-09-18T19:28:09.774061] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-18T19:28:10.123436] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-18T19:28:10.165960] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-18T19:28:10.212676] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-18T19:28:10.213583] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-18T19:28:10.214938] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-18T19:28:10.215083] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-18T19:28:10.215954] [INFO ] [REMOTE ] HGER: Full fetch complete (15713 records). [2025-09-18T19:28:10.216482] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-18T19:28:10.300249] [DEBUG] [LOCAL ] HGV: Trimmed 65632 records to 47467 (keeping 200 days of data) [2025-09-18T19:28:10.717035] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-18T19:28:10.717463] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-18T19:28:10.718029] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-18T19:28:10.718116] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-18T19:28:10.720544] [DEBUG] [LOCAL ] HGER: Trimmed 15713 records to 12752 (keeping 200 days of data) [2025-09-18T19:28:10.924017] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-18T19:28:10.929851] [DEBUG] [LOCAL ] HGER: Primary data saved (12752 records). [2025-09-18T19:28:10.930687] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-18T19:28:10.930837] [INFO ] [MAIN ] Update Progress: 1014/2372 symbols completed. HGER took 54.4s. Estimated remaining: 3h 18m 23s. Rate: 6.8 symbols/min [2025-09-18T19:28:11.166164] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:28:11.242350] [DEBUG] [LOCAL ] HGV: Primary data saved (47467 records). [2025-09-18T19:28:11.242606] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-18T19:28:11.242757] [INFO ] [MAIN ] Update Progress: 1015/2372 symbols completed. HGV took 37.5s. Estimated remaining: 3h 18m 3s. Rate: 6.9 symbols/min [2025-09-18T19:28:11.521073] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:28:11.525988] [DEBUG] [LOCAL ] HIG: Loaded 51306 existing records from primary storage. [2025-09-18T19:28:11.526344] [INFO ] [MAIN ] HIG: Loaded 51306 existing records. [2025-09-18T19:28:11.750693] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:28:11.751524] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-18T19:28:11.751736] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-18T19:28:11.753854] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-18T19:28:11.753928] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-18T19:28:11.902106] [DEBUG] [LOCAL ] HII: Loaded 35736 existing records from primary storage. [2025-09-18T19:28:11.906322] [INFO ] [MAIN ] HII: Loaded 35736 existing records. [2025-09-18T19:28:11.913911] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-18T19:28:12.002269] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-18T19:28:12.310999] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:28:12.360752] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T19:28:12.360874] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-18T19:28:12.412401] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-18T19:28:12.464033] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-18T19:28:12.464256] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-18T19:28:12.469571] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:28:12.527726] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-18T19:28:12.843101] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:28:13.319514] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-11. [2025-09-18T19:28:13.400806] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-18T19:28:13.695450] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T19:28:14.119575] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-18T19:28:14.444671] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-18T19:28:14.919544] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-11. [2025-09-18T19:28:15.146127] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-18T19:28:15.719573] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-18T19:28:16.519581] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-09-18T19:28:16.655936] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-18T19:28:16.761513] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-18T19:28:16.766414] [INFO ] [REMOTE ] HHH: Full fetch complete (44813 records). [2025-09-18T19:28:16.766529] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-18T19:28:17.149329] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-18T19:28:17.149415] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-18T19:28:17.150053] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-18T19:28:17.150116] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-18T19:28:17.151620] [DEBUG] [LOCAL ] HHH: Trimmed 44813 records to 33111 (keeping 200 days of data) [2025-09-18T19:28:17.323234] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-09-18T19:28:17.346897] [DEBUG] [LOCAL ] HHH: Primary data saved (33111 records). [2025-09-18T19:28:17.347047] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-18T19:28:17.347137] [INFO ] [MAIN ] Update Progress: 1016/2372 symbols completed. HHH took 37.6s. Estimated remaining: 3h 17m 50s. Rate: 6.9 symbols/min [2025-09-18T19:28:17.523820] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:28:17.579140] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-09-18T19:28:17.579355] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-09-18T19:28:17.763414] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:28:17.763966] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-18T19:28:17.764111] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-18T19:28:17.765587] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-18T19:28:17.765685] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-18T19:28:18.074178] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-18T19:28:18.125191] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-09-18T19:28:18.168018] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:28:18.817798] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T19:28:18.919576] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-18T19:28:19.179617] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-18T19:28:19.719553] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-18T19:28:19.973707] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-18T19:28:19.978261] [INFO ] [REMOTE ] HI: Full fetch complete (49493 records). [2025-09-18T19:28:19.978357] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-18T19:28:20.366116] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-18T19:28:20.366235] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-18T19:28:20.367400] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-18T19:28:20.367467] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-18T19:28:20.368739] [DEBUG] [LOCAL ] HI: Trimmed 49493 records to 35349 (keeping 200 days of data) [2025-09-18T19:28:20.534524] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-09-18T19:28:20.592053] [DEBUG] [LOCAL ] HI: Primary data saved (35349 records). [2025-09-18T19:28:20.592186] [INFO ] [MAIN ] HI: Full history saved. [2025-09-18T19:28:20.592311] [INFO ] [MAIN ] Update Progress: 1017/2372 symbols completed. HI took 35.9s. Estimated remaining: 3h 17m 34s. Rate: 6.9 symbols/min [2025-09-18T19:28:20.762216] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:28:20.785533] [DEBUG] [LOCAL ] HIO: Loaded 24117 existing records from primary storage. [2025-09-18T19:28:20.785713] [INFO ] [MAIN ] HIO: Loaded 24117 existing records. [2025-09-18T19:28:20.968255] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:28:20.968531] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-18T19:28:20.968579] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-18T19:28:20.969460] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-18T19:28:20.969521] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-18T19:28:21.319780] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-11. [2025-09-18T19:28:21.356994] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:28:21.382413] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-18T19:28:21.915446] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T19:28:22.119569] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-11. [2025-09-18T19:28:22.919569] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-18T19:28:23.216733] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-18T19:28:23.476475] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-11 (2.16 seconds). [2025-09-18T19:28:23.719571] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-09-18T19:28:24.281776] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T19:28:24.519523] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-18T19:28:24.554570] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T19:28:25.319555] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-09-18T19:28:26.119613] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-09-18T19:28:26.392109] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-18T19:28:26.449256] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-18T19:28:26.919549] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-18T19:28:27.719567] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-18T19:28:28.003194] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-18T19:28:28.427203] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-18T19:28:28.519495] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-18T19:28:28.913322] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-18T19:28:29.319558] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-09-18T19:28:29.459868] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-18T19:28:30.119612] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-18T19:28:30.919554] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-18T19:28:31.319705] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-18T19:28:31.719530] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-18T19:28:31.878134] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-18T19:28:31.914473] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-18T19:28:32.519549] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-18T19:28:33.319610] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-18T19:28:33.725778] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-18T19:28:33.890565] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-18T19:28:34.119589] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-18T19:28:34.205763] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-18T19:28:34.919552] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-18T19:28:35.720621] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-18T19:28:35.723495] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-18T19:28:35.752499] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-18T19:28:36.519580] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-18T19:28:36.877184] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-18T19:28:37.319554] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-18T19:28:38.119605] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-18T19:28:38.262424] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-18T19:28:38.347791] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-18T19:28:38.352439] [INFO ] [REMOTE ] HII: Full fetch complete (53374 records). [2025-09-18T19:28:38.352574] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-18T19:28:38.733534] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-18T19:28:38.733687] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-18T19:28:38.734424] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-18T19:28:38.734500] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-18T19:28:38.735686] [DEBUG] [LOCAL ] HII: Trimmed 53374 records to 35965 (keeping 200 days of data) [2025-09-18T19:28:38.933631] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-18T19:28:38.994090] [DEBUG] [LOCAL ] HII: Primary data saved (35965 records). [2025-09-18T19:28:38.994245] [INFO ] [MAIN ] HII: Full history saved. [2025-09-18T19:28:38.994406] [INFO ] [MAIN ] Update Progress: 1018/2372 symbols completed. HII took 27.8s. Estimated remaining: 3h 17m 38s. Rate: 6.9 symbols/min [2025-09-18T19:28:39.170739] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:28:39.195226] [DEBUG] [LOCAL ] HIPO: Loaded 22987 existing records from primary storage. [2025-09-18T19:28:39.195375] [INFO ] [MAIN ] HIPO: Loaded 22987 existing records. [2025-09-18T19:28:39.379776] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:28:39.380010] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-18T19:28:39.380059] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-18T19:28:39.380759] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-18T19:28:39.380820] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-18T19:28:39.724820] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-18T19:28:39.764885] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:28:40.359353] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T19:28:40.420703] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-18T19:28:40.519533] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-11. [2025-09-18T19:28:40.919803] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-18T19:28:41.319575] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-18T19:28:41.347166] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-18T19:28:42.119614] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-18T19:28:42.379727] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-18T19:28:42.919606] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-18T19:28:43.552914] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T19:28:43.719527] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-18T19:28:43.902085] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-18T19:28:44.519542] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-18T19:28:45.192585] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T19:28:45.251225] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-18T19:28:45.319507] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-18T19:28:46.119541] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-18T19:28:46.405785] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-18T19:28:46.410447] [INFO ] [REMOTE ] HIO: Full fetch complete (36872 records). [2025-09-18T19:28:46.410547] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-18T19:28:46.799075] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-18T19:28:46.799154] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-18T19:28:46.799777] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-18T19:28:46.799865] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-18T19:28:46.802729] [DEBUG] [LOCAL ] HIO: Trimmed 36872 records to 24268 (keeping 200 days of data) [2025-09-18T19:28:46.919754] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-09-18T19:28:46.964966] [DEBUG] [LOCAL ] HIO: Primary data saved (24268 records). [2025-09-18T19:28:46.965107] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-18T19:28:46.965267] [INFO ] [MAIN ] Update Progress: 1019/2372 symbols completed. HIO took 26.4s. Estimated remaining: 3h 17m 28s. Rate: 6.9 symbols/min [2025-09-18T19:28:47.154346] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:28:47.202746] [DEBUG] [LOCAL ] HIW: Loaded 44886 existing records from primary storage. [2025-09-18T19:28:47.202908] [INFO ] [MAIN ] HIW: Loaded 44886 existing records. [2025-09-18T19:28:47.396352] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:28:47.396891] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-18T19:28:47.397003] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-18T19:28:47.398292] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-18T19:28:47.398376] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-18T19:28:47.720763] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-18T19:28:47.783061] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:28:47.817280] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-18T19:28:47.829106] [INFO ] [REMOTE ] HIG: Full fetch complete (73105 records). [2025-09-18T19:28:47.829351] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-18T19:28:48.226684] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T19:28:48.281768] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-18T19:28:48.281874] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-18T19:28:48.282760] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-18T19:28:48.282827] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-18T19:28:48.284573] [DEBUG] [LOCAL ] HIG: Trimmed 73105 records to 51670 (keeping 200 days of data) [2025-09-18T19:28:48.528386] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-09-18T19:28:48.646843] [DEBUG] [LOCAL ] HIG: Primary data saved (51670 records). [2025-09-18T19:28:48.647008] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-18T19:28:48.648811] [INFO ] [MAIN ] Update Progress: 1020/2372 symbols completed. HIG took 37.7s. Estimated remaining: 3h 17m 10s. Rate: 6.9 symbols/min [2025-09-18T19:28:48.822761] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:28:48.845724] [DEBUG] [LOCAL ] HIX: Loaded 20273 existing records from primary storage. [2025-09-18T19:28:48.845874] [INFO ] [MAIN ] HIX: Loaded 20273 existing records. [2025-09-18T19:28:49.022105] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:28:49.022366] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-18T19:28:49.022442] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-18T19:28:49.023203] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-18T19:28:49.023263] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-18T19:28:49.324693] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-11. [2025-09-18T19:28:49.389791] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:28:49.509621] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-18T19:28:50.119527] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-18T19:28:50.228716] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-18T19:28:50.411178] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T19:28:50.695233] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-18T19:28:50.919540] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-18T19:28:51.719509] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-11. [2025-09-18T19:28:52.130053] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-18T19:28:52.496413] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-18T19:28:52.519501] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-09-18T19:28:53.319531] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-18T19:28:53.374466] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-18T19:28:54.119589] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-09-18T19:28:54.919582] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-18T19:28:55.225105] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T19:28:55.719552] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-09-18T19:28:56.140531] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-09-18T19:28:56.174694] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-18T19:28:56.519569] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-18T19:28:56.824135] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-18T19:28:57.319558] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-18T19:28:58.119558] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-09-18T19:28:58.414743] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-18T19:28:58.867516] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-18T19:28:58.896523] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-18T19:28:58.919497] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-18T19:28:59.719565] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-18T19:29:00.519606] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-18T19:29:01.325974] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-18T19:29:01.328686] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-18T19:29:01.480343] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-18T19:29:01.513071] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-18T19:29:02.087039] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-18T19:29:02.119505] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-18T19:29:02.905824] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-18T19:29:02.919497] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-18T19:29:03.719532] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-18T19:29:03.896155] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-18T19:29:04.519548] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-18T19:29:05.325213] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-18T19:29:05.327710] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-18T19:29:06.119590] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-18T19:29:06.573635] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.85 seconds). [2025-09-18T19:29:06.644918] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T19:29:06.881972] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-18T19:29:06.919497] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-18T19:29:07.719554] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-18T19:29:07.943862] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-18T19:29:08.519549] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-18T19:29:09.319574] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-18T19:29:09.878446] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-18T19:29:10.044969] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-18T19:29:10.053909] [INFO ] [REMOTE ] HIMS: Full fetch complete (77909 records). [2025-09-18T19:29:10.054047] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-18T19:29:10.124636] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-18T19:29:10.471090] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-18T19:29:10.470392] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-18T19:29:10.475261] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-18T19:29:10.476360] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-18T19:29:10.476444] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-18T19:29:10.478253] [DEBUG] [LOCAL ] HIMS: Trimmed 77909 records to 54207 (keeping 200 days of data) [2025-09-18T19:29:10.817548] [DEBUG] [LOCAL ] HIMS: Primary data saved (54207 records). [2025-09-18T19:29:10.817991] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-18T19:29:10.818105] [INFO ] [MAIN ] Update Progress: 1021/2372 symbols completed. HIMS took 53.5s. Estimated remaining: 3h 17m 19s. Rate: 6.8 symbols/min [2025-09-18T19:29:10.919741] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-18T19:29:10.996626] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:29:11.016502] [DEBUG] [LOCAL ] HKD: Loaded 17934 existing records from primary storage. [2025-09-18T19:29:11.016681] [INFO ] [MAIN ] HKD: Loaded 17934 existing records. [2025-09-18T19:29:11.209122] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:29:11.209435] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-18T19:29:11.209485] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-18T19:29:11.210579] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-09-18T19:29:11.210672] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-18T19:29:11.581838] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:29:11.610115] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T19:29:11.719506] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-18T19:29:11.914453] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-18T19:29:11.919760] [INFO ] [REMOTE ] HIPO: Full fetch complete (31795 records). [2025-09-18T19:29:11.919844] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-18T19:29:12.292844] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-18T19:29:12.292934] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-18T19:29:12.293574] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-18T19:29:12.293618] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-18T19:29:12.294610] [DEBUG] [LOCAL ] HIPO: Trimmed 31795 records to 23127 (keeping 200 days of data) [2025-09-18T19:29:12.439182] [DEBUG] [LOCAL ] HIPO: Primary data saved (23127 records). [2025-09-18T19:29:12.439346] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-18T19:29:12.439456] [INFO ] [MAIN ] Update Progress: 1022/2372 symbols completed. HIPO took 33.4s. Estimated remaining: 3h 17m 1s. Rate: 6.9 symbols/min [2025-09-18T19:29:12.524743] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-18T19:29:12.616915] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:29:12.668563] [DEBUG] [LOCAL ] HL: Loaded 53670 existing records from primary storage. [2025-09-18T19:29:12.668743] [INFO ] [MAIN ] HL: Loaded 53670 existing records. [2025-09-18T19:29:12.849003] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:29:12.849247] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-18T19:29:12.849303] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-18T19:29:12.850734] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-18T19:29:12.850795] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-18T19:29:13.214334] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:29:13.241410] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-18T19:29:13.319501] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-18T19:29:13.338437] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-18T19:29:14.119557] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-18T19:29:14.609106] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-18T19:29:14.837578] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-18T19:29:14.919537] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-18T19:29:15.719522] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-11. [2025-09-18T19:29:15.973350] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-18T19:29:15.976359] [INFO ] [REMOTE ] HIX: Full fetch complete (30791 records). [2025-09-18T19:29:15.976470] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-18T19:29:16.351027] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-18T19:29:16.351111] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-18T19:29:16.351764] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-18T19:29:16.351829] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-18T19:29:16.352879] [DEBUG] [LOCAL ] HIX: Trimmed 30791 records to 20398 (keeping 200 days of data) [2025-09-18T19:29:16.478349] [DEBUG] [LOCAL ] HIX: Primary data saved (20398 records). [2025-09-18T19:29:16.478480] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-18T19:29:16.478609] [INFO ] [MAIN ] Update Progress: 1023/2372 symbols completed. HIX took 27.8s. Estimated remaining: 3h 16m 46s. Rate: 6.9 symbols/min [2025-09-18T19:29:16.524602] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-18T19:29:16.714722] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:29:16.766578] [DEBUG] [LOCAL ] HLF: Loaded 48939 existing records from primary storage. [2025-09-18T19:29:16.766842] [INFO ] [MAIN ] HLF: Loaded 48939 existing records. [2025-09-18T19:29:16.962750] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:29:16.977119] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-18T19:29:16.977804] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-18T19:29:16.978294] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-18T19:29:16.980222] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-18T19:29:16.984012] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-18T19:29:17.321793] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-09-18T19:29:17.345181] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:29:17.881092] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-18T19:29:18.119539] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-11. [2025-09-18T19:29:18.603344] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-18T19:29:18.919549] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-18T19:29:19.719557] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-11. [2025-09-18T19:29:19.946392] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-18T19:29:20.042282] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T19:29:20.048872] [INFO ] [REMOTE ] HIW: Full fetch complete (64557 records). [2025-09-18T19:29:20.048982] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-18T19:29:20.438092] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-18T19:29:20.438172] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-18T19:29:20.438969] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-18T19:29:20.439039] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-18T19:29:20.440368] [DEBUG] [LOCAL ] HIW: Trimmed 64557 records to 45221 (keeping 200 days of data) [2025-09-18T19:29:20.530423] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-09-18T19:29:20.722708] [DEBUG] [LOCAL ] HIW: Primary data saved (45221 records). [2025-09-18T19:29:20.722882] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-18T19:29:20.722999] [INFO ] [MAIN ] Update Progress: 1024/2372 symbols completed. HIW took 33.8s. Estimated remaining: 3h 16m 31s. Rate: 6.9 symbols/min [2025-09-18T19:29:20.892326] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:29:20.932755] [DEBUG] [LOCAL ] HLI: Loaded 31485 existing records from primary storage. [2025-09-18T19:29:20.932891] [INFO ] [MAIN ] HLI: Loaded 31485 existing records. [2025-09-18T19:29:21.114117] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:29:21.114511] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-18T19:29:21.114614] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-18T19:29:21.115602] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-18T19:29:21.115705] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-18T19:29:21.336361] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-18T19:29:21.320179] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-09-18T19:29:21.524075] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:29:22.068798] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-18T19:29:22.119501] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-09-18T19:29:22.582812] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-18T19:29:22.919624] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-11. [2025-09-18T19:29:23.357596] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-18T19:29:23.719564] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-18T19:29:24.140035] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-18T19:29:24.519570] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-09-18T19:29:24.595775] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-18T19:29:25.319543] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-09-18T19:29:25.411367] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-18T19:29:26.119612] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-09-18T19:29:26.919617] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-18T19:29:27.244558] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-18T19:29:27.476209] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-18T19:29:27.595278] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-18T19:29:27.719567] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-18T19:29:28.519568] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-18T19:29:28.631234] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-18T19:29:29.319544] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-09-18T19:29:30.124904] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-18T19:29:30.146566] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-18T19:29:30.255610] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-18T19:29:30.853380] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-18T19:29:30.919535] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-18T19:29:31.719548] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-18T19:29:32.279836] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-18T19:29:32.519587] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-18T19:29:33.266808] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-18T19:29:33.319519] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-18T19:29:33.570174] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-18T19:29:34.119592] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-18T19:29:34.919620] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-18T19:29:35.027338] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-18T19:29:35.461085] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T19:29:35.719559] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-18T19:29:35.900917] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-18T19:29:36.519581] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-18T19:29:37.052013] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-18T19:29:37.319696] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-18T19:29:37.569475] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-18T19:29:38.119549] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-18T19:29:38.919626] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-18T19:29:39.201218] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-18T19:29:39.261232] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-18T19:29:39.719716] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-18T19:29:39.766285] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-18T19:29:40.519589] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-18T19:29:41.078637] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-18T19:29:41.319569] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-18T19:29:42.119552] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-18T19:29:42.292803] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-18T19:29:42.919564] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-18T19:29:43.094935] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-18T19:29:43.123140] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-18T19:29:43.719581] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-18T19:29:43.755872] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-18T19:29:43.759354] [INFO ] [REMOTE ] HKD: Full fetch complete (28501 records). [2025-09-18T19:29:43.759456] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-18T19:29:44.140324] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-09-18T19:29:44.140411] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-09-18T19:29:44.140940] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-09-18T19:29:44.141002] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-09-18T19:29:44.141814] [DEBUG] [LOCAL ] HKD: Trimmed 28501 records to 18070 (keeping 200 days of data) [2025-09-18T19:29:44.250882] [DEBUG] [LOCAL ] HKD: Primary data saved (18070 records). [2025-09-18T19:29:44.251040] [INFO ] [MAIN ] HKD: Full history saved. [2025-09-18T19:29:44.251133] [INFO ] [MAIN ] Update Progress: 1025/2372 symbols completed. HKD took 33.4s. Estimated remaining: 3h 16m 42s. Rate: 6.8 symbols/min [2025-09-18T19:29:44.448497] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:29:44.480314] [DEBUG] [LOCAL ] HLIO: Loaded 28187 existing records from primary storage. [2025-09-18T19:29:44.480475] [INFO ] [MAIN ] HLIO: Loaded 28187 existing records. [2025-09-18T19:29:44.528407] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-18T19:29:44.671019] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:29:44.671274] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-18T19:29:44.671365] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-18T19:29:44.672434] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-18T19:29:44.672497] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-18T19:29:45.037615] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:29:45.319557] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-18T19:29:45.497150] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-18T19:29:45.581780] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-18T19:29:46.119566] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-18T19:29:46.656731] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T19:29:46.919514] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-11. [2025-09-18T19:29:47.625348] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-18T19:29:47.719543] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-18T19:29:47.759639] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-18T19:29:48.519527] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-18T19:29:48.718805] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-18T19:29:49.319602] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-18T19:29:50.119588] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-18T19:29:50.177139] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-18T19:29:50.919571] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-18T19:29:51.094714] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-18T19:29:51.117429] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-18T19:29:51.121752] [INFO ] [REMOTE ] HLI: Full fetch complete (45031 records). [2025-09-18T19:29:51.121862] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-18T19:29:51.505840] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-18T19:29:51.505951] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-18T19:29:51.506691] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-18T19:29:51.506752] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-18T19:29:51.507869] [DEBUG] [LOCAL ] HLI: Trimmed 45031 records to 31662 (keeping 200 days of data) [2025-09-18T19:29:51.711518] [DEBUG] [LOCAL ] HLI: Primary data saved (31662 records). [2025-09-18T19:29:51.711711] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-18T19:29:51.711819] [INFO ] [MAIN ] Update Progress: 1026/2372 symbols completed. HLI took 31.0s. Estimated remaining: 3h 16m 32s. Rate: 6.8 symbols/min [2025-09-18T19:29:51.725639] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-09-18T19:29:51.904179] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:29:51.939705] [DEBUG] [LOCAL ] HLLY: Loaded 33095 existing records from primary storage. [2025-09-18T19:29:51.939850] [INFO ] [MAIN ] HLLY: Loaded 33095 existing records. [2025-09-18T19:29:52.125048] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:29:52.125344] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-18T19:29:52.125392] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-18T19:29:52.126112] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-18T19:29:52.126172] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-18T19:29:52.507731] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:29:52.519493] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-11. [2025-09-18T19:29:52.741220] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-18T19:29:52.797277] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-18T19:29:52.805063] [INFO ] [REMOTE ] HL: Full fetch complete (77523 records). [2025-09-18T19:29:52.805221] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-18T19:29:53.211958] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-18T19:29:53.212059] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-18T19:29:53.213100] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-18T19:29:53.213168] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-18T19:29:53.214790] [DEBUG] [LOCAL ] HL: Trimmed 77523 records to 54060 (keeping 200 days of data) [2025-09-18T19:29:53.320703] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-09-18T19:29:53.560424] [DEBUG] [LOCAL ] HL: Primary data saved (54060 records). [2025-09-18T19:29:53.560709] [INFO ] [MAIN ] HL: Full history saved. [2025-09-18T19:29:53.561755] [INFO ] [MAIN ] Update Progress: 1027/2372 symbols completed. HL took 41.1s. Estimated remaining: 3h 16m 14s. Rate: 6.9 symbols/min [2025-09-18T19:29:53.670741] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-18T19:29:53.775696] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:29:53.838265] [DEBUG] [LOCAL ] HLN: Loaded 53084 existing records from primary storage. [2025-09-18T19:29:53.838470] [INFO ] [MAIN ] HLN: Loaded 53084 existing records. [2025-09-18T19:29:54.027481] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:29:54.027926] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-18T19:29:54.028029] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-18T19:29:54.034401] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-18T19:29:54.039943] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-18T19:29:54.046256] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-18T19:29:54.124606] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-18T19:29:54.417979] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:29:54.919546] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-11. [2025-09-18T19:29:55.502912] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-18T19:29:55.719565] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-18T19:29:56.519626] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-18T19:29:56.686134] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-18T19:29:57.045860] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T19:29:57.056266] [INFO ] [REMOTE ] HLF: Full fetch complete (71419 records). [2025-09-18T19:29:57.056478] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-18T19:29:57.324683] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-09-18T19:29:57.375907] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-18T19:29:57.474597] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-18T19:29:57.474707] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-18T19:29:57.475562] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-18T19:29:57.475606] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-18T19:29:57.477021] [DEBUG] [LOCAL ] HLF: Trimmed 71419 records to 49283 (keeping 200 days of data) [2025-09-18T19:29:57.766769] [DEBUG] [LOCAL ] HLF: Primary data saved (49283 records). [2025-09-18T19:29:57.766932] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-18T19:29:57.767785] [INFO ] [MAIN ] Update Progress: 1028/2372 symbols completed. HLF took 41.3s. Estimated remaining: 3h 15m 59s. Rate: 6.9 symbols/min [2025-09-18T19:29:57.939568] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:29:57.993148] [DEBUG] [LOCAL ] HLT: Loaded 50795 existing records from primary storage. [2025-09-18T19:29:57.993297] [INFO ] [MAIN ] HLT: Loaded 50795 existing records. [2025-09-18T19:29:58.132300] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-18T19:29:58.175565] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:29:58.175807] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-18T19:29:58.175856] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-18T19:29:58.177044] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-18T19:29:58.177104] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-18T19:29:58.548050] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:29:58.919548] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-11. [2025-09-18T19:29:59.078447] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-18T19:29:59.103821] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-18T19:29:59.719557] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-09-18T19:30:00.321744] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-18T19:30:00.519544] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-09-18T19:30:00.919007] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T19:30:01.319516] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-18T19:30:01.372096] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-18T19:30:02.119553] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-18T19:30:02.862396] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-18T19:30:02.919540] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-18T19:30:03.361930] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-18T19:30:03.719589] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-09-18T19:30:04.519596] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-18T19:30:04.566934] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-18T19:30:05.319619] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-18T19:30:05.602068] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-18T19:30:05.883075] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-18T19:30:06.119549] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-18T19:30:06.919557] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-09-18T19:30:07.434318] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-18T19:30:07.703574] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-18T19:30:07.719508] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-18T19:30:08.013130] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-18T19:30:08.519547] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-18T19:30:09.319562] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-18T19:30:09.618024] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-18T19:30:09.649569] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T19:30:10.120234] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-09-18T19:30:10.127369] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-18T19:30:10.919594] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-18T19:30:11.599263] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-18T19:30:11.719545] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-18T19:30:12.338838] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-18T19:30:12.519547] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-18T19:30:13.225396] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-18T19:30:13.319506] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-18T19:30:13.566398] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-18T19:30:14.119539] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-18T19:30:14.884928] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-18T19:30:14.919526] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-18T19:30:15.504184] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T19:30:15.719545] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-18T19:30:16.299291] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-18T19:30:16.519548] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-18T19:30:17.293499] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T19:30:17.319491] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-18T19:30:18.119542] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-18T19:30:18.201078] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-18T19:30:18.212298] [INFO ] [REMOTE ] HLN: Full fetch complete (76578 records). [2025-09-18T19:30:18.212437] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-18T19:30:18.654906] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-18T19:30:18.654995] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-18T19:30:18.655882] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-18T19:30:18.655949] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-18T19:30:18.657480] [DEBUG] [LOCAL ] HLN: Trimmed 76578 records to 53472 (keeping 200 days of data) [2025-09-18T19:30:18.931048] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-18T19:30:18.980707] [DEBUG] [LOCAL ] HLN: Primary data saved (53472 records). [2025-09-18T19:30:18.982770] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-18T19:30:18.982873] [INFO ] [MAIN ] Update Progress: 1029/2372 symbols completed. HLN took 25.4s. Estimated remaining: 3h 16m 7s. Rate: 6.8 symbols/min [2025-09-18T19:30:19.164382] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:30:19.206113] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-18T19:30:19.246387] [DEBUG] [LOCAL ] HLX: Loaded 48180 existing records from primary storage. [2025-09-18T19:30:19.246583] [INFO ] [MAIN ] HLX: Loaded 48180 existing records. [2025-09-18T19:30:19.435580] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:30:19.436033] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-18T19:30:19.436220] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-18T19:30:19.437400] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-18T19:30:19.437463] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-18T19:30:19.588169] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-18T19:30:19.724771] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-18T19:30:19.845292] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:30:20.519570] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-18T19:30:20.719007] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-18T19:30:20.725164] [INFO ] [REMOTE ] HLIO: Full fetch complete (36016 records). [2025-09-18T19:30:20.725280] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-18T19:30:21.110863] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-18T19:30:21.110959] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-18T19:30:21.111572] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-18T19:30:21.111615] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-18T19:30:21.113572] [DEBUG] [LOCAL ] HLIO: Trimmed 36016 records to 28359 (keeping 200 days of data) [2025-09-18T19:30:21.316925] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-18T19:30:21.326467] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-11. [2025-09-18T19:30:21.331092] [DEBUG] [LOCAL ] HLIO: Primary data saved (28359 records). [2025-09-18T19:30:21.331839] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-18T19:30:21.331946] [INFO ] [MAIN ] Update Progress: 1030/2372 symbols completed. HLIO took 37.1s. Estimated remaining: 3h 15m 50s. Rate: 6.9 symbols/min [2025-09-18T19:30:21.519679] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:30:21.568166] [DEBUG] [LOCAL ] HMC: Loaded 47041 existing records from primary storage. [2025-09-18T19:30:21.568306] [INFO ] [MAIN ] HMC: Loaded 47041 existing records. [2025-09-18T19:30:21.751499] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:30:21.751843] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-18T19:30:21.751896] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-18T19:30:21.753377] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-18T19:30:21.753439] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-18T19:30:22.124759] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-18T19:30:22.158762] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:30:22.426910] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-18T19:30:22.755423] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T19:30:22.919781] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-18T19:30:22.919705] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-18T19:30:23.719584] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-09-18T19:30:24.519597] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-18T19:30:24.604780] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-18T19:30:24.810338] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-18T19:30:25.319572] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-09-18T19:30:25.542512] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-18T19:30:26.119608] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-11. [2025-09-18T19:30:26.384745] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-18T19:30:26.919559] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-18T19:30:27.535271] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T19:30:27.719547] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-09-18T19:30:28.313751] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T19:30:28.519583] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-18T19:30:29.319583] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-18T19:30:29.509327] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-18T19:30:29.893885] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-18T19:30:30.119566] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-18T19:30:30.919580] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-18T19:30:31.087862] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-18T19:30:31.686729] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-18T19:30:31.692235] [INFO ] [REMOTE ] HLLY: Full fetch complete (46076 records). [2025-09-18T19:30:31.692432] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-18T19:30:31.724718] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-18T19:30:32.083916] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-18T19:30:32.084016] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-18T19:30:32.084698] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-18T19:30:32.084779] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-18T19:30:32.085971] [DEBUG] [LOCAL ] HLLY: Trimmed 46076 records to 33420 (keeping 200 days of data) [2025-09-18T19:30:32.277921] [DEBUG] [LOCAL ] HLLY: Primary data saved (33420 records). [2025-09-18T19:30:32.278084] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-18T19:30:32.278203] [INFO ] [MAIN ] Update Progress: 1031/2372 symbols completed. HLLY took 40.6s. Estimated remaining: 3h 15m 44s. Rate: 6.9 symbols/min [2025-09-18T19:30:32.458967] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:30:32.509440] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T19:30:32.508201] [DEBUG] [LOCAL ] HMN: Loaded 23228 existing records from primary storage. [2025-09-18T19:30:32.509676] [INFO ] [MAIN ] HMN: Loaded 23228 existing records. [2025-09-18T19:30:32.520046] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-09-18T19:30:32.711584] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:30:32.711908] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-18T19:30:32.711961] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-18T19:30:32.712605] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-18T19:30:32.712706] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-18T19:30:33.075841] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:30:33.319587] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-18T19:30:33.491711] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-18T19:30:34.122236] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-11. [2025-09-18T19:30:34.129764] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T19:30:34.612986] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-18T19:30:34.620028] [INFO ] [REMOTE ] HLT: Full fetch complete (73299 records). [2025-09-18T19:30:34.620199] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-18T19:30:34.933941] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-18T19:30:35.039894] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-18T19:30:35.040097] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-18T19:30:35.041411] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-18T19:30:35.041545] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-18T19:30:35.058170] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-18T19:30:35.064574] [DEBUG] [LOCAL ] HLT: Trimmed 73299 records to 51154 (keeping 200 days of data) [2025-09-18T19:30:35.392843] [DEBUG] [LOCAL ] HLT: Primary data saved (51154 records). [2025-09-18T19:30:35.392989] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-18T19:30:35.394356] [INFO ] [MAIN ] Update Progress: 1032/2372 symbols completed. HLT took 37.6s. Estimated remaining: 3h 15m 28s. Rate: 6.9 symbols/min [2025-09-18T19:30:35.573115] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:30:35.633889] [DEBUG] [LOCAL ] HMY: Loaded 53125 existing records from primary storage. [2025-09-18T19:30:35.634078] [INFO ] [MAIN ] HMY: Loaded 53125 existing records. [2025-09-18T19:30:35.728213] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-18T19:30:35.829111] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:30:35.829382] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-18T19:30:35.829438] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-18T19:30:35.830564] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-18T19:30:35.830625] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-18T19:30:36.188786] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:30:36.460767] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-18T19:30:36.519495] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-18T19:30:37.319616] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-11. [2025-09-18T19:30:37.498245] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-18T19:30:37.849807] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T19:30:38.119618] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-18T19:30:38.919572] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-18T19:30:39.071187] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-18T19:30:39.351639] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-18T19:30:39.719599] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-18T19:30:40.483243] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-18T19:30:40.519539] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-18T19:30:41.319583] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-09-18T19:30:41.532402] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-18T19:30:42.021082] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-18T19:30:42.064901] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-18T19:30:42.119564] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-09-18T19:30:42.910693] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-18T19:30:42.919489] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-18T19:30:43.719615] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-18T19:30:43.772191] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-18T19:30:44.519568] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-18T19:30:45.319623] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-09-18T19:30:45.347122] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-18T19:30:45.435978] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-18T19:30:46.119574] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-18T19:30:46.919628] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-18T19:30:47.043453] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-18T19:30:47.233067] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-18T19:30:47.671268] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-18T19:30:47.719596] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-18T19:30:48.519569] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-09-18T19:30:49.319554] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-18T19:30:49.735030] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-18T19:30:50.119573] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-18T19:30:50.201866] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-18T19:30:50.556750] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T19:30:50.919549] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-18T19:30:51.719576] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-18T19:30:51.859150] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-18T19:30:52.206960] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-18T19:30:52.213292] [INFO ] [REMOTE ] HLX: Full fetch complete (68956 records). [2025-09-18T19:30:52.213456] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-18T19:30:52.524606] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-18T19:30:52.619838] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-18T19:30:52.619914] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-18T19:30:52.621563] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-18T19:30:52.621661] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-18T19:30:52.628483] [DEBUG] [LOCAL ] HLX: Trimmed 68956 records to 48514 (keeping 200 days of data) [2025-09-18T19:30:52.881919] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-18T19:30:52.952382] [DEBUG] [LOCAL ] HLX: Primary data saved (48514 records). [2025-09-18T19:30:52.952531] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-18T19:30:52.952639] [INFO ] [MAIN ] Update Progress: 1033/2372 symbols completed. HLX took 34.0s. Estimated remaining: 3h 15m 30s. Rate: 6.8 symbols/min [2025-09-18T19:30:53.128326] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:30:53.128538] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-18T19:30:53.128593] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-18T19:30:53.128767] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-18T19:30:53.128813] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-18T19:30:53.128855] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-18T19:30:53.128888] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-18T19:30:53.325342] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-18T19:30:53.493361] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:30:54.119565] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-11. [2025-09-18T19:30:54.336478] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:30:54.351988] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-18T19:30:54.350778] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-11 [2025-09-18T19:30:54.767222] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-18T19:30:54.773985] [INFO ] [REMOTE ] HMC: Full fetch complete (69629 records). [2025-09-18T19:30:54.774129] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-18T19:30:54.924704] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-18T19:30:55.180959] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-18T19:30:55.181101] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-18T19:30:55.182930] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-18T19:30:55.183036] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-18T19:30:55.188489] [DEBUG] [LOCAL ] HMC: Trimmed 69629 records to 47409 (keeping 200 days of data) [2025-09-18T19:30:55.492586] [DEBUG] [LOCAL ] HMC: Primary data saved (47409 records). [2025-09-18T19:30:55.492757] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-18T19:30:55.492889] [INFO ] [MAIN ] Update Progress: 1034/2372 symbols completed. HMC took 34.2s. Estimated remaining: 3h 15m 13s. Rate: 6.9 symbols/min [2025-09-18T19:30:55.678093] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:30:55.717969] [DEBUG] [LOCAL ] HNI: Loaded 28800 existing records from primary storage. [2025-09-18T19:30:55.718117] [INFO ] [MAIN ] HNI: Loaded 28800 existing records. [2025-09-18T19:30:55.729450] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-18T19:30:55.901062] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:30:55.901368] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-18T19:30:55.901444] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-18T19:30:55.902140] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-18T19:30:55.902199] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-18T19:30:56.042122] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:30:56.100579] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-18T19:30:56.314527] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:30:56.316200] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-18T19:30:56.519569] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-18T19:30:57.319576] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-18T19:30:57.513249] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-18T19:30:58.119577] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-18T19:30:58.832017] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T19:30:58.919576] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-18T19:30:59.172454] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-18T19:30:59.719548] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-18T19:31:00.519594] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-09-18T19:31:00.595085] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-18T19:31:00.598565] [INFO ] [REMOTE ] HMN: Full fetch complete (31524 records). [2025-09-18T19:31:00.598667] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-18T19:31:00.714851] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:31:00.739965] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-09-18T19:31:00.969333] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-18T19:31:00.969414] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-18T19:31:00.969974] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-18T19:31:00.970036] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-18T19:31:00.970872] [DEBUG] [LOCAL ] HMN: Trimmed 31524 records to 23442 (keeping 200 days of data) [2025-09-18T19:31:01.127497] [DEBUG] [LOCAL ] HMN: Primary data saved (23442 records). [2025-09-18T19:31:01.127629] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-18T19:31:01.127825] [INFO ] [MAIN ] Update Progress: 1035/2372 symbols completed. HMN took 28.8s. Estimated remaining: 3h 15m 1s. Rate: 6.9 symbols/min [2025-09-18T19:31:01.307801] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:31:01.330879] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-02. [2025-09-18T19:31:01.359233] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-18T19:31:01.426990] [DEBUG] [LOCAL ] HOG: Loaded 51295 existing records from primary storage. [2025-09-18T19:31:01.427143] [INFO ] [MAIN ] HOG: Loaded 51295 existing records. [2025-09-18T19:31:01.566352] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:31:01.580252] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-02 [2025-09-18T19:31:01.607091] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:31:01.607335] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-18T19:31:01.607401] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-18T19:31:01.608549] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-18T19:31:01.608617] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-18T19:31:01.957314] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:31:02.119493] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-11. [2025-09-18T19:31:02.919549] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-03. [2025-09-18T19:31:03.123201] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:31:03.123610] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-03 [2025-09-18T19:31:03.345134] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-18T19:31:03.719547] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-11. [2025-09-18T19:31:04.519522] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-04. [2025-09-18T19:31:04.696296] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-18T19:31:04.717139] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:31:04.717486] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-04 [2025-09-18T19:31:05.319542] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-05. [2025-09-18T19:31:05.951942] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-18T19:31:06.119549] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-06. [2025-09-18T19:31:06.919553] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-09-18T19:31:07.719537] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-18T19:31:07.755508] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-18T19:31:08.333681] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-18T19:31:08.519550] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-07. [2025-09-18T19:31:09.319550] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-09-18T19:31:09.493712] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-18T19:31:10.119521] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-09-18T19:31:10.195870] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-18T19:31:10.686000] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-18T19:31:10.919511] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-08. [2025-09-18T19:31:11.074963] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-18T19:31:11.719543] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-18T19:31:12.289874] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-18T19:31:12.519556] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-18T19:31:13.293180] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-18T19:31:13.319555] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-09-18T19:31:14.119548] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-18T19:31:14.187238] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T19:31:14.256569] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-18T19:31:14.919533] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-18T19:31:15.719610] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-18T19:31:15.888468] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-18T19:31:16.533022] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-18T19:31:16.563183] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T19:31:17.000153] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-18T19:31:17.006750] [INFO ] [REMOTE ] HNGE: Full fetch complete (25019 records). [2025-09-18T19:31:17.006922] [DEBUG] [VALIDATOR ] HNGE: Validating primary data. [2025-09-18T19:31:17.209095] [WARN ] [VALIDATOR ] HNGE: Validation failed - insufficient historical data. Have 82 unique days, need 200 days [2025-09-18T19:31:17.209562] [FATAL] [MAIN ] HNGE: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:31:17.209666] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:31:17.209735] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-18T19:31:17.209822] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-18T19:31:17.209900] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-18T19:31:17.209984] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-18T19:31:17.210118] [INFO ] [MAIN ] Update Progress: 1036/2372 symbols completed. HNGE took 24.3s. Estimated remaining: 3h 15m 1s. Rate: 6.9 symbols/min [2025-09-18T19:31:17.325565] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-18T19:31:17.407712] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:31:17.437022] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-18T19:31:17.474480] [DEBUG] [LOCAL ] HOMB: Loaded 43727 existing records from primary storage. [2025-09-18T19:31:17.474661] [INFO ] [MAIN ] HOMB: Loaded 43727 existing records. [2025-09-18T19:31:17.667069] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:31:17.667342] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-18T19:31:17.667392] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-18T19:31:17.668750] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-18T19:31:17.668819] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-18T19:31:18.059389] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:31:18.119492] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-11. [2025-09-18T19:31:18.879023] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-18T19:31:18.919549] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-18T19:31:19.290422] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-18T19:31:19.719566] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-18T19:31:20.459873] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-18T19:31:20.519561] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-09-18T19:31:21.319580] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-18T19:31:21.432359] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-18T19:31:21.655756] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-18T19:31:22.119550] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-18T19:31:22.184797] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-18T19:31:22.919588] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-18T19:31:23.719730] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-09-18T19:31:24.075951] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-18T19:31:24.086938] [INFO ] [REMOTE ] HMY: Full fetch complete (76455 records). [2025-09-18T19:31:24.087141] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-18T19:31:24.507563] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-18T19:31:24.507733] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-18T19:31:24.508931] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-18T19:31:24.509056] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-18T19:31:24.519929] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-18T19:31:24.543352] [DEBUG] [LOCAL ] HMY: Trimmed 76455 records to 53515 (keeping 200 days of data) [2025-09-18T19:31:24.543145] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-18T19:31:24.834794] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-18T19:31:24.933121] [DEBUG] [LOCAL ] HMY: Primary data saved (53515 records). [2025-09-18T19:31:24.933289] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-18T19:31:24.934324] [INFO ] [MAIN ] Update Progress: 1037/2372 symbols completed. HMY took 49.5s. Estimated remaining: 3h 14m 51s. Rate: 6.9 symbols/min [2025-09-18T19:31:25.319621] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-18T19:31:25.358254] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-18T19:31:26.119569] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-18T19:31:26.736713] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T19:31:26.919630] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-18T19:31:27.650513] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T19:31:27.725825] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-18T19:31:27.729875] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-18T19:31:28.519575] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-18T19:31:29.108885] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-18T19:31:29.319579] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-18T19:31:29.728228] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-18T19:31:30.119591] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-18T19:31:30.919566] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-18T19:31:31.006279] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T19:31:31.082159] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-18T19:31:31.090596] [INFO ] [REMOTE ] HOG: Full fetch complete (74076 records). [2025-09-18T19:31:31.090787] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-18T19:31:31.578663] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-18T19:31:31.578760] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-18T19:31:31.579622] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-18T19:31:31.579699] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-18T19:31:31.581145] [DEBUG] [LOCAL ] HOG: Trimmed 74076 records to 51670 (keeping 200 days of data) [2025-09-18T19:31:31.719589] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-18T19:31:31.937121] [DEBUG] [LOCAL ] HOG: Primary data saved (51670 records). [2025-09-18T19:31:31.937276] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-18T19:31:31.937378] [INFO ] [MAIN ] Update Progress: 1038/2372 symbols completed. HOG took 30.8s. Estimated remaining: 3h 14m 40s. Rate: 6.9 symbols/min [2025-09-18T19:31:32.133885] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-18T19:31:32.519557] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-18T19:31:32.759142] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-18T19:31:33.319531] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-18T19:31:33.761014] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-18T19:31:34.119573] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-18T19:31:34.349212] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-18T19:31:34.919581] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-18T19:31:35.467615] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-18T19:31:35.719602] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-18T19:31:36.061021] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-18T19:31:36.066618] [INFO ] [REMOTE ] HNI: Full fetch complete (40709 records). [2025-09-18T19:31:36.066763] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-18T19:31:36.516324] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-18T19:31:36.516420] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-18T19:31:36.517082] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-18T19:31:36.517144] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-18T19:31:36.518431] [DEBUG] [LOCAL ] HNI: Trimmed 40709 records to 29086 (keeping 200 days of data) [2025-09-18T19:31:36.707567] [DEBUG] [LOCAL ] HNI: Primary data saved (29086 records). [2025-09-18T19:31:36.707730] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-18T19:31:36.707826] [INFO ] [MAIN ] Update Progress: 1039/2372 symbols completed. HNI took 41.2s. Estimated remaining: 3h 14m 26s. Rate: 6.9 symbols/min [2025-09-18T19:31:37.222721] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-18T19:31:37.234274] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-18T19:31:38.447383] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-18T19:31:38.456971] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-18T19:31:39.758433] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-18T19:31:39.775748] [INFO ] [REMOTE ] HOMB: Full fetch complete (63431 records). [2025-09-18T19:31:39.775989] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-18T19:31:40.308350] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-18T19:31:40.308458] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-18T19:31:40.309373] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-18T19:31:40.309461] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-18T19:31:40.311016] [DEBUG] [LOCAL ] HOMB: Trimmed 63431 records to 44071 (keeping 200 days of data) [2025-09-18T19:31:40.594893] [DEBUG] [LOCAL ] HOMB: Primary data saved (44071 records). [2025-09-18T19:31:40.595050] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-18T19:31:40.595144] [INFO ] [MAIN ] Update Progress: 1040/2372 symbols completed. HOMB took 23.4s. Estimated remaining: 3h 14m 11s. Rate: 6.9 symbols/min [2025-09-18T19:31:41.206544] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:31:41.279221] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:31:41.313218] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:31:41.370572] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:31:41.397481] [DEBUG] [LOCAL ] HOV: Loaded 13751 existing records from primary storage. [2025-09-18T19:31:41.397832] [INFO ] [MAIN ] HOV: Loaded 13751 existing records. [2025-09-18T19:31:41.682072] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:31:41.683360] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-09-18T19:31:41.684748] [DEBUG] [LOCAL ] HOUS: Loaded 43946 existing records from primary storage. [2025-09-18T19:31:41.684837] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-09-18T19:31:41.685280] [INFO ] [MAIN ] HOUS: Loaded 43946 existing records. [2025-09-18T19:31:41.685072] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-18T19:31:41.714059] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-18T19:31:41.744412] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-18T19:31:41.770736] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-18T19:31:41.900258] [DEBUG] [LOCAL ] HP: Loaded 51644 existing records from primary storage. [2025-09-18T19:31:41.965154] [INFO ] [MAIN ] HP: Loaded 51644 existing records. [2025-09-18T19:31:42.222020] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:31:42.325602] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-18T19:31:42.399204] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-18T19:31:42.417685] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:31:42.493178] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-18T19:31:42.525621] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-18T19:31:42.547984] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-18T19:31:42.558122] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-18T19:31:42.598079] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-18T19:31:42.695720] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-18T19:31:42.690355] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:31:42.797157] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-18T19:31:42.843722] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-18T19:31:42.946672] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:31:42.942201] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-18T19:31:42.981185] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-11. [2025-09-18T19:31:42.983108] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-18T19:31:43.754312] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:31:43.830106] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-11. [2025-09-18T19:31:43.829784] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:31:43.838584] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-11. [2025-09-18T19:31:43.936332] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-18T19:31:43.942827] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:31:43.947309] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-11. [2025-09-18T19:31:43.946978] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-09-18T19:31:44.788902] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T19:31:44.792903] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-09-18T19:31:45.389679] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-18T19:31:45.399504] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-09-18T19:31:45.446326] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-18T19:31:45.449660] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-18T19:31:45.487043] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-18T19:31:45.497902] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-09-18T19:31:45.541779] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-18T19:31:45.552462] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-09-18T19:31:45.981408] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-18T19:31:46.119549] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-18T19:31:46.359992] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-18T19:31:46.704828] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-18T19:31:46.919560] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-09-18T19:31:47.011035] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-18T19:31:47.351732] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-18T19:31:47.719556] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-09-18T19:31:48.118243] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T19:31:48.519557] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-09-18T19:31:49.319596] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-18T19:31:49.798206] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-18T19:31:49.866267] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-18T19:31:50.119568] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-18T19:31:50.296192] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-18T19:31:50.919576] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-18T19:31:51.719590] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-18T19:31:52.051154] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-18T19:31:52.086417] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-18T19:31:52.519613] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-18T19:31:53.146953] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T19:31:53.319538] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-18T19:31:54.119570] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-18T19:31:54.413513] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-18T19:31:54.593957] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-18T19:31:54.738877] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-18T19:31:54.919569] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-18T19:31:55.719572] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-18T19:31:56.519552] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-18T19:31:56.741944] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-18T19:31:57.319575] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-18T19:31:57.619401] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-18T19:31:57.669040] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-18T19:31:58.119587] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-18T19:31:58.919590] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-18T19:31:59.189879] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-18T19:31:59.530867] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-18T19:31:59.719588] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-18T19:32:00.324416] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T19:32:00.519561] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-18T19:32:01.333065] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-18T19:32:01.341154] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-18T19:32:01.559394] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-18T19:32:02.119547] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-18T19:32:02.850239] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-18T19:32:02.919530] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-18T19:32:03.367628] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-18T19:32:03.719565] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-18T19:32:04.495730] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-18T19:32:04.519535] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-18T19:32:04.677838] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-18T19:32:05.102303] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-18T19:32:05.319548] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-18T19:32:06.119557] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-18T19:32:06.919561] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-18T19:32:07.288846] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-18T19:32:07.399898] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-18T19:32:07.719557] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-18T19:32:08.158813] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T19:32:08.519559] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-18T19:32:09.139286] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-18T19:32:09.159865] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-18T19:32:09.163691] [INFO ] [REMOTE ] HOV: Full fetch complete (19389 records). [2025-09-18T19:32:09.163830] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-18T19:32:09.327161] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-18T19:32:09.564366] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-18T19:32:09.564462] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-18T19:32:09.564916] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-18T19:32:09.564978] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-18T19:32:09.565618] [DEBUG] [LOCAL ] HOV: Trimmed 19389 records to 13888 (keeping 200 days of data) [2025-09-18T19:32:09.651330] [DEBUG] [LOCAL ] HOV: Primary data saved (13888 records). [2025-09-18T19:32:09.651489] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-18T19:32:09.651583] [INFO ] [MAIN ] Update Progress: 1041/2372 symbols completed. HOV took 29.1s. Estimated remaining: 3h 14m 29s. Rate: 6.8 symbols/min [2025-09-18T19:32:09.824418] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:32:09.834493] [DEBUG] [LOCAL ] HPF: Loaded 7238 existing records from primary storage. [2025-09-18T19:32:09.834627] [INFO ] [MAIN ] HPF: Loaded 7238 existing records. [2025-09-18T19:32:10.016795] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:32:10.017083] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-18T19:32:10.017133] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-18T19:32:10.017498] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-18T19:32:10.017567] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-18T19:32:10.123056] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-18T19:32:10.386565] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:32:10.919605] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-11. [2025-09-18T19:32:11.386782] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-18T19:32:11.440844] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-18T19:32:11.449203] [INFO ] [REMOTE ] HP: Full fetch complete (73740 records). [2025-09-18T19:32:11.449315] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-18T19:32:11.724999] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-18T19:32:11.846588] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-18T19:32:11.846720] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-18T19:32:11.847615] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-18T19:32:11.847705] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-18T19:32:11.849329] [DEBUG] [LOCAL ] HP: Trimmed 73740 records to 52009 (keeping 200 days of data) [2025-09-18T19:32:12.086724] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-18T19:32:12.106451] [INFO ] [REMOTE ] HPE: Full fetch complete (77587 records). [2025-09-18T19:32:12.121217] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-18T19:32:12.531376] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-09-18T19:32:12.531506] [DEBUG] [LOCAL ] HP: Primary data saved (52009 records). [2025-09-18T19:32:12.536863] [INFO ] [MAIN ] HP: Full history saved. [2025-09-18T19:32:12.538115] [INFO ] [MAIN ] Update Progress: 1042/2372 symbols completed. HP took 31.9s. Estimated remaining: 3h 14m 12s. Rate: 6.8 symbols/min [2025-09-18T19:32:12.744433] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-18T19:32:12.744869] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-18T19:32:12.762584] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-18T19:32:12.778159] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-18T19:32:12.823247] [DEBUG] [LOCAL ] HPE: Trimmed 77587 records to 54087 (keeping 200 days of data) [2025-09-18T19:32:12.823098] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:32:12.951062] [DEBUG] [LOCAL ] HPI: Loaded 9976 existing records from primary storage. [2025-09-18T19:32:12.955803] [INFO ] [MAIN ] HPI: Loaded 9976 existing records. [2025-09-18T19:32:13.293143] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-18T19:32:13.296694] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:32:13.299375] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-18T19:32:13.299637] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-18T19:32:13.314092] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-18T19:32:13.317443] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-18T19:32:13.318339] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-18T19:32:13.330493] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-09-18T19:32:13.827157] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:32:13.854219] [DEBUG] [LOCAL ] HPE: Primary data saved (54087 records). [2025-09-18T19:32:13.854370] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-18T19:32:13.855493] [INFO ] [MAIN ] Update Progress: 1043/2372 symbols completed. HPE took 33.3s. Estimated remaining: 3h 13m 54s. Rate: 6.9 symbols/min [2025-09-18T19:32:14.041002] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:32:14.096149] [DEBUG] [LOCAL ] HPP: Loaded 50736 existing records from primary storage. [2025-09-18T19:32:14.096338] [INFO ] [MAIN ] HPP: Loaded 50736 existing records. [2025-09-18T19:32:14.131239] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-11. [2025-09-18T19:32:14.264716] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-18T19:32:14.313520] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:32:14.313888] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-18T19:32:14.313949] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-18T19:32:14.315326] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-09-18T19:32:14.315393] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-18T19:32:14.704839] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:32:14.886340] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-18T19:32:14.919565] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-09-18T19:32:15.674689] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-18T19:32:15.719583] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-09-18T19:32:16.357410] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-18T19:32:16.519532] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-18T19:32:17.053410] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-18T19:32:17.319567] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-18T19:32:18.119591] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-11. [2025-09-18T19:32:18.619855] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T19:32:18.919605] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-18T19:32:19.404959] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-18T19:32:19.719595] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-18T19:32:19.772904] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T19:32:20.335157] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-18T19:32:20.519594] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-18T19:32:21.063900] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-18T19:32:21.319578] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-18T19:32:21.885932] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-18T19:32:22.119564] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-09-18T19:32:22.919578] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-18T19:32:23.715661] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-18T19:32:23.727195] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-18T19:32:24.217576] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-18T19:32:24.224187] [INFO ] [REMOTE ] HOUS: Full fetch complete (62288 records). [2025-09-18T19:32:24.224318] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-18T19:32:24.340757] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-18T19:32:24.524700] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-09-18T19:32:24.643499] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-18T19:32:24.643583] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-18T19:32:24.644444] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-18T19:32:24.644510] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-18T19:32:24.646855] [DEBUG] [LOCAL ] HOUS: Trimmed 62288 records to 44321 (keeping 200 days of data) [2025-09-18T19:32:24.898657] [DEBUG] [LOCAL ] HOUS: Primary data saved (44321 records). [2025-09-18T19:32:24.898822] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-18T19:32:24.898954] [INFO ] [MAIN ] Update Progress: 1044/2372 symbols completed. HOUS took 44.3s. Estimated remaining: 3h 13m 48s. Rate: 6.9 symbols/min [2025-09-18T19:32:25.070074] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:32:25.127505] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-09-18T19:32:25.127694] [INFO ] [MAIN ] HPQ: Loaded 53669 existing records. [2025-09-18T19:32:25.321437] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-18T19:32:25.349960] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:32:25.350275] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-18T19:32:25.350324] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-18T19:32:25.351935] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-18T19:32:25.352028] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-18T19:32:25.747937] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:32:25.981249] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-18T19:32:25.984180] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-18T19:32:26.119556] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-18T19:32:26.919579] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-18T19:32:27.405423] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-18T19:32:27.719613] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-18T19:32:27.773125] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-18T19:32:28.519694] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-18T19:32:29.014099] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-18T19:32:29.301028] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-18T19:32:29.319494] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-18T19:32:30.119566] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-18T19:32:30.925570] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-18T19:32:30.931847] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-18T19:32:30.958448] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-18T19:32:30.960268] [INFO ] [REMOTE ] HPF: Full fetch complete (10757 records). [2025-09-18T19:32:30.960346] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-18T19:32:31.333820] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-18T19:32:31.333920] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-18T19:32:31.334255] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-18T19:32:31.334298] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-18T19:32:31.334900] [DEBUG] [LOCAL ] HPF: Trimmed 10757 records to 7301 (keeping 200 days of data) [2025-09-18T19:32:31.383659] [DEBUG] [LOCAL ] HPF: Primary data saved (7301 records). [2025-09-18T19:32:31.383849] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-18T19:32:31.383959] [INFO ] [MAIN ] Update Progress: 1045/2372 symbols completed. HPF took 21.7s. Estimated remaining: 3h 13m 37s. Rate: 6.9 symbols/min [2025-09-18T19:32:31.619490] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:32:31.631921] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-18T19:32:31.649455] [DEBUG] [LOCAL ] HPS: Loaded 10274 existing records from primary storage. [2025-09-18T19:32:31.649693] [INFO ] [MAIN ] HPS: Loaded 10274 existing records. [2025-09-18T19:32:31.724762] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-11. [2025-09-18T19:32:31.974219] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:32:31.974567] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-18T19:32:31.974627] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-18T19:32:31.975252] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-18T19:32:31.975324] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-18T19:32:32.494407] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:32:32.519630] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-18T19:32:33.074457] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-18T19:32:33.319548] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-18T19:32:33.646361] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-18T19:32:33.758171] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-18T19:32:34.119559] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-18T19:32:34.919544] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-09-18T19:32:35.420853] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-18T19:32:35.719561] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-18T19:32:36.519557] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-11. [2025-09-18T19:32:36.814199] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-18T19:32:37.079002] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-18T19:32:37.097329] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-18T19:32:37.319540] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-09-18T19:32:38.119564] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-18T19:32:38.806340] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-18T19:32:38.919586] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-18T19:32:39.102819] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-18T19:32:39.595198] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-18T19:32:39.719590] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-09-18T19:32:40.519581] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-18T19:32:40.586088] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-18T19:32:41.319578] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-18T19:32:42.100052] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-18T19:32:42.104618] [INFO ] [REMOTE ] HPI: Full fetch complete (13333 records). [2025-09-18T19:32:42.104764] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-18T19:32:42.124665] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-18T19:32:42.491252] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-18T19:32:42.491362] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-18T19:32:42.491707] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-18T19:32:42.491780] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-18T19:32:42.492698] [DEBUG] [LOCAL ] HPI: Trimmed 13333 records to 10086 (keeping 200 days of data) [2025-09-18T19:32:42.567546] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-18T19:32:42.599530] [DEBUG] [LOCAL ] HPI: Primary data saved (10086 records). [2025-09-18T19:32:42.599686] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-18T19:32:42.599793] [INFO ] [MAIN ] Update Progress: 1046/2372 symbols completed. HPI took 30.1s. Estimated remaining: 3h 13m 31s. Rate: 6.9 symbols/min [2025-09-18T19:32:42.780666] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:32:42.809898] [DEBUG] [LOCAL ] HQH: Loaded 24920 existing records from primary storage. [2025-09-18T19:32:42.810046] [INFO ] [MAIN ] HQH: Loaded 24920 existing records. [2025-09-18T19:32:42.924751] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-18T19:32:43.003381] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:32:43.003663] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-18T19:32:43.003777] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-18T19:32:43.004739] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-18T19:32:43.004801] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-18T19:32:43.373532] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:32:43.618222] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-18T19:32:43.719558] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-18T19:32:44.509025] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-18T19:32:44.520474] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-09-18T19:32:44.745908] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-18T19:32:45.303099] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-18T19:32:45.319512] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-18T19:32:46.119608] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-11. [2025-09-18T19:32:46.873483] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-18T19:32:46.919497] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-18T19:32:47.210911] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T19:32:47.719560] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-18T19:32:48.519539] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-09-18T19:32:48.659110] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-18T19:32:49.236140] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T19:32:49.243630] [INFO ] [REMOTE ] HPP: Full fetch complete (73176 records). [2025-09-18T19:32:49.243874] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-18T19:32:49.325686] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-18T19:32:49.715706] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-09-18T19:32:49.715515] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-18T19:32:49.715919] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-09-18T19:32:49.724045] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-09-18T19:32:49.724123] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-09-18T19:32:49.725734] [DEBUG] [LOCAL ] HPP: Trimmed 73176 records to 51117 (keeping 200 days of data) [2025-09-18T19:32:50.023893] [DEBUG] [LOCAL ] HPP: Primary data saved (51117 records). [2025-09-18T19:32:50.024053] [INFO ] [MAIN ] HPP: Full history saved. [2025-09-18T19:32:50.024145] [INFO ] [MAIN ] Update Progress: 1047/2372 symbols completed. HPP took 36.2s. Estimated remaining: 3h 13m 21s. Rate: 6.9 symbols/min [2025-09-18T19:32:50.127957] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-09-18T19:32:50.206265] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:32:50.224184] [DEBUG] [LOCAL ] HQL: Loaded 16166 existing records from primary storage. [2025-09-18T19:32:50.224317] [INFO ] [MAIN ] HQL: Loaded 16166 existing records. [2025-09-18T19:32:50.409115] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:32:50.409490] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-18T19:32:50.409553] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-18T19:32:50.410349] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-18T19:32:50.410415] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-18T19:32:50.797430] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:32:50.847329] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-18T19:32:50.919539] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-18T19:32:51.382079] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T19:32:51.411700] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-18T19:32:51.719563] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-18T19:32:52.519564] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-18T19:32:53.135844] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-18T19:32:53.319543] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-18T19:32:53.611321] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-18T19:32:53.870677] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-18T19:32:54.119544] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-18T19:32:54.920930] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-18T19:32:54.919960] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-18T19:32:55.719565] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-18T19:32:56.041622] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-18T19:32:56.519550] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-11. [2025-09-18T19:32:57.199785] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-18T19:32:57.319597] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-18T19:32:57.399633] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-18T19:32:57.885040] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-18T19:32:58.119567] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-18T19:32:58.804474] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-18T19:32:58.919542] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-18T19:32:59.719543] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-18T19:32:59.736423] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-18T19:33:00.366753] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-18T19:33:00.519555] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-18T19:33:01.319552] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-18T19:33:02.119634] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-18T19:33:02.672921] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-18T19:33:02.680293] [INFO ] [REMOTE ] HPQ: Full fetch complete (77540 records). [2025-09-18T19:33:02.680428] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-18T19:33:02.924994] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-09-18T19:33:03.107782] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-18T19:33:03.107879] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-18T19:33:03.109108] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-18T19:33:03.109202] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-18T19:33:03.110796] [DEBUG] [LOCAL ] HPQ: Trimmed 77540 records to 54059 (keeping 200 days of data) [2025-09-18T19:33:03.343100] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-18T19:33:03.346808] [INFO ] [REMOTE ] HPS: Full fetch complete (15121 records). [2025-09-18T19:33:03.347785] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-18T19:33:03.836388] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-18T19:33:03.839463] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-18T19:33:03.841603] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-18T19:33:03.841987] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-18T19:33:03.844841] [DEBUG] [LOCAL ] HPS: Trimmed 15121 records to 10359 (keeping 200 days of data) [2025-09-18T19:33:03.917760] [DEBUG] [LOCAL ] HPQ: Primary data saved (54059 records). [2025-09-18T19:33:03.918406] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-18T19:33:03.920818] [INFO ] [MAIN ] Update Progress: 1048/2372 symbols completed. HPQ took 39.0s. Estimated remaining: 3h 13m 18s. Rate: 6.8 symbols/min [2025-09-18T19:33:03.990412] [DEBUG] [LOCAL ] HPS: Primary data saved (10359 records). [2025-09-18T19:33:04.002622] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-18T19:33:04.020015] [INFO ] [MAIN ] Update Progress: 1049/2372 symbols completed. HPS took 32.6s. Estimated remaining: 3h 12m 59s. Rate: 6.9 symbols/min [2025-09-18T19:33:04.219112] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:33:04.309701] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:33:04.375113] [DEBUG] [LOCAL ] HR: Loaded 51970 existing records from primary storage. [2025-09-18T19:33:04.375318] [INFO ] [MAIN ] HR: Loaded 51970 existing records. [2025-09-18T19:33:04.493879] [DEBUG] [LOCAL ] HRB: Loaded 48638 existing records from primary storage. [2025-09-18T19:33:04.514731] [INFO ] [MAIN ] HRB: Loaded 48638 existing records. [2025-09-18T19:33:04.659184] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:33:04.684261] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-18T19:33:04.688141] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-18T19:33:04.694606] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-09-18T19:33:04.704937] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-18T19:33:04.877479] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:33:04.877804] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-18T19:33:04.883449] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-18T19:33:04.889855] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-18T19:33:04.895025] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-18T19:33:05.472507] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:33:05.472967] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-11. [2025-09-18T19:33:05.558069] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:33:05.558839] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-11. [2025-09-18T19:33:05.585253] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (3.47 seconds). [2025-09-18T19:33:05.586163] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-18T19:33:05.596072] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-09-18T19:33:06.119557] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-18T19:33:06.599663] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-18T19:33:06.859429] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-18T19:33:06.915667] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-18T19:33:06.925379] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-09-18T19:33:06.965058] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-18T19:33:07.719570] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-18T19:33:08.503932] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-18T19:33:08.519504] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-09-18T19:33:08.552025] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-18T19:33:09.319536] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-18T19:33:10.033717] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T19:33:10.119514] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-18T19:33:10.137269] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-18T19:33:10.919583] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-18T19:33:11.549495] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T19:33:11.719583] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-09-18T19:33:12.077878] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-18T19:33:12.519591] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-18T19:33:13.319636] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-18T19:33:14.119535] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-18T19:33:14.538964] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-18T19:33:14.680416] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (2.96 seconds). [2025-09-18T19:33:14.919558] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-18T19:33:15.231802] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-18T19:33:15.268905] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-18T19:33:15.620136] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-18T19:33:15.719564] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-18T19:33:16.519593] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-09-18T19:33:17.319563] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-18T19:33:17.518385] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-18T19:33:17.780991] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-18T19:33:18.119545] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-18T19:33:18.337566] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-18T19:33:18.919584] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-18T19:33:19.265571] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-18T19:33:19.719557] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-18T19:33:19.936962] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-18T19:33:20.519572] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-18T19:33:20.955553] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T19:33:21.319572] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-18T19:33:21.824894] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-18T19:33:22.119584] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-18T19:33:22.386830] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-18T19:33:22.390361] [INFO ] [REMOTE ] HQH: Full fetch complete (37376 records). [2025-09-18T19:33:22.390513] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-18T19:33:22.780573] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-18T19:33:22.780701] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-18T19:33:22.781803] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-18T19:33:22.781904] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-18T19:33:22.783594] [DEBUG] [LOCAL ] HQH: Trimmed 37376 records to 25114 (keeping 200 days of data) [2025-09-18T19:33:22.931294] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-18T19:33:22.952086] [DEBUG] [LOCAL ] HQH: Primary data saved (25114 records). [2025-09-18T19:33:22.952301] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-18T19:33:22.952444] [INFO ] [MAIN ] Update Progress: 1050/2372 symbols completed. HQH took 40.4s. Estimated remaining: 3h 13m 3s. Rate: 6.8 symbols/min [2025-09-18T19:33:23.125043] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:33:23.166250] [DEBUG] [LOCAL ] HRI: Loaded 33291 existing records from primary storage. [2025-09-18T19:33:23.166396] [INFO ] [MAIN ] HRI: Loaded 33291 existing records. [2025-09-18T19:33:23.363327] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:33:23.363622] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-18T19:33:23.363710] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-18T19:33:23.364783] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-09-18T19:33:23.364863] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-18T19:33:23.723266] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-18T19:33:23.738123] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:33:24.044896] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-18T19:33:24.228244] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-18T19:33:24.519606] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-18T19:33:25.331306] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-18T19:33:25.364744] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-18T19:33:25.919890] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T19:33:25.948107] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-18T19:33:26.119601] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-18T19:33:26.783997] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-18T19:33:26.786625] [INFO ] [REMOTE ] HQL: Full fetch complete (24029 records). [2025-09-18T19:33:26.786748] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-18T19:33:26.930272] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-18T19:33:27.176304] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-18T19:33:27.176391] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-18T19:33:27.176928] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-18T19:33:27.176992] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-18T19:33:27.177785] [DEBUG] [LOCAL ] HQL: Trimmed 24029 records to 16275 (keeping 200 days of data) [2025-09-18T19:33:27.292910] [DEBUG] [LOCAL ] HQL: Primary data saved (16275 records). [2025-09-18T19:33:27.293050] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-18T19:33:27.293164] [INFO ] [MAIN ] Update Progress: 1051/2372 symbols completed. HQL took 37.3s. Estimated remaining: 3h 12m 48s. Rate: 6.9 symbols/min [2025-09-18T19:33:27.470179] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:33:27.530431] [DEBUG] [LOCAL ] HRL: Loaded 53082 existing records from primary storage. [2025-09-18T19:33:27.530614] [INFO ] [MAIN ] HRL: Loaded 53082 existing records. [2025-09-18T19:33:27.720291] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:33:27.720168] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-11. [2025-09-18T19:33:27.721554] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-18T19:33:27.721675] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-18T19:33:27.723048] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-09-18T19:33:27.723113] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-18T19:33:28.091165] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:33:28.519554] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-11. [2025-09-18T19:33:28.685994] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-18T19:33:28.759448] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-18T19:33:29.319581] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-18T19:33:29.964848] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-18T19:33:30.119550] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-18T19:33:30.762227] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-18T19:33:30.919575] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-09-18T19:33:31.501491] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T19:33:31.719589] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-09-18T19:33:32.174227] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-18T19:33:32.519583] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-18T19:33:33.180973] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-18T19:33:33.319579] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-09-18T19:33:33.782532] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-18T19:33:33.792895] [INFO ] [REMOTE ] HRB: Full fetch complete (69651 records). [2025-09-18T19:33:33.793047] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-18T19:33:34.124775] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-09-18T19:33:34.199946] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-18T19:33:34.200037] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-18T19:33:34.201143] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-18T19:33:34.201218] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-18T19:33:34.206517] [DEBUG] [LOCAL ] HRB: Trimmed 69651 records to 48974 (keeping 200 days of data) [2025-09-18T19:33:34.535951] [DEBUG] [LOCAL ] HRB: Primary data saved (48974 records). [2025-09-18T19:33:34.536155] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-18T19:33:34.536343] [INFO ] [MAIN ] Update Progress: 1052/2372 symbols completed. HRB took 30.5s. Estimated remaining: 3h 12m 38s. Rate: 6.9 symbols/min [2025-09-18T19:33:34.755220] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:33:34.803725] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-18T19:33:34.826516] [DEBUG] [LOCAL ] HRTG: Loaded 32250 existing records from primary storage. [2025-09-18T19:33:34.826746] [INFO ] [MAIN ] HRTG: Loaded 32250 existing records. [2025-09-18T19:33:34.926616] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-18T19:33:35.027493] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:33:35.028282] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-18T19:33:35.028392] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-18T19:33:35.029211] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-18T19:33:35.029286] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-18T19:33:35.156407] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-18T19:33:35.417328] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:33:35.719559] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-18T19:33:36.455486] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T19:33:36.519557] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-11. [2025-09-18T19:33:37.140449] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T19:33:37.319541] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-18T19:33:37.499416] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-18T19:33:38.119565] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-18T19:33:38.919552] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-18T19:33:39.002181] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-18T19:33:39.598109] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-18T19:33:39.719539] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-18T19:33:40.122902] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-18T19:33:40.519551] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-18T19:33:41.307664] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T19:33:41.319488] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-18T19:33:42.006206] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-18T19:33:42.119547] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-18T19:33:42.856510] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T19:33:42.919564] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-18T19:33:43.288405] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-18T19:33:43.719564] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-18T19:33:44.371237] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T19:33:44.519518] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-18T19:33:45.228211] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T19:33:45.237192] [INFO ] [REMOTE ] HR: Full fetch complete (74642 records). [2025-09-18T19:33:45.237335] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-18T19:33:45.324772] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-18T19:33:45.635813] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-09-18T19:33:45.635902] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-09-18T19:33:45.636849] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-09-18T19:33:45.636914] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-09-18T19:33:45.638360] [DEBUG] [LOCAL ] HR: Trimmed 74642 records to 52355 (keeping 200 days of data) [2025-09-18T19:33:45.985126] [DEBUG] [LOCAL ] HR: Primary data saved (52355 records). [2025-09-18T19:33:45.985706] [INFO ] [MAIN ] HR: Full history saved. [2025-09-18T19:33:45.985960] [INFO ] [MAIN ] Update Progress: 1053/2372 symbols completed. HR took 42.1s. Estimated remaining: 3h 12m 32s. Rate: 6.9 symbols/min [2025-09-18T19:33:46.129248] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-09-18T19:33:46.163710] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:33:46.206944] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-18T19:33:46.253962] [DEBUG] [LOCAL ] HSBC: Loaded 51268 existing records from primary storage. [2025-09-18T19:33:46.254144] [INFO ] [MAIN ] HSBC: Loaded 51268 existing records. [2025-09-18T19:33:46.441325] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:33:46.441880] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-18T19:33:46.441969] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-18T19:33:46.443238] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-09-18T19:33:46.443302] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-18T19:33:46.617930] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-18T19:33:46.854285] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:33:46.919509] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-11. [2025-09-18T19:33:47.581011] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-18T19:33:47.719548] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-18T19:33:48.519557] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-18T19:33:48.658214] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-18T19:33:49.258704] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-18T19:33:49.319538] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-18T19:33:49.546801] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-18T19:33:50.119565] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-18T19:33:50.919683] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-09-18T19:33:50.919547] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-18T19:33:51.015467] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-18T19:33:51.719613] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-09-18T19:33:52.370293] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-18T19:33:52.519548] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-18T19:33:52.809733] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-18T19:33:53.319590] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-18T19:33:54.119631] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-09-18T19:33:54.159133] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-18T19:33:54.166504] [INFO ] [REMOTE ] HRL: Full fetch complete (76536 records). [2025-09-18T19:33:54.166625] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-18T19:33:54.586941] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-09-18T19:33:54.587034] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-09-18T19:33:54.588030] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-09-18T19:33:54.588097] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-09-18T19:33:54.589688] [DEBUG] [LOCAL ] HRL: Trimmed 76536 records to 53469 (keeping 200 days of data) [2025-09-18T19:33:54.805142] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T19:33:54.836208] [INFO ] [REMOTE ] HRI: Full fetch complete (45526 records). [2025-09-18T19:33:54.842715] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-18T19:33:54.920199] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-18T19:33:55.178687] [DEBUG] [LOCAL ] HRL: Primary data saved (53469 records). [2025-09-18T19:33:55.207739] [INFO ] [MAIN ] HRL: Full history saved. [2025-09-18T19:33:55.219800] [INFO ] [MAIN ] Update Progress: 1054/2372 symbols completed. HRL took 27.9s. Estimated remaining: 3h 12m 24s. Rate: 6.9 symbols/min [2025-09-18T19:33:55.546534] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:33:55.562418] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-09-18T19:33:55.562510] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-09-18T19:33:55.563277] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-09-18T19:33:55.563450] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-09-18T19:33:55.566789] [DEBUG] [LOCAL ] HRI: Trimmed 45526 records to 33522 (keeping 200 days of data) [2025-09-18T19:33:55.675221] [DEBUG] [LOCAL ] HSHP: Loaded 15651 existing records from primary storage. [2025-09-18T19:33:55.679879] [INFO ] [MAIN ] HSHP: Loaded 15651 existing records. [2025-09-18T19:33:55.889332] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-18T19:33:55.935328] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:33:55.938347] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-18T19:33:55.939145] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-18T19:33:55.940836] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-18T19:33:55.942073] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-18T19:33:55.942669] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-18T19:33:56.386045] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:33:56.401169] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-18T19:33:56.430141] [DEBUG] [LOCAL ] HRI: Primary data saved (33522 records). [2025-09-18T19:33:56.430318] [INFO ] [MAIN ] HRI: Full history saved. [2025-09-18T19:33:56.430431] [INFO ] [MAIN ] Update Progress: 1055/2372 symbols completed. HRI took 33.5s. Estimated remaining: 3h 12m 6s. Rate: 6.9 symbols/min [2025-09-18T19:33:56.529223] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-18T19:33:56.610713] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:33:56.670286] [DEBUG] [LOCAL ] HSY: Loaded 50499 existing records from primary storage. [2025-09-18T19:33:56.670471] [INFO ] [MAIN ] HSY: Loaded 50499 existing records. [2025-09-18T19:33:56.855599] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:33:56.855970] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-18T19:33:56.856052] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-18T19:33:56.857594] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-18T19:33:56.857703] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-18T19:33:57.220604] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:33:57.319508] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-11. [2025-09-18T19:33:57.442343] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-18T19:33:57.709101] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-18T19:33:58.119562] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-18T19:33:58.891891] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-18T19:33:58.919500] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-09-18T19:33:59.719562] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-11. [2025-09-18T19:34:00.192634] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-18T19:34:00.519559] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-18T19:34:00.672890] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-18T19:34:00.929564] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-18T19:34:01.319571] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-09-18T19:34:02.119568] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-09-18T19:34:02.478389] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-18T19:34:02.773636] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-18T19:34:02.855700] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-18T19:34:02.919500] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-09-18T19:34:03.645112] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-18T19:34:03.719541] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-18T19:34:04.519549] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-18T19:34:04.992009] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-18T19:34:05.319576] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-18T19:34:06.119578] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-18T19:34:06.645732] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-18T19:34:06.694138] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T19:34:06.919559] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-18T19:34:07.719563] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-18T19:34:07.769616] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-18T19:34:08.036538] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-18T19:34:08.488594] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-18T19:34:08.519548] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-18T19:34:09.319526] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-18T19:34:09.641143] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-18T19:34:10.119564] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-18T19:34:10.921194] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-18T19:34:10.924698] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-18T19:34:11.028560] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-18T19:34:11.719549] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-18T19:34:12.452836] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T19:34:12.519532] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-18T19:34:13.137467] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-18T19:34:13.319558] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-18T19:34:13.983887] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T19:34:14.119604] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-18T19:34:14.695808] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-18T19:34:14.700730] [INFO ] [REMOTE ] HRTG: Full fetch complete (41635 records). [2025-09-18T19:34:14.700857] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-18T19:34:14.927215] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-18T19:34:15.115220] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-18T19:34:15.115306] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-18T19:34:15.115975] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-18T19:34:15.116051] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-18T19:34:15.117005] [DEBUG] [LOCAL ] HRTG: Trimmed 41635 records to 32581 (keeping 200 days of data) [2025-09-18T19:34:15.306057] [DEBUG] [LOCAL ] HRTG: Primary data saved (32581 records). [2025-09-18T19:34:15.306195] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-18T19:34:15.306295] [INFO ] [MAIN ] Update Progress: 1056/2372 symbols completed. HRTG took 40.8s. Estimated remaining: 3h 12m 10s. Rate: 6.8 symbols/min [2025-09-18T19:34:15.481701] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:34:15.481899] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-18T19:34:15.481949] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-18T19:34:15.482090] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-18T19:34:15.482133] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-18T19:34:15.482175] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-18T19:34:15.482207] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-18T19:34:15.728492] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-18T19:34:15.853282] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:34:15.889621] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-18T19:34:16.519571] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-18T19:34:16.671876] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-18T19:34:16.929063] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-18T19:34:17.319560] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-18T19:34:17.975948] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T19:34:18.119567] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-18T19:34:18.813213] [DEBUG] [REMOTE ] HSBC: Error fetching primary data for 2025-08: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-18T19:34:18.813374] [WARN ] [REMOTE ] HSBC: No data returned for month 2025-08 [2025-09-18T19:34:18.919533] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-18T19:34:19.719564] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-18T19:34:19.741406] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-18T19:34:19.998420] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-18T19:34:20.519557] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-18T19:34:21.319580] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-11. [2025-09-18T19:34:21.434147] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-18T19:34:21.441092] [INFO ] [REMOTE ] HSBC: Full fetch complete (65838 records). [2025-09-18T19:34:21.441233] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-18T19:34:21.517914] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:34:21.542794] [WARN ] [REMOTE ] HTB: No data returned for month 2024-11 [2025-09-18T19:34:21.646075] [WARN ] [VALIDATOR ] HSBC: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-18T19:34:21.646819] [FATAL] [MAIN ] HSBC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:34:21.646895] [WARN ] [MAIN ] HSBC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:34:21.646968] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-18T19:34:21.647049] [DEBUG] [LOCAL ] HSBC: No primary data file found to delete. [2025-09-18T19:34:21.647112] [INFO ] [LOCAL ] HSBC: Starting deletion of derivative data. [2025-09-18T19:34:21.647560] [DEBUG] [LOCAL ] HSBC: Deleted derivative data file. [2025-09-18T19:34:21.648416] [INFO ] [MAIN ] Update Progress: 1057/2372 symbols completed. HSBC took 35.7s. Estimated remaining: 3h 11m 58s. Rate: 6.9 symbols/min [2025-09-18T19:34:21.821727] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:34:21.837627] [DEBUG] [LOCAL ] HTD: Loaded 13433 existing records from primary storage. [2025-09-18T19:34:21.837789] [INFO ] [MAIN ] HTD: Loaded 13433 existing records. [2025-09-18T19:34:22.018521] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:34:22.018927] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-18T19:34:22.019054] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-18T19:34:22.019543] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-18T19:34:22.019613] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-18T19:34:22.121142] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-18T19:34:22.341792] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-18T19:34:22.437569] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:34:22.829631] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-18T19:34:22.919600] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-11. [2025-09-18T19:34:23.719594] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-09-18T19:34:23.771125] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-18T19:34:23.896921] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:34:23.897348] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-09-18T19:34:24.519594] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-09-18T19:34:24.705360] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:34:24.705962] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-09-18T19:34:25.319575] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-09-18T19:34:26.119595] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-18T19:34:26.246400] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-18T19:34:26.814569] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-18T19:34:26.919505] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-09-18T19:34:27.719569] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-02. [2025-09-18T19:34:27.802293] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-18T19:34:28.122554] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-18T19:34:28.519562] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-18T19:34:29.319569] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-18T19:34:30.120378] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-18T19:34:30.123080] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-18T19:34:30.131530] [INFO ] [REMOTE ] HSY: Full fetch complete (73769 records). [2025-09-18T19:34:30.131720] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-18T19:34:30.302202] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-18T19:34:30.543470] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-18T19:34:30.543575] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-18T19:34:30.544703] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-18T19:34:30.544777] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-18T19:34:30.546360] [DEBUG] [LOCAL ] HSY: Trimmed 73769 records to 50876 (keeping 200 days of data) [2025-09-18T19:34:30.742815] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-18T19:34:30.889296] [DEBUG] [LOCAL ] HSY: Primary data saved (50876 records). [2025-09-18T19:34:30.889456] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-18T19:34:30.889545] [INFO ] [MAIN ] Update Progress: 1058/2372 symbols completed. HSY took 34.5s. Estimated remaining: 3h 11m 50s. Rate: 6.8 symbols/min [2025-09-18T19:34:30.924781] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-18T19:34:31.064134] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:34:31.064331] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-18T19:34:31.064386] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-18T19:34:31.064534] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-18T19:34:31.064603] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-18T19:34:31.064704] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-18T19:34:31.064763] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-18T19:34:31.443850] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:34:31.719561] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-11. [2025-09-18T19:34:31.819367] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-18T19:34:31.823439] [INFO ] [REMOTE ] HSHP: Full fetch complete (23528 records). [2025-09-18T19:34:31.823672] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-18T19:34:32.119380] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-11 (0.40 seconds). [2025-09-18T19:34:32.204137] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-18T19:34:32.204222] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-18T19:34:32.204725] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-18T19:34:32.204792] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-18T19:34:32.205428] [DEBUG] [LOCAL ] HSHP: Trimmed 23528 records to 15834 (keeping 200 days of data) [2025-09-18T19:34:32.294074] [DEBUG] [LOCAL ] HSHP: Primary data saved (15834 records). [2025-09-18T19:34:32.294215] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-18T19:34:32.294344] [INFO ] [MAIN ] Update Progress: 1059/2372 symbols completed. HSHP took 37.1s. Estimated remaining: 3h 11m 32s. Rate: 6.9 symbols/min [2025-09-18T19:34:32.462329] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:34:32.511073] [DEBUG] [LOCAL ] HTGC: Loaded 47767 existing records from primary storage. [2025-09-18T19:34:32.511277] [INFO ] [MAIN ] HTGC: Loaded 47767 existing records. [2025-09-18T19:34:32.524738] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-18T19:34:32.693392] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:34:32.693706] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-18T19:34:32.693762] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-18T19:34:32.695049] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-18T19:34:32.695111] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-18T19:34:33.045193] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:34:33.319565] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-09-18T19:34:33.519630] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-18T19:34:33.570678] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-09-18T19:34:34.119626] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-09-18T19:34:34.373170] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-09-18T19:34:34.919546] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-11. [2025-09-18T19:34:35.719617] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-18T19:34:36.519616] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-03. [2025-09-18T19:34:36.645593] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-18T19:34:36.829632] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-18T19:34:37.091270] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-18T19:34:37.319561] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-04. [2025-09-18T19:34:38.090842] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-18T19:34:38.119506] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-05. [2025-09-18T19:34:38.808490] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-18T19:34:38.919603] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-06. [2025-09-18T19:34:39.664425] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-18T19:34:39.719499] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-07. [2025-09-18T19:34:40.519575] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-09-18T19:34:40.527133] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-18T19:34:41.319550] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-18T19:34:42.002967] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-18T19:34:42.119506] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-18T19:34:42.157238] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-18T19:34:42.919567] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-09-18T19:34:43.013629] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T19:34:43.719551] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-08. [2025-09-18T19:34:44.342844] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-18T19:34:44.507956] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T19:34:44.519486] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-09. [2025-09-18T19:34:45.301172] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-18T19:34:45.302990] [INFO ] [REMOTE ] HTB: Full fetch complete (7216 records). [2025-09-18T19:34:45.303068] [DEBUG] [VALIDATOR ] HTB: Validating primary data. [2025-09-18T19:34:45.324728] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-18T19:34:45.489929] [WARN ] [VALIDATOR ] HTB: Validation failed - insufficient historical data. Have 140 unique days, need 200 days [2025-09-18T19:34:45.490162] [FATAL] [MAIN ] HTB: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:34:45.490233] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:34:45.490306] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-18T19:34:45.490370] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-18T19:34:45.490407] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-18T19:34:45.490445] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-18T19:34:45.490504] [INFO ] [MAIN ] Update Progress: 1060/2372 symbols completed. HTB took 30.2s. Estimated remaining: 3h 11m 29s. Rate: 6.9 symbols/min [2025-09-18T19:34:45.659919] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:34:45.668368] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-18T19:34:45.697624] [DEBUG] [LOCAL ] HTH: Loaded 32885 existing records from primary storage. [2025-09-18T19:34:45.697794] [INFO ] [MAIN ] HTH: Loaded 32885 existing records. [2025-09-18T19:34:45.874746] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:34:45.874975] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-18T19:34:45.875023] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-18T19:34:45.875903] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-18T19:34:45.875964] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-18T19:34:46.124862] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-18T19:34:46.239087] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:34:46.919919] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-18T19:34:46.919512] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-18T19:34:47.250372] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-18T19:34:47.719581] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-18T19:34:48.519576] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-11. [2025-09-18T19:34:48.549563] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-18T19:34:49.319560] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-18T19:34:49.422392] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-18T19:34:50.001591] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-18T19:34:50.004435] [INFO ] [REMOTE ] HTD: Full fetch complete (18799 records). [2025-09-18T19:34:50.004516] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-18T19:34:50.124688] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-18T19:34:50.403233] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-18T19:34:50.403394] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-18T19:34:50.404228] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-18T19:34:50.404295] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-18T19:34:50.405363] [DEBUG] [LOCAL ] HTD: Trimmed 18799 records to 13557 (keeping 200 days of data) [2025-09-18T19:34:50.496799] [DEBUG] [LOCAL ] HTD: Primary data saved (13557 records). [2025-09-18T19:34:50.497013] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-18T19:34:50.497129] [INFO ] [MAIN ] Update Progress: 1061/2372 symbols completed. HTD took 28.8s. Estimated remaining: 3h 11m 15s. Rate: 6.9 symbols/min [2025-09-18T19:34:50.675901] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:34:50.724126] [DEBUG] [LOCAL ] HUBB: Loaded 37613 existing records from primary storage. [2025-09-18T19:34:50.724391] [INFO ] [MAIN ] HUBB: Loaded 37613 existing records. [2025-09-18T19:34:50.910228] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:34:50.910600] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-18T19:34:50.910688] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-18T19:34:50.911920] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-18T19:34:50.911984] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-18T19:34:50.925208] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-18T19:34:51.295570] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:34:51.719619] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-09-18T19:34:51.726495] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-18T19:34:51.762595] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-18T19:34:52.519531] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-18T19:34:52.662102] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-18T19:34:52.853151] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-18T19:34:53.319533] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-18T19:34:53.557332] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-18T19:34:54.119559] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-09-18T19:34:54.919526] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-18T19:34:55.064753] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T19:34:55.133678] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-18T19:34:55.719567] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-18T19:34:55.987481] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-18T19:34:56.519608] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-18T19:34:57.319563] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-18T19:34:57.657110] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T19:34:58.119609] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-11. [2025-09-18T19:34:58.919560] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-18T19:34:59.229939] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-18T19:34:59.273384] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-18T19:34:59.274276] [INFO ] [REMOTE ] HTFC: Full fetch complete (859 records). [2025-09-18T19:34:59.274347] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-18T19:34:59.473988] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 184 unique days, need 200 days [2025-09-18T19:34:59.474518] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:34:59.474613] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:34:59.474738] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-18T19:34:59.474958] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-18T19:34:59.475064] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-18T19:34:59.475270] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-18T19:34:59.475396] [INFO ] [MAIN ] Update Progress: 1062/2372 symbols completed. HTFC took 28.6s. Estimated remaining: 3h 11m 7s. Rate: 6.9 symbols/min [2025-09-18T19:34:59.620413] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-18T19:34:59.694343] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:34:59.722617] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-09-18T19:34:59.744018] [DEBUG] [LOCAL ] HUBS: Loaded 39848 existing records from primary storage. [2025-09-18T19:34:59.744277] [INFO ] [MAIN ] HUBS: Loaded 39848 existing records. [2025-09-18T19:34:59.962172] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:34:59.962564] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-18T19:34:59.962632] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-18T19:34:59.964267] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-18T19:34:59.964340] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-18T19:35:00.345971] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:35:00.519569] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-18T19:35:01.162472] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-18T19:35:01.319551] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-09-18T19:35:02.103279] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T19:35:02.119497] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-18T19:35:02.661413] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-18T19:35:02.919543] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-18T19:35:03.719567] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-11. [2025-09-18T19:35:04.076387] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-18T19:35:04.103501] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-18T19:35:04.519546] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-18T19:35:05.227491] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-18T19:35:05.319529] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-18T19:35:05.970278] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-18T19:35:06.119503] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-18T19:35:06.457870] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T19:35:06.919573] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-18T19:35:07.719559] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-18T19:35:07.837270] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-18T19:35:08.034737] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-18T19:35:08.519565] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-18T19:35:09.014620] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-18T19:35:09.319535] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-18T19:35:09.726741] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T19:35:10.119546] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-18T19:35:10.919529] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-18T19:35:10.977723] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T19:35:11.197895] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-18T19:35:11.719566] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-18T19:35:12.519527] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-09-18T19:35:12.620807] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-18T19:35:12.698473] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-18T19:35:13.319628] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-18T19:35:13.577871] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-18T19:35:14.119556] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-18T19:35:14.653051] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T19:35:14.919576] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-09-18T19:35:15.350511] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-18T19:35:15.719621] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-18T19:35:16.062197] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-18T19:35:16.519600] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-18T19:35:17.319535] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-18T19:35:17.532424] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-18T19:35:17.538708] [INFO ] [REMOTE ] HTGC: Full fetch complete (68004 records). [2025-09-18T19:35:17.538825] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-18T19:35:17.895938] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T19:35:17.976804] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-18T19:35:17.976887] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-18T19:35:17.977722] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-18T19:35:17.977797] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-18T19:35:17.980261] [DEBUG] [LOCAL ] HTGC: Trimmed 68004 records to 48106 (keeping 200 days of data) [2025-09-18T19:35:18.154279] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-18T19:35:18.277381] [DEBUG] [LOCAL ] HTGC: Primary data saved (48106 records). [2025-09-18T19:35:18.277505] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-18T19:35:18.277599] [INFO ] [MAIN ] Update Progress: 1063/2372 symbols completed. HTGC took 46.0s. Estimated remaining: 3h 11m 11s. Rate: 6.8 symbols/min [2025-09-18T19:35:18.454400] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:35:18.470139] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-18T19:35:18.475674] [INFO ] [REMOTE ] HTH: Full fetch complete (46390 records). [2025-09-18T19:35:18.475808] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-18T19:35:18.820705] [DEBUG] [LOCAL ] HUM: Loaded 48841 existing records from primary storage. [2025-09-18T19:35:18.875102] [INFO ] [MAIN ] HUM: Loaded 48841 existing records. [2025-09-18T19:35:18.923398] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-18T19:35:19.068505] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-18T19:35:19.068608] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-18T19:35:19.069310] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-18T19:35:19.069388] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-18T19:35:19.122035] [DEBUG] [LOCAL ] HTH: Trimmed 46390 records to 33114 (keeping 200 days of data) [2025-09-18T19:35:19.202725] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:35:19.203154] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-18T19:35:19.203240] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-18T19:35:19.211800] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-18T19:35:19.212206] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-18T19:35:19.621349] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:35:19.659969] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-18T19:35:19.730319] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-18T19:35:19.756904] [DEBUG] [LOCAL ] HTH: Primary data saved (33114 records). [2025-09-18T19:35:19.757031] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-18T19:35:19.757115] [INFO ] [MAIN ] Update Progress: 1064/2372 symbols completed. HTH took 34.3s. Estimated remaining: 3h 10m 53s. Rate: 6.9 symbols/min [2025-09-18T19:35:19.929258] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:35:19.981290] [DEBUG] [LOCAL ] HUN: Loaded 53201 existing records from primary storage. [2025-09-18T19:35:19.981429] [INFO ] [MAIN ] HUN: Loaded 53201 existing records. [2025-09-18T19:35:20.162488] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:35:20.162740] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-18T19:35:20.162805] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-18T19:35:20.164071] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-18T19:35:20.164131] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-18T19:35:20.524309] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-11. [2025-09-18T19:35:20.530024] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:35:20.564067] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T19:35:21.257095] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T19:35:21.319495] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-18T19:35:22.119553] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-18T19:35:22.177951] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T19:35:22.568038] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-18T19:35:22.919566] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-18T19:35:23.545964] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T19:35:23.719540] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-09-18T19:35:24.143031] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-18T19:35:24.148312] [INFO ] [REMOTE ] HUBB: Full fetch complete (53303 records). [2025-09-18T19:35:24.148427] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-18T19:35:24.531068] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-18T19:35:24.533923] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-18T19:35:24.534767] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-18T19:35:24.535638] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-18T19:35:24.535836] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-18T19:35:24.537152] [DEBUG] [LOCAL ] HUBB: Trimmed 53303 records to 37812 (keeping 200 days of data) [2025-09-18T19:35:24.779321] [DEBUG] [LOCAL ] HUBB: Primary data saved (37812 records). [2025-09-18T19:35:24.779466] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-18T19:35:24.781417] [INFO ] [MAIN ] Update Progress: 1065/2372 symbols completed. HUBB took 34.3s. Estimated remaining: 3h 10m 39s. Rate: 6.9 symbols/min [2025-09-18T19:35:24.957784] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:35:25.004567] [DEBUG] [LOCAL ] HUYA: Loaded 44401 existing records from primary storage. [2025-09-18T19:35:25.004764] [INFO ] [MAIN ] HUYA: Loaded 44401 existing records. [2025-09-18T19:35:25.183870] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:35:25.184151] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-18T19:35:25.184209] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-18T19:35:25.185182] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-18T19:35:25.185253] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-18T19:35:25.327470] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-11. [2025-09-18T19:35:25.556532] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:35:25.590267] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-18T19:35:25.799441] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-18T19:35:26.119582] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-11. [2025-09-18T19:35:26.919508] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-09-18T19:35:26.952711] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-18T19:35:27.387637] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T19:35:27.719556] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-09-18T19:35:28.519691] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-18T19:35:28.803041] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-18T19:35:28.975264] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-18T19:35:29.319696] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-09-18T19:35:29.609357] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-18T19:35:30.119571] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-18T19:35:30.456593] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-18T19:35:30.919619] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-09-18T19:35:31.293192] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T19:35:31.719575] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-18T19:35:32.360072] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-18T19:35:32.519566] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-18T19:35:33.048186] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-18T19:35:33.319537] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-18T19:35:33.896163] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T19:35:34.119538] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-18T19:35:34.919551] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-18T19:35:35.054099] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-18T19:35:35.059870] [INFO ] [REMOTE ] HUBS: Full fetch complete (55328 records). [2025-09-18T19:35:35.059977] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-18T19:35:35.477496] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-18T19:35:35.477668] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-18T19:35:35.478799] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-18T19:35:35.478915] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-18T19:35:35.480427] [DEBUG] [LOCAL ] HUBS: Trimmed 55328 records to 40122 (keeping 200 days of data) [2025-09-18T19:35:35.732720] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T19:35:35.731694] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-09-18T19:35:35.781944] [DEBUG] [LOCAL ] HUBS: Primary data saved (40122 records). [2025-09-18T19:35:35.782200] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-18T19:35:35.782315] [INFO ] [MAIN ] Update Progress: 1066/2372 symbols completed. HUBS took 36.3s. Estimated remaining: 3h 10m 33s. Rate: 6.9 symbols/min [2025-09-18T19:35:35.953777] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:35:35.970853] [DEBUG] [LOCAL ] HVT: Loaded 16284 existing records from primary storage. [2025-09-18T19:35:35.970984] [INFO ] [MAIN ] HVT: Loaded 16284 existing records. [2025-09-18T19:35:36.149826] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:35:36.150204] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-18T19:35:36.150276] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-18T19:35:36.150918] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-18T19:35:36.151021] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-18T19:35:36.503428] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-18T19:35:36.529748] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-18T19:35:36.600485] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:35:36.993828] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-18T19:35:37.319560] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-18T19:35:38.119511] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-11. [2025-09-18T19:35:38.155437] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-18T19:35:38.919555] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-18T19:35:39.033632] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-18T19:35:39.279165] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-18T19:35:39.719550] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-18T19:35:40.519533] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-18T19:35:40.692632] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-18T19:35:41.323297] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-09-18T19:35:41.329414] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-18T19:35:41.586368] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-18T19:35:42.003895] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-18T19:35:42.119552] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-09-18T19:35:42.919580] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-18T19:35:43.074759] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-18T19:35:43.719553] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-18T19:35:44.492033] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T19:35:44.519493] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-18T19:35:44.542054] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-18T19:35:45.319532] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-18T19:35:46.119586] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-18T19:35:46.172773] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-18T19:35:46.225281] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-18T19:35:46.919562] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-18T19:35:47.520916] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-18T19:35:47.631575] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-18T19:35:47.719495] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-18T19:35:48.486471] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-18T19:35:48.519489] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-18T19:35:49.319517] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-18T19:35:49.524275] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-18T19:35:50.119582] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-18T19:35:50.814804] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-18T19:35:50.919528] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-18T19:35:51.312407] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-18T19:35:51.719552] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-18T19:35:52.529096] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-18T19:35:52.550587] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-18T19:35:52.681168] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-18T19:35:53.319540] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-18T19:35:54.119515] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-18T19:35:54.239417] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-18T19:35:54.467945] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-18T19:35:54.919609] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-18T19:35:55.514021] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T19:35:55.719560] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-18T19:35:56.519549] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-18T19:35:56.693300] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-18T19:35:56.735225] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-18T19:35:57.319533] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-18T19:35:58.041425] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-18T19:35:58.058532] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T19:35:58.061416] [INFO ] [REMOTE ] HVT: Full fetch complete (23789 records). [2025-09-18T19:35:58.061550] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-18T19:35:58.124667] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-18T19:35:58.437627] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-18T19:35:58.437735] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-18T19:35:58.438241] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-18T19:35:58.438328] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-18T19:35:58.439038] [DEBUG] [LOCAL ] HVT: Trimmed 23789 records to 16375 (keeping 200 days of data) [2025-09-18T19:35:58.548442] [DEBUG] [LOCAL ] HVT: Primary data saved (16375 records). [2025-09-18T19:35:58.548763] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-18T19:35:58.548952] [INFO ] [MAIN ] Update Progress: 1067/2372 symbols completed. HVT took 22.8s. Estimated remaining: 3h 10m 42s. Rate: 6.8 symbols/min [2025-09-18T19:35:58.718253] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:35:58.788155] [DEBUG] [LOCAL ] HWM: Loaded 53039 existing records from primary storage. [2025-09-18T19:35:58.788322] [INFO ] [MAIN ] HWM: Loaded 53039 existing records. [2025-09-18T19:35:58.927475] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-18T19:35:58.970817] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:35:58.971171] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-18T19:35:58.971245] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-18T19:35:58.973110] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-18T19:35:58.973179] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-18T19:35:59.338983] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:35:59.690937] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-18T19:35:59.719493] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-18T19:36:00.519545] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-18T19:36:00.831624] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-18T19:36:00.838561] [INFO ] [REMOTE ] HUM: Full fetch complete (70767 records). [2025-09-18T19:36:00.838723] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-18T19:36:01.242527] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-18T19:36:01.242672] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-18T19:36:01.243669] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-18T19:36:01.243875] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-18T19:36:01.253845] [DEBUG] [LOCAL ] HUM: Trimmed 70767 records to 49197 (keeping 200 days of data) [2025-09-18T19:36:01.267580] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-18T19:36:01.276398] [INFO ] [REMOTE ] HUN: Full fetch complete (76361 records). [2025-09-18T19:36:01.276574] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-18T19:36:01.374286] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-11. [2025-09-18T19:36:01.944741] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-18T19:36:01.944844] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-18T19:36:01.946139] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-18T19:36:01.946222] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-18T19:36:01.955817] [DEBUG] [LOCAL ] HUN: Trimmed 76361 records to 53591 (keeping 200 days of data) [2025-09-18T19:36:02.346755] [DEBUG] [LOCAL ] HUM: Primary data saved (49197 records). [2025-09-18T19:36:02.350090] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-18T19:36:02.350580] [INFO ] [MAIN ] Update Progress: 1068/2372 symbols completed. HUM took 44.1s. Estimated remaining: 3h 10m 27s. Rate: 6.8 symbols/min [2025-09-18T19:36:02.464895] [DEBUG] [LOCAL ] HUN: Primary data saved (53591 records). [2025-09-18T19:36:02.470365] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-18T19:36:02.470561] [INFO ] [MAIN ] Update Progress: 1069/2372 symbols completed. HUN took 42.7s. Estimated remaining: 3h 10m 8s. Rate: 6.9 symbols/min [2025-09-18T19:36:02.483365] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-18T19:36:02.596223] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-18T19:36:02.711956] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:36:02.790410] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:36:02.810585] [DEBUG] [LOCAL ] HY: Loaded 10419 existing records from primary storage. [2025-09-18T19:36:02.810758] [INFO ] [MAIN ] HY: Loaded 10419 existing records. [2025-09-18T19:36:03.027679] [DEBUG] [LOCAL ] HXL: Loaded 46239 existing records from primary storage. [2025-09-18T19:36:03.025495] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:36:03.028201] [INFO ] [MAIN ] HXL: Loaded 46239 existing records. [2025-09-18T19:36:03.028404] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-18T19:36:03.028510] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-18T19:36:03.098992] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-18T19:36:03.120406] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-18T19:36:03.351091] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:36:03.385867] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-18T19:36:03.396022] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-18T19:36:03.470358] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-18T19:36:03.485994] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-18T19:36:03.694565] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:36:03.723487] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-11. [2025-09-18T19:36:03.946387] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:36:03.946737] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-11. [2025-09-18T19:36:05.301670] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-11 (3.93 seconds). [2025-09-18T19:36:05.312816] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-09-18T19:36:06.386790] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (3.79 seconds). [2025-09-18T19:36:06.396239] [INFO ] [REMOTE ] HUYA: Full fetch complete (63652 records). [2025-09-18T19:36:06.396376] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-18T19:36:06.820366] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-11 (3.10 seconds). [2025-09-18T19:36:06.820800] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-18T19:36:06.824858] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-09-18T19:36:06.825044] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-18T19:36:06.826992] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-18T19:36:06.827158] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-18T19:36:06.828928] [DEBUG] [LOCAL ] HUYA: Trimmed 63652 records to 44714 (keeping 200 days of data) [2025-09-18T19:36:07.109220] [DEBUG] [LOCAL ] HUYA: Primary data saved (44714 records). [2025-09-18T19:36:07.109497] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-18T19:36:07.110339] [INFO ] [MAIN ] Update Progress: 1070/2372 symbols completed. HUYA took 42.3s. Estimated remaining: 3h 9m 54s. Rate: 6.9 symbols/min [2025-09-18T19:36:07.252944] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-11 (3.31 seconds). [2025-09-18T19:36:07.272533] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-09-18T19:36:07.331616] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:36:07.331821] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-18T19:36:07.331864] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-18T19:36:07.332021] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-18T19:36:07.332071] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-18T19:36:07.332114] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-18T19:36:07.332162] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-18T19:36:07.717813] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:36:07.718381] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-11. [2025-09-18T19:36:07.727786] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-18T19:36:07.730766] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-09-18T19:36:07.966362] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-09-18T19:36:07.980390] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-11 (0.26 seconds). [2025-09-18T19:36:08.291277] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-18T19:36:08.519563] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-09-18T19:36:08.708735] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-18T19:36:08.790772] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-09-18T19:36:09.319611] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-09-18T19:36:10.119621] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-18T19:36:10.708000] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-18T19:36:10.919595] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-18T19:36:11.001222] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-18T19:36:11.719576] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-18T19:36:11.818058] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-18T19:36:12.519588] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-09-18T19:36:13.228691] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-18T19:36:13.319534] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-18T19:36:14.119555] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-18T19:36:14.919572] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-18T19:36:15.073315] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-18T19:36:15.719728] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-18T19:36:15.799424] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-18T19:36:15.878291] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-18T19:36:16.014431] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-18T19:36:16.519548] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-18T19:36:17.319551] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-18T19:36:17.462491] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-18T19:36:17.559073] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-18T19:36:17.689716] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-18T19:36:18.119552] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-18T19:36:18.435825] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-18T19:36:18.919553] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-18T19:36:19.449458] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-18T19:36:19.719531] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-18T19:36:20.063228] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-18T19:36:20.519575] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-18T19:36:21.142003] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-18T19:36:21.319605] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-18T19:36:22.119558] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-18T19:36:22.512320] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-18T19:36:22.919531] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-18T19:36:22.962162] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T19:36:23.719571] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-18T19:36:24.384735] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-18T19:36:24.519575] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-18T19:36:24.953448] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-18T19:36:25.276138] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-18T19:36:25.278499] [INFO ] [REMOTE ] HY: Full fetch complete (15179 records). [2025-09-18T19:36:25.278575] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-18T19:36:25.324630] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-18T19:36:25.669177] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-18T19:36:25.669283] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-18T19:36:25.669633] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-18T19:36:25.669725] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-18T19:36:25.670274] [DEBUG] [LOCAL ] HY: Trimmed 15179 records to 10522 (keeping 200 days of data) [2025-09-18T19:36:25.736018] [DEBUG] [LOCAL ] HY: Primary data saved (10522 records). [2025-09-18T19:36:25.736163] [INFO ] [MAIN ] HY: Full history saved. [2025-09-18T19:36:25.736279] [INFO ] [MAIN ] Update Progress: 1071/2372 symbols completed. HY took 23.3s. Estimated remaining: 3h 9m 57s. Rate: 6.8 symbols/min [2025-09-18T19:36:25.907010] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:36:25.907192] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-18T19:36:25.907247] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-18T19:36:25.907390] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-18T19:36:25.907432] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-18T19:36:25.907475] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-18T19:36:25.907554] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-18T19:36:26.124678] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-18T19:36:26.272769] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:36:26.613933] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-18T19:36:26.919565] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-18T19:36:27.719519] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-11. [2025-09-18T19:36:27.830707] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-18T19:36:28.004254] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-11 (0.28 seconds). [2025-09-18T19:36:28.519529] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-09-18T19:36:28.620523] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-18T19:36:28.791695] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-09-18T19:36:29.319533] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-18T19:36:30.119564] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-18T19:36:30.919523] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-09-18T19:36:31.002412] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-18T19:36:31.251221] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-18T19:36:31.334993] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-18T19:36:31.719569] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-18T19:36:32.519566] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-18T19:36:32.817543] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-18T19:36:33.326029] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-18T19:36:33.331845] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-18T19:36:33.570023] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-18T19:36:34.119555] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-18T19:36:34.319637] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.20 seconds). [2025-09-18T19:36:34.919579] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-18T19:36:35.163848] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-18T19:36:35.719578] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-18T19:36:36.519600] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-18T19:36:37.319586] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-18T19:36:37.505733] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-18T19:36:37.578720] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-09-18T19:36:38.119597] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-18T19:36:38.251329] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-18T19:36:38.433926] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-18T19:36:38.919588] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-18T19:36:39.169049] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-18T19:36:39.719576] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-18T19:36:40.519608] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-18T19:36:41.272099] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-18T19:36:41.319514] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-18T19:36:42.119561] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-18T19:36:42.164915] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-18T19:36:42.373144] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-18T19:36:42.742853] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-18T19:36:42.749462] [INFO ] [REMOTE ] HXL: Full fetch complete (65972 records). [2025-09-18T19:36:42.749666] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-18T19:36:42.926402] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-18T19:36:43.143450] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-18T19:36:43.143558] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-18T19:36:43.144547] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-18T19:36:43.144616] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-18T19:36:43.146156] [DEBUG] [LOCAL ] HXL: Trimmed 65972 records to 46545 (keeping 200 days of data) [2025-09-18T19:36:43.372681] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-18T19:36:43.447849] [DEBUG] [LOCAL ] HXL: Primary data saved (46545 records). [2025-09-18T19:36:43.448049] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-18T19:36:43.448147] [INFO ] [MAIN ] Update Progress: 1072/2372 symbols completed. HXL took 41.1s. Estimated remaining: 3h 9m 59s. Rate: 6.8 symbols/min [2025-09-18T19:36:43.631260] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:36:43.642150] [DEBUG] [LOCAL ] HYI: Loaded 8918 existing records from primary storage. [2025-09-18T19:36:43.642312] [INFO ] [MAIN ] HYI: Loaded 8918 existing records. [2025-09-18T19:36:43.724792] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-18T19:36:43.824288] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:36:43.824558] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-18T19:36:43.824609] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-18T19:36:43.825089] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-18T19:36:43.825149] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-18T19:36:44.240558] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:36:44.519556] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-11. [2025-09-18T19:36:45.319543] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-18T19:36:45.608858] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T19:36:45.634368] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-18T19:36:45.643497] [INFO ] [REMOTE ] HWM: Full fetch complete (76524 records). [2025-09-18T19:36:45.643635] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-18T19:36:45.754969] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-18T19:36:45.759346] [INFO ] [REMOTE ] HYBX: Full fetch complete (829 records). [2025-09-18T19:36:45.759444] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-18T19:36:46.128112] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-09-18T19:36:46.127989] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-18T19:36:46.160694] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:36:46.177753] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:36:46.178131] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-18T19:36:46.194036] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-18T19:36:46.228557] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-18T19:36:46.238079] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-18T19:36:46.238565] [INFO ] [MAIN ] Update Progress: 1073/2372 symbols completed. HYBX took 20.5s. Estimated remaining: 3h 9m 43s. Rate: 6.8 symbols/min [2025-09-18T19:36:46.333844] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-18T19:36:46.342693] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-18T19:36:46.355107] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-18T19:36:46.360327] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-18T19:36:46.409383] [DEBUG] [LOCAL ] HWM: Trimmed 76524 records to 53421 (keeping 200 days of data) [2025-09-18T19:36:46.512787] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:36:46.699555] [DEBUG] [LOCAL ] HYT: Loaded 33259 existing records from primary storage. [2025-09-18T19:36:46.702788] [INFO ] [MAIN ] HYT: Loaded 33259 existing records. [2025-09-18T19:36:46.895265] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:36:46.897107] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-18T19:36:46.897187] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-18T19:36:46.899039] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-18T19:36:46.899403] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-18T19:36:46.929308] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-18T19:36:47.007921] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T19:36:47.404352] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:36:47.410409] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-18T19:36:47.414029] [INFO ] [REMOTE ] HYAC: Full fetch complete (873 records). [2025-09-18T19:36:47.416211] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-18T19:36:47.682703] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-18T19:36:47.683574] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:36:47.683685] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:36:47.684144] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-18T19:36:47.685438] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-18T19:36:47.685840] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-18T19:36:47.686677] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-18T19:36:47.687137] [INFO ] [MAIN ] Update Progress: 1074/2372 symbols completed. HYAC took 40.6s. Estimated remaining: 3h 9m 26s. Rate: 6.9 symbols/min [2025-09-18T19:36:47.724899] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-09-18T19:36:47.763245] [DEBUG] [LOCAL ] HWM: Primary data saved (53421 records). [2025-09-18T19:36:47.787049] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-18T19:36:47.797941] [INFO ] [MAIN ] Update Progress: 1075/2372 symbols completed. HWM took 49.2s. Estimated remaining: 3h 9m 6s. Rate: 6.9 symbols/min [2025-09-18T19:36:47.967594] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:36:48.053334] [DEBUG] [LOCAL ] HYTR: Loaded 3209 existing records from primary storage. [2025-09-18T19:36:48.071264] [INFO ] [MAIN ] HYTR: Loaded 3209 existing records. [2025-09-18T19:36:48.071200] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:36:48.265923] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:36:48.266233] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-18T19:36:48.266282] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-18T19:36:48.266540] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-18T19:36:48.266598] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-18T19:36:48.378048] [DEBUG] [LOCAL ] HZO: Loaded 29399 existing records from primary storage. [2025-09-18T19:36:48.383827] [INFO ] [MAIN ] HZO: Loaded 29399 existing records. [2025-09-18T19:36:48.522935] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-11. [2025-09-18T19:36:48.672848] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T19:36:48.768502] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:36:48.789324] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-18T19:36:48.802008] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-18T19:36:48.836669] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-18T19:36:48.842045] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-18T19:36:48.841984] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:36:49.193715] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:36:49.319535] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-11. [2025-09-18T19:36:49.833409] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-18T19:36:50.119586] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-18T19:36:50.178627] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-18T19:36:50.864028] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-18T19:36:50.919496] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-18T19:36:51.535056] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-18T19:36:51.719603] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-11. [2025-09-18T19:36:52.166568] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-18T19:36:52.519543] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-09-18T19:36:53.319516] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-18T19:36:53.759006] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-18T19:36:53.853497] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-18T19:36:54.119540] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-18T19:36:54.916043] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-18T19:36:54.919487] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-18T19:36:55.498099] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-18T19:36:55.719549] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-18T19:36:56.496533] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-18T19:36:56.519497] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-18T19:36:57.319588] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-09-18T19:36:57.328835] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-18T19:36:58.119543] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-09-18T19:36:58.413438] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-18T19:36:58.432495] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-18T19:36:58.919543] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-09-18T19:36:59.261793] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-18T19:36:59.719547] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-18T19:37:00.519592] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-18T19:37:00.898907] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-18T19:37:01.215499] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-18T19:37:01.217492] [INFO ] [REMOTE ] HYI: Full fetch complete (12902 records). [2025-09-18T19:37:01.217632] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-18T19:37:01.325917] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-18T19:37:01.604602] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-18T19:37:01.604715] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-18T19:37:01.605009] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-18T19:37:01.605050] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-18T19:37:01.605734] [DEBUG] [LOCAL ] HYI: Trimmed 12902 records to 8946 (keeping 200 days of data) [2025-09-18T19:37:01.661822] [DEBUG] [LOCAL ] HYI: Primary data saved (8946 records). [2025-09-18T19:37:01.661970] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-18T19:37:01.662059] [INFO ] [MAIN ] Update Progress: 1076/2372 symbols completed. HYI took 18.2s. Estimated remaining: 3h 9m 4s. Rate: 6.9 symbols/min [2025-09-18T19:37:01.855137] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:37:01.862583] [DEBUG] [LOCAL ] IAE: Loaded 5729 existing records from primary storage. [2025-09-18T19:37:01.862716] [INFO ] [MAIN ] IAE: Loaded 5729 existing records. [2025-09-18T19:37:02.041954] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:37:02.042307] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-18T19:37:02.042378] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-18T19:37:02.042749] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-18T19:37:02.042843] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-18T19:37:02.124672] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-18T19:37:02.432225] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:37:02.693366] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-18T19:37:02.713020] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-18T19:37:02.919545] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-09-18T19:37:03.719542] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-18T19:37:04.105726] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-18T19:37:04.125223] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-18T19:37:04.519605] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-18T19:37:05.319539] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-18T19:37:05.849630] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-18T19:37:05.899300] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-18T19:37:06.119537] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-18T19:37:06.544589] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-18T19:37:06.919543] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-18T19:37:07.496554] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-18T19:37:07.719563] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-11. [2025-09-18T19:37:08.298318] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-18T19:37:08.519547] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-18T19:37:09.319558] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-18T19:37:09.687477] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-18T19:37:09.871784] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-18T19:37:10.119538] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-18T19:37:10.919588] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-18T19:37:11.160211] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-18T19:37:11.414520] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-18T19:37:11.719532] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-18T19:37:12.344018] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T19:37:12.345050] [INFO ] [REMOTE ] HYTR: Full fetch complete (4373 records). [2025-09-18T19:37:12.345185] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-18T19:37:12.526350] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-18T19:37:12.706051] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-18T19:37:12.706127] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-18T19:37:12.706256] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-18T19:37:12.706293] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-18T19:37:12.706875] [DEBUG] [LOCAL ] HYTR: Trimmed 4373 records to 3236 (keeping 200 days of data) [2025-09-18T19:37:12.727428] [DEBUG] [LOCAL ] HYTR: Primary data saved (3236 records). [2025-09-18T19:37:12.727503] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-18T19:37:12.727596] [INFO ] [MAIN ] Update Progress: 1077/2372 symbols completed. HYTR took 25.0s. Estimated remaining: 3h 8m 58s. Rate: 6.9 symbols/min [2025-09-18T19:37:13.319537] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-09-18T19:37:14.088091] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-18T19:37:14.119619] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-18T19:37:14.334849] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-18T19:37:14.919622] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-18T19:37:15.610265] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T19:37:15.719580] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-18T19:37:15.839710] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-18T19:37:16.519571] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-09-18T19:37:16.989301] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-18T19:37:17.147553] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-18T19:37:17.152308] [INFO ] [REMOTE ] HYT: Full fetch complete (46814 records). [2025-09-18T19:37:17.152459] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-18T19:37:17.323548] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-09-18T19:37:17.565605] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-18T19:37:17.565749] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-18T19:37:17.566452] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-18T19:37:17.566496] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-18T19:37:17.567675] [DEBUG] [LOCAL ] HYT: Trimmed 46814 records to 33425 (keeping 200 days of data) [2025-09-18T19:37:17.773193] [DEBUG] [LOCAL ] HYT: Primary data saved (33425 records). [2025-09-18T19:37:17.773352] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-18T19:37:17.773445] [INFO ] [MAIN ] Update Progress: 1078/2372 symbols completed. HYT took 31.5s. Estimated remaining: 3h 8m 45s. Rate: 6.9 symbols/min [2025-09-18T19:37:17.856212] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-18T19:37:18.119579] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-18T19:37:18.919564] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-18T19:37:19.478105] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T19:37:19.502742] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-18T19:37:19.719587] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-18T19:37:20.352800] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-18T19:37:20.519597] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-18T19:37:21.319599] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-18T19:37:21.821749] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-18T19:37:21.836909] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-18T19:37:22.119550] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-18T19:37:22.634139] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-18T19:37:22.919573] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-18T19:37:23.719591] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-18T19:37:23.819624] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-18T19:37:24.142937] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-18T19:37:24.519594] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-18T19:37:25.319562] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-18T19:37:25.342805] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-18T19:37:26.077308] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-18T19:37:26.119581] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-18T19:37:26.919567] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-18T19:37:27.118064] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-18T19:37:27.405465] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-18T19:37:27.719563] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-18T19:37:28.464314] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T19:37:28.465828] [INFO ] [REMOTE ] IAE: Full fetch complete (8378 records). [2025-09-18T19:37:28.465921] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-18T19:37:28.531269] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-18T19:37:28.840939] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-18T19:37:28.841025] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-18T19:37:28.841301] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-18T19:37:28.841358] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-18T19:37:28.841810] [DEBUG] [LOCAL ] IAE: Trimmed 8378 records to 5777 (keeping 200 days of data) [2025-09-18T19:37:28.875215] [DEBUG] [LOCAL ] IAE: Primary data saved (5777 records). [2025-09-18T19:37:28.875352] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-18T19:37:28.875472] [INFO ] [MAIN ] Update Progress: 1079/2372 symbols completed. IAE took 27.2s. Estimated remaining: 3h 8m 39s. Rate: 6.9 symbols/min [2025-09-18T19:37:29.583240] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-18T19:37:29.590745] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-18T19:37:30.821617] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-18T19:37:30.825759] [INFO ] [REMOTE ] HZO: Full fetch complete (40357 records). [2025-09-18T19:37:30.825916] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-18T19:37:31.216926] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-18T19:37:31.217036] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-18T19:37:31.217783] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-18T19:37:31.217860] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-18T19:37:31.220029] [DEBUG] [LOCAL ] HZO: Trimmed 40357 records to 29607 (keeping 200 days of data) [2025-09-18T19:37:31.400511] [DEBUG] [LOCAL ] HZO: Primary data saved (29607 records). [2025-09-18T19:37:31.400702] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-18T19:37:31.400811] [INFO ] [MAIN ] Update Progress: 1080/2372 symbols completed. HZO took 43.6s. Estimated remaining: 3h 8m 23s. Rate: 6.9 symbols/min [2025-09-18T19:37:32.080227] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:37:32.114689] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:37:32.162324] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:37:32.167353] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:37:32.213569] [DEBUG] [LOCAL ] IBP: Loaded 29531 existing records from primary storage. [2025-09-18T19:37:32.228480] [INFO ] [MAIN ] IBP: Loaded 29531 existing records. [2025-09-18T19:37:32.428024] [DEBUG] [LOCAL ] IBN: Loaded 52931 existing records from primary storage. [2025-09-18T19:37:32.464219] [INFO ] [MAIN ] IBN: Loaded 52931 existing records. [2025-09-18T19:37:32.464099] [DEBUG] [LOCAL ] IAG: Loaded 53433 existing records from primary storage. [2025-09-18T19:37:32.523166] [DEBUG] [LOCAL ] IBM: Loaded 53609 existing records from primary storage. [2025-09-18T19:37:32.522267] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:37:32.523445] [INFO ] [MAIN ] IBM: Loaded 53609 existing records. [2025-09-18T19:37:32.522040] [INFO ] [MAIN ] IAG: Loaded 53433 existing records. [2025-09-18T19:37:32.580387] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-18T19:37:32.615989] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-18T19:37:32.658057] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-18T19:37:32.694365] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-18T19:37:33.104149] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:37:33.081463] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:37:33.111420] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-18T19:37:33.125871] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-18T19:37:33.120603] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-18T19:37:33.173063] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-18T19:37:33.181691] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-18T19:37:33.245176] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:37:33.245360] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-18T19:37:33.250761] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-18T19:37:33.263604] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-18T19:37:33.263532] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-18T19:37:33.301883] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-18T19:37:33.410671] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-18T19:37:33.423981] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-18T19:37:34.071937] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:37:34.128792] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-11. [2025-09-18T19:37:34.583963] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:37:34.628963] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:37:34.629256] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-11. [2025-09-18T19:37:34.645789] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-11. [2025-09-18T19:37:34.653155] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:37:34.653739] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-11. [2025-09-18T19:37:35.366863] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-18T19:37:35.372410] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-09-18T19:37:36.054508] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T19:37:36.064582] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-09-18T19:37:36.197122] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-18T19:37:36.207214] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-09-18T19:37:36.235990] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-18T19:37:36.241540] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-09-18T19:37:36.370578] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-18T19:37:36.519584] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-09-18T19:37:37.024017] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-18T19:37:37.319594] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-18T19:37:37.503347] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-18T19:37:37.571015] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T19:37:38.119509] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-09-18T19:37:38.356176] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-18T19:37:38.411393] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-18T19:37:38.919632] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-18T19:37:39.488384] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-18T19:37:39.719551] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-09-18T19:37:39.943967] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-18T19:37:40.519546] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-18T19:37:41.319548] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-18T19:37:41.750671] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-18T19:37:41.828726] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-18T19:37:42.119536] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-09-18T19:37:42.347291] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-18T19:37:42.919558] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-18T19:37:43.574437] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-18T19:37:43.719513] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-18T19:37:44.379769] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T19:37:44.519540] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-18T19:37:45.319513] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-18T19:37:45.365359] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-18T19:37:46.021249] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-18T19:37:46.119578] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-18T19:37:46.919518] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-18T19:37:47.199790] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-18T19:37:47.381423] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-18T19:37:47.719545] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-18T19:37:48.519545] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-18T19:37:48.632503] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-18T19:37:49.319552] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-18T19:37:49.693828] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-18T19:37:50.046248] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T19:37:50.119531] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-18T19:37:50.919567] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-18T19:37:51.216818] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-18T19:37:51.555779] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T19:37:51.719550] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-18T19:37:52.519510] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-18T19:37:52.721796] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-18T19:37:53.291768] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-18T19:37:53.319607] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-18T19:37:53.952747] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-18T19:37:54.119547] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-18T19:37:54.793893] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-18T19:37:54.919540] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-18T19:37:55.719613] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-18T19:37:56.056582] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-18T19:37:56.519553] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-18T19:37:56.803062] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-18T19:37:56.804263] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-18T19:37:57.319545] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-18T19:37:58.119569] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-18T19:37:58.540538] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-18T19:37:58.919597] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-18T19:37:59.219141] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-18T19:37:59.564697] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T19:37:59.571948] [INFO ] [REMOTE ] IBN: Full fetch complete (76131 records). [2025-09-18T19:37:59.572078] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-18T19:37:59.722727] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-18T19:38:00.000826] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-18T19:38:00.001105] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-18T19:38:00.002877] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-18T19:38:00.003004] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-18T19:38:00.005077] [DEBUG] [LOCAL ] IBN: Trimmed 76131 records to 53316 (keeping 200 days of data) [2025-09-18T19:38:00.129724] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-18T19:38:00.374420] [DEBUG] [LOCAL ] IBN: Primary data saved (53316 records). [2025-09-18T19:38:00.374562] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-18T19:38:00.374723] [INFO ] [MAIN ] Update Progress: 1081/2372 symbols completed. IBN took 29.0s. Estimated remaining: 3h 8m 38s. Rate: 6.8 symbols/min [2025-09-18T19:38:00.528348] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-18T19:38:00.549512] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:38:00.587986] [DEBUG] [LOCAL ] IBTA: Loaded 38303 existing records from primary storage. [2025-09-18T19:38:00.588139] [INFO ] [MAIN ] IBTA: Loaded 38303 existing records. [2025-09-18T19:38:00.778276] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:38:00.778519] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-18T19:38:00.778617] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-18T19:38:00.779726] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-18T19:38:00.779809] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-18T19:38:01.138772] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:38:01.319537] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-11. [2025-09-18T19:38:02.119585] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-18T19:38:02.317904] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-18T19:38:02.397401] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-18T19:38:02.438531] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T19:38:02.919555] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-18T19:38:03.267436] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-18T19:38:03.272613] [INFO ] [REMOTE ] IBP: Full fetch complete (40950 records). [2025-09-18T19:38:03.272790] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-18T19:38:03.667788] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-18T19:38:03.667925] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-18T19:38:03.668992] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-18T19:38:03.669058] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-18T19:38:03.670547] [DEBUG] [LOCAL ] IBP: Trimmed 40950 records to 29731 (keeping 200 days of data) [2025-09-18T19:38:03.744875] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-18T19:38:03.883344] [DEBUG] [LOCAL ] IBP: Primary data saved (29731 records). [2025-09-18T19:38:03.883475] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-18T19:38:03.883626] [INFO ] [MAIN ] Update Progress: 1082/2372 symbols completed. IBP took 32.5s. Estimated remaining: 3h 8m 23s. Rate: 6.8 symbols/min [2025-09-18T19:38:04.058510] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:38:04.123074] [DEBUG] [LOCAL ] ICE: Loaded 53026 existing records from primary storage. [2025-09-18T19:38:04.123229] [INFO ] [MAIN ] ICE: Loaded 53026 existing records. [2025-09-18T19:38:04.299515] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:38:04.299823] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-18T19:38:04.299915] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-18T19:38:04.301383] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-18T19:38:04.301446] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-18T19:38:04.526268] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-09-18T19:38:04.669862] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:38:05.319557] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-11. [2025-09-18T19:38:05.374101] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-18T19:38:05.469533] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-18T19:38:05.521628] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-18T19:38:06.119587] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-18T19:38:06.765853] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-18T19:38:06.919625] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-09-18T19:38:07.719575] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-09-18T19:38:08.171996] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-18T19:38:08.186528] [INFO ] [REMOTE ] IAG: Full fetch complete (77027 records). [2025-09-18T19:38:08.200318] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-18T19:38:08.201438] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-18T19:38:08.524772] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-18T19:38:08.616361] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-18T19:38:08.616465] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-18T19:38:08.617587] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-18T19:38:08.617712] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-18T19:38:08.622738] [DEBUG] [LOCAL ] IAG: Trimmed 77027 records to 53823 (keeping 200 days of data) [2025-09-18T19:38:08.948273] [DEBUG] [LOCAL ] IAG: Primary data saved (53823 records). [2025-09-18T19:38:08.948437] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-18T19:38:08.948550] [INFO ] [MAIN ] Update Progress: 1083/2372 symbols completed. IAG took 37.5s. Estimated remaining: 3h 8m 10s. Rate: 6.9 symbols/min [2025-09-18T19:38:09.137060] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:38:09.180893] [DEBUG] [LOCAL ] ICL: Loaded 39017 existing records from primary storage. [2025-09-18T19:38:09.181039] [INFO ] [MAIN ] ICL: Loaded 39017 existing records. [2025-09-18T19:38:09.335495] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-18T19:38:09.368272] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:38:09.370024] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-18T19:38:09.370089] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-18T19:38:09.380771] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-18T19:38:09.386113] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-18T19:38:09.487518] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-18T19:38:09.728587] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-18T19:38:09.808769] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:38:10.119554] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-11. [2025-09-18T19:38:10.919540] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-09-18T19:38:11.394260] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T19:38:11.719585] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-09-18T19:38:11.913018] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-18T19:38:11.922678] [INFO ] [REMOTE ] IBM: Full fetch complete (77494 records). [2025-09-18T19:38:11.922947] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-18T19:38:12.357615] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-18T19:38:12.358079] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-18T19:38:12.359705] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-18T19:38:12.359790] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-18T19:38:12.365916] [DEBUG] [LOCAL ] IBM: Trimmed 77494 records to 53999 (keeping 200 days of data) [2025-09-18T19:38:12.520008] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-18T19:38:12.532778] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T19:38:12.818874] [DEBUG] [LOCAL ] IBM: Primary data saved (53999 records). [2025-09-18T19:38:12.819234] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-18T19:38:12.819445] [INFO ] [MAIN ] Update Progress: 1084/2372 symbols completed. IBM took 41.4s. Estimated remaining: 3h 7m 55s. Rate: 6.9 symbols/min [2025-09-18T19:38:13.008955] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:38:13.033769] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T19:38:13.088931] [DEBUG] [LOCAL ] IDA: Loaded 32074 existing records from primary storage. [2025-09-18T19:38:13.089180] [INFO ] [MAIN ] IDA: Loaded 32074 existing records. [2025-09-18T19:38:13.290863] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:38:13.291317] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-18T19:38:13.291374] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-18T19:38:13.292713] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-18T19:38:13.292780] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-18T19:38:13.325709] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-18T19:38:13.683276] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:38:14.119544] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-09-18T19:38:14.241282] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-18T19:38:14.661880] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-18T19:38:14.919599] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-18T19:38:15.380399] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-18T19:38:15.719574] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-18T19:38:16.519545] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-11. [2025-09-18T19:38:16.798893] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-18T19:38:17.142101] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T19:38:17.319547] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-18T19:38:17.531105] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T19:38:18.119622] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-09-18T19:38:18.371307] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-18T19:38:18.919567] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-18T19:38:19.008322] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-18T19:38:19.719518] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-18T19:38:19.918128] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-18T19:38:20.519602] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-18T19:38:21.289551] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-18T19:38:21.319497] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-18T19:38:21.451757] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T19:38:22.119575] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-18T19:38:22.850535] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T19:38:22.919514] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-18T19:38:23.724617] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-18T19:38:23.738408] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-18T19:38:24.421438] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T19:38:24.519573] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-18T19:38:24.884829] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-18T19:38:25.319629] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-18T19:38:25.910624] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-18T19:38:26.119588] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-18T19:38:26.919568] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-09-18T19:38:27.018591] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-18T19:38:27.025313] [INFO ] [REMOTE ] IBTA: Full fetch complete (50296 records). [2025-09-18T19:38:27.025488] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-18T19:38:27.405767] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-18T19:38:27.405869] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-18T19:38:27.406601] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-18T19:38:27.406666] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-18T19:38:27.407910] [DEBUG] [LOCAL ] IBTA: Trimmed 50296 records to 38598 (keeping 200 days of data) [2025-09-18T19:38:27.641940] [DEBUG] [LOCAL ] IBTA: Primary data saved (38598 records). [2025-09-18T19:38:27.642179] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-18T19:38:27.642415] [INFO ] [MAIN ] Update Progress: 1085/2372 symbols completed. IBTA took 27.3s. Estimated remaining: 3h 7m 54s. Rate: 6.8 symbols/min [2025-09-18T19:38:27.729004] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-18T19:38:27.823051] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:38:27.857905] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-18T19:38:27.877023] [DEBUG] [LOCAL ] IDE: Loaded 8365 existing records from primary storage. [2025-09-18T19:38:27.877161] [INFO ] [MAIN ] IDE: Loaded 8365 existing records. [2025-09-18T19:38:28.066127] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:38:28.066756] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-18T19:38:28.066878] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-18T19:38:28.067414] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-18T19:38:28.085759] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-18T19:38:28.092749] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T19:38:28.464080] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:38:28.519517] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-11. [2025-09-18T19:38:29.014032] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-18T19:38:29.321684] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-18T19:38:29.328899] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-18T19:38:30.119588] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-09-18T19:38:30.919515] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-18T19:38:30.960201] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-18T19:38:30.969245] [INFO ] [REMOTE ] ICE: Full fetch complete (76605 records). [2025-09-18T19:38:30.969442] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-18T19:38:31.170328] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T19:38:31.410637] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-18T19:38:31.410792] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-18T19:38:31.411910] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-18T19:38:31.412004] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-18T19:38:31.414158] [DEBUG] [LOCAL ] ICE: Trimmed 76605 records to 53416 (keeping 200 days of data) [2025-09-18T19:38:31.733066] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-09-18T19:38:31.759213] [DEBUG] [LOCAL ] ICE: Primary data saved (53416 records). [2025-09-18T19:38:31.759358] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-18T19:38:31.759479] [INFO ] [MAIN ] Update Progress: 1086/2372 symbols completed. ICE took 27.9s. Estimated remaining: 3h 7m 39s. Rate: 6.9 symbols/min [2025-09-18T19:38:31.935515] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:38:31.953362] [DEBUG] [LOCAL ] IDT: Loaded 17478 existing records from primary storage. [2025-09-18T19:38:31.953500] [INFO ] [MAIN ] IDT: Loaded 17478 existing records. [2025-09-18T19:38:32.143154] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:38:32.143469] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-18T19:38:32.143525] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-18T19:38:32.144102] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-18T19:38:32.144164] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-18T19:38:32.541008] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-18T19:38:32.531712] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:38:32.528531] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-18T19:38:32.569635] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-18T19:38:33.319553] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-11. [2025-09-18T19:38:33.750715] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T19:38:33.831294] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-18T19:38:34.119556] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-09-18T19:38:34.919565] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-18T19:38:35.141814] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-18T19:38:35.719576] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-09-18T19:38:35.911774] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-18T19:38:36.276875] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-18T19:38:36.519556] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-18T19:38:37.293154] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-18T19:38:37.319490] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-18T19:38:38.119561] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-18T19:38:38.437400] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-18T19:38:38.535355] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-18T19:38:38.919623] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-18T19:38:39.719600] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-18T19:38:40.236174] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T19:38:40.340491] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-18T19:38:40.519539] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-18T19:38:41.319519] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-18T19:38:41.648257] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-18T19:38:41.865864] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-18T19:38:42.119543] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-18T19:38:42.919525] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-18T19:38:43.244350] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-18T19:38:43.341815] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-18T19:38:43.719545] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-18T19:38:44.334734] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-18T19:38:44.519624] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-18T19:38:45.319599] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-18T19:38:45.758975] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-18T19:38:46.090706] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-18T19:38:46.119504] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-18T19:38:46.919551] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-18T19:38:47.209465] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-18T19:38:47.437263] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-18T19:38:47.719548] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-18T19:38:48.519539] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-18T19:38:48.977564] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-18T19:38:49.267939] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-18T19:38:49.319553] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-18T19:38:50.122877] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-18T19:38:50.124548] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-18T19:38:50.919546] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-18T19:38:51.217399] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-18T19:38:51.220436] [INFO ] [REMOTE ] IDT: Full fetch complete (22270 records). [2025-09-18T19:38:51.220512] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-18T19:38:51.598445] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-18T19:38:51.598534] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-18T19:38:51.599169] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-18T19:38:51.599237] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-18T19:38:51.600013] [DEBUG] [LOCAL ] IDT: Trimmed 22270 records to 17622 (keeping 200 days of data) [2025-09-18T19:38:51.709103] [DEBUG] [LOCAL ] IDT: Primary data saved (17622 records). [2025-09-18T19:38:51.709252] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-18T19:38:51.709339] [INFO ] [MAIN ] Update Progress: 1087/2372 symbols completed. IDT took 19.9s. Estimated remaining: 3h 7m 44s. Rate: 6.8 symbols/min [2025-09-18T19:38:51.724619] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-18T19:38:51.892903] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:38:51.934534] [DEBUG] [LOCAL ] IEX: Loaded 38392 existing records from primary storage. [2025-09-18T19:38:51.934723] [INFO ] [MAIN ] IEX: Loaded 38392 existing records. [2025-09-18T19:38:52.122850] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:38:52.123154] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-18T19:38:52.123208] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-18T19:38:52.124249] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-18T19:38:52.124322] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-18T19:38:52.511024] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:38:52.511945] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-18T19:38:52.521883] [INFO ] [REMOTE ] IDE: Full fetch complete (12659 records). [2025-09-18T19:38:52.521963] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-18T19:38:52.527316] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-18T19:38:52.575092] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-18T19:38:52.921130] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-18T19:38:52.921213] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-18T19:38:52.921668] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-18T19:38:52.921732] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-18T19:38:52.922308] [DEBUG] [LOCAL ] IDE: Trimmed 12659 records to 8414 (keeping 200 days of data) [2025-09-18T19:38:52.977296] [DEBUG] [LOCAL ] IDE: Primary data saved (8414 records). [2025-09-18T19:38:52.977477] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-18T19:38:52.977608] [INFO ] [MAIN ] Update Progress: 1088/2372 symbols completed. IDE took 25.3s. Estimated remaining: 3h 7m 26s. Rate: 6.9 symbols/min [2025-09-18T19:38:53.147944] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:38:53.209732] [DEBUG] [LOCAL ] IFF: Loaded 50946 existing records from primary storage. [2025-09-18T19:38:53.209894] [INFO ] [MAIN ] IFF: Loaded 50946 existing records. [2025-09-18T19:38:53.324621] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-11. [2025-09-18T19:38:53.396773] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:38:53.397013] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-18T19:38:53.397062] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-18T19:38:53.398175] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-18T19:38:53.398236] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-18T19:38:53.786086] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:38:54.110788] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-18T19:38:54.119493] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-18T19:38:54.635773] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-18T19:38:54.919538] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-18T19:38:55.186725] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-18T19:38:55.719559] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-09-18T19:38:56.325292] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-18T19:38:56.519610] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-11. [2025-09-18T19:38:56.885050] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-18T19:38:57.319574] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-18T19:38:57.876456] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-18T19:38:58.119569] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-09-18T19:38:58.560420] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-18T19:38:58.565812] [INFO ] [REMOTE ] ICL: Full fetch complete (56367 records). [2025-09-18T19:38:58.565938] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-18T19:38:58.929433] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-18T19:38:58.950119] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-18T19:38:58.950273] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-18T19:38:58.951168] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-18T19:38:58.951236] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-18T19:38:58.952626] [DEBUG] [LOCAL ] ICL: Trimmed 56367 records to 39304 (keeping 200 days of data) [2025-09-18T19:38:59.192196] [DEBUG] [LOCAL ] ICL: Primary data saved (39304 records). [2025-09-18T19:38:59.192401] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-18T19:38:59.193269] [INFO ] [MAIN ] Update Progress: 1089/2372 symbols completed. ICL took 50.2s. Estimated remaining: 3h 7m 15s. Rate: 6.9 symbols/min [2025-09-18T19:38:59.378924] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:38:59.402279] [DEBUG] [LOCAL ] IFN: Loaded 18298 existing records from primary storage. [2025-09-18T19:38:59.402432] [INFO ] [MAIN ] IFN: Loaded 18298 existing records. [2025-09-18T19:38:59.586000] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:38:59.603256] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-18T19:38:59.614860] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-18T19:38:59.616781] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-18T19:38:59.616731] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T19:38:59.625976] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-18T19:38:59.727399] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-09-18T19:38:59.994634] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:39:00.184058] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T19:39:00.519585] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-18T19:39:01.189831] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-18T19:39:01.319600] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-09-18T19:39:01.926471] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-18T19:39:02.119619] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-11. [2025-09-18T19:39:02.919566] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-18T19:39:03.661770] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-18T19:39:03.719502] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-18T19:39:04.519566] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-18T19:39:04.664848] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-11 (2.55 seconds). [2025-09-18T19:39:05.020241] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-18T19:39:05.125628] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T19:39:05.319561] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-18T19:39:05.835193] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-18T19:39:05.839156] [INFO ] [REMOTE ] IDA: Full fetch complete (44553 records). [2025-09-18T19:39:05.839303] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-18T19:39:06.124685] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-09-18T19:39:06.238152] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-18T19:39:06.238228] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-18T19:39:06.238922] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-18T19:39:06.238985] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-18T19:39:06.240027] [DEBUG] [LOCAL ] IDA: Trimmed 44553 records to 32258 (keeping 200 days of data) [2025-09-18T19:39:06.443516] [DEBUG] [LOCAL ] IDA: Primary data saved (32258 records). [2025-09-18T19:39:06.443716] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-18T19:39:06.443839] [INFO ] [MAIN ] Update Progress: 1090/2372 symbols completed. IDA took 53.6s. Estimated remaining: 3h 7m 4s. Rate: 6.9 symbols/min [2025-09-18T19:39:06.626524] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:39:06.650153] [DEBUG] [LOCAL ] IFS: Loaded 22968 existing records from primary storage. [2025-09-18T19:39:06.650367] [INFO ] [MAIN ] IFS: Loaded 22968 existing records. [2025-09-18T19:39:06.831198] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T19:39:06.863237] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:39:06.864610] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-18T19:39:06.865290] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-18T19:39:06.865890] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-18T19:39:06.865951] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-18T19:39:06.928826] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-18T19:39:07.222417] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-18T19:39:07.306515] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:39:07.719571] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-18T19:39:08.519552] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-09-18T19:39:08.584244] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T19:39:09.319519] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-18T19:39:09.364783] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-18T19:39:09.721276] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T19:39:10.119605] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-18T19:39:10.593054] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-18T19:39:10.919580] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-11. [2025-09-18T19:39:11.719542] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-18T19:39:11.741869] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-18T19:39:11.781813] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T19:39:12.519597] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-09-18T19:39:12.860022] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-18T19:39:13.188305] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-18T19:39:13.319559] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-18T19:39:14.096006] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-18T19:39:14.119591] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-09-18T19:39:14.919595] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-18T19:39:15.506767] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-18T19:39:15.719590] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-18T19:39:16.519584] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-18T19:39:17.319614] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-18T19:39:18.032298] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T19:39:18.037632] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (3.12 seconds). [2025-09-18T19:39:18.083710] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-18T19:39:18.119626] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-18T19:39:18.610737] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-18T19:39:18.919577] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-18T19:39:19.172961] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-18T19:39:19.719576] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-18T19:39:20.270728] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-18T19:39:20.519556] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-18T19:39:20.634474] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-18T19:39:21.319567] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-18T19:39:21.412952] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-18T19:39:22.119532] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-18T19:39:22.412873] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-18T19:39:22.919548] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-18T19:39:23.620760] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-18T19:39:23.719533] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-18T19:39:24.222924] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T19:39:24.519583] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-18T19:39:25.211258] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T19:39:25.235884] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-18T19:39:25.319576] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-18T19:39:26.119553] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-18T19:39:26.400039] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-18T19:39:26.919619] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-18T19:39:27.723218] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-18T19:39:27.727952] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-18T19:39:27.739390] [INFO ] [REMOTE ] IFF: Full fetch complete (72549 records). [2025-09-18T19:39:27.739513] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-18T19:39:28.145108] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-18T19:39:28.145196] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-18T19:39:28.146082] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-18T19:39:28.146146] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-18T19:39:28.147570] [DEBUG] [LOCAL ] IFF: Trimmed 72549 records to 51320 (keeping 200 days of data) [2025-09-18T19:39:28.455057] [DEBUG] [LOCAL ] IFF: Primary data saved (51320 records). [2025-09-18T19:39:28.455197] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-18T19:39:28.455299] [INFO ] [MAIN ] Update Progress: 1091/2372 symbols completed. IFF took 35.5s. Estimated remaining: 3h 7m 11s. Rate: 6.8 symbols/min [2025-09-18T19:39:28.526049] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-18T19:39:28.638546] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:39:28.650088] [DEBUG] [LOCAL ] IGA: Loaded 9709 existing records from primary storage. [2025-09-18T19:39:28.650245] [INFO ] [MAIN ] IGA: Loaded 9709 existing records. [2025-09-18T19:39:28.836370] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:39:28.836628] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-18T19:39:28.836724] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-18T19:39:28.837093] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-09-18T19:39:28.837156] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-18T19:39:29.226822] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:39:29.237087] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-18T19:39:29.264154] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-18T19:39:29.319504] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-18T19:39:29.825893] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T19:39:30.119544] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-18T19:39:30.924784] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-11. [2025-09-18T19:39:30.936327] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-18T19:39:30.943023] [INFO ] [REMOTE ] IEX: Full fetch complete (53071 records). [2025-09-18T19:39:30.943201] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-18T19:39:31.357874] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-18T19:39:31.366634] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-18T19:39:31.366737] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-18T19:39:31.369700] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-18T19:39:31.370541] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-18T19:39:31.370219] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-18T19:39:31.374968] [INFO ] [REMOTE ] IFS: Full fetch complete (31128 records). [2025-09-18T19:39:31.375310] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-18T19:39:31.375771] [DEBUG] [LOCAL ] IEX: Trimmed 53071 records to 38692 (keeping 200 days of data) [2025-09-18T19:39:31.724753] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-18T19:39:31.907977] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-18T19:39:31.911950] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-18T19:39:31.913429] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-18T19:39:31.913777] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-18T19:39:31.918069] [DEBUG] [LOCAL ] IFS: Trimmed 31128 records to 23167 (keeping 200 days of data) [2025-09-18T19:39:32.179314] [DEBUG] [LOCAL ] IFS: Primary data saved (23167 records). [2025-09-18T19:39:32.180264] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-18T19:39:32.180408] [INFO ] [MAIN ] Update Progress: 1092/2372 symbols completed. IFS took 25.7s. Estimated remaining: 3h 6m 56s. Rate: 6.8 symbols/min [2025-09-18T19:39:32.314529] [DEBUG] [LOCAL ] IEX: Primary data saved (38692 records). [2025-09-18T19:39:32.325061] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-18T19:39:32.346839] [INFO ] [MAIN ] Update Progress: 1093/2372 symbols completed. IEX took 40.6s. Estimated remaining: 3h 6m 37s. Rate: 6.9 symbols/min [2025-09-18T19:39:32.450350] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:39:32.524541] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-09-18T19:39:32.566887] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:39:32.576758] [DEBUG] [LOCAL ] IGD: Loaded 19315 existing records from primary storage. [2025-09-18T19:39:32.576939] [INFO ] [MAIN ] IGD: Loaded 19315 existing records. [2025-09-18T19:39:32.611813] [DEBUG] [LOCAL ] IGI: Loaded 3745 existing records from primary storage. [2025-09-18T19:39:32.645792] [INFO ] [MAIN ] IGI: Loaded 3745 existing records. [2025-09-18T19:39:32.949772] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:39:32.970671] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-18T19:39:32.970127] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:39:32.970887] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-18T19:39:32.982325] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-18T19:39:32.982535] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-18T19:39:32.984530] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-18T19:39:32.984585] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-18T19:39:32.991075] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-18T19:39:33.024527] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-18T19:39:33.037013] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-18T19:39:33.216312] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-18T19:39:33.321547] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-09-18T19:39:33.759789] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:39:33.792068] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:39:34.031761] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-18T19:39:34.119512] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-18T19:39:34.642570] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-18T19:39:34.919542] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-18T19:39:35.719574] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-18T19:39:35.968247] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-18T19:39:36.308430] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-18T19:39:36.519549] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-18T19:39:37.169941] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-18T19:39:37.319546] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-18T19:39:38.119563] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-11. [2025-09-18T19:39:38.228166] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-18T19:39:38.230947] [INFO ] [REMOTE ] IFN: Full fetch complete (28951 records). [2025-09-18T19:39:38.231025] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-18T19:39:38.536180] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-18T19:39:38.615901] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-18T19:39:38.615982] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-18T19:39:38.616540] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-18T19:39:38.616579] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-18T19:39:38.617325] [DEBUG] [LOCAL ] IFN: Trimmed 28951 records to 18440 (keeping 200 days of data) [2025-09-18T19:39:38.729885] [DEBUG] [LOCAL ] IFN: Primary data saved (18440 records). [2025-09-18T19:39:38.730042] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-18T19:39:38.730130] [INFO ] [MAIN ] Update Progress: 1094/2372 symbols completed. IFN took 39.5s. Estimated remaining: 3h 6m 26s. Rate: 6.9 symbols/min [2025-09-18T19:39:38.898707] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:39:38.919567] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-09-18T19:39:38.930511] [DEBUG] [LOCAL ] IGR: Loaded 30557 existing records from primary storage. [2025-09-18T19:39:38.930635] [INFO ] [MAIN ] IGR: Loaded 30557 existing records. [2025-09-18T19:39:39.114872] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:39:39.115117] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-18T19:39:39.115168] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-18T19:39:39.116144] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-18T19:39:39.116206] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-18T19:39:39.480226] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-18T19:39:39.479865] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:39:39.719534] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-11. [2025-09-18T19:39:40.519590] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-18T19:39:40.860669] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-18T19:39:41.236796] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-18T19:39:41.319502] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-09-18T19:39:41.779884] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-18T19:39:42.119541] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-18T19:39:42.559898] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-18T19:39:42.919583] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-11. [2025-09-18T19:39:43.719564] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-18T19:39:43.994966] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-18T19:39:44.087668] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-18T19:39:44.519604] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-09-18T19:39:45.319572] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-09-18T19:39:45.556706] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-18T19:39:46.119569] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-18T19:39:46.574331] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-18T19:39:46.620377] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-18T19:39:46.919593] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-18T19:39:47.704464] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-18T19:39:47.719572] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-09-18T19:39:48.519563] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-18T19:39:49.018137] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-18T19:39:49.037887] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-18T19:39:49.319561] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-09-18T19:39:50.119551] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-18T19:39:50.548793] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-18T19:39:50.733245] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-18T19:39:50.919553] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-18T19:39:51.719573] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-18T19:39:51.968960] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-18T19:39:52.519530] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-18T19:39:52.819850] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-18T19:39:53.319559] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-18T19:39:53.362304] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-18T19:39:53.364547] [INFO ] [REMOTE ] IGA: Full fetch complete (13507 records). [2025-09-18T19:39:53.364667] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-18T19:39:53.730258] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-09-18T19:39:53.730340] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-09-18T19:39:53.730663] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-09-18T19:39:53.730742] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-09-18T19:39:53.731255] [DEBUG] [LOCAL ] IGA: Trimmed 13507 records to 9786 (keeping 200 days of data) [2025-09-18T19:39:53.790486] [DEBUG] [LOCAL ] IGA: Primary data saved (9786 records). [2025-09-18T19:39:53.790628] [INFO ] [MAIN ] IGA: Full history saved. [2025-09-18T19:39:53.790774] [INFO ] [MAIN ] Update Progress: 1095/2372 symbols completed. IGA took 25.3s. Estimated remaining: 3h 6m 24s. Rate: 6.9 symbols/min [2025-09-18T19:39:53.958513] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:39:53.963725] [DEBUG] [LOCAL ] IH: Loaded 3585 existing records from primary storage. [2025-09-18T19:39:53.963862] [INFO ] [MAIN ] IH: Loaded 3585 existing records. [2025-09-18T19:39:54.141878] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-18T19:39:54.146815] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:39:54.148587] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-18T19:39:54.148665] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-18T19:39:54.148970] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-09-18T19:39:54.149030] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-18T19:39:54.516824] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:39:54.535493] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-18T19:39:54.919509] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-11. [2025-09-18T19:39:55.290679] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-18T19:39:55.351777] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-18T19:39:55.719549] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-09-18T19:39:56.162116] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-18T19:39:56.519603] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-09-18T19:39:56.891834] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-18T19:39:57.319544] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-18T19:39:57.807367] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-18T19:39:58.119583] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-18T19:39:58.509294] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-18T19:39:58.919550] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-18T19:39:59.488344] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-18T19:39:59.719562] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-18T19:40:00.519594] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-18T19:40:00.858113] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-18T19:40:01.166162] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-18T19:40:01.319580] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-18T19:40:02.119558] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-18T19:40:02.571234] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-18T19:40:02.919551] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-18T19:40:03.137573] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-18T19:40:03.719544] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-18T19:40:03.970432] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-18T19:40:04.100457] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-18T19:40:04.519548] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-18T19:40:04.959889] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-18T19:40:05.319559] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-18T19:40:05.959183] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-18T19:40:06.119564] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-18T19:40:06.498306] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-18T19:40:06.919597] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-18T19:40:07.719565] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-18T19:40:07.984057] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-18T19:40:08.167936] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-18T19:40:08.519606] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-18T19:40:09.319599] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-18T19:40:09.602300] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-18T19:40:09.839594] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-18T19:40:10.119544] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-18T19:40:10.919632] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-18T19:40:10.997171] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-18T19:40:11.298225] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-18T19:40:11.719592] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-18T19:40:12.330579] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-18T19:40:12.331582] [INFO ] [REMOTE ] IGI: Full fetch complete (5190 records). [2025-09-18T19:40:12.331687] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-18T19:40:12.527321] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-18T19:40:12.707601] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-18T19:40:12.707718] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-18T19:40:12.707994] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-18T19:40:12.708059] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-18T19:40:12.708550] [DEBUG] [LOCAL ] IGI: Trimmed 5190 records to 3767 (keeping 200 days of data) [2025-09-18T19:40:12.733869] [DEBUG] [LOCAL ] IGI: Primary data saved (3767 records). [2025-09-18T19:40:12.734057] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-18T19:40:12.734187] [INFO ] [MAIN ] Update Progress: 1096/2372 symbols completed. IGI took 40.4s. Estimated remaining: 3h 6m 27s. Rate: 6.8 symbols/min [2025-09-18T19:40:12.912625] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:40:12.924362] [DEBUG] [LOCAL ] IHD: Loaded 7223 existing records from primary storage. [2025-09-18T19:40:12.924488] [INFO ] [MAIN ] IHD: Loaded 7223 existing records. [2025-09-18T19:40:13.101924] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:40:13.102197] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-18T19:40:13.102246] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-18T19:40:13.102572] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-18T19:40:13.102630] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-18T19:40:13.321309] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-18T19:40:13.460274] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:40:13.718551] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-18T19:40:14.119546] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-18T19:40:14.919560] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-18T19:40:15.655508] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T19:40:15.659131] [INFO ] [REMOTE ] IGD: Full fetch complete (29346 records). [2025-09-18T19:40:15.659359] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-18T19:40:15.729704] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-11. [2025-09-18T19:40:15.882934] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-09-18T19:40:15.950465] [INFO ] [REMOTE ] IH: Full fetch complete (4873 records). [2025-09-18T19:40:15.969586] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-18T19:40:15.978329] [FATAL] [VALIDATOR ] IH: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T19:40:15.996908] [FATAL] [MAIN ] IH: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:40:15.999405] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-18T19:40:15.997801] [WARN ] [MAIN ] IH: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:40:16.016184] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-18T19:40:16.021052] [DEBUG] [LOCAL ] IH: No primary data file found to delete. [2025-09-18T19:40:16.021250] [INFO ] [LOCAL ] IH: Starting deletion of derivative data. [2025-09-18T19:40:16.033090] [DEBUG] [LOCAL ] IH: Deleted derivative data file. [2025-09-18T19:40:16.043501] [INFO ] [MAIN ] Update Progress: 1097/2372 symbols completed. IH took 22.3s. Estimated remaining: 3h 6m 12s. Rate: 6.8 symbols/min [2025-09-18T19:40:16.198934] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-18T19:40:16.209912] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-18T19:40:16.210979] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-18T19:40:16.211107] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-18T19:40:16.235218] [DEBUG] [LOCAL ] IGD: Trimmed 29346 records to 19399 (keeping 200 days of data) [2025-09-18T19:40:16.339291] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:40:16.422849] [DEBUG] [LOCAL ] IHG: Loaded 24901 existing records from primary storage. [2025-09-18T19:40:16.423525] [INFO ] [MAIN ] IHG: Loaded 24901 existing records. [2025-09-18T19:40:16.525108] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-18T19:40:16.535833] [DEBUG] [LOCAL ] IGD: Primary data saved (19399 records). [2025-09-18T19:40:16.586987] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-18T19:40:16.598146] [INFO ] [MAIN ] Update Progress: 1098/2372 symbols completed. IGD took 44.4s. Estimated remaining: 3h 5m 54s. Rate: 6.9 symbols/min [2025-09-18T19:40:16.621215] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:40:16.661701] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-18T19:40:16.667352] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-18T19:40:16.677552] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-18T19:40:16.706681] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-18T19:40:16.713139] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-18T19:40:16.977571] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:40:17.181726] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:40:17.207553] [DEBUG] [LOCAL ] IHS: Loaded 39155 existing records from primary storage. [2025-09-18T19:40:17.207709] [INFO ] [MAIN ] IHS: Loaded 39155 existing records. [2025-09-18T19:40:17.324614] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-09-18T19:40:17.387594] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:40:17.387840] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-18T19:40:17.387888] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-18T19:40:17.388933] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-18T19:40:17.388995] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-18T19:40:17.791759] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:40:17.920259] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-18T19:40:17.936058] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-18T19:40:18.119550] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-18T19:40:18.919577] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-09-18T19:40:19.457584] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-18T19:40:19.465586] [INFO ] [REMOTE ] IGR: Full fetch complete (45831 records). [2025-09-18T19:40:19.465789] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-18T19:40:19.693013] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-18T19:40:19.728386] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-11. [2025-09-18T19:40:19.949540] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-18T19:40:19.949703] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-18T19:40:19.950720] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-18T19:40:19.950807] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-18T19:40:19.952552] [DEBUG] [LOCAL ] IGR: Trimmed 45831 records to 30764 (keeping 200 days of data) [2025-09-18T19:40:20.183412] [DEBUG] [LOCAL ] IGR: Primary data saved (30764 records). [2025-09-18T19:40:20.183637] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-18T19:40:20.183962] [INFO ] [MAIN ] Update Progress: 1099/2372 symbols completed. IGR took 41.5s. Estimated remaining: 3h 5m 39s. Rate: 6.9 symbols/min [2025-09-18T19:40:20.388249] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:40:20.399776] [DEBUG] [LOCAL ] IIF: Loaded 5841 existing records from primary storage. [2025-09-18T19:40:20.399962] [INFO ] [MAIN ] IIF: Loaded 5841 existing records. [2025-09-18T19:40:20.524752] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-18T19:40:20.614806] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:40:20.615289] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-18T19:40:20.615376] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-18T19:40:20.615846] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-18T19:40:20.615954] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-18T19:40:21.004328] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:40:21.152315] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-18T19:40:21.152049] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T19:40:21.319546] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-18T19:40:21.959353] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-18T19:40:22.119568] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-09-18T19:40:22.919594] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-11. [2025-09-18T19:40:23.269100] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-18T19:40:23.364434] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-18T19:40:23.719568] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-09-18T19:40:24.497977] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-18T19:40:24.519501] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-18T19:40:25.319580] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-18T19:40:25.605791] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-18T19:40:25.874042] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-18T19:40:26.119565] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-09-18T19:40:26.579897] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-18T19:40:26.919577] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-18T19:40:27.451150] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-18T19:40:27.719547] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-18T19:40:28.185816] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-18T19:40:28.519561] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-18T19:40:29.072163] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-18T19:40:29.319556] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-11. [2025-09-18T19:40:30.119514] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-18T19:40:30.438989] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T19:40:30.919577] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-09-18T19:40:31.358223] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T19:40:31.432759] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-18T19:40:31.719552] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-18T19:40:32.519558] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-18T19:40:33.104029] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-18T19:40:33.177894] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T19:40:33.319559] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-18T19:40:34.119553] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-18T19:40:34.731512] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-18T19:40:34.831772] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-18T19:40:34.919554] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-18T19:40:35.586475] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-18T19:40:35.719542] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-18T19:40:36.426704] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-18T19:40:36.519601] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-18T19:40:37.207390] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-18T19:40:37.319608] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-18T19:40:38.119634] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-18T19:40:38.503206] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-18T19:40:38.573584] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-18T19:40:38.919586] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-18T19:40:39.560129] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-18T19:40:39.719727] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-09-18T19:40:40.519613] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-18T19:40:40.708560] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-18T19:40:40.980071] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-18T19:40:41.319580] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-18T19:40:42.057972] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T19:40:42.060687] [INFO ] [REMOTE ] IHD: Full fetch complete (12021 records). [2025-09-18T19:40:42.060840] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-18T19:40:42.124753] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-18T19:40:42.464452] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-18T19:40:42.464567] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-18T19:40:42.465069] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-18T19:40:42.465134] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-18T19:40:42.465752] [DEBUG] [LOCAL ] IHD: Trimmed 12021 records to 7264 (keeping 200 days of data) [2025-09-18T19:40:42.519000] [DEBUG] [LOCAL ] IHD: Primary data saved (7264 records). [2025-09-18T19:40:42.519213] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-18T19:40:42.519387] [INFO ] [MAIN ] Update Progress: 1100/2372 symbols completed. IHD took 29.8s. Estimated remaining: 3h 5m 46s. Rate: 6.8 symbols/min [2025-09-18T19:40:42.728984] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:40:42.749281] [DEBUG] [LOCAL ] IIIN: Loaded 16975 existing records from primary storage. [2025-09-18T19:40:42.749457] [INFO ] [MAIN ] IIIN: Loaded 16975 existing records. [2025-09-18T19:40:42.932761] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-18T19:40:42.939024] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:40:42.940545] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-18T19:40:42.940622] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-18T19:40:42.941510] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-09-18T19:40:42.941573] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-18T19:40:43.303170] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:40:43.589563] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-18T19:40:43.591060] [INFO ] [REMOTE ] IIF: Full fetch complete (9677 records). [2025-09-18T19:40:43.591251] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-18T19:40:43.724227] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-11. [2025-09-18T19:40:44.004568] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-18T19:40:44.013104] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-18T19:40:44.013203] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-18T19:40:44.013548] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-18T19:40:44.013675] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-18T19:40:44.022932] [DEBUG] [LOCAL ] IIF: Trimmed 9677 records to 5865 (keeping 200 days of data) [2025-09-18T19:40:44.058096] [DEBUG] [LOCAL ] IIF: Primary data saved (5865 records). [2025-09-18T19:40:44.058206] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-18T19:40:44.058290] [INFO ] [MAIN ] Update Progress: 1101/2372 symbols completed. IIF took 23.9s. Estimated remaining: 3h 5m 29s. Rate: 6.9 symbols/min [2025-09-18T19:40:44.228842] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:40:44.246327] [DEBUG] [LOCAL ] IIM: Loaded 15936 existing records from primary storage. [2025-09-18T19:40:44.246458] [INFO ] [MAIN ] IIM: Loaded 15936 existing records. [2025-09-18T19:40:44.438584] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:40:44.438882] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-18T19:40:44.438937] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-18T19:40:44.439470] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-18T19:40:44.439534] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-18T19:40:44.524681] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-18T19:40:44.811630] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:40:44.823547] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-18T19:40:45.319544] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-09-18T19:40:45.729901] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-18T19:40:45.952080] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-18T19:40:46.119589] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-11. [2025-09-18T19:40:46.919537] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-09-18T19:40:47.041806] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-18T19:40:47.719546] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-09-18T19:40:47.893220] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-18T19:40:48.476871] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-18T19:40:48.519547] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-09-18T19:40:49.319537] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-09-18T19:40:49.605359] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-18T19:40:50.107116] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-18T19:40:50.119502] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-18T19:40:50.919572] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-18T19:40:51.282893] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-18T19:40:51.719525] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-18T19:40:51.797715] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-18T19:40:52.519553] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-18T19:40:52.962840] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T19:40:53.196867] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-18T19:40:53.319557] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-18T19:40:54.119564] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-18T19:40:54.653850] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-18T19:40:54.919565] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-18T19:40:55.249322] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-18T19:40:55.254284] [INFO ] [REMOTE ] IHS: Full fetch complete (52478 records). [2025-09-18T19:40:55.254397] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-18T19:40:55.645096] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-18T19:40:55.645465] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-18T19:40:55.646325] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-18T19:40:55.646391] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-18T19:40:55.647690] [DEBUG] [LOCAL ] IHS: Trimmed 52478 records to 39355 (keeping 200 days of data) [2025-09-18T19:40:55.733070] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-18T19:40:55.882678] [DEBUG] [LOCAL ] IHS: Primary data saved (39355 records). [2025-09-18T19:40:55.882850] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-18T19:40:55.882966] [INFO ] [MAIN ] Update Progress: 1102/2372 symbols completed. IHS took 39.3s. Estimated remaining: 3h 5m 24s. Rate: 6.9 symbols/min [2025-09-18T19:40:56.057852] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:40:56.075580] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-18T19:40:56.115901] [DEBUG] [LOCAL ] IIPR: Loaded 29606 existing records from primary storage. [2025-09-18T19:40:56.116048] [INFO ] [MAIN ] IIPR: Loaded 29606 existing records. [2025-09-18T19:40:56.307958] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:40:56.308283] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-18T19:40:56.308334] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-18T19:40:56.309563] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-18T19:40:56.309630] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-18T19:40:56.524719] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-18T19:40:56.700987] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:40:56.738272] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-18T19:40:57.319571] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-18T19:40:57.545639] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-18T19:40:58.119526] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-18T19:40:58.282235] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-18T19:40:58.919559] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-11. [2025-09-18T19:40:59.078457] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-18T19:40:59.719560] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-18T19:41:00.031529] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-18T19:41:00.519522] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-18T19:41:00.580403] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-18T19:41:01.143961] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-18T19:41:01.319598] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-09-18T19:41:02.119567] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-18T19:41:02.657442] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T19:41:02.919514] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-18T19:41:02.933746] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-18T19:41:02.937253] [INFO ] [REMOTE ] IHG: Full fetch complete (33396 records). [2025-09-18T19:41:02.937366] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-18T19:41:03.371670] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-18T19:41:03.371815] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-18T19:41:03.372827] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-18T19:41:03.372908] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-18T19:41:03.374339] [DEBUG] [LOCAL ] IHG: Trimmed 33396 records to 25038 (keeping 200 days of data) [2025-09-18T19:41:03.643446] [DEBUG] [LOCAL ] IHG: Primary data saved (25038 records). [2025-09-18T19:41:03.643681] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-18T19:41:03.643860] [INFO ] [MAIN ] Update Progress: 1103/2372 symbols completed. IHG took 47.6s. Estimated remaining: 3h 5m 14s. Rate: 6.9 symbols/min [2025-09-18T19:41:03.724832] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-09-18T19:41:03.813473] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-18T19:41:03.976625] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:41:04.043199] [DEBUG] [LOCAL ] IMAX: Loaded 42683 existing records from primary storage. [2025-09-18T19:41:04.043419] [INFO ] [MAIN ] IMAX: Loaded 42683 existing records. [2025-09-18T19:41:04.312228] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:41:04.312619] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-18T19:41:04.312737] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-18T19:41:04.315036] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-18T19:41:04.315120] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-18T19:41:04.526742] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-18T19:41:04.730942] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:41:04.884732] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-18T19:41:05.243970] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T19:41:05.319521] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-11. [2025-09-18T19:41:06.119551] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-18T19:41:06.463569] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-18T19:41:06.919564] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-18T19:41:07.305286] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-18T19:41:07.719543] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-18T19:41:07.829736] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-18T19:41:08.288267] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-18T19:41:08.519564] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-18T19:41:09.319569] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-09-18T19:41:09.878218] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T19:41:10.119548] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-18T19:41:10.711235] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T19:41:10.775772] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-18T19:41:10.919513] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-18T19:41:11.693476] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-18T19:41:11.719584] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-18T19:41:12.519600] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-18T19:41:12.549531] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-18T19:41:13.319579] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-18T19:41:13.524001] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-18T19:41:14.041930] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-18T19:41:14.119510] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-18T19:41:14.919568] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-09-18T19:41:15.127429] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T19:41:15.130787] [INFO ] [REMOTE ] IIM: Full fetch complete (25412 records). [2025-09-18T19:41:15.130880] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-18T19:41:15.509229] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-18T19:41:15.509334] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-18T19:41:15.509881] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-18T19:41:15.509954] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-18T19:41:15.510679] [DEBUG] [LOCAL ] IIM: Trimmed 25412 records to 16071 (keeping 200 days of data) [2025-09-18T19:41:15.612070] [DEBUG] [LOCAL ] IIM: Primary data saved (16071 records). [2025-09-18T19:41:15.612234] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-18T19:41:15.612349] [INFO ] [MAIN ] Update Progress: 1104/2372 symbols completed. IIM took 31.6s. Estimated remaining: 3h 5m 9s. Rate: 6.8 symbols/min [2025-09-18T19:41:15.724706] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-18T19:41:15.784345] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:41:15.839113] [DEBUG] [LOCAL ] INFA: Loaded 50192 existing records from primary storage. [2025-09-18T19:41:15.839267] [INFO ] [MAIN ] INFA: Loaded 50192 existing records. [2025-09-18T19:41:16.017199] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:41:16.017471] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-18T19:41:16.017520] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-18T19:41:16.018826] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-18T19:41:16.018888] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-18T19:41:16.394780] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:41:16.418052] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-18T19:41:16.519566] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-11. [2025-09-18T19:41:16.538463] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-18T19:41:16.540893] [INFO ] [REMOTE ] IIIN: Full fetch complete (25263 records). [2025-09-18T19:41:16.540992] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-18T19:41:16.916250] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-09-18T19:41:16.916339] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-09-18T19:41:16.916932] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-09-18T19:41:16.916997] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-09-18T19:41:16.917794] [DEBUG] [LOCAL ] IIIN: Trimmed 25263 records to 17104 (keeping 200 days of data) [2025-09-18T19:41:17.038317] [DEBUG] [LOCAL ] IIIN: Primary data saved (17104 records). [2025-09-18T19:41:17.038472] [INFO ] [MAIN ] IIIN: Full history saved. [2025-09-18T19:41:17.038558] [INFO ] [MAIN ] Update Progress: 1105/2372 symbols completed. IIIN took 34.5s. Estimated remaining: 3h 4m 52s. Rate: 6.9 symbols/min [2025-09-18T19:41:17.213683] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:41:17.275625] [DEBUG] [LOCAL ] INFY: Loaded 53598 existing records from primary storage. [2025-09-18T19:41:17.275831] [INFO ] [MAIN ] INFY: Loaded 53598 existing records. [2025-09-18T19:41:17.324696] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-18T19:41:17.467262] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:41:17.467541] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-18T19:41:17.467595] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-18T19:41:17.468944] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-18T19:41:17.469016] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-18T19:41:17.828956] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:41:18.119513] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-18T19:41:18.159270] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-18T19:41:18.682481] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-18T19:41:18.919570] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-11. [2025-09-18T19:41:19.587134] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-18T19:41:19.719582] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-09-18T19:41:20.471077] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-18T19:41:20.519500] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-09-18T19:41:21.033531] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T19:41:21.319590] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-18T19:41:21.965234] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-18T19:41:22.119558] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-09-18T19:41:22.804070] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T19:41:22.919576] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-09-18T19:41:23.298623] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-18T19:41:23.719549] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-18T19:41:24.416750] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-18T19:41:24.519522] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-18T19:41:25.314017] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-18T19:41:25.323311] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-18T19:41:25.940183] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T19:41:26.119534] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-18T19:41:26.618051] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-18T19:41:26.919569] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-18T19:41:27.590719] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-18T19:41:27.719554] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-18T19:41:27.977096] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-18T19:41:28.519543] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-18T19:41:28.629401] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-18T19:41:29.319585] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-18T19:41:30.115678] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-18T19:41:30.125334] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-18T19:41:30.746912] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T19:41:30.919567] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-18T19:41:31.575534] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T19:41:31.719565] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-18T19:41:32.352423] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-18T19:41:32.519555] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-18T19:41:33.289149] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T19:41:33.319512] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-18T19:41:33.842904] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-18T19:41:34.119551] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-18T19:41:34.919563] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-18T19:41:35.248673] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-18T19:41:35.504965] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-18T19:41:35.719561] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-18T19:41:36.021142] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-18T19:41:36.519568] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-18T19:41:37.319549] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-18T19:41:37.413851] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-18T19:41:37.625414] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-18T19:41:37.629398] [INFO ] [REMOTE ] IIPR: Full fetch complete (43804 records). [2025-09-18T19:41:37.629493] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-18T19:41:38.023773] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-18T19:41:38.023932] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-18T19:41:38.024717] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-18T19:41:38.024783] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-18T19:41:38.025897] [DEBUG] [LOCAL ] IIPR: Trimmed 43804 records to 29843 (keeping 200 days of data) [2025-09-18T19:41:38.120832] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-18T19:41:38.207965] [DEBUG] [LOCAL ] IIPR: Primary data saved (29843 records). [2025-09-18T19:41:38.208113] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-18T19:41:38.208240] [INFO ] [MAIN ] Update Progress: 1106/2372 symbols completed. IIPR took 42.3s. Estimated remaining: 3h 4m 57s. Rate: 6.8 symbols/min [2025-09-18T19:41:38.385534] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:41:38.385760] [DEBUG] [LOCAL ] ING: No existing data file found in primary storage. [2025-09-18T19:41:38.385808] [WARN ] [MAIN ] ING: No existing data found, performing full refresh instead. [2025-09-18T19:41:38.386039] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-18T19:41:38.386117] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-18T19:41:38.386185] [DEBUG] [LOCAL ] ING: No primary data file found to delete. [2025-09-18T19:41:38.386223] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-18T19:41:38.799346] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:41:38.921365] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-11. [2025-09-18T19:41:38.924839] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-18T19:41:39.719550] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-18T19:41:39.827348] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-18T19:41:39.834542] [INFO ] [REMOTE ] INFA: Full fetch complete (71810 records). [2025-09-18T19:41:39.834799] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-18T19:41:40.234033] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-18T19:41:40.234237] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-18T19:41:40.235184] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-18T19:41:40.235261] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-18T19:41:40.237053] [DEBUG] [LOCAL ] INFA: Trimmed 71810 records to 50516 (keeping 200 days of data) [2025-09-18T19:41:40.263746] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-18T19:41:40.530441] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-09-18T19:41:40.569512] [DEBUG] [LOCAL ] INFA: Primary data saved (50516 records). [2025-09-18T19:41:40.569624] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-18T19:41:40.570673] [INFO ] [MAIN ] Update Progress: 1107/2372 symbols completed. INFA took 25.0s. Estimated remaining: 3h 4m 41s. Rate: 6.8 symbols/min [2025-09-18T19:41:40.745130] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:41:40.776683] [DEBUG] [LOCAL ] INGM: Loaded 29340 existing records from primary storage. [2025-09-18T19:41:40.776844] [INFO ] [MAIN ] INGM: Loaded 29340 existing records. [2025-09-18T19:41:40.956352] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:41:40.956796] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-18T19:41:40.956873] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-18T19:41:40.957789] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-18T19:41:40.957850] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-18T19:41:41.149154] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T19:41:41.327604] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-18T19:41:41.350154] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:41:41.833721] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-18T19:41:42.119574] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-09-18T19:41:42.575180] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T19:41:42.919601] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-18T19:41:43.652558] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-18T19:41:43.719553] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-18T19:41:44.519519] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-11. [2025-09-18T19:41:44.562272] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T19:41:45.077884] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-18T19:41:45.319598] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-18T19:41:45.585504] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-18T19:41:46.119569] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-09-18T19:41:46.669074] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-18T19:41:46.675480] [INFO ] [REMOTE ] IMAX: Full fetch complete (59283 records). [2025-09-18T19:41:46.675589] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-18T19:41:46.930083] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-18T19:41:47.062196] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-18T19:41:47.062275] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-18T19:41:47.063066] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-18T19:41:47.063129] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-18T19:41:47.064472] [DEBUG] [LOCAL ] IMAX: Trimmed 59283 records to 43011 (keeping 200 days of data) [2025-09-18T19:41:47.172543] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T19:41:47.341626] [DEBUG] [LOCAL ] IMAX: Primary data saved (43011 records). [2025-09-18T19:41:47.341787] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-18T19:41:47.341869] [INFO ] [MAIN ] Update Progress: 1108/2372 symbols completed. IMAX took 43.7s. Estimated remaining: 3h 4m 30s. Rate: 6.9 symbols/min [2025-09-18T19:41:47.527946] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:41:47.573019] [DEBUG] [LOCAL ] INGR: Loaded 33355 existing records from primary storage. [2025-09-18T19:41:47.573266] [INFO ] [MAIN ] INGR: Loaded 33355 existing records. [2025-09-18T19:41:47.724755] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-18T19:41:47.787372] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:41:47.787612] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-18T19:41:47.787978] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-18T19:41:47.788986] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-18T19:41:47.789047] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-18T19:41:48.140955] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:41:48.431245] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T19:41:48.519491] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-11. [2025-09-18T19:41:49.319522] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-18T19:41:49.614802] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-18T19:41:49.643756] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T19:41:50.119558] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-09-18T19:41:50.919509] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-09-18T19:41:50.954473] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-18T19:41:51.007944] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-18T19:41:51.719565] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-18T19:41:51.988392] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-18T19:41:52.519586] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-18T19:41:53.319557] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-18T19:41:53.362851] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T19:41:53.389786] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-18T19:41:54.119555] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-18T19:41:54.926098] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-18T19:41:54.948515] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-18T19:41:55.483779] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T19:41:55.719580] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-18T19:41:56.519501] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-09-18T19:41:56.543249] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-18T19:41:56.552172] [INFO ] [REMOTE ] INFY: Full fetch complete (77376 records). [2025-09-18T19:41:56.552304] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-18T19:41:56.948750] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-18T19:41:56.948840] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-18T19:41:56.950306] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-18T19:41:56.950373] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-18T19:41:56.951935] [DEBUG] [LOCAL ] INFY: Trimmed 77376 records to 53988 (keeping 200 days of data) [2025-09-18T19:41:57.299733] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T19:41:57.320963] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-18T19:41:57.327457] [DEBUG] [LOCAL ] INFY: Primary data saved (53988 records). [2025-09-18T19:41:57.328557] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-18T19:41:57.328697] [INFO ] [MAIN ] Update Progress: 1109/2372 symbols completed. INFY took 40.3s. Estimated remaining: 3h 4m 23s. Rate: 6.8 symbols/min [2025-09-18T19:41:57.499704] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:41:57.538863] [DEBUG] [LOCAL ] INN: Loaded 41983 existing records from primary storage. [2025-09-18T19:41:57.539010] [INFO ] [MAIN ] INN: Loaded 41983 existing records. [2025-09-18T19:41:57.716230] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:41:57.716475] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-18T19:41:57.716523] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-18T19:41:57.717550] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-18T19:41:57.717611] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-18T19:41:58.084895] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:41:58.105948] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-18T19:41:58.119490] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-18T19:41:58.470084] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-18T19:41:58.919535] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-18T19:41:59.521374] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T19:41:59.719599] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-11. [2025-09-18T19:42:00.267722] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-18T19:42:00.519570] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-18T19:42:00.758977] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-18T19:42:01.319545] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-09-18T19:42:02.119576] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-18T19:42:02.711689] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-18T19:42:02.919557] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-18T19:42:03.719555] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-18T19:42:04.149328] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (2.83 seconds). [2025-09-18T19:42:04.519590] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-09-18T19:42:04.692385] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-18T19:42:04.751717] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-18T19:42:05.319541] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-18T19:42:05.694872] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-18T19:42:05.945003] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (3.83 seconds). [2025-09-18T19:42:06.119640] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-18T19:42:06.316946] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-18T19:42:06.919610] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-18T19:42:07.719565] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-18T19:42:07.778819] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-18T19:42:07.830065] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-18T19:42:08.519584] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-18T19:42:08.903694] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-18T19:42:09.319609] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-18T19:42:10.026445] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T19:42:10.034435] [INFO ] [REMOTE ] ING: Full fetch complete (73502 records). [2025-09-18T19:42:10.034606] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-18T19:42:10.124762] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-18T19:42:10.497816] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-09-18T19:42:10.497908] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-09-18T19:42:10.498850] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-09-18T19:42:10.498916] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-09-18T19:42:10.500496] [DEBUG] [LOCAL ] ING: Trimmed 73502 records to 51271 (keeping 200 days of data) [2025-09-18T19:42:10.814777] [DEBUG] [LOCAL ] ING: Primary data saved (51271 records). [2025-09-18T19:42:10.814932] [INFO ] [MAIN ] ING: Full history saved. [2025-09-18T19:42:10.815015] [INFO ] [MAIN ] Update Progress: 1110/2372 symbols completed. ING took 32.6s. Estimated remaining: 3h 4m 19s. Rate: 6.8 symbols/min [2025-09-18T19:42:10.924721] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-18T19:42:10.987097] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:42:10.987286] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-09-18T19:42:10.987372] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-09-18T19:42:10.987526] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-18T19:42:10.987581] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-18T19:42:10.987673] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-18T19:42:10.987733] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-18T19:42:11.369433] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:42:11.412181] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-18T19:42:11.414206] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-18T19:42:11.719565] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-18T19:42:11.951338] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-18T19:42:12.519611] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-11. [2025-09-18T19:42:12.724481] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:42:12.724858] [WARN ] [REMOTE ] INR: No data returned for month 2024-11 [2025-09-18T19:42:13.092834] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-18T19:42:13.319552] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-18T19:42:14.119601] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-18T19:42:14.920616] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-18T19:42:15.086947] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-18T19:42:15.261131] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:42:15.261582] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-18T19:42:15.719575] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-18T19:42:16.519584] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-18T19:42:16.808853] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-18T19:42:16.866168] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-18T19:42:17.319558] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-18T19:42:17.377786] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-18T19:42:18.119554] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-18T19:42:18.885573] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-18T19:42:18.919506] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-18T19:42:19.198115] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-18T19:42:19.202051] [INFO ] [REMOTE ] INGM: Full fetch complete (42126 records). [2025-09-18T19:42:19.202167] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-18T19:42:19.576111] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-18T19:42:19.576210] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-18T19:42:19.576982] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-18T19:42:19.577060] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-18T19:42:19.578187] [DEBUG] [LOCAL ] INGM: Trimmed 42126 records to 29495 (keeping 200 days of data) [2025-09-18T19:42:19.733591] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-09-18T19:42:19.768152] [DEBUG] [LOCAL ] INGM: Primary data saved (29495 records). [2025-09-18T19:42:19.768294] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-18T19:42:19.768428] [INFO ] [MAIN ] Update Progress: 1111/2372 symbols completed. INGM took 39.2s. Estimated remaining: 3h 4m 11s. Rate: 6.8 symbols/min [2025-09-18T19:42:19.939221] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:42:19.977291] [DEBUG] [LOCAL ] INSP: Loaded 36566 existing records from primary storage. [2025-09-18T19:42:19.977459] [INFO ] [MAIN ] INSP: Loaded 36566 existing records. [2025-09-18T19:42:20.161442] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:42:20.161938] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-18T19:42:20.162039] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-18T19:42:20.163014] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-18T19:42:20.163078] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-18T19:42:20.295576] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-18T19:42:20.326626] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-18T19:42:20.535344] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-18T19:42:20.577239] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:42:21.319612] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-09-18T19:42:21.975894] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-18T19:42:22.119548] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-18T19:42:22.434525] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-18T19:42:22.919601] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-18T19:42:23.279465] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-18T19:42:23.284824] [INFO ] [REMOTE ] INN: Full fetch complete (57738 records). [2025-09-18T19:42:23.284933] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-18T19:42:23.686287] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-18T19:42:23.686382] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-18T19:42:23.687211] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-18T19:42:23.687277] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-18T19:42:23.688547] [DEBUG] [LOCAL ] INN: Trimmed 57738 records to 42287 (keeping 200 days of data) [2025-09-18T19:42:23.735716] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-11. [2025-09-18T19:42:23.941832] [DEBUG] [LOCAL ] INN: Primary data saved (42287 records). [2025-09-18T19:42:23.941973] [INFO ] [MAIN ] INN: Full history saved. [2025-09-18T19:42:23.942057] [INFO ] [MAIN ] Update Progress: 1112/2372 symbols completed. INN took 26.6s. Estimated remaining: 3h 3m 57s. Rate: 6.8 symbols/min [2025-09-18T19:42:24.128233] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:42:24.168383] [DEBUG] [LOCAL ] INSW: Loaded 40716 existing records from primary storage. [2025-09-18T19:42:24.168593] [INFO ] [MAIN ] INSW: Loaded 40716 existing records. [2025-09-18T19:42:24.348965] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:42:24.349258] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-18T19:42:24.349309] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-18T19:42:24.350253] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-18T19:42:24.350326] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-18T19:42:24.532065] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-09-18T19:42:24.722476] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-18T19:42:24.789822] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:42:24.786698] [INFO ] [REMOTE ] INGR: Full fetch complete (49506 records). [2025-09-18T19:42:24.790257] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-18T19:42:25.210843] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-18T19:42:25.211195] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-18T19:42:25.212552] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-18T19:42:25.214042] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-18T19:42:25.213912] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-18T19:42:25.225305] [DEBUG] [LOCAL ] INGR: Trimmed 49506 records to 33638 (keeping 200 days of data) [2025-09-18T19:42:25.323390] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-11. [2025-09-18T19:42:25.436746] [DEBUG] [LOCAL ] INGR: Primary data saved (33638 records). [2025-09-18T19:42:25.436894] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-18T19:42:25.437034] [INFO ] [MAIN ] Update Progress: 1113/2372 symbols completed. INGR took 38.1s. Estimated remaining: 3h 3m 40s. Rate: 6.9 symbols/min [2025-09-18T19:42:25.645702] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:42:25.697872] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-18T19:42:25.721486] [DEBUG] [LOCAL ] INVH: Loaded 53144 existing records from primary storage. [2025-09-18T19:42:25.721634] [INFO ] [MAIN ] INVH: Loaded 53144 existing records. [2025-09-18T19:42:25.897815] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:42:25.898051] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-18T19:42:25.898100] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-18T19:42:25.899292] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-18T19:42:25.899353] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-18T19:42:26.124732] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-09-18T19:42:26.262625] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:42:26.919581] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-09-18T19:42:27.300579] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-11 (1.98 seconds). [2025-09-18T19:42:27.719617] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-09-18T19:42:28.059914] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-18T19:42:28.519533] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-09-18T19:42:28.538195] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-18T19:42:29.319549] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-09-18T19:42:29.648091] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-18T19:42:30.086251] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-18T19:42:30.119496] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-18T19:42:30.149749] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-18T19:42:30.919612] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-09-18T19:42:31.550323] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T19:42:31.620021] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-18T19:42:31.719591] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-11. [2025-09-18T19:42:32.519551] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-18T19:42:33.226617] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-18T19:42:33.319530] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-09-18T19:42:33.627131] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-18T19:42:34.119548] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-09-18T19:42:34.691366] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-18T19:42:34.919541] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-09-18T19:42:35.719569] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-09-18T19:42:35.869521] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-18T19:42:36.339899] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-18T19:42:36.519547] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-18T19:42:36.579265] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-18T19:42:37.319544] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-18T19:42:37.932374] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T19:42:38.119551] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-09-18T19:42:38.917709] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-18T19:42:38.926041] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-18T19:42:38.985435] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-18T19:42:39.719543] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-18T19:42:40.529943] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-09-18T19:42:40.536512] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T19:42:41.022717] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-18T19:42:41.319546] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-18T19:42:41.830935] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-18T19:42:41.835031] [INFO ] [REMOTE ] INR: Full fetch complete (32254 records). [2025-09-18T19:42:41.835142] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-09-18T19:42:42.024708] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 159 unique days, need 200 days [2025-09-18T19:42:42.025152] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:42:42.025227] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:42:42.025327] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-18T19:42:42.025427] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-18T19:42:42.025490] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-09-18T19:42:42.025553] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-09-18T19:42:42.025677] [INFO ] [MAIN ] Update Progress: 1114/2372 symbols completed. INR took 31.2s. Estimated remaining: 3h 3m 40s. Rate: 6.8 symbols/min [2025-09-18T19:42:42.125568] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-18T19:42:42.196614] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:42:42.226115] [DEBUG] [LOCAL ] INVX: Loaded 29305 existing records from primary storage. [2025-09-18T19:42:42.226316] [INFO ] [MAIN ] INVX: Loaded 29305 existing records. [2025-09-18T19:42:42.432115] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:42:42.432379] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-18T19:42:42.432431] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-18T19:42:42.433087] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-18T19:42:42.433155] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-18T19:42:42.832076] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:42:42.860900] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T19:42:42.919498] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-18T19:42:43.620826] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-18T19:42:43.719534] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-18T19:42:44.098468] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-18T19:42:44.519553] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-18T19:42:45.291707] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T19:42:45.319506] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-18T19:42:45.484132] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-18T19:42:46.119534] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-18T19:42:46.919546] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-11. [2025-09-18T19:42:47.115064] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-18T19:42:47.479489] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-18T19:42:47.719565] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-18T19:42:47.947049] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-18T19:42:48.519548] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-18T19:42:49.044830] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-18T19:42:49.319586] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-18T19:42:49.973337] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T19:42:50.119559] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-18T19:42:50.811546] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-18T19:42:50.919565] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-09-18T19:42:51.646623] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-18T19:42:51.719520] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-18T19:42:52.181626] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-18T19:42:52.519552] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-09-18T19:42:52.889364] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-18T19:42:52.895454] [INFO ] [REMOTE ] INSW: Full fetch complete (60871 records). [2025-09-18T19:42:52.895624] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-18T19:42:53.314445] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-18T19:42:53.314536] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-18T19:42:53.315420] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-18T19:42:53.315487] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-18T19:42:53.316887] [DEBUG] [LOCAL ] INSW: Trimmed 60871 records to 40985 (keeping 200 days of data) [2025-09-18T19:42:53.319529] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-18T19:42:53.611760] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-18T19:42:53.612676] [DEBUG] [LOCAL ] INSW: Primary data saved (40985 records). [2025-09-18T19:42:53.620487] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-18T19:42:53.620998] [INFO ] [MAIN ] Update Progress: 1115/2372 symbols completed. INSW took 29.7s. Estimated remaining: 3h 3m 34s. Rate: 6.8 symbols/min [2025-09-18T19:42:53.799483] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:42:53.852808] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-09-18T19:42:53.852967] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-09-18T19:42:54.041808] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:42:54.042051] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-18T19:42:54.042100] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-18T19:42:54.043222] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-09-18T19:42:54.043285] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-18T19:42:54.124689] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-18T19:42:54.438805] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:42:54.489845] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-18T19:42:54.919600] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-11. [2025-09-18T19:42:55.112789] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-18T19:42:55.719556] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-18T19:42:56.519569] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-18T19:42:57.052898] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-18T19:42:57.319521] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-18T19:42:57.373724] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-11 (2.45 seconds). [2025-09-18T19:42:57.640306] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-18T19:42:58.119567] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-09-18T19:42:58.919551] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-18T19:42:59.186126] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-18T19:42:59.719544] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-18T19:43:00.407141] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T19:43:00.480892] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-18T19:43:00.519497] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-09-18T19:43:01.222082] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-18T19:43:01.230921] [INFO ] [REMOTE ] INVH: Full fetch complete (76507 records). [2025-09-18T19:43:01.231109] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-18T19:43:01.324761] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-18T19:43:01.640702] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-18T19:43:01.640797] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-18T19:43:01.641744] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-18T19:43:01.641837] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-18T19:43:01.646318] [DEBUG] [LOCAL ] INVH: Trimmed 76507 records to 53529 (keeping 200 days of data) [2025-09-18T19:43:01.984321] [DEBUG] [LOCAL ] INVH: Primary data saved (53529 records). [2025-09-18T19:43:01.984472] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-18T19:43:01.984593] [INFO ] [MAIN ] Update Progress: 1116/2372 symbols completed. INVH took 36.5s. Estimated remaining: 3h 3m 25s. Rate: 6.8 symbols/min [2025-09-18T19:43:02.130959] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-18T19:43:02.169103] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:43:02.225660] [DEBUG] [LOCAL ] IOT: Loaded 53473 existing records from primary storage. [2025-09-18T19:43:02.225821] [INFO ] [MAIN ] IOT: Loaded 53473 existing records. [2025-09-18T19:43:02.403435] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:43:02.403758] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-18T19:43:02.403848] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-18T19:43:02.404950] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-18T19:43:02.405064] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-18T19:43:02.780792] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:43:02.808243] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-18T19:43:02.883888] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-18T19:43:02.919510] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-18T19:43:03.586136] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T19:43:03.597464] [INFO ] [REMOTE ] INSP: Full fetch complete (52041 records). [2025-09-18T19:43:03.597588] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-18T19:43:03.725037] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-11. [2025-09-18T19:43:04.024601] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-18T19:43:04.024727] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-18T19:43:04.025483] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-18T19:43:04.025561] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-18T19:43:04.026989] [DEBUG] [LOCAL ] INSP: Trimmed 52041 records to 36882 (keeping 200 days of data) [2025-09-18T19:43:04.269799] [DEBUG] [LOCAL ] INSP: Primary data saved (36882 records). [2025-09-18T19:43:04.269953] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-18T19:43:04.271261] [INFO ] [MAIN ] Update Progress: 1117/2372 symbols completed. INSP took 44.5s. Estimated remaining: 3h 3m 9s. Rate: 6.9 symbols/min [2025-09-18T19:43:04.519600] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-18T19:43:05.351364] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-18T19:43:05.362709] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-18T19:43:05.443943] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-18T19:43:05.622839] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-18T19:43:06.119565] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-09-18T19:43:06.919601] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-18T19:43:07.822312] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-18T19:43:07.838115] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-09-18T19:43:07.952719] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-18T19:43:08.204158] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-18T19:43:08.519610] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-18T19:43:09.319619] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-18T19:43:09.396915] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-18T19:43:09.544677] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-18T19:43:10.119602] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-18T19:43:10.919604] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-18T19:43:11.744028] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-18T19:43:11.761903] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-18T19:43:11.788959] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-18T19:43:12.045337] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-09-18T19:43:12.519607] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-18T19:43:13.301770] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-18T19:43:13.319520] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-18T19:43:14.119551] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-18T19:43:15.087819] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-18T19:43:15.092140] [INFO ] [REMOTE ] INVX: Full fetch complete (44546 records). [2025-09-18T19:43:15.092322] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-18T19:43:15.357766] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-09-18T19:43:15.426545] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-18T19:43:15.568844] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-18T19:43:15.596558] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-18T19:43:15.597259] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-18T19:43:15.598013] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-18T19:43:15.598089] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-18T19:43:15.601141] [DEBUG] [LOCAL ] INVX: Trimmed 44546 records to 29524 (keeping 200 days of data) [2025-09-18T19:43:15.719690] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-18T19:43:15.791258] [DEBUG] [LOCAL ] INVX: Primary data saved (29524 records). [2025-09-18T19:43:15.791425] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-18T19:43:15.791567] [INFO ] [MAIN ] Update Progress: 1118/2372 symbols completed. INVX took 33.8s. Estimated remaining: 3h 3m 4s. Rate: 6.9 symbols/min [2025-09-18T19:43:17.448804] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-18T19:43:17.461447] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-18T19:43:17.722093] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-18T19:43:17.734468] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-18T19:43:19.403734] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-18T19:43:19.420042] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-18T19:43:20.243505] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-18T19:43:20.255729] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-18T19:43:21.438112] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-18T19:43:21.450958] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-18T19:43:22.711734] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-18T19:43:22.723298] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-18T19:43:23.386847] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-18T19:43:23.400156] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-18T19:43:25.220753] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-18T19:43:25.228202] [INFO ] [REMOTE ] IOT: Full fetch complete (77219 records). [2025-09-18T19:43:25.228337] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-18T19:43:25.651669] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-18T19:43:25.651804] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-18T19:43:25.653107] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-18T19:43:25.653232] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-18T19:43:25.674040] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.95 seconds). [2025-09-18T19:43:25.681319] [DEBUG] [LOCAL ] IOT: Trimmed 77219 records to 53863 (keeping 200 days of data) [2025-09-18T19:43:25.683887] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-09-18T19:43:25.684036] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-18T19:43:26.193610] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-09-18T19:43:26.194344] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-09-18T19:43:26.196089] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-09-18T19:43:26.196170] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-09-18T19:43:26.201020] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54178 (keeping 200 days of data) [2025-09-18T19:43:26.711585] [DEBUG] [LOCAL ] IOT: Primary data saved (53863 records). [2025-09-18T19:43:26.736872] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-18T19:43:26.737933] [INFO ] [MAIN ] Update Progress: 1119/2372 symbols completed. IOT took 24.8s. Estimated remaining: 3h 2m 57s. Rate: 6.8 symbols/min [2025-09-18T19:43:26.762715] [DEBUG] [LOCAL ] IONQ: Primary data saved (54178 records). [2025-09-18T19:43:26.762798] [INFO ] [MAIN ] IONQ: Full history saved. [2025-09-18T19:43:26.762875] [INFO ] [MAIN ] Update Progress: 1120/2372 symbols completed. IONQ took 33.1s. Estimated remaining: 3h 2m 39s. Rate: 6.9 symbols/min [2025-09-18T19:43:27.340060] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:43:27.498839] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:43:27.533021] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:43:27.559311] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:43:27.569613] [DEBUG] [LOCAL ] IQI: Loaded 17965 existing records from primary storage. [2025-09-18T19:43:27.570079] [INFO ] [MAIN ] IQI: Loaded 17965 existing records. [2025-09-18T19:43:27.705591] [DEBUG] [LOCAL ] IPI: Loaded 21425 existing records from primary storage. [2025-09-18T19:43:27.705938] [INFO ] [MAIN ] IPI: Loaded 21425 existing records. [2025-09-18T19:43:27.957421] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:43:27.979329] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-18T19:43:27.984592] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-18T19:43:28.025425] [DEBUG] [LOCAL ] IP: Loaded 53330 existing records from primary storage. [2025-09-18T19:43:28.054873] [INFO ] [MAIN ] IP: Loaded 53330 existing records. [2025-09-18T19:43:28.058339] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-09-18T19:43:28.059205] [DEBUG] [LOCAL ] IPG: Loaded 53333 existing records from primary storage. [2025-09-18T19:43:28.058211] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:43:28.070176] [INFO ] [MAIN ] IPG: Loaded 53333 existing records. [2025-09-18T19:43:28.079905] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-18T19:43:28.232862] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-18T19:43:28.292092] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-18T19:43:28.386258] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-18T19:43:28.405253] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-18T19:43:28.626400] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:43:28.721387] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:43:28.754907] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-18T19:43:28.764541] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-18T19:43:28.774943] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-18T19:43:28.775254] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-18T19:43:28.797498] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-18T19:43:28.821876] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-18T19:43:28.853036] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-18T19:43:28.895578] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-18T19:43:29.232259] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:43:29.326844] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-11. [2025-09-18T19:43:29.745717] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:43:29.775750] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-11. [2025-09-18T19:43:29.948311] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:43:29.953963] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-11. [2025-09-18T19:43:29.995307] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:43:29.995659] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-11. [2025-09-18T19:43:30.601529] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T19:43:30.606595] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-09-18T19:43:30.642554] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-18T19:43:30.646245] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-09-18T19:43:31.556575] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-18T19:43:31.567073] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-09-18T19:43:31.605227] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-18T19:43:31.610026] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-09-18T19:43:31.642999] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-18T19:43:31.654079] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-09-18T19:43:31.688147] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-18T19:43:31.693066] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-09-18T19:43:32.388060] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-18T19:43:32.393458] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-18T19:43:32.461837] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-18T19:43:32.465812] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-18T19:43:33.011622] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-18T19:43:33.024579] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-09-18T19:43:33.071429] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-18T19:43:33.076171] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-18T19:43:33.097517] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-18T19:43:33.138621] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-18T19:43:33.319516] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-09-18T19:43:33.927226] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-18T19:43:34.119549] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-18T19:43:34.355885] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-18T19:43:34.727389] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-18T19:43:34.919565] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-18T19:43:34.949762] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-18T19:43:35.719605] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-18T19:43:36.519576] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-18T19:43:36.770289] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-18T19:43:36.798910] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-18T19:43:37.319574] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-18T19:43:37.359056] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-18T19:43:38.119560] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-18T19:43:38.919566] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-18T19:43:39.143720] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-18T19:43:39.342386] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T19:43:39.640072] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T19:43:39.719502] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-18T19:43:40.519566] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-18T19:43:40.765380] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-18T19:43:41.319562] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-18T19:43:42.090487] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-18T19:43:42.122840] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-18T19:43:42.129052] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T19:43:42.919513] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-18T19:43:43.110694] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-18T19:43:43.719546] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-18T19:43:44.410352] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-18T19:43:44.499637] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-18T19:43:44.503123] [INFO ] [REMOTE ] IPI: Full fetch complete (28891 records). [2025-09-18T19:43:44.503226] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-18T19:43:44.519509] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-18T19:43:44.914432] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-18T19:43:44.914541] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-18T19:43:44.915246] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-18T19:43:44.915326] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-18T19:43:44.916169] [DEBUG] [LOCAL ] IPI: Trimmed 28891 records to 21585 (keeping 200 days of data) [2025-09-18T19:43:45.044773] [DEBUG] [LOCAL ] IPI: Primary data saved (21585 records). [2025-09-18T19:43:45.044919] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-18T19:43:45.045009] [INFO ] [MAIN ] Update Progress: 1121/2372 symbols completed. IPI took 18.3s. Estimated remaining: 3h 2m 41s. Rate: 6.8 symbols/min [2025-09-18T19:43:45.227001] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:43:45.280089] [DEBUG] [LOCAL ] IQV: Loaded 50554 existing records from primary storage. [2025-09-18T19:43:45.280269] [INFO ] [MAIN ] IQV: Loaded 50554 existing records. [2025-09-18T19:43:45.324769] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-18T19:43:45.451908] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-18T19:43:45.493934] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:43:45.494166] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-18T19:43:45.494216] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-18T19:43:45.495603] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-09-18T19:43:45.495692] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-18T19:43:45.872919] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:43:46.119541] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-18T19:43:46.886370] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-18T19:43:46.919529] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-18T19:43:47.086548] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-18T19:43:47.576977] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-18T19:43:47.719581] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-18T19:43:48.519552] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-11. [2025-09-18T19:43:49.324380] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-18T19:43:49.330223] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-18T19:43:50.119579] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-18T19:43:50.178995] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-18T19:43:50.806945] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-18T19:43:50.919592] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-18T19:43:51.644322] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-18T19:43:51.719541] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-18T19:43:51.983479] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-18T19:43:52.519546] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-18T19:43:53.162692] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T19:43:53.243229] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-18T19:43:53.246697] [INFO ] [REMOTE ] IQI: Full fetch complete (27305 records). [2025-09-18T19:43:53.246885] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-18T19:43:53.324880] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-18T19:43:53.720372] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-09-18T19:43:53.720484] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-09-18T19:43:53.721539] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-09-18T19:43:53.721606] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-09-18T19:43:53.722631] [DEBUG] [LOCAL ] IQI: Trimmed 27305 records to 18112 (keeping 200 days of data) [2025-09-18T19:43:53.837788] [DEBUG] [LOCAL ] IQI: Primary data saved (18112 records). [2025-09-18T19:43:53.837994] [INFO ] [MAIN ] IQI: Full history saved. [2025-09-18T19:43:53.838125] [INFO ] [MAIN ] Update Progress: 1122/2372 symbols completed. IQI took 27.1s. Estimated remaining: 3h 2m 32s. Rate: 6.8 symbols/min [2025-09-18T19:43:54.014837] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:43:54.080458] [DEBUG] [LOCAL ] IR: Loaded 52699 existing records from primary storage. [2025-09-18T19:43:54.080671] [INFO ] [MAIN ] IR: Loaded 52699 existing records. [2025-09-18T19:43:54.124779] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-18T19:43:54.266976] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:43:54.267240] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-18T19:43:54.267289] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-18T19:43:54.268763] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-18T19:43:54.268826] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-18T19:43:54.627753] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:43:54.919528] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-09-18T19:43:54.989262] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-18T19:43:55.719607] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-11. [2025-09-18T19:43:56.184526] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-18T19:43:56.340422] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-18T19:43:56.519587] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-09-18T19:43:57.107312] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T19:43:57.319583] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-18T19:43:58.005619] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T19:43:58.119534] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-18T19:43:58.919553] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-09-18T19:43:59.045017] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-18T19:43:59.721538] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-18T19:43:59.737352] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-18T19:44:00.232151] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T19:44:00.519627] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-09-18T19:44:01.264143] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-18T19:44:01.271380] [INFO ] [REMOTE ] IPG: Full fetch complete (77077 records). [2025-09-18T19:44:01.271497] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-18T19:44:01.327401] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-18T19:44:01.689093] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-18T19:44:01.689270] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-18T19:44:01.690248] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-18T19:44:01.690315] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-18T19:44:01.691838] [DEBUG] [LOCAL ] IPG: Trimmed 77077 records to 53723 (keeping 200 days of data) [2025-09-18T19:44:02.071902] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T19:44:02.087074] [DEBUG] [LOCAL ] IPG: Primary data saved (53723 records). [2025-09-18T19:44:02.087232] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-18T19:44:02.087329] [INFO ] [MAIN ] Update Progress: 1123/2372 symbols completed. IPG took 35.3s. Estimated remaining: 3h 2m 23s. Rate: 6.8 symbols/min [2025-09-18T19:44:02.124786] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-18T19:44:02.266243] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:44:02.315582] [DEBUG] [LOCAL ] IRM: Loaded 49577 existing records from primary storage. [2025-09-18T19:44:02.315786] [INFO ] [MAIN ] IRM: Loaded 49577 existing records. [2025-09-18T19:44:02.510436] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:44:02.510783] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-18T19:44:02.510853] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-18T19:44:02.512748] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-18T19:44:02.512832] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-18T19:44:02.893331] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:44:02.919495] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-11. [2025-09-18T19:44:02.919387] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-18T19:44:03.623608] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-18T19:44:03.719561] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-18T19:44:04.281917] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-18T19:44:04.519579] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-18T19:44:05.086236] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-18T19:44:05.319589] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-18T19:44:06.119593] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-09-18T19:44:06.265979] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-18T19:44:06.710278] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T19:44:06.919628] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-18T19:44:07.677388] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-18T19:44:07.719549] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-09-18T19:44:08.519587] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-18T19:44:08.789279] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-18T19:44:09.209095] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T19:44:09.319577] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-18T19:44:10.119525] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-18T19:44:10.199201] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-18T19:44:10.207281] [INFO ] [REMOTE ] IP: Full fetch complete (76866 records). [2025-09-18T19:44:10.207440] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-18T19:44:10.645148] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-18T19:44:10.645498] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-18T19:44:10.646750] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-18T19:44:10.646857] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-18T19:44:10.649591] [DEBUG] [LOCAL ] IP: Trimmed 76866 records to 53719 (keeping 200 days of data) [2025-09-18T19:44:10.784038] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T19:44:10.929547] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-18T19:44:11.070097] [DEBUG] [LOCAL ] IP: Primary data saved (53719 records). [2025-09-18T19:44:11.070304] [INFO ] [MAIN ] IP: Full history saved. [2025-09-18T19:44:11.071245] [INFO ] [MAIN ] Update Progress: 1124/2372 symbols completed. IP took 44.3s. Estimated remaining: 3h 2m 14s. Rate: 6.8 symbols/min [2025-09-18T19:44:11.245785] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:44:11.268980] [DEBUG] [LOCAL ] IRS: Loaded 21140 existing records from primary storage. [2025-09-18T19:44:11.269144] [INFO ] [MAIN ] IRS: Loaded 21140 existing records. [2025-09-18T19:44:11.450144] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:44:11.450428] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-18T19:44:11.450488] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-18T19:44:11.451304] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-18T19:44:11.451367] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-18T19:44:11.727590] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-18T19:44:11.844517] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:44:11.874764] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-18T19:44:12.492236] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-18T19:44:12.519505] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-18T19:44:13.284920] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-18T19:44:13.319516] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-18T19:44:13.906166] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-18T19:44:14.119578] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-11. [2025-09-18T19:44:14.602347] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-18T19:44:14.919540] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-18T19:44:15.388388] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T19:44:15.719570] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-18T19:44:16.368242] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-18T19:44:16.519559] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-18T19:44:17.325925] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-18T19:44:17.331918] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T19:44:18.119596] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-18T19:44:18.318311] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-18T19:44:18.327772] [INFO ] [REMOTE ] IQV: Full fetch complete (72417 records). [2025-09-18T19:44:18.327925] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-18T19:44:18.725494] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-09-18T19:44:18.725624] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-09-18T19:44:18.726613] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-09-18T19:44:18.726694] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-09-18T19:44:18.728088] [DEBUG] [LOCAL ] IQV: Trimmed 72417 records to 50871 (keeping 200 days of data) [2025-09-18T19:44:18.945314] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-09-18T19:44:19.058572] [DEBUG] [LOCAL ] IQV: Primary data saved (50871 records). [2025-09-18T19:44:19.058746] [INFO ] [MAIN ] IQV: Full history saved. [2025-09-18T19:44:19.058865] [INFO ] [MAIN ] Update Progress: 1125/2372 symbols completed. IQV took 34.0s. Estimated remaining: 3h 2m 4s. Rate: 6.8 symbols/min [2025-09-18T19:44:19.207289] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-18T19:44:19.280325] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:44:19.332109] [DEBUG] [LOCAL ] IRT: Loaded 50419 existing records from primary storage. [2025-09-18T19:44:19.332270] [INFO ] [MAIN ] IRT: Loaded 50419 existing records. [2025-09-18T19:44:19.511718] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:44:19.511976] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-18T19:44:19.512026] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-18T19:44:19.513273] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-18T19:44:19.513335] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-18T19:44:19.728615] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-18T19:44:19.933579] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:44:19.978507] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-18T19:44:19.992504] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T19:44:20.519554] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-09-18T19:44:21.319603] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-11. [2025-09-18T19:44:21.441395] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-18T19:44:21.574427] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-18T19:44:22.119611] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-18T19:44:22.658362] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-18T19:44:22.919550] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-18T19:44:23.598884] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-18T19:44:23.719558] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-18T19:44:23.751476] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-18T19:44:24.519622] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-18T19:44:25.319521] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-18T19:44:25.550385] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-18T19:44:25.708287] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-18T19:44:25.715773] [INFO ] [REMOTE ] IR: Full fetch complete (75876 records). [2025-09-18T19:44:25.715918] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-18T19:44:26.122867] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-18T19:44:26.123115] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-18T19:44:26.124511] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-18T19:44:26.125573] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-18T19:44:26.125749] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-18T19:44:26.127380] [DEBUG] [LOCAL ] IR: Trimmed 75876 records to 53086 (keeping 200 days of data) [2025-09-18T19:44:26.461800] [DEBUG] [LOCAL ] IR: Primary data saved (53086 records). [2025-09-18T19:44:26.461943] [INFO ] [MAIN ] IR: Full history saved. [2025-09-18T19:44:26.462030] [INFO ] [MAIN ] Update Progress: 1126/2372 symbols completed. IR took 32.6s. Estimated remaining: 3h 1m 54s. Rate: 6.8 symbols/min [2025-09-18T19:44:26.639326] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:44:26.674774] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-18T19:44:26.698532] [DEBUG] [LOCAL ] ISD: Loaded 15835 existing records from primary storage. [2025-09-18T19:44:26.698700] [INFO ] [MAIN ] ISD: Loaded 15835 existing records. [2025-09-18T19:44:26.887394] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:44:26.887685] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-18T19:44:26.887763] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-18T19:44:26.888384] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-18T19:44:26.888444] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-18T19:44:26.920437] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-18T19:44:27.204813] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-18T19:44:27.310820] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:44:27.719593] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-09-18T19:44:28.519572] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-18T19:44:28.598918] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-18T19:44:29.224454] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-18T19:44:29.319582] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-18T19:44:29.383787] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-18T19:44:30.060335] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-18T19:44:30.119527] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-18T19:44:30.919555] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-09-18T19:44:31.177974] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-18T19:44:31.719544] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-18T19:44:32.254240] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-18T19:44:32.464891] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-18T19:44:32.519531] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-18T19:44:33.319551] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-18T19:44:33.894970] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-18T19:44:33.900314] [INFO ] [REMOTE ] IRS: Full fetch complete (32001 records). [2025-09-18T19:44:33.900436] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-18T19:44:34.126481] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-11. [2025-09-18T19:44:34.324629] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-18T19:44:34.324755] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-18T19:44:34.325422] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-18T19:44:34.325480] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-18T19:44:34.326738] [DEBUG] [LOCAL ] IRS: Trimmed 32001 records to 21446 (keeping 200 days of data) [2025-09-18T19:44:34.458532] [DEBUG] [LOCAL ] IRS: Primary data saved (21446 records). [2025-09-18T19:44:34.458704] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-18T19:44:34.458804] [INFO ] [MAIN ] Update Progress: 1127/2372 symbols completed. IRS took 23.4s. Estimated remaining: 3h 1m 45s. Rate: 6.9 symbols/min [2025-09-18T19:44:34.660276] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:44:34.689941] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-18T19:44:34.742287] [DEBUG] [LOCAL ] IT: Loaded 41079 existing records from primary storage. [2025-09-18T19:44:34.742456] [INFO ] [MAIN ] IT: Loaded 41079 existing records. [2025-09-18T19:44:34.921732] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-18T19:44:34.953513] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:44:34.965925] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-18T19:44:34.966053] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-18T19:44:34.967151] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-18T19:44:34.971662] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-18T19:44:34.971772] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-18T19:44:35.347481] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:44:35.719557] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-11. [2025-09-18T19:44:36.524762] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-18T19:44:36.539921] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-18T19:44:37.060808] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-18T19:44:37.319546] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-09-18T19:44:37.955471] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-18T19:44:38.119521] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-18T19:44:38.722458] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-18T19:44:38.919545] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-09-18T19:44:39.683440] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-18T19:44:39.690257] [INFO ] [REMOTE ] IRM: Full fetch complete (72150 records). [2025-09-18T19:44:39.690392] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-18T19:44:39.724726] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-09-18T19:44:40.089872] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-18T19:44:40.089958] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-18T19:44:40.090862] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-18T19:44:40.090929] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-18T19:44:40.092404] [DEBUG] [LOCAL ] IRM: Trimmed 72150 records to 49920 (keeping 200 days of data) [2025-09-18T19:44:40.338769] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-18T19:44:40.443675] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-18T19:44:40.466396] [DEBUG] [LOCAL ] IRM: Primary data saved (49920 records). [2025-09-18T19:44:40.466592] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-18T19:44:40.466748] [INFO ] [MAIN ] Update Progress: 1128/2372 symbols completed. IRM took 38.4s. Estimated remaining: 3h 1m 33s. Rate: 6.9 symbols/min [2025-09-18T19:44:40.524621] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-09-18T19:44:40.646012] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:44:40.682839] [DEBUG] [LOCAL ] ITGR: Loaded 31638 existing records from primary storage. [2025-09-18T19:44:40.682993] [INFO ] [MAIN ] ITGR: Loaded 31638 existing records. [2025-09-18T19:44:40.860406] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:44:40.860735] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-18T19:44:40.860792] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-18T19:44:40.861855] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-18T19:44:40.861916] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-18T19:44:41.214410] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:44:41.319542] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-11. [2025-09-18T19:44:41.694733] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T19:44:42.079593] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-18T19:44:42.119506] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-18T19:44:42.919537] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-09-18T19:44:43.303716] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-18T19:44:43.719537] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-18T19:44:44.002289] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-18T19:44:44.519547] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-09-18T19:44:45.077846] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T19:44:45.281139] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-18T19:44:45.319497] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-18T19:44:46.119566] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-18T19:44:46.461569] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T19:44:46.889142] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-18T19:44:46.919578] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-18T19:44:47.712183] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-18T19:44:47.719485] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-18T19:44:48.446900] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-18T19:44:48.519635] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-18T19:44:49.319566] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-18T19:44:49.590294] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-18T19:44:50.124777] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-18T19:44:50.132847] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-18T19:44:50.919555] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-18T19:44:51.485841] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-18T19:44:51.719589] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-18T19:44:52.141482] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-18T19:44:52.519592] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-18T19:44:53.218012] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-18T19:44:53.319577] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-18T19:44:54.120706] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-18T19:44:54.132547] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-18T19:44:54.544873] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-18T19:44:54.914886] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-18T19:44:54.919721] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-18T19:44:55.719632] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-18T19:44:56.402187] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-18T19:44:56.519594] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-18T19:44:57.205569] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T19:44:57.319525] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-18T19:44:57.350047] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-18T19:44:58.119591] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-18T19:44:58.651552] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-18T19:44:58.919606] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-18T19:44:59.352454] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-18T19:44:59.502485] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-18T19:44:59.719560] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-18T19:45:00.519596] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-18T19:45:01.319585] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-18T19:45:01.560267] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-18T19:45:01.997183] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T19:45:02.119565] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-18T19:45:02.919611] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-18T19:45:03.719569] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-18T19:45:04.117129] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-09-18T19:45:04.256633] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-18T19:45:04.519571] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-18T19:45:04.784952] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-18T19:45:05.280289] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-18T19:45:05.283277] [INFO ] [REMOTE ] ISD: Full fetch complete (23880 records). [2025-09-18T19:45:05.283512] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-18T19:45:05.320686] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-18T19:45:05.750672] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-18T19:45:05.751304] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-18T19:45:05.754039] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-18T19:45:05.752807] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-18T19:45:05.754152] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-18T19:45:05.767025] [DEBUG] [LOCAL ] ISD: Trimmed 23880 records to 15949 (keeping 200 days of data) [2025-09-18T19:45:05.880351] [DEBUG] [LOCAL ] ISD: Primary data saved (15949 records). [2025-09-18T19:45:05.880557] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-18T19:45:05.880713] [INFO ] [MAIN ] Update Progress: 1129/2372 symbols completed. ISD took 39.4s. Estimated remaining: 3h 1m 42s. Rate: 6.8 symbols/min [2025-09-18T19:45:06.060400] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:45:06.105786] [DEBUG] [LOCAL ] ITT: Loaded 33505 existing records from primary storage. [2025-09-18T19:45:06.105984] [INFO ] [MAIN ] ITT: Loaded 33505 existing records. [2025-09-18T19:45:06.127064] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-18T19:45:06.305914] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:45:06.306250] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-18T19:45:06.306305] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-18T19:45:06.307545] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-09-18T19:45:06.307610] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-18T19:45:06.707052] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:45:06.722145] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-18T19:45:06.727363] [INFO ] [REMOTE ] ITGR: Full fetch complete (40956 records). [2025-09-18T19:45:06.727546] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-18T19:45:06.924720] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-11. [2025-09-18T19:45:07.147129] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-18T19:45:07.147225] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-18T19:45:07.148250] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-18T19:45:07.148320] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-18T19:45:07.149497] [DEBUG] [LOCAL ] ITGR: Trimmed 40956 records to 31906 (keeping 200 days of data) [2025-09-18T19:45:07.354436] [DEBUG] [LOCAL ] ITGR: Primary data saved (31906 records). [2025-09-18T19:45:07.354601] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-18T19:45:07.354744] [INFO ] [MAIN ] Update Progress: 1130/2372 symbols completed. ITGR took 26.9s. Estimated remaining: 3h 1m 26s. Rate: 6.8 symbols/min [2025-09-18T19:45:07.526333] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:45:07.579341] [DEBUG] [LOCAL ] ITUB: Loaded 53303 existing records from primary storage. [2025-09-18T19:45:07.579500] [INFO ] [MAIN ] ITUB: Loaded 53303 existing records. [2025-09-18T19:45:07.724701] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-18T19:45:07.784791] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:45:07.785377] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-18T19:45:07.785494] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-18T19:45:07.787329] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-09-18T19:45:07.787570] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-18T19:45:07.908028] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-18T19:45:07.946227] [INFO ] [REMOTE ] IT: Full fetch complete (54666 records). [2025-09-18T19:45:07.951670] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-18T19:45:08.340508] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:45:08.523472] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-11. [2025-09-18T19:45:08.626248] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-18T19:45:08.655280] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-18T19:45:08.655417] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-18T19:45:08.656845] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-18T19:45:08.656930] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-18T19:45:08.662077] [DEBUG] [LOCAL ] IT: Trimmed 54666 records to 41428 (keeping 200 days of data) [2025-09-18T19:45:08.937449] [DEBUG] [LOCAL ] IT: Primary data saved (41428 records). [2025-09-18T19:45:08.937589] [INFO ] [MAIN ] IT: Full history saved. [2025-09-18T19:45:08.939342] [INFO ] [MAIN ] Update Progress: 1131/2372 symbols completed. IT took 34.5s. Estimated remaining: 3h 1m 9s. Rate: 6.9 symbols/min [2025-09-18T19:45:09.144826] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:45:09.206452] [DEBUG] [LOCAL ] ITW: Loaded 46540 existing records from primary storage. [2025-09-18T19:45:09.206607] [INFO ] [MAIN ] ITW: Loaded 46540 existing records. [2025-09-18T19:45:09.324706] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-09-18T19:45:09.391490] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:45:09.391960] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-18T19:45:09.392037] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-18T19:45:09.394092] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-18T19:45:09.394199] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-18T19:45:09.601411] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-18T19:45:09.685409] [INFO ] [REMOTE ] IRT: Full fetch complete (72147 records). [2025-09-18T19:45:09.725488] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-18T19:45:09.952419] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:45:10.130202] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-11. [2025-09-18T19:45:10.265434] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-18T19:45:10.265569] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-18T19:45:10.266597] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-18T19:45:10.266711] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-18T19:45:10.268731] [DEBUG] [LOCAL ] IRT: Trimmed 72147 records to 50772 (keeping 200 days of data) [2025-09-18T19:45:10.365457] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-18T19:45:10.616246] [DEBUG] [LOCAL ] IRT: Primary data saved (50772 records). [2025-09-18T19:45:10.616455] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-18T19:45:10.616686] [INFO ] [MAIN ] Update Progress: 1132/2372 symbols completed. IRT took 51.6s. Estimated remaining: 3h 0m 52s. Rate: 6.9 symbols/min [2025-09-18T19:45:10.792817] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:45:10.810460] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T19:45:10.859437] [DEBUG] [LOCAL ] IVR: Loaded 47721 existing records from primary storage. [2025-09-18T19:45:10.859618] [INFO ] [MAIN ] IVR: Loaded 47721 existing records. [2025-09-18T19:45:10.927595] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-09-18T19:45:11.057807] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:45:11.058072] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-18T19:45:11.058132] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-18T19:45:11.059350] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-18T19:45:11.059411] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-18T19:45:11.435428] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:45:11.527136] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-18T19:45:11.719563] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-09-18T19:45:12.239394] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-18T19:45:12.519544] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-11. [2025-09-18T19:45:13.174391] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-18T19:45:13.319579] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-09-18T19:45:13.776346] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-18T19:45:14.119557] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-18T19:45:14.919591] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-09-18T19:45:15.584622] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-18T19:45:15.719567] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-09-18T19:45:16.231123] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-18T19:45:16.519600] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-18T19:45:17.319617] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-18T19:45:17.888827] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-18T19:45:17.982552] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-18T19:45:18.119537] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-18T19:45:18.692514] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-18T19:45:18.919554] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-18T19:45:19.719605] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-09-18T19:45:21.451745] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-18T19:45:21.461624] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-18T19:45:23.141369] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-18T19:45:23.151070] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-18T19:45:58.286539] [DEBUG] [REMOTE ] ITUB: Error fetching primary data for 2024-12: ("Connection broken: InvalidChunkLength(got length b'', 0 bytes read)", InvalidChunkLength(got length b'', 0 bytes read)) [2025-09-18T19:45:58.287132] [WARN ] [REMOTE ] ITUB: No data returned for month 2024-12 [2025-09-18T19:45:58.288690] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-09-18T19:45:59.857115] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (41.74 seconds). [2025-09-18T19:45:59.868449] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-18T19:45:59.950105] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (41.03 seconds). [2025-09-18T19:45:59.961344] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-18T19:46:00.079323] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (36.93 seconds). [2025-09-18T19:46:00.092193] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-18T19:46:00.125685] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-18T19:46:00.136364] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-18T19:46:01.203086] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T19:46:01.212068] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-18T19:46:01.583749] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-18T19:46:01.595164] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-18T19:46:01.753675] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T19:46:01.764611] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-18T19:46:01.855999] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-18T19:46:01.866491] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-18T19:46:02.377014] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-18T19:46:02.384150] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-18T19:46:03.101379] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-18T19:46:03.111663] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-18T19:46:03.239374] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-18T19:46:03.252926] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-18T19:46:03.310454] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-18T19:46:03.323393] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-18T19:46:03.344208] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-18T19:46:03.351326] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-18T19:46:04.385574] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-18T19:46:04.394632] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-18T19:46:04.441409] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-18T19:46:04.448403] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-18T19:46:04.562305] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-18T19:46:04.571787] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-18T19:46:04.702193] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-18T19:46:04.713242] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-18T19:46:05.759464] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T19:46:05.773270] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-18T19:46:05.786379] [INFO ] [REMOTE ] ITT: Full fetch complete (46586 records). [2025-09-18T19:46:05.786234] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-18T19:46:05.787528] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-18T19:46:06.319810] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-18T19:46:06.437884] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-18T19:46:06.438197] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-09-18T19:46:06.439404] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-09-18T19:46:06.440863] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-09-18T19:46:06.441113] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-09-18T19:46:06.476109] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-18T19:46:06.486716] [DEBUG] [LOCAL ] ITT: Trimmed 46586 records to 33669 (keeping 200 days of data) [2025-09-18T19:46:06.488294] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-18T19:46:06.733777] [DEBUG] [LOCAL ] ITT: Primary data saved (33669 records). [2025-09-18T19:46:06.734273] [INFO ] [MAIN ] ITT: Full history saved. [2025-09-18T19:46:06.734393] [INFO ] [MAIN ] Update Progress: 1133/2372 symbols completed. ITT took 1m 1s. Estimated remaining: 3h 1m 35s. Rate: 6.8 symbols/min [2025-09-18T19:46:06.905875] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:46:06.946040] [DEBUG] [LOCAL ] IVT: Loaded 31017 existing records from primary storage. [2025-09-18T19:46:06.946198] [INFO ] [MAIN ] IVT: Loaded 31017 existing records. [2025-09-18T19:46:07.134630] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:46:07.135122] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-18T19:46:07.135201] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-18T19:46:07.136697] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-18T19:46:07.136760] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-18T19:46:07.328971] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-18T19:46:07.441977] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-18T19:46:07.563493] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:46:07.563860] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-11. [2025-09-18T19:46:07.969365] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-18T19:46:07.980232] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-18T19:46:08.053166] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-18T19:46:08.064526] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-18T19:46:08.476879] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-18T19:46:08.484168] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-09-18T19:46:08.893063] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T19:46:08.899939] [INFO ] [REMOTE ] ITW: Full fetch complete (66535 records). [2025-09-18T19:46:08.900130] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-18T19:46:09.321864] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-18T19:46:09.322001] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-18T19:46:09.323410] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-18T19:46:09.323482] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-18T19:46:09.325183] [DEBUG] [LOCAL ] ITW: Trimmed 66535 records to 46843 (keeping 200 days of data) [2025-09-18T19:46:09.596078] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T19:46:09.605689] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-09-18T19:46:09.674873] [DEBUG] [LOCAL ] ITW: Primary data saved (46843 records). [2025-09-18T19:46:09.675034] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-18T19:46:09.676125] [INFO ] [MAIN ] Update Progress: 1134/2372 symbols completed. ITW took 1m 1s. Estimated remaining: 3h 1m 20s. Rate: 6.8 symbols/min [2025-09-18T19:46:09.857359] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:46:09.887189] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-18T19:46:09.896956] [INFO ] [REMOTE ] IVR: Full fetch complete (68764 records). [2025-09-18T19:46:09.897257] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-18T19:46:10.247116] [DEBUG] [LOCAL ] IVZ: Loaded 53146 existing records from primary storage. [2025-09-18T19:46:10.264380] [INFO ] [MAIN ] IVZ: Loaded 53146 existing records. [2025-09-18T19:46:10.337206] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-18T19:46:10.431949] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-18T19:46:10.468805] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-18T19:46:10.489373] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-18T19:46:10.488288] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-18T19:46:10.505113] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-18T19:46:10.573971] [DEBUG] [LOCAL ] IVR: Trimmed 68764 records to 48089 (keeping 200 days of data) [2025-09-18T19:46:10.596304] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:46:10.596844] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-18T19:46:10.597116] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-18T19:46:10.598501] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-18T19:46:10.598603] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-18T19:46:11.099066] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:46:11.103219] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-11. [2025-09-18T19:46:11.107163] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-18T19:46:11.121401] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-18T19:46:11.308801] [DEBUG] [LOCAL ] IVR: Primary data saved (48089 records). [2025-09-18T19:46:11.308972] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-18T19:46:11.309088] [INFO ] [MAIN ] Update Progress: 1135/2372 symbols completed. IVR took 1m 1s. Estimated remaining: 3h 1m 4s. Rate: 6.8 symbols/min [2025-09-18T19:46:11.487187] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:46:11.509784] [DEBUG] [LOCAL ] IX: Loaded 22870 existing records from primary storage. [2025-09-18T19:46:11.509931] [INFO ] [MAIN ] IX: Loaded 22870 existing records. [2025-09-18T19:46:11.692951] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:46:11.693210] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-18T19:46:11.693258] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-18T19:46:11.693944] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-18T19:46:11.694025] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-18T19:46:12.058979] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:46:12.059317] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-11. [2025-09-18T19:46:12.333417] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-18T19:46:12.346472] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-18T19:46:12.394840] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-18T19:46:12.401807] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-18T19:46:12.662172] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-18T19:46:12.664330] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-09-18T19:46:12.704396] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-18T19:46:12.714744] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-09-18T19:46:13.465020] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-18T19:46:13.467378] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-09-18T19:46:13.645314] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T19:46:13.652715] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-18T19:46:13.857959] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T19:46:13.865247] [INFO ] [REMOTE ] ITUB: Full fetch complete (69058 records). [2025-09-18T19:46:13.865422] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-18T19:46:14.061073] [WARN ] [VALIDATOR ] ITUB: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-18T19:46:14.062256] [FATAL] [MAIN ] ITUB: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:46:14.062355] [WARN ] [MAIN ] ITUB: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:46:14.062470] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-18T19:46:14.062583] [DEBUG] [LOCAL ] ITUB: No primary data file found to delete. [2025-09-18T19:46:14.062677] [INFO ] [LOCAL ] ITUB: Starting deletion of derivative data. [2025-09-18T19:46:14.063206] [DEBUG] [LOCAL ] ITUB: Deleted derivative data file. [2025-09-18T19:46:14.063334] [INFO ] [MAIN ] Update Progress: 1136/2372 symbols completed. ITUB took 1m 7s. Estimated remaining: 3h 0m 48s. Rate: 6.8 symbols/min [2025-09-18T19:46:14.084532] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-18T19:46:14.114147] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-18T19:46:14.258981] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:46:14.293445] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-18T19:46:14.304506] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-09-18T19:46:14.353121] [DEBUG] [LOCAL ] J: Loaded 40617 existing records from primary storage. [2025-09-18T19:46:14.353279] [INFO ] [MAIN ] J: Loaded 40617 existing records. [2025-09-18T19:46:14.534862] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:46:14.535111] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-18T19:46:14.535160] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-18T19:46:14.536194] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-18T19:46:14.536256] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-18T19:46:14.890341] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-18T19:46:14.930836] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-18T19:46:14.952917] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:46:14.954780] [INFO ] [REMOTE ] J: Fetching primary data for 2024-11. [2025-09-18T19:46:14.978376] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-18T19:46:14.986462] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-18T19:46:16.070997] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-18T19:46:16.082727] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-18T19:46:16.103259] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-18T19:46:16.110309] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-18T19:46:16.130298] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-18T19:46:16.136303] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-18T19:46:16.205363] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-18T19:46:16.213793] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-09-18T19:46:17.112821] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-18T19:46:17.121397] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-18T19:46:17.172748] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-18T19:46:17.179096] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-18T19:46:17.372035] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-18T19:46:17.382433] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-18T19:46:17.541708] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T19:46:17.550088] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-09-18T19:46:17.902473] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-18T19:46:17.908363] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-18T19:46:18.032168] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-18T19:46:18.040245] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-18T19:46:18.673285] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-18T19:46:18.678900] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-18T19:46:18.882447] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-18T19:46:18.895114] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-18T19:46:18.920029] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-18T19:46:18.929398] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-18T19:46:18.994946] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-18T19:46:19.002710] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-18T19:46:19.458690] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-18T19:46:19.464347] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-18T19:46:20.172078] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-18T19:46:20.176500] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-18T19:46:20.199900] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-18T19:46:20.208325] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-18T19:46:20.301868] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-18T19:46:20.306294] [INFO ] [REMOTE ] IVT: Full fetch complete (45509 records). [2025-09-18T19:46:20.306382] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-18T19:46:20.686732] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-18T19:46:20.686864] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-18T19:46:20.687596] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-18T19:46:20.687720] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-18T19:46:20.714059] [DEBUG] [LOCAL ] IVT: Trimmed 45509 records to 31317 (keeping 200 days of data) [2025-09-18T19:46:20.720057] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-18T19:46:20.816288] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-18T19:46:20.926303] [DEBUG] [LOCAL ] IVT: Primary data saved (31317 records). [2025-09-18T19:46:20.926485] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-18T19:46:20.926621] [INFO ] [MAIN ] Update Progress: 1137/2372 symbols completed. IVT took 14.2s. Estimated remaining: 3h 0m 37s. Rate: 6.8 symbols/min [2025-09-18T19:46:21.099037] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:46:21.106907] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-18T19:46:21.110089] [INFO ] [REMOTE ] IX: Full fetch complete (26581 records). [2025-09-18T19:46:21.110189] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-18T19:46:21.426454] [DEBUG] [LOCAL ] JBGS: Loaded 42400 existing records from primary storage. [2025-09-18T19:46:21.442784] [INFO ] [MAIN ] JBGS: Loaded 42400 existing records. [2025-09-18T19:46:21.629783] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-18T19:46:21.645455] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-18T19:46:21.671885] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-18T19:46:21.712629] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-18T19:46:21.712460] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:46:21.713195] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-18T19:46:21.713465] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-18T19:46:21.714757] [DEBUG] [LOCAL ] IX: Trimmed 26581 records to 23003 (keeping 200 days of data) [2025-09-18T19:46:21.715488] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-18T19:46:21.715869] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-18T19:46:21.986603] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-18T19:46:22.093965] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-18T19:46:22.253627] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:46:22.254618] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-11. [2025-09-18T19:46:22.281237] [DEBUG] [LOCAL ] IX: Primary data saved (23003 records). [2025-09-18T19:46:22.281354] [INFO ] [MAIN ] IX: Full history saved. [2025-09-18T19:46:22.281442] [INFO ] [MAIN ] Update Progress: 1138/2372 symbols completed. IX took 11.0s. Estimated remaining: 3h 0m 21s. Rate: 6.8 symbols/min [2025-09-18T19:46:22.456207] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:46:22.498930] [DEBUG] [LOCAL ] JBI: Loaded 44221 existing records from primary storage. [2025-09-18T19:46:22.520759] [INFO ] [MAIN ] JBI: Loaded 44221 existing records. [2025-09-18T19:46:22.644294] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-18T19:46:22.682663] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-18T19:46:22.735968] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:46:22.736233] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-18T19:46:22.736281] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-18T19:46:22.737229] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-18T19:46:22.737290] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-18T19:46:23.105463] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:46:23.105844] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-11. [2025-09-18T19:46:23.705040] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-18T19:46:23.713209] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-09-18T19:46:23.800310] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-18T19:46:23.809915] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-18T19:46:24.209703] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-18T19:46:24.220541] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-18T19:46:24.348150] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-18T19:46:24.358407] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-09-18T19:46:24.783176] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-18T19:46:24.791300] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-09-18T19:46:25.016273] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T19:46:25.025747] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-18T19:46:25.492043] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-18T19:46:25.501764] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-09-18T19:46:25.662576] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-18T19:46:25.674344] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-18T19:46:26.162911] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-18T19:46:26.170620] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-18T19:46:26.257891] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-18T19:46:26.266883] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-18T19:46:26.733509] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-18T19:46:26.743998] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-18T19:46:27.120263] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-18T19:46:27.129717] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-18T19:46:27.334796] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-18T19:46:27.345522] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-18T19:46:27.388719] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-18T19:46:27.402726] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-18T19:46:27.825139] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-18T19:46:27.833559] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-18T19:46:28.330360] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-18T19:46:28.339282] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-18T19:46:28.555115] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-18T19:46:28.563955] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-18T19:46:28.899672] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-18T19:46:28.907297] [INFO ] [REMOTE ] IVZ: Full fetch complete (76539 records). [2025-09-18T19:46:28.907439] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-18T19:46:29.360861] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-18T19:46:29.361202] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-18T19:46:29.362236] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-18T19:46:29.362331] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-18T19:46:29.364287] [DEBUG] [LOCAL ] IVZ: Trimmed 76539 records to 53534 (keeping 200 days of data) [2025-09-18T19:46:29.492517] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-18T19:46:29.528686] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-18T19:46:29.762779] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T19:46:29.783215] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-18T19:46:29.803245] [DEBUG] [LOCAL ] IVZ: Primary data saved (53534 records). [2025-09-18T19:46:29.803454] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-18T19:46:29.804453] [INFO ] [MAIN ] Update Progress: 1139/2372 symbols completed. IVZ took 20.1s. Estimated remaining: 3h 0m 11s. Rate: 6.8 symbols/min [2025-09-18T19:46:29.929635] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-18T19:46:29.962051] [INFO ] [REMOTE ] J: Full fetch complete (59118 records). [2025-09-18T19:46:29.995121] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-18T19:46:30.014346] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:46:30.421834] [DEBUG] [LOCAL ] JBL: Loaded 48361 existing records from primary storage. [2025-09-18T19:46:30.441279] [INFO ] [MAIN ] JBL: Loaded 48361 existing records. [2025-09-18T19:46:30.441411] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-18T19:46:30.441486] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-18T19:46:30.474048] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-18T19:46:30.485611] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-18T19:46:30.547048] [DEBUG] [LOCAL ] J: Trimmed 59118 records to 40914 (keeping 200 days of data) [2025-09-18T19:46:30.717830] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:46:30.718083] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-18T19:46:30.718889] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-18T19:46:30.720929] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-18T19:46:30.721219] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-18T19:46:31.229330] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:46:31.234446] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-11. [2025-09-18T19:46:31.264470] [DEBUG] [LOCAL ] J: Primary data saved (40914 records). [2025-09-18T19:46:31.264677] [INFO ] [MAIN ] J: Full history saved. [2025-09-18T19:46:31.264802] [INFO ] [MAIN ] Update Progress: 1140/2372 symbols completed. J took 17.2s. Estimated remaining: 2h 59m 54s. Rate: 6.8 symbols/min [2025-09-18T19:46:31.388959] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-18T19:46:31.488421] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:46:31.484738] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-18T19:46:31.515255] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-18T19:46:31.525260] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-18T19:46:31.547600] [DEBUG] [LOCAL ] JBND: Loaded 25102 existing records from primary storage. [2025-09-18T19:46:31.547796] [INFO ] [MAIN ] JBND: Loaded 25102 existing records. [2025-09-18T19:46:31.741037] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:46:31.741318] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-18T19:46:31.741369] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-18T19:46:31.742091] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-09-18T19:46:31.742153] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-18T19:46:32.104994] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:46:32.105406] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-11. [2025-09-18T19:46:32.646697] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-18T19:46:32.650107] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-09-18T19:46:32.676507] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-18T19:46:32.685861] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-09-18T19:46:32.741993] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-18T19:46:32.778328] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-18T19:46:33.319605] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-18T19:46:33.484081] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-18T19:46:34.001829] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-18T19:46:34.119536] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-09-18T19:46:34.368125] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-18T19:46:34.919550] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-09-18T19:46:35.719547] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-18T19:46:35.887032] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-18T19:46:35.931312] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-18T19:46:36.519548] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-18T19:46:36.901007] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-18T19:46:37.319541] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-18T19:46:37.920887] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T19:46:38.119546] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-18T19:46:38.386278] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-18T19:46:38.714074] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-18T19:46:38.919538] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-18T19:46:39.719574] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-18T19:46:40.506895] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-18T19:46:40.513044] [INFO ] [REMOTE ] JBGS: Full fetch complete (58730 records). [2025-09-18T19:46:40.513159] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-18T19:46:40.525783] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-18T19:46:40.929147] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-18T19:46:40.929364] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-18T19:46:40.930544] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-18T19:46:40.930639] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-18T19:46:40.932297] [DEBUG] [LOCAL ] JBGS: Trimmed 58730 records to 42727 (keeping 200 days of data) [2025-09-18T19:46:41.202932] [DEBUG] [LOCAL ] JBGS: Primary data saved (42727 records). [2025-09-18T19:46:41.203086] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-18T19:46:41.203176] [INFO ] [MAIN ] Update Progress: 1141/2372 symbols completed. JBGS took 20.3s. Estimated remaining: 2h 59m 46s. Rate: 6.8 symbols/min [2025-09-18T19:46:41.324698] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-18T19:46:41.391425] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:46:41.391792] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-18T19:46:41.391917] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-18T19:46:41.392143] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-18T19:46:41.392285] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-18T19:46:41.392439] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-18T19:46:41.392533] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-18T19:46:41.773211] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-18T19:46:41.806624] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:46:41.841688] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-18T19:46:42.119594] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-11. [2025-09-18T19:46:42.311235] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:46:42.311580] [WARN ] [REMOTE ] JBS: No data returned for month 2024-11 [2025-09-18T19:46:42.529857] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-18T19:46:42.919546] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-18T19:46:43.719579] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-18T19:46:44.519583] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-18T19:46:44.749615] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-18T19:46:44.833899] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-18T19:46:45.319551] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-18T19:46:45.754166] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-18T19:46:46.119534] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-18T19:46:46.160880] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-18T19:46:46.919551] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-18T19:46:47.121118] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:46:47.121447] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-18T19:46:47.597791] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-18T19:46:47.719557] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-18T19:46:48.519530] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-09-18T19:46:48.882754] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:46:48.883081] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-09-18T19:46:48.903150] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-18T19:46:48.908713] [INFO ] [REMOTE ] JBI: Full fetch complete (64643 records). [2025-09-18T19:46:48.908835] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-18T19:46:49.304380] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-18T19:46:49.304465] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-18T19:46:49.305310] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-18T19:46:49.305375] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-18T19:46:49.306664] [DEBUG] [LOCAL ] JBI: Trimmed 64643 records to 44548 (keeping 200 days of data) [2025-09-18T19:46:49.353134] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-18T19:46:49.565630] [DEBUG] [LOCAL ] JBI: Primary data saved (44548 records). [2025-09-18T19:46:49.565824] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-18T19:46:49.565930] [INFO ] [MAIN ] Update Progress: 1142/2372 symbols completed. JBI took 27.3s. Estimated remaining: 2h 59m 37s. Rate: 6.8 symbols/min [2025-09-18T19:46:49.736449] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:46:49.736604] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-09-18T19:46:49.736662] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-09-18T19:46:49.736808] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-18T19:46:49.736853] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-18T19:46:49.736938] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-18T19:46:49.737000] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-18T19:46:50.089606] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:46:50.119514] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-11. [2025-09-18T19:46:50.337274] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:46:50.337524] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-11 [2025-09-18T19:46:50.919574] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-02. [2025-09-18T19:46:51.072778] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-18T19:46:51.161261] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:46:51.161595] [WARN ] [REMOTE ] JBS: No data returned for month 2025-02 [2025-09-18T19:46:51.719556] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-18T19:46:52.519586] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-03. [2025-09-18T19:46:52.564600] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-18T19:46:52.755155] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:46:52.755516] [WARN ] [REMOTE ] JBS: No data returned for month 2025-03 [2025-09-18T19:46:53.319572] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-18T19:46:54.119605] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-18T19:46:54.577681] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-18T19:46:54.919571] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-04. [2025-09-18T19:46:55.143619] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:46:55.144120] [WARN ] [REMOTE ] JBS: No data returned for month 2025-04 [2025-09-18T19:46:55.658749] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-18T19:46:55.719565] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-18T19:46:56.519582] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-05. [2025-09-18T19:46:56.754707] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:46:56.755049] [WARN ] [REMOTE ] JBS: No data returned for month 2025-05 [2025-09-18T19:46:57.242510] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-18T19:46:57.319595] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-18T19:46:57.556698] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:46:57.557032] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-18T19:46:58.119582] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-09-18T19:46:58.919601] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-06. [2025-09-18T19:46:59.157910] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-18T19:46:59.719627] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-18T19:46:59.751484] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-18T19:47:00.519566] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-18T19:47:00.829613] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-18T19:47:01.319568] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-18T19:47:02.059141] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-18T19:47:02.065787] [INFO ] [REMOTE ] JBL: Full fetch complete (69669 records). [2025-09-18T19:47:02.065908] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-18T19:47:02.130737] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-07. [2025-09-18T19:47:02.471587] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-18T19:47:02.471754] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-18T19:47:02.485049] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-18T19:47:02.485835] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-18T19:47:02.486485] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-18T19:47:02.491840] [INFO ] [REMOTE ] JBND: Full fetch complete (32788 records). [2025-09-18T19:47:02.492189] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-18T19:47:02.575759] [DEBUG] [LOCAL ] JBL: Trimmed 69669 records to 48738 (keeping 200 days of data) [2025-09-18T19:47:02.923834] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-09-18T19:47:03.055954] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-09-18T19:47:03.056586] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-09-18T19:47:03.061957] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-09-18T19:47:03.064805] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-09-18T19:47:03.072534] [DEBUG] [LOCAL ] JBND: Trimmed 32788 records to 25327 (keeping 200 days of data) [2025-09-18T19:47:03.426174] [DEBUG] [LOCAL ] JBL: Primary data saved (48738 records). [2025-09-18T19:47:03.426906] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-18T19:47:03.427304] [INFO ] [MAIN ] Update Progress: 1143/2372 symbols completed. JBL took 33.6s. Estimated remaining: 2h 59m 34s. Rate: 6.8 symbols/min [2025-09-18T19:47:03.434298] [DEBUG] [LOCAL ] JBND: Primary data saved (25327 records). [2025-09-18T19:47:03.440737] [INFO ] [MAIN ] JBND: Full history saved. [2025-09-18T19:47:03.492714] [INFO ] [MAIN ] Update Progress: 1144/2372 symbols completed. JBND took 32.2s. Estimated remaining: 2h 59m 16s. Rate: 6.9 symbols/min [2025-09-18T19:47:03.789396] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:47:03.813389] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:47:03.823694] [DEBUG] [LOCAL ] JCE: Loaded 6333 existing records from primary storage. [2025-09-18T19:47:03.823859] [INFO ] [MAIN ] JCE: Loaded 6333 existing records. [2025-09-18T19:47:04.076389] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:47:04.080906] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-18T19:47:04.081481] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-18T19:47:04.083765] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-18T19:47:04.095681] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-18T19:47:04.096132] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-18T19:47:04.101941] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-08. [2025-09-18T19:47:04.199086] [DEBUG] [LOCAL ] JCI: Loaded 53550 existing records from primary storage. [2025-09-18T19:47:04.211077] [INFO ] [MAIN ] JCI: Loaded 53550 existing records. [2025-09-18T19:47:04.665589] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:47:04.698973] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-18T19:47:04.742678] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:47:04.743275] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-11. [2025-09-18T19:47:04.742778] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-18T19:47:04.750760] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-09-18T19:47:04.750931] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-18T19:47:04.803031] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-18T19:47:05.167849] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:47:05.278923] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-18T19:47:05.319507] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-09-18T19:47:05.735441] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-18T19:47:05.753954] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-18T19:47:06.119568] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-09-18T19:47:06.919559] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-09. [2025-09-18T19:47:07.235120] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-18T19:47:07.719577] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-09-18T19:47:08.519582] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-11. [2025-09-18T19:47:08.843469] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-18T19:47:08.851627] [INFO ] [REMOTE ] JBS: Full fetch complete (25214 records). [2025-09-18T19:47:08.851913] [DEBUG] [VALIDATOR ] JBS: Validating primary data. [2025-09-18T19:47:09.052041] [WARN ] [VALIDATOR ] JBS: Validation failed - insufficient historical data. Have 66 unique days, need 200 days [2025-09-18T19:47:09.052519] [FATAL] [MAIN ] JBS: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:47:09.052840] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:47:09.053024] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-18T19:47:09.053230] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-18T19:47:09.053348] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-18T19:47:09.053506] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-18T19:47:09.053704] [INFO ] [MAIN ] Update Progress: 1145/2372 symbols completed. JBS took 27.9s. Estimated remaining: 2h 59m 4s. Rate: 6.9 symbols/min [2025-09-18T19:47:09.247996] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:47:09.279039] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-18T19:47:09.319544] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-09-18T19:47:09.335811] [DEBUG] [LOCAL ] JEF: Loaded 50005 existing records from primary storage. [2025-09-18T19:47:09.335953] [INFO ] [MAIN ] JEF: Loaded 50005 existing records. [2025-09-18T19:47:09.525846] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:47:09.526150] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-18T19:47:09.526200] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-18T19:47:09.527719] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-09-18T19:47:09.527780] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-18T19:47:09.885122] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:47:10.079768] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-18T19:47:10.119511] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-09-18T19:47:10.458129] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-18T19:47:10.919550] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-09-18T19:47:11.719524] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-09-18T19:47:11.842368] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-18T19:47:11.873112] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-18T19:47:12.265564] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-18T19:47:12.519576] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-11. [2025-09-18T19:47:13.319582] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-09-18T19:47:14.119546] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-09-18T19:47:14.284901] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-18T19:47:14.374308] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-18T19:47:14.919586] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-18T19:47:15.432918] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-18T19:47:15.719531] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-18T19:47:15.785443] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-18T19:47:16.078684] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-18T19:47:16.519579] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-18T19:47:17.270595] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-18T19:47:17.319521] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-18T19:47:17.803525] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-18T19:47:18.119553] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-09-18T19:47:18.919558] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-18T19:47:19.605322] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-18T19:47:19.646902] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-18T19:47:19.719560] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-09-18T19:47:20.519549] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-09-18T19:47:20.763572] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-18T19:47:21.319576] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-18T19:47:21.958456] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-18T19:47:22.119544] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-09-18T19:47:22.270512] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-18T19:47:22.919543] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-18T19:47:23.416926] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-18T19:47:23.421737] [INFO ] [REMOTE ] JBTM: Full fetch complete (41041 records). [2025-09-18T19:47:23.421866] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-09-18T19:47:23.613775] [WARN ] [VALIDATOR ] JBTM: Validation failed - insufficient historical data. Have 177 unique days, need 200 days [2025-09-18T19:47:23.614310] [FATAL] [MAIN ] JBTM: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:47:23.614382] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:47:23.614473] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-18T19:47:23.614580] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-18T19:47:23.614636] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-18T19:47:23.614725] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-09-18T19:47:23.614812] [INFO ] [MAIN ] Update Progress: 1146/2372 symbols completed. JBTM took 34.0s. Estimated remaining: 2h 59m 1s. Rate: 6.8 symbols/min [2025-09-18T19:47:23.724620] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-18T19:47:23.840704] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:47:23.890278] [DEBUG] [LOCAL ] JELD: Loaded 46226 existing records from primary storage. [2025-09-18T19:47:23.890453] [INFO ] [MAIN ] JELD: Loaded 46226 existing records. [2025-09-18T19:47:24.088918] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:47:24.089206] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-18T19:47:24.089266] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-18T19:47:24.090618] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-09-18T19:47:24.090705] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-18T19:47:24.491774] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:47:24.519514] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-11. [2025-09-18T19:47:24.596508] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-18T19:47:25.275388] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-18T19:47:25.319518] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-18T19:47:25.630018] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-18T19:47:26.119549] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-09-18T19:47:26.909691] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T19:47:26.920698] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-18T19:47:27.101595] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-18T19:47:27.719544] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-18T19:47:28.380606] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T19:47:28.519596] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-18T19:47:29.027028] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-18T19:47:29.319554] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-18T19:47:29.625206] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-18T19:47:29.871929] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-18T19:47:29.874025] [INFO ] [REMOTE ] JCE: Full fetch complete (8958 records). [2025-09-18T19:47:29.874102] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-18T19:47:30.124730] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-18T19:47:30.265954] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-18T19:47:30.266043] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-18T19:47:30.266316] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-18T19:47:30.266394] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-18T19:47:30.267410] [DEBUG] [LOCAL ] JCE: Trimmed 8958 records to 6445 (keeping 200 days of data) [2025-09-18T19:47:30.306514] [DEBUG] [LOCAL ] JCE: Primary data saved (6445 records). [2025-09-18T19:47:30.306602] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-18T19:47:30.306743] [INFO ] [MAIN ] Update Progress: 1147/2372 symbols completed. JCE took 26.9s. Estimated remaining: 2h 58m 50s. Rate: 6.8 symbols/min [2025-09-18T19:47:30.474745] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:47:30.488703] [DEBUG] [LOCAL ] JEQ: Loaded 8997 existing records from primary storage. [2025-09-18T19:47:30.488822] [INFO ] [MAIN ] JEQ: Loaded 8997 existing records. [2025-09-18T19:47:30.664143] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:47:30.664373] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-18T19:47:30.664421] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-18T19:47:30.664826] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-18T19:47:30.664885] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-18T19:47:30.924780] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-18T19:47:31.025254] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:47:31.719560] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-09-18T19:47:32.009200] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-18T19:47:32.412182] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T19:47:32.519585] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-11. [2025-09-18T19:47:32.881347] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-11 (0.36 seconds). [2025-09-18T19:47:32.923157] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T19:47:33.319605] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-18T19:47:34.119545] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-09-18T19:47:34.666055] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-18T19:47:34.919531] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-09-18T19:47:35.006378] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-18T19:47:35.381349] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-18T19:47:35.719550] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-18T19:47:36.282199] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-18T19:47:36.519548] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-18T19:47:37.220545] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-18T19:47:37.319556] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-18T19:47:38.029932] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-18T19:47:38.119541] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-18T19:47:38.664089] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-18T19:47:38.919537] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-18T19:47:39.719541] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-18T19:47:40.519549] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-18T19:47:40.735340] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-18T19:47:41.319521] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-18T19:47:41.375220] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-18T19:47:41.603403] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-18T19:47:41.740937] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-18T19:47:42.119556] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-18T19:47:42.919571] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-18T19:47:43.566466] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-18T19:47:43.602158] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-18T19:47:43.719554] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-18T19:47:44.519599] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-18T19:47:45.242211] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-18T19:47:45.319514] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-18T19:47:45.373128] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-18T19:47:46.032687] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-18T19:47:46.035719] [INFO ] [REMOTE ] JEQ: Full fetch complete (11279 records). [2025-09-18T19:47:46.035812] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-18T19:47:46.124703] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-18T19:47:46.423804] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-18T19:47:46.423955] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-18T19:47:46.424354] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-18T19:47:46.424448] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-18T19:47:46.425331] [DEBUG] [LOCAL ] JEQ: Trimmed 11279 records to 9046 (keeping 200 days of data) [2025-09-18T19:47:46.482927] [DEBUG] [LOCAL ] JEQ: Primary data saved (9046 records). [2025-09-18T19:47:46.483099] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-18T19:47:46.483370] [INFO ] [MAIN ] Update Progress: 1148/2372 symbols completed. JEQ took 16.2s. Estimated remaining: 2h 58m 49s. Rate: 6.8 symbols/min [2025-09-18T19:47:46.661187] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:47:46.706001] [DEBUG] [LOCAL ] JFR: Loaded 30653 existing records from primary storage. [2025-09-18T19:47:46.706216] [INFO ] [MAIN ] JFR: Loaded 30653 existing records. [2025-09-18T19:47:46.887591] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:47:46.887855] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-18T19:47:46.887915] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-18T19:47:46.888781] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-09-18T19:47:46.888851] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-18T19:47:46.924742] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-18T19:47:47.264728] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:47:47.541743] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-18T19:47:47.719555] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-18T19:47:48.519594] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-18T19:47:48.704013] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-18T19:47:48.953097] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-18T19:47:49.319568] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-11. [2025-09-18T19:47:49.916306] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-18T19:47:49.927208] [INFO ] [REMOTE ] JCI: Full fetch complete (77238 records). [2025-09-18T19:47:49.927387] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-18T19:47:50.124768] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-18T19:47:50.331124] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-09-18T19:47:50.331321] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-09-18T19:47:50.332355] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-09-18T19:47:50.332456] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-09-18T19:47:50.352583] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-18T19:47:50.359207] [DEBUG] [LOCAL ] JCI: Trimmed 77238 records to 53940 (keeping 200 days of data) [2025-09-18T19:47:50.728421] [DEBUG] [LOCAL ] JCI: Primary data saved (53940 records). [2025-09-18T19:47:50.728763] [INFO ] [MAIN ] JCI: Full history saved. [2025-09-18T19:47:50.728888] [INFO ] [MAIN ] Update Progress: 1149/2372 symbols completed. JCI took 47.2s. Estimated remaining: 2h 58m 36s. Rate: 6.8 symbols/min [2025-09-18T19:47:50.910600] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:47:50.919570] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-18T19:47:50.927462] [DEBUG] [LOCAL ] JGH: Loaded 10962 existing records from primary storage. [2025-09-18T19:47:50.927615] [INFO ] [MAIN ] JGH: Loaded 10962 existing records. [2025-09-18T19:47:51.160794] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:47:51.161171] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-18T19:47:51.161234] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-18T19:47:51.162882] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-18T19:47:51.162972] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-18T19:47:51.742368] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-09-18T19:47:51.764745] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:47:51.861004] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-18T19:47:52.303684] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-18T19:47:52.519552] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-11. [2025-09-18T19:47:52.856786] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T19:47:53.159717] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-18T19:47:53.319553] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-18T19:47:54.119604] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-18T19:47:54.919549] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-09-18T19:47:55.106934] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-18T19:47:55.114542] [INFO ] [REMOTE ] JEF: Full fetch complete (72614 records). [2025-09-18T19:47:55.114773] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-18T19:47:55.484919] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-18T19:47:55.542634] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-09-18T19:47:55.542776] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-09-18T19:47:55.543755] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-09-18T19:47:55.543866] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-09-18T19:47:55.570207] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-18T19:47:55.570334] [DEBUG] [LOCAL ] JEF: Trimmed 72614 records to 50392 (keeping 200 days of data) [2025-09-18T19:47:55.721689] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-18T19:47:55.907698] [DEBUG] [LOCAL ] JEF: Primary data saved (50392 records). [2025-09-18T19:47:55.907846] [INFO ] [MAIN ] JEF: Full history saved. [2025-09-18T19:47:55.907995] [INFO ] [MAIN ] Update Progress: 1150/2372 symbols completed. JEF took 46.9s. Estimated remaining: 2h 58m 23s. Rate: 6.9 symbols/min [2025-09-18T19:47:56.085630] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:47:56.133981] [DEBUG] [LOCAL ] JHG: Loaded 48220 existing records from primary storage. [2025-09-18T19:47:56.134166] [INFO ] [MAIN ] JHG: Loaded 48220 existing records. [2025-09-18T19:47:56.318578] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:47:56.320160] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-18T19:47:56.320220] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-18T19:47:56.321902] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-18T19:47:56.321966] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-18T19:47:56.524699] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-09-18T19:47:56.685997] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:47:57.285517] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-18T19:47:57.319541] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-18T19:47:57.382016] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-18T19:47:57.838940] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-18T19:47:58.119580] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-18T19:47:58.919545] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-11. [2025-09-18T19:47:59.503340] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-18T19:47:59.719579] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-18T19:48:00.326250] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-18T19:48:00.486430] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-18T19:48:00.519521] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-18T19:48:01.319556] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-09-18T19:48:01.544073] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-18T19:48:02.119589] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-09-18T19:48:02.919542] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-18T19:48:03.719582] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-18T19:48:04.456581] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (3.14 seconds). [2025-09-18T19:48:04.519494] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-09-18T19:48:04.983258] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-18T19:48:05.012077] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (2.89 seconds). [2025-09-18T19:48:05.060008] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-18T19:48:05.066209] [INFO ] [REMOTE ] JELD: Full fetch complete (63147 records). [2025-09-18T19:48:05.066310] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-18T19:48:05.324778] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-18T19:48:05.459173] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-09-18T19:48:05.459253] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-09-18T19:48:05.460095] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-09-18T19:48:05.460159] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-09-18T19:48:05.461779] [DEBUG] [LOCAL ] JELD: Trimmed 63147 records to 46566 (keeping 200 days of data) [2025-09-18T19:48:05.745446] [DEBUG] [LOCAL ] JELD: Primary data saved (46566 records). [2025-09-18T19:48:05.745596] [INFO ] [MAIN ] JELD: Full history saved. [2025-09-18T19:48:05.745749] [INFO ] [MAIN ] Update Progress: 1151/2372 symbols completed. JELD took 42.1s. Estimated remaining: 2h 58m 16s. Rate: 6.8 symbols/min [2025-09-18T19:48:05.917361] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:48:05.922712] [DEBUG] [LOCAL ] JHI: Loaded 3756 existing records from primary storage. [2025-09-18T19:48:05.922794] [INFO ] [MAIN ] JHI: Loaded 3756 existing records. [2025-09-18T19:48:06.106158] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:48:06.106528] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-18T19:48:06.106602] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-18T19:48:06.107136] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-18T19:48:06.107241] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-18T19:48:06.127890] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-18T19:48:06.316920] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-18T19:48:06.513825] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:48:06.536726] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-18T19:48:06.718402] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-18T19:48:06.919532] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-11. [2025-09-18T19:48:07.382163] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-18T19:48:07.719545] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-18T19:48:08.519555] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-18T19:48:09.305232] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-18T19:48:09.319497] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-18T19:48:09.434921] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-18T19:48:10.119567] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-09-18T19:48:10.689434] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-18T19:48:10.858556] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-18T19:48:10.919554] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-18T19:48:11.719540] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-09-18T19:48:12.146261] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-18T19:48:12.519542] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-18T19:48:12.708449] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-18T19:48:12.934052] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-18T19:48:13.319547] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-18T19:48:14.119552] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-18T19:48:14.919556] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-18T19:48:15.719547] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-18T19:48:16.277351] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (2.96 seconds). [2025-09-18T19:48:16.333668] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-18T19:48:16.362821] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-18T19:48:16.376314] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-18T19:48:16.519583] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-18T19:48:17.319570] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-18T19:48:17.380918] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-18T19:48:18.119581] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-18T19:48:18.341759] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-18T19:48:18.918672] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-18T19:48:18.919674] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-18T19:48:18.922699] [INFO ] [REMOTE ] JGH: Full fetch complete (14718 records). [2025-09-18T19:48:18.922777] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-18T19:48:19.299059] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-18T19:48:19.299148] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-18T19:48:19.299482] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-18T19:48:19.299559] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-18T19:48:19.300241] [DEBUG] [LOCAL ] JGH: Trimmed 14718 records to 11091 (keeping 200 days of data) [2025-09-18T19:48:19.369895] [DEBUG] [LOCAL ] JGH: Primary data saved (11091 records). [2025-09-18T19:48:19.370053] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-18T19:48:19.370222] [INFO ] [MAIN ] Update Progress: 1152/2372 symbols completed. JGH took 28.6s. Estimated remaining: 2h 58m 12s. Rate: 6.8 symbols/min [2025-09-18T19:48:19.415457] [DEBUG] [REMOTE ] JFR: Error fetching primary data for 2025-06: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [2025-09-18T19:48:19.437410] [WARN ] [REMOTE ] JFR: No data returned for month 2025-06 [2025-09-18T19:48:19.545014] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:48:19.550062] [DEBUG] [LOCAL ] JHS: Loaded 2928 existing records from primary storage. [2025-09-18T19:48:19.550151] [INFO ] [MAIN ] JHS: Loaded 2928 existing records. [2025-09-18T19:48:19.732134] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-18T19:48:19.738181] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:48:19.739205] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-18T19:48:19.739265] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-18T19:48:19.739614] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-18T19:48:19.739710] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-18T19:48:20.108853] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:48:20.398689] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-18T19:48:20.519559] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-18T19:48:21.319560] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-11. [2025-09-18T19:48:21.778147] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-18T19:48:22.061142] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T19:48:22.119554] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-18T19:48:22.919545] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-09-18T19:48:23.443018] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-18T19:48:23.543275] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-18T19:48:23.719622] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-18T19:48:24.519555] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-09-18T19:48:25.043521] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-18T19:48:25.319546] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-18T19:48:25.705343] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-18T19:48:25.949295] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-18T19:48:26.119544] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-18T19:48:26.919546] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-18T19:48:27.719565] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-18T19:48:28.119628] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-18T19:48:28.182454] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-18T19:48:28.250586] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-18T19:48:28.519542] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-18T19:48:29.319556] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-18T19:48:29.711026] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-18T19:48:29.724893] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-18T19:48:29.729339] [INFO ] [REMOTE ] JFR: Full fetch complete (43642 records). [2025-09-18T19:48:29.729422] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-18T19:48:29.924771] [WARN ] [VALIDATOR ] JFR: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-18T19:48:29.925491] [FATAL] [MAIN ] JFR: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:48:29.925621] [WARN ] [MAIN ] JFR: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:48:29.925745] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-18T19:48:29.925883] [DEBUG] [LOCAL ] JFR: No primary data file found to delete. [2025-09-18T19:48:29.925968] [INFO ] [LOCAL ] JFR: Starting deletion of derivative data. [2025-09-18T19:48:29.926414] [DEBUG] [LOCAL ] JFR: Deleted derivative data file. [2025-09-18T19:48:29.926532] [INFO ] [MAIN ] Update Progress: 1153/2372 symbols completed. JFR took 43.4s. Estimated remaining: 2h 58m 5s. Rate: 6.8 symbols/min [2025-09-18T19:48:30.098023] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:48:30.130023] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-18T19:48:30.153276] [DEBUG] [LOCAL ] JHX: Loaded 48946 existing records from primary storage. [2025-09-18T19:48:30.153427] [INFO ] [MAIN ] JHX: Loaded 48946 existing records. [2025-09-18T19:48:30.333620] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:48:30.333958] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-18T19:48:30.334040] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-18T19:48:30.335149] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-18T19:48:30.335212] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-18T19:48:30.664489] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-18T19:48:30.744332] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:48:30.919548] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-11. [2025-09-18T19:48:31.585025] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-18T19:48:31.719543] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-09-18T19:48:32.519557] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-18T19:48:32.651179] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-18T19:48:32.963933] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-18T19:48:33.319540] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-18T19:48:33.781472] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-18T19:48:34.119549] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-18T19:48:34.919549] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-18T19:48:35.719595] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-09-18T19:48:35.767478] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-18T19:48:35.787097] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-18T19:48:35.793522] [INFO ] [REMOTE ] JHG: Full fetch complete (68454 records). [2025-09-18T19:48:35.793634] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-18T19:48:36.184232] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-18T19:48:36.184323] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-18T19:48:36.185215] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-18T19:48:36.185278] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-18T19:48:36.186687] [DEBUG] [LOCAL ] JHG: Trimmed 68454 records to 48523 (keeping 200 days of data) [2025-09-18T19:48:36.487625] [DEBUG] [LOCAL ] JHG: Primary data saved (48523 records). [2025-09-18T19:48:36.487990] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-18T19:48:36.488171] [INFO ] [MAIN ] Update Progress: 1154/2372 symbols completed. JHG took 40.6s. Estimated remaining: 2h 57m 54s. Rate: 6.8 symbols/min [2025-09-18T19:48:36.520934] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-18T19:48:36.611805] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-18T19:48:36.691730] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:48:36.711410] [DEBUG] [LOCAL ] JILL: Loaded 16690 existing records from primary storage. [2025-09-18T19:48:36.711578] [INFO ] [MAIN ] JILL: Loaded 16690 existing records. [2025-09-18T19:48:36.891038] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:48:36.891273] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-18T19:48:36.891320] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-18T19:48:36.891854] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-18T19:48:36.891915] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-18T19:48:37.169053] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-18T19:48:37.257952] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:48:37.319504] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-18T19:48:37.875677] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-18T19:48:37.877111] [INFO ] [REMOTE ] JHI: Full fetch complete (5316 records). [2025-09-18T19:48:37.877181] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-18T19:48:38.119681] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-18T19:48:38.249999] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-18T19:48:38.250081] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-18T19:48:38.250244] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-18T19:48:38.250285] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-18T19:48:38.250694] [DEBUG] [LOCAL ] JHI: Trimmed 5316 records to 3809 (keeping 200 days of data) [2025-09-18T19:48:38.274062] [DEBUG] [LOCAL ] JHI: Primary data saved (3809 records). [2025-09-18T19:48:38.274137] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-18T19:48:38.274211] [INFO ] [MAIN ] Update Progress: 1155/2372 symbols completed. JHI took 32.5s. Estimated remaining: 2h 57m 38s. Rate: 6.9 symbols/min [2025-09-18T19:48:38.464420] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:48:38.506471] [DEBUG] [LOCAL ] JKS: Loaded 40240 existing records from primary storage. [2025-09-18T19:48:38.506618] [INFO ] [MAIN ] JKS: Loaded 40240 existing records. [2025-09-18T19:48:38.688630] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:48:38.688917] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-18T19:48:38.688966] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-18T19:48:38.689939] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-18T19:48:38.690002] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-18T19:48:38.920151] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-18T19:48:38.993488] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-18T19:48:39.076332] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:48:39.551697] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-18T19:48:39.719564] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-18T19:48:40.201561] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-18T19:48:40.519564] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-11. [2025-09-18T19:48:41.319548] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-18T19:48:42.119571] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-18T19:48:42.257786] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-18T19:48:42.328160] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-18T19:48:42.526165] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-18T19:48:42.919585] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-18T19:48:43.719728] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-09-18T19:48:44.519622] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-18T19:48:44.732349] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-18T19:48:44.961289] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-18T19:48:45.109502] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-18T19:48:45.110992] [INFO ] [REMOTE ] JHS: Full fetch complete (4477 records). [2025-09-18T19:48:45.111077] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-18T19:48:45.324619] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-09-18T19:48:45.483394] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-18T19:48:45.483514] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-18T19:48:45.483710] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-18T19:48:45.483773] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-18T19:48:45.484248] [DEBUG] [LOCAL ] JHS: Trimmed 4477 records to 2939 (keeping 200 days of data) [2025-09-18T19:48:45.503763] [DEBUG] [LOCAL ] JHS: Primary data saved (2939 records). [2025-09-18T19:48:45.503901] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-18T19:48:45.503993] [INFO ] [MAIN ] Update Progress: 1156/2372 symbols completed. JHS took 26.1s. Estimated remaining: 2h 57m 27s. Rate: 6.9 symbols/min [2025-09-18T19:48:45.672902] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:48:45.707452] [DEBUG] [LOCAL ] JLL: Loaded 32337 existing records from primary storage. [2025-09-18T19:48:45.707605] [INFO ] [MAIN ] JLL: Loaded 32337 existing records. [2025-09-18T19:48:45.884121] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:48:45.884405] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-18T19:48:45.884453] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-18T19:48:45.885202] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-18T19:48:45.885261] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-18T19:48:46.124625] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-11. [2025-09-18T19:48:46.249999] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:48:46.719734] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-18T19:48:46.919564] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-18T19:48:47.078410] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-18T19:48:47.719555] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-09-18T19:48:48.135419] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T19:48:48.519596] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-11. [2025-09-18T19:48:48.765272] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T19:48:49.319539] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-18T19:48:49.491190] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-18T19:48:50.119554] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-18T19:48:50.853581] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T19:48:50.919538] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-18T19:48:51.299710] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-18T19:48:51.719557] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-18T19:48:52.210039] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-18T19:48:52.519564] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-09-18T19:48:53.135700] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T19:48:53.319597] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-09-18T19:48:53.391164] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-18T19:48:54.119556] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-18T19:48:54.369730] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T19:48:54.613442] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-18T19:48:54.919575] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-09-18T19:48:55.719567] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-18T19:48:55.967483] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-18T19:48:56.519548] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-18T19:48:56.818926] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-18T19:48:57.319567] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-18T19:48:57.530027] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T19:48:58.119558] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-09-18T19:48:58.775667] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-18T19:48:58.919600] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-18T19:48:59.702538] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-18T19:48:59.719487] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-09-18T19:48:59.882136] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-18T19:49:00.519555] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-18T19:49:01.136122] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-18T19:49:01.319546] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-18T19:49:02.023144] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-18T19:49:02.119563] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-18T19:49:02.173766] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-18T19:49:02.919570] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-18T19:49:03.719517] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-18T19:49:03.761511] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-18T19:49:03.768936] [INFO ] [REMOTE ] JHX: Full fetch complete (55742 records). [2025-09-18T19:49:03.769063] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-18T19:49:04.198156] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-18T19:49:04.198266] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-18T19:49:04.199218] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-18T19:49:04.199284] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-18T19:49:04.200675] [DEBUG] [LOCAL ] JHX: Trimmed 55742 records to 49336 (keeping 200 days of data) [2025-09-18T19:49:04.350751] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T19:49:04.529107] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-09-18T19:49:04.548057] [DEBUG] [LOCAL ] JHX: Primary data saved (49336 records). [2025-09-18T19:49:04.548168] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-18T19:49:04.549589] [INFO ] [MAIN ] Update Progress: 1157/2372 symbols completed. JHX took 34.6s. Estimated remaining: 2h 57m 30s. Rate: 6.8 symbols/min [2025-09-18T19:49:04.586026] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-18T19:49:05.319548] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-18T19:49:05.694744] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-18T19:49:06.119555] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-09-18T19:49:06.233385] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-18T19:49:06.919842] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-18T19:49:07.442424] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-18T19:49:07.448266] [INFO ] [REMOTE ] JKS: Full fetch complete (59650 records). [2025-09-18T19:49:07.448411] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-09-18T19:49:07.732564] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-18T19:49:07.872396] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-09-18T19:49:07.873428] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-18T19:49:07.873519] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-09-18T19:49:07.878943] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-09-18T19:49:07.879298] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-09-18T19:49:07.880585] [DEBUG] [LOCAL ] JKS: Trimmed 59650 records to 40528 (keeping 200 days of data) [2025-09-18T19:49:08.124268] [DEBUG] [LOCAL ] JKS: Primary data saved (40528 records). [2025-09-18T19:49:08.124402] [INFO ] [MAIN ] JKS: Full history saved. [2025-09-18T19:49:08.124482] [INFO ] [MAIN ] Update Progress: 1158/2372 symbols completed. JKS took 29.9s. Estimated remaining: 2h 57m 15s. Rate: 6.8 symbols/min [2025-09-18T19:49:08.519581] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-18T19:49:08.976663] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-18T19:49:09.116193] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-18T19:49:09.319553] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-18T19:49:10.119585] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-18T19:49:10.236726] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-18T19:49:10.919557] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-18T19:49:11.361350] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T19:49:11.719575] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-18T19:49:11.904855] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-18T19:49:11.907798] [INFO ] [REMOTE ] JILL: Full fetch complete (23024 records). [2025-09-18T19:49:11.907901] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-18T19:49:12.295728] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-18T19:49:12.295859] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-18T19:49:12.296426] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-18T19:49:12.296471] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-18T19:49:12.297132] [DEBUG] [LOCAL ] JILL: Trimmed 23024 records to 16786 (keeping 200 days of data) [2025-09-18T19:49:12.401508] [DEBUG] [LOCAL ] JILL: Primary data saved (16786 records). [2025-09-18T19:49:12.401699] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-18T19:49:12.401806] [INFO ] [MAIN ] Update Progress: 1159/2372 symbols completed. JILL took 35.9s. Estimated remaining: 2h 57m 2s. Rate: 6.9 symbols/min [2025-09-18T19:49:12.851926] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T19:49:12.860075] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-18T19:49:14.299833] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-18T19:49:14.307995] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-18T19:49:15.710860] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-18T19:49:15.716810] [INFO ] [REMOTE ] JLL: Full fetch complete (44738 records). [2025-09-18T19:49:15.716960] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-18T19:49:16.139782] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-18T19:49:16.139869] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-18T19:49:16.140556] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-18T19:49:16.140599] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-18T19:49:16.141770] [DEBUG] [LOCAL ] JLL: Trimmed 44738 records to 32581 (keeping 200 days of data) [2025-09-18T19:49:16.335497] [DEBUG] [LOCAL ] JLL: Primary data saved (32581 records). [2025-09-18T19:49:16.335660] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-18T19:49:16.335765] [INFO ] [MAIN ] Update Progress: 1160/2372 symbols completed. JLL took 30.8s. Estimated remaining: 2h 56m 48s. Rate: 6.9 symbols/min [2025-09-18T19:49:17.036839] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:49:17.009606] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:49:17.055755] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:49:17.075218] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:49:17.076068] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-18T19:49:17.076121] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-18T19:49:17.078032] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-18T19:49:17.078107] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-18T19:49:17.078200] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-18T19:49:17.078314] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-18T19:49:17.112885] [DEBUG] [LOCAL ] JLS: Loaded 4110 existing records from primary storage. [2025-09-18T19:49:17.137476] [INFO ] [MAIN ] JLS: Loaded 4110 existing records. [2025-09-18T19:49:17.606130] [DEBUG] [LOCAL ] JMIA: Loaded 50432 existing records from primary storage. [2025-09-18T19:49:17.587971] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:49:17.615702] [INFO ] [MAIN ] JMIA: Loaded 50432 existing records. [2025-09-18T19:49:17.645511] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-18T19:49:17.676306] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-18T19:49:17.667341] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-09-18T19:49:17.712560] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-18T19:49:17.743451] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-09-18T19:49:17.769127] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-18T19:49:17.895097] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:49:17.920533] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-11. [2025-09-18T19:49:18.122090] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:49:18.127858] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-18T19:49:18.154017] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-18T19:49:18.257369] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:49:18.292248] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-09-18T19:49:18.299549] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-18T19:49:18.324372] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-18T19:49:18.354525] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-18T19:49:18.434809] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-18T19:49:18.457246] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-18T19:49:18.510504] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-18T19:49:18.553406] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-18T19:49:18.735266] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:49:18.757035] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-11. [2025-09-18T19:49:19.061145] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-18T19:49:19.079309] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-18T19:49:19.111476] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:49:19.123956] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-11. [2025-09-18T19:49:19.234324] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:49:19.234634] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-11. [2025-09-18T19:49:19.397699] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-18T19:49:19.399017] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-09-18T19:49:19.473560] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-18T19:49:19.719633] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-18T19:49:19.915915] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-18T19:49:20.134392] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-18T19:49:20.519617] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-09-18T19:49:20.888824] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-18T19:49:20.890330] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-18T19:49:21.118921] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-18T19:49:21.319533] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-09-18T19:49:22.119560] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-18T19:49:22.425869] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-18T19:49:22.919546] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-18T19:49:23.350999] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-18T19:49:23.640145] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-18T19:49:23.719552] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-18T19:49:24.177418] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-18T19:49:24.519547] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-09-18T19:49:25.319576] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-18T19:49:25.845040] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-18T19:49:26.119552] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-18T19:49:26.581869] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-18T19:49:26.617542] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-18T19:49:26.919546] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-18T19:49:27.719547] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-09-18T19:49:28.519550] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-18T19:49:29.019686] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-18T19:49:29.054275] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-18T19:49:29.184933] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-18T19:49:29.319526] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-09-18T19:49:30.119546] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-18T19:49:30.919547] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-18T19:49:31.066616] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-18T19:49:31.337365] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-18T19:49:31.719543] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-18T19:49:31.990461] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-18T19:49:32.081989] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-18T19:49:32.519546] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-18T19:49:33.045805] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-18T19:49:33.319559] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-18T19:49:34.119537] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-18T19:49:34.919570] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-18T19:49:35.109886] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-18T19:49:35.352301] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-18T19:49:35.719557] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-18T19:49:36.124798] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-18T19:49:36.125778] [INFO ] [REMOTE ] JMM: Full fetch complete (2274 records). [2025-09-18T19:49:36.125909] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-18T19:49:36.312433] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-18T19:49:36.312727] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:49:36.313065] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:49:36.313147] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-18T19:49:36.313216] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-18T19:49:36.313256] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-18T19:49:36.313312] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-18T19:49:36.325543] [INFO ] [MAIN ] Update Progress: 1161/2372 symbols completed. JMM took 20.0s. Estimated remaining: 2h 56m 51s. Rate: 6.8 symbols/min [2025-09-18T19:49:36.429976] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-18T19:49:36.537041] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:49:36.533614] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-18T19:49:36.595218] [DEBUG] [LOCAL ] JOBY: Loaded 53798 existing records from primary storage. [2025-09-18T19:49:36.595374] [INFO ] [MAIN ] JOBY: Loaded 53798 existing records. [2025-09-18T19:49:36.775784] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:49:36.776032] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-18T19:49:36.776089] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-18T19:49:36.777818] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-18T19:49:36.777881] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-18T19:49:37.134862] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:49:37.319535] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-11. [2025-09-18T19:49:38.089132] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-18T19:49:38.119512] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-18T19:49:38.689875] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-18T19:49:38.919555] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-18T19:49:39.506444] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-11 (2.19 seconds). [2025-09-18T19:49:39.719571] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-18T19:49:40.519574] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-09-18T19:49:41.229697] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-18T19:49:41.275934] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-18T19:49:41.319512] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-18T19:49:42.119552] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-18T19:49:42.904138] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-18T19:49:42.919500] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-09-18T19:49:43.083439] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-18T19:49:43.719601] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-18T19:49:43.987621] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-18T19:49:44.519532] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-18T19:49:45.207973] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-18T19:49:45.319556] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-18T19:49:45.795996] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-18T19:49:45.856091] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-18T19:49:46.119550] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-18T19:49:46.919564] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-18T19:49:47.368106] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-18T19:49:47.541352] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-18T19:49:47.719566] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-18T19:49:48.020434] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-18T19:49:48.519626] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-18T19:49:49.319564] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-18T19:49:49.726926] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-18T19:49:50.085330] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-18T19:49:50.119495] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-18T19:49:50.542702] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-18T19:49:50.550243] [INFO ] [REMOTE ] JNJ: Full fetch complete (77782 records). [2025-09-18T19:49:50.550408] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-18T19:49:50.924711] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-18T19:49:50.991836] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-18T19:49:50.991940] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-18T19:49:50.993297] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-18T19:49:50.993375] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-18T19:49:50.995048] [DEBUG] [LOCAL ] JNJ: Trimmed 77782 records to 54143 (keeping 200 days of data) [2025-09-18T19:49:51.362731] [DEBUG] [LOCAL ] JNJ: Primary data saved (54143 records). [2025-09-18T19:49:51.362887] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-18T19:49:51.363000] [INFO ] [MAIN ] Update Progress: 1162/2372 symbols completed. JNJ took 35.0s. Estimated remaining: 2h 56m 49s. Rate: 6.8 symbols/min [2025-09-18T19:49:51.562920] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:49:51.588872] [DEBUG] [LOCAL ] JOE: Loaded 24848 existing records from primary storage. [2025-09-18T19:49:51.589133] [INFO ] [MAIN ] JOE: Loaded 24848 existing records. [2025-09-18T19:49:51.625988] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-18T19:49:51.666213] [INFO ] [REMOTE ] JLS: Full fetch complete (5754 records). [2025-09-18T19:49:51.677491] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-18T19:49:51.721033] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-18T19:49:51.958086] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:49:51.985169] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-18T19:49:52.036885] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-18T19:49:52.064344] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-18T19:49:52.082620] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-18T19:49:52.321464] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-18T19:49:52.329621] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-18T19:49:52.330484] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-18T19:49:52.331917] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-18T19:49:52.393555] [DEBUG] [LOCAL ] JLS: Trimmed 5754 records to 4135 (keeping 200 days of data) [2025-09-18T19:49:52.565964] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:49:52.567205] [DEBUG] [LOCAL ] JLS: Primary data saved (4135 records). [2025-09-18T19:49:52.567878] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-18T19:49:52.567815] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-11. [2025-09-18T19:49:52.569073] [INFO ] [MAIN ] Update Progress: 1163/2372 symbols completed. JLS took 36.2s. Estimated remaining: 2h 56m 32s. Rate: 6.8 symbols/min [2025-09-18T19:49:52.753803] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:49:52.790240] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-18T19:49:52.804809] [DEBUG] [LOCAL ] JOF: Loaded 7194 existing records from primary storage. [2025-09-18T19:49:52.805197] [INFO ] [MAIN ] JOF: Loaded 7194 existing records. [2025-09-18T19:49:52.985882] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:49:52.986134] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-18T19:49:52.986184] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-18T19:49:52.986582] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-09-18T19:49:52.986678] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-18T19:49:53.326021] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-18T19:49:53.370890] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:49:53.390003] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-18T19:49:53.424065] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-18T19:49:54.119559] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-11. [2025-09-18T19:49:54.578334] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-18T19:49:54.919601] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-09-18T19:49:55.438114] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-18T19:49:55.719568] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-09-18T19:49:55.946525] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-18T19:49:56.206395] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-18T19:49:56.519625] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-18T19:49:57.319613] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-09-18T19:49:58.119606] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-18T19:49:58.235362] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-18T19:49:58.611918] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-18T19:49:58.669085] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-18T19:49:58.919605] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-09-18T19:49:59.719588] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-18T19:49:59.939962] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-18T19:50:00.457435] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-18T19:50:00.519560] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-18T19:50:01.135607] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-18T19:50:01.319604] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-18T19:50:01.942380] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-18T19:50:02.119586] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-18T19:50:02.919556] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-18T19:50:03.719579] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-18T19:50:04.519605] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-18T19:50:04.791513] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-09-18T19:50:04.833354] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-18T19:50:04.858313] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-18T19:50:04.868058] [INFO ] [REMOTE ] JMIA: Full fetch complete (73072 records). [2025-09-18T19:50:04.868203] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-18T19:50:05.025421] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-18T19:50:05.298116] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-09-18T19:50:05.298219] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-09-18T19:50:05.299200] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-09-18T19:50:05.299297] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-09-18T19:50:05.300926] [DEBUG] [LOCAL ] JMIA: Trimmed 73072 records to 50812 (keeping 200 days of data) [2025-09-18T19:50:05.362827] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-18T19:50:05.614208] [DEBUG] [LOCAL ] JMIA: Primary data saved (50812 records). [2025-09-18T19:50:05.614367] [INFO ] [MAIN ] JMIA: Full history saved. [2025-09-18T19:50:05.614514] [INFO ] [MAIN ] Update Progress: 1164/2372 symbols completed. JMIA took 49.3s. Estimated remaining: 2h 56m 28s. Rate: 6.8 symbols/min [2025-09-18T19:50:05.794375] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:50:05.833664] [DEBUG] [LOCAL ] JPC: Loaded 37319 existing records from primary storage. [2025-09-18T19:50:05.833813] [INFO ] [MAIN ] JPC: Loaded 37319 existing records. [2025-09-18T19:50:06.012280] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:50:06.012637] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-18T19:50:06.012765] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-18T19:50:06.013804] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-18T19:50:06.013953] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-18T19:50:06.124759] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-18T19:50:06.380086] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:50:06.588089] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T19:50:06.919595] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-11. [2025-09-18T19:50:07.719571] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-18T19:50:08.200340] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-18T19:50:08.372811] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-18T19:50:08.519555] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-18T19:50:08.690399] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-18T19:50:09.261484] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-18T19:50:09.319503] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-18T19:50:09.939830] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T19:50:09.942232] [INFO ] [REMOTE ] JOF: Full fetch complete (9447 records). [2025-09-18T19:50:09.942310] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-18T19:50:10.121280] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-18T19:50:10.312373] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-09-18T19:50:10.312456] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-09-18T19:50:10.312720] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-09-18T19:50:10.312792] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-09-18T19:50:10.313272] [DEBUG] [LOCAL ] JOF: Trimmed 9447 records to 7219 (keeping 200 days of data) [2025-09-18T19:50:10.360557] [DEBUG] [LOCAL ] JOF: Primary data saved (7219 records). [2025-09-18T19:50:10.360723] [INFO ] [MAIN ] JOF: Full history saved. [2025-09-18T19:50:10.360856] [INFO ] [MAIN ] Update Progress: 1165/2372 symbols completed. JOF took 17.8s. Estimated remaining: 2h 56m 15s. Rate: 6.8 symbols/min [2025-09-18T19:50:10.530921] [INFO ] [MAIN ] JPI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:50:10.539307] [DEBUG] [LOCAL ] JPI: Loaded 5451 existing records from primary storage. [2025-09-18T19:50:10.539427] [INFO ] [MAIN ] JPI: Loaded 5451 existing records. [2025-09-18T19:50:10.729006] [WARN ] [MAIN ] JPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:50:10.729620] [INFO ] [MAIN ] JPI: Wiping existing primary data before full refresh. [2025-09-18T19:50:10.729715] [INFO ] [LOCAL ] JPI: Starting deletion of primary data. [2025-09-18T19:50:10.730183] [DEBUG] [LOCAL ] JPI: Deleted primary data file. [2025-09-18T19:50:10.730245] [INFO ] [MAIN ] JPI: Starting full primary refresh. [2025-09-18T19:50:10.930382] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-09-18T19:50:11.101189] [INFO ] [REMOTE ] JPI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:50:11.573680] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T19:50:11.719572] [INFO ] [REMOTE ] JPI: Fetching primary data for 2024-11. [2025-09-18T19:50:12.143386] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-18T19:50:12.335051] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-18T19:50:12.519545] [INFO ] [REMOTE ] JPI: Fetching primary data for 2024-12. [2025-09-18T19:50:13.147661] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-18T19:50:13.319560] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-18T19:50:14.119547] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-09-18T19:50:14.919548] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-18T19:50:15.380063] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-18T19:50:15.649727] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-18T19:50:15.719512] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-18T19:50:15.761667] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-18T19:50:16.519550] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-18T19:50:17.319548] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-01. [2025-09-18T19:50:17.670759] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-18T19:50:17.923486] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-18T19:50:18.119556] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-18T19:50:18.252815] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-18T19:50:18.261719] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-09-18T19:50:18.261872] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-18T19:50:18.653616] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-18T19:50:18.653736] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-18T19:50:18.654697] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-18T19:50:18.654764] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-18T19:50:18.656325] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 54188 (keeping 200 days of data) [2025-09-18T19:50:18.944811] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-02. [2025-09-18T19:50:19.000148] [DEBUG] [LOCAL ] JOBY: Primary data saved (54188 records). [2025-09-18T19:50:19.000304] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-18T19:50:19.000450] [INFO ] [MAIN ] Update Progress: 1166/2372 symbols completed. JOBY took 42.7s. Estimated remaining: 2h 56m 6s. Rate: 6.8 symbols/min [2025-09-18T19:50:19.185215] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:50:19.245328] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-09-18T19:50:19.245505] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-09-18T19:50:19.430141] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:50:19.431594] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-18T19:50:19.431681] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-18T19:50:19.433765] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-18T19:50:19.433854] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-18T19:50:19.723172] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-18T19:50:19.746371] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-18T19:50:19.818700] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:50:19.842505] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-18T19:50:20.519510] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-11. [2025-09-18T19:50:20.917069] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-18T19:50:21.319547] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-18T19:50:22.119549] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-18T19:50:22.518898] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-18T19:50:22.649322] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-11 (2.13 seconds). [2025-09-18T19:50:22.919556] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-18T19:50:23.336083] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-18T19:50:23.719570] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-09-18T19:50:23.798285] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-18T19:50:24.519541] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-03. [2025-09-18T19:50:25.028804] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-18T19:50:25.319549] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-18T19:50:25.991683] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-18T19:50:26.081763] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-18T19:50:26.086051] [INFO ] [REMOTE ] JOE: Full fetch complete (36385 records). [2025-09-18T19:50:26.086190] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-18T19:50:26.124626] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-09-18T19:50:26.479820] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-18T19:50:26.479931] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-18T19:50:26.480563] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-18T19:50:26.480606] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-18T19:50:26.481821] [DEBUG] [LOCAL ] JOE: Trimmed 36385 records to 25031 (keeping 200 days of data) [2025-09-18T19:50:26.655566] [DEBUG] [LOCAL ] JOE: Primary data saved (25031 records). [2025-09-18T19:50:26.655737] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-18T19:50:26.655867] [INFO ] [MAIN ] Update Progress: 1167/2372 symbols completed. JOE took 35.3s. Estimated remaining: 2h 55m 56s. Rate: 6.8 symbols/min [2025-09-18T19:50:26.827724] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:50:26.866965] [DEBUG] [LOCAL ] JQC: Loaded 33859 existing records from primary storage. [2025-09-18T19:50:26.867104] [INFO ] [MAIN ] JQC: Loaded 33859 existing records. [2025-09-18T19:50:26.930717] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-04. [2025-09-18T19:50:27.054430] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:50:27.054749] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-18T19:50:27.054807] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-18T19:50:27.055966] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-18T19:50:27.056044] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-18T19:50:27.504482] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:50:27.708448] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-18T19:50:27.719494] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-05. [2025-09-18T19:50:28.354827] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-18T19:50:28.381125] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-18T19:50:28.519510] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-18T19:50:29.319545] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-18T19:50:29.835865] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T19:50:30.119542] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-06. [2025-09-18T19:50:30.576366] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-18T19:50:30.919545] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-18T19:50:31.607122] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-18T19:50:31.719537] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-18T19:50:31.981470] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-18T19:50:32.519542] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-11. [2025-09-18T19:50:33.319550] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-18T19:50:33.689603] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-18T19:50:33.917639] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-18T19:50:34.119556] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-18T19:50:34.513542] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-18T19:50:34.919537] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-18T19:50:35.719588] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-09-18T19:50:36.134725] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-18T19:50:36.292076] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-18T19:50:36.519587] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-18T19:50:37.013071] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-18T19:50:37.319601] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-07. [2025-09-18T19:50:37.737822] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-18T19:50:37.737967] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-18T19:50:37.745400] [INFO ] [REMOTE ] JPC: Full fetch complete (55785 records). [2025-09-18T19:50:37.745501] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-18T19:50:38.121544] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-09-18T19:50:38.136428] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-18T19:50:38.136501] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-18T19:50:38.137366] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-18T19:50:38.137459] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-18T19:50:38.138823] [DEBUG] [LOCAL ] JPC: Trimmed 55785 records to 37578 (keeping 200 days of data) [2025-09-18T19:50:38.361048] [DEBUG] [LOCAL ] JPC: Primary data saved (37578 records). [2025-09-18T19:50:38.361192] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-18T19:50:38.361276] [INFO ] [MAIN ] Update Progress: 1168/2372 symbols completed. JPC took 32.7s. Estimated remaining: 2h 55m 50s. Rate: 6.8 symbols/min [2025-09-18T19:50:38.533424] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:50:38.553956] [DEBUG] [LOCAL ] JRI: Loaded 15147 existing records from primary storage. [2025-09-18T19:50:38.554140] [INFO ] [MAIN ] JRI: Loaded 15147 existing records. [2025-09-18T19:50:38.735221] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:50:38.735458] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-18T19:50:38.735507] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-18T19:50:38.736152] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-09-18T19:50:38.736214] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-18T19:50:38.925316] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-08. [2025-09-18T19:50:39.098403] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:50:39.515830] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-18T19:50:39.538899] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-18T19:50:39.719534] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-18T19:50:40.519543] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-09. [2025-09-18T19:50:41.217675] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-18T19:50:41.219170] [INFO ] [REMOTE ] JPI: Full fetch complete (7885 records). [2025-09-18T19:50:41.219243] [DEBUG] [VALIDATOR ] JPI: Validating primary data. [2025-09-18T19:50:41.320783] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-11. [2025-09-18T19:50:41.588030] [DEBUG] [VALIDATOR ] JPI: All expected trading days are present. [2025-09-18T19:50:41.588165] [DEBUG] [VALIDATOR ] JPI: Primary data validation passed. [2025-09-18T19:50:41.588427] [INFO ] [MAIN ] JPI: Fetched primary data is valid. [2025-09-18T19:50:41.588505] [DEBUG] [LOCAL ] JPI: Saving primary data. [2025-09-18T19:50:41.589203] [DEBUG] [LOCAL ] JPI: Trimmed 7885 records to 5496 (keeping 200 days of data) [2025-09-18T19:50:41.624433] [DEBUG] [LOCAL ] JPI: Primary data saved (5496 records). [2025-09-18T19:50:41.624556] [INFO ] [MAIN ] JPI: Full history saved. [2025-09-18T19:50:41.624667] [INFO ] [MAIN ] Update Progress: 1169/2372 symbols completed. JPI took 31.3s. Estimated remaining: 2h 55m 36s. Rate: 6.9 symbols/min [2025-09-18T19:50:41.805462] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:50:41.838906] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-18T19:50:41.856892] [DEBUG] [LOCAL ] JRS: Loaded 11014 existing records from primary storage. [2025-09-18T19:50:41.857015] [INFO ] [MAIN ] JRS: Loaded 11014 existing records. [2025-09-18T19:50:42.070980] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:50:42.072131] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-18T19:50:42.076022] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-18T19:50:42.076084] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-18T19:50:42.076474] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-18T19:50:42.076535] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-18T19:50:42.124689] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-09-18T19:50:42.446490] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:50:42.919593] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-18T19:50:43.007878] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T19:50:43.719580] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-09-18T19:50:44.155522] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-18T19:50:44.519556] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-18T19:50:44.597481] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-18T19:50:45.319575] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-11. [2025-09-18T19:50:45.953007] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-18T19:50:46.119522] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-09-18T19:50:46.387296] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-18T19:50:46.919568] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-18T19:50:46.937532] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-18T19:50:47.719567] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-18T19:50:48.519553] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-09-18T19:50:48.655919] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-18T19:50:49.149798] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-18T19:50:49.169924] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-18T19:50:49.319679] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-18T19:50:50.122659] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-18T19:50:50.125620] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-18T19:50:50.919549] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-18T19:50:51.522904] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-18T19:50:51.655821] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-18T19:50:51.719573] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-18T19:50:52.519602] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-18T19:50:53.062201] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-18T19:50:53.319606] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-18T19:50:53.566153] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-18T19:50:54.119611] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-18T19:50:54.784515] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-18T19:50:54.919548] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-18T19:50:55.287821] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-18T19:50:55.452603] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-18T19:50:55.719589] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-18T19:50:56.519569] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-18T19:50:57.037176] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T19:50:57.319583] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-18T19:50:57.861858] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-18T19:50:58.119550] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-18T19:50:58.587803] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-18T19:50:58.597539] [INFO ] [REMOTE ] JPM: Full fetch complete (77826 records). [2025-09-18T19:50:58.597716] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-18T19:50:58.920412] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-18T19:50:59.039366] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-18T19:50:59.038757] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-18T19:50:59.042598] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-18T19:50:59.044564] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-18T19:50:59.044672] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-18T19:50:59.046427] [DEBUG] [LOCAL ] JPM: Trimmed 77826 records to 54184 (keeping 200 days of data) [2025-09-18T19:50:59.394212] [DEBUG] [LOCAL ] JPM: Primary data saved (54184 records). [2025-09-18T19:50:59.394395] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-18T19:50:59.394504] [INFO ] [MAIN ] Update Progress: 1170/2372 symbols completed. JPM took 40.4s. Estimated remaining: 2h 55m 36s. Rate: 6.8 symbols/min [2025-09-18T19:50:59.579430] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:50:59.625390] [DEBUG] [LOCAL ] JXN: Loaded 46064 existing records from primary storage. [2025-09-18T19:50:59.625542] [INFO ] [MAIN ] JXN: Loaded 46064 existing records. [2025-09-18T19:50:59.724704] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-18T19:50:59.850915] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:50:59.851594] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-18T19:50:59.859631] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-18T19:50:59.860699] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-18T19:50:59.863786] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-18T19:50:59.864290] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-18T19:51:00.240014] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:51:00.519550] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-11. [2025-09-18T19:51:00.773286] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-18T19:51:01.319575] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-18T19:51:02.119591] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-18T19:51:02.757276] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-11 (2.24 seconds). [2025-09-18T19:51:02.919559] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-09-18T19:51:02.962252] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-18T19:51:03.719694] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-18T19:51:04.519619] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-18T19:51:04.786771] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-18T19:51:04.804317] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-18T19:51:05.245787] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-18T19:51:05.325937] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-18T19:51:05.333152] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (3.21 seconds). [2025-09-18T19:51:06.119331] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-18T19:51:06.119583] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-18T19:51:06.122831] [INFO ] [REMOTE ] JRS: Full fetch complete (15976 records). [2025-09-18T19:51:06.122903] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-18T19:51:06.494310] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-18T19:51:06.494400] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-18T19:51:06.494784] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-18T19:51:06.494845] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-18T19:51:06.495512] [DEBUG] [LOCAL ] JRS: Trimmed 15976 records to 11157 (keeping 200 days of data) [2025-09-18T19:51:06.571624] [DEBUG] [LOCAL ] JRS: Primary data saved (11157 records). [2025-09-18T19:51:06.571838] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-18T19:51:06.571960] [INFO ] [MAIN ] Update Progress: 1171/2372 symbols completed. JRS took 24.9s. Estimated remaining: 2h 55m 26s. Rate: 6.8 symbols/min [2025-09-18T19:51:06.744066] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:51:06.810534] [DEBUG] [LOCAL ] K: Loaded 49762 existing records from primary storage. [2025-09-18T19:51:06.810719] [INFO ] [MAIN ] K: Loaded 49762 existing records. [2025-09-18T19:51:06.924782] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-18T19:51:07.049182] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:51:07.049874] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-18T19:51:07.050090] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-18T19:51:07.056857] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-18T19:51:07.063785] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-18T19:51:07.064340] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-18T19:51:07.465846] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:51:07.719617] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-09-18T19:51:08.387245] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-18T19:51:08.519734] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-18T19:51:09.218193] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-18T19:51:09.236586] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-18T19:51:09.319545] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-18T19:51:10.119523] [INFO ] [REMOTE ] K: Fetching primary data for 2024-11. [2025-09-18T19:51:10.243070] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-18T19:51:10.246344] [INFO ] [REMOTE ] JRI: Full fetch complete (23121 records). [2025-09-18T19:51:10.246420] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-18T19:51:10.619237] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-09-18T19:51:10.619354] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-09-18T19:51:10.619897] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-09-18T19:51:10.619962] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-09-18T19:51:10.621073] [DEBUG] [LOCAL ] JRI: Trimmed 23121 records to 15258 (keeping 200 days of data) [2025-09-18T19:51:10.715959] [DEBUG] [LOCAL ] JRI: Primary data saved (15258 records). [2025-09-18T19:51:10.716118] [INFO ] [MAIN ] JRI: Full history saved. [2025-09-18T19:51:10.716210] [INFO ] [MAIN ] Update Progress: 1172/2372 symbols completed. JRI took 32.4s. Estimated remaining: 2h 55m 13s. Rate: 6.8 symbols/min [2025-09-18T19:51:10.885704] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:51:10.901300] [DEBUG] [LOCAL ] KAI: Loaded 13671 existing records from primary storage. [2025-09-18T19:51:10.901465] [INFO ] [MAIN ] KAI: Loaded 13671 existing records. [2025-09-18T19:51:10.924676] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-18T19:51:11.082819] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:51:11.083054] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-18T19:51:11.083102] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-18T19:51:11.083570] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-18T19:51:11.083630] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-18T19:51:11.461522] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:51:11.719572] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-18T19:51:11.754104] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-18T19:51:12.146906] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-18T19:51:12.151900] [INFO ] [REMOTE ] JQC: Full fetch complete (48614 records). [2025-09-18T19:51:12.152021] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-18T19:51:12.524626] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-09-18T19:51:12.567663] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-18T19:51:12.567741] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-18T19:51:12.568620] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-18T19:51:12.568800] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-18T19:51:12.570374] [DEBUG] [LOCAL ] JQC: Trimmed 48614 records to 34199 (keeping 200 days of data) [2025-09-18T19:51:12.789708] [DEBUG] [LOCAL ] JQC: Primary data saved (34199 records). [2025-09-18T19:51:12.789842] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-18T19:51:12.789927] [INFO ] [MAIN ] Update Progress: 1173/2372 symbols completed. JQC took 46.1s. Estimated remaining: 2h 54m 57s. Rate: 6.9 symbols/min [2025-09-18T19:51:12.967571] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:51:13.007930] [DEBUG] [LOCAL ] KAR: Loaded 40104 existing records from primary storage. [2025-09-18T19:51:13.008083] [INFO ] [MAIN ] KAR: Loaded 40104 existing records. [2025-09-18T19:51:13.204405] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:51:13.204836] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-18T19:51:13.205045] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-18T19:51:13.206060] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-18T19:51:13.206125] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-18T19:51:13.322920] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-11. [2025-09-18T19:51:13.533127] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-18T19:51:13.623797] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:51:13.887848] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T19:51:14.120255] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-11. [2025-09-18T19:51:14.122025] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-18T19:51:14.919549] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-18T19:51:15.719599] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-09-18T19:51:16.519539] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-09-18T19:51:16.520572] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-11 (2.40 seconds). [2025-09-18T19:51:17.187683] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-18T19:51:17.204996] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-18T19:51:17.288354] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-18T19:51:17.319497] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-09-18T19:51:18.119562] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-18T19:51:18.919606] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-09-18T19:51:19.079317] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-18T19:51:19.477796] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-18T19:51:19.719547] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-18T19:51:19.779123] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-18T19:51:20.519536] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-18T19:51:21.175502] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T19:51:21.196202] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-18T19:51:21.319542] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-18T19:51:22.119543] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-09-18T19:51:22.919554] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-18T19:51:23.225212] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-18T19:51:23.295878] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-18T19:51:23.494456] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-18T19:51:23.719542] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-18T19:51:24.519593] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-18T19:51:25.319571] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-18T19:51:25.437992] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-18T19:51:25.607125] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-18T19:51:26.119566] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-18T19:51:26.919547] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-18T19:51:27.370217] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-18T19:51:27.443022] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-18T19:51:27.719524] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-18T19:51:28.017077] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-18T19:51:28.519550] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-18T19:51:28.895703] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-18T19:51:29.319599] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-18T19:51:30.119550] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-18T19:51:30.302387] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-18T19:51:30.554490] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-18T19:51:30.919553] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-18T19:51:30.976128] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-18T19:51:31.719539] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-18T19:51:32.242601] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-18T19:51:32.347351] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-18T19:51:32.519481] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-18T19:51:33.319544] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-18T19:51:34.119604] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-18T19:51:34.289135] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-18T19:51:34.430724] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-18T19:51:34.919587] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-18T19:51:35.161885] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-18T19:51:35.719601] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-18T19:51:36.218325] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T19:51:36.519573] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-18T19:51:37.316248] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-18T19:51:37.319506] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-18T19:51:37.486090] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-18T19:51:37.493166] [INFO ] [REMOTE ] K: Full fetch complete (71650 records). [2025-09-18T19:51:37.493304] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-18T19:51:37.885996] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-18T19:51:37.886095] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-18T19:51:37.887111] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-18T19:51:37.887188] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-18T19:51:37.888801] [DEBUG] [LOCAL ] K: Trimmed 71650 records to 50133 (keeping 200 days of data) [2025-09-18T19:51:38.119769] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-18T19:51:38.212213] [DEBUG] [LOCAL ] K: Primary data saved (50133 records). [2025-09-18T19:51:38.212361] [INFO ] [MAIN ] K: Full history saved. [2025-09-18T19:51:38.213358] [INFO ] [MAIN ] Update Progress: 1174/2372 symbols completed. K took 31.6s. Estimated remaining: 2h 55m 5s. Rate: 6.8 symbols/min [2025-09-18T19:51:38.387292] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:51:38.412778] [DEBUG] [LOCAL ] KB: Loaded 24487 existing records from primary storage. [2025-09-18T19:51:38.412920] [INFO ] [MAIN ] KB: Loaded 24487 existing records. [2025-09-18T19:51:38.590123] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:51:38.590373] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-18T19:51:38.590439] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-18T19:51:38.591340] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-18T19:51:38.591400] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-18T19:51:38.939873] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-18T19:51:38.951814] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-18T19:51:38.987755] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:51:39.014942] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-18T19:51:39.719575] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-18T19:51:40.339517] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-18T19:51:40.345849] [INFO ] [REMOTE ] JXN: Full fetch complete (65073 records). [2025-09-18T19:51:40.345979] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-18T19:51:40.456916] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T19:51:40.481344] [INFO ] [REMOTE ] KAI: Full fetch complete (18685 records). [2025-09-18T19:51:40.505727] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-18T19:51:40.520760] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-11. [2025-09-18T19:51:41.078820] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-18T19:51:41.090356] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-18T19:51:41.097067] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-18T19:51:41.107491] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-18T19:51:41.179760] [DEBUG] [LOCAL ] JXN: Trimmed 65073 records to 46440 (keeping 200 days of data) [2025-09-18T19:51:41.213137] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-18T19:51:41.213591] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-18T19:51:41.213940] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-18T19:51:41.214010] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-18T19:51:41.215013] [DEBUG] [LOCAL ] KAI: Trimmed 18685 records to 13769 (keeping 200 days of data) [2025-09-18T19:51:41.357538] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-18T19:51:41.528533] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T19:51:41.543867] [DEBUG] [LOCAL ] KAI: Primary data saved (13769 records). [2025-09-18T19:51:41.545379] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-18T19:51:41.546151] [INFO ] [MAIN ] Update Progress: 1175/2372 symbols completed. KAI took 30.8s. Estimated remaining: 2h 54m 51s. Rate: 6.8 symbols/min [2025-09-18T19:51:41.940966] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:51:42.030862] [DEBUG] [LOCAL ] KBDC: Loaded 20545 existing records from primary storage. [2025-09-18T19:51:42.032474] [INFO ] [MAIN ] KBDC: Loaded 20545 existing records. [2025-09-18T19:51:42.124793] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-09-18T19:51:42.313110] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:51:42.314728] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-18T19:51:42.315113] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-18T19:51:42.317469] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-18T19:51:42.317825] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-18T19:51:42.761293] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:51:42.767360] [DEBUG] [LOCAL ] JXN: Primary data saved (46440 records). [2025-09-18T19:51:42.767609] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-18T19:51:42.767886] [INFO ] [MAIN ] Update Progress: 1176/2372 symbols completed. JXN took 43.4s. Estimated remaining: 2h 54m 35s. Rate: 6.9 symbols/min [2025-09-18T19:51:42.893593] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T19:51:42.921799] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-11. [2025-09-18T19:51:42.972750] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:51:43.019279] [DEBUG] [LOCAL ] KBH: Loaded 48842 existing records from primary storage. [2025-09-18T19:51:43.019427] [INFO ] [MAIN ] KBH: Loaded 48842 existing records. [2025-09-18T19:51:43.204002] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:51:43.204409] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-18T19:51:43.204513] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-18T19:51:43.205774] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-18T19:51:43.205839] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-18T19:51:43.326355] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-18T19:51:43.532235] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-18T19:51:43.601481] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:51:43.719501] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-11. [2025-09-18T19:51:44.519559] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-09-18T19:51:45.120185] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-18T19:51:45.319553] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-09-18T19:51:45.594611] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-18T19:51:46.119569] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-09-18T19:51:46.700498] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-18T19:51:46.804715] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-18T19:51:46.919549] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-18T19:51:47.719614] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-09-18T19:51:47.857817] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-18T19:51:48.519551] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-18T19:51:48.561994] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T19:51:49.319549] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-18T19:51:49.615358] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-18T19:51:50.022635] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-18T19:51:50.119523] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-18T19:51:50.919551] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-09-18T19:51:51.031009] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-18T19:51:51.719577] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-18T19:51:52.427363] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T19:51:52.519512] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-18T19:51:52.855575] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-18T19:51:53.319566] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-18T19:51:53.925623] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T19:51:54.119605] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-18T19:51:54.875046] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-18T19:51:54.919500] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-18T19:51:54.994779] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-18T19:51:55.719514] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-18T19:51:56.073055] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-18T19:51:56.519549] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-18T19:51:56.871055] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-18T19:51:57.319571] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-18T19:51:57.366220] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-18T19:51:58.119549] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-18T19:51:58.395839] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-18T19:51:58.919544] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-18T19:51:59.157572] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-18T19:51:59.570553] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-18T19:51:59.719540] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-18T19:52:00.519542] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-18T19:52:01.319621] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-18T19:52:01.502701] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-18T19:52:01.551966] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-18T19:52:02.119560] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-18T19:52:02.525777] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-18T19:52:02.531767] [INFO ] [REMOTE ] KAR: Full fetch complete (56499 records). [2025-09-18T19:52:02.531943] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-18T19:52:02.922268] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-18T19:52:02.937848] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-18T19:52:02.937915] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-18T19:52:02.938891] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-18T19:52:02.939099] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-18T19:52:02.940693] [DEBUG] [LOCAL ] KAR: Trimmed 56499 records to 40396 (keeping 200 days of data) [2025-09-18T19:52:03.041074] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-18T19:52:03.046132] [INFO ] [REMOTE ] KB: Full fetch complete (34848 records). [2025-09-18T19:52:03.046474] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-18T19:52:03.469512] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-18T19:52:03.469950] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-18T19:52:03.470956] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-18T19:52:03.471037] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-18T19:52:03.477870] [DEBUG] [LOCAL ] KB: Trimmed 34848 records to 24589 (keeping 200 days of data) [2025-09-18T19:52:03.719916] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-18T19:52:03.754163] [DEBUG] [LOCAL ] KAR: Primary data saved (40396 records). [2025-09-18T19:52:03.754883] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-18T19:52:03.755300] [INFO ] [MAIN ] Update Progress: 1177/2372 symbols completed. KAR took 51.0s. Estimated remaining: 2h 54m 38s. Rate: 6.8 symbols/min [2025-09-18T19:52:03.937758] [DEBUG] [LOCAL ] KB: Primary data saved (24589 records). [2025-09-18T19:52:03.940818] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:52:03.940975] [INFO ] [MAIN ] KB: Full history saved. [2025-09-18T19:52:03.941117] [INFO ] [MAIN ] Update Progress: 1178/2372 symbols completed. KB took 25.7s. Estimated remaining: 2h 54m 21s. Rate: 6.8 symbols/min [2025-09-18T19:52:04.133546] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:52:04.148415] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-18T19:52:04.182475] [DEBUG] [LOCAL ] KBR: Loaded 48362 existing records from primary storage. [2025-09-18T19:52:04.182723] [INFO ] [MAIN ] KBR: Loaded 48362 existing records. [2025-09-18T19:52:04.394628] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:52:04.394936] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-18T19:52:04.395846] [DEBUG] [LOCAL ] KD: Loaded 52300 existing records from primary storage. [2025-09-18T19:52:04.395939] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-18T19:52:04.396121] [INFO ] [MAIN ] KD: Loaded 52300 existing records. [2025-09-18T19:52:04.439194] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-09-18T19:52:04.465747] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-18T19:52:04.522523] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-18T19:52:04.808871] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:52:04.853104] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-18T19:52:04.858352] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-18T19:52:04.877145] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-18T19:52:04.879673] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-18T19:52:05.097373] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:52:05.338366] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:52:05.338505] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-11. [2025-09-18T19:52:05.377314] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T19:52:05.409146] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-18T19:52:06.119587] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-11. [2025-09-18T19:52:06.919565] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-18T19:52:06.991391] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T19:52:07.719540] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-09-18T19:52:07.766139] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T19:52:08.386287] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-18T19:52:08.519562] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-09-18T19:52:09.319585] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-18T19:52:09.368590] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-18T19:52:09.894766] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-18T19:52:10.119586] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-18T19:52:10.761743] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T19:52:10.919562] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-09-18T19:52:10.954047] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-18T19:52:10.958597] [INFO ] [REMOTE ] KBDC: Full fetch complete (27456 records). [2025-09-18T19:52:10.958735] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-18T19:52:11.352413] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-09-18T19:52:11.352510] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-09-18T19:52:11.353319] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-09-18T19:52:11.353414] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-09-18T19:52:11.354843] [DEBUG] [LOCAL ] KBDC: Trimmed 27456 records to 20772 (keeping 200 days of data) [2025-09-18T19:52:11.505012] [DEBUG] [LOCAL ] KBDC: Primary data saved (20772 records). [2025-09-18T19:52:11.505155] [INFO ] [MAIN ] KBDC: Full history saved. [2025-09-18T19:52:11.505298] [INFO ] [MAIN ] Update Progress: 1179/2372 symbols completed. KBDC took 30.0s. Estimated remaining: 2h 54m 11s. Rate: 6.8 symbols/min [2025-09-18T19:52:11.687257] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:52:11.695071] [DEBUG] [LOCAL ] KEN: Loaded 4724 existing records from primary storage. [2025-09-18T19:52:11.695187] [INFO ] [MAIN ] KEN: Loaded 4724 existing records. [2025-09-18T19:52:11.728796] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-09-18T19:52:11.891013] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:52:11.891336] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-18T19:52:11.891412] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-18T19:52:11.891802] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-18T19:52:11.891871] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-18T19:52:12.302037] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:52:12.519554] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-11. [2025-09-18T19:52:12.616158] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-18T19:52:12.852493] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-18T19:52:13.319519] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-09-18T19:52:13.369525] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-18T19:52:13.809399] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-18T19:52:14.119566] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-18T19:52:14.919582] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-09-18T19:52:15.299038] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-18T19:52:15.452324] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T19:52:15.719560] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-18T19:52:16.250445] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-18T19:52:16.519632] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-18T19:52:17.319625] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-18T19:52:18.119536] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-18T19:52:18.273960] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-18T19:52:18.864403] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-18T19:52:18.919540] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-18T19:52:19.719548] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-18T19:52:19.773810] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-18T19:52:20.153885] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-18T19:52:20.390478] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-18T19:52:20.519491] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-18T19:52:21.319595] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-18T19:52:21.915113] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-18T19:52:22.119588] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-18T19:52:22.371586] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-18T19:52:22.591390] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-18T19:52:22.919538] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-18T19:52:23.719544] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-18T19:52:24.239690] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-18T19:52:24.519540] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-18T19:52:24.582062] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T19:52:25.319551] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-18T19:52:26.119595] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-18T19:52:26.276986] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-18T19:52:26.776416] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-18T19:52:26.919512] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-09-18T19:52:27.616086] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-18T19:52:27.719563] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-18T19:52:28.297432] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-18T19:52:28.519552] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-18T19:52:28.639061] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-18T19:52:29.319560] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-18T19:52:30.131236] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-18T19:52:30.137077] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-18T19:52:30.590616] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-18T19:52:30.919524] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-18T19:52:31.052755] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-18T19:52:31.061494] [INFO ] [REMOTE ] KBH: Full fetch complete (70232 records). [2025-09-18T19:52:31.061698] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-18T19:52:31.472155] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-18T19:52:31.472329] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-18T19:52:31.473233] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-18T19:52:31.473298] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-18T19:52:31.474825] [DEBUG] [LOCAL ] KBH: Trimmed 70232 records to 49212 (keeping 200 days of data) [2025-09-18T19:52:31.719777] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-09-18T19:52:31.787037] [DEBUG] [LOCAL ] KBH: Primary data saved (49212 records). [2025-09-18T19:52:31.787174] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-18T19:52:31.787301] [INFO ] [MAIN ] Update Progress: 1180/2372 symbols completed. KBH took 49.0s. Estimated remaining: 2h 54m 14s. Rate: 6.8 symbols/min [2025-09-18T19:52:31.967523] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:52:31.998632] [DEBUG] [LOCAL ] KEP: Loaded 30243 existing records from primary storage. [2025-09-18T19:52:31.998791] [INFO ] [MAIN ] KEP: Loaded 30243 existing records. [2025-09-18T19:52:32.190114] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:52:32.190423] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-18T19:52:32.190480] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-18T19:52:32.191383] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-18T19:52:32.191447] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-18T19:52:32.536029] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-18T19:52:32.576849] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:52:32.640670] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-18T19:52:33.141723] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-18T19:52:33.142904] [INFO ] [REMOTE ] KEN: Full fetch complete (5933 records). [2025-09-18T19:52:33.142985] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-18T19:52:33.335846] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-18T19:52:33.535682] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-18T19:52:33.535858] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-18T19:52:33.536163] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-18T19:52:33.536293] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-18T19:52:33.537168] [DEBUG] [LOCAL ] KEN: Trimmed 5933 records to 4756 (keeping 200 days of data) [2025-09-18T19:52:33.570913] [DEBUG] [LOCAL ] KEN: Primary data saved (4756 records). [2025-09-18T19:52:33.571133] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-18T19:52:33.571270] [INFO ] [MAIN ] Update Progress: 1181/2372 symbols completed. KEN took 22.1s. Estimated remaining: 2h 53m 58s. Rate: 6.8 symbols/min [2025-09-18T19:52:33.744638] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-18T19:52:33.854777] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:52:33.906312] [DEBUG] [LOCAL ] KEX: Loaded 37719 existing records from primary storage. [2025-09-18T19:52:33.906505] [INFO ] [MAIN ] KEX: Loaded 37719 existing records. [2025-09-18T19:52:34.136739] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-09-18T19:52:34.203872] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:52:34.204363] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-18T19:52:34.204442] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-18T19:52:34.206581] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-09-18T19:52:34.206705] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-18T19:52:34.687354] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:52:34.919582] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-11. [2025-09-18T19:52:35.143870] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-18T19:52:35.486716] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-18T19:52:35.719519] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-09-18T19:52:35.762853] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-18T19:52:36.519720] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-18T19:52:37.049779] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T19:52:37.319602] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-18T19:52:38.119582] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-11. [2025-09-18T19:52:38.206302] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-18T19:52:38.216981] [INFO ] [REMOTE ] KD: Full fetch complete (75420 records). [2025-09-18T19:52:38.217135] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-18T19:52:38.615769] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-18T19:52:38.615939] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-18T19:52:38.617119] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-18T19:52:38.617330] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-18T19:52:38.636876] [DEBUG] [LOCAL ] KD: Trimmed 75420 records to 52684 (keeping 200 days of data) [2025-09-18T19:52:38.636745] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-18T19:52:38.644351] [INFO ] [REMOTE ] KBR: Full fetch complete (69746 records). [2025-09-18T19:52:38.644500] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-09-18T19:52:38.932121] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-09-18T19:52:39.232919] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-09-18T19:52:39.243076] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-09-18T19:52:39.270669] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-09-18T19:52:39.272196] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-09-18T19:52:39.277628] [DEBUG] [LOCAL ] KBR: Trimmed 69746 records to 48678 (keeping 200 days of data) [2025-09-18T19:52:39.372339] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-18T19:52:39.630761] [DEBUG] [LOCAL ] KD: Primary data saved (52684 records). [2025-09-18T19:52:39.631432] [INFO ] [MAIN ] KD: Full history saved. [2025-09-18T19:52:39.632838] [INFO ] [MAIN ] Update Progress: 1182/2372 symbols completed. KD took 35.7s. Estimated remaining: 2h 53m 46s. Rate: 6.8 symbols/min [2025-09-18T19:52:39.735697] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-09-18T19:52:39.819226] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:52:39.820113] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-18T19:52:39.820672] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-18T19:52:39.821942] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-18T19:52:39.822009] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-18T19:52:39.822311] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-18T19:52:39.822683] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-18T19:52:40.202379] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-18T19:52:40.265705] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:52:40.281261] [DEBUG] [LOCAL ] KBR: Primary data saved (48678 records). [2025-09-18T19:52:40.281353] [INFO ] [MAIN ] KBR: Full history saved. [2025-09-18T19:52:40.281425] [INFO ] [MAIN ] Update Progress: 1183/2372 symbols completed. KBR took 36.5s. Estimated remaining: 2h 53m 29s. Rate: 6.9 symbols/min [2025-09-18T19:52:40.447662] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:52:40.495826] [DEBUG] [LOCAL ] KEYS: Loaded 43452 existing records from primary storage. [2025-09-18T19:52:40.496010] [INFO ] [MAIN ] KEYS: Loaded 43452 existing records. [2025-09-18T19:52:40.526847] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-11. [2025-09-18T19:52:40.680858] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:52:40.681075] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-18T19:52:40.681131] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-18T19:52:40.682240] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-18T19:52:40.682302] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-18T19:52:41.075603] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:52:41.125860] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T19:52:41.319584] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-18T19:52:42.007352] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-18T19:52:42.102919] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-18T19:52:42.119491] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-18T19:52:42.919550] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-09-18T19:52:42.988807] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-18T19:52:43.719550] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-18T19:52:44.221111] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-18T19:52:44.519535] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-18T19:52:44.762993] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-18T19:52:45.319594] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-11. [2025-09-18T19:52:45.900736] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T19:52:46.119689] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-18T19:52:46.680442] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-18T19:52:46.919571] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-18T19:52:47.719599] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-09-18T19:52:47.962585] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-18T19:52:47.991774] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-18T19:52:48.519535] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-18T19:52:49.054707] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T19:52:49.319569] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-09-18T19:52:49.739452] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-18T19:52:50.119552] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-18T19:52:50.900256] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T19:52:50.919502] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-18T19:52:51.677863] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-18T19:52:51.719496] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-18T19:52:52.178703] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-18T19:52:52.519550] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-18T19:52:53.201097] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-18T19:52:53.319550] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-18T19:52:53.670473] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-18T19:52:54.119543] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-18T19:52:54.899469] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-18T19:52:54.919490] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-18T19:52:55.623122] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-18T19:52:55.719548] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-18T19:52:56.519530] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-18T19:52:56.811397] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-18T19:52:57.072238] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-18T19:52:57.319563] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-18T19:52:57.536325] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-18T19:52:58.119584] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-18T19:52:58.919595] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-18T19:52:59.208426] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-18T19:52:59.396305] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-18T19:52:59.719553] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-18T19:53:00.209718] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-18T19:53:00.519594] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-18T19:53:01.319571] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-18T19:53:01.401336] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-18T19:53:01.681013] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-18T19:53:02.119614] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-18T19:53:02.475594] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-18T19:53:02.479541] [INFO ] [REMOTE ] KEP: Full fetch complete (41482 records). [2025-09-18T19:53:02.479686] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-18T19:53:02.872945] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-18T19:53:02.873053] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-18T19:53:02.873744] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-18T19:53:02.873844] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-18T19:53:02.875397] [DEBUG] [LOCAL ] KEP: Trimmed 41482 records to 30415 (keeping 200 days of data) [2025-09-18T19:53:02.922698] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-18T19:53:03.053357] [DEBUG] [LOCAL ] KEP: Primary data saved (30415 records). [2025-09-18T19:53:03.053501] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-18T19:53:03.053588] [INFO ] [MAIN ] Update Progress: 1184/2372 symbols completed. KEP took 31.3s. Estimated remaining: 2h 53m 35s. Rate: 6.8 symbols/min [2025-09-18T19:53:03.230139] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:53:03.234948] [DEBUG] [LOCAL ] KF: Loaded 2507 existing records from primary storage. [2025-09-18T19:53:03.235058] [INFO ] [MAIN ] KF: Loaded 2507 existing records. [2025-09-18T19:53:03.421863] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:53:03.422183] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-18T19:53:03.422283] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-18T19:53:03.422722] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-18T19:53:03.422966] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-18T19:53:03.720989] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-18T19:53:03.752799] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-18T19:53:03.827501] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:53:04.342982] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-18T19:53:04.519530] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-18T19:53:05.319552] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-18T19:53:06.119574] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-11. [2025-09-18T19:53:06.947051] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-18T19:53:06.948699] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-09-18T19:53:07.332834] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (3.61 seconds). [2025-09-18T19:53:07.367054] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-18T19:53:07.372078] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-18T19:53:07.564024] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (3.04 seconds). [2025-09-18T19:53:07.719557] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-18T19:53:08.519546] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-18T19:53:09.206267] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-18T19:53:09.319558] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-18T19:53:09.848916] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-18T19:53:10.119547] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-18T19:53:10.497448] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-18T19:53:10.919560] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-18T19:53:11.532497] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-18T19:53:11.539107] [INFO ] [REMOTE ] KEX: Full fetch complete (55121 records). [2025-09-18T19:53:11.539227] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-18T19:53:11.727348] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-09-18T19:53:11.959213] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-09-18T19:53:11.959291] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-09-18T19:53:11.960076] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-09-18T19:53:11.960152] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-09-18T19:53:11.961385] [DEBUG] [LOCAL ] KEX: Trimmed 55121 records to 38096 (keeping 200 days of data) [2025-09-18T19:53:12.196110] [DEBUG] [LOCAL ] KEX: Primary data saved (38096 records). [2025-09-18T19:53:12.196289] [INFO ] [MAIN ] KEX: Full history saved. [2025-09-18T19:53:12.196394] [INFO ] [MAIN ] Update Progress: 1185/2372 symbols completed. KEX took 38.6s. Estimated remaining: 2h 53m 26s. Rate: 6.8 symbols/min [2025-09-18T19:53:12.383322] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:53:12.387384] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-18T19:53:12.406325] [DEBUG] [LOCAL ] KFRC: Loaded 19132 existing records from primary storage. [2025-09-18T19:53:12.406455] [INFO ] [MAIN ] KFRC: Loaded 19132 existing records. [2025-09-18T19:53:12.520933] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-18T19:53:12.605797] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:53:12.606316] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-18T19:53:12.606470] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-18T19:53:12.607196] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-18T19:53:12.607260] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-18T19:53:12.879814] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-18T19:53:13.073012] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:53:13.319565] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-11. [2025-09-18T19:53:14.119602] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-18T19:53:14.252085] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-18T19:53:14.258709] [INFO ] [REMOTE ] KEYS: Full fetch complete (62846 records). [2025-09-18T19:53:14.258941] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-18T19:53:14.314305] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-18T19:53:14.566309] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-18T19:53:14.682917] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-18T19:53:14.683002] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-18T19:53:14.683892] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-18T19:53:14.683957] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-18T19:53:14.685224] [DEBUG] [LOCAL ] KEYS: Trimmed 62846 records to 43754 (keeping 200 days of data) [2025-09-18T19:53:14.919585] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-09-18T19:53:14.955734] [DEBUG] [LOCAL ] KEYS: Primary data saved (43754 records). [2025-09-18T19:53:14.955887] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-18T19:53:14.955987] [INFO ] [MAIN ] Update Progress: 1186/2372 symbols completed. KEYS took 34.7s. Estimated remaining: 2h 53m 12s. Rate: 6.8 symbols/min [2025-09-18T19:53:15.131006] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:53:15.141625] [DEBUG] [LOCAL ] KFS: Loaded 8100 existing records from primary storage. [2025-09-18T19:53:15.141775] [INFO ] [MAIN ] KFS: Loaded 8100 existing records. [2025-09-18T19:53:15.324107] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:53:15.324366] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-18T19:53:15.324416] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-18T19:53:15.324903] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-18T19:53:15.324965] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-18T19:53:15.608928] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-18T19:53:15.693677] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:53:15.719493] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-11. [2025-09-18T19:53:16.350068] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-18T19:53:16.519546] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-09-18T19:53:17.171904] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-18T19:53:17.319551] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-09-18T19:53:18.119555] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-09-18T19:53:18.919576] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-18T19:53:19.270318] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-18T19:53:19.462519] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T19:53:19.719560] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-09-18T19:53:20.191860] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-18T19:53:20.473288] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-18T19:53:20.484053] [INFO ] [REMOTE ] KEY: Full fetch complete (77096 records). [2025-09-18T19:53:20.484246] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-18T19:53:20.524708] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-09-18T19:53:20.691212] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-18T19:53:20.692168] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:53:20.692254] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:53:20.692352] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-18T19:53:20.692479] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-18T19:53:20.692545] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-18T19:53:20.692609] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-18T19:53:20.692778] [INFO ] [MAIN ] Update Progress: 1187/2372 symbols completed. KEY took 41.1s. Estimated remaining: 2h 52m 60s. Rate: 6.8 symbols/min [2025-09-18T19:53:20.866432] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:53:20.897665] [DEBUG] [LOCAL ] KFY: Loaded 30780 existing records from primary storage. [2025-09-18T19:53:20.897826] [INFO ] [MAIN ] KFY: Loaded 30780 existing records. [2025-09-18T19:53:21.075349] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:53:21.075667] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-18T19:53:21.075742] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-18T19:53:21.076824] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-18T19:53:21.076888] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-18T19:53:21.325836] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-09-18T19:53:21.434743] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-18T19:53:21.465575] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:53:21.866340] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-18T19:53:22.119542] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-09-18T19:53:22.500606] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-18T19:53:22.919555] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-09-18T19:53:23.371013] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-18T19:53:23.719558] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-11. [2025-09-18T19:53:24.519527] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-18T19:53:24.909638] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-18T19:53:25.262483] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-18T19:53:25.319497] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-18T19:53:26.119565] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-09-18T19:53:26.302244] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-18T19:53:26.555024] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-18T19:53:26.919544] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-18T19:53:27.483340] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-18T19:53:27.719541] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-09-18T19:53:28.519528] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-18T19:53:29.070832] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-18T19:53:29.273046] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-18T19:53:29.319494] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-18T19:53:30.110216] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-18T19:53:30.119489] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-18T19:53:30.919554] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-09-18T19:53:31.100313] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-18T19:53:31.342064] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-18T19:53:31.344205] [INFO ] [REMOTE ] KF: Full fetch complete (3928 records). [2025-09-18T19:53:31.344293] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-09-18T19:53:31.710686] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-09-18T19:53:31.710831] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-09-18T19:53:31.710990] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-09-18T19:53:31.711032] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-09-18T19:53:31.711444] [DEBUG] [LOCAL ] KF: Trimmed 3928 records to 2515 (keeping 200 days of data) [2025-09-18T19:53:31.720135] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-18T19:53:31.729276] [DEBUG] [LOCAL ] KF: Primary data saved (2515 records). [2025-09-18T19:53:31.729374] [INFO ] [MAIN ] KF: Full history saved. [2025-09-18T19:53:31.729461] [INFO ] [MAIN ] Update Progress: 1188/2372 symbols completed. KF took 28.7s. Estimated remaining: 2h 52m 53s. Rate: 6.8 symbols/min [2025-09-18T19:53:31.903346] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:53:31.963191] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-09-18T19:53:31.963346] [INFO ] [MAIN ] KGC: Loaded 53699 existing records. [2025-09-18T19:53:32.140563] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:53:32.140898] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-18T19:53:32.140954] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-18T19:53:32.142544] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-18T19:53:32.142606] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-18T19:53:32.254580] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-18T19:53:32.517219] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:53:32.519499] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-11. [2025-09-18T19:53:33.319586] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-09-18T19:53:34.119588] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-18T19:53:34.584832] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-11 (2.07 seconds). [2025-09-18T19:53:34.634441] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-18T19:53:34.919569] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-09-18T19:53:35.162320] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-18T19:53:35.719578] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-18T19:53:36.519507] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-18T19:53:36.669622] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-18T19:53:36.690672] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-18T19:53:37.319547] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-09-18T19:53:37.662764] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T19:53:38.119540] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-18T19:53:38.919541] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-18T19:53:38.996084] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-18T19:53:39.023337] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-18T19:53:39.719603] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-18T19:53:39.901913] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-18T19:53:39.905767] [INFO ] [REMOTE ] KFRC: Full fetch complete (24965 records). [2025-09-18T19:53:39.905882] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-18T19:53:40.311606] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-18T19:53:40.311784] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-18T19:53:40.312408] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-18T19:53:40.312455] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-18T19:53:40.313279] [DEBUG] [LOCAL ] KFRC: Trimmed 24965 records to 19331 (keeping 200 days of data) [2025-09-18T19:53:40.436530] [DEBUG] [LOCAL ] KFRC: Primary data saved (19331 records). [2025-09-18T19:53:40.436718] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-18T19:53:40.436826] [INFO ] [MAIN ] Update Progress: 1189/2372 symbols completed. KFRC took 28.2s. Estimated remaining: 2h 52m 44s. Rate: 6.8 symbols/min [2025-09-18T19:53:40.524753] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-18T19:53:40.622557] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:53:40.674684] [DEBUG] [LOCAL ] KGS: Loaded 45768 existing records from primary storage. [2025-09-18T19:53:40.674848] [INFO ] [MAIN ] KGS: Loaded 45768 existing records. [2025-09-18T19:53:40.861190] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:53:40.861483] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-18T19:53:40.861550] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-18T19:53:40.863106] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-18T19:53:40.863168] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-18T19:53:41.255027] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:53:41.319494] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-11. [2025-09-18T19:53:41.386536] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T19:53:41.674824] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-18T19:53:42.119548] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-18T19:53:42.383571] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-18T19:53:42.919575] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-18T19:53:43.256111] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-18T19:53:43.679844] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-18T19:53:43.719492] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-18T19:53:44.472237] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-18T19:53:44.519490] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-18T19:53:45.319606] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-09-18T19:53:45.367042] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-18T19:53:46.119569] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-18T19:53:46.830683] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-18T19:53:46.919525] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-09-18T19:53:47.719562] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-18T19:53:47.885637] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-18T19:53:48.359564] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-18T19:53:48.519515] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-18T19:53:48.592273] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-18T19:53:49.319581] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-18T19:53:50.119562] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-18T19:53:50.545408] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-18T19:53:50.809779] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T19:53:50.903920] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-18T19:53:50.919495] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-18T19:53:51.719546] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-18T19:53:52.236282] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-18T19:53:52.519537] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-18T19:53:52.904821] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-18T19:53:53.111184] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-18T19:53:53.113125] [INFO ] [REMOTE ] KFS: Full fetch complete (10307 records). [2025-09-18T19:53:53.113199] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-18T19:53:53.324745] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-18T19:53:53.504258] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-18T19:53:53.504357] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-18T19:53:53.504619] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-18T19:53:53.504709] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-18T19:53:53.505204] [DEBUG] [LOCAL ] KFS: Trimmed 10307 records to 8191 (keeping 200 days of data) [2025-09-18T19:53:53.551893] [DEBUG] [LOCAL ] KFS: Primary data saved (8191 records). [2025-09-18T19:53:53.552024] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-18T19:53:53.552128] [INFO ] [MAIN ] Update Progress: 1190/2372 symbols completed. KFS took 38.6s. Estimated remaining: 2h 52m 40s. Rate: 6.8 symbols/min [2025-09-18T19:53:53.720866] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:53:53.773206] [DEBUG] [LOCAL ] KIM: Loaded 53074 existing records from primary storage. [2025-09-18T19:53:53.773397] [INFO ] [MAIN ] KIM: Loaded 53074 existing records. [2025-09-18T19:53:53.952400] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:53:53.952723] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-18T19:53:53.952784] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-18T19:53:53.954071] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-18T19:53:53.954132] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-18T19:53:54.125444] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-18T19:53:54.323263] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:53:54.715929] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T19:53:54.919536] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-18T19:53:55.213946] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-18T19:53:55.719571] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-18T19:53:56.116477] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-18T19:53:56.519529] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-11. [2025-09-18T19:53:56.846199] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-18T19:53:57.319549] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-18T19:53:58.053310] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-18T19:53:58.119565] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-09-18T19:53:58.919616] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-18T19:53:59.035166] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-18T19:53:59.307391] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-18T19:53:59.719566] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-18T19:54:00.107448] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-18T19:54:00.112627] [INFO ] [REMOTE ] KFY: Full fetch complete (43752 records). [2025-09-18T19:54:00.112836] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-18T19:54:00.491093] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-18T19:54:00.491183] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-18T19:54:00.491894] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-18T19:54:00.491958] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-18T19:54:00.493026] [DEBUG] [LOCAL ] KFY: Trimmed 43752 records to 31051 (keeping 200 days of data) [2025-09-18T19:54:00.546417] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-09-18T19:54:00.688378] [DEBUG] [LOCAL ] KFY: Primary data saved (31051 records). [2025-09-18T19:54:00.688520] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-18T19:54:00.688609] [INFO ] [MAIN ] Update Progress: 1191/2372 symbols completed. KFY took 40.0s. Estimated remaining: 2h 52m 30s. Rate: 6.8 symbols/min [2025-09-18T19:54:00.858505] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:54:00.879807] [DEBUG] [LOCAL ] KIO: Loaded 21432 existing records from primary storage. [2025-09-18T19:54:00.879940] [INFO ] [MAIN ] KIO: Loaded 21432 existing records. [2025-09-18T19:54:01.059046] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:54:01.059295] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-18T19:54:01.059353] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-18T19:54:01.060021] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-18T19:54:01.060083] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-18T19:54:01.326022] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-18T19:54:01.413593] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:54:02.119521] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-11. [2025-09-18T19:54:02.556245] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (2.84 seconds). [2025-09-18T19:54:02.919592] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-18T19:54:03.252802] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-09-18T19:54:03.626985] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-18T19:54:03.668365] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-18T19:54:03.719564] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-09-18T19:54:04.399560] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-18T19:54:04.519548] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-09-18T19:54:04.801934] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-18T19:54:05.319515] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-18T19:54:05.343171] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T19:54:06.119559] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-18T19:54:06.919575] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-18T19:54:07.380256] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-18T19:54:07.406414] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-18T19:54:07.719565] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-18T19:54:08.232273] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-18T19:54:08.519538] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-18T19:54:09.319576] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-18T19:54:09.566430] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-18T19:54:09.575780] [INFO ] [REMOTE ] KGC: Full fetch complete (77604 records). [2025-09-18T19:54:09.576058] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-18T19:54:09.981806] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-18T19:54:09.982008] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-18T19:54:09.983058] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-18T19:54:09.983145] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-18T19:54:09.985115] [DEBUG] [LOCAL ] KGC: Trimmed 77604 records to 54089 (keeping 200 days of data) [2025-09-18T19:54:10.109328] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T19:54:10.120786] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-18T19:54:10.364548] [DEBUG] [LOCAL ] KGC: Primary data saved (54089 records). [2025-09-18T19:54:10.364730] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-18T19:54:10.364860] [INFO ] [MAIN ] Update Progress: 1192/2372 symbols completed. KGC took 38.6s. Estimated remaining: 2h 52m 22s. Rate: 6.8 symbols/min [2025-09-18T19:54:10.534608] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:54:10.593583] [DEBUG] [LOCAL ] KKR: Loaded 53514 existing records from primary storage. [2025-09-18T19:54:10.593767] [INFO ] [MAIN ] KKR: Loaded 53514 existing records. [2025-09-18T19:54:10.776667] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:54:10.777125] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-18T19:54:10.777210] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-18T19:54:10.778750] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-09-18T19:54:10.778818] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-18T19:54:10.946238] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-18T19:54:11.025863] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-18T19:54:11.189063] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:54:11.205852] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-18T19:54:11.719559] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-18T19:54:12.519539] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-18T19:54:12.581568] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-18T19:54:12.589399] [INFO ] [REMOTE ] KGS: Full fetch complete (65606 records). [2025-09-18T19:54:12.589574] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-18T19:54:12.973379] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-18T19:54:12.973463] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-18T19:54:12.974330] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-18T19:54:12.974396] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-18T19:54:12.975693] [DEBUG] [LOCAL ] KGS: Trimmed 65606 records to 46132 (keeping 200 days of data) [2025-09-18T19:54:13.261016] [DEBUG] [LOCAL ] KGS: Primary data saved (46132 records). [2025-09-18T19:54:13.261204] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-18T19:54:13.261317] [INFO ] [MAIN ] Update Progress: 1193/2372 symbols completed. KGS took 32.8s. Estimated remaining: 2h 52m 7s. Rate: 6.8 symbols/min [2025-09-18T19:54:13.329463] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-11. [2025-09-18T19:54:13.444349] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:54:13.452028] [DEBUG] [LOCAL ] KKRS: Loaded 5742 existing records from primary storage. [2025-09-18T19:54:13.452141] [INFO ] [MAIN ] KKRS: Loaded 5742 existing records. [2025-09-18T19:54:13.668978] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:54:13.669250] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-18T19:54:13.669299] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-18T19:54:13.669779] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-18T19:54:13.669841] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-18T19:54:14.036023] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:54:14.119500] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-11. [2025-09-18T19:54:14.583957] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (2.86 seconds). [2025-09-18T19:54:14.919558] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-18T19:54:14.940837] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-18T19:54:15.284522] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-18T19:54:15.379050] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-18T19:54:15.719560] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-18T19:54:16.519552] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-09-18T19:54:16.760169] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-18T19:54:16.787062] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-18T19:54:17.319551] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-09-18T19:54:17.860351] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-18T19:54:18.027812] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-18T19:54:18.119544] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-09-18T19:54:18.562158] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-18T19:54:18.919573] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-09-18T19:54:19.719543] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-18T19:54:20.519584] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-18T19:54:20.758775] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-18T19:54:20.903739] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-18T19:54:21.169816] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T19:54:21.319531] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-18T19:54:22.119549] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-18T19:54:22.919564] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-18T19:54:23.617478] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-18T19:54:23.714424] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T19:54:23.730337] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-18T19:54:23.783211] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-18T19:54:24.201685] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-18T19:54:24.519535] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-18T19:54:25.306336] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-18T19:54:25.319502] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-18T19:54:25.971833] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-18T19:54:26.119552] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-18T19:54:26.919544] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-18T19:54:27.719543] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-18T19:54:28.078517] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-18T19:54:28.107197] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-18T19:54:28.519540] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-18T19:54:29.229140] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-18T19:54:29.319495] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-18T19:54:29.610475] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-18T19:54:30.119555] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-18T19:54:30.783429] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-18T19:54:30.919540] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-18T19:54:31.191442] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-18T19:54:31.194964] [INFO ] [REMOTE ] KIO: Full fetch complete (30935 records). [2025-09-18T19:54:31.195075] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-18T19:54:31.591193] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-18T19:54:31.591280] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-18T19:54:31.591897] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-18T19:54:31.591998] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-18T19:54:31.593046] [DEBUG] [LOCAL ] KIO: Trimmed 30935 records to 21562 (keeping 200 days of data) [2025-09-18T19:54:31.721062] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-18T19:54:31.745884] [DEBUG] [LOCAL ] KIO: Primary data saved (21562 records). [2025-09-18T19:54:31.746037] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-18T19:54:31.746170] [INFO ] [MAIN ] Update Progress: 1194/2372 symbols completed. KIO took 31.1s. Estimated remaining: 2h 52m 8s. Rate: 6.8 symbols/min [2025-09-18T19:54:31.963259] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:54:31.963473] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-18T19:54:31.963543] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-18T19:54:31.963731] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-18T19:54:31.963786] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-18T19:54:31.963860] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-18T19:54:31.963945] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-18T19:54:32.332844] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:54:32.359291] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-18T19:54:32.519548] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-18T19:54:32.580511] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-18T19:54:32.590127] [INFO ] [REMOTE ] KIM: Full fetch complete (76652 records). [2025-09-18T19:54:32.590307] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-18T19:54:33.027512] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-18T19:54:33.027683] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-18T19:54:33.028717] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-18T19:54:33.028854] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-18T19:54:33.034866] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-18T19:54:33.040428] [DEBUG] [LOCAL ] KIM: Trimmed 76652 records to 53461 (keeping 200 days of data) [2025-09-18T19:54:33.338981] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-18T19:54:33.389751] [DEBUG] [LOCAL ] KIM: Primary data saved (53461 records). [2025-09-18T19:54:33.389905] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-18T19:54:33.390094] [INFO ] [MAIN ] Update Progress: 1195/2372 symbols completed. KIM took 39.8s. Estimated remaining: 2h 51m 52s. Rate: 6.8 symbols/min [2025-09-18T19:54:33.575086] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:54:33.575295] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-18T19:54:33.575352] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-18T19:54:33.575498] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-18T19:54:33.575553] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-18T19:54:33.575623] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-18T19:54:33.575695] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-18T19:54:33.905956] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-18T19:54:33.982517] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:54:34.119562] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-11. [2025-09-18T19:54:34.315818] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:54:34.316175] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-11 [2025-09-18T19:54:34.919574] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-18T19:54:35.530852] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-18T19:54:35.532535] [INFO ] [REMOTE ] KKRS: Full fetch complete (8047 records). [2025-09-18T19:54:35.532610] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-18T19:54:35.724728] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-18T19:54:35.894240] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-18T19:54:35.894323] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-18T19:54:35.894538] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-18T19:54:35.894577] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-18T19:54:35.895028] [DEBUG] [LOCAL ] KKRS: Trimmed 8047 records to 5768 (keeping 200 days of data) [2025-09-18T19:54:35.937802] [DEBUG] [LOCAL ] KKRS: Primary data saved (5768 records). [2025-09-18T19:54:35.938074] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-18T19:54:35.938215] [INFO ] [MAIN ] Update Progress: 1196/2372 symbols completed. KKRS took 22.7s. Estimated remaining: 2h 51m 37s. Rate: 6.9 symbols/min [2025-09-18T19:54:36.110239] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:54:36.160169] [DEBUG] [LOCAL ] KLC: Loaded 36209 existing records from primary storage. [2025-09-18T19:54:36.160309] [INFO ] [MAIN ] KLC: Loaded 36209 existing records. [2025-09-18T19:54:36.338196] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:54:36.338541] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-18T19:54:36.338591] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-18T19:54:36.339854] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-18T19:54:36.339926] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-18T19:54:36.527830] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-18T19:54:36.719441] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:54:36.879803] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:54:36.880251] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-18T19:54:37.319498] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-11. [2025-09-18T19:54:37.522276] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:54:37.522621] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-11 [2025-09-18T19:54:37.606570] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-18T19:54:38.119576] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-11. [2025-09-18T19:54:38.919588] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-18T19:54:39.211530] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T19:54:39.345376] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:54:39.345849] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-18T19:54:39.719539] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-09-18T19:54:39.942831] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:54:39.943175] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-09-18T19:54:40.519584] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-09-18T19:54:40.720351] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:54:40.720748] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-09-18T19:54:41.319552] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-02. [2025-09-18T19:54:41.507272] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:54:41.507602] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-02 [2025-09-18T19:54:42.119543] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-18T19:54:42.919562] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-09-18T19:54:43.719573] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-03. [2025-09-18T19:54:44.119235] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:54:44.119681] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-03 [2025-09-18T19:54:44.155985] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-18T19:54:44.267255] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-18T19:54:44.519543] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-09-18T19:54:45.319610] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-02. [2025-09-18T19:54:45.551076] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:54:45.551416] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-02 [2025-09-18T19:54:45.590805] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-18T19:54:46.119545] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-03. [2025-09-18T19:54:46.355146] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:54:46.355505] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-03 [2025-09-18T19:54:46.919565] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-04. [2025-09-18T19:54:47.174499] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:54:47.174767] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-04 [2025-09-18T19:54:47.719570] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-18T19:54:48.519544] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-18T19:54:49.295956] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-18T19:54:49.319489] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-18T19:54:49.597637] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-18T19:54:50.119606] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-18T19:54:50.919582] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-05. [2025-09-18T19:54:51.207284] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-18T19:54:51.233186] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-18T19:54:51.248582] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-18T19:54:51.719568] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-18T19:54:52.519558] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-04. [2025-09-18T19:54:52.706455] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:54:52.706803] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-04 [2025-09-18T19:54:53.319552] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-05. [2025-09-18T19:54:53.380167] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-18T19:54:53.521920] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:54:53.522245] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-05 [2025-09-18T19:54:54.119548] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-06. [2025-09-18T19:54:54.336956] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:54:54.337362] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-06 [2025-09-18T19:54:54.919558] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-18T19:54:55.719593] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-07. [2025-09-18T19:54:56.368854] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:54:56.369244] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-07 [2025-09-18T19:54:56.400406] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-18T19:54:56.519533] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-08. [2025-09-18T19:54:56.751058] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:54:56.751424] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-08 [2025-09-18T19:54:57.319547] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-09. [2025-09-18T19:54:58.119585] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-06. [2025-09-18T19:54:58.383326] [INFO ] [REMOTE ] KLAR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-18T19:54:58.387300] [INFO ] [REMOTE ] KLAR: Full fetch complete (2511 records). [2025-09-18T19:54:58.387406] [DEBUG] [VALIDATOR ] KLAR: Validating primary data. [2025-09-18T19:54:58.577095] [WARN ] [VALIDATOR ] KLAR: Validation failed - insufficient historical data. Have 7 unique days, need 200 days [2025-09-18T19:54:58.577311] [FATAL] [MAIN ] KLAR: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:54:58.577394] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:54:58.577471] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-18T19:54:58.577561] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-18T19:54:58.577630] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-18T19:54:58.577746] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-18T19:54:58.577850] [INFO ] [MAIN ] Update Progress: 1197/2372 symbols completed. KLAR took 25.2s. Estimated remaining: 2h 51m 42s. Rate: 6.8 symbols/min [2025-09-18T19:54:58.919544] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-18T19:54:59.264527] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-18T19:54:59.719563] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-07. [2025-09-18T19:55:00.020511] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-18T19:55:00.488345] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-18T19:55:00.519499] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-08. [2025-09-18T19:55:01.228596] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-18T19:55:01.319542] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-09. [2025-09-18T19:55:02.041544] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-18T19:55:02.044240] [INFO ] [REMOTE ] KKRT: Full fetch complete (8148 records). [2025-09-18T19:55:02.044337] [DEBUG] [VALIDATOR ] KKRT: Validating primary data. [2025-09-18T19:55:02.124681] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-18T19:55:02.258851] [WARN ] [VALIDATOR ] KKRT: Validation failed - insufficient historical data. Have 77 unique days, need 200 days [2025-09-18T19:55:02.259237] [FATAL] [MAIN ] KKRT: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:55:02.259367] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:55:02.259460] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-18T19:55:02.259542] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-18T19:55:02.259597] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-18T19:55:02.259697] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-18T19:55:02.259802] [INFO ] [MAIN ] Update Progress: 1198/2372 symbols completed. KKRT took 30.5s. Estimated remaining: 2h 51m 29s. Rate: 6.8 symbols/min [2025-09-18T19:55:02.919564] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-18T19:55:03.319515] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-18T19:55:03.719590] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-18T19:55:04.824562] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-18T19:55:04.833345] [INFO ] [REMOTE ] KKR: Full fetch complete (77302 records). [2025-09-18T19:55:04.833468] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-18T19:55:05.244321] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-18T19:55:05.269908] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-09-18T19:55:05.269987] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-09-18T19:55:05.271116] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-09-18T19:55:05.271233] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-09-18T19:55:05.271551] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-18T19:55:05.273537] [DEBUG] [LOCAL ] KKR: Trimmed 77302 records to 53901 (keeping 200 days of data) [2025-09-18T19:55:05.621329] [DEBUG] [LOCAL ] KKR: Primary data saved (53901 records). [2025-09-18T19:55:05.621466] [INFO ] [MAIN ] KKR: Full history saved. [2025-09-18T19:55:05.621580] [INFO ] [MAIN ] Update Progress: 1199/2372 symbols completed. KKR took 55.3s. Estimated remaining: 2h 51m 14s. Rate: 6.8 symbols/min [2025-09-18T19:55:06.769217] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-18T19:55:06.777445] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-18T19:55:08.049853] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-18T19:55:08.055129] [INFO ] [REMOTE ] KLC: Full fetch complete (50672 records). [2025-09-18T19:55:08.055246] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-18T19:55:08.440970] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-18T19:55:08.441071] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-18T19:55:08.441823] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-18T19:55:08.441885] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-18T19:55:08.442942] [DEBUG] [LOCAL ] KLC: Trimmed 50672 records to 36441 (keeping 200 days of data) [2025-09-18T19:55:08.661170] [DEBUG] [LOCAL ] KLC: Primary data saved (36441 records). [2025-09-18T19:55:08.661317] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-18T19:55:08.661404] [INFO ] [MAIN ] Update Progress: 1200/2372 symbols completed. KLC took 32.7s. Estimated remaining: 2h 51m 0s. Rate: 6.9 symbols/min [2025-09-18T19:55:09.236184] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:55:09.321850] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:55:09.315472] [INFO ] [MAIN ] KLG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:55:09.369317] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:55:09.379250] [DEBUG] [LOCAL ] KMPB: Loaded 3628 existing records from primary storage. [2025-09-18T19:55:09.379686] [INFO ] [MAIN ] KMPB: Loaded 3628 existing records. [2025-09-18T19:55:09.614249] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:55:09.614739] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-18T19:55:09.614829] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-18T19:55:09.615893] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-18T19:55:09.616296] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-18T19:55:09.761244] [DEBUG] [LOCAL ] KLG: Loaded 41953 existing records from primary storage. [2025-09-18T19:55:09.732062] [DEBUG] [LOCAL ] KMPR: Loaded 37775 existing records from primary storage. [2025-09-18T19:55:09.761995] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-09-18T19:55:09.762317] [INFO ] [MAIN ] KMPR: Loaded 37775 existing records. [2025-09-18T19:55:09.762892] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-09-18T19:55:09.773467] [INFO ] [MAIN ] KLG: Loaded 41953 existing records. [2025-09-18T19:55:10.429841] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:55:10.477776] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:55:10.519081] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-18T19:55:10.538024] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-18T19:55:10.538194] [WARN ] [MAIN ] KLG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:55:10.572177] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-09-18T19:55:10.572520] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-18T19:55:10.572330] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-18T19:55:10.606532] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-18T19:55:10.572444] [INFO ] [MAIN ] KLG: Wiping existing primary data before full refresh. [2025-09-18T19:55:10.622872] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:55:10.619736] [INFO ] [LOCAL ] KLG: Starting deletion of primary data. [2025-09-18T19:55:10.637339] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-18T19:55:10.637759] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-11. [2025-09-18T19:55:10.643858] [DEBUG] [LOCAL ] KLG: Deleted primary data file. [2025-09-18T19:55:10.649075] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-18T19:55:10.650149] [INFO ] [MAIN ] KLG: Starting full primary refresh. [2025-09-18T19:55:11.346467] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-18T19:55:11.433585] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-09-18T19:55:11.617726] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:55:11.641839] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-11. [2025-09-18T19:55:11.720279] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:55:11.740532] [INFO ] [REMOTE ] KLG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:55:11.740820] [INFO ] [REMOTE ] KLG: Fetching primary data for 2024-11. [2025-09-18T19:55:11.741805] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-11. [2025-09-18T19:55:12.036410] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-18T19:55:12.037898] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-09-18T19:55:12.319030] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-18T19:55:12.320199] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-18T19:55:12.700663] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-18T19:55:12.701931] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-18T19:55:12.917394] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-18T19:55:12.924234] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-09-18T19:55:13.073362] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-18T19:55:13.186502] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-18T19:55:13.319500] [INFO ] [REMOTE ] KLG: Fetching primary data for 2024-12. [2025-09-18T19:55:13.384573] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-18T19:55:13.993168] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-18T19:55:14.119509] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-09-18T19:55:14.899984] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-18T19:55:14.919493] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-01. [2025-09-18T19:55:14.963385] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T19:55:15.719555] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-18T19:55:16.225336] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-18T19:55:16.519548] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-09-18T19:55:16.770884] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-18T19:55:17.319558] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-02. [2025-09-18T19:55:18.119576] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-18T19:55:18.539239] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-18T19:55:18.596256] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-18T19:55:18.656745] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-18T19:55:18.919565] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-18T19:55:19.375898] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-18T19:55:19.719544] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-18T19:55:20.212052] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-18T19:55:20.519554] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-09-18T19:55:21.319540] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-18T19:55:21.772053] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-18T19:55:22.119545] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-18T19:55:22.703020] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-18T19:55:22.919535] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-18T19:55:23.136402] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-18T19:55:23.719554] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-03. [2025-09-18T19:55:24.519534] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-18T19:55:24.620735] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-18T19:55:24.906049] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-18T19:55:25.161043] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-18T19:55:25.319539] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-04. [2025-09-18T19:55:26.119548] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-18T19:55:26.671335] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-18T19:55:26.919542] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-05. [2025-09-18T19:55:27.119964] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-18T19:55:27.719539] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-18T19:55:28.405579] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T19:55:28.519551] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-18T19:55:28.618534] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-18T19:55:29.319573] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-06. [2025-09-18T19:55:30.119519] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-18T19:55:30.374289] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-18T19:55:30.593807] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-18T19:55:30.723732] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-18T19:55:30.724782] [INFO ] [REMOTE ] KMPB: Full fetch complete (4838 records). [2025-09-18T19:55:30.724858] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-18T19:55:30.927903] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-18T19:55:31.095267] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-18T19:55:31.095362] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-18T19:55:31.095529] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-18T19:55:31.095570] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-18T19:55:31.096039] [DEBUG] [LOCAL ] KMPB: Trimmed 4838 records to 3640 (keeping 200 days of data) [2025-09-18T19:55:31.119517] [DEBUG] [LOCAL ] KMPB: Primary data saved (3640 records). [2025-09-18T19:55:31.119681] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-18T19:55:31.119839] [INFO ] [MAIN ] Update Progress: 1201/2372 symbols completed. KMPB took 22.5s. Estimated remaining: 2h 51m 5s. Rate: 6.8 symbols/min [2025-09-18T19:55:31.312798] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:55:31.361316] [DEBUG] [LOCAL ] KMT: Loaded 43208 existing records from primary storage. [2025-09-18T19:55:31.361464] [INFO ] [MAIN ] KMT: Loaded 43208 existing records. [2025-09-18T19:55:31.549356] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:55:31.549717] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-18T19:55:31.549777] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-18T19:55:31.551077] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-18T19:55:31.551143] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-18T19:55:31.724679] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-07. [2025-09-18T19:55:32.065245] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:55:32.437555] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-18T19:55:32.519601] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-18T19:55:33.325148] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-11. [2025-09-18T19:55:33.342906] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-18T19:55:33.817005] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-18T19:55:34.119616] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-08. [2025-09-18T19:55:34.484214] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-18T19:55:34.919594] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-18T19:55:35.572104] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T19:55:35.719548] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-09. [2025-09-18T19:55:36.519556] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-09-18T19:55:36.647252] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-18T19:55:36.758722] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-18T19:55:36.764339] [INFO ] [REMOTE ] KLG: Full fetch complete (61796 records). [2025-09-18T19:55:36.764453] [DEBUG] [VALIDATOR ] KLG: Validating primary data. [2025-09-18T19:55:37.156871] [DEBUG] [VALIDATOR ] KLG: All expected trading days are present. [2025-09-18T19:55:37.156969] [DEBUG] [VALIDATOR ] KLG: Primary data validation passed. [2025-09-18T19:55:37.157810] [INFO ] [MAIN ] KLG: Fetched primary data is valid. [2025-09-18T19:55:37.157873] [DEBUG] [LOCAL ] KLG: Saving primary data. [2025-09-18T19:55:37.159573] [DEBUG] [LOCAL ] KLG: Trimmed 61796 records to 42255 (keeping 200 days of data) [2025-09-18T19:55:37.332127] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-18T19:55:37.417329] [DEBUG] [LOCAL ] KLG: Primary data saved (42255 records). [2025-09-18T19:55:37.417453] [INFO ] [MAIN ] KLG: Full history saved. [2025-09-18T19:55:37.417536] [INFO ] [MAIN ] Update Progress: 1202/2372 symbols completed. KLG took 28.8s. Estimated remaining: 2h 50m 54s. Rate: 6.8 symbols/min [2025-09-18T19:55:37.640735] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:55:37.697185] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-18T19:55:37.722086] [DEBUG] [LOCAL ] KMX: Loaded 53095 existing records from primary storage. [2025-09-18T19:55:37.722227] [INFO ] [MAIN ] KMX: Loaded 53095 existing records. [2025-09-18T19:55:37.902334] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:55:37.902593] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-18T19:55:37.902677] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-18T19:55:37.904252] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-18T19:55:37.904318] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-18T19:55:38.127729] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-18T19:55:38.268388] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:55:38.919586] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-09-18T19:55:39.042526] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-18T19:55:39.719603] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-18T19:55:39.999139] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-18T19:55:40.073164] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T19:55:40.519617] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-11. [2025-09-18T19:55:41.319560] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-18T19:55:41.421394] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-18T19:55:41.427619] [INFO ] [REMOTE ] KMPR: Full fetch complete (49863 records). [2025-09-18T19:55:41.427825] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-18T19:55:41.811589] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-18T19:55:41.811695] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-18T19:55:41.812420] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-18T19:55:41.812464] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-18T19:55:41.813614] [DEBUG] [LOCAL ] KMPR: Trimmed 49863 records to 38088 (keeping 200 days of data) [2025-09-18T19:55:41.946369] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T19:55:42.092785] [DEBUG] [LOCAL ] KMPR: Primary data saved (38088 records). [2025-09-18T19:55:42.092960] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-18T19:55:42.093059] [INFO ] [MAIN ] Update Progress: 1203/2372 symbols completed. KMPR took 33.4s. Estimated remaining: 2h 50m 41s. Rate: 6.8 symbols/min [2025-09-18T19:55:42.124913] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-09-18T19:55:42.269419] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:55:42.308474] [DEBUG] [LOCAL ] KN: Loaded 39090 existing records from primary storage. [2025-09-18T19:55:42.308632] [INFO ] [MAIN ] KN: Loaded 39090 existing records. [2025-09-18T19:55:42.502406] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:55:42.502791] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-18T19:55:42.502902] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-18T19:55:42.503930] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-18T19:55:42.503990] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-18T19:55:42.679585] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-18T19:55:42.908704] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:55:42.919507] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-11. [2025-09-18T19:55:43.689734] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-18T19:55:43.719503] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-09-18T19:55:44.072304] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-18T19:55:44.519582] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-09-18T19:55:45.319601] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-18T19:55:45.386528] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-18T19:55:45.714581] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-18T19:55:46.119604] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-18T19:55:46.507928] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-18T19:55:46.919566] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-09-18T19:55:47.444051] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-18T19:55:47.719549] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-18T19:55:48.513445] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-18T19:55:48.521045] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-18T19:55:49.282698] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-18T19:55:49.319613] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-18T19:55:49.887633] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-18T19:55:50.119513] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-18T19:55:50.919567] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-18T19:55:51.055202] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-18T19:55:51.319599] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-18T19:55:51.719545] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-18T19:55:52.519574] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-18T19:55:52.675343] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-18T19:55:53.212778] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T19:55:53.319519] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-18T19:55:53.525487] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T19:55:54.119557] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-18T19:55:54.588846] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-18T19:55:54.919550] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-18T19:55:55.719885] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-18T19:55:55.724753] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-18T19:55:55.734106] [INFO ] [REMOTE ] KMI: Full fetch complete (77658 records). [2025-09-18T19:55:55.734297] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-18T19:55:56.171014] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-09-18T19:55:56.171142] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-09-18T19:55:56.172127] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-09-18T19:55:56.172194] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-09-18T19:55:56.174066] [DEBUG] [LOCAL ] KMI: Trimmed 77658 records to 54083 (keeping 200 days of data) [2025-09-18T19:55:56.519985] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-18T19:55:56.560751] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T19:55:56.587795] [DEBUG] [LOCAL ] KMI: Primary data saved (54083 records). [2025-09-18T19:55:56.587931] [INFO ] [MAIN ] KMI: Full history saved. [2025-09-18T19:55:56.589168] [INFO ] [MAIN ] Update Progress: 1204/2372 symbols completed. KMI took 47.9s. Estimated remaining: 2h 50m 38s. Rate: 6.8 symbols/min [2025-09-18T19:55:56.760504] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:55:56.799040] [DEBUG] [LOCAL ] KNF: Loaded 35717 existing records from primary storage. [2025-09-18T19:55:56.799209] [INFO ] [MAIN ] KNF: Loaded 35717 existing records. [2025-09-18T19:55:56.984710] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:55:56.985176] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-18T19:55:56.985340] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-18T19:55:56.986561] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-18T19:55:56.986630] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-18T19:55:57.161992] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-18T19:55:57.320252] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-18T19:55:57.398245] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:55:57.790317] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-18T19:55:58.119574] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-11. [2025-09-18T19:55:58.768464] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T19:55:58.919565] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-18T19:55:59.208687] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T19:55:59.719552] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-09-18T19:56:00.115099] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-18T19:56:00.519725] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-18T19:56:01.063781] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T19:56:01.319579] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-18T19:56:02.119573] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-18T19:56:02.188143] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-18T19:56:02.722769] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-18T19:56:02.919598] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-18T19:56:03.282032] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-18T19:56:03.719588] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-18T19:56:04.224721] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-18T19:56:04.519539] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-18T19:56:05.319559] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-18T19:56:05.470573] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-18T19:56:05.804578] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-18T19:56:06.119561] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-18T19:56:06.583868] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-18T19:56:06.590581] [INFO ] [REMOTE ] KMT: Full fetch complete (61784 records). [2025-09-18T19:56:06.590744] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-18T19:56:06.930367] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-18T19:56:06.987238] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-18T19:56:06.987320] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-18T19:56:06.988227] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-18T19:56:06.988293] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-18T19:56:06.989743] [DEBUG] [LOCAL ] KMT: Trimmed 61784 records to 43538 (keeping 200 days of data) [2025-09-18T19:56:07.260237] [DEBUG] [LOCAL ] KMT: Primary data saved (43538 records). [2025-09-18T19:56:07.260434] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-18T19:56:07.260545] [INFO ] [MAIN ] Update Progress: 1205/2372 symbols completed. KMT took 36.1s. Estimated remaining: 2h 50m 31s. Rate: 6.8 symbols/min [2025-09-18T19:56:07.439031] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:56:07.451503] [DEBUG] [LOCAL ] KNOP: Loaded 9935 existing records from primary storage. [2025-09-18T19:56:07.451626] [INFO ] [MAIN ] KNOP: Loaded 9935 existing records. [2025-09-18T19:56:07.636884] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:56:07.637149] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-18T19:56:07.637197] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-18T19:56:07.637714] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-18T19:56:07.637776] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-18T19:56:07.722830] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-09-18T19:56:08.018889] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:56:08.050141] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-18T19:56:08.335088] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-18T19:56:08.340979] [INFO ] [REMOTE ] KN: Full fetch complete (56139 records). [2025-09-18T19:56:08.341120] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-18T19:56:08.525475] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-18T19:56:08.744356] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-18T19:56:08.744449] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-18T19:56:08.745359] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-18T19:56:08.745426] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-18T19:56:08.746970] [DEBUG] [LOCAL ] KN: Trimmed 56139 records to 39405 (keeping 200 days of data) [2025-09-18T19:56:08.876972] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T19:56:09.014238] [DEBUG] [LOCAL ] KN: Primary data saved (39405 records). [2025-09-18T19:56:09.014390] [INFO ] [MAIN ] KN: Full history saved. [2025-09-18T19:56:09.014477] [INFO ] [MAIN ] Update Progress: 1206/2372 symbols completed. KN took 26.9s. Estimated remaining: 2h 50m 15s. Rate: 6.8 symbols/min [2025-09-18T19:56:09.185923] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:56:09.206636] [DEBUG] [LOCAL ] KNSL: Loaded 18097 existing records from primary storage. [2025-09-18T19:56:09.206792] [INFO ] [MAIN ] KNSL: Loaded 18097 existing records. [2025-09-18T19:56:09.324616] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-18T19:56:09.391396] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:56:09.391704] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-18T19:56:09.391773] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-18T19:56:09.392471] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-18T19:56:09.392531] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-18T19:56:09.768299] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:56:10.119599] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-11. [2025-09-18T19:56:10.199143] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-18T19:56:10.697131] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-18T19:56:10.767556] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-18T19:56:10.919560] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-09-18T19:56:11.692282] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-18T19:56:11.719540] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-09-18T19:56:12.329373] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-18T19:56:12.519560] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-11. [2025-09-18T19:56:13.319539] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-18T19:56:13.380333] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-18T19:56:14.050223] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-18T19:56:14.119579] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-18T19:56:14.919547] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-18T19:56:15.597566] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T19:56:15.614558] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-18T19:56:15.719547] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-18T19:56:16.519543] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-18T19:56:17.092901] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-18T19:56:17.319561] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-18T19:56:18.119514] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-18T19:56:18.197528] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-18T19:56:18.205573] [INFO ] [REMOTE ] KMX: Full fetch complete (75725 records). [2025-09-18T19:56:18.205776] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-18T19:56:18.606615] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-18T19:56:18.606761] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-18T19:56:18.607820] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-18T19:56:18.607915] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-18T19:56:18.616148] [DEBUG] [LOCAL ] KMX: Trimmed 75725 records to 53480 (keeping 200 days of data) [2025-09-18T19:56:18.629133] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-18T19:56:18.736631] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-18T19:56:18.940876] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-18T19:56:18.968774] [DEBUG] [LOCAL ] KMX: Primary data saved (53480 records). [2025-09-18T19:56:18.968911] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-18T19:56:18.969025] [INFO ] [MAIN ] Update Progress: 1207/2372 symbols completed. KMX took 41.6s. Estimated remaining: 2h 50m 8s. Rate: 6.8 symbols/min [2025-09-18T19:56:19.138994] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:56:19.183040] [DEBUG] [LOCAL ] KNTK: Loaded 46122 existing records from primary storage. [2025-09-18T19:56:19.183193] [INFO ] [MAIN ] KNTK: Loaded 46122 existing records. [2025-09-18T19:56:19.360508] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:56:19.360837] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-18T19:56:19.360904] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-18T19:56:19.362197] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-18T19:56:19.362261] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-18T19:56:19.723115] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-09-18T19:56:19.746370] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:56:20.181262] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T19:56:20.448260] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-18T19:56:20.519544] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-09-18T19:56:21.319506] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-11. [2025-09-18T19:56:21.615697] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-18T19:56:22.119544] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-18T19:56:22.505128] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-18T19:56:22.919556] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-18T19:56:23.241796] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-18T19:56:23.719550] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-09-18T19:56:23.921776] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-18T19:56:24.519614] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-18T19:56:24.823340] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-18T19:56:25.319579] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-18T19:56:25.534613] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-18T19:56:26.119551] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-18T19:56:26.532479] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-18T19:56:26.676724] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-18T19:56:26.919547] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-18T19:56:27.661622] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-18T19:56:27.719558] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-18T19:56:28.400900] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-18T19:56:28.519494] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-18T19:56:29.294327] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-18T19:56:29.319507] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-09-18T19:56:30.119543] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-18T19:56:30.735456] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-18T19:56:30.919567] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-18T19:56:31.403299] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-18T19:56:31.408746] [INFO ] [REMOTE ] KNF: Full fetch complete (49968 records). [2025-09-18T19:56:31.408872] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-18T19:56:31.724714] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-18T19:56:31.796704] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-18T19:56:31.797069] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-18T19:56:31.798339] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-18T19:56:31.798426] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-18T19:56:31.799744] [DEBUG] [LOCAL ] KNF: Trimmed 49968 records to 36005 (keeping 200 days of data) [2025-09-18T19:56:32.022622] [DEBUG] [LOCAL ] KNF: Primary data saved (36005 records). [2025-09-18T19:56:32.022820] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-18T19:56:32.024431] [INFO ] [MAIN ] Update Progress: 1208/2372 symbols completed. KNF took 35.4s. Estimated remaining: 2h 50m 3s. Rate: 6.8 symbols/min [2025-09-18T19:56:32.197063] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:56:32.254538] [DEBUG] [LOCAL ] KNX: Loaded 52589 existing records from primary storage. [2025-09-18T19:56:32.254720] [INFO ] [MAIN ] KNX: Loaded 52589 existing records. [2025-09-18T19:56:32.453970] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:56:32.455404] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-18T19:56:32.455612] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-18T19:56:32.466108] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-18T19:56:32.483981] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-18T19:56:32.531417] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-18T19:56:32.520850] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-18T19:56:32.614848] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-18T19:56:32.643593] [INFO ] [REMOTE ] KNOP: Full fetch complete (14710 records). [2025-09-18T19:56:32.677842] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-18T19:56:33.133599] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:56:33.255554] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-18T19:56:33.255630] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-18T19:56:33.256004] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-18T19:56:33.256052] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-18T19:56:33.257146] [DEBUG] [LOCAL ] KNOP: Trimmed 14710 records to 9985 (keeping 200 days of data) [2025-09-18T19:56:33.315236] [DEBUG] [LOCAL ] KNOP: Primary data saved (9985 records). [2025-09-18T19:56:33.315363] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-18T19:56:33.315481] [INFO ] [MAIN ] Update Progress: 1209/2372 symbols completed. KNOP took 26.1s. Estimated remaining: 2h 49m 47s. Rate: 6.8 symbols/min [2025-09-18T19:56:33.326913] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-11. [2025-09-18T19:56:33.501171] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:56:33.561515] [DEBUG] [LOCAL ] KO: Loaded 53818 existing records from primary storage. [2025-09-18T19:56:33.561676] [INFO ] [MAIN ] KO: Loaded 53818 existing records. [2025-09-18T19:56:33.746047] [WARN ] [MAIN ] KO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:56:33.746452] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-18T19:56:33.746592] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-18T19:56:33.753287] [DEBUG] [LOCAL ] KO: Deleted primary data file. [2025-09-18T19:56:33.760856] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-18T19:56:33.803699] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-18T19:56:34.150874] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:56:34.145430] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-18T19:56:34.699375] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-18T19:56:34.919571] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-09-18T19:56:35.174032] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-18T19:56:35.719556] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-11. [2025-09-18T19:56:36.392094] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-18T19:56:36.519524] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-09-18T19:56:37.319598] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-18T19:56:37.935366] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-18T19:56:38.119558] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-18T19:56:38.279554] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-11 (2.56 seconds). [2025-09-18T19:56:38.507203] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-18T19:56:38.919548] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-18T19:56:39.520591] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T19:56:39.719511] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-18T19:56:39.755107] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-18T19:56:40.519548] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-18T19:56:41.046545] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-18T19:56:41.319520] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-18T19:56:41.689297] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T19:56:42.119595] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-18T19:56:42.895415] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-18T19:56:42.919518] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-18T19:56:42.948777] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-18T19:56:43.719614] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-18T19:56:44.400722] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-18T19:56:44.519552] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-18T19:56:45.075738] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-18T19:56:45.319624] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-18T19:56:46.094469] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T19:56:46.119510] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-18T19:56:46.919582] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-18T19:56:47.723448] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-18T19:56:47.740582] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-18T19:56:47.790469] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-18T19:56:48.193950] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-18T19:56:48.472014] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-18T19:56:48.475047] [INFO ] [REMOTE ] KNSL: Full fetch complete (26593 records). [2025-09-18T19:56:48.475165] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-18T19:56:48.524736] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-18T19:56:48.865099] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-18T19:56:48.865188] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-18T19:56:48.865826] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-18T19:56:48.865922] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-18T19:56:48.866624] [DEBUG] [LOCAL ] KNSL: Trimmed 26593 records to 18273 (keeping 200 days of data) [2025-09-18T19:56:48.998025] [DEBUG] [LOCAL ] KNSL: Primary data saved (18273 records). [2025-09-18T19:56:48.998194] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-18T19:56:48.998370] [INFO ] [MAIN ] Update Progress: 1210/2372 symbols completed. KNSL took 40.0s. Estimated remaining: 2h 49m 45s. Rate: 6.8 symbols/min [2025-09-18T19:56:49.180459] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:56:49.234885] [DEBUG] [LOCAL ] KODK: Loaded 43470 existing records from primary storage. [2025-09-18T19:56:49.235090] [INFO ] [MAIN ] KODK: Loaded 43470 existing records. [2025-09-18T19:56:49.329829] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-18T19:56:49.424057] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:56:49.424358] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-18T19:56:49.424425] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-18T19:56:49.425452] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-18T19:56:49.425528] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-18T19:56:49.790037] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:56:50.119551] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-11. [2025-09-18T19:56:50.219934] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-18T19:56:50.919550] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-18T19:56:51.377846] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-18T19:56:51.533824] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-18T19:56:51.719571] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-09-18T19:56:52.325789] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-18T19:56:52.519602] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-18T19:56:53.252600] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-18T19:56:53.319558] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-18T19:56:54.119602] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-18T19:56:54.445264] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-18T19:56:54.919612] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-18T19:56:55.355219] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-18T19:56:55.361818] [INFO ] [REMOTE ] KNTK: Full fetch complete (63587 records). [2025-09-18T19:56:55.361934] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-18T19:56:55.735519] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-09-18T19:56:55.848293] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-18T19:56:55.848419] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-18T19:56:55.849427] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-18T19:56:55.849570] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-18T19:56:55.852081] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-09-18T19:56:55.862770] [DEBUG] [LOCAL ] KNTK: Trimmed 63587 records to 46485 (keeping 200 days of data) [2025-09-18T19:56:56.165158] [DEBUG] [LOCAL ] KNTK: Primary data saved (46485 records). [2025-09-18T19:56:56.165300] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-18T19:56:56.165418] [INFO ] [MAIN ] Update Progress: 1211/2372 symbols completed. KNTK took 37.2s. Estimated remaining: 2h 49m 35s. Rate: 6.8 symbols/min [2025-09-18T19:56:56.346013] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:56:56.374574] [DEBUG] [LOCAL ] KOF: Loaded 25967 existing records from primary storage. [2025-09-18T19:56:56.374765] [INFO ] [MAIN ] KOF: Loaded 25967 existing records. [2025-09-18T19:56:56.529736] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-18T19:56:56.556140] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T19:56:56.605718] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:56:56.606241] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-18T19:56:56.606318] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-18T19:56:56.607264] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-18T19:56:56.607327] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-18T19:56:56.970168] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:56:57.319563] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-11. [2025-09-18T19:56:57.407783] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-18T19:56:58.119518] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-18T19:56:58.197956] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-18T19:56:58.897130] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-18T19:56:58.919493] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-18T19:56:59.446681] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T19:56:59.719547] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-18T19:57:00.519549] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-09-18T19:57:01.276967] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-18T19:57:01.319545] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-18T19:57:01.453990] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-18T19:57:01.512278] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-18T19:57:01.522842] [INFO ] [REMOTE ] KNX: Full fetch complete (75465 records). [2025-09-18T19:57:01.523044] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-18T19:57:01.956222] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-18T19:57:01.956571] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-18T19:57:01.957586] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-18T19:57:01.957697] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-18T19:57:01.960106] [DEBUG] [LOCAL ] KNX: Trimmed 75465 records to 52977 (keeping 200 days of data) [2025-09-18T19:57:02.155405] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-18T19:57:02.311331] [DEBUG] [LOCAL ] KNX: Primary data saved (52977 records). [2025-09-18T19:57:02.311475] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-18T19:57:02.312294] [INFO ] [MAIN ] Update Progress: 1212/2372 symbols completed. KNX took 30.3s. Estimated remaining: 2h 49m 23s. Rate: 6.8 symbols/min [2025-09-18T19:57:02.486756] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:57:02.509245] [DEBUG] [LOCAL ] KOP: Loaded 18043 existing records from primary storage. [2025-09-18T19:57:02.509381] [INFO ] [MAIN ] KOP: Loaded 18043 existing records. [2025-09-18T19:57:02.694809] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:57:02.695109] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-18T19:57:02.695163] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-18T19:57:02.695959] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-18T19:57:02.696020] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-18T19:57:02.929927] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-09-18T19:57:03.085848] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:57:03.719557] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-11. [2025-09-18T19:57:04.526006] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (3.21 seconds). [2025-09-18T19:57:04.537592] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-18T19:57:04.805201] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T19:57:04.901993] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-09-18T19:57:05.231621] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-18T19:57:05.319531] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-18T19:57:06.119584] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-18T19:57:06.370434] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-18T19:57:06.892405] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-18T19:57:06.919504] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-18T19:57:07.372374] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-18T19:57:07.719546] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-18T19:57:08.519547] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-18T19:57:09.319553] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-09-18T19:57:09.417736] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-18T19:57:09.477799] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-18T19:57:09.502731] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-18T19:57:10.077126] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-18T19:57:10.119495] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-18T19:57:10.919585] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-09-18T19:57:11.567398] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T19:57:11.587502] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-18T19:57:11.719553] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-18T19:57:12.519602] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-18T19:57:13.319561] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-18T19:57:13.638798] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-18T19:57:14.119556] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-18T19:57:14.919568] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-18T19:57:15.214378] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-18T19:57:15.401752] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-09-18T19:57:15.494303] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-18T19:57:15.584945] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-18T19:57:15.719508] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-18T19:57:16.519612] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-18T19:57:17.319604] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-18T19:57:17.450757] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-18T19:57:18.085328] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-18T19:57:18.119501] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-18T19:57:18.924665] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-18T19:57:18.937363] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-18T19:57:18.947026] [INFO ] [REMOTE ] KO: Full fetch complete (77993 records). [2025-09-18T19:57:18.947188] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-18T19:57:19.399777] [DEBUG] [VALIDATOR ] KO: All expected trading days are present. [2025-09-18T19:57:19.400376] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-18T19:57:19.400629] [DEBUG] [VALIDATOR ] KO: Primary data validation passed. [2025-09-18T19:57:19.406686] [INFO ] [MAIN ] KO: Fetched primary data is valid. [2025-09-18T19:57:19.407309] [DEBUG] [LOCAL ] KO: Saving primary data. [2025-09-18T19:57:19.409335] [DEBUG] [LOCAL ] KO: Trimmed 77993 records to 54208 (keeping 200 days of data) [2025-09-18T19:57:19.742960] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-18T19:57:19.799314] [DEBUG] [LOCAL ] KO: Primary data saved (54208 records). [2025-09-18T19:57:19.799481] [INFO ] [MAIN ] KO: Full history saved. [2025-09-18T19:57:19.799600] [INFO ] [MAIN ] Update Progress: 1213/2372 symbols completed. KO took 46.5s. Estimated remaining: 2h 49m 23s. Rate: 6.8 symbols/min [2025-09-18T19:57:19.980624] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:57:20.001601] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-18T19:57:20.004379] [DEBUG] [LOCAL ] KORE: Loaded 1946 existing records from primary storage. [2025-09-18T19:57:20.004683] [INFO ] [MAIN ] KORE: Loaded 1946 existing records. [2025-09-18T19:57:20.192210] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:57:20.192527] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-18T19:57:20.192608] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-18T19:57:20.192922] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-18T19:57:20.192994] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-18T19:57:20.528280] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-18T19:57:20.559826] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:57:20.838614] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-18T19:57:21.319609] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-11. [2025-09-18T19:57:21.738946] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-18T19:57:22.045761] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-18T19:57:22.119528] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-18T19:57:22.919538] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-18T19:57:22.959763] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-18T19:57:23.719581] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-09-18T19:57:23.908912] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-18T19:57:24.519554] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-18T19:57:24.767074] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T19:57:25.319540] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-18T19:57:25.651186] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-18T19:57:25.655345] [INFO ] [REMOTE ] KOF: Full fetch complete (36994 records). [2025-09-18T19:57:25.655425] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-18T19:57:26.034371] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-18T19:57:26.034459] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-18T19:57:26.035309] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-18T19:57:26.035377] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-18T19:57:26.036210] [DEBUG] [LOCAL ] KOF: Trimmed 36994 records to 26218 (keeping 200 days of data) [2025-09-18T19:57:26.125070] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-09-18T19:57:26.197866] [DEBUG] [LOCAL ] KOF: Primary data saved (26218 records). [2025-09-18T19:57:26.197994] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-18T19:57:26.198094] [INFO ] [MAIN ] Update Progress: 1214/2372 symbols completed. KOF took 30.0s. Estimated remaining: 2h 49m 12s. Rate: 6.8 symbols/min [2025-09-18T19:57:26.375052] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:57:26.385891] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-18T19:57:26.439824] [DEBUG] [LOCAL ] KOS: Loaded 53069 existing records from primary storage. [2025-09-18T19:57:26.439975] [INFO ] [MAIN ] KOS: Loaded 53069 existing records. [2025-09-18T19:57:26.615818] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:57:26.616044] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-18T19:57:26.616145] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-18T19:57:26.617536] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-18T19:57:26.617600] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-18T19:57:26.922919] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-18T19:57:26.925368] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-18T19:57:27.011671] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:57:27.719569] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-18T19:57:28.519575] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-18T19:57:28.636288] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-18T19:57:28.642061] [INFO ] [REMOTE ] KODK: Full fetch complete (63682 records). [2025-09-18T19:57:28.642168] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-18T19:57:28.957493] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T19:57:28.973058] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-18T19:57:29.065328] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-18T19:57:29.065444] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-18T19:57:29.066333] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-18T19:57:29.066397] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-18T19:57:29.067605] [DEBUG] [LOCAL ] KODK: Trimmed 63682 records to 43791 (keeping 200 days of data) [2025-09-18T19:57:29.313860] [DEBUG] [LOCAL ] KODK: Primary data saved (43791 records). [2025-09-18T19:57:29.314009] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-18T19:57:29.314093] [INFO ] [MAIN ] Update Progress: 1215/2372 symbols completed. KODK took 40.3s. Estimated remaining: 2h 48m 58s. Rate: 6.8 symbols/min [2025-09-18T19:57:29.325369] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-11. [2025-09-18T19:57:29.488676] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:57:29.541040] [DEBUG] [LOCAL ] KR: Loaded 53682 existing records from primary storage. [2025-09-18T19:57:29.541196] [INFO ] [MAIN ] KR: Loaded 53682 existing records. [2025-09-18T19:57:29.721692] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:57:29.721983] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-18T19:57:29.722040] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-18T19:57:29.723452] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-18T19:57:29.723513] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-18T19:57:30.074831] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:57:30.119490] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-11. [2025-09-18T19:57:30.870291] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-18T19:57:30.919495] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-09-18T19:57:31.719564] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-18T19:57:31.913156] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-18T19:57:32.001154] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-18T19:57:32.514045] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-18T19:57:32.524916] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-18T19:57:33.029761] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-18T19:57:33.319605] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-09-18T19:57:34.119573] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-18T19:57:34.518004] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-18T19:57:34.919581] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-09-18T19:57:35.255366] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-18T19:57:35.719566] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-18T19:57:36.490788] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-18T19:57:36.524520] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-09-18T19:57:36.532839] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-18T19:57:36.538629] [INFO ] [REMOTE ] KOP: Full fetch complete (25257 records). [2025-09-18T19:57:36.538860] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-18T19:57:37.088465] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-18T19:57:37.088580] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-18T19:57:37.089243] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-18T19:57:37.089308] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-18T19:57:37.090542] [DEBUG] [LOCAL ] KOP: Trimmed 25257 records to 18197 (keeping 200 days of data) [2025-09-18T19:57:37.207049] [DEBUG] [LOCAL ] KOP: Primary data saved (18197 records). [2025-09-18T19:57:37.207203] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-18T19:57:37.207290] [INFO ] [MAIN ] Update Progress: 1216/2372 symbols completed. KOP took 34.9s. Estimated remaining: 2h 48m 48s. Rate: 6.8 symbols/min [2025-09-18T19:57:37.327267] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-18T19:57:37.387900] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:57:37.438400] [DEBUG] [LOCAL ] KRC: Loaded 48440 existing records from primary storage. [2025-09-18T19:57:37.438573] [INFO ] [MAIN ] KRC: Loaded 48440 existing records. [2025-09-18T19:57:37.621791] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:57:37.622068] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-18T19:57:37.622117] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-18T19:57:37.623220] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-18T19:57:37.623290] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-18T19:57:37.978201] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:57:38.119590] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-11. [2025-09-18T19:57:38.276963] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-18T19:57:38.820905] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T19:57:38.919505] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-18T19:57:39.409830] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-18T19:57:39.719570] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-09-18T19:57:40.514101] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T19:57:40.524854] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-18T19:57:40.956380] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-18T19:57:41.033386] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T19:57:41.319604] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-09-18T19:57:42.119607] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-18T19:57:42.784518] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-18T19:57:42.816069] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-18T19:57:42.919492] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-18T19:57:43.719559] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-18T19:57:44.230367] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-18T19:57:44.519550] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-18T19:57:45.319552] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-18T19:57:45.613126] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-18T19:57:45.616555] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-18T19:57:45.947769] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T19:57:46.119504] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-18T19:57:46.919597] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-18T19:57:47.719548] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-18T19:57:48.102170] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-18T19:57:48.103226] [INFO ] [REMOTE ] KORE: Full fetch complete (6118 records). [2025-09-18T19:57:48.104983] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-18T19:57:48.103769] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-18T19:57:48.523495] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-18T19:57:48.523112] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-18T19:57:48.523717] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-18T19:57:48.525015] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-18T19:57:48.525088] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-18T19:57:48.525971] [DEBUG] [LOCAL ] KORE: Trimmed 6118 records to 1964 (keeping 200 days of data) [2025-09-18T19:57:48.538071] [DEBUG] [LOCAL ] KORE: Primary data saved (1964 records). [2025-09-18T19:57:48.538139] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-18T19:57:48.538237] [INFO ] [MAIN ] Update Progress: 1217/2372 symbols completed. KORE took 28.7s. Estimated remaining: 2h 48m 42s. Rate: 6.8 symbols/min [2025-09-18T19:57:48.753825] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:57:48.782599] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-18T19:57:48.829077] [DEBUG] [LOCAL ] KREF: Loaded 36950 existing records from primary storage. [2025-09-18T19:57:48.829216] [INFO ] [MAIN ] KREF: Loaded 36950 existing records. [2025-09-18T19:57:49.007355] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:57:49.007633] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-18T19:57:49.007753] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-18T19:57:49.008515] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-18T19:57:49.008576] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-18T19:57:49.324697] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-18T19:57:49.381881] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:57:50.119546] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-11. [2025-09-18T19:57:50.214308] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-18T19:57:50.919539] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-18T19:57:51.327909] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-18T19:57:51.357543] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-18T19:57:51.719589] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-18T19:57:52.412562] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-18T19:57:52.519509] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-18T19:57:53.319583] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-18T19:57:53.736044] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-18T19:57:54.119504] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-18T19:57:54.196354] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-18T19:57:54.662623] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-18T19:57:54.919569] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-18T19:57:55.718460] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-18T19:57:55.728165] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-09-18T19:57:56.275008] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-18T19:57:56.519547] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-18T19:57:56.842086] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T19:57:57.319566] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-09-18T19:57:58.119609] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-18T19:57:58.535888] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-18T19:57:58.575849] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-18T19:57:58.919601] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-18T19:57:59.301085] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-18T19:57:59.719585] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-18T19:58:00.519589] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-18T19:58:00.826985] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-18T19:58:01.319521] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-18T19:58:01.380182] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-18T19:58:01.968639] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T19:58:02.119607] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-18T19:58:02.919588] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-18T19:58:03.393786] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-18T19:58:03.405080] [INFO ] [REMOTE ] KR: Full fetch complete (77531 records). [2025-09-18T19:58:03.405294] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-18T19:58:03.724780] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-18T19:58:03.819329] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-18T19:58:03.819549] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-18T19:58:03.820617] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-18T19:58:03.820754] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-18T19:58:03.838775] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-18T19:58:03.838104] [DEBUG] [LOCAL ] KR: Trimmed 77531 records to 54072 (keeping 200 days of data) [2025-09-18T19:58:03.955614] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-18T19:58:03.965008] [INFO ] [REMOTE ] KOS: Full fetch complete (76692 records). [2025-09-18T19:58:03.965631] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-18T19:58:04.414872] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-18T19:58:04.415249] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-18T19:58:04.416937] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-18T19:58:04.417042] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-18T19:58:04.421796] [DEBUG] [LOCAL ] KOS: Trimmed 76692 records to 53459 (keeping 200 days of data) [2025-09-18T19:58:04.519956] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-18T19:58:04.947209] [DEBUG] [LOCAL ] KR: Primary data saved (54072 records). [2025-09-18T19:58:04.947992] [INFO ] [MAIN ] KR: Full history saved. [2025-09-18T19:58:04.948148] [INFO ] [MAIN ] Update Progress: 1218/2372 symbols completed. KR took 35.6s. Estimated remaining: 2h 48m 40s. Rate: 6.8 symbols/min [2025-09-18T19:58:05.135323] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:58:05.146133] [DEBUG] [LOCAL ] KOS: Primary data saved (53459 records). [2025-09-18T19:58:05.146288] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-18T19:58:05.146406] [INFO ] [MAIN ] Update Progress: 1219/2372 symbols completed. KOS took 38.9s. Estimated remaining: 2h 48m 23s. Rate: 6.8 symbols/min [2025-09-18T19:58:05.340463] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:58:05.340914] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-18T19:58:05.340980] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-18T19:58:05.341424] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-18T19:58:05.341496] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-18T19:58:05.341704] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-18T19:58:05.341835] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-18T19:58:05.459509] [DEBUG] [LOCAL ] KRG: Loaded 49169 existing records from primary storage. [2025-09-18T19:58:05.463381] [INFO ] [MAIN ] KRG: Loaded 49169 existing records. [2025-09-18T19:58:05.710731] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-18T19:58:05.810795] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-18T19:58:05.922940] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:58:05.956982] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-18T19:58:05.982903] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-18T19:58:05.986139] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:58:05.994958] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-18T19:58:06.010309] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-18T19:58:06.017375] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-18T19:58:06.120922] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-18T19:58:06.381186] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:58:06.919541] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-11. [2025-09-18T19:58:07.561287] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-18T19:58:07.653232] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-18T19:58:07.660038] [INFO ] [REMOTE ] KRC: Full fetch complete (69368 records). [2025-09-18T19:58:07.660159] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-18T19:58:07.724613] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-18T19:58:08.053490] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-18T19:58:08.053587] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-18T19:58:08.054500] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-18T19:58:08.054568] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-18T19:58:08.056097] [DEBUG] [LOCAL ] KRC: Trimmed 69368 records to 48795 (keeping 200 days of data) [2025-09-18T19:58:08.384403] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-18T19:58:08.402558] [DEBUG] [LOCAL ] KRC: Primary data saved (48795 records). [2025-09-18T19:58:08.402671] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-18T19:58:08.404130] [INFO ] [MAIN ] Update Progress: 1220/2372 symbols completed. KRC took 31.2s. Estimated remaining: 2h 48m 9s. Rate: 6.9 symbols/min [2025-09-18T19:58:08.524635] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-09-18T19:58:08.620228] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:58:08.647884] [DEBUG] [LOCAL ] KRO: Loaded 25757 existing records from primary storage. [2025-09-18T19:58:08.648038] [INFO ] [MAIN ] KRO: Loaded 25757 existing records. [2025-09-18T19:58:08.829932] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:58:08.830187] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-18T19:58:08.830236] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-18T19:58:08.830885] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-09-18T19:58:08.830945] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-18T19:58:09.194829] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:58:09.229318] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-18T19:58:09.319560] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-11. [2025-09-18T19:58:09.945755] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-18T19:58:10.119552] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-09-18T19:58:10.392130] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-18T19:58:10.919566] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-11. [2025-09-18T19:58:11.116795] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:58:11.117216] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-11 [2025-09-18T19:58:11.495136] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T19:58:11.719587] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-18T19:58:12.519554] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-09-18T19:58:13.182501] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T19:58:13.319624] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-18T19:58:13.508519] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-18T19:58:14.119619] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-18T19:58:14.742485] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-18T19:58:14.919584] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-18T19:58:15.470472] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T19:58:15.725903] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-18T19:58:15.739046] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-18T19:58:15.957080] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:58:15.957403] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-18T19:58:16.519613] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-18T19:58:17.319599] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-09-18T19:58:18.119606] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-18T19:58:18.157828] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T19:58:18.179467] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-18T19:58:18.919552] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-18T19:58:19.442902] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-18T19:58:19.448503] [INFO ] [REMOTE ] KREF: Full fetch complete (51507 records). [2025-09-18T19:58:19.448695] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-18T19:58:19.720462] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-09-18T19:58:19.856409] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-18T19:58:19.872917] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-18T19:58:19.873548] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-18T19:58:19.874996] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-18T19:58:19.875093] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-18T19:58:19.876251] [DEBUG] [LOCAL ] KREF: Trimmed 51507 records to 37241 (keeping 200 days of data) [2025-09-18T19:58:19.986091] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T19:58:19.988362] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-09-18T19:58:20.098542] [DEBUG] [LOCAL ] KREF: Primary data saved (37241 records). [2025-09-18T19:58:20.098711] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-18T19:58:20.098835] [INFO ] [MAIN ] Update Progress: 1221/2372 symbols completed. KREF took 31.6s. Estimated remaining: 2h 48m 3s. Rate: 6.8 symbols/min [2025-09-18T19:58:20.266637] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:58:20.306812] [DEBUG] [LOCAL ] KRP: Loaded 38029 existing records from primary storage. [2025-09-18T19:58:20.306955] [INFO ] [MAIN ] KRP: Loaded 38029 existing records. [2025-09-18T19:58:20.482512] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:58:20.482766] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-18T19:58:20.482861] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-18T19:58:20.483775] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-18T19:58:20.483853] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-18T19:58:20.527475] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-18T19:58:20.843710] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:58:21.319584] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-02. [2025-09-18T19:58:22.119524] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-11. [2025-09-18T19:58:22.263354] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-18T19:58:22.321516] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-18T19:58:22.919543] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-18T19:58:23.234539] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T19:58:23.719552] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-09-18T19:58:24.314154] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-18T19:58:24.519509] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-18T19:58:24.719563] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-18T19:58:25.319587] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-09-18T19:58:26.119565] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-03. [2025-09-18T19:58:26.204486] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-18T19:58:26.311144] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-18T19:58:26.919694] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-18T19:58:27.392965] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-18T19:58:27.719520] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-18T19:58:28.077068] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-18T19:58:28.519617] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-18T19:58:28.861395] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T19:58:29.319619] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-04. [2025-09-18T19:58:29.807271] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-18T19:58:30.119552] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-18T19:58:30.638130] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-18T19:58:30.919564] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-05. [2025-09-18T19:58:31.417313] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T19:58:31.719563] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-18T19:58:32.286622] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T19:58:32.519564] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-06. [2025-09-18T19:58:33.319594] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-18T19:58:33.355307] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-18T19:58:33.362090] [INFO ] [REMOTE ] KRG: Full fetch complete (70750 records). [2025-09-18T19:58:33.362198] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-18T19:58:33.763636] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-18T19:58:33.763796] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-18T19:58:33.765407] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-18T19:58:33.765473] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-18T19:58:33.766955] [DEBUG] [LOCAL ] KRG: Trimmed 70750 records to 49537 (keeping 200 days of data) [2025-09-18T19:58:33.896476] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T19:58:34.103295] [DEBUG] [LOCAL ] KRG: Primary data saved (49537 records). [2025-09-18T19:58:34.103432] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-18T19:58:34.103516] [INFO ] [MAIN ] Update Progress: 1222/2372 symbols completed. KRG took 29.2s. Estimated remaining: 2h 47m 60s. Rate: 6.8 symbols/min [2025-09-18T19:58:34.129826] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-18T19:58:34.290371] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:58:34.360597] [DEBUG] [LOCAL ] KSS: Loaded 53612 existing records from primary storage. [2025-09-18T19:58:34.360809] [INFO ] [MAIN ] KSS: Loaded 53612 existing records. [2025-09-18T19:58:34.557719] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:58:34.557971] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-18T19:58:34.558024] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-18T19:58:34.559799] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-18T19:58:34.559864] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-18T19:58:34.927126] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-07. [2025-09-18T19:58:34.998468] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-18T19:58:35.005052] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:58:35.433479] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-18T19:58:35.719610] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-18T19:58:36.509461] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-18T19:58:36.519627] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-11. [2025-09-18T19:58:36.930186] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-18T19:58:37.319572] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-18T19:58:38.119560] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-18T19:58:38.530283] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-11 (2.01 seconds). [2025-09-18T19:58:38.573620] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-18T19:58:38.919583] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-08. [2025-09-18T19:58:39.167149] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-18T19:58:39.719624] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-18T19:58:40.349408] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-18T19:58:40.519511] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-09. [2025-09-18T19:58:40.954949] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T19:58:41.319567] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-18T19:58:41.990479] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-18T19:58:41.997312] [INFO ] [REMOTE ] KRMN: Full fetch complete (48474 records). [2025-09-18T19:58:41.997432] [DEBUG] [VALIDATOR ] KRMN: Validating primary data. [2025-09-18T19:58:42.124721] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-09-18T19:58:42.199446] [WARN ] [VALIDATOR ] KRMN: Validation failed - insufficient historical data. Have 150 unique days, need 200 days [2025-09-18T19:58:42.200109] [FATAL] [MAIN ] KRMN: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:58:42.200247] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:58:42.200356] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-18T19:58:42.200473] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-18T19:58:42.200547] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-18T19:58:42.200664] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-18T19:58:42.200812] [INFO ] [MAIN ] Update Progress: 1223/2372 symbols completed. KRMN took 37.1s. Estimated remaining: 2h 47m 50s. Rate: 6.8 symbols/min [2025-09-18T19:58:42.385691] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:58:42.450068] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T19:58:42.471545] [DEBUG] [LOCAL ] KT: Loaded 45715 existing records from primary storage. [2025-09-18T19:58:42.471749] [INFO ] [MAIN ] KT: Loaded 45715 existing records. [2025-09-18T19:58:42.648235] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:58:42.648523] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-18T19:58:42.648601] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-18T19:58:42.649801] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-18T19:58:42.649862] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-18T19:58:42.924890] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-18T19:58:43.006977] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:58:43.719528] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-11. [2025-09-18T19:58:43.979069] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-18T19:58:44.041071] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-18T19:58:44.519559] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-09-18T19:58:45.319602] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-18T19:58:45.399437] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-18T19:58:46.119520] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-09-18T19:58:46.208250] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-18T19:58:46.572486] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-18T19:58:46.577528] [INFO ] [REMOTE ] KRP: Full fetch complete (54755 records). [2025-09-18T19:58:46.577686] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-18T19:58:46.924134] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-18T19:58:46.968922] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-18T19:58:46.969009] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-18T19:58:46.969853] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-18T19:58:46.969938] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-18T19:58:46.973009] [DEBUG] [LOCAL ] KRP: Trimmed 54755 records to 38364 (keeping 200 days of data) [2025-09-18T19:58:47.236811] [DEBUG] [LOCAL ] KRP: Primary data saved (38364 records). [2025-09-18T19:58:47.237033] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-18T19:58:47.237220] [INFO ] [MAIN ] Update Progress: 1224/2372 symbols completed. KRP took 27.1s. Estimated remaining: 2h 47m 38s. Rate: 6.8 symbols/min [2025-09-18T19:58:47.415274] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:58:47.452032] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T19:58:47.502546] [DEBUG] [LOCAL ] KTB: Loaded 41325 existing records from primary storage. [2025-09-18T19:58:47.502730] [INFO ] [MAIN ] KTB: Loaded 41325 existing records. [2025-09-18T19:58:47.678816] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:58:47.679081] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-18T19:58:47.679130] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-18T19:58:47.680230] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-18T19:58:47.680291] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-18T19:58:47.724166] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-18T19:58:48.058274] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:58:48.077789] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-18T19:58:48.519568] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-09-18T19:58:49.319583] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-11. [2025-09-18T19:58:49.622574] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-18T19:58:49.827371] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-18T19:58:50.119566] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-18T19:58:50.244068] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-18T19:58:50.919571] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-18T19:58:51.623397] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-18T19:58:51.713870] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-18T19:58:51.719579] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-18T19:58:52.519559] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-18T19:58:53.141818] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-18T19:58:53.319549] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-09-18T19:58:54.119555] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-18T19:58:54.317017] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-18T19:58:54.728889] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-18T19:58:54.919585] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-09-18T19:58:55.519408] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T19:58:55.719559] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-18T19:58:56.057205] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-18T19:58:56.519550] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-18T19:58:56.719283] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-18T19:58:57.319547] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-18T19:58:57.844546] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T19:58:58.119598] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-18T19:58:58.278196] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-18T19:58:58.282265] [INFO ] [REMOTE ] KRO: Full fetch complete (34590 records). [2025-09-18T19:58:58.282350] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-18T19:58:58.678164] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-09-18T19:58:58.678347] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-09-18T19:58:58.679094] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-09-18T19:58:58.679159] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-09-18T19:58:58.680116] [DEBUG] [LOCAL ] KRO: Trimmed 34590 records to 25967 (keeping 200 days of data) [2025-09-18T19:58:58.848201] [DEBUG] [LOCAL ] KRO: Primary data saved (25967 records). [2025-09-18T19:58:58.848356] [INFO ] [MAIN ] KRO: Full history saved. [2025-09-18T19:58:58.848514] [INFO ] [MAIN ] Update Progress: 1225/2372 symbols completed. KRO took 50.4s. Estimated remaining: 2h 47m 32s. Rate: 6.8 symbols/min [2025-09-18T19:58:58.925735] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-18T19:58:59.026336] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:58:59.043631] [DEBUG] [LOCAL ] KTF: Loaded 13205 existing records from primary storage. [2025-09-18T19:58:59.043816] [INFO ] [MAIN ] KTF: Loaded 13205 existing records. [2025-09-18T19:58:59.242584] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:58:59.242903] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-18T19:58:59.242957] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-18T19:58:59.243600] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-18T19:58:59.243717] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-18T19:58:59.671084] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:58:59.725852] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-11. [2025-09-18T19:58:59.743498] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-18T19:59:00.354963] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-18T19:59:00.396908] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-18T19:59:00.519560] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-18T19:59:01.319573] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-18T19:59:02.119554] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-18T19:59:02.155565] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T19:59:02.882559] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-18T19:59:02.919542] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-18T19:59:03.719581] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-18T19:59:04.443906] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-18T19:59:04.504187] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T19:59:04.519489] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-18T19:59:05.164842] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T19:59:05.319522] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-18T19:59:05.584153] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-18T19:59:06.119559] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-18T19:59:06.520451] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-18T19:59:06.919601] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-18T19:59:07.401552] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-18T19:59:07.719580] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-09-18T19:59:08.473948] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-18T19:59:08.519555] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-09-18T19:59:09.035983] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-18T19:59:09.124889] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-18T19:59:09.319542] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-18T19:59:10.119580] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-18T19:59:10.919562] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-18T19:59:11.141823] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-18T19:59:11.417781] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T19:59:11.719566] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-18T19:59:12.205882] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-18T19:59:12.213054] [INFO ] [REMOTE ] KT: Full fetch complete (66759 records). [2025-09-18T19:59:12.213240] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-18T19:59:12.524787] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-18T19:59:12.652070] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-18T19:59:12.652170] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-18T19:59:12.653094] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-18T19:59:12.653172] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-18T19:59:12.654763] [DEBUG] [LOCAL ] KT: Trimmed 66759 records to 46030 (keeping 200 days of data) [2025-09-18T19:59:12.966362] [DEBUG] [LOCAL ] KT: Primary data saved (46030 records). [2025-09-18T19:59:12.966512] [INFO ] [MAIN ] KT: Full history saved. [2025-09-18T19:59:12.966607] [INFO ] [MAIN ] Update Progress: 1226/2372 symbols completed. KT took 30.8s. Estimated remaining: 2h 47m 28s. Rate: 6.8 symbols/min [2025-09-18T19:59:13.141807] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:59:13.142029] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-18T19:59:13.142079] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-18T19:59:13.142244] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-18T19:59:13.142288] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-18T19:59:13.142329] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-18T19:59:13.142361] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-18T19:59:13.267998] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-18T19:59:13.329491] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-18T19:59:13.479403] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-18T19:59:13.519447] [INFO ] [REMOTE ] KTB: Full fetch complete (57200 records). [2025-09-18T19:59:13.526527] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-18T19:59:13.539588] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:59:13.935170] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-18T19:59:13.935262] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-18T19:59:13.936061] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-18T19:59:13.936129] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-18T19:59:13.937443] [DEBUG] [LOCAL ] KTB: Trimmed 57200 records to 41629 (keeping 200 days of data) [2025-09-18T19:59:14.119907] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-11. [2025-09-18T19:59:14.206843] [DEBUG] [LOCAL ] KTB: Primary data saved (41629 records). [2025-09-18T19:59:14.207008] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-18T19:59:14.207126] [INFO ] [MAIN ] Update Progress: 1227/2372 symbols completed. KTB took 27.0s. Estimated remaining: 2h 47m 12s. Rate: 6.8 symbols/min [2025-09-18T19:59:14.380393] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:59:14.422183] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-18T19:59:14.443200] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-09-18T19:59:14.443349] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-09-18T19:59:14.622040] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:59:14.622300] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-18T19:59:14.622348] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-18T19:59:14.623841] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-09-18T19:59:14.623903] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-18T19:59:14.924685] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-18T19:59:14.987248] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:59:15.081237] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-18T19:59:15.694034] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-18T19:59:15.719504] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-18T19:59:16.248732] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-18T19:59:16.519564] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-18T19:59:17.319559] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-18T19:59:18.119526] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-11. [2025-09-18T19:59:18.145029] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-18T19:59:18.374874] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-18T19:59:18.919558] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-18T19:59:19.687914] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-18T19:59:19.719490] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-18T19:59:19.910091] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-18T19:59:20.173214] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-18T19:59:20.519537] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-18T19:59:21.265846] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-18T19:59:21.319556] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-18T19:59:22.050125] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-18T19:59:22.119564] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-18T19:59:22.682862] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-18T19:59:22.919574] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-18T19:59:23.719555] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-18T19:59:24.519619] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-09-18T19:59:24.714198] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-18T19:59:25.319560] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-18T19:59:25.437957] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-18T19:59:26.119597] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-18T19:59:26.919602] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-18T19:59:27.411458] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-18T19:59:27.444006] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (2.92 seconds). [2025-09-18T19:59:27.503296] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-18T19:59:27.719538] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-18T19:59:28.020627] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-18T19:59:28.263115] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-18T19:59:28.270404] [INFO ] [REMOTE ] KSS: Full fetch complete (77580 records). [2025-09-18T19:59:28.270535] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-18T19:59:28.527028] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-18T19:59:28.676147] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-18T19:59:28.676237] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-18T19:59:28.677276] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-18T19:59:28.677353] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-18T19:59:28.678889] [DEBUG] [LOCAL ] KSS: Trimmed 77580 records to 54002 (keeping 200 days of data) [2025-09-18T19:59:29.011384] [DEBUG] [LOCAL ] KSS: Primary data saved (54002 records). [2025-09-18T19:59:29.011533] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-18T19:59:29.011634] [INFO ] [MAIN ] Update Progress: 1228/2372 symbols completed. KSS took 54.9s. Estimated remaining: 2h 47m 9s. Rate: 6.8 symbols/min [2025-09-18T19:59:29.182825] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:59:29.234189] [DEBUG] [LOCAL ] KVYO: Loaded 49801 existing records from primary storage. [2025-09-18T19:59:29.234362] [INFO ] [MAIN ] KVYO: Loaded 49801 existing records. [2025-09-18T19:59:29.325684] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-18T19:59:29.419440] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:59:29.424833] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-18T19:59:29.424899] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-18T19:59:29.426904] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-18T19:59:29.427006] [INFO ] [REMOTE ] KTF: Full fetch complete (18443 records). [2025-09-18T19:59:29.427160] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-18T19:59:29.438989] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-18T19:59:29.439258] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-18T19:59:29.847768] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-18T19:59:30.120836] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-18T19:59:30.191783] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-18T19:59:30.191603] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:59:30.192718] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-18T19:59:30.193248] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-18T19:59:30.193625] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-18T19:59:30.194879] [DEBUG] [LOCAL ] KTF: Trimmed 18443 records to 13268 (keeping 200 days of data) [2025-09-18T19:59:30.276401] [DEBUG] [LOCAL ] KTF: Primary data saved (13268 records). [2025-09-18T19:59:30.276547] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-18T19:59:30.276674] [INFO ] [MAIN ] Update Progress: 1229/2372 symbols completed. KTF took 31.4s. Estimated remaining: 2h 46m 53s. Rate: 6.8 symbols/min [2025-09-18T19:59:30.451903] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:59:30.452093] [DEBUG] [LOCAL ] KW: No existing data file found in primary storage. [2025-09-18T19:59:30.452135] [WARN ] [MAIN ] KW: No existing data found, performing full refresh instead. [2025-09-18T19:59:30.452274] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-18T19:59:30.452316] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-18T19:59:30.452358] [DEBUG] [LOCAL ] KW: No primary data file found to delete. [2025-09-18T19:59:30.452390] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-18T19:59:30.808538] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:59:30.812566] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-18T19:59:30.919539] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-18T19:59:31.684156] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-18T19:59:31.685448] [INFO ] [REMOTE ] KUKE: Full fetch complete (7982 records). [2025-09-18T19:59:31.685525] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-18T19:59:31.725098] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-11. [2025-09-18T19:59:31.876977] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-18T19:59:31.877199] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-18T19:59:31.877264] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-18T19:59:31.877332] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-18T19:59:31.877396] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-18T19:59:31.877433] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-18T19:59:31.877473] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-18T19:59:31.877531] [INFO ] [MAIN ] Update Progress: 1230/2372 symbols completed. KUKE took 18.9s. Estimated remaining: 2h 46m 38s. Rate: 6.9 symbols/min [2025-09-18T19:59:32.055682] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:59:32.074609] [DEBUG] [LOCAL ] KWR: Loaded 16961 existing records from primary storage. [2025-09-18T19:59:32.074757] [INFO ] [MAIN ] KWR: Loaded 16961 existing records. [2025-09-18T19:59:32.264267] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:59:32.264561] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-18T19:59:32.264623] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-18T19:59:32.265258] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-18T19:59:32.265320] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-18T19:59:32.524739] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-11. [2025-09-18T19:59:32.641578] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T19:59:33.168369] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-18T19:59:33.319544] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-09-18T19:59:34.005043] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-18T19:59:34.119579] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-09-18T19:59:34.737857] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-18T19:59:34.919555] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-11. [2025-09-18T19:59:35.067400] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-18T19:59:35.541858] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-18T19:59:35.719536] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-09-18T19:59:36.519554] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-09-18T19:59:36.949832] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T19:59:37.319549] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-09-18T19:59:38.119566] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-09-18T19:59:38.899340] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-18T19:59:38.919497] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-18T19:59:38.946515] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-18T19:59:39.314687] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-18T19:59:39.719574] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-18T19:59:40.519577] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-18T19:59:40.552733] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-18T19:59:40.861766] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T19:59:41.319627] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-18T19:59:41.556419] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-18T19:59:42.119564] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-18T19:59:42.919515] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-18T19:59:42.971793] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-18T19:59:43.019413] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-18T19:59:43.719553] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-18T19:59:44.223146] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-18T19:59:44.519556] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-09-18T19:59:45.225782] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-18T19:59:45.319566] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-18T19:59:46.026765] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T19:59:46.119560] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-18T19:59:46.175919] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-18T19:59:46.919559] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-18T19:59:47.719601] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-18T19:59:47.990632] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-18T19:59:48.519582] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-18T19:59:48.915501] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-18T19:59:49.319561] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-18T19:59:49.998547] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-18T19:59:50.120099] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-18T19:59:50.293947] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-18T19:59:50.603210] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-18T19:59:50.919550] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-18T19:59:51.450139] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T19:59:51.675583] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-18T19:59:51.719546] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-18T19:59:52.519564] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-18T19:59:53.140735] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-18T19:59:53.319549] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-18T19:59:54.124617] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-18T19:59:54.144257] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-18T19:59:54.321790] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-18T19:59:54.919560] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-18T19:59:55.613760] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-18T19:59:55.719524] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-18T19:59:56.469281] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-18T19:59:56.519518] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-18T19:59:57.088092] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-18T19:59:57.319563] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-18T19:59:58.129962] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-18T19:59:58.132407] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-18T19:59:58.141778] [INFO ] [REMOTE ] KVUE: Full fetch complete (77507 records). [2025-09-18T19:59:58.141902] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-18T19:59:58.558659] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-09-18T19:59:58.558766] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-09-18T19:59:58.559909] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-09-18T19:59:58.559977] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-09-18T19:59:58.561639] [DEBUG] [LOCAL ] KVUE: Trimmed 77507 records to 54057 (keeping 200 days of data) [2025-09-18T19:59:58.675077] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-18T19:59:58.919772] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-18T19:59:58.932681] [DEBUG] [LOCAL ] KVUE: Primary data saved (54057 records). [2025-09-18T19:59:58.932785] [INFO ] [MAIN ] KVUE: Full history saved. [2025-09-18T19:59:58.932870] [INFO ] [MAIN ] Update Progress: 1231/2372 symbols completed. KVUE took 44.7s. Estimated remaining: 2h 46m 46s. Rate: 6.8 symbols/min [2025-09-18T19:59:59.114012] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T19:59:59.146130] [DEBUG] [LOCAL ] KYN: Loaded 30453 existing records from primary storage. [2025-09-18T19:59:59.146329] [INFO ] [MAIN ] KYN: Loaded 30453 existing records. [2025-09-18T19:59:59.337292] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T19:59:59.337807] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-18T19:59:59.337951] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-18T19:59:59.344164] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-18T19:59:59.350001] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-18T19:59:59.384160] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T19:59:59.729276] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-18T19:59:59.755104] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:00:00.217401] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-18T20:00:00.222930] [INFO ] [REMOTE ] KW: Full fetch complete (56627 records). [2025-09-18T20:00:00.223059] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-18T20:00:00.524871] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-11. [2025-09-18T20:00:00.620807] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-09-18T20:00:00.620907] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-09-18T20:00:00.621766] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-09-18T20:00:00.621830] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-09-18T20:00:00.623040] [DEBUG] [LOCAL ] KW: Trimmed 56627 records to 40949 (keeping 200 days of data) [2025-09-18T20:00:00.880329] [DEBUG] [LOCAL ] KW: Primary data saved (40949 records). [2025-09-18T20:00:00.880473] [INFO ] [MAIN ] KW: Full history saved. [2025-09-18T20:00:00.880553] [INFO ] [MAIN ] Update Progress: 1232/2372 symbols completed. KW took 30.6s. Estimated remaining: 2h 46m 31s. Rate: 6.8 symbols/min [2025-09-18T20:00:01.063317] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:00:01.114419] [DEBUG] [LOCAL ] L: Loaded 40964 existing records from primary storage. [2025-09-18T20:00:01.114587] [INFO ] [MAIN ] L: Loaded 40964 existing records. [2025-09-18T20:00:01.316040] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:00:01.316354] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-18T20:00:01.316409] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-18T20:00:01.317389] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-18T20:00:01.317453] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-18T20:00:01.351314] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-18T20:00:01.763036] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:00:01.836683] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-18T20:00:02.119591] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-18T20:00:02.265597] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-18T20:00:02.383534] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-18T20:00:02.919570] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-09-18T20:00:03.725107] [INFO ] [REMOTE ] L: Fetching primary data for 2024-11. [2025-09-18T20:00:03.761887] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-18T20:00:04.305749] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T20:00:04.519623] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-18T20:00:05.112062] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T20:00:05.204361] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-18T20:00:05.207149] [INFO ] [REMOTE ] KWR: Full fetch complete (24027 records). [2025-09-18T20:00:05.207236] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-18T20:00:05.324730] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-18T20:00:05.646450] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-18T20:00:05.646535] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-18T20:00:05.647100] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-18T20:00:05.647164] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-18T20:00:05.647973] [DEBUG] [LOCAL ] KWR: Trimmed 24027 records to 17058 (keeping 200 days of data) [2025-09-18T20:00:05.771899] [DEBUG] [LOCAL ] KWR: Primary data saved (17058 records). [2025-09-18T20:00:05.772070] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-18T20:00:05.772162] [INFO ] [MAIN ] Update Progress: 1233/2372 symbols completed. KWR took 33.9s. Estimated remaining: 2h 46m 19s. Rate: 6.8 symbols/min [2025-09-18T20:00:05.963953] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:00:06.020205] [DEBUG] [LOCAL ] LAC: Loaded 52283 existing records from primary storage. [2025-09-18T20:00:06.020406] [INFO ] [MAIN ] LAC: Loaded 52283 existing records. [2025-09-18T20:00:06.124803] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-09-18T20:00:06.207288] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:00:06.207567] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-18T20:00:06.207630] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-18T20:00:06.208688] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-18T20:00:06.208749] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-18T20:00:06.570352] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:00:06.919516] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-09-18T20:00:06.969609] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-18T20:00:07.719619] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-18T20:00:07.865336] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-18T20:00:07.943329] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-18T20:00:08.519589] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-09-18T20:00:09.319566] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-11. [2025-09-18T20:00:09.385908] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-18T20:00:09.948842] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T20:00:10.119589] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-18T20:00:10.919584] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-18T20:00:11.169947] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-18T20:00:11.197171] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-18T20:00:11.719571] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-18T20:00:12.001358] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-18T20:00:12.519549] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-18T20:00:12.691745] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-18T20:00:13.319566] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-18T20:00:13.745119] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T20:00:14.119575] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-18T20:00:14.469853] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-18T20:00:14.919625] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-18T20:00:15.557118] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-18T20:00:15.719627] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-18T20:00:16.209767] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-18T20:00:16.519549] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-18T20:00:17.212773] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T20:00:17.223898] [INFO ] [REMOTE ] KVYO: Full fetch complete (71072 records). [2025-09-18T20:00:17.224092] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-18T20:00:17.321587] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-09-18T20:00:17.652207] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-18T20:00:17.652335] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-18T20:00:17.653440] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-18T20:00:17.653539] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-18T20:00:17.671203] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-18T20:00:17.678047] [DEBUG] [LOCAL ] KVYO: Trimmed 71072 records to 50181 (keeping 200 days of data) [2025-09-18T20:00:17.989398] [DEBUG] [LOCAL ] KVYO: Primary data saved (50181 records). [2025-09-18T20:00:17.989580] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-18T20:00:17.989740] [INFO ] [MAIN ] Update Progress: 1234/2372 symbols completed. KVYO took 49.0s. Estimated remaining: 2h 46m 13s. Rate: 6.8 symbols/min [2025-09-18T20:00:18.124699] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-18T20:00:18.177134] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:00:18.202957] [DEBUG] [LOCAL ] LAD: Loaded 24135 existing records from primary storage. [2025-09-18T20:00:18.203094] [INFO ] [MAIN ] LAD: Loaded 24135 existing records. [2025-09-18T20:00:18.395605] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:00:18.395881] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-18T20:00:18.395933] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-18T20:00:18.396670] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-18T20:00:18.396754] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-18T20:00:18.793210] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:00:18.919516] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-18T20:00:19.426087] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-18T20:00:19.522986] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-18T20:00:19.719557] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-09-18T20:00:19.855215] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-18T20:00:20.519556] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-18T20:00:21.319526] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-18T20:00:21.373025] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-18T20:00:21.471078] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-18T20:00:22.119541] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-18T20:00:22.710031] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-18T20:00:22.919567] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-18T20:00:23.022536] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-18T20:00:23.026836] [INFO ] [REMOTE ] KYN: Full fetch complete (45173 records). [2025-09-18T20:00:23.026943] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-18T20:00:23.401671] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-18T20:00:23.401765] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-18T20:00:23.402459] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-18T20:00:23.402556] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-18T20:00:23.403703] [DEBUG] [LOCAL ] KYN: Trimmed 45173 records to 30666 (keeping 200 days of data) [2025-09-18T20:00:23.599325] [DEBUG] [LOCAL ] KYN: Primary data saved (30666 records). [2025-09-18T20:00:23.599463] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-18T20:00:23.599551] [INFO ] [MAIN ] Update Progress: 1235/2372 symbols completed. KYN took 24.7s. Estimated remaining: 2h 46m 2s. Rate: 6.8 symbols/min [2025-09-18T20:00:23.724726] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-18T20:00:23.775215] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:00:23.816621] [DEBUG] [LOCAL ] LADR: Loaded 38617 existing records from primary storage. [2025-09-18T20:00:23.816792] [INFO ] [MAIN ] LADR: Loaded 38617 existing records. [2025-09-18T20:00:23.995886] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:00:23.996150] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-18T20:00:23.996201] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-18T20:00:23.997243] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-18T20:00:23.997304] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-18T20:00:24.356506] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:00:24.414227] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-18T20:00:24.519565] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-18T20:00:25.326802] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-11. [2025-09-18T20:00:25.345905] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-18T20:00:25.703498] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-18T20:00:26.119587] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-18T20:00:26.790221] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-18T20:00:26.919583] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-11. [2025-09-18T20:00:27.719568] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-09-18T20:00:27.899507] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-18T20:00:27.952823] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-18T20:00:28.519545] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-18T20:00:28.953423] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T20:00:29.319551] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-09-18T20:00:29.713435] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-18T20:00:29.719205] [INFO ] [REMOTE ] L: Full fetch complete (59323 records). [2025-09-18T20:00:29.719336] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-18T20:00:30.122853] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-18T20:00:30.122589] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-09-18T20:00:30.122994] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-18T20:00:30.124726] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-18T20:00:30.124892] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-18T20:00:30.126249] [DEBUG] [LOCAL ] L: Trimmed 59323 records to 41224 (keeping 200 days of data) [2025-09-18T20:00:30.412931] [DEBUG] [LOCAL ] L: Primary data saved (41224 records). [2025-09-18T20:00:30.413191] [INFO ] [MAIN ] L: Full history saved. [2025-09-18T20:00:30.416384] [INFO ] [MAIN ] Update Progress: 1236/2372 symbols completed. L took 29.5s. Estimated remaining: 2h 45m 51s. Rate: 6.8 symbols/min [2025-09-18T20:00:30.608127] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:00:30.619144] [DEBUG] [LOCAL ] LANV: Loaded 2637 existing records from primary storage. [2025-09-18T20:00:30.628778] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T20:00:30.628200] [INFO ] [MAIN ] LANV: Loaded 2637 existing records. [2025-09-18T20:00:30.838311] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:00:30.838604] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-18T20:00:30.838702] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-18T20:00:30.838973] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-18T20:00:30.839060] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-18T20:00:30.924633] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-09-18T20:00:31.223549] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:00:31.264571] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-18T20:00:31.719545] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-18T20:00:31.976759] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-18T20:00:32.519550] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-11. [2025-09-18T20:00:32.823105] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-18T20:00:32.842523] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-11 (0.32 seconds). [2025-09-18T20:00:33.319573] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-09-18T20:00:33.768892] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-18T20:00:34.119554] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-09-18T20:00:34.572084] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-18T20:00:34.919580] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-18T20:00:35.719629] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-18T20:00:36.080392] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-18T20:00:36.519597] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-18T20:00:36.990374] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-18T20:00:37.319556] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-18T20:00:37.478105] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-18T20:00:38.119563] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-18T20:00:38.537430] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-18T20:00:38.726431] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-18T20:00:38.919605] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-18T20:00:39.303506] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-18T20:00:39.719574] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-18T20:00:40.519567] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-18T20:00:41.319614] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-18T20:00:41.456140] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-18T20:00:41.511323] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-18T20:00:41.716478] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-18T20:00:42.119562] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-18T20:00:42.919557] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-18T20:00:43.530490] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-18T20:00:43.719581] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-18T20:00:43.921445] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-18T20:00:43.993350] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-18T20:00:44.519583] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-18T20:00:45.319559] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-18T20:00:45.826596] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-18T20:00:46.119566] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-18T20:00:46.609343] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-18T20:00:46.919585] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-18T20:00:46.974070] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-18T20:00:47.719565] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-18T20:00:48.089290] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-18T20:00:48.519567] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-18T20:00:48.931443] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-18T20:00:49.319592] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-18T20:00:49.627010] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-18T20:00:50.119549] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-18T20:00:50.563730] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T20:00:50.688024] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-18T20:00:50.919557] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-18T20:00:51.719583] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-18T20:00:52.274350] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-18T20:00:52.282364] [INFO ] [REMOTE ] LADR: Full fetch complete (54739 records). [2025-09-18T20:00:52.282461] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-18T20:00:52.530729] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-18T20:00:52.685117] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-18T20:00:52.685253] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-18T20:00:52.687028] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-18T20:00:52.687109] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-18T20:00:52.689715] [DEBUG] [LOCAL ] LADR: Trimmed 54739 records to 38963 (keeping 200 days of data) [2025-09-18T20:00:52.937697] [DEBUG] [LOCAL ] LADR: Primary data saved (38963 records). [2025-09-18T20:00:52.937876] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-18T20:00:52.938056] [INFO ] [MAIN ] Update Progress: 1237/2372 symbols completed. LADR took 29.3s. Estimated remaining: 2h 45m 55s. Rate: 6.8 symbols/min [2025-09-18T20:00:53.024359] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-18T20:00:53.025589] [INFO ] [REMOTE ] LANV: Full fetch complete (4308 records). [2025-09-18T20:00:53.025684] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-18T20:00:53.323797] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-18T20:00:53.409978] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-18T20:00:53.410154] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-18T20:00:53.410347] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-18T20:00:53.410429] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-18T20:00:53.411390] [DEBUG] [LOCAL ] LANV: Trimmed 4308 records to 2666 (keeping 200 days of data) [2025-09-18T20:00:53.429551] [DEBUG] [LOCAL ] LANV: Primary data saved (2666 records). [2025-09-18T20:00:53.429725] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-18T20:00:53.429856] [INFO ] [MAIN ] Update Progress: 1238/2372 symbols completed. LANV took 23.0s. Estimated remaining: 2h 45m 39s. Rate: 6.8 symbols/min [2025-09-18T20:00:53.511715] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-18T20:00:54.119596] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-18T20:00:54.226302] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-18T20:00:54.919704] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-18T20:00:56.122784] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-18T20:00:56.135184] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-18T20:00:56.188815] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-18T20:00:56.519591] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-18T20:00:57.483803] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-18T20:00:57.490767] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-18T20:00:58.090973] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-18T20:00:58.099524] [INFO ] [REMOTE ] LAC: Full fetch complete (75867 records). [2025-09-18T20:00:58.099722] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-18T20:00:58.503904] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T20:00:58.503492] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-18T20:00:58.506997] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-18T20:00:58.508132] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-18T20:00:58.508200] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-18T20:00:58.508421] [INFO ] [REMOTE ] LAD: Full fetch complete (35300 records). [2025-09-18T20:00:58.508503] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-18T20:00:58.600249] [DEBUG] [LOCAL ] LAC: Trimmed 75867 records to 52671 (keeping 200 days of data) [2025-09-18T20:00:59.100234] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-18T20:00:59.101256] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-18T20:00:59.101989] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-18T20:00:59.106214] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-18T20:00:59.131912] [DEBUG] [LOCAL ] LAD: Trimmed 35300 records to 24252 (keeping 200 days of data) [2025-09-18T20:00:59.311075] [DEBUG] [LOCAL ] LAC: Primary data saved (52671 records). [2025-09-18T20:00:59.314027] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-18T20:00:59.314485] [INFO ] [MAIN ] Update Progress: 1239/2372 symbols completed. LAC took 53.5s. Estimated remaining: 2h 45m 27s. Rate: 6.8 symbols/min [2025-09-18T20:00:59.371902] [DEBUG] [LOCAL ] LAD: Primary data saved (24252 records). [2025-09-18T20:00:59.372059] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-18T20:00:59.372210] [INFO ] [MAIN ] Update Progress: 1240/2372 symbols completed. LAD took 41.4s. Estimated remaining: 2h 45m 10s. Rate: 6.9 symbols/min [2025-09-18T20:01:00.060466] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:01:00.068929] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:01:00.167076] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:01:00.199050] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-09-18T20:01:00.198869] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:01:00.199474] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-09-18T20:01:00.206397] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-18T20:01:00.206569] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-18T20:01:00.206666] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-18T20:01:00.206724] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-18T20:01:00.281202] [DEBUG] [LOCAL ] LAW: Loaded 13850 existing records from primary storage. [2025-09-18T20:01:00.292572] [INFO ] [MAIN ] LAW: Loaded 13850 existing records. [2025-09-18T20:01:00.802604] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:01:00.799242] [DEBUG] [LOCAL ] LB: Loaded 37916 existing records from primary storage. [2025-09-18T20:01:00.818488] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-18T20:01:00.818386] [INFO ] [MAIN ] LB: Loaded 37916 existing records. [2025-09-18T20:01:00.798637] [DEBUG] [LOCAL ] LAZ: Loaded 45461 existing records from primary storage. [2025-09-18T20:01:00.818602] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-18T20:01:00.874049] [INFO ] [MAIN ] LAZ: Loaded 45461 existing records. [2025-09-18T20:01:00.943707] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-18T20:01:00.963083] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-18T20:01:01.139609] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:01:01.203266] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-11. [2025-09-18T20:01:01.387692] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:01:01.457431] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-18T20:01:01.493609] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-18T20:01:01.437843] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:01:01.537719] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-18T20:01:01.555740] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-18T20:01:01.550530] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-18T20:01:01.579617] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-18T20:01:01.579532] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-18T20:01:01.595429] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:01:01.617709] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-18T20:01:01.623953] [WARN ] [REMOTE ] LAR: No data returned for month 2024-11 [2025-09-18T20:01:01.650420] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-18T20:01:01.763770] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:01:01.790981] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-11. [2025-09-18T20:01:02.142467] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:01:02.254070] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-18T20:01:02.300439] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-09-18T20:01:02.435728] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:01:02.436306] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-11. [2025-09-18T20:01:02.517269] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:01:02.517586] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-11. [2025-09-18T20:01:02.867864] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-18T20:01:02.919588] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-09-18T20:01:03.089320] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-18T20:01:03.566392] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-18T20:01:03.719568] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-09-18T20:01:03.833221] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-18T20:01:03.864772] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T20:01:04.283328] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-18T20:01:04.519561] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-09-18T20:01:05.319558] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-09-18T20:01:06.119704] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-18T20:01:06.163163] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-18T20:01:06.667906] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-18T20:01:06.919549] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-09-18T20:01:07.040148] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-18T20:01:07.719567] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-18T20:01:08.378004] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-18T20:01:08.469161] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T20:01:08.519727] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-09-18T20:01:09.319550] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-09-18T20:01:10.130372] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-18T20:01:10.135115] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-18T20:01:10.409350] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-18T20:01:10.669248] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-18T20:01:10.919548] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-09-18T20:01:11.719545] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-18T20:01:12.471186] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-18T20:01:12.490547] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-18T20:01:12.519496] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-18T20:01:13.319555] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-09-18T20:01:13.447962] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-18T20:01:14.119546] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-09-18T20:01:14.883111] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-18T20:01:14.919494] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-09-18T20:01:15.182300] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-18T20:01:15.719563] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-09-18T20:01:16.255285] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-18T20:01:16.519545] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-18T20:01:17.319550] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-09-18T20:01:17.463718] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-18T20:01:17.511574] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-18T20:01:18.119558] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-09-18T20:01:18.744606] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T20:01:18.919521] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-09-18T20:01:19.212311] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-18T20:01:19.719545] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-09-18T20:01:20.519539] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-18T20:01:20.574887] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-18T20:01:20.975434] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-18T20:01:21.319535] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-09-18T20:01:21.375785] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-18T20:01:22.119595] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-09-18T20:01:22.919608] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-18T20:01:22.983122] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T20:01:23.573804] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T20:01:23.650483] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-18T20:01:23.653044] [INFO ] [REMOTE ] LAW: Full fetch complete (20597 records). [2025-09-18T20:01:23.653122] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-09-18T20:01:23.724682] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-09-18T20:01:24.092686] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-09-18T20:01:24.092786] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-09-18T20:01:24.093266] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-18T20:01:24.093361] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-09-18T20:01:24.094419] [DEBUG] [LOCAL ] LAW: Trimmed 20597 records to 13988 (keeping 200 days of data) [2025-09-18T20:01:24.180879] [DEBUG] [LOCAL ] LAW: Primary data saved (13988 records). [2025-09-18T20:01:24.181060] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-18T20:01:24.181183] [INFO ] [MAIN ] Update Progress: 1241/2372 symbols completed. LAW took 24.8s. Estimated remaining: 2h 45m 16s. Rate: 6.8 symbols/min [2025-09-18T20:01:24.373282] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:01:24.441477] [DEBUG] [LOCAL ] LBRT: Loaded 52924 existing records from primary storage. [2025-09-18T20:01:24.441682] [INFO ] [MAIN ] LBRT: Loaded 52924 existing records. [2025-09-18T20:01:24.524720] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-09-18T20:01:24.625709] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:01:24.626005] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-18T20:01:24.626098] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-18T20:01:24.627668] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-18T20:01:24.627731] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-18T20:01:25.002295] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:01:25.231877] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-18T20:01:25.319582] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-09-18T20:01:26.058185] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T20:01:26.119526] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-09-18T20:01:26.438493] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-18T20:01:26.919613] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-09-18T20:01:27.323187] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-18T20:01:27.719616] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-09-18T20:01:28.519569] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-11. [2025-09-18T20:01:28.551504] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-18T20:01:29.036831] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-18T20:01:29.319584] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-09-18T20:01:30.030635] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-18T20:01:30.119519] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-09-18T20:01:30.919603] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-09-18T20:01:31.067515] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-18T20:01:31.547908] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-18T20:01:31.719555] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-09-18T20:01:32.147335] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-18T20:01:32.519568] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-09-18T20:01:33.319575] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-18T20:01:33.477454] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-18T20:01:33.838426] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-18T20:01:34.119559] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-09-18T20:01:34.260177] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-18T20:01:34.265179] [INFO ] [REMOTE ] LB: Full fetch complete (56178 records). [2025-09-18T20:01:34.265302] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-09-18T20:01:34.651687] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-09-18T20:01:34.651776] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-09-18T20:01:34.652574] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-09-18T20:01:34.652678] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-09-18T20:01:34.653876] [DEBUG] [LOCAL ] LB: Trimmed 56178 records to 38177 (keeping 200 days of data) [2025-09-18T20:01:34.892177] [DEBUG] [LOCAL ] LB: Primary data saved (38177 records). [2025-09-18T20:01:34.892315] [INFO ] [MAIN ] LB: Full history saved. [2025-09-18T20:01:34.892401] [INFO ] [MAIN ] Update Progress: 1242/2372 symbols completed. LB took 35.5s. Estimated remaining: 2h 45m 9s. Rate: 6.8 symbols/min [2025-09-18T20:01:34.924714] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-18T20:01:35.065633] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:01:35.110941] [DEBUG] [LOCAL ] LC: Loaded 48027 existing records from primary storage. [2025-09-18T20:01:35.111086] [INFO ] [MAIN ] LC: Loaded 48027 existing records. [2025-09-18T20:01:35.289059] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:01:35.289313] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-18T20:01:35.289369] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-18T20:01:35.290490] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-09-18T20:01:35.290552] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-18T20:01:35.659035] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:01:35.675815] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-18T20:01:35.682537] [INFO ] [REMOTE ] LAR: Full fetch complete (53314 records). [2025-09-18T20:01:35.682673] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-09-18T20:01:35.725384] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-09-18T20:01:35.880628] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 163 unique days, need 200 days [2025-09-18T20:01:35.881380] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:01:35.881472] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:01:35.881574] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-18T20:01:35.881716] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-18T20:01:35.881779] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-18T20:01:35.881842] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-09-18T20:01:35.881996] [INFO ] [MAIN ] Update Progress: 1243/2372 symbols completed. LAR took 36.5s. Estimated remaining: 2h 44m 53s. Rate: 6.8 symbols/min [2025-09-18T20:01:36.058425] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:01:36.091890] [DEBUG] [LOCAL ] LCII: Loaded 28782 existing records from primary storage. [2025-09-18T20:01:36.092039] [INFO ] [MAIN ] LCII: Loaded 28782 existing records. [2025-09-18T20:01:36.273696] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:01:36.274089] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-09-18T20:01:36.274232] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-09-18T20:01:36.275191] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-09-18T20:01:36.275264] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-09-18T20:01:36.442421] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T20:01:36.471041] [INFO ] [REMOTE ] LAZ: Full fetch complete (65555 records). [2025-09-18T20:01:36.524868] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-09-18T20:01:36.524748] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-11. [2025-09-18T20:01:36.867976] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:01:37.114576] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-09-18T20:01:37.114836] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-09-18T20:01:37.115746] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-09-18T20:01:37.115892] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-09-18T20:01:37.117358] [DEBUG] [LOCAL ] LAZ: Trimmed 65555 records to 45782 (keeping 200 days of data) [2025-09-18T20:01:37.251602] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-18T20:01:37.356986] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-09-18T20:01:37.461715] [DEBUG] [LOCAL ] LAZ: Primary data saved (45782 records). [2025-09-18T20:01:37.461862] [INFO ] [MAIN ] LAZ: Full history saved. [2025-09-18T20:01:37.461965] [INFO ] [MAIN ] Update Progress: 1244/2372 symbols completed. LAZ took 38.1s. Estimated remaining: 2h 44m 38s. Rate: 6.9 symbols/min [2025-09-18T20:01:37.642412] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:01:37.684518] [DEBUG] [LOCAL ] LDI: Loaded 43355 existing records from primary storage. [2025-09-18T20:01:37.684692] [INFO ] [MAIN ] LDI: Loaded 43355 existing records. [2025-09-18T20:01:37.878816] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:01:37.879081] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-09-18T20:01:37.879137] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-09-18T20:01:37.880773] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-09-18T20:01:37.880838] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-09-18T20:01:38.123905] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-11. [2025-09-18T20:01:38.269601] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:01:38.322893] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-18T20:01:38.919595] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-09-18T20:01:39.170052] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-18T20:01:39.207255] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-18T20:01:39.719540] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-09-18T20:01:40.258574] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T20:01:40.519781] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-09-18T20:01:40.522062] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-18T20:01:41.319573] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-11. [2025-09-18T20:01:42.081441] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-18T20:01:42.119538] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-09-18T20:01:42.797577] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-18T20:01:42.919503] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-09-18T20:01:43.442079] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T20:01:43.719594] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-09-18T20:01:44.239033] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-18T20:01:44.519552] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-09-18T20:01:45.092271] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-18T20:01:45.319565] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-09-18T20:01:45.956693] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-18T20:01:46.119560] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-09-18T20:01:46.268636] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T20:01:46.919570] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-18T20:01:47.719551] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-09-18T20:01:47.968090] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-18T20:01:48.459590] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-18T20:01:48.519555] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-18T20:01:48.733602] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T20:01:49.319582] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-09-18T20:01:50.119556] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-09-18T20:01:50.237113] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-18T20:01:50.636133] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T20:01:50.919609] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-18T20:01:51.588060] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T20:01:51.719561] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-09-18T20:01:52.244075] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-18T20:01:52.519548] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-18T20:01:52.544264] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T20:01:53.319551] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-09-18T20:01:54.119566] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-18T20:01:54.349727] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-18T20:01:54.358361] [INFO ] [REMOTE ] LBRT: Full fetch complete (76327 records). [2025-09-18T20:01:54.358629] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-09-18T20:01:54.817905] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-09-18T20:01:54.823170] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-09-18T20:01:54.829823] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-09-18T20:01:54.840131] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-09-18T20:01:54.846950] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-18T20:01:54.861115] [DEBUG] [LOCAL ] LBRT: Trimmed 76327 records to 53311 (keeping 200 days of data) [2025-09-18T20:01:54.922415] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-09-18T20:01:55.220517] [DEBUG] [LOCAL ] LBRT: Primary data saved (53311 records). [2025-09-18T20:01:55.220708] [INFO ] [MAIN ] LBRT: Full history saved. [2025-09-18T20:01:55.221521] [INFO ] [MAIN ] Update Progress: 1245/2372 symbols completed. LBRT took 31.0s. Estimated remaining: 2h 44m 38s. Rate: 6.8 symbols/min [2025-09-18T20:01:55.409147] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:01:55.443809] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T20:01:55.499406] [DEBUG] [LOCAL ] LDOS: Loaded 46034 existing records from primary storage. [2025-09-18T20:01:55.499591] [INFO ] [MAIN ] LDOS: Loaded 46034 existing records. [2025-09-18T20:01:55.689105] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:01:55.689386] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-09-18T20:01:55.689437] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-09-18T20:01:55.690882] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-09-18T20:01:55.690949] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-09-18T20:01:55.724713] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-18T20:01:56.076860] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:01:56.224547] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-18T20:01:56.519549] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-11. [2025-09-18T20:01:57.064247] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T20:01:57.319580] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-09-18T20:01:57.910015] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T20:01:58.119561] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-09-18T20:01:58.195270] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-18T20:01:58.919553] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-09-18T20:01:59.607684] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T20:01:59.719583] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-09-18T20:01:59.849605] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-18T20:02:00.519579] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-09-18T20:02:01.087068] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-18T20:02:01.319555] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-09-18T20:02:01.732182] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-18T20:02:02.119586] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-18T20:02:02.745930] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T20:02:02.919565] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-09-18T20:02:03.719557] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-09-18T20:02:03.794685] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-18T20:02:04.519598] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-18T20:02:04.687610] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-18T20:02:04.741747] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-18T20:02:05.319553] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-09-18T20:02:06.119568] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-09-18T20:02:06.168406] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-18T20:02:06.415798] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-18T20:02:06.927246] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-18T20:02:06.931121] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-18T20:02:07.719537] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-09-18T20:02:08.519564] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-09-18T20:02:09.023259] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-18T20:02:09.032573] [INFO ] [REMOTE ] LDI: Full fetch complete (59760 records). [2025-09-18T20:02:09.032807] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-09-18T20:02:09.332610] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-18T20:02:09.486823] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-09-18T20:02:09.487380] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-09-18T20:02:09.488633] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-09-18T20:02:09.488856] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-09-18T20:02:09.526848] [DEBUG] [LOCAL ] LDI: Trimmed 59760 records to 43745 (keeping 200 days of data) [2025-09-18T20:02:09.528760] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-18T20:02:09.642241] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-18T20:02:09.810526] [DEBUG] [LOCAL ] LDI: Primary data saved (43745 records). [2025-09-18T20:02:09.810709] [INFO ] [MAIN ] LDI: Full history saved. [2025-09-18T20:02:09.810816] [INFO ] [MAIN ] Update Progress: 1246/2372 symbols completed. LDI took 32.3s. Estimated remaining: 2h 44m 34s. Rate: 6.8 symbols/min [2025-09-18T20:02:09.986310] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:02:10.002986] [DEBUG] [LOCAL ] LDP: Loaded 13223 existing records from primary storage. [2025-09-18T20:02:10.003142] [INFO ] [MAIN ] LDP: Loaded 13223 existing records. [2025-09-18T20:02:10.124829] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-09-18T20:02:10.205094] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:02:10.205440] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-18T20:02:10.205514] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-18T20:02:10.206145] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-09-18T20:02:10.206229] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-18T20:02:10.590141] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:02:10.892921] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-18T20:02:10.901597] [INFO ] [REMOTE ] LC: Full fetch complete (70162 records). [2025-09-18T20:02:10.901754] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-09-18T20:02:10.924706] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-09-18T20:02:11.304126] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-09-18T20:02:11.304250] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-09-18T20:02:11.305473] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-18T20:02:11.305563] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-09-18T20:02:11.307520] [DEBUG] [LOCAL ] LC: Trimmed 70162 records to 48396 (keeping 200 days of data) [2025-09-18T20:02:11.446302] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-18T20:02:11.639751] [DEBUG] [LOCAL ] LC: Primary data saved (48396 records). [2025-09-18T20:02:11.639911] [INFO ] [MAIN ] LC: Full history saved. [2025-09-18T20:02:11.640001] [INFO ] [MAIN ] Update Progress: 1247/2372 symbols completed. LC took 36.7s. Estimated remaining: 2h 44m 19s. Rate: 6.8 symbols/min [2025-09-18T20:02:11.724707] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-18T20:02:11.827516] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:02:11.872708] [DEBUG] [LOCAL ] LEA: Loaded 41916 existing records from primary storage. [2025-09-18T20:02:11.872858] [INFO ] [MAIN ] LEA: Loaded 41916 existing records. [2025-09-18T20:02:12.065021] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:02:12.065367] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-09-18T20:02:12.065440] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-09-18T20:02:12.066878] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-09-18T20:02:12.066942] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-09-18T20:02:12.439667] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:02:12.519520] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-11. [2025-09-18T20:02:12.558566] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-18T20:02:12.628289] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-18T20:02:12.632270] [INFO ] [REMOTE ] LCII: Full fetch complete (38785 records). [2025-09-18T20:02:12.632362] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-09-18T20:02:13.024567] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-09-18T20:02:13.024679] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-09-18T20:02:13.025340] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-09-18T20:02:13.025394] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-09-18T20:02:13.026277] [DEBUG] [LOCAL ] LCII: Trimmed 38785 records to 28969 (keeping 200 days of data) [2025-09-18T20:02:13.212317] [DEBUG] [LOCAL ] LCII: Primary data saved (28969 records). [2025-09-18T20:02:13.212496] [INFO ] [MAIN ] LCII: Full history saved. [2025-09-18T20:02:13.212619] [INFO ] [MAIN ] Update Progress: 1248/2372 symbols completed. LCII took 37.3s. Estimated remaining: 2h 44m 4s. Rate: 6.9 symbols/min [2025-09-18T20:02:13.324694] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-11. [2025-09-18T20:02:13.395276] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:02:13.444254] [DEBUG] [LOCAL ] LEG: Loaded 50409 existing records from primary storage. [2025-09-18T20:02:13.444394] [INFO ] [MAIN ] LEG: Loaded 50409 existing records. [2025-09-18T20:02:13.623238] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:02:13.623546] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-09-18T20:02:13.623633] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-18T20:02:13.625199] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-09-18T20:02:13.625265] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-09-18T20:02:13.990904] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:02:14.018710] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-18T20:02:14.107340] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-18T20:02:14.119518] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-09-18T20:02:14.919545] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-11. [2025-09-18T20:02:15.480989] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T20:02:15.719534] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-09-18T20:02:16.519555] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-09-18T20:02:16.575717] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-18T20:02:17.123613] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-18T20:02:17.319555] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-09-18T20:02:18.088502] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-18T20:02:18.119534] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-09-18T20:02:18.213308] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-18T20:02:18.808630] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-18T20:02:18.919543] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-09-18T20:02:19.719584] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-18T20:02:20.474028] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-18T20:02:20.522865] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-09-18T20:02:20.526459] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-18T20:02:21.319561] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-18T20:02:22.037692] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-18T20:02:22.119589] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-09-18T20:02:22.185419] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-18T20:02:22.919566] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-18T20:02:23.723502] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-09-18T20:02:23.746850] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-18T20:02:23.767976] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-18T20:02:24.519554] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-18T20:02:25.275719] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-18T20:02:25.319559] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-09-18T20:02:25.523208] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-18T20:02:26.119559] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-09-18T20:02:26.732356] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-18T20:02:26.919553] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-09-18T20:02:27.574288] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-18T20:02:27.719579] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-09-18T20:02:28.259946] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-18T20:02:28.519579] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-18T20:02:29.017199] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-18T20:02:29.325672] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-09-18T20:02:29.327323] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-18T20:02:30.119560] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-09-18T20:02:30.773549] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T20:02:30.919570] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-09-18T20:02:31.569570] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T20:02:31.719572] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-09-18T20:02:32.473914] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-18T20:02:32.519590] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-09-18T20:02:33.319601] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-09-18T20:02:33.448125] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-18T20:02:33.747404] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-18T20:02:34.119609] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-18T20:02:34.855856] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-18T20:02:34.919546] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-18T20:02:34.919635] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-18T20:02:35.681150] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-18T20:02:35.719519] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-18T20:02:36.519600] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-09-18T20:02:36.759294] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-18T20:02:36.761746] [INFO ] [REMOTE ] LDP: Full fetch complete (19513 records). [2025-09-18T20:02:36.761998] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-09-18T20:02:37.157286] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-09-18T20:02:37.157374] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-09-18T20:02:37.157808] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-18T20:02:37.157886] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-09-18T20:02:37.158605] [DEBUG] [LOCAL ] LDP: Trimmed 19513 records to 13295 (keeping 200 days of data) [2025-09-18T20:02:37.241113] [DEBUG] [LOCAL ] LDP: Primary data saved (13295 records). [2025-09-18T20:02:37.241263] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-18T20:02:37.241375] [INFO ] [MAIN ] Update Progress: 1249/2372 symbols completed. LDP took 27.4s. Estimated remaining: 2h 44m 9s. Rate: 6.8 symbols/min [2025-09-18T20:02:37.324635] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-09-18T20:02:37.424277] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:02:37.488562] [DEBUG] [LOCAL ] LEN: Loaded 53184 existing records from primary storage. [2025-09-18T20:02:37.488746] [INFO ] [MAIN ] LEN: Loaded 53184 existing records. [2025-09-18T20:02:37.672417] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:02:37.672720] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-09-18T20:02:37.672776] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-09-18T20:02:37.674233] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-09-18T20:02:37.674298] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-09-18T20:02:38.049516] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:02:38.106372] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-18T20:02:38.119494] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-09-18T20:02:38.486393] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-18T20:02:38.919557] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-18T20:02:39.446871] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T20:02:39.719546] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-09-18T20:02:40.202855] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-18T20:02:40.208936] [INFO ] [REMOTE ] LDOS: Full fetch complete (67761 records). [2025-09-18T20:02:40.209065] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-09-18T20:02:40.527329] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-11. [2025-09-18T20:02:40.630745] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-09-18T20:02:40.630835] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-09-18T20:02:40.631719] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-09-18T20:02:40.631783] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-09-18T20:02:40.633149] [DEBUG] [LOCAL ] LDOS: Trimmed 67761 records to 46352 (keeping 200 days of data) [2025-09-18T20:02:40.944753] [DEBUG] [LOCAL ] LDOS: Primary data saved (46352 records). [2025-09-18T20:02:40.945008] [INFO ] [MAIN ] LDOS: Full history saved. [2025-09-18T20:02:40.946968] [INFO ] [MAIN ] Update Progress: 1250/2372 symbols completed. LDOS took 45.7s. Estimated remaining: 2h 43m 55s. Rate: 6.8 symbols/min [2025-09-18T20:02:41.133570] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:02:41.165057] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-18T20:02:41.188452] [DEBUG] [LOCAL ] LEO: Loaded 17756 existing records from primary storage. [2025-09-18T20:02:41.188663] [INFO ] [MAIN ] LEO: Loaded 17756 existing records. [2025-09-18T20:02:41.334490] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-18T20:02:41.380080] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:02:41.380338] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-09-18T20:02:41.380392] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-18T20:02:41.381093] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-09-18T20:02:41.381155] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-09-18T20:02:41.754695] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:02:42.119600] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-11. [2025-09-18T20:02:42.246217] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-18T20:02:42.620372] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-18T20:02:42.630300] [INFO ] [REMOTE ] LEA: Full fetch complete (60823 records). [2025-09-18T20:02:42.630498] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-09-18T20:02:42.924457] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-09-18T20:02:42.931981] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-18T20:02:43.064844] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-09-18T20:02:43.064928] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-09-18T20:02:43.065755] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-09-18T20:02:43.065819] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-09-18T20:02:43.067118] [DEBUG] [LOCAL ] LEA: Trimmed 60823 records to 42219 (keeping 200 days of data) [2025-09-18T20:02:43.352082] [DEBUG] [LOCAL ] LEA: Primary data saved (42219 records). [2025-09-18T20:02:43.352325] [INFO ] [MAIN ] LEA: Full history saved. [2025-09-18T20:02:43.352569] [INFO ] [MAIN ] Update Progress: 1251/2372 symbols completed. LEA took 31.7s. Estimated remaining: 2h 43m 41s. Rate: 6.8 symbols/min [2025-09-18T20:02:43.524789] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:02:43.579737] [DEBUG] [LOCAL ] LEVI: Loaded 51482 existing records from primary storage. [2025-09-18T20:02:43.579887] [INFO ] [MAIN ] LEVI: Loaded 51482 existing records. [2025-09-18T20:02:43.728408] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-09-18T20:02:43.761760] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:02:43.761962] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-09-18T20:02:43.762011] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-09-18T20:02:43.763440] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-09-18T20:02:43.763520] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-09-18T20:02:44.128975] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:02:44.519565] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-09-18T20:02:44.883936] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-18T20:02:45.151694] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-18T20:02:45.226427] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-18T20:02:45.319549] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-09-18T20:02:46.119593] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-11. [2025-09-18T20:02:46.352226] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-18T20:02:46.919587] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-09-18T20:02:47.720031] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-09-18T20:02:47.719940] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-18T20:02:48.387608] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T20:02:48.519534] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-18T20:02:49.259513] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-18T20:02:49.319578] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-09-18T20:02:50.119591] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-09-18T20:02:50.207334] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-18T20:02:50.214509] [INFO ] [REMOTE ] LEG: Full fetch complete (73018 records). [2025-09-18T20:02:50.214699] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-09-18T20:02:50.645904] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-09-18T20:02:50.646065] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-09-18T20:02:50.647140] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-09-18T20:02:50.647259] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-09-18T20:02:50.652770] [DEBUG] [LOCAL ] LEG: Trimmed 73018 records to 50752 (keeping 200 days of data) [2025-09-18T20:02:50.798709] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-18T20:02:50.923416] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-09-18T20:02:51.023033] [DEBUG] [LOCAL ] LEG: Primary data saved (50752 records). [2025-09-18T20:02:51.023174] [INFO ] [MAIN ] LEG: Full history saved. [2025-09-18T20:02:51.023348] [INFO ] [MAIN ] Update Progress: 1252/2372 symbols completed. LEG took 37.8s. Estimated remaining: 2h 43m 31s. Rate: 6.8 symbols/min [2025-09-18T20:02:51.204529] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:02:51.226086] [DEBUG] [LOCAL ] LFT: Loaded 17835 existing records from primary storage. [2025-09-18T20:02:51.226222] [INFO ] [MAIN ] LFT: Loaded 17835 existing records. [2025-09-18T20:02:51.409185] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:02:51.409446] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-09-18T20:02:51.409523] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-18T20:02:51.410120] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-09-18T20:02:51.410180] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-09-18T20:02:51.727075] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-09-18T20:02:51.789583] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:02:51.850286] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-18T20:02:52.519619] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-09-18T20:02:52.711003] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-18T20:02:52.837928] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-18T20:02:53.319545] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-09-18T20:02:53.962713] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-18T20:02:54.119513] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-09-18T20:02:54.299330] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-18T20:02:54.919580] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-11. [2025-09-18T20:02:55.614944] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-18T20:02:55.696170] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-18T20:02:55.719502] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-09-18T20:02:56.519570] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-09-18T20:02:57.167396] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-18T20:02:57.280072] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-18T20:02:57.319496] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-09-18T20:02:58.119552] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-09-18T20:02:58.227879] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-18T20:02:58.911319] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-18T20:02:58.919480] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-09-18T20:02:59.624284] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-18T20:02:59.719539] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-09-18T20:03:00.519590] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-09-18T20:03:00.535616] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-18T20:03:01.319597] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-09-18T20:03:02.119558] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-09-18T20:03:02.919999] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-09-18T20:03:02.958342] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-18T20:03:03.719605] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-09-18T20:03:04.176314] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-09-18T20:03:04.383003] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-18T20:03:04.519589] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-09-18T20:03:05.152859] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-18T20:03:05.319500] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-09-18T20:03:05.409262] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-18T20:03:06.115087] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-18T20:03:06.119500] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-09-18T20:03:06.160691] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-18T20:03:06.919558] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-09-18T20:03:07.132753] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-18T20:03:07.719550] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-09-18T20:03:07.878534] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-18T20:03:08.364849] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-18T20:03:08.519541] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-18T20:03:09.302690] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-18T20:03:09.305583] [INFO ] [REMOTE ] LEO: Full fetch complete (27214 records). [2025-09-18T20:03:09.305727] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-09-18T20:03:09.328189] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-09-18T20:03:09.685412] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-09-18T20:03:09.685582] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-09-18T20:03:09.686319] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-09-18T20:03:09.686390] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-09-18T20:03:09.687716] [DEBUG] [LOCAL ] LEO: Trimmed 27214 records to 17840 (keeping 200 days of data) [2025-09-18T20:03:09.804991] [DEBUG] [LOCAL ] LEO: Primary data saved (17840 records). [2025-09-18T20:03:09.805163] [INFO ] [MAIN ] LEO: Full history saved. [2025-09-18T20:03:09.805326] [INFO ] [MAIN ] Update Progress: 1253/2372 symbols completed. LEO took 28.9s. Estimated remaining: 2h 43m 31s. Rate: 6.8 symbols/min [2025-09-18T20:03:09.982818] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:03:09.998709] [DEBUG] [LOCAL ] LGI: Loaded 10182 existing records from primary storage. [2025-09-18T20:03:09.998853] [INFO ] [MAIN ] LGI: Loaded 10182 existing records. [2025-09-18T20:03:10.124730] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-09-18T20:03:10.182817] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:03:10.183302] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-18T20:03:10.183394] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-18T20:03:10.184074] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-09-18T20:03:10.184172] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-18T20:03:10.544906] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:03:10.919542] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-11. [2025-09-18T20:03:10.975800] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-18T20:03:11.527569] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-18T20:03:11.715903] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T20:03:11.725932] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-09-18T20:03:12.519630] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-09-18T20:03:13.312508] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T20:03:13.319490] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-09-18T20:03:13.849465] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T20:03:14.119555] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-09-18T20:03:14.765206] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-18T20:03:14.869431] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-18T20:03:14.919544] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-18T20:03:15.570459] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-18T20:03:15.719535] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-18T20:03:16.519546] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-09-18T20:03:16.530935] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-18T20:03:17.319578] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-18T20:03:18.062477] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-18T20:03:18.119502] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-18T20:03:18.424126] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-18T20:03:18.616110] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-18T20:03:18.919544] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-09-18T20:03:19.719588] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-18T20:03:20.486758] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-18T20:03:20.519532] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-18T20:03:20.744364] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-18T20:03:21.164384] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-18T20:03:21.319579] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-18T20:03:22.119594] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-09-18T20:03:22.875784] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-18T20:03:22.886146] [INFO ] [REMOTE ] LEVI: Full fetch complete (74282 records). [2025-09-18T20:03:22.886312] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-09-18T20:03:22.924633] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-18T20:03:23.342567] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-18T20:03:23.371937] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-09-18T20:03:23.372516] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-09-18T20:03:23.373512] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-09-18T20:03:23.373580] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-09-18T20:03:23.375328] [DEBUG] [LOCAL ] LEVI: Trimmed 74282 records to 51868 (keeping 200 days of data) [2025-09-18T20:03:23.694922] [DEBUG] [LOCAL ] LEVI: Primary data saved (51868 records). [2025-09-18T20:03:23.695097] [INFO ] [MAIN ] LEVI: Full history saved. [2025-09-18T20:03:23.695193] [INFO ] [MAIN ] Update Progress: 1254/2372 symbols completed. LEVI took 40.3s. Estimated remaining: 2h 43m 27s. Rate: 6.8 symbols/min [2025-09-18T20:03:23.728177] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-18T20:03:23.885355] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-18T20:03:23.894290] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:03:23.940606] [DEBUG] [LOCAL ] LH: Loaded 38870 existing records from primary storage. [2025-09-18T20:03:23.940786] [INFO ] [MAIN ] LH: Loaded 38870 existing records. [2025-09-18T20:03:24.127417] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:03:24.127785] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-18T20:03:24.127839] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-18T20:03:24.129127] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-09-18T20:03:24.129192] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-18T20:03:24.485782] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:03:24.519505] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-11. [2025-09-18T20:03:24.655497] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-18T20:03:24.657980] [INFO ] [REMOTE ] LFT: Full fetch complete (23885 records). [2025-09-18T20:03:24.658069] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-09-18T20:03:25.039933] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-09-18T20:03:25.040019] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-09-18T20:03:25.040513] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-09-18T20:03:25.040555] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-09-18T20:03:25.041380] [DEBUG] [LOCAL ] LFT: Trimmed 23885 records to 17989 (keeping 200 days of data) [2025-09-18T20:03:25.145526] [DEBUG] [LOCAL ] LFT: Primary data saved (17989 records). [2025-09-18T20:03:25.145725] [INFO ] [MAIN ] LFT: Full history saved. [2025-09-18T20:03:25.145830] [INFO ] [MAIN ] Update Progress: 1255/2372 symbols completed. LFT took 34.1s. Estimated remaining: 2h 43m 12s. Rate: 6.8 symbols/min [2025-09-18T20:03:25.327590] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:03:25.324691] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-09-18T20:03:25.388805] [DEBUG] [LOCAL ] LHX: Loaded 49075 existing records from primary storage. [2025-09-18T20:03:25.388980] [INFO ] [MAIN ] LHX: Loaded 49075 existing records. [2025-09-18T20:03:25.571783] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:03:25.572042] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-09-18T20:03:25.572109] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-09-18T20:03:25.573386] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-09-18T20:03:25.573447] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-09-18T20:03:25.933892] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:03:25.959133] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-18T20:03:26.119533] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-11. [2025-09-18T20:03:26.919573] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-09-18T20:03:27.183236] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-18T20:03:27.513071] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T20:03:27.719588] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-09-18T20:03:28.037834] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-18T20:03:28.519583] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-09-18T20:03:29.259935] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-18T20:03:29.319556] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-09-18T20:03:30.119555] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-09-18T20:03:30.259502] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-18T20:03:30.692326] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-18T20:03:30.919521] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-09-18T20:03:31.216686] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-18T20:03:31.719556] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-18T20:03:32.329231] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T20:03:32.327767] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-18T20:03:32.341164] [INFO ] [REMOTE ] LGI: Full fetch complete (14252 records). [2025-09-18T20:03:32.341295] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-09-18T20:03:32.530786] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-18T20:03:32.741350] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-09-18T20:03:32.741463] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-09-18T20:03:32.741965] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-09-18T20:03:32.742061] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-09-18T20:03:32.742942] [DEBUG] [LOCAL ] LGI: Trimmed 14252 records to 10235 (keeping 200 days of data) [2025-09-18T20:03:32.814510] [DEBUG] [LOCAL ] LGI: Primary data saved (10235 records). [2025-09-18T20:03:32.814789] [INFO ] [MAIN ] LGI: Full history saved. [2025-09-18T20:03:32.815003] [INFO ] [MAIN ] Update Progress: 1256/2372 symbols completed. LGI took 23.0s. Estimated remaining: 2h 43m 2s. Rate: 6.8 symbols/min [2025-09-18T20:03:33.005542] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:03:33.036049] [DEBUG] [LOCAL ] LII: Loaded 28705 existing records from primary storage. [2025-09-18T20:03:33.036203] [INFO ] [MAIN ] LII: Loaded 28705 existing records. [2025-09-18T20:03:33.215313] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:03:33.215596] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-09-18T20:03:33.215667] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-09-18T20:03:33.216479] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-09-18T20:03:33.216543] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-09-18T20:03:33.319754] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-09-18T20:03:33.585798] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:03:34.119585] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-11. [2025-09-18T20:03:34.258845] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-18T20:03:34.919579] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-18T20:03:35.719603] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-18T20:03:36.161511] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-09-18T20:03:36.207363] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-11 (2.09 seconds). [2025-09-18T20:03:36.519570] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-09-18T20:03:36.713352] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-18T20:03:37.319550] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-09-18T20:03:37.681779] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-18T20:03:37.690597] [INFO ] [REMOTE ] LEN: Full fetch complete (76808 records). [2025-09-18T20:03:37.690977] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-09-18T20:03:37.818601] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-18T20:03:38.121273] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-09-18T20:03:38.122422] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-09-18T20:03:38.122485] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-09-18T20:03:38.123467] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-09-18T20:03:38.123677] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-09-18T20:03:38.125350] [DEBUG] [LOCAL ] LEN: Trimmed 76808 records to 53574 (keeping 200 days of data) [2025-09-18T20:03:38.474698] [DEBUG] [LOCAL ] LEN: Primary data saved (53574 records). [2025-09-18T20:03:38.474854] [INFO ] [MAIN ] LEN: Full history saved. [2025-09-18T20:03:38.476563] [INFO ] [MAIN ] Update Progress: 1257/2372 symbols completed. LEN took 1m 1s. Estimated remaining: 2h 42m 51s. Rate: 6.8 symbols/min [2025-09-18T20:03:38.653905] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:03:38.702736] [DEBUG] [LOCAL ] LION: Loaded 42314 existing records from primary storage. [2025-09-18T20:03:38.702888] [INFO ] [MAIN ] LION: Loaded 42314 existing records. [2025-09-18T20:03:38.891350] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:03:38.891968] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-09-18T20:03:38.892134] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-09-18T20:03:38.893353] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-09-18T20:03:38.893426] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-09-18T20:03:38.923696] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-18T20:03:39.293112] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-18T20:03:39.344863] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:03:39.501952] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T20:03:39.719561] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-09-18T20:03:40.405903] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-18T20:03:40.519551] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-11. [2025-09-18T20:03:41.129251] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T20:03:41.148483] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-18T20:03:41.319545] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-09-18T20:03:42.119546] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-18T20:03:42.548744] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T20:03:42.919563] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-09-18T20:03:43.719589] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-09-18T20:03:43.889288] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-18T20:03:44.235369] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-18T20:03:44.408613] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-18T20:03:44.519540] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-09-18T20:03:45.319587] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-09-18T20:03:45.430261] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-18T20:03:46.119574] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-09-18T20:03:46.390752] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-18T20:03:46.877819] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-18T20:03:46.919498] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-09-18T20:03:47.719585] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-09-18T20:03:48.002706] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-18T20:03:48.519551] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-09-18T20:03:49.319560] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-18T20:03:49.995997] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-18T20:03:50.119511] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-09-18T20:03:50.546939] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-18T20:03:50.825373] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-18T20:03:50.919528] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-09-18T20:03:51.658493] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T20:03:51.719518] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-09-18T20:03:51.750622] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-18T20:03:52.519554] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-09-18T20:03:53.319519] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-18T20:03:53.707394] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-18T20:03:54.046569] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T20:03:54.119524] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-09-18T20:03:54.622276] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-18T20:03:54.919549] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-09-18T20:03:55.435843] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T20:03:55.719575] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-18T20:03:56.069787] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-18T20:03:56.519558] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-09-18T20:03:56.850001] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-18T20:03:57.319599] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-18T20:03:57.908485] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-18T20:03:58.119543] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-09-18T20:03:58.466233] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-18T20:03:58.470692] [INFO ] [REMOTE ] LH: Full fetch complete (54854 records). [2025-09-18T20:03:58.470803] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-09-18T20:03:58.861775] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-09-18T20:03:58.861861] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-09-18T20:03:58.862732] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-18T20:03:58.862798] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-09-18T20:03:58.864066] [DEBUG] [LOCAL ] LH: Trimmed 54854 records to 39098 (keeping 200 days of data) [2025-09-18T20:03:58.922593] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-09-18T20:03:59.114119] [DEBUG] [LOCAL ] LH: Primary data saved (39098 records). [2025-09-18T20:03:59.114275] [INFO ] [MAIN ] LH: Full history saved. [2025-09-18T20:03:59.114362] [INFO ] [MAIN ] Update Progress: 1258/2372 symbols completed. LH took 35.4s. Estimated remaining: 2h 42m 52s. Rate: 6.8 symbols/min [2025-09-18T20:03:59.287164] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:03:59.293249] [DEBUG] [LOCAL ] LITB: Loaded 4260 existing records from primary storage. [2025-09-18T20:03:59.293363] [INFO ] [MAIN ] LITB: Loaded 4260 existing records. [2025-09-18T20:03:59.472434] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:03:59.472852] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-09-18T20:03:59.472913] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-18T20:03:59.473163] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-09-18T20:03:59.473229] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-09-18T20:03:59.728001] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-18T20:03:59.842304] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:03:59.988479] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-18T20:04:00.519542] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-11. [2025-09-18T20:04:01.181009] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-18T20:04:01.209820] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-18T20:04:01.217698] [INFO ] [REMOTE ] LII: Full fetch complete (41002 records). [2025-09-18T20:04:01.217904] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-09-18T20:04:01.324726] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-18T20:04:01.399058] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-18T20:04:01.661611] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-09-18T20:04:01.661735] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-09-18T20:04:01.662412] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-09-18T20:04:01.662455] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-09-18T20:04:01.663714] [DEBUG] [LOCAL ] LII: Trimmed 41002 records to 28933 (keeping 200 days of data) [2025-09-18T20:04:01.851512] [DEBUG] [LOCAL ] LII: Primary data saved (28933 records). [2025-09-18T20:04:01.851685] [INFO ] [MAIN ] LII: Full history saved. [2025-09-18T20:04:01.851796] [INFO ] [MAIN ] Update Progress: 1259/2372 symbols completed. LII took 29.0s. Estimated remaining: 2h 42m 38s. Rate: 6.8 symbols/min [2025-09-18T20:04:02.041183] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:04:02.111025] [DEBUG] [LOCAL ] LLY: Loaded 53302 existing records from primary storage. [2025-09-18T20:04:02.111194] [INFO ] [MAIN ] LLY: Loaded 53302 existing records. [2025-09-18T20:04:02.124733] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-09-18T20:04:02.317158] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:04:02.317448] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-09-18T20:04:02.317498] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-09-18T20:04:02.318857] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-09-18T20:04:02.318919] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-09-18T20:04:02.631379] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-18T20:04:02.706893] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:04:02.919561] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-09-18T20:04:03.091072] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-18T20:04:03.099048] [INFO ] [REMOTE ] LHX: Full fetch complete (70806 records). [2025-09-18T20:04:03.099177] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-09-18T20:04:03.511364] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-09-18T20:04:03.511481] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-09-18T20:04:03.512401] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-09-18T20:04:03.512468] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-09-18T20:04:03.513987] [DEBUG] [LOCAL ] LHX: Trimmed 70806 records to 49373 (keeping 200 days of data) [2025-09-18T20:04:03.722217] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-11. [2025-09-18T20:04:03.846370] [DEBUG] [LOCAL ] LHX: Primary data saved (49373 records). [2025-09-18T20:04:03.846504] [INFO ] [MAIN ] LHX: Full history saved. [2025-09-18T20:04:03.846587] [INFO ] [MAIN ] Update Progress: 1260/2372 symbols completed. LHX took 38.7s. Estimated remaining: 2h 42m 24s. Rate: 6.8 symbols/min [2025-09-18T20:04:04.021992] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:04:04.075518] [DEBUG] [LOCAL ] LMND: Loaded 51874 existing records from primary storage. [2025-09-18T20:04:04.075690] [INFO ] [MAIN ] LMND: Loaded 51874 existing records. [2025-09-18T20:04:04.253706] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:04:04.254078] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-09-18T20:04:04.254163] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-18T20:04:04.255267] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-09-18T20:04:04.255329] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-09-18T20:04:04.524621] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-09-18T20:04:04.641781] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:04:04.677253] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-18T20:04:04.916404] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-18T20:04:05.319628] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-09-18T20:04:05.795578] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-18T20:04:05.989336] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-11 (2.27 seconds). [2025-09-18T20:04:06.119575] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-09-18T20:04:06.767723] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-18T20:04:06.919557] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-09-18T20:04:07.696421] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-18T20:04:07.719499] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-09-18T20:04:08.519611] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-09-18T20:04:09.002049] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-18T20:04:09.319544] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-09-18T20:04:09.720784] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-18T20:04:10.003382] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-18T20:04:10.119553] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-18T20:04:10.919552] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-11. [2025-09-18T20:04:11.593078] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-18T20:04:11.599818] [INFO ] [REMOTE ] LION: Full fetch complete (53117 records). [2025-09-18T20:04:11.599915] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-09-18T20:04:11.724604] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-09-18T20:04:12.001276] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-09-18T20:04:12.001358] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-09-18T20:04:12.002127] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-09-18T20:04:12.002192] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-09-18T20:04:12.003318] [DEBUG] [LOCAL ] LION: Trimmed 53117 records to 42669 (keeping 200 days of data) [2025-09-18T20:04:12.230842] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-18T20:04:12.258943] [DEBUG] [LOCAL ] LION: Primary data saved (42669 records). [2025-09-18T20:04:12.259106] [INFO ] [MAIN ] LION: Full history saved. [2025-09-18T20:04:12.259219] [INFO ] [MAIN ] Update Progress: 1261/2372 symbols completed. LION took 33.8s. Estimated remaining: 2h 42m 15s. Rate: 6.8 symbols/min [2025-09-18T20:04:12.431965] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:04:12.483425] [DEBUG] [LOCAL ] LMT: Loaded 50008 existing records from primary storage. [2025-09-18T20:04:12.483598] [INFO ] [MAIN ] LMT: Loaded 50008 existing records. [2025-09-18T20:04:12.525602] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-09-18T20:04:12.664314] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:04:12.664610] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-18T20:04:12.664691] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-18T20:04:12.666037] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-09-18T20:04:12.666100] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-18T20:04:12.908541] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-18T20:04:13.049096] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:04:13.079595] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-11 (2.16 seconds). [2025-09-18T20:04:13.319539] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-09-18T20:04:14.119542] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-09-18T20:04:14.893160] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-18T20:04:14.894662] [INFO ] [REMOTE ] LITB: Full fetch complete (5534 records). [2025-09-18T20:04:14.894738] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-09-18T20:04:14.926047] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-11. [2025-09-18T20:04:15.287764] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-09-18T20:04:15.287891] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-09-18T20:04:15.288190] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-09-18T20:04:15.288295] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-09-18T20:04:15.289344] [DEBUG] [LOCAL ] LITB: Trimmed 5534 records to 4298 (keeping 200 days of data) [2025-09-18T20:04:15.346208] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-18T20:04:15.347048] [DEBUG] [LOCAL ] LITB: Primary data saved (4298 records). [2025-09-18T20:04:15.357527] [INFO ] [MAIN ] LITB: Full history saved. [2025-09-18T20:04:15.358745] [INFO ] [MAIN ] Update Progress: 1262/2372 symbols completed. LITB took 16.2s. Estimated remaining: 2h 42m 1s. Rate: 6.9 symbols/min [2025-09-18T20:04:15.532276] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:04:15.586966] [DEBUG] [LOCAL ] LNC: Loaded 51636 existing records from primary storage. [2025-09-18T20:04:15.587139] [INFO ] [MAIN ] LNC: Loaded 51636 existing records. [2025-09-18T20:04:15.725479] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-09-18T20:04:15.766522] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:04:15.766759] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-09-18T20:04:15.766824] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-09-18T20:04:15.767922] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-09-18T20:04:15.767982] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-09-18T20:04:16.129870] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:04:16.519588] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-11. [2025-09-18T20:04:16.822250] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-18T20:04:17.319617] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-09-18T20:04:17.591926] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-18T20:04:17.769850] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-18T20:04:18.119556] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-09-18T20:04:18.919552] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-09-18T20:04:19.190354] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-18T20:04:19.719531] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-09-18T20:04:19.822724] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-18T20:04:20.460748] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-18T20:04:20.519562] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-09-18T20:04:21.319564] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-09-18T20:04:21.853074] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-18T20:04:21.925519] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-18T20:04:22.119568] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-09-18T20:04:22.919558] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-09-18T20:04:23.064259] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-18T20:04:23.719575] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-18T20:04:23.968444] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-18T20:04:24.519582] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-09-18T20:04:24.946901] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-18T20:04:25.319564] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-09-18T20:04:25.610164] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-18T20:04:26.090698] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T20:04:26.119522] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-09-18T20:04:26.659740] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-18T20:04:26.919593] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-18T20:04:27.719572] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-09-18T20:04:28.116012] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-18T20:04:28.519567] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-09-18T20:04:28.811108] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-18T20:04:29.024705] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-18T20:04:29.319547] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-09-18T20:04:30.119548] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-18T20:04:30.795742] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-18T20:04:30.919584] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-09-18T20:04:31.118287] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-18T20:04:31.719540] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-09-18T20:04:31.935619] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-18T20:04:32.519604] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-09-18T20:04:32.758301] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-18T20:04:33.319564] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-09-18T20:04:33.941349] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-18T20:04:34.080765] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-18T20:04:34.119504] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-09-18T20:04:34.919566] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-09-18T20:04:35.170365] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-18T20:04:35.624400] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-18T20:04:35.719515] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-09-18T20:04:36.519592] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-18T20:04:37.329691] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-18T20:04:37.350433] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-18T20:04:37.469060] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-18T20:04:38.119524] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-09-18T20:04:38.191581] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-18T20:04:38.919575] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-18T20:04:39.196703] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-18T20:04:39.204388] [INFO ] [REMOTE ] LMND: Full fetch complete (75183 records). [2025-09-18T20:04:39.204544] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-09-18T20:04:39.610986] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-09-18T20:04:39.611074] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-09-18T20:04:39.612024] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-09-18T20:04:39.612102] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-09-18T20:04:39.613977] [DEBUG] [LOCAL ] LMND: Trimmed 75183 records to 52260 (keeping 200 days of data) [2025-09-18T20:04:39.721822] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-09-18T20:04:39.925088] [DEBUG] [LOCAL ] LMND: Primary data saved (52260 records). [2025-09-18T20:04:39.925241] [INFO ] [MAIN ] LMND: Full history saved. [2025-09-18T20:04:39.925336] [INFO ] [MAIN ] Update Progress: 1263/2372 symbols completed. LMND took 36.1s. Estimated remaining: 2h 42m 6s. Rate: 6.8 symbols/min [2025-09-18T20:04:40.138774] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:04:40.145602] [DEBUG] [LOCAL ] LND: Loaded 5207 existing records from primary storage. [2025-09-18T20:04:40.146352] [INFO ] [MAIN ] LND: Loaded 5207 existing records. [2025-09-18T20:04:40.325048] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:04:40.325748] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-09-18T20:04:40.325871] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-09-18T20:04:40.326325] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-09-18T20:04:40.326480] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-09-18T20:04:40.724817] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:04:40.725283] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-11. [2025-09-18T20:04:40.729003] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-09-18T20:04:41.003435] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-18T20:04:41.197673] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T20:04:41.319526] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-09-18T20:04:41.475109] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-18T20:04:42.119543] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-09-18T20:04:42.919562] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-09-18T20:04:43.538179] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-18T20:04:43.572802] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T20:04:43.719580] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-18T20:04:44.027463] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-09-18T20:04:44.519550] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-09-18T20:04:45.074750] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-18T20:04:45.134185] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-18T20:04:45.141865] [INFO ] [REMOTE ] LNC: Full fetch complete (73719 records). [2025-09-18T20:04:45.142034] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-09-18T20:04:45.325494] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-09-18T20:04:45.554885] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-09-18T20:04:45.554973] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-09-18T20:04:45.555949] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-09-18T20:04:45.556017] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-09-18T20:04:45.558767] [DEBUG] [LOCAL ] LNC: Trimmed 73719 records to 52021 (keeping 200 days of data) [2025-09-18T20:04:45.875183] [DEBUG] [LOCAL ] LNC: Primary data saved (52021 records). [2025-09-18T20:04:45.875375] [INFO ] [MAIN ] LNC: Full history saved. [2025-09-18T20:04:45.875549] [INFO ] [MAIN ] Update Progress: 1264/2372 symbols completed. LNC took 30.5s. Estimated remaining: 2h 41m 55s. Rate: 6.8 symbols/min [2025-09-18T20:04:46.056622] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-18T20:04:46.059541] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:04:46.114094] [DEBUG] [LOCAL ] LNG: Loaded 51576 existing records from primary storage. [2025-09-18T20:04:46.114254] [INFO ] [MAIN ] LNG: Loaded 51576 existing records. [2025-09-18T20:04:46.125156] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-09-18T20:04:46.298898] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:04:46.299149] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-18T20:04:46.299200] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-18T20:04:46.300978] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-09-18T20:04:46.301042] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-18T20:04:46.656100] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:04:46.757304] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-18T20:04:46.919586] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-09-18T20:04:47.553971] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-18T20:04:47.719558] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-09-18T20:04:48.519567] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-09-18T20:04:49.125430] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-18T20:04:49.319583] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-11. [2025-09-18T20:04:50.119554] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-09-18T20:04:50.503891] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-09-18T20:04:50.504517] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-18T20:04:50.924566] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-18T20:04:50.930574] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-18T20:04:51.719539] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-09-18T20:04:52.519561] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-18T20:04:53.189923] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-18T20:04:53.241136] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-18T20:04:53.319538] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-09-18T20:04:54.119551] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-18T20:04:54.919512] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-09-18T20:04:55.067890] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-18T20:04:55.234805] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-09-18T20:04:55.242331] [INFO ] [REMOTE ] LLY: Full fetch complete (77228 records). [2025-09-18T20:04:55.242480] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-09-18T20:04:55.418474] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-18T20:04:55.688247] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-09-18T20:04:55.688336] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-09-18T20:04:55.689328] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-09-18T20:04:55.689393] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-09-18T20:04:55.695439] [DEBUG] [LOCAL ] LLY: Trimmed 77228 records to 53688 (keeping 200 days of data) [2025-09-18T20:04:55.759357] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-09-18T20:04:56.008538] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-18T20:04:56.126626] [DEBUG] [LOCAL ] LLY: Primary data saved (53688 records). [2025-09-18T20:04:56.126928] [INFO ] [MAIN ] LLY: Full history saved. [2025-09-18T20:04:56.128937] [INFO ] [MAIN ] Update Progress: 1265/2372 symbols completed. LLY took 54.3s. Estimated remaining: 2h 41m 47s. Rate: 6.8 symbols/min [2025-09-18T20:04:56.255971] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-18T20:04:56.322042] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:04:56.337618] [DEBUG] [LOCAL ] LNN: Loaded 11224 existing records from primary storage. [2025-09-18T20:04:56.337778] [INFO ] [MAIN ] LNN: Loaded 11224 existing records. [2025-09-18T20:04:56.530843] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-18T20:04:56.537190] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:04:56.538497] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-09-18T20:04:56.538615] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-09-18T20:04:56.539071] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-09-18T20:04:56.539158] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-09-18T20:04:56.914125] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:04:57.130136] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-18T20:04:57.132525] [INFO ] [REMOTE ] LND: Full fetch complete (8977 records). [2025-09-18T20:04:57.132625] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-09-18T20:04:57.324633] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-18T20:04:57.520483] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-09-18T20:04:57.520568] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-09-18T20:04:57.520815] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-09-18T20:04:57.520877] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-09-18T20:04:57.521381] [DEBUG] [LOCAL ] LND: Trimmed 8977 records to 5231 (keeping 200 days of data) [2025-09-18T20:04:57.551322] [DEBUG] [LOCAL ] LND: Primary data saved (5231 records). [2025-09-18T20:04:57.551428] [INFO ] [MAIN ] LND: Full history saved. [2025-09-18T20:04:57.551580] [INFO ] [MAIN ] Update Progress: 1266/2372 symbols completed. LND took 17.6s. Estimated remaining: 2h 41m 32s. Rate: 6.8 symbols/min [2025-09-18T20:04:57.720682] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:04:57.771060] [DEBUG] [LOCAL ] LOAR: Loaded 41556 existing records from primary storage. [2025-09-18T20:04:57.771208] [INFO ] [MAIN ] LOAR: Loaded 41556 existing records. [2025-09-18T20:04:57.952737] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:04:57.952989] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-09-18T20:04:57.953039] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-09-18T20:04:57.954246] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-09-18T20:04:57.954311] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-09-18T20:04:58.130737] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-18T20:04:58.355747] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:04:58.919588] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-11. [2025-09-18T20:04:59.031630] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-18T20:04:59.719554] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-18T20:05:00.351951] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T20:05:00.438787] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-18T20:05:00.451354] [INFO ] [REMOTE ] LMT: Full fetch complete (72472 records). [2025-09-18T20:05:00.451625] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-18T20:05:00.524775] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-11. [2025-09-18T20:05:00.893272] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-09-18T20:05:00.893394] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-09-18T20:05:00.894747] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-09-18T20:05:00.894821] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-09-18T20:05:00.897464] [DEBUG] [LOCAL ] LMT: Trimmed 72472 records to 50362 (keeping 200 days of data) [2025-09-18T20:05:01.282119] [DEBUG] [LOCAL ] LMT: Primary data saved (50362 records). [2025-09-18T20:05:01.282701] [INFO ] [MAIN ] LMT: Full history saved. [2025-09-18T20:05:01.285566] [INFO ] [MAIN ] Update Progress: 1267/2372 symbols completed. LMT took 49.0s. Estimated remaining: 2h 41m 19s. Rate: 6.8 symbols/min [2025-09-18T20:05:01.329905] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-09-18T20:05:01.409308] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-18T20:05:01.549000] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:05:01.554121] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-18T20:05:01.612566] [DEBUG] [LOCAL ] LOB: Loaded 27410 existing records from primary storage. [2025-09-18T20:05:01.612832] [INFO ] [MAIN ] LOB: Loaded 27410 existing records. [2025-09-18T20:05:01.831058] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:05:01.832116] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-09-18T20:05:01.832224] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-09-18T20:05:01.833627] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-09-18T20:05:01.833760] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-09-18T20:05:02.124717] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-18T20:05:02.227937] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:05:02.919547] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-09-18T20:05:03.034354] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-18T20:05:03.515868] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-18T20:05:03.719616] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-09-18T20:05:03.962211] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-18T20:05:04.519552] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-18T20:05:04.965938] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T20:05:05.319597] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-09-18T20:05:06.119571] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-09-18T20:05:06.204721] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-18T20:05:06.234290] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-18T20:05:06.726278] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-18T20:05:06.919544] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-09-18T20:05:07.533669] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-18T20:05:07.719554] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-18T20:05:08.519565] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-09-18T20:05:09.319529] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-09-18T20:05:09.341338] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-18T20:05:09.425489] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-18T20:05:10.119553] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-09-18T20:05:10.412169] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-18T20:05:10.919558] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-11. [2025-09-18T20:05:11.183539] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-18T20:05:11.719534] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-09-18T20:05:11.814742] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-18T20:05:12.204522] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-18T20:05:12.519560] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-09-18T20:05:13.319555] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-09-18T20:05:14.100112] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-18T20:05:14.119510] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-09-18T20:05:14.211897] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-18T20:05:14.897148] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-18T20:05:14.919561] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-09-18T20:05:15.719552] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-09-18T20:05:15.975102] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-18T20:05:16.519632] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-09-18T20:05:16.674890] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-18T20:05:17.319621] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-09-18T20:05:17.918628] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-18T20:05:18.119505] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-09-18T20:05:18.364675] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-18T20:05:18.919601] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-09-18T20:05:19.405129] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-18T20:05:19.719596] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-09-18T20:05:19.883248] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-18T20:05:20.519589] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-18T20:05:20.873615] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-18T20:05:21.319543] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-09-18T20:05:21.862546] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-18T20:05:22.119547] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-09-18T20:05:22.156454] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-18T20:05:22.919569] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-09-18T20:05:23.708515] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T20:05:23.719514] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-18T20:05:24.088105] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-18T20:05:24.519542] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-18T20:05:25.319553] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-09-18T20:05:25.406538] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-18T20:05:25.408838] [INFO ] [REMOTE ] LNN: Full fetch complete (15464 records). [2025-09-18T20:05:25.408921] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-09-18T20:05:25.828375] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-09-18T20:05:25.828796] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-09-18T20:05:25.829328] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-09-18T20:05:25.829408] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-09-18T20:05:25.830325] [DEBUG] [LOCAL ] LNN: Trimmed 15464 records to 11338 (keeping 200 days of data) [2025-09-18T20:05:25.918583] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-18T20:05:25.948140] [DEBUG] [LOCAL ] LNN: Primary data saved (11338 records). [2025-09-18T20:05:25.948280] [INFO ] [MAIN ] LNN: Full history saved. [2025-09-18T20:05:25.948413] [INFO ] [MAIN ] Update Progress: 1268/2372 symbols completed. LNN took 29.8s. Estimated remaining: 2h 41m 24s. Rate: 6.8 symbols/min [2025-09-18T20:05:26.131717] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-18T20:05:26.136208] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:05:26.145196] [DEBUG] [LOCAL ] LOCL: Loaded 3441 existing records from primary storage. [2025-09-18T20:05:26.145328] [INFO ] [MAIN ] LOCL: Loaded 3441 existing records. [2025-09-18T20:05:26.339999] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:05:26.340613] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-18T20:05:26.340749] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-18T20:05:26.341268] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-09-18T20:05:26.354673] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-18T20:05:26.403907] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-18T20:05:26.765407] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:05:26.919572] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-11. [2025-09-18T20:05:27.342699] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-18T20:05:27.497814] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-18T20:05:27.503724] [INFO ] [REMOTE ] LOAR: Full fetch complete (56037 records). [2025-09-18T20:05:27.503836] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-09-18T20:05:27.726475] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-18T20:05:27.914677] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-09-18T20:05:27.914772] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-09-18T20:05:27.915554] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-09-18T20:05:27.915596] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-09-18T20:05:27.916837] [DEBUG] [LOCAL ] LOAR: Trimmed 56037 records to 41811 (keeping 200 days of data) [2025-09-18T20:05:28.181045] [DEBUG] [LOCAL ] LOAR: Primary data saved (41811 records). [2025-09-18T20:05:28.181173] [INFO ] [MAIN ] LOAR: Full history saved. [2025-09-18T20:05:28.181266] [INFO ] [MAIN ] Update Progress: 1269/2372 symbols completed. LOAR took 30.6s. Estimated remaining: 2h 41m 10s. Rate: 6.8 symbols/min [2025-09-18T20:05:28.352866] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:05:28.387674] [DEBUG] [LOCAL ] LOMA: Loaded 31289 existing records from primary storage. [2025-09-18T20:05:28.387839] [INFO ] [MAIN ] LOMA: Loaded 31289 existing records. [2025-09-18T20:05:28.527539] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-09-18T20:05:28.577713] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:05:28.578008] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-09-18T20:05:28.578085] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-09-18T20:05:28.579048] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-09-18T20:05:28.579111] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-09-18T20:05:28.951734] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:05:29.232355] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-18T20:05:29.319518] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-09-18T20:05:29.382214] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-18T20:05:29.389683] [INFO ] [REMOTE ] LNG: Full fetch complete (74497 records). [2025-09-18T20:05:29.389882] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-09-18T20:05:29.744583] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-18T20:05:29.850620] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-09-18T20:05:29.850762] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-09-18T20:05:29.851925] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-09-18T20:05:29.852019] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-09-18T20:05:29.853773] [DEBUG] [LOCAL ] LNG: Trimmed 74497 records to 51931 (keeping 200 days of data) [2025-09-18T20:05:30.119548] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-11. [2025-09-18T20:05:30.215540] [DEBUG] [LOCAL ] LNG: Primary data saved (51931 records). [2025-09-18T20:05:30.215755] [INFO ] [MAIN ] LNG: Full history saved. [2025-09-18T20:05:30.215893] [INFO ] [MAIN ] Update Progress: 1270/2372 symbols completed. LNG took 44.3s. Estimated remaining: 2h 40m 55s. Rate: 6.8 symbols/min [2025-09-18T20:05:30.410245] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:05:30.469575] [DEBUG] [LOCAL ] LOW: Loaded 52965 existing records from primary storage. [2025-09-18T20:05:30.469755] [INFO ] [MAIN ] LOW: Loaded 52965 existing records. [2025-09-18T20:05:30.646906] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:05:30.647144] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-09-18T20:05:30.647191] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-09-18T20:05:30.648463] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-09-18T20:05:30.648524] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-09-18T20:05:30.926259] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-18T20:05:31.009538] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:05:31.309120] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-18T20:05:31.336388] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-18T20:05:31.719528] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-18T20:05:32.143002] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-18T20:05:32.519596] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-18T20:05:33.299448] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-18T20:05:33.319501] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-09-18T20:05:33.753983] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-18T20:05:34.119567] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-09-18T20:05:34.919554] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-09-18T20:05:35.660049] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-18T20:05:35.722227] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-09-18T20:05:35.724702] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-18T20:05:36.519553] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-09-18T20:05:36.922480] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T20:05:37.319550] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-09-18T20:05:37.339741] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-18T20:05:37.779818] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-18T20:05:38.119557] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-09-18T20:05:38.919552] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-11. [2025-09-18T20:05:39.255094] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T20:05:39.719555] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-09-18T20:05:40.190674] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-18T20:05:40.519565] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-09-18T20:05:40.608623] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-18T20:05:40.983590] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-18T20:05:41.319612] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-09-18T20:05:42.119511] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-18T20:05:42.331949] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T20:05:42.919563] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-09-18T20:05:43.022989] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-18T20:05:43.027143] [INFO ] [REMOTE ] LOB: Full fetch complete (37344 records). [2025-09-18T20:05:43.027246] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-09-18T20:05:43.455558] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-09-18T20:05:43.455673] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-09-18T20:05:43.456361] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-09-18T20:05:43.456406] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-09-18T20:05:43.457451] [DEBUG] [LOCAL ] LOB: Trimmed 37344 records to 27714 (keeping 200 days of data) [2025-09-18T20:05:43.626734] [DEBUG] [LOCAL ] LOB: Primary data saved (27714 records). [2025-09-18T20:05:43.626878] [INFO ] [MAIN ] LOB: Full history saved. [2025-09-18T20:05:43.626965] [INFO ] [MAIN ] Update Progress: 1271/2372 symbols completed. LOB took 42.3s. Estimated remaining: 2h 40m 50s. Rate: 6.8 symbols/min [2025-09-18T20:05:43.724822] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-09-18T20:05:43.814701] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:05:43.854896] [DEBUG] [LOCAL ] LPG: Loaded 40417 existing records from primary storage. [2025-09-18T20:05:43.855054] [INFO ] [MAIN ] LPG: Loaded 40417 existing records. [2025-09-18T20:05:44.043948] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:05:44.044376] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-09-18T20:05:44.044598] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-09-18T20:05:44.051784] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-09-18T20:05:44.060561] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-09-18T20:05:44.108103] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-18T20:05:44.436944] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:05:44.475160] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-18T20:05:44.476611] [INFO ] [REMOTE ] LOCL: Full fetch complete (4738 records). [2025-09-18T20:05:44.476710] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-09-18T20:05:44.529832] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-11. [2025-09-18T20:05:44.841610] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-09-18T20:05:44.841742] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-09-18T20:05:44.841914] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-09-18T20:05:44.841955] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-09-18T20:05:44.842349] [DEBUG] [LOCAL ] LOCL: Trimmed 4738 records to 3492 (keeping 200 days of data) [2025-09-18T20:05:44.863568] [DEBUG] [LOCAL ] LOCL: Primary data saved (3492 records). [2025-09-18T20:05:44.863685] [INFO ] [MAIN ] LOCL: Full history saved. [2025-09-18T20:05:44.863783] [INFO ] [MAIN ] Update Progress: 1272/2372 symbols completed. LOCL took 18.9s. Estimated remaining: 2h 40m 35s. Rate: 6.9 symbols/min [2025-09-18T20:05:45.048010] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:05:45.077450] [DEBUG] [LOCAL ] LPL: Loaded 25017 existing records from primary storage. [2025-09-18T20:05:45.077618] [INFO ] [MAIN ] LPL: Loaded 25017 existing records. [2025-09-18T20:05:45.252443] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:05:45.252706] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-09-18T20:05:45.252763] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-09-18T20:05:45.253289] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-09-18T20:05:45.253347] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-09-18T20:05:45.326144] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-09-18T20:05:45.608843] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:05:46.119539] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-09-18T20:05:46.172408] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-18T20:05:46.253679] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-18T20:05:46.919561] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-09-18T20:05:47.719552] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-11. [2025-09-18T20:05:47.766440] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-18T20:05:48.125152] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-18T20:05:48.519538] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-09-18T20:05:48.788563] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-18T20:05:49.319553] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-09-18T20:05:49.969121] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-18T20:05:50.109104] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-18T20:05:50.119481] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-09-18T20:05:50.919520] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-09-18T20:05:50.948678] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-18T20:05:51.719549] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-09-18T20:05:52.070925] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-18T20:05:52.519578] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-09-18T20:05:52.952991] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-18T20:05:53.319546] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-09-18T20:05:53.666824] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-18T20:05:54.119565] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-09-18T20:05:54.919532] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-09-18T20:05:54.971496] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-18T20:05:55.240451] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-18T20:05:55.719559] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-09-18T20:05:55.782946] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-18T20:05:56.519615] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-09-18T20:05:57.268680] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-18T20:05:57.319504] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-09-18T20:05:57.380888] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-18T20:05:58.119546] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-09-18T20:05:58.879600] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T20:05:58.919501] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-09-18T20:05:59.665472] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-18T20:05:59.719510] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-09-18T20:05:59.761063] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-18T20:06:00.519589] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-09-18T20:06:01.319570] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-09-18T20:06:01.991152] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-18T20:06:02.036705] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-18T20:06:02.119559] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-09-18T20:06:02.919542] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-09-18T20:06:03.673974] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-18T20:06:03.719501] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-09-18T20:06:04.509992] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-18T20:06:04.519483] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-09-18T20:06:05.220993] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-18T20:06:05.319539] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-18T20:06:05.369298] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-18T20:06:05.620742] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-18T20:06:06.119560] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-09-18T20:06:06.586245] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-18T20:06:06.592205] [INFO ] [REMOTE ] LOMA: Full fetch complete (47960 records). [2025-09-18T20:06:06.592322] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-09-18T20:06:06.935077] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-09-18T20:06:06.990501] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-09-18T20:06:06.990594] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-09-18T20:06:06.991345] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-09-18T20:06:06.991410] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-09-18T20:06:06.992541] [DEBUG] [LOCAL ] LOMA: Trimmed 47960 records to 31637 (keeping 200 days of data) [2025-09-18T20:06:07.178661] [DEBUG] [LOCAL ] LOMA: Primary data saved (31637 records). [2025-09-18T20:06:07.178829] [INFO ] [MAIN ] LOMA: Full history saved. [2025-09-18T20:06:07.178921] [INFO ] [MAIN ] Update Progress: 1273/2372 symbols completed. LOMA took 39.0s. Estimated remaining: 2h 40m 38s. Rate: 6.8 symbols/min [2025-09-18T20:06:07.369251] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:06:07.409403] [DEBUG] [LOCAL ] LPX: Loaded 39725 existing records from primary storage. [2025-09-18T20:06:07.422361] [INFO ] [MAIN ] LPX: Loaded 39725 existing records. [2025-09-18T20:06:07.507098] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T20:06:07.638367] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:06:07.638787] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-09-18T20:06:07.638869] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-09-18T20:06:07.640202] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-09-18T20:06:07.640292] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-09-18T20:06:07.724691] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-18T20:06:08.019012] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:06:08.519564] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-09-18T20:06:08.741061] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-18T20:06:09.048841] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-18T20:06:09.057806] [INFO ] [REMOTE ] LPG: Full fetch complete (60092 records). [2025-09-18T20:06:09.058047] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-09-18T20:06:09.270123] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-18T20:06:09.327409] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-09-18T20:06:09.746501] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-09-18T20:06:09.746688] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-09-18T20:06:09.748240] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-09-18T20:06:09.748333] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-09-18T20:06:09.750232] [DEBUG] [LOCAL ] LPG: Trimmed 60092 records to 40699 (keeping 200 days of data) [2025-09-18T20:06:10.056346] [DEBUG] [LOCAL ] LPG: Primary data saved (40699 records). [2025-09-18T20:06:10.056511] [INFO ] [MAIN ] LPG: Full history saved. [2025-09-18T20:06:10.056617] [INFO ] [MAIN ] Update Progress: 1274/2372 symbols completed. LPG took 26.4s. Estimated remaining: 2h 40m 24s. Rate: 6.8 symbols/min [2025-09-18T20:06:10.126067] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-11. [2025-09-18T20:06:10.239876] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:06:10.288382] [DEBUG] [LOCAL ] LRN: Loaded 40094 existing records from primary storage. [2025-09-18T20:06:10.288557] [INFO ] [MAIN ] LRN: Loaded 40094 existing records. [2025-09-18T20:06:10.468596] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:06:10.468910] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-18T20:06:10.468968] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-18T20:06:10.469872] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-09-18T20:06:10.469934] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-18T20:06:10.864993] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-18T20:06:10.890886] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:06:10.919496] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-09-18T20:06:11.330067] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-18T20:06:11.719541] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-09-18T20:06:12.234626] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-18T20:06:12.519546] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-18T20:06:12.822367] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-18T20:06:13.319525] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-11. [2025-09-18T20:06:14.124600] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-09-18T20:06:14.133375] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-18T20:06:14.139370] [INFO ] [REMOTE ] LPL: Full fetch complete (34107 records). [2025-09-18T20:06:14.139469] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-09-18T20:06:14.530886] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-09-18T20:06:14.531046] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-09-18T20:06:14.531833] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-09-18T20:06:14.531900] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-09-18T20:06:14.533132] [DEBUG] [LOCAL ] LPL: Trimmed 34107 records to 25276 (keeping 200 days of data) [2025-09-18T20:06:14.686560] [DEBUG] [LOCAL ] LPL: Primary data saved (25276 records). [2025-09-18T20:06:14.686755] [INFO ] [MAIN ] LPL: Full history saved. [2025-09-18T20:06:14.686860] [INFO ] [MAIN ] Update Progress: 1275/2372 symbols completed. LPL took 29.8s. Estimated remaining: 2h 40m 12s. Rate: 6.8 symbols/min [2025-09-18T20:06:14.886870] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:06:14.913521] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-18T20:06:14.922040] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-09-18T20:06:14.969097] [DEBUG] [LOCAL ] LSPD: Loaded 43687 existing records from primary storage. [2025-09-18T20:06:14.969261] [INFO ] [MAIN ] LSPD: Loaded 43687 existing records. [2025-09-18T20:06:15.166585] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:06:15.166860] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-18T20:06:15.166951] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-18T20:06:15.168146] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-09-18T20:06:15.168208] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-18T20:06:15.533757] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:06:15.719564] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-11. [2025-09-18T20:06:16.519533] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-09-18T20:06:16.675567] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-18T20:06:16.727099] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-18T20:06:17.269920] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-18T20:06:17.319512] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-09-18T20:06:17.654139] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-18T20:06:18.119537] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-09-18T20:06:18.416949] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-18T20:06:18.919558] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-09-18T20:06:19.404118] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-18T20:06:19.719578] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-09-18T20:06:20.366007] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-18T20:06:20.519558] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-18T20:06:20.963425] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-18T20:06:21.319579] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-18T20:06:21.709927] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-18T20:06:22.119562] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-18T20:06:22.699925] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T20:06:22.919545] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-18T20:06:23.486347] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-18T20:06:23.719544] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-09-18T20:06:24.127475] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-18T20:06:24.519542] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-18T20:06:25.009404] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-18T20:06:25.319546] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-09-18T20:06:25.743223] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-18T20:06:26.119573] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-18T20:06:26.511423] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-18T20:06:26.919571] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-18T20:06:27.719561] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-09-18T20:06:27.779069] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T20:06:27.975911] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-18T20:06:28.519547] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-18T20:06:29.319525] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-09-18T20:06:29.498422] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-18T20:06:29.641372] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-18T20:06:30.119551] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-18T20:06:30.513745] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-18T20:06:30.919555] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-09-18T20:06:31.505595] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-18T20:06:31.719567] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-09-18T20:06:32.250630] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-18T20:06:32.519552] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-18T20:06:33.319605] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-09-18T20:06:33.603177] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-18T20:06:33.669692] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-18T20:06:34.119609] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-18T20:06:34.461985] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-18T20:06:34.919582] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-18T20:06:35.719561] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-18T20:06:36.249694] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T20:06:36.281921] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-18T20:06:36.290455] [INFO ] [REMOTE ] LOW: Full fetch complete (76328 records). [2025-09-18T20:06:36.290595] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-09-18T20:06:36.525367] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-18T20:06:36.727706] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-09-18T20:06:36.727810] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-09-18T20:06:36.729094] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-09-18T20:06:36.729177] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-09-18T20:06:36.730860] [DEBUG] [LOCAL ] LOW: Trimmed 76328 records to 53348 (keeping 200 days of data) [2025-09-18T20:06:36.856125] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-18T20:06:36.863305] [INFO ] [REMOTE ] LSPD: Full fetch complete (61656 records). [2025-09-18T20:06:36.864022] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-09-18T20:06:37.313364] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-09-18T20:06:37.313792] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-09-18T20:06:37.314805] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-18T20:06:37.315974] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-09-18T20:06:37.319511] [DEBUG] [LOCAL ] LSPD: Trimmed 61656 records to 43972 (keeping 200 days of data) [2025-09-18T20:06:37.320278] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-09-18T20:06:37.775773] [DEBUG] [LOCAL ] LOW: Primary data saved (53348 records). [2025-09-18T20:06:37.776542] [INFO ] [MAIN ] LOW: Full history saved. [2025-09-18T20:06:37.776736] [INFO ] [MAIN ] Update Progress: 1276/2372 symbols completed. LOW took 1m 8s. Estimated remaining: 2h 40m 15s. Rate: 6.8 symbols/min [2025-09-18T20:06:37.971314] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:06:38.011595] [DEBUG] [LOCAL ] LSPD: Primary data saved (43972 records). [2025-09-18T20:06:38.012031] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-18T20:06:38.013431] [INFO ] [MAIN ] Update Progress: 1277/2372 symbols completed. LSPD took 23.3s. Estimated remaining: 2h 39m 59s. Rate: 6.8 symbols/min [2025-09-18T20:06:38.044232] [DEBUG] [LOCAL ] LTC: Loaded 29977 existing records from primary storage. [2025-09-18T20:06:38.045244] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-18T20:06:38.045503] [INFO ] [MAIN ] LTC: Loaded 29977 existing records. [2025-09-18T20:06:38.129106] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-18T20:06:38.238051] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:06:38.238448] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-09-18T20:06:38.238532] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-09-18T20:06:38.239405] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-09-18T20:06:38.239473] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-09-18T20:06:38.606427] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:06:38.700084] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-18T20:06:38.919603] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-18T20:06:39.348589] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-18T20:06:39.719618] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-18T20:06:40.050013] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-18T20:06:40.055426] [INFO ] [REMOTE ] LPX: Full fetch complete (58112 records). [2025-09-18T20:06:40.055533] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-09-18T20:06:40.434211] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-09-18T20:06:40.434299] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-09-18T20:06:40.435084] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-09-18T20:06:40.435151] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-09-18T20:06:40.436310] [DEBUG] [LOCAL ] LPX: Trimmed 58112 records to 40075 (keeping 200 days of data) [2025-09-18T20:06:40.524998] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-11. [2025-09-18T20:06:40.684333] [DEBUG] [LOCAL ] LPX: Primary data saved (40075 records). [2025-09-18T20:06:40.684464] [INFO ] [MAIN ] LPX: Full history saved. [2025-09-18T20:06:40.684547] [INFO ] [MAIN ] Update Progress: 1278/2372 symbols completed. LPX took 33.5s. Estimated remaining: 2h 39m 45s. Rate: 6.8 symbols/min [2025-09-18T20:06:40.958331] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T20:06:41.319564] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-18T20:06:41.712808] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-18T20:06:42.119615] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-09-18T20:06:42.869381] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-18T20:06:42.875044] [INFO ] [REMOTE ] LRN: Full fetch complete (58253 records). [2025-09-18T20:06:42.875149] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-09-18T20:06:43.279522] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-09-18T20:06:43.279636] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-09-18T20:06:43.280678] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-09-18T20:06:43.280867] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-09-18T20:06:43.297403] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-18T20:06:43.303880] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-09-18T20:06:43.304045] [DEBUG] [LOCAL ] LRN: Trimmed 58253 records to 40443 (keeping 200 days of data) [2025-09-18T20:06:43.566701] [DEBUG] [LOCAL ] LRN: Primary data saved (40443 records). [2025-09-18T20:06:43.566851] [INFO ] [MAIN ] LRN: Full history saved. [2025-09-18T20:06:43.566939] [INFO ] [MAIN ] Update Progress: 1279/2372 symbols completed. LRN took 33.5s. Estimated remaining: 2h 39m 31s. Rate: 6.9 symbols/min [2025-09-18T20:06:44.554198] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T20:06:44.560407] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-09-18T20:06:45.585711] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-18T20:06:45.591713] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-09-18T20:06:46.790813] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-18T20:06:46.797237] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-09-18T20:06:47.936577] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-18T20:06:47.943934] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-09-18T20:06:49.034179] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-18T20:06:49.041084] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-09-18T20:06:50.292202] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-18T20:06:50.298606] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-09-18T20:06:51.800052] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-18T20:06:51.810274] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-09-18T20:06:53.221589] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-18T20:06:53.228667] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-18T20:06:54.358598] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-18T20:06:54.362753] [INFO ] [REMOTE ] LTC: Full fetch complete (42654 records). [2025-09-18T20:06:54.362886] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-09-18T20:06:54.750912] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-09-18T20:06:54.751030] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-09-18T20:06:54.751816] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-09-18T20:06:54.751895] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-09-18T20:06:54.752875] [DEBUG] [LOCAL ] LTC: Trimmed 42654 records to 30192 (keeping 200 days of data) [2025-09-18T20:06:54.942318] [DEBUG] [LOCAL ] LTC: Primary data saved (30192 records). [2025-09-18T20:06:54.942494] [INFO ] [MAIN ] LTC: Full history saved. [2025-09-18T20:06:54.942638] [INFO ] [MAIN ] Update Progress: 1280/2372 symbols completed. LTC took 17.2s. Estimated remaining: 2h 39m 25s. Rate: 6.9 symbols/min [2025-09-18T20:06:55.589426] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:06:55.670833] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:06:55.671852] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:06:55.667390] [DEBUG] [LOCAL ] LUCK: No existing data file found in primary storage. [2025-09-18T20:06:55.617256] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:06:55.672061] [WARN ] [MAIN ] LUCK: No existing data found, performing full refresh instead. [2025-09-18T20:06:55.674171] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-18T20:06:55.674685] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-18T20:06:55.674795] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-18T20:06:55.675500] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-18T20:06:55.995694] [DEBUG] [LOCAL ] LTM: Loaded 35608 existing records from primary storage. [2025-09-18T20:06:55.996099] [INFO ] [MAIN ] LTM: Loaded 35608 existing records. [2025-09-18T20:06:56.127623] [DEBUG] [LOCAL ] LU: Loaded 48955 existing records from primary storage. [2025-09-18T20:06:56.111391] [DEBUG] [LOCAL ] LTH: Loaded 51937 existing records from primary storage. [2025-09-18T20:06:56.158852] [INFO ] [MAIN ] LTH: Loaded 51937 existing records. [2025-09-18T20:06:56.164133] [INFO ] [MAIN ] LU: Loaded 48955 existing records. [2025-09-18T20:06:56.386267] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:06:56.434746] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-11. [2025-09-18T20:06:56.662804] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:06:56.699324] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:06:56.742295] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:06:56.742153] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-09-18T20:06:56.742489] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-09-18T20:06:56.742807] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-09-18T20:06:56.742697] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-09-18T20:06:56.742985] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-18T20:06:56.743147] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-18T20:06:56.744250] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-09-18T20:06:56.744320] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-09-18T20:06:56.744344] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-09-18T20:06:56.750265] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-09-18T20:06:56.744472] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-09-18T20:06:56.775510] [DEBUG] [REMOTE ] LUCK: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:06:56.781310] [WARN ] [REMOTE ] LUCK: No data returned for month 2024-11 [2025-09-18T20:06:56.780996] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-18T20:06:56.853181] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-18T20:06:57.737611] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:06:57.756585] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-11. [2025-09-18T20:06:57.905952] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:06:57.942890] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:06:57.943765] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-11. [2025-09-18T20:06:57.943436] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-11. [2025-09-18T20:06:57.961854] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T20:06:57.967090] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-18T20:06:59.160440] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-18T20:06:59.165963] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-09-18T20:06:59.290874] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-18T20:06:59.300878] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-09-18T20:06:59.324837] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-18T20:06:59.333767] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-18T20:06:59.363773] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T20:06:59.373081] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-09-18T20:06:59.855197] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-18T20:06:59.860026] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-09-18T20:07:00.470547] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T20:07:00.478302] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-18T20:07:00.716173] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-18T20:07:00.742997] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-09-18T20:07:00.766997] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-18T20:07:00.777324] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-09-18T20:07:00.981507] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-18T20:07:01.319606] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-09-18T20:07:01.479395] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-18T20:07:01.738283] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-18T20:07:02.056163] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-18T20:07:02.119582] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-09-18T20:07:02.922021] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-18T20:07:02.926450] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T20:07:02.981607] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-18T20:07:03.719557] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-09-18T20:07:04.519564] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-18T20:07:04.558138] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-18T20:07:05.118775] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T20:07:05.319550] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-09-18T20:07:05.904276] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-18T20:07:06.119546] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-18T20:07:06.809185] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-18T20:07:06.919554] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-18T20:07:07.628170] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T20:07:07.719543] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-18T20:07:08.091194] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-18T20:07:08.519538] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-18T20:07:09.319523] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-09-18T20:07:09.362157] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T20:07:09.463812] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-18T20:07:10.119552] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-18T20:07:10.769003] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T20:07:10.919589] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-09-18T20:07:10.962226] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-18T20:07:11.719541] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-18T20:07:12.519546] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-09-18T20:07:12.761569] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-18T20:07:12.911911] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-18T20:07:13.319623] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-18T20:07:13.622708] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-18T20:07:14.038488] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-18T20:07:14.119530] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-18T20:07:14.919616] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-18T20:07:15.030417] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-18T20:07:15.034017] [INFO ] [REMOTE ] LUCK: Full fetch complete (39563 records). [2025-09-18T20:07:15.034146] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-18T20:07:15.242905] [WARN ] [VALIDATOR ] LUCK: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-09-18T20:07:15.243869] [FATAL] [MAIN ] LUCK: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:07:15.243970] [WARN ] [MAIN ] LUCK: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:07:15.244075] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-18T20:07:15.244214] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-18T20:07:15.244276] [INFO ] [LOCAL ] LUCK: Starting deletion of derivative data. [2025-09-18T20:07:15.244338] [DEBUG] [LOCAL ] LUCK: No derivative data file found to delete. [2025-09-18T20:07:15.244576] [INFO ] [MAIN ] Update Progress: 1281/2372 symbols completed. LUCK took 20.3s. Estimated remaining: 2h 39m 26s. Rate: 6.8 symbols/min [2025-09-18T20:07:15.417048] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:07:15.486414] [DEBUG] [LOCAL ] LUMN: Loaded 53634 existing records from primary storage. [2025-09-18T20:07:15.486582] [INFO ] [MAIN ] LUMN: Loaded 53634 existing records. [2025-09-18T20:07:15.666629] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:07:15.666950] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-18T20:07:15.667005] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-18T20:07:15.668402] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-09-18T20:07:15.668472] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-18T20:07:15.731161] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-09-18T20:07:16.044486] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:07:16.519619] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-11. [2025-09-18T20:07:16.610090] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-18T20:07:16.842730] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-18T20:07:17.319566] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-09-18T20:07:18.119621] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-18T20:07:18.274228] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-18T20:07:18.442465] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-18T20:07:18.919591] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-09-18T20:07:19.583009] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-18T20:07:19.719629] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-09-18T20:07:20.519628] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-18T20:07:20.651622] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-18T20:07:21.230194] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-18T20:07:21.319556] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-09-18T20:07:21.918843] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-18T20:07:22.119555] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-09-18T20:07:22.919545] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-09-18T20:07:23.047426] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-18T20:07:23.359100] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T20:07:23.719628] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-09-18T20:07:24.491158] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-18T20:07:24.519498] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-18T20:07:25.034400] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-18T20:07:25.319585] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-18T20:07:26.041797] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-18T20:07:26.119498] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-18T20:07:26.747860] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-18T20:07:26.754466] [INFO ] [REMOTE ] LTM: Full fetch complete (46229 records). [2025-09-18T20:07:26.754594] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-09-18T20:07:26.932940] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-09-18T20:07:27.144201] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-09-18T20:07:27.144304] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-09-18T20:07:27.145086] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-09-18T20:07:27.145176] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-09-18T20:07:27.147701] [DEBUG] [LOCAL ] LTM: Trimmed 46229 records to 35889 (keeping 200 days of data) [2025-09-18T20:07:27.378875] [DEBUG] [LOCAL ] LTM: Primary data saved (35889 records). [2025-09-18T20:07:27.379032] [INFO ] [MAIN ] LTM: Full history saved. [2025-09-18T20:07:27.379176] [INFO ] [MAIN ] Update Progress: 1282/2372 symbols completed. LTM took 32.4s. Estimated remaining: 2h 39m 20s. Rate: 6.8 symbols/min [2025-09-18T20:07:27.551605] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:07:27.614857] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-09-18T20:07:27.615111] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-09-18T20:07:27.724811] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-18T20:07:27.796123] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:07:27.796450] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-09-18T20:07:27.796515] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-09-18T20:07:27.798411] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-09-18T20:07:27.798489] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-09-18T20:07:28.169065] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:07:28.210024] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-18T20:07:28.519547] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-18T20:07:28.569059] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T20:07:29.085172] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-18T20:07:29.093587] [INFO ] [REMOTE ] LU: Full fetch complete (70327 records). [2025-09-18T20:07:29.093766] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-09-18T20:07:29.324711] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-11. [2025-09-18T20:07:29.492931] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-09-18T20:07:29.493150] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-09-18T20:07:29.494170] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-18T20:07:29.494235] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-09-18T20:07:29.498505] [DEBUG] [LOCAL ] LU: Trimmed 70327 records to 49316 (keeping 200 days of data) [2025-09-18T20:07:29.794631] [DEBUG] [LOCAL ] LU: Primary data saved (49316 records). [2025-09-18T20:07:29.795084] [INFO ] [MAIN ] LU: Full history saved. [2025-09-18T20:07:29.795239] [INFO ] [MAIN ] Update Progress: 1283/2372 symbols completed. LU took 34.8s. Estimated remaining: 2h 39m 6s. Rate: 6.8 symbols/min [2025-09-18T20:07:29.967250] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:07:29.967436] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-18T20:07:29.967492] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-18T20:07:29.967724] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-18T20:07:29.967776] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-18T20:07:29.967820] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-18T20:07:29.967853] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-18T20:07:30.130338] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-18T20:07:30.330625] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:07:30.424263] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-18T20:07:30.919568] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-11. [2025-09-18T20:07:31.081959] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-18T20:07:31.118171] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:07:31.118434] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-11 [2025-09-18T20:07:31.563268] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-18T20:07:31.570377] [INFO ] [REMOTE ] LTH: Full fetch complete (73627 records). [2025-09-18T20:07:31.570497] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-09-18T20:07:31.731224] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-09-18T20:07:31.969872] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-09-18T20:07:31.969956] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-09-18T20:07:31.970964] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-09-18T20:07:31.971030] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-09-18T20:07:31.975121] [DEBUG] [LOCAL ] LTH: Trimmed 73627 records to 52311 (keeping 200 days of data) [2025-09-18T20:07:32.306879] [DEBUG] [LOCAL ] LTH: Primary data saved (52311 records). [2025-09-18T20:07:32.307032] [INFO ] [MAIN ] LTH: Full history saved. [2025-09-18T20:07:32.307168] [INFO ] [MAIN ] Update Progress: 1284/2372 symbols completed. LTH took 37.4s. Estimated remaining: 2h 38m 52s. Rate: 6.8 symbols/min [2025-09-18T20:07:32.483941] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:07:32.524916] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-18T20:07:32.547236] [DEBUG] [LOCAL ] LVS: Loaded 53567 existing records from primary storage. [2025-09-18T20:07:32.547373] [INFO ] [MAIN ] LVS: Loaded 53567 existing records. [2025-09-18T20:07:32.731127] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:07:32.731412] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-09-18T20:07:32.731461] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-09-18T20:07:32.733157] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-09-18T20:07:32.733221] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-09-18T20:07:33.093381] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:07:33.319509] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-11. [2025-09-18T20:07:33.531019] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-18T20:07:34.119543] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-09-18T20:07:34.519157] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-18T20:07:34.797371] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-18T20:07:34.919503] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-09-18T20:07:35.707763] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-18T20:07:35.719500] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-09-18T20:07:36.519553] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-18T20:07:36.645310] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-18T20:07:36.741967] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:07:36.742266] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-18T20:07:37.152033] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T20:07:37.319570] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-09-18T20:07:37.531825] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:07:37.532157] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-09-18T20:07:38.119560] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-09-18T20:07:38.919545] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-18T20:07:39.719610] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-09-18T20:07:40.197778] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-18T20:07:40.519559] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-09-18T20:07:40.761530] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-18T20:07:41.238435] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T20:07:41.319559] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-18T20:07:42.119606] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-02. [2025-09-18T20:07:42.324752] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:07:42.325212] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-02 [2025-09-18T20:07:42.355884] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-18T20:07:42.919690] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-09-18T20:07:43.111462] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-18T20:07:43.719533] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-18T20:07:44.519546] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-03. [2025-09-18T20:07:44.695848] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-18T20:07:44.734794] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:07:44.735120] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-03 [2025-09-18T20:07:45.319605] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-04. [2025-09-18T20:07:45.488060] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-18T20:07:45.537212] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:07:45.537546] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-04 [2025-09-18T20:07:46.119553] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-18T20:07:46.919566] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-09-18T20:07:47.719545] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-09-18T20:07:47.967624] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-18T20:07:47.975343] [INFO ] [REMOTE ] LUMN: Full fetch complete (77517 records). [2025-09-18T20:07:47.975548] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-09-18T20:07:48.383739] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-09-18T20:07:48.383834] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-09-18T20:07:48.384863] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-18T20:07:48.384948] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-09-18T20:07:48.386477] [DEBUG] [LOCAL ] LUMN: Trimmed 77517 records to 54024 (keeping 200 days of data) [2025-09-18T20:07:48.556933] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-05. [2025-09-18T20:07:48.723138] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-18T20:07:48.749556] [DEBUG] [LOCAL ] LUMN: Primary data saved (54024 records). [2025-09-18T20:07:48.749735] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-18T20:07:48.749873] [INFO ] [MAIN ] Update Progress: 1285/2372 symbols completed. LUMN took 33.5s. Estimated remaining: 2h 38m 50s. Rate: 6.8 symbols/min [2025-09-18T20:07:48.923222] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:07:48.941522] [DEBUG] [LOCAL ] LVWR: Loaded 17030 existing records from primary storage. [2025-09-18T20:07:48.941679] [INFO ] [MAIN ] LVWR: Loaded 17030 existing records. [2025-09-18T20:07:49.129132] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:07:49.129537] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-18T20:07:49.129675] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-18T20:07:49.130291] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-09-18T20:07:49.130353] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-18T20:07:49.322068] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-09-18T20:07:49.488011] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-18T20:07:49.601912] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-18T20:07:49.608481] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:07:50.119561] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-09-18T20:07:50.919590] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-11. [2025-09-18T20:07:51.295549] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-18T20:07:51.318406] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-11 (0.40 seconds). [2025-09-18T20:07:51.719549] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-09-18T20:07:51.812381] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-18T20:07:52.519604] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-09-18T20:07:53.319586] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-09-18T20:07:53.399194] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-18T20:07:53.722780] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-18T20:07:54.049515] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-18T20:07:54.119693] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-18T20:07:54.919588] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-09-18T20:07:55.719535] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-09-18T20:07:56.036135] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-18T20:07:56.045539] [INFO ] [REMOTE ] LUV: Full fetch complete (77593 records). [2025-09-18T20:07:56.045730] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-09-18T20:07:56.185012] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-18T20:07:56.469992] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-09-18T20:07:56.470124] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-09-18T20:07:56.471276] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-09-18T20:07:56.471497] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-09-18T20:07:56.473254] [DEBUG] [LOCAL ] LUV: Trimmed 77593 records to 54079 (keeping 200 days of data) [2025-09-18T20:07:56.531095] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-06. [2025-09-18T20:07:56.604483] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-18T20:07:56.866034] [DEBUG] [LOCAL ] LUV: Primary data saved (54079 records). [2025-09-18T20:07:56.866195] [INFO ] [MAIN ] LUV: Full history saved. [2025-09-18T20:07:56.866285] [INFO ] [MAIN ] Update Progress: 1286/2372 symbols completed. LUV took 29.5s. Estimated remaining: 2h 38m 40s. Rate: 6.8 symbols/min [2025-09-18T20:07:57.048906] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:07:57.099610] [DEBUG] [LOCAL ] LW: Loaded 51313 existing records from primary storage. [2025-09-18T20:07:57.099786] [INFO ] [MAIN ] LW: Loaded 51313 existing records. [2025-09-18T20:07:57.292600] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:07:57.292844] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-09-18T20:07:57.292892] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-09-18T20:07:57.294460] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-09-18T20:07:57.294541] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-09-18T20:07:57.326852] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-18T20:07:57.677111] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-18T20:07:57.702919] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:07:57.786633] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-18T20:07:58.119543] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-18T20:07:58.659740] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-18T20:07:58.919544] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-18T20:07:59.423432] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-18T20:07:59.719543] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-18T20:08:00.519556] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-07. [2025-09-18T20:08:00.861384] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-18T20:08:01.251407] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-18T20:08:01.319562] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-09-18T20:08:02.119563] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-18T20:08:02.919585] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-11. [2025-09-18T20:08:03.084345] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-18T20:08:03.511002] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-18T20:08:03.719555] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-08. [2025-09-18T20:08:04.219912] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-18T20:08:04.506884] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T20:08:04.519516] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-09-18T20:08:05.319569] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-18T20:08:06.119601] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-09-18T20:08:06.573372] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-18T20:08:06.613253] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-18T20:08:06.919592] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-09-18T20:08:07.686701] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-18T20:08:07.719549] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-09-18T20:08:08.394274] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T20:08:08.519563] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-18T20:08:09.319554] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-09. [2025-09-18T20:08:09.452686] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-18T20:08:10.116876] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-18T20:08:10.124264] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-18T20:08:10.125870] [INFO ] [REMOTE ] LVS: Full fetch complete (77366 records). [2025-09-18T20:08:10.125975] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-09-18T20:08:10.344483] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-18T20:08:10.424523] [INFO ] [REMOTE ] LUXE: Full fetch complete (12232 records). [2025-09-18T20:08:10.454386] [DEBUG] [VALIDATOR ] LUXE: Validating primary data. [2025-09-18T20:08:10.733479] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-09-18T20:08:10.735360] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-09-18T20:08:10.754076] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-09-18T20:08:10.760537] [WARN ] [VALIDATOR ] LUXE: Validation failed - insufficient historical data. Have 97 unique days, need 200 days [2025-09-18T20:08:10.760915] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-09-18T20:08:10.761127] [FATAL] [MAIN ] LUXE: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:08:10.761530] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:08:10.761605] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-18T20:08:10.761707] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-18T20:08:10.761773] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-18T20:08:10.762227] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-18T20:08:10.762419] [INFO ] [MAIN ] Update Progress: 1287/2372 symbols completed. LUXE took 41.0s. Estimated remaining: 2h 38m 36s. Rate: 6.8 symbols/min [2025-09-18T20:08:10.869985] [DEBUG] [LOCAL ] LVS: Trimmed 77366 records to 53957 (keeping 200 days of data) [2025-09-18T20:08:10.920863] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-09-18T20:08:11.048217] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:08:11.062553] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-18T20:08:11.084193] [DEBUG] [LOCAL ] LXFR: Loaded 17168 existing records from primary storage. [2025-09-18T20:08:11.084937] [INFO ] [MAIN ] LXFR: Loaded 17168 existing records. [2025-09-18T20:08:11.287080] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:08:11.288824] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-09-18T20:08:11.289186] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-09-18T20:08:11.290593] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-09-18T20:08:11.290981] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-09-18T20:08:11.723605] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-18T20:08:11.770949] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:08:11.895622] [DEBUG] [LOCAL ] LVS: Primary data saved (53957 records). [2025-09-18T20:08:11.895797] [INFO ] [MAIN ] LVS: Full history saved. [2025-09-18T20:08:11.896738] [INFO ] [MAIN ] Update Progress: 1288/2372 symbols completed. LVS took 39.6s. Estimated remaining: 2h 38m 21s. Rate: 6.8 symbols/min [2025-09-18T20:08:12.067559] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:08:12.067785] [DEBUG] [LOCAL ] LXP: No existing data file found in primary storage. [2025-09-18T20:08:12.067842] [WARN ] [MAIN ] LXP: No existing data found, performing full refresh instead. [2025-09-18T20:08:12.067988] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-18T20:08:12.068032] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-18T20:08:12.068074] [DEBUG] [LOCAL ] LXP: No primary data file found to delete. [2025-09-18T20:08:12.068153] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-18T20:08:12.435454] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:08:12.519520] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-11. [2025-09-18T20:08:12.547874] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-18T20:08:12.889189] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-18T20:08:12.892674] [INFO ] [REMOTE ] LVWR: Full fetch complete (19428 records). [2025-09-18T20:08:12.892806] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-09-18T20:08:13.271040] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-09-18T20:08:13.271123] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-09-18T20:08:13.271558] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-09-18T20:08:13.271600] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-09-18T20:08:13.272233] [DEBUG] [LOCAL ] LVWR: Trimmed 19428 records to 17218 (keeping 200 days of data) [2025-09-18T20:08:13.340105] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-09-18T20:08:13.372143] [DEBUG] [LOCAL ] LVWR: Primary data saved (17218 records). [2025-09-18T20:08:13.372290] [INFO ] [MAIN ] LVWR: Full history saved. [2025-09-18T20:08:13.372402] [INFO ] [MAIN ] Update Progress: 1289/2372 symbols completed. LVWR took 24.6s. Estimated remaining: 2h 38m 6s. Rate: 6.9 symbols/min [2025-09-18T20:08:13.542271] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:08:13.573824] [DEBUG] [LOCAL ] LXU: Loaded 32285 existing records from primary storage. [2025-09-18T20:08:13.574000] [INFO ] [MAIN ] LXU: Loaded 32285 existing records. [2025-09-18T20:08:13.763559] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:08:13.763925] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-18T20:08:13.763987] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-18T20:08:13.764844] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-09-18T20:08:13.764907] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-18T20:08:14.149150] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-11. [2025-09-18T20:08:14.138782] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:08:14.171250] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T20:08:14.919578] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-09-18T20:08:15.055969] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-18T20:08:15.139842] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-18T20:08:15.719602] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-09-18T20:08:16.311270] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T20:08:16.514028] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-18T20:08:16.519481] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-09-18T20:08:17.319560] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-09-18T20:08:17.355557] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T20:08:18.119551] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-09-18T20:08:18.760187] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-18T20:08:18.912180] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-18T20:08:18.919487] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-09-18T20:08:19.719596] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-18T20:08:19.768393] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-18T20:08:20.519555] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-11. [2025-09-18T20:08:21.049574] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T20:08:21.319533] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-18T20:08:21.683837] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-18T20:08:22.119610] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-09-18T20:08:22.847035] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T20:08:22.919493] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-18T20:08:23.460813] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-18T20:08:23.719567] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-09-18T20:08:24.289275] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-18T20:08:24.519544] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-09-18T20:08:24.612540] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-18T20:08:25.319535] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-18T20:08:25.623222] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-18T20:08:26.119550] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-09-18T20:08:26.890508] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T20:08:26.919493] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-18T20:08:27.703713] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T20:08:27.719494] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-09-18T20:08:28.519547] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-09-18T20:08:28.559007] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-18T20:08:29.048562] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-18T20:08:29.316149] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-18T20:08:29.320341] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-09-18T20:08:30.119553] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-09-18T20:08:30.408214] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-18T20:08:30.919579] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-18T20:08:31.676523] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-18T20:08:31.719564] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-18T20:08:32.308705] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-18T20:08:32.519607] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-09-18T20:08:32.822064] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-18T20:08:33.319582] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-18T20:08:34.034019] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-18T20:08:34.119503] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-18T20:08:34.666350] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-18T20:08:34.919619] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-18T20:08:35.473877] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-18T20:08:35.480820] [INFO ] [REMOTE ] LW: Full fetch complete (74487 records). [2025-09-18T20:08:35.480944] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-09-18T20:08:35.724767] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-09-18T20:08:35.882873] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-09-18T20:08:35.882957] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-09-18T20:08:35.883914] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-09-18T20:08:35.883979] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-09-18T20:08:35.885482] [DEBUG] [LOCAL ] LW: Trimmed 74487 records to 51681 (keeping 200 days of data) [2025-09-18T20:08:36.201166] [DEBUG] [LOCAL ] LW: Primary data saved (51681 records). [2025-09-18T20:08:36.201302] [INFO ] [MAIN ] LW: Full history saved. [2025-09-18T20:08:36.201387] [INFO ] [MAIN ] Update Progress: 1290/2372 symbols completed. LW took 39.3s. Estimated remaining: 2h 38m 9s. Rate: 6.8 symbols/min [2025-09-18T20:08:36.374260] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:08:36.431088] [DEBUG] [LOCAL ] LYB: Loaded 53600 existing records from primary storage. [2025-09-18T20:08:36.431258] [INFO ] [MAIN ] LYB: Loaded 53600 existing records. [2025-09-18T20:08:36.526474] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-18T20:08:36.624488] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:08:36.625710] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-09-18T20:08:36.626040] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-18T20:08:36.637279] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-09-18T20:08:36.643932] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-09-18T20:08:36.668311] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-18T20:08:36.684209] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-18T20:08:36.769778] [INFO ] [REMOTE ] LXP: Full fetch complete (72242 records). [2025-09-18T20:08:36.780971] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-09-18T20:08:37.322067] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-09-18T20:08:37.350265] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:08:37.480323] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-09-18T20:08:37.480455] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-09-18T20:08:37.481751] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-09-18T20:08:37.481903] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-09-18T20:08:37.484052] [DEBUG] [LOCAL ] LXP: Trimmed 72242 records to 51004 (keeping 200 days of data) [2025-09-18T20:08:37.800905] [DEBUG] [LOCAL ] LXP: Primary data saved (51004 records). [2025-09-18T20:08:37.801061] [INFO ] [MAIN ] LXP: Full history saved. [2025-09-18T20:08:37.801147] [INFO ] [MAIN ] Update Progress: 1291/2372 symbols completed. LXP took 25.9s. Estimated remaining: 2h 37m 54s. Rate: 6.8 symbols/min [2025-09-18T20:08:37.978416] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:08:38.003882] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T20:08:38.059329] [DEBUG] [LOCAL ] LYG: Loaded 52937 existing records from primary storage. [2025-09-18T20:08:38.059483] [INFO ] [MAIN ] LYG: Loaded 52937 existing records. [2025-09-18T20:08:38.127272] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-11. [2025-09-18T20:08:38.260023] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:08:38.260737] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-09-18T20:08:38.260806] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-09-18T20:08:38.267684] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-09-18T20:08:38.272410] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-09-18T20:08:38.322112] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-18T20:08:38.639080] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:08:38.919551] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-18T20:08:39.719697] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-11. [2025-09-18T20:08:39.860199] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-18T20:08:40.025502] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-18T20:08:40.519549] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-18T20:08:41.289503] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-18T20:08:41.319494] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-09-18T20:08:41.913625] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-18T20:08:42.119620] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-18T20:08:42.911661] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-18T20:08:42.921856] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-09-18T20:08:43.037443] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T20:08:43.719588] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-18T20:08:44.519549] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-09-18T20:08:44.556183] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-18T20:08:44.618231] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-18T20:08:45.319588] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-18T20:08:46.042347] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T20:08:46.119637] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-09-18T20:08:46.625034] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-18T20:08:46.744813] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T20:08:46.919490] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-18T20:08:47.719548] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-09-18T20:08:47.769092] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-18T20:08:47.771599] [INFO ] [REMOTE ] LXFR: Full fetch complete (25046 records). [2025-09-18T20:08:47.771702] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-09-18T20:08:48.142480] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-09-18T20:08:48.142618] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-09-18T20:08:48.143214] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-09-18T20:08:48.143263] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-09-18T20:08:48.144135] [DEBUG] [LOCAL ] LXFR: Trimmed 25046 records to 17313 (keeping 200 days of data) [2025-09-18T20:08:48.250788] [DEBUG] [LOCAL ] LXFR: Primary data saved (17313 records). [2025-09-18T20:08:48.250947] [INFO ] [MAIN ] LXFR: Full history saved. [2025-09-18T20:08:48.251055] [INFO ] [MAIN ] Update Progress: 1292/2372 symbols completed. LXFR took 37.5s. Estimated remaining: 2h 37m 47s. Rate: 6.8 symbols/min [2025-09-18T20:08:48.427419] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:08:48.481809] [DEBUG] [LOCAL ] LYV: Loaded 51304 existing records from primary storage. [2025-09-18T20:08:48.481971] [INFO ] [MAIN ] LYV: Loaded 51304 existing records. [2025-09-18T20:08:48.524874] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-18T20:08:48.667055] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:08:48.667309] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-09-18T20:08:48.667371] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-09-18T20:08:48.668572] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-09-18T20:08:48.668634] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-09-18T20:08:49.020552] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:08:49.319632] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-11. [2025-09-18T20:08:49.561966] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-18T20:08:49.603098] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-18T20:08:49.607257] [INFO ] [REMOTE ] LXU: Full fetch complete (44735 records). [2025-09-18T20:08:49.607364] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-09-18T20:08:49.988373] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-09-18T20:08:49.988503] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-09-18T20:08:49.989215] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-18T20:08:49.989288] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-09-18T20:08:49.990272] [DEBUG] [LOCAL ] LXU: Trimmed 44735 records to 32513 (keeping 200 days of data) [2025-09-18T20:08:50.126667] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-09-18T20:08:50.169887] [DEBUG] [LOCAL ] LXU: Primary data saved (32513 records). [2025-09-18T20:08:50.169992] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-18T20:08:50.170069] [INFO ] [MAIN ] Update Progress: 1293/2372 symbols completed. LXU took 36.8s. Estimated remaining: 2h 37m 32s. Rate: 6.8 symbols/min [2025-09-18T20:08:50.339998] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:08:50.376524] [DEBUG] [LOCAL ] LZB: Loaded 35504 existing records from primary storage. [2025-09-18T20:08:50.376720] [INFO ] [MAIN ] LZB: Loaded 35504 existing records. [2025-09-18T20:08:50.552738] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:08:50.552971] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-09-18T20:08:50.553019] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-09-18T20:08:50.553872] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-09-18T20:08:50.553933] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-09-18T20:08:50.915738] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:08:50.919486] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-11. [2025-09-18T20:08:50.971026] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T20:08:51.532253] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T20:08:51.719550] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-09-18T20:08:51.954065] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-18T20:08:52.519563] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-09-18T20:08:53.319624] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-09-18T20:08:53.459044] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-18T20:08:53.597194] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-18T20:08:54.119545] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-09-18T20:08:54.930988] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-09-18T20:08:54.959835] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T20:08:55.719577] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-09-18T20:08:55.816342] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-18T20:08:56.352276] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T20:08:56.519548] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-09-18T20:08:57.202770] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-18T20:08:57.319543] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-09-18T20:08:58.048765] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T20:08:58.119543] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-09-18T20:08:58.920418] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-09-18T20:08:58.942005] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-18T20:08:59.394162] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-18T20:08:59.719537] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-09-18T20:09:00.414330] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T20:09:00.519547] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-09-18T20:09:00.895907] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-18T20:09:01.319575] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-09-18T20:09:02.119556] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-09-18T20:09:02.830467] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-18T20:09:02.919602] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-09-18T20:09:03.719572] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-09-18T20:09:05.179266] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (3.86 seconds). [2025-09-18T20:09:05.191134] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-09-18T20:09:05.256916] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-18T20:09:05.320164] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-09-18T20:09:05.325856] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-18T20:09:05.426074] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (3.31 seconds). [2025-09-18T20:09:06.119607] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-09-18T20:09:06.925525] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-09-18T20:09:06.945482] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-18T20:09:07.060214] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-18T20:09:07.719545] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-09-18T20:09:07.935878] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-18T20:09:08.173552] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-18T20:09:08.519578] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-09-18T20:09:09.164247] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T20:09:09.319583] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-09-18T20:09:10.119577] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-09-18T20:09:10.367539] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-18T20:09:10.870214] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-18T20:09:10.919500] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-09-18T20:09:11.116327] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-18T20:09:11.719548] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-09-18T20:09:12.519544] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-18T20:09:13.166218] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-18T20:09:13.319593] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-09-18T20:09:13.671252] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-18T20:09:14.119571] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-18T20:09:14.919688] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-09-18T20:09:15.031813] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-18T20:09:15.043947] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-18T20:09:15.052046] [INFO ] [REMOTE ] LYG: Full fetch complete (75912 records). [2025-09-18T20:09:15.052287] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-09-18T20:09:15.449586] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-09-18T20:09:15.449708] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-09-18T20:09:15.451095] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-09-18T20:09:15.451177] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-09-18T20:09:15.453080] [DEBUG] [LOCAL ] LYG: Trimmed 75912 records to 53313 (keeping 200 days of data) [2025-09-18T20:09:15.729858] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-09-18T20:09:15.771053] [DEBUG] [LOCAL ] LYG: Primary data saved (53313 records). [2025-09-18T20:09:15.771164] [INFO ] [MAIN ] LYG: Full history saved. [2025-09-18T20:09:15.773248] [INFO ] [MAIN ] Update Progress: 1294/2372 symbols completed. LYG took 38.0s. Estimated remaining: 2h 37m 37s. Rate: 6.8 symbols/min [2025-09-18T20:09:15.949623] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:09:15.965392] [DEBUG] [LOCAL ] LZM: Loaded 13420 existing records from primary storage. [2025-09-18T20:09:15.965549] [INFO ] [MAIN ] LZM: Loaded 13420 existing records. [2025-09-18T20:09:16.076593] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-18T20:09:16.128918] [INFO ] [REMOTE ] LYV: Full fetch complete (73581 records). [2025-09-18T20:09:16.164743] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-09-18T20:09:16.185889] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:09:16.198103] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-09-18T20:09:16.198370] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-18T20:09:16.242240] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-09-18T20:09:16.288736] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-09-18T20:09:16.445025] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T20:09:16.521503] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-09-18T20:09:16.999084] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-09-18T20:09:17.004135] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:09:17.004290] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-09-18T20:09:17.005501] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-09-18T20:09:17.005876] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-09-18T20:09:17.010379] [DEBUG] [LOCAL ] LYV: Trimmed 73581 records to 51684 (keeping 200 days of data) [2025-09-18T20:09:17.319519] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-11. [2025-09-18T20:09:17.341476] [DEBUG] [LOCAL ] LYV: Primary data saved (51684 records). [2025-09-18T20:09:17.341576] [INFO ] [MAIN ] LYV: Full history saved. [2025-09-18T20:09:17.341698] [INFO ] [MAIN ] Update Progress: 1295/2372 symbols completed. LYV took 29.1s. Estimated remaining: 2h 37m 23s. Rate: 6.8 symbols/min [2025-09-18T20:09:17.511924] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:09:17.578461] [DEBUG] [LOCAL ] M: Loaded 53536 existing records from primary storage. [2025-09-18T20:09:17.578728] [INFO ] [MAIN ] M: Loaded 53536 existing records. [2025-09-18T20:09:17.771962] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:09:17.772450] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-09-18T20:09:17.772534] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-09-18T20:09:17.774045] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-09-18T20:09:17.774121] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-09-18T20:09:17.909433] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-18T20:09:18.123065] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-18T20:09:18.123368] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-09-18T20:09:18.235759] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-18T20:09:18.241231] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:09:18.919550] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-18T20:09:19.719554] [INFO ] [REMOTE ] M: Fetching primary data for 2024-11. [2025-09-18T20:09:20.106022] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-18T20:09:20.234221] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-18T20:09:20.241557] [INFO ] [REMOTE ] LZB: Full fetch complete (49979 records). [2025-09-18T20:09:20.241812] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-09-18T20:09:20.524626] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-18T20:09:20.665611] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-09-18T20:09:20.665719] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-09-18T20:09:20.666626] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-09-18T20:09:20.666727] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-09-18T20:09:20.668520] [DEBUG] [LOCAL ] LZB: Trimmed 49979 records to 35776 (keeping 200 days of data) [2025-09-18T20:09:20.902192] [DEBUG] [LOCAL ] LZB: Primary data saved (35776 records). [2025-09-18T20:09:20.902342] [INFO ] [MAIN ] LZB: Full history saved. [2025-09-18T20:09:20.902472] [INFO ] [MAIN ] Update Progress: 1296/2372 symbols completed. LZB took 30.7s. Estimated remaining: 2h 37m 10s. Rate: 6.8 symbols/min [2025-09-18T20:09:21.073952] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:09:21.134459] [DEBUG] [LOCAL ] MA: Loaded 52595 existing records from primary storage. [2025-09-18T20:09:21.134611] [INFO ] [MAIN ] MA: Loaded 52595 existing records. [2025-09-18T20:09:21.372755] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-09-18T20:09:21.372960] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:09:21.374332] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-09-18T20:09:21.374385] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-09-18T20:09:21.375587] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-09-18T20:09:21.375680] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-09-18T20:09:21.742822] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:09:21.773800] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-18T20:09:22.075044] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-18T20:09:22.088620] [INFO ] [REMOTE ] LYB: Full fetch complete (77289 records). [2025-09-18T20:09:22.088827] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-09-18T20:09:22.124761] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-11. [2025-09-18T20:09:22.370308] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-18T20:09:22.549438] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-09-18T20:09:22.549543] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-09-18T20:09:22.550550] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-09-18T20:09:22.550619] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-09-18T20:09:22.557758] [DEBUG] [LOCAL ] LYB: Trimmed 77289 records to 53989 (keeping 200 days of data) [2025-09-18T20:09:22.911197] [DEBUG] [LOCAL ] LYB: Primary data saved (53989 records). [2025-09-18T20:09:22.911365] [INFO ] [MAIN ] LYB: Full history saved. [2025-09-18T20:09:22.911483] [INFO ] [MAIN ] Update Progress: 1297/2372 symbols completed. LYB took 46.7s. Estimated remaining: 2h 36m 55s. Rate: 6.9 symbols/min [2025-09-18T20:09:22.925308] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-09-18T20:09:23.102714] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:09:23.156519] [DEBUG] [LOCAL ] MAA: Loaded 43047 existing records from primary storage. [2025-09-18T20:09:23.156763] [INFO ] [MAIN ] MAA: Loaded 43047 existing records. [2025-09-18T20:09:23.347454] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:09:23.347763] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-09-18T20:09:23.347818] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-18T20:09:23.348976] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-09-18T20:09:23.349037] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-09-18T20:09:23.719847] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-09-18T20:09:23.719786] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:09:23.923392] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-18T20:09:24.481584] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-18T20:09:24.519583] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-09-18T20:09:24.825926] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-18T20:09:25.132550] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-18T20:09:25.319544] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-09-18T20:09:26.039855] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-18T20:09:26.119595] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-09-18T20:09:26.919604] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-09-18T20:09:27.247133] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-18T20:09:27.719564] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-09-18T20:09:28.519558] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-09-18T20:09:28.692090] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-18T20:09:29.172503] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-18T20:09:29.325055] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-11. [2025-09-18T20:09:29.344388] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-18T20:09:30.119515] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-09-18T20:09:30.719146] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T20:09:30.919597] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-09-18T20:09:31.719512] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-09-18T20:09:31.811487] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-18T20:09:32.425918] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-18T20:09:32.519531] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-09-18T20:09:32.619262] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-18T20:09:33.004491] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-18T20:09:33.319573] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-09-18T20:09:34.119589] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-09-18T20:09:34.626034] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T20:09:34.916824] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-18T20:09:34.919925] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-09-18T20:09:35.719556] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-09-18T20:09:36.481583] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-18T20:09:36.519502] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-09-18T20:09:37.297795] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-18T20:09:37.319503] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-09-18T20:09:37.580853] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-18T20:09:38.119557] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-09-18T20:09:38.919571] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-18T20:09:39.071481] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-18T20:09:39.719510] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-09-18T20:09:39.750990] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-18T20:09:39.754205] [INFO ] [REMOTE ] LZM: Full fetch complete (17542 records). [2025-09-18T20:09:39.754290] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-09-18T20:09:39.930067] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-18T20:09:40.185360] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-09-18T20:09:40.185517] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-09-18T20:09:40.187480] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-09-18T20:09:40.187549] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-09-18T20:09:40.188414] [DEBUG] [LOCAL ] LZM: Trimmed 17542 records to 13504 (keeping 200 days of data) [2025-09-18T20:09:40.275612] [DEBUG] [LOCAL ] LZM: Primary data saved (13504 records). [2025-09-18T20:09:40.275774] [INFO ] [MAIN ] LZM: Full history saved. [2025-09-18T20:09:40.275892] [INFO ] [MAIN ] Update Progress: 1298/2372 symbols completed. LZM took 24.5s. Estimated remaining: 2h 36m 54s. Rate: 6.8 symbols/min [2025-09-18T20:09:40.444603] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:09:40.512940] [DEBUG] [LOCAL ] MAC: Loaded 49752 existing records from primary storage. [2025-09-18T20:09:40.513108] [INFO ] [MAIN ] MAC: Loaded 49752 existing records. [2025-09-18T20:09:40.524673] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-09-18T20:09:40.699719] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:09:40.700088] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-09-18T20:09:40.700181] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-09-18T20:09:40.701732] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-09-18T20:09:40.701800] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-09-18T20:09:41.065142] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:09:41.210916] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-18T20:09:41.319545] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-09-18T20:09:42.119606] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-11. [2025-09-18T20:09:42.457202] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-18T20:09:42.919544] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-09-18T20:09:42.970330] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-18T20:09:43.533258] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-18T20:09:43.719552] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-09-18T20:09:44.519521] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-09-18T20:09:44.950450] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-18T20:09:45.250196] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-18T20:09:45.319499] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-09-18T20:09:46.119605] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-09-18T20:09:46.257485] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-18T20:09:46.898024] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T20:09:46.919504] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-09-18T20:09:47.719536] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-09-18T20:09:48.001591] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-18T20:09:48.189745] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-18T20:09:48.519555] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-09-18T20:09:49.301667] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T20:09:49.319504] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-09-18T20:09:50.119624] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-09-18T20:09:50.602868] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-18T20:09:50.919513] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-09-18T20:09:51.021367] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-18T20:09:51.405958] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-18T20:09:51.719545] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-09-18T20:09:52.519553] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-09-18T20:09:52.700436] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-18T20:09:53.227461] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T20:09:53.319503] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-09-18T20:09:54.119595] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-09-18T20:09:54.177053] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-18T20:09:54.745195] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T20:09:54.919548] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-09-18T20:09:55.719538] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-09-18T20:09:55.795051] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-18T20:09:55.802399] [INFO ] [REMOTE ] MA: Full fetch complete (76144 records). [2025-09-18T20:09:55.802563] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-09-18T20:09:56.220757] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-09-18T20:09:56.220861] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-09-18T20:09:56.222013] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-09-18T20:09:56.222102] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-09-18T20:09:56.223797] [DEBUG] [LOCAL ] MA: Trimmed 76144 records to 52979 (keeping 200 days of data) [2025-09-18T20:09:56.521097] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-09-18T20:09:56.564708] [DEBUG] [LOCAL ] MA: Primary data saved (52979 records). [2025-09-18T20:09:56.564835] [INFO ] [MAIN ] MA: Full history saved. [2025-09-18T20:09:56.564934] [INFO ] [MAIN ] Update Progress: 1299/2372 symbols completed. MA took 35.7s. Estimated remaining: 2h 36m 51s. Rate: 6.8 symbols/min [2025-09-18T20:09:56.781465] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:09:56.786816] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-18T20:09:56.830445] [DEBUG] [LOCAL ] MAGN: Loaded 35003 existing records from primary storage. [2025-09-18T20:09:56.830605] [INFO ] [MAIN ] MAGN: Loaded 35003 existing records. [2025-09-18T20:09:57.019200] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:09:57.019502] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-09-18T20:09:57.019564] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-09-18T20:09:57.020464] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-09-18T20:09:57.020526] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-09-18T20:09:57.319950] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-09-18T20:09:57.419264] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:09:57.452218] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-18T20:09:58.120007] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-09-18T20:09:58.122241] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-18T20:09:58.648950] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-18T20:09:58.919689] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-09-18T20:09:59.712337] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-18T20:09:59.722261] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-09-18T20:10:00.519618] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-09-18T20:10:00.750440] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-18T20:10:00.758117] [INFO ] [REMOTE ] M: Full fetch complete (77369 records). [2025-09-18T20:10:00.758290] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-09-18T20:10:01.160619] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-09-18T20:10:01.160764] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-09-18T20:10:01.161935] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-09-18T20:10:01.162025] [DEBUG] [LOCAL ] M: Saving primary data. [2025-09-18T20:10:01.163983] [DEBUG] [LOCAL ] M: Trimmed 77369 records to 53926 (keeping 200 days of data) [2025-09-18T20:10:01.324797] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-11. [2025-09-18T20:10:01.353174] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-18T20:10:01.633256] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-18T20:10:01.646838] [DEBUG] [LOCAL ] M: Primary data saved (53926 records). [2025-09-18T20:10:01.646973] [INFO ] [MAIN ] M: Full history saved. [2025-09-18T20:10:01.647054] [INFO ] [MAIN ] Update Progress: 1300/2372 symbols completed. M took 44.3s. Estimated remaining: 2h 36m 39s. Rate: 6.8 symbols/min [2025-09-18T20:10:01.818020] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:10:01.861030] [DEBUG] [LOCAL ] MAIN: Loaded 41395 existing records from primary storage. [2025-09-18T20:10:01.861187] [INFO ] [MAIN ] MAIN: Loaded 41395 existing records. [2025-09-18T20:10:02.043015] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:10:02.043526] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-09-18T20:10:02.043593] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-09-18T20:10:02.045421] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-09-18T20:10:02.045488] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-09-18T20:10:02.124858] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-09-18T20:10:02.466823] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:10:02.506863] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-18T20:10:02.919557] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-11. [2025-09-18T20:10:03.642522] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-18T20:10:03.719525] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-09-18T20:10:04.393420] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-18T20:10:04.519557] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-09-18T20:10:05.319571] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-09-18T20:10:05.473823] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-18T20:10:05.481903] [INFO ] [REMOTE ] MAC: Full fetch complete (71380 records). [2025-09-18T20:10:05.482050] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-09-18T20:10:05.922818] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-09-18T20:10:05.922984] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-09-18T20:10:05.924200] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-09-18T20:10:05.924286] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-09-18T20:10:05.949396] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-18T20:10:05.948575] [DEBUG] [LOCAL ] MAC: Trimmed 71380 records to 50122 (keeping 200 days of data) [2025-09-18T20:10:06.147715] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-09-18T20:10:06.292732] [DEBUG] [LOCAL ] MAC: Primary data saved (50122 records). [2025-09-18T20:10:06.292909] [INFO ] [MAIN ] MAC: Full history saved. [2025-09-18T20:10:06.293880] [INFO ] [MAIN ] Update Progress: 1301/2372 symbols completed. MAC took 26.0s. Estimated remaining: 2h 36m 27s. Rate: 6.8 symbols/min [2025-09-18T20:10:06.483994] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:10:06.529812] [DEBUG] [LOCAL ] MAN: Loaded 43676 existing records from primary storage. [2025-09-18T20:10:06.529976] [INFO ] [MAIN ] MAN: Loaded 43676 existing records. [2025-09-18T20:10:06.725353] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:10:06.725834] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-09-18T20:10:06.726003] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-09-18T20:10:06.727087] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-09-18T20:10:06.727151] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-09-18T20:10:06.917475] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-18T20:10:06.935672] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-09-18T20:10:07.169534] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:10:07.229588] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-18T20:10:07.719590] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-11. [2025-09-18T20:10:08.519581] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-09-18T20:10:09.309778] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-18T20:10:09.316215] [INFO ] [REMOTE ] MAA: Full fetch complete (61049 records). [2025-09-18T20:10:09.316438] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-09-18T20:10:09.350253] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-09-18T20:10:09.721543] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-09-18T20:10:09.721627] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-09-18T20:10:09.722492] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-09-18T20:10:09.722545] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-09-18T20:10:09.723837] [DEBUG] [LOCAL ] MAA: Trimmed 61049 records to 43351 (keeping 200 days of data) [2025-09-18T20:10:10.002145] [DEBUG] [LOCAL ] MAA: Primary data saved (43351 records). [2025-09-18T20:10:10.002316] [INFO ] [MAIN ] MAA: Full history saved. [2025-09-18T20:10:10.002437] [INFO ] [MAIN ] Update Progress: 1302/2372 symbols completed. MAA took 47.1s. Estimated remaining: 2h 36m 14s. Rate: 6.8 symbols/min [2025-09-18T20:10:10.177392] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:10:10.201594] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-11 (2.48 seconds). [2025-09-18T20:10:10.209391] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-09-18T20:10:10.232857] [DEBUG] [LOCAL ] MANU: Loaded 27155 existing records from primary storage. [2025-09-18T20:10:10.232998] [INFO ] [MAIN ] MANU: Loaded 27155 existing records. [2025-09-18T20:10:10.418142] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:10:10.418399] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-09-18T20:10:10.418449] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-09-18T20:10:10.419135] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-09-18T20:10:10.419194] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-09-18T20:10:10.827028] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-18T20:10:10.825626] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:10:10.919519] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-11. [2025-09-18T20:10:11.551278] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (3.03 seconds). [2025-09-18T20:10:11.642336] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-18T20:10:11.719523] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-09-18T20:10:11.960038] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-18T20:10:12.519598] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-09-18T20:10:13.123831] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T20:10:13.319561] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-09-18T20:10:13.686389] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T20:10:14.119599] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-09-18T20:10:14.360544] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-18T20:10:14.911089] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-18T20:10:14.919495] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-09-18T20:10:15.719551] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-09-18T20:10:15.852531] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-18T20:10:16.519559] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-09-18T20:10:17.071274] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-18T20:10:17.319572] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-09-18T20:10:17.809503] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-18T20:10:18.119558] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-09-18T20:10:18.449595] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-18T20:10:18.919559] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-09-18T20:10:19.541935] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-18T20:10:19.719543] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-09-18T20:10:20.355310] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-18T20:10:20.519568] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-09-18T20:10:21.319615] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-09-18T20:10:21.581611] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-18T20:10:21.847804] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-18T20:10:22.119545] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-09-18T20:10:22.919554] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-09-18T20:10:23.719564] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-09-18T20:10:23.852634] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-18T20:10:23.922279] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-18T20:10:24.056367] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-18T20:10:24.519587] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-09-18T20:10:24.637426] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-18T20:10:25.319556] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-09-18T20:10:26.105135] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-18T20:10:26.119498] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-09-18T20:10:26.594190] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-18T20:10:26.919561] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-09-18T20:10:27.593792] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-18T20:10:27.719534] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-09-18T20:10:27.795565] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-18T20:10:28.519566] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-09-18T20:10:29.319550] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-09-18T20:10:29.442271] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-18T20:10:29.536314] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-18T20:10:30.119556] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-09-18T20:10:30.526041] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-18T20:10:30.919582] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-09-18T20:10:31.315038] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-18T20:10:31.719540] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-09-18T20:10:32.271538] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-18T20:10:32.519573] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-09-18T20:10:33.145051] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-18T20:10:33.150120] [INFO ] [REMOTE ] MAGN: Full fetch complete (51215 records). [2025-09-18T20:10:33.150279] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-09-18T20:10:33.330574] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-09-18T20:10:33.577524] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-09-18T20:10:33.577610] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-09-18T20:10:33.578498] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-09-18T20:10:33.578563] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-09-18T20:10:33.579744] [DEBUG] [LOCAL ] MAGN: Trimmed 51215 records to 35283 (keeping 200 days of data) [2025-09-18T20:10:33.783463] [DEBUG] [LOCAL ] MAGN: Primary data saved (35283 records). [2025-09-18T20:10:33.783614] [INFO ] [MAIN ] MAGN: Full history saved. [2025-09-18T20:10:33.783767] [INFO ] [MAIN ] Update Progress: 1303/2372 symbols completed. MAGN took 37.2s. Estimated remaining: 2h 36m 18s. Rate: 6.8 symbols/min [2025-09-18T20:10:33.961396] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:10:33.990604] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T20:10:34.046029] [DEBUG] [LOCAL ] MAS: Loaded 52371 existing records from primary storage. [2025-09-18T20:10:34.046180] [INFO ] [MAIN ] MAS: Loaded 52371 existing records. [2025-09-18T20:10:34.125195] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-09-18T20:10:34.251872] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:10:34.252187] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-09-18T20:10:34.252254] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-09-18T20:10:34.253879] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-09-18T20:10:34.253956] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-09-18T20:10:34.670231] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:10:34.699815] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-18T20:10:34.919547] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-11. [2025-09-18T20:10:35.485242] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-18T20:10:35.491590] [INFO ] [REMOTE ] MAN: Full fetch complete (61503 records). [2025-09-18T20:10:35.491768] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-09-18T20:10:35.729265] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-09-18T20:10:35.881861] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-09-18T20:10:35.882064] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-09-18T20:10:35.883046] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-09-18T20:10:35.883111] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-09-18T20:10:35.884581] [DEBUG] [LOCAL ] MAN: Trimmed 61503 records to 44000 (keeping 200 days of data) [2025-09-18T20:10:36.156356] [DEBUG] [LOCAL ] MAN: Primary data saved (44000 records). [2025-09-18T20:10:36.156563] [INFO ] [MAIN ] MAN: Full history saved. [2025-09-18T20:10:36.157345] [INFO ] [MAIN ] Update Progress: 1304/2372 symbols completed. MAN took 29.9s. Estimated remaining: 2h 36m 4s. Rate: 6.8 symbols/min [2025-09-18T20:10:36.330416] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:10:36.372110] [DEBUG] [LOCAL ] MATV: Loaded 37940 existing records from primary storage. [2025-09-18T20:10:36.372275] [INFO ] [MAIN ] MATV: Loaded 37940 existing records. [2025-09-18T20:10:36.521703] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-09-18T20:10:36.601931] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:10:36.602465] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-09-18T20:10:36.601721] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-18T20:10:36.602839] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-09-18T20:10:36.619077] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-09-18T20:10:36.619168] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-09-18T20:10:37.006081] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:10:37.025241] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-18T20:10:37.319561] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-09-18T20:10:38.119573] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-11. [2025-09-18T20:10:38.317233] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-18T20:10:38.359276] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-18T20:10:38.919546] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-09-18T20:10:39.169725] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-18T20:10:39.719551] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-09-18T20:10:39.933486] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T20:10:39.940007] [INFO ] [REMOTE ] MANU: Full fetch complete (38038 records). [2025-09-18T20:10:39.940175] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-09-18T20:10:40.334955] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-09-18T20:10:40.335087] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-09-18T20:10:40.335791] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-09-18T20:10:40.335854] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-09-18T20:10:40.337134] [DEBUG] [LOCAL ] MANU: Trimmed 38038 records to 27429 (keeping 200 days of data) [2025-09-18T20:10:40.491931] [DEBUG] [LOCAL ] MANU: Primary data saved (27429 records). [2025-09-18T20:10:40.492065] [INFO ] [MAIN ] MANU: Full history saved. [2025-09-18T20:10:40.492150] [INFO ] [MAIN ] Update Progress: 1305/2372 symbols completed. MANU took 30.5s. Estimated remaining: 2h 35m 51s. Rate: 6.8 symbols/min [2025-09-18T20:10:40.524637] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-09-18T20:10:40.664139] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:10:40.697747] [DEBUG] [LOCAL ] MATX: Loaded 31582 existing records from primary storage. [2025-09-18T20:10:40.713783] [INFO ] [MAIN ] MATX: Loaded 31582 existing records. [2025-09-18T20:10:40.783877] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-18T20:10:40.904896] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:10:40.905139] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-09-18T20:10:40.905197] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-09-18T20:10:40.906131] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-09-18T20:10:40.906222] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-09-18T20:10:41.259176] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:10:41.319489] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-11. [2025-09-18T20:10:42.119581] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-09-18T20:10:42.463902] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-18T20:10:42.469855] [INFO ] [REMOTE ] MAIN: Full fetch complete (59441 records). [2025-09-18T20:10:42.469973] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-09-18T20:10:42.904928] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-09-18T20:10:42.906250] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-18T20:10:42.905625] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-09-18T20:10:42.912772] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-09-18T20:10:42.912871] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-09-18T20:10:42.914313] [DEBUG] [LOCAL ] MAIN: Trimmed 59441 records to 41760 (keeping 200 days of data) [2025-09-18T20:10:42.967555] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-09-18T20:10:43.181368] [DEBUG] [LOCAL ] MAIN: Primary data saved (41760 records). [2025-09-18T20:10:43.181508] [INFO ] [MAIN ] MAIN: Full history saved. [2025-09-18T20:10:43.181595] [INFO ] [MAIN ] Update Progress: 1306/2372 symbols completed. MAIN took 41.5s. Estimated remaining: 2h 35m 38s. Rate: 6.8 symbols/min [2025-09-18T20:10:43.363146] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:10:43.395626] [DEBUG] [LOCAL ] MAX: Loaded 31090 existing records from primary storage. [2025-09-18T20:10:43.395821] [INFO ] [MAIN ] MAX: Loaded 31090 existing records. [2025-09-18T20:10:43.600200] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:10:43.600824] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-09-18T20:10:43.600979] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-09-18T20:10:43.601983] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-09-18T20:10:43.602047] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-09-18T20:10:43.721450] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-09-18T20:10:43.968552] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-18T20:10:44.017337] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:10:44.036424] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-18T20:10:44.466261] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-18T20:10:44.519551] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-09-18T20:10:45.319526] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-11. [2025-09-18T20:10:45.724293] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T20:10:46.119544] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-09-18T20:10:46.472116] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-18T20:10:46.919513] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-09-18T20:10:47.001294] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-18T20:10:47.719541] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-09-18T20:10:48.354275] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T20:10:48.519542] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-09-18T20:10:48.954469] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T20:10:49.319553] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-09-18T20:10:50.049472] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-18T20:10:50.119534] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-09-18T20:10:50.725136] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-18T20:10:50.919550] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-09-18T20:10:51.726367] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-09-18T20:10:51.755327] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T20:10:52.202551] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-18T20:10:52.519562] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-09-18T20:10:53.040496] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-18T20:10:53.319562] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-09-18T20:10:54.119558] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-09-18T20:10:54.332685] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-18T20:10:54.489235] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-18T20:10:54.919598] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-09-18T20:10:55.014043] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-18T20:10:55.719580] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-09-18T20:10:56.519551] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-09-18T20:10:56.580309] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-18T20:10:56.818753] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-18T20:10:57.319589] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-09-18T20:10:57.793960] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-18T20:10:58.119565] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-09-18T20:10:58.741250] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-18T20:10:58.919555] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-09-18T20:10:59.655813] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T20:10:59.719514] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-09-18T20:10:59.811994] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T20:11:00.519562] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-09-18T20:11:01.319580] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-09-18T20:11:01.377078] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-18T20:11:01.950682] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T20:11:02.119561] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-09-18T20:11:02.509106] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-18T20:11:02.919545] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-09-18T20:11:03.289380] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-18T20:11:03.719555] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-09-18T20:11:04.174315] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-18T20:11:04.519559] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-09-18T20:11:04.811930] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-18T20:11:05.319639] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-09-18T20:11:05.721960] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-18T20:11:06.119523] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-09-18T20:11:06.505605] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-18T20:11:06.919606] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-09-18T20:11:07.724633] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-09-18T20:11:07.754146] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-18T20:11:07.837578] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-18T20:11:08.519595] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-09-18T20:11:08.927217] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-18T20:11:09.319546] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-09-18T20:11:10.119600] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-09-18T20:11:10.168144] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-18T20:11:10.178202] [INFO ] [REMOTE ] MAS: Full fetch complete (74536 records). [2025-09-18T20:11:10.178383] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-09-18T20:11:10.601779] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-09-18T20:11:10.601866] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-09-18T20:11:10.602846] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-09-18T20:11:10.602929] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-09-18T20:11:10.604481] [DEBUG] [LOCAL ] MAS: Trimmed 74536 records to 52753 (keeping 200 days of data) [2025-09-18T20:11:10.928474] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-09-18T20:11:10.957806] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-18T20:11:10.965230] [INFO ] [REMOTE ] MAX: Full fetch complete (45625 records). [2025-09-18T20:11:10.965935] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-09-18T20:11:11.096155] [DEBUG] [LOCAL ] MAS: Primary data saved (52753 records). [2025-09-18T20:11:11.106542] [INFO ] [MAIN ] MAS: Full history saved. [2025-09-18T20:11:11.119909] [INFO ] [MAIN ] Update Progress: 1307/2372 symbols completed. MAS took 37.3s. Estimated remaining: 2h 35m 44s. Rate: 6.8 symbols/min [2025-09-18T20:11:11.500432] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:11:11.542295] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-09-18T20:11:11.542691] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-09-18T20:11:11.543504] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-09-18T20:11:11.543808] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-09-18T20:11:11.546344] [DEBUG] [LOCAL ] MAX: Trimmed 45625 records to 31388 (keeping 200 days of data) [2025-09-18T20:11:11.657118] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-18T20:11:11.720856] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-09-18T20:11:11.728054] [DEBUG] [LOCAL ] MBC: Loaded 43058 existing records from primary storage. [2025-09-18T20:11:11.728220] [INFO ] [MAIN ] MBC: Loaded 43058 existing records. [2025-09-18T20:11:11.982315] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:11:11.985810] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-09-18T20:11:11.987025] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-09-18T20:11:11.990602] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-09-18T20:11:11.991564] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-09-18T20:11:12.050142] [DEBUG] [LOCAL ] MAX: Primary data saved (31388 records). [2025-09-18T20:11:12.064261] [INFO ] [MAIN ] MAX: Full history saved. [2025-09-18T20:11:12.071494] [INFO ] [MAIN ] Update Progress: 1308/2372 symbols completed. MAX took 28.9s. Estimated remaining: 2h 35m 29s. Rate: 6.8 symbols/min [2025-09-18T20:11:12.433494] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:11:12.549997] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:11:12.556703] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-11. [2025-09-18T20:11:12.578453] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-18T20:11:12.596756] [DEBUG] [LOCAL ] MBI: Loaded 25048 existing records from primary storage. [2025-09-18T20:11:12.596894] [INFO ] [MAIN ] MBI: Loaded 25048 existing records. [2025-09-18T20:11:12.775255] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:11:12.775548] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-09-18T20:11:12.775622] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-09-18T20:11:12.776424] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-09-18T20:11:12.776486] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-09-18T20:11:13.139522] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:11:13.238503] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T20:11:13.246996] [INFO ] [REMOTE ] MATV: Full fetch complete (52262 records). [2025-09-18T20:11:13.247105] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-09-18T20:11:13.326922] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-09-18T20:11:13.641703] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-09-18T20:11:13.641791] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-09-18T20:11:13.642620] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-09-18T20:11:13.642697] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-09-18T20:11:13.643964] [DEBUG] [LOCAL ] MATV: Trimmed 52262 records to 38185 (keeping 200 days of data) [2025-09-18T20:11:13.793380] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-18T20:11:13.929311] [DEBUG] [LOCAL ] MATV: Primary data saved (38185 records). [2025-09-18T20:11:13.929452] [INFO ] [MAIN ] MATV: Full history saved. [2025-09-18T20:11:13.931523] [INFO ] [MAIN ] Update Progress: 1309/2372 symbols completed. MATV took 37.8s. Estimated remaining: 2h 35m 15s. Rate: 6.8 symbols/min [2025-09-18T20:11:14.111755] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:11:14.119721] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-09-18T20:11:14.170917] [DEBUG] [LOCAL ] MC: Loaded 44467 existing records from primary storage. [2025-09-18T20:11:14.171063] [INFO ] [MAIN ] MC: Loaded 44467 existing records. [2025-09-18T20:11:14.353316] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:11:14.353736] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-09-18T20:11:14.354205] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-09-18T20:11:14.355329] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-09-18T20:11:14.355530] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-09-18T20:11:14.531266] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-18T20:11:14.759278] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:11:14.919560] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-09-18T20:11:15.353252] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T20:11:15.719582] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-11. [2025-09-18T20:11:16.092609] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-18T20:11:16.098902] [INFO ] [REMOTE ] MATX: Full fetch complete (42361 records). [2025-09-18T20:11:16.099043] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-09-18T20:11:16.493289] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-09-18T20:11:16.493382] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-09-18T20:11:16.494243] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-09-18T20:11:16.494311] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-09-18T20:11:16.495618] [DEBUG] [LOCAL ] MATX: Trimmed 42361 records to 31817 (keeping 200 days of data) [2025-09-18T20:11:16.564871] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-09-18T20:11:16.731348] [DEBUG] [LOCAL ] MATX: Primary data saved (31817 records). [2025-09-18T20:11:16.731513] [INFO ] [MAIN ] MATX: Full history saved. [2025-09-18T20:11:16.731667] [INFO ] [MAIN ] Update Progress: 1310/2372 symbols completed. MATX took 36.2s. Estimated remaining: 2h 35m 1s. Rate: 6.9 symbols/min [2025-09-18T20:11:16.906903] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:11:16.923213] [DEBUG] [LOCAL ] MCB: Loaded 11743 existing records from primary storage. [2025-09-18T20:11:16.923355] [INFO ] [MAIN ] MCB: Loaded 11743 existing records. [2025-09-18T20:11:17.103484] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-18T20:11:17.192621] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:11:17.192894] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-09-18T20:11:17.192947] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-09-18T20:11:17.193411] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-09-18T20:11:17.193480] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-09-18T20:11:17.324746] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-09-18T20:11:17.559880] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:11:18.119570] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-11. [2025-09-18T20:11:18.206137] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-18T20:11:18.657378] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T20:11:18.919577] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-09-18T20:11:19.210249] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T20:11:19.719556] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-09-18T20:11:20.102505] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-18T20:11:20.519586] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-09-18T20:11:20.853430] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-18T20:11:21.319609] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-09-18T20:11:21.995007] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-18T20:11:22.119506] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-09-18T20:11:22.554402] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T20:11:22.919557] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-11. [2025-09-18T20:11:23.275942] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-18T20:11:23.427472] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-18T20:11:23.719560] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-09-18T20:11:24.332963] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-18T20:11:24.519573] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-09-18T20:11:25.319559] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-09-18T20:11:25.514742] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-18T20:11:26.119558] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-09-18T20:11:26.622968] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-18T20:11:26.832619] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-18T20:11:26.919539] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-09-18T20:11:27.719573] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-09-18T20:11:28.289508] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-18T20:11:28.524729] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-09-18T20:11:28.528391] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-18T20:11:29.319520] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-09-18T20:11:29.433175] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-18T20:11:30.110974] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-18T20:11:30.119485] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-09-18T20:11:30.919534] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-09-18T20:11:31.217123] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-18T20:11:31.719602] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-09-18T20:11:32.454993] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-18T20:11:32.506490] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-18T20:11:32.519483] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-09-18T20:11:33.319560] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-09-18T20:11:33.993639] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-18T20:11:34.119585] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-09-18T20:11:34.462401] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-18T20:11:34.919589] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-09-18T20:11:35.352921] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-18T20:11:35.719687] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-09-18T20:11:36.125849] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T20:11:36.519613] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-09-18T20:11:36.648320] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-18T20:11:37.319569] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-09-18T20:11:38.119558] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-09-18T20:11:38.894851] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-18T20:11:38.919527] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-09-18T20:11:39.719601] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-09-18T20:11:39.921881] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-18T20:11:40.467876] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-18T20:11:40.519525] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-09-18T20:11:40.561064] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-18T20:11:41.101046] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-18T20:11:41.121526] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-18T20:11:41.319544] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-09-18T20:11:42.119542] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-09-18T20:11:42.808180] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T20:11:42.814014] [INFO ] [REMOTE ] MC: Full fetch complete (61945 records). [2025-09-18T20:11:42.814159] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-09-18T20:11:42.924767] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-09-18T20:11:43.215837] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-09-18T20:11:43.215937] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-09-18T20:11:43.216826] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-09-18T20:11:43.216923] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-09-18T20:11:43.218339] [DEBUG] [LOCAL ] MC: Trimmed 61945 records to 44790 (keeping 200 days of data) [2025-09-18T20:11:43.359497] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-18T20:11:43.542538] [DEBUG] [LOCAL ] MC: Primary data saved (44790 records). [2025-09-18T20:11:43.542729] [INFO ] [MAIN ] MC: Full history saved. [2025-09-18T20:11:43.543603] [INFO ] [MAIN ] Update Progress: 1311/2372 symbols completed. MC took 29.6s. Estimated remaining: 2h 35m 7s. Rate: 6.8 symbols/min [2025-09-18T20:11:43.724213] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:11:43.720041] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-09-18T20:11:43.740618] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-18T20:11:43.799937] [DEBUG] [LOCAL ] MCD: Loaded 53467 existing records from primary storage. [2025-09-18T20:11:43.800095] [INFO ] [MAIN ] MCD: Loaded 53467 existing records. [2025-09-18T20:11:43.987091] [WARN ] [MAIN ] MCD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:11:43.987433] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-18T20:11:43.987485] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-18T20:11:43.988930] [DEBUG] [LOCAL ] MCD: Deleted primary data file. [2025-09-18T20:11:43.988995] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-18T20:11:44.367282] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:11:44.373482] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-18T20:11:44.519535] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-11. [2025-09-18T20:11:45.319562] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-09-18T20:11:46.119560] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-09-18T20:11:46.272414] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-18T20:11:46.275968] [INFO ] [REMOTE ] MCB: Full fetch complete (16321 records). [2025-09-18T20:11:46.276086] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-09-18T20:11:46.739909] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-09-18T20:11:46.740160] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-09-18T20:11:46.740855] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-09-18T20:11:46.741333] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-09-18T20:11:46.778723] [DEBUG] [LOCAL ] MCB: Trimmed 16321 records to 11902 (keeping 200 days of data) [2025-09-18T20:11:46.840691] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-11 (2.32 seconds). [2025-09-18T20:11:46.921577] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-09-18T20:11:46.929124] [DEBUG] [LOCAL ] MCB: Primary data saved (11902 records). [2025-09-18T20:11:46.929334] [INFO ] [MAIN ] MCB: Full history saved. [2025-09-18T20:11:46.930853] [INFO ] [MAIN ] Update Progress: 1312/2372 symbols completed. MCB took 30.2s. Estimated remaining: 2h 34m 54s. Rate: 6.8 symbols/min [2025-09-18T20:11:47.225387] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:11:47.236542] [DEBUG] [LOCAL ] MCI: Loaded 6336 existing records from primary storage. [2025-09-18T20:11:47.236758] [INFO ] [MAIN ] MCI: Loaded 6336 existing records. [2025-09-18T20:11:47.479851] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:11:47.480178] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-09-18T20:11:47.480254] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-09-18T20:11:47.480680] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-09-18T20:11:47.480782] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-09-18T20:11:47.725149] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-09-18T20:11:47.910274] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:11:47.952739] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-18T20:11:48.519552] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-09-18T20:11:49.023512] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-18T20:11:49.319547] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-09-18T20:11:50.119626] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-11. [2025-09-18T20:11:50.368243] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (3.45 seconds). [2025-09-18T20:11:50.919555] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-09-18T20:11:50.941069] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-18T20:11:51.055978] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-09-18T20:11:51.065260] [INFO ] [REMOTE ] MBC: Full fetch complete (62186 records). [2025-09-18T20:11:51.065421] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-09-18T20:11:51.484803] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-09-18T20:11:51.484964] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-09-18T20:11:51.485955] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-09-18T20:11:51.492480] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-09-18T20:11:51.505239] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-18T20:11:51.513042] [DEBUG] [LOCAL ] MBC: Trimmed 62186 records to 43429 (keeping 200 days of data) [2025-09-18T20:11:51.725213] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-09-18T20:11:51.783118] [DEBUG] [LOCAL ] MBC: Primary data saved (43429 records). [2025-09-18T20:11:51.783272] [INFO ] [MAIN ] MBC: Full history saved. [2025-09-18T20:11:51.783381] [INFO ] [MAIN ] Update Progress: 1313/2372 symbols completed. MBC took 40.7s. Estimated remaining: 2h 34m 42s. Rate: 6.8 symbols/min [2025-09-18T20:11:51.964998] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:11:52.008977] [DEBUG] [LOCAL ] MCK: Loaded 39599 existing records from primary storage. [2025-09-18T20:11:52.009127] [INFO ] [MAIN ] MCK: Loaded 39599 existing records. [2025-09-18T20:11:52.202424] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-18T20:11:52.208910] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:11:52.211897] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-09-18T20:11:52.211957] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-09-18T20:11:52.213075] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-09-18T20:11:52.213136] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-09-18T20:11:52.520571] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-09-18T20:11:52.591346] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:11:52.703043] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-18T20:11:53.319558] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-18T20:11:53.551854] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-18T20:11:53.556154] [INFO ] [REMOTE ] MBI: Full fetch complete (36854 records). [2025-09-18T20:11:53.556323] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-09-18T20:11:53.942127] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-09-18T20:11:53.942217] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-09-18T20:11:53.942925] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-09-18T20:11:53.942990] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-09-18T20:11:53.945356] [DEBUG] [LOCAL ] MBI: Trimmed 36854 records to 25241 (keeping 200 days of data) [2025-09-18T20:11:54.095032] [DEBUG] [LOCAL ] MBI: Primary data saved (25241 records). [2025-09-18T20:11:54.095182] [INFO ] [MAIN ] MBI: Full history saved. [2025-09-18T20:11:54.095273] [INFO ] [MAIN ] Update Progress: 1314/2372 symbols completed. MBI took 42.0s. Estimated remaining: 2h 34m 28s. Rate: 6.8 symbols/min [2025-09-18T20:11:54.125799] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-11. [2025-09-18T20:11:54.274344] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:11:54.285107] [DEBUG] [LOCAL ] MCN: Loaded 8222 existing records from primary storage. [2025-09-18T20:11:54.285238] [INFO ] [MAIN ] MCN: Loaded 8222 existing records. [2025-09-18T20:11:54.482891] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:11:54.483197] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-09-18T20:11:54.483248] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-09-18T20:11:54.483752] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-09-18T20:11:54.483820] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-09-18T20:11:54.887039] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:11:54.919498] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-11. [2025-09-18T20:11:55.154338] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-18T20:11:55.326952] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-18T20:11:55.474904] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-18T20:11:55.719554] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-09-18T20:11:56.383020] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-18T20:11:56.519605] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-09-18T20:11:57.319599] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-18T20:11:57.875114] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T20:11:58.119567] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-09-18T20:11:58.681574] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-18T20:11:58.919556] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-09-18T20:11:59.640798] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-18T20:11:59.653239] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-18T20:11:59.719592] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-18T20:12:00.519577] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-09-18T20:12:01.319575] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-09-18T20:12:01.951372] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-18T20:12:01.994078] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-18T20:12:02.066937] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T20:12:02.119528] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-09-18T20:12:02.919594] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-09-18T20:12:03.488256] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-18T20:12:03.566376] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T20:12:03.719557] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-09-18T20:12:04.389344] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-18T20:12:04.519568] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-09-18T20:12:05.319568] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-09-18T20:12:05.996486] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T20:12:06.012890] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-18T20:12:06.119545] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-09-18T20:12:06.919561] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-18T20:12:07.702007] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T20:12:07.719497] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-09-18T20:12:08.519560] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-09-18T20:12:08.660428] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-18T20:12:08.994818] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-18T20:12:09.052243] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T20:12:09.319563] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-09-18T20:12:10.119547] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-09-18T20:12:10.722603] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-18T20:12:10.749428] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T20:12:10.919538] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-09-18T20:12:11.719597] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-09-18T20:12:12.205164] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-18T20:12:12.390091] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-18T20:12:12.519567] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-09-18T20:12:13.319577] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-18T20:12:14.119524] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-09-18T20:12:14.197514] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-18T20:12:14.684873] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-18T20:12:14.919571] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-09-18T20:12:15.288086] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-18T20:12:15.719571] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-09-18T20:12:16.266391] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-18T20:12:16.271632] [INFO ] [REMOTE ] MCK: Full fetch complete (57436 records). [2025-09-18T20:12:16.271790] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-09-18T20:12:16.524372] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-09-18T20:12:16.598609] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-18T20:12:16.697948] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-09-18T20:12:16.698044] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-09-18T20:12:16.699123] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-09-18T20:12:16.699233] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-09-18T20:12:16.700630] [DEBUG] [LOCAL ] MCK: Trimmed 57436 records to 39841 (keeping 200 days of data) [2025-09-18T20:12:16.957708] [DEBUG] [LOCAL ] MCK: Primary data saved (39841 records). [2025-09-18T20:12:16.957873] [INFO ] [MAIN ] MCK: Full history saved. [2025-09-18T20:12:16.957970] [INFO ] [MAIN ] Update Progress: 1315/2372 symbols completed. MCK took 25.2s. Estimated remaining: 2h 34m 31s. Rate: 6.8 symbols/min [2025-09-18T20:12:17.131971] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:12:17.170895] [DEBUG] [LOCAL ] MCO: Loaded 39609 existing records from primary storage. [2025-09-18T20:12:17.171045] [INFO ] [MAIN ] MCO: Loaded 39609 existing records. [2025-09-18T20:12:17.329850] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-18T20:12:17.368894] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:12:17.369266] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-09-18T20:12:17.369455] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-09-18T20:12:17.374398] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-09-18T20:12:17.376612] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-09-18T20:12:17.376950] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-18T20:12:17.759244] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:12:18.119576] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-09-18T20:12:18.712180] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-18T20:12:18.919558] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-09-18T20:12:19.478908] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-18T20:12:19.665615] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-18T20:12:19.719554] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-18T20:12:20.519609] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-09-18T20:12:21.020835] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-18T20:12:21.319586] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-11. [2025-09-18T20:12:21.529269] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-18T20:12:22.119568] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-18T20:12:22.541224] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-18T20:12:22.919595] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-09-18T20:12:23.473406] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-18T20:12:23.719538] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-09-18T20:12:24.161968] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-18T20:12:24.169457] [INFO ] [REMOTE ] MCD: Full fetch complete (77315 records). [2025-09-18T20:12:24.169607] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-18T20:12:24.286801] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-18T20:12:24.305178] [INFO ] [REMOTE ] MCI: Full fetch complete (9752 records). [2025-09-18T20:12:24.320882] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-09-18T20:12:24.527133] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-09-18T20:12:24.967893] [DEBUG] [VALIDATOR ] MCD: All expected trading days are present. [2025-09-18T20:12:24.976267] [DEBUG] [VALIDATOR ] MCD: Primary data validation passed. [2025-09-18T20:12:24.993815] [INFO ] [MAIN ] MCD: Fetched primary data is valid. [2025-09-18T20:12:25.002694] [DEBUG] [LOCAL ] MCD: Saving primary data. [2025-09-18T20:12:25.002615] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-09-18T20:12:25.002925] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-09-18T20:12:25.003080] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-09-18T20:12:25.003211] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-09-18T20:12:25.004333] [DEBUG] [LOCAL ] MCI: Trimmed 9752 records to 6363 (keeping 200 days of data) [2025-09-18T20:12:25.005598] [DEBUG] [LOCAL ] MCD: Trimmed 77315 records to 53857 (keeping 200 days of data) [2025-09-18T20:12:25.186539] [DEBUG] [LOCAL ] MCI: Primary data saved (6363 records). [2025-09-18T20:12:25.189485] [INFO ] [MAIN ] MCI: Full history saved. [2025-09-18T20:12:25.189620] [INFO ] [MAIN ] Update Progress: 1316/2372 symbols completed. MCI took 38.3s. Estimated remaining: 2h 34m 21s. Rate: 6.8 symbols/min [2025-09-18T20:12:25.327467] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-09-18T20:12:25.484002] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:12:25.506310] [DEBUG] [LOCAL ] MCR: Loaded 8977 existing records from primary storage. [2025-09-18T20:12:25.506957] [INFO ] [MAIN ] MCR: Loaded 8977 existing records. [2025-09-18T20:12:25.777020] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:12:25.778633] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-09-18T20:12:25.778963] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-09-18T20:12:25.780285] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-09-18T20:12:25.780632] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-09-18T20:12:26.038035] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-18T20:12:26.078325] [INFO ] [REMOTE ] MCN: Full fetch complete (11480 records). [2025-09-18T20:12:26.095247] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-09-18T20:12:26.216035] [DEBUG] [LOCAL ] MCD: Primary data saved (53857 records). [2025-09-18T20:12:26.305253] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:12:26.316969] [INFO ] [MAIN ] MCD: Full history saved. [2025-09-18T20:12:26.317740] [INFO ] [MAIN ] Update Progress: 1317/2372 symbols completed. MCD took 42.8s. Estimated remaining: 2h 34m 7s. Rate: 6.8 symbols/min [2025-09-18T20:12:26.321796] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-11. [2025-09-18T20:12:26.530156] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-18T20:12:26.629989] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-09-18T20:12:26.630075] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-09-18T20:12:26.630416] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-09-18T20:12:26.630459] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-09-18T20:12:26.630976] [DEBUG] [LOCAL ] MCN: Trimmed 11480 records to 8248 (keeping 200 days of data) [2025-09-18T20:12:26.681576] [DEBUG] [LOCAL ] MCN: Primary data saved (8248 records). [2025-09-18T20:12:26.681754] [INFO ] [MAIN ] MCN: Full history saved. [2025-09-18T20:12:26.681854] [INFO ] [MAIN ] Update Progress: 1318/2372 symbols completed. MCN took 32.6s. Estimated remaining: 2h 33m 51s. Rate: 6.9 symbols/min [2025-09-18T20:12:26.919582] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-09-18T20:12:27.061205] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-18T20:12:27.719563] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-09-18T20:12:28.107925] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-18T20:12:28.519602] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-09-18T20:12:28.590895] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-18T20:12:29.319559] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-09-18T20:12:29.900776] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T20:12:30.119552] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-09-18T20:12:30.291995] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-18T20:12:30.919598] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-09-18T20:12:31.510636] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-18T20:12:31.719553] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-09-18T20:12:31.759231] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T20:12:32.519558] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-09-18T20:12:32.575794] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-18T20:12:33.319579] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-09-18T20:12:34.234966] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-18T20:12:34.237963] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-09-18T20:12:34.268609] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-18T20:12:34.919587] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-09-18T20:12:35.022062] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-18T20:12:35.719552] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-09-18T20:12:36.218765] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-18T20:12:36.354489] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-18T20:12:36.519733] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-09-18T20:12:37.319612] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-09-18T20:12:37.677081] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-18T20:12:37.887213] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-18T20:12:38.119581] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-09-18T20:12:38.922910] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-09-18T20:12:38.926284] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-18T20:12:39.719568] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-09-18T20:12:40.248505] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-18T20:12:40.332859] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-18T20:12:40.338495] [INFO ] [REMOTE ] MCR: Full fetch complete (14232 records). [2025-09-18T20:12:40.338708] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-09-18T20:12:40.524695] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-09-18T20:12:40.719573] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-09-18T20:12:40.719682] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-09-18T20:12:40.720020] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-09-18T20:12:40.720062] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-09-18T20:12:40.720616] [DEBUG] [LOCAL ] MCR: Trimmed 14232 records to 9016 (keeping 200 days of data) [2025-09-18T20:12:40.774547] [DEBUG] [LOCAL ] MCR: Primary data saved (9016 records). [2025-09-18T20:12:40.774716] [INFO ] [MAIN ] MCR: Full history saved. [2025-09-18T20:12:40.774855] [INFO ] [MAIN ] Update Progress: 1319/2372 symbols completed. MCR took 15.6s. Estimated remaining: 2h 33m 47s. Rate: 6.8 symbols/min [2025-09-18T20:12:42.167284] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T20:12:42.175320] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-09-18T20:12:43.787173] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-18T20:12:43.792871] [INFO ] [REMOTE ] MCO: Full fetch complete (56177 records). [2025-09-18T20:12:43.792994] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-09-18T20:12:44.191185] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-09-18T20:12:44.191316] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-09-18T20:12:44.192207] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-09-18T20:12:44.192273] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-09-18T20:12:44.193669] [DEBUG] [LOCAL ] MCO: Trimmed 56177 records to 39958 (keeping 200 days of data) [2025-09-18T20:12:44.442406] [DEBUG] [LOCAL ] MCO: Primary data saved (39958 records). [2025-09-18T20:12:44.442560] [INFO ] [MAIN ] MCO: Full history saved. [2025-09-18T20:12:44.442670] [INFO ] [MAIN ] Update Progress: 1320/2372 symbols completed. MCO took 27.5s. Estimated remaining: 2h 33m 34s. Rate: 6.9 symbols/min [2025-09-18T20:12:45.009677] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:12:45.174715] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:12:45.140713] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:12:45.179151] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:12:45.190551] [DEBUG] [LOCAL ] MDST: Loaded 5430 existing records from primary storage. [2025-09-18T20:12:45.190715] [INFO ] [MAIN ] MDST: Loaded 5430 existing records. [2025-09-18T20:12:45.330501] [DEBUG] [LOCAL ] MCS: Loaded 21471 existing records from primary storage. [2025-09-18T20:12:45.341074] [INFO ] [MAIN ] MCS: Loaded 21471 existing records. [2025-09-18T20:12:45.469890] [DEBUG] [LOCAL ] MCY: Loaded 25667 existing records from primary storage. [2025-09-18T20:12:45.537311] [INFO ] [MAIN ] MCY: Loaded 25667 existing records. [2025-09-18T20:12:45.511134] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:12:45.590172] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-09-18T20:12:45.610802] [DEBUG] [LOCAL ] MD: Loaded 38815 existing records from primary storage. [2025-09-18T20:12:45.667335] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-09-18T20:12:45.677977] [INFO ] [MAIN ] MD: Loaded 38815 existing records. [2025-09-18T20:12:45.722498] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-09-18T20:12:45.770059] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-09-18T20:12:45.754344] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:12:46.009167] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-09-18T20:12:46.014599] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:12:46.027123] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-09-18T20:12:46.047861] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-09-18T20:12:46.053899] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-09-18T20:12:46.054087] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-09-18T20:12:46.064601] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-09-18T20:12:46.090530] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-09-18T20:12:46.120465] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-09-18T20:12:46.336336] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:12:46.421732] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-09-18T20:12:46.506032] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-09-18T20:12:46.557293] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-09-18T20:12:46.598059] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-09-18T20:12:46.944119] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:12:46.981940] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-11. [2025-09-18T20:12:47.155516] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:12:47.236621] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-11. [2025-09-18T20:12:47.328109] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:12:47.352217] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-11. [2025-09-18T20:12:47.535268] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:12:47.535681] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-11. [2025-09-18T20:12:47.767036] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-18T20:12:47.768967] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-09-18T20:12:48.292325] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-18T20:12:48.298208] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-09-18T20:12:48.306454] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-18T20:12:48.308836] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-09-18T20:12:48.369245] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-18T20:12:48.375371] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-09-18T20:12:48.860064] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-18T20:12:48.862147] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-09-18T20:12:48.898609] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-18T20:12:49.163441] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-18T20:12:49.322573] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-09-18T20:12:49.325987] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-18T20:12:49.341622] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-18T20:12:50.119541] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-09-18T20:12:50.464947] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-18T20:12:50.919544] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-09-18T20:12:51.430231] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T20:12:51.459185] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-18T20:12:51.719550] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-09-18T20:12:52.519579] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-09-18T20:12:53.100739] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T20:12:53.319577] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-09-18T20:12:53.961528] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-18T20:12:54.119588] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-09-18T20:12:54.690416] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-18T20:12:54.919530] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-09-18T20:12:55.001604] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-18T20:12:55.719570] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-09-18T20:12:56.298916] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T20:12:56.299852] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-18T20:12:56.519600] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-09-18T20:12:57.319526] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-09-18T20:12:57.470335] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-18T20:12:58.119624] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-09-18T20:12:58.424533] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-18T20:12:58.919601] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-09-18T20:12:59.619306] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-18T20:12:59.719515] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-09-18T20:12:59.990429] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-18T20:13:00.519558] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-09-18T20:13:00.810630] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-18T20:13:01.319566] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-09-18T20:13:01.905005] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-18T20:13:02.053871] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-18T20:13:02.119521] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-09-18T20:13:02.919556] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-09-18T20:13:03.273138] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-18T20:13:03.373382] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-18T20:13:03.719550] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-09-18T20:13:04.519618] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-09-18T20:13:04.787757] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-18T20:13:05.319554] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-09-18T20:13:05.946426] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-18T20:13:05.974232] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T20:13:06.119559] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-09-18T20:13:06.919555] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-09-18T20:13:07.634272] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-18T20:13:07.658463] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T20:13:07.719541] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-09-18T20:13:08.519567] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-09-18T20:13:08.942047] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-18T20:13:08.970216] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T20:13:09.319583] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-09-18T20:13:10.119597] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-09-18T20:13:10.919515] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-09-18T20:13:11.089850] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-18T20:13:11.248573] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T20:13:11.456497] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-18T20:13:11.458158] [INFO ] [REMOTE ] MDST: Full fetch complete (8326 records). [2025-09-18T20:13:11.458229] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-09-18T20:13:11.724702] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-09-18T20:13:11.821019] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-09-18T20:13:11.821105] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-09-18T20:13:11.821314] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-09-18T20:13:11.821363] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-09-18T20:13:11.821839] [DEBUG] [LOCAL ] MDST: Trimmed 8326 records to 5493 (keeping 200 days of data) [2025-09-18T20:13:11.856208] [DEBUG] [LOCAL ] MDST: Primary data saved (5493 records). [2025-09-18T20:13:11.856302] [INFO ] [MAIN ] MDST: Full history saved. [2025-09-18T20:13:11.856381] [INFO ] [MAIN ] Update Progress: 1321/2372 symbols completed. MDST took 27.4s. Estimated remaining: 2h 33m 40s. Rate: 6.8 symbols/min [2025-09-18T20:13:12.032928] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:13:12.087447] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-09-18T20:13:12.087614] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-09-18T20:13:12.267154] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:13:12.267447] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-09-18T20:13:12.267504] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-09-18T20:13:12.270289] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-09-18T20:13:12.270363] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-09-18T20:13:12.520375] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-09-18T20:13:12.635215] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:13:12.696999] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-18T20:13:13.319563] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-11. [2025-09-18T20:13:14.040984] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T20:13:14.046754] [INFO ] [REMOTE ] MD: Full fetch complete (55170 records). [2025-09-18T20:13:14.046887] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-09-18T20:13:14.124713] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-09-18T20:13:14.447100] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-09-18T20:13:14.447190] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-09-18T20:13:14.448052] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-09-18T20:13:14.448116] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-09-18T20:13:14.449425] [DEBUG] [LOCAL ] MD: Trimmed 55170 records to 39088 (keeping 200 days of data) [2025-09-18T20:13:14.677085] [DEBUG] [LOCAL ] MD: Primary data saved (39088 records). [2025-09-18T20:13:14.677236] [INFO ] [MAIN ] MD: Full history saved. [2025-09-18T20:13:14.677327] [INFO ] [MAIN ] Update Progress: 1322/2372 symbols completed. MD took 30.2s. Estimated remaining: 2h 33m 26s. Rate: 6.8 symbols/min [2025-09-18T20:13:14.850603] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:13:14.920217] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-09-18T20:13:14.924467] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-18T20:13:14.925575] [DEBUG] [LOCAL ] MDU: Loaded 47853 existing records from primary storage. [2025-09-18T20:13:14.935586] [INFO ] [MAIN ] MDU: Loaded 47853 existing records. [2025-09-18T20:13:15.128625] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:13:15.128950] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-09-18T20:13:15.129002] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-09-18T20:13:15.131429] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-09-18T20:13:15.131492] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-09-18T20:13:15.521364] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:13:15.537201] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-18T20:13:15.719520] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-09-18T20:13:15.795178] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-18T20:13:16.519564] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-11. [2025-09-18T20:13:17.319580] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-09-18T20:13:17.461334] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-18T20:13:17.724464] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-18T20:13:18.119576] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-09-18T20:13:18.256289] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-18T20:13:18.919699] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-09-18T20:13:19.647511] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-18T20:13:19.719610] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-09-18T20:13:19.778317] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-18T20:13:19.782182] [INFO ] [REMOTE ] MCY: Full fetch complete (41761 records). [2025-09-18T20:13:19.782272] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-09-18T20:13:20.179206] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-09-18T20:13:20.179338] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-09-18T20:13:20.180125] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-09-18T20:13:20.180195] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-09-18T20:13:20.181489] [DEBUG] [LOCAL ] MCY: Trimmed 41761 records to 25816 (keeping 200 days of data) [2025-09-18T20:13:20.349535] [DEBUG] [LOCAL ] MCY: Primary data saved (25816 records). [2025-09-18T20:13:20.349704] [INFO ] [MAIN ] MCY: Full history saved. [2025-09-18T20:13:20.349811] [INFO ] [MAIN ] Update Progress: 1323/2372 symbols completed. MCY took 35.9s. Estimated remaining: 2h 33m 15s. Rate: 6.8 symbols/min [2025-09-18T20:13:20.526777] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:13:20.524793] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-09-18T20:13:20.539255] [DEBUG] [LOCAL ] MDV: Loaded 8837 existing records from primary storage. [2025-09-18T20:13:20.539373] [INFO ] [MAIN ] MDV: Loaded 8837 existing records. [2025-09-18T20:13:20.721789] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:13:20.722089] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-09-18T20:13:20.722140] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-09-18T20:13:20.722562] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-09-18T20:13:20.722621] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-09-18T20:13:20.912376] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-18T20:13:21.013112] [INFO ] [REMOTE ] MCS: Full fetch complete (30245 records). [2025-09-18T20:13:21.023567] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-09-18T20:13:21.233466] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:13:21.325119] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-11. [2025-09-18T20:13:21.520342] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-09-18T20:13:21.520422] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-09-18T20:13:21.521045] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-09-18T20:13:21.521107] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-09-18T20:13:21.521898] [DEBUG] [LOCAL ] MCS: Trimmed 30245 records to 21651 (keeping 200 days of data) [2025-09-18T20:13:21.668256] [DEBUG] [LOCAL ] MCS: Primary data saved (21651 records). [2025-09-18T20:13:21.668392] [INFO ] [MAIN ] MCS: Full history saved. [2025-09-18T20:13:21.668528] [INFO ] [MAIN ] Update Progress: 1324/2372 symbols completed. MCS took 37.2s. Estimated remaining: 2h 33m 0s. Rate: 6.8 symbols/min [2025-09-18T20:13:21.839448] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:13:21.860502] [DEBUG] [LOCAL ] MEC: Loaded 16704 existing records from primary storage. [2025-09-18T20:13:21.860672] [INFO ] [MAIN ] MEC: Loaded 16704 existing records. [2025-09-18T20:13:22.051410] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-18T20:13:22.051061] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:13:22.055075] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-09-18T20:13:22.055190] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-09-18T20:13:22.056137] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-09-18T20:13:22.056219] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-09-18T20:13:22.124726] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-09-18T20:13:22.365374] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-18T20:13:22.519774] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:13:22.803168] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-18T20:13:22.919547] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-09-18T20:13:23.485079] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-18T20:13:23.719566] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-11. [2025-09-18T20:13:24.519568] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-09-18T20:13:24.762156] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-18T20:13:25.319590] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-09-18T20:13:26.095772] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-18T20:13:26.119493] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-09-18T20:13:26.919589] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-09-18T20:13:27.023907] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-18T20:13:27.622568] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-18T20:13:27.640219] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-18T20:13:27.719606] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-09-18T20:13:28.519600] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-09-18T20:13:28.664261] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-18T20:13:29.319618] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-09-18T20:13:29.919934] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-18T20:13:30.097945] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-18T20:13:30.119507] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-09-18T20:13:30.919607] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-09-18T20:13:31.719547] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-09-18T20:13:32.080075] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-18T20:13:32.195493] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-18T20:13:32.448284] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-18T20:13:32.519528] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-09-18T20:13:33.319590] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-09-18T20:13:34.068066] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-18T20:13:34.119577] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-09-18T20:13:34.919590] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-09-18T20:13:35.034039] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-18T20:13:35.659635] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-18T20:13:35.702109] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-18T20:13:35.719501] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-09-18T20:13:36.373874] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-18T20:13:36.519613] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-09-18T20:13:37.319581] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-09-18T20:13:38.119623] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-09-18T20:13:38.192157] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-18T20:13:38.225097] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-18T20:13:38.919569] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-09-18T20:13:39.611631] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-18T20:13:39.719620] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-09-18T20:13:40.423962] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T20:13:40.519622] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-09-18T20:13:40.951524] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-18T20:13:41.319580] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-09-18T20:13:42.119584] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-09-18T20:13:42.233007] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-18T20:13:42.316795] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-18T20:13:42.679009] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-18T20:13:42.919585] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-09-18T20:13:43.719576] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-09-18T20:13:44.519621] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-09-18T20:13:44.879770] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-18T20:13:44.926532] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-18T20:13:44.941926] [INFO ] [REMOTE ] MDU: Full fetch complete (70051 records). [2025-09-18T20:13:44.942292] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-09-18T20:13:45.325332] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-09-18T20:13:45.388221] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-09-18T20:13:45.389241] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-09-18T20:13:45.390975] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-09-18T20:13:45.391157] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-09-18T20:13:45.406240] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-18T20:13:45.411892] [DEBUG] [LOCAL ] MDU: Trimmed 70051 records to 48211 (keeping 200 days of data) [2025-09-18T20:13:45.751359] [DEBUG] [LOCAL ] MDU: Primary data saved (48211 records). [2025-09-18T20:13:45.751581] [INFO ] [MAIN ] MDU: Full history saved. [2025-09-18T20:13:45.751829] [INFO ] [MAIN ] Update Progress: 1325/2372 symbols completed. MDU took 31.1s. Estimated remaining: 2h 33m 4s. Rate: 6.8 symbols/min [2025-09-18T20:13:45.933302] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:13:45.957781] [DEBUG] [LOCAL ] MED: Loaded 21925 existing records from primary storage. [2025-09-18T20:13:45.958004] [INFO ] [MAIN ] MED: Loaded 21925 existing records. [2025-09-18T20:13:46.123522] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-09-18T20:13:46.149830] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:13:46.158711] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-09-18T20:13:46.159618] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-18T20:13:46.159906] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-09-18T20:13:46.163288] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-09-18T20:13:46.163370] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-09-18T20:13:46.554774] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:13:46.919575] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-11. [2025-09-18T20:13:47.148307] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-18T20:13:47.719591] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-09-18T20:13:47.933464] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T20:13:48.519724] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-09-18T20:13:49.319540] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-09-18T20:13:49.351252] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-18T20:13:49.360473] [INFO ] [REMOTE ] MDT: Full fetch complete (77542 records). [2025-09-18T20:13:49.360907] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-09-18T20:13:49.498867] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-18T20:13:49.832847] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-09-18T20:13:49.832969] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-09-18T20:13:49.834330] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-09-18T20:13:49.834434] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-09-18T20:13:49.836766] [DEBUG] [LOCAL ] MDT: Trimmed 77542 records to 54068 (keeping 200 days of data) [2025-09-18T20:13:50.119623] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-09-18T20:13:50.201219] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-18T20:13:50.227546] [DEBUG] [LOCAL ] MDT: Primary data saved (54068 records). [2025-09-18T20:13:50.227744] [INFO ] [MAIN ] MDT: Full history saved. [2025-09-18T20:13:50.227889] [INFO ] [MAIN ] Update Progress: 1326/2372 symbols completed. MDT took 38.4s. Estimated remaining: 2h 32m 52s. Rate: 6.8 symbols/min [2025-09-18T20:13:50.412465] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:13:50.450495] [DEBUG] [LOCAL ] MEG: Loaded 32122 existing records from primary storage. [2025-09-18T20:13:50.450668] [INFO ] [MAIN ] MEG: Loaded 32122 existing records. [2025-09-18T20:13:50.631329] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:13:50.631767] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-09-18T20:13:50.631827] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-09-18T20:13:50.633246] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-09-18T20:13:50.633310] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-09-18T20:13:50.924706] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-09-18T20:13:51.025780] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:13:51.038859] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-18T20:13:51.552020] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T20:13:51.719629] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-09-18T20:13:52.519556] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-09-18T20:13:52.715406] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-18T20:13:53.068153] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-18T20:13:53.069483] [INFO ] [REMOTE ] MDV: Full fetch complete (11616 records). [2025-09-18T20:13:53.069554] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-09-18T20:13:53.324862] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-09-18T20:13:53.437229] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-09-18T20:13:53.437313] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-09-18T20:13:53.437590] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-09-18T20:13:53.437629] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-09-18T20:13:53.438140] [DEBUG] [LOCAL ] MDV: Trimmed 11616 records to 8882 (keeping 200 days of data) [2025-09-18T20:13:53.500341] [DEBUG] [LOCAL ] MDV: Primary data saved (8882 records). [2025-09-18T20:13:53.500478] [INFO ] [MAIN ] MDV: Full history saved. [2025-09-18T20:13:53.500630] [INFO ] [MAIN ] Update Progress: 1327/2372 symbols completed. MDV took 33.2s. Estimated remaining: 2h 32m 39s. Rate: 6.8 symbols/min [2025-09-18T20:13:53.673523] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:13:53.700028] [DEBUG] [LOCAL ] MEGI: Loaded 20616 existing records from primary storage. [2025-09-18T20:13:53.700167] [INFO ] [MAIN ] MEGI: Loaded 20616 existing records. [2025-09-18T20:13:53.882074] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:13:53.882362] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-09-18T20:13:53.882467] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-09-18T20:13:53.883277] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-09-18T20:13:53.883340] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-09-18T20:13:54.132228] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-11. [2025-09-18T20:13:54.261728] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:13:54.347823] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-18T20:13:54.919601] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-09-18T20:13:55.626239] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-18T20:13:55.719503] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-09-18T20:13:55.768013] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-18T20:13:56.519568] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-09-18T20:13:56.955348] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-18T20:13:57.319577] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-11. [2025-09-18T20:13:57.597752] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-18T20:13:58.119569] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-09-18T20:13:58.312633] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-18T20:13:58.919569] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-09-18T20:13:58.960059] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-18T20:13:59.719546] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-09-18T20:13:59.860003] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-18T20:14:00.519559] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-09-18T20:14:00.657108] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-18T20:14:00.659838] [INFO ] [REMOTE ] MEC: Full fetch complete (22549 records). [2025-09-18T20:14:00.659933] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-09-18T20:14:01.065026] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-09-18T20:14:01.065122] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-09-18T20:14:01.065693] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-09-18T20:14:01.065757] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-09-18T20:14:01.067613] [DEBUG] [LOCAL ] MEC: Trimmed 22549 records to 16794 (keeping 200 days of data) [2025-09-18T20:14:01.183706] [DEBUG] [LOCAL ] MEC: Primary data saved (16794 records). [2025-09-18T20:14:01.183929] [INFO ] [MAIN ] MEC: Full history saved. [2025-09-18T20:14:01.184058] [INFO ] [MAIN ] Update Progress: 1328/2372 symbols completed. MEC took 39.5s. Estimated remaining: 2h 32m 29s. Rate: 6.8 symbols/min [2025-09-18T20:14:01.329199] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-09-18T20:14:01.362579] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:14:01.404734] [DEBUG] [LOCAL ] MEI: Loaded 32663 existing records from primary storage. [2025-09-18T20:14:01.404871] [INFO ] [MAIN ] MEI: Loaded 32663 existing records. [2025-09-18T20:14:01.590542] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:14:01.590827] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-09-18T20:14:01.590880] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-09-18T20:14:01.591722] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-09-18T20:14:01.591820] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-09-18T20:14:01.992388] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:14:02.006286] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T20:14:02.119507] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-09-18T20:14:02.280219] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-18T20:14:02.919598] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-11. [2025-09-18T20:14:03.358624] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-18T20:14:03.719624] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-09-18T20:14:04.038960] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T20:14:04.519611] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-09-18T20:14:04.730305] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T20:14:05.319594] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-09-18T20:14:05.560295] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-18T20:14:06.119571] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-09-18T20:14:06.620960] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-18T20:14:06.919550] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-09-18T20:14:07.461814] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T20:14:07.719572] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-09-18T20:14:07.842330] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-18T20:14:08.519572] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-09-18T20:14:08.770900] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-18T20:14:09.319608] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-09-18T20:14:10.013235] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-18T20:14:10.119567] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-09-18T20:14:10.243055] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-18T20:14:10.919512] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-09-18T20:14:10.991113] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-18T20:14:11.719544] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-09-18T20:14:12.404162] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T20:14:12.425297] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-18T20:14:12.519581] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-09-18T20:14:13.319521] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-09-18T20:14:13.615163] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-18T20:14:14.119544] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-09-18T20:14:14.479859] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-18T20:14:14.919616] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-09-18T20:14:15.231623] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-18T20:14:15.719517] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-09-18T20:14:16.048521] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-18T20:14:16.519548] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-09-18T20:14:16.816426] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-18T20:14:17.219360] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-18T20:14:17.319585] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-09-18T20:14:18.089198] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-18T20:14:18.119543] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-09-18T20:14:18.919543] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-09-18T20:14:18.932545] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-18T20:14:19.719597] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-09-18T20:14:19.968869] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-18T20:14:19.971914] [INFO ] [REMOTE ] MED: Full fetch complete (33130 records). [2025-09-18T20:14:19.971998] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-09-18T20:14:20.359876] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-09-18T20:14:20.359956] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-09-18T20:14:20.360565] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-09-18T20:14:20.360636] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-09-18T20:14:20.361480] [DEBUG] [LOCAL ] MED: Trimmed 33130 records to 22087 (keeping 200 days of data) [2025-09-18T20:14:20.491355] [DEBUG] [LOCAL ] MED: Primary data saved (22087 records). [2025-09-18T20:14:20.491511] [INFO ] [MAIN ] MED: Full history saved. [2025-09-18T20:14:20.491626] [INFO ] [MAIN ] Update Progress: 1329/2372 symbols completed. MED took 34.7s. Estimated remaining: 2h 32m 28s. Rate: 6.8 symbols/min [2025-09-18T20:14:20.527609] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-09-18T20:14:20.670672] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:14:20.688997] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-18T20:14:20.745456] [DEBUG] [LOCAL ] MET: Loaded 53314 existing records from primary storage. [2025-09-18T20:14:20.745607] [INFO ] [MAIN ] MET: Loaded 53314 existing records. [2025-09-18T20:14:20.923076] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:14:20.923349] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-09-18T20:14:20.923399] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-09-18T20:14:20.924842] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-09-18T20:14:20.924915] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-09-18T20:14:21.281965] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:14:21.319554] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-11. [2025-09-18T20:14:21.733542] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-18T20:14:22.119571] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-09-18T20:14:22.902671] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-18T20:14:22.919519] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-09-18T20:14:23.073413] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-18T20:14:23.719605] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-09-18T20:14:24.513313] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-18T20:14:24.523713] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-09-18T20:14:24.652176] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-18T20:14:25.319563] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-09-18T20:14:26.066084] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-18T20:14:26.119550] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-09-18T20:14:26.172023] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-18T20:14:26.175312] [INFO ] [REMOTE ] MEGI: Full fetch complete (30718 records). [2025-09-18T20:14:26.175395] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-09-18T20:14:26.561187] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-09-18T20:14:26.561272] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-09-18T20:14:26.561912] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-09-18T20:14:26.561974] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-09-18T20:14:26.562781] [DEBUG] [LOCAL ] MEGI: Trimmed 30718 records to 20737 (keeping 200 days of data) [2025-09-18T20:14:26.698531] [DEBUG] [LOCAL ] MEGI: Primary data saved (20737 records). [2025-09-18T20:14:26.698693] [INFO ] [MAIN ] MEGI: Full history saved. [2025-09-18T20:14:26.698805] [INFO ] [MAIN ] Update Progress: 1330/2372 symbols completed. MEGI took 33.2s. Estimated remaining: 2h 32m 18s. Rate: 6.8 symbols/min [2025-09-18T20:14:26.872290] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:14:26.920734] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-09-18T20:14:26.922679] [DEBUG] [LOCAL ] MFA: Loaded 45140 existing records from primary storage. [2025-09-18T20:14:26.922870] [INFO ] [MAIN ] MFA: Loaded 45140 existing records. [2025-09-18T20:14:27.109945] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:14:27.110212] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-09-18T20:14:27.110261] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-09-18T20:14:27.111342] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-09-18T20:14:27.111404] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-09-18T20:14:27.489210] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:14:27.512281] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T20:14:27.719590] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-11. [2025-09-18T20:14:28.512739] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-18T20:14:28.523144] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-09-18T20:14:29.286243] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-18T20:14:29.319508] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-09-18T20:14:29.689762] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-18T20:14:29.696217] [INFO ] [REMOTE ] MEG: Full fetch complete (48245 records). [2025-09-18T20:14:29.696363] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-09-18T20:14:30.094832] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-09-18T20:14:30.094965] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-09-18T20:14:30.095734] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-09-18T20:14:30.095800] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-09-18T20:14:30.097023] [DEBUG] [LOCAL ] MEG: Trimmed 48245 records to 32409 (keeping 200 days of data) [2025-09-18T20:14:30.145572] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-09-18T20:14:30.287686] [DEBUG] [LOCAL ] MEG: Primary data saved (32409 records). [2025-09-18T20:14:30.287830] [INFO ] [MAIN ] MEG: Full history saved. [2025-09-18T20:14:30.287960] [INFO ] [MAIN ] Update Progress: 1331/2372 symbols completed. MEG took 40.1s. Estimated remaining: 2h 32m 5s. Rate: 6.8 symbols/min [2025-09-18T20:14:30.457925] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:14:30.464085] [DEBUG] [LOCAL ] MFAN: Loaded 4281 existing records from primary storage. [2025-09-18T20:14:30.464176] [INFO ] [MAIN ] MFAN: Loaded 4281 existing records. [2025-09-18T20:14:30.646063] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:14:30.646364] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-09-18T20:14:30.646424] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-09-18T20:14:30.646732] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-09-18T20:14:30.646793] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-09-18T20:14:30.923375] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-09-18T20:14:31.011292] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:14:31.041172] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-18T20:14:31.109602] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-18T20:14:31.719558] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-09-18T20:14:32.405339] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-18T20:14:32.519537] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-09-18T20:14:33.180156] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T20:14:33.319545] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-09-18T20:14:34.051273] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-18T20:14:34.119541] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-09-18T20:14:34.517777] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-18T20:14:34.523247] [INFO ] [REMOTE ] MEI: Full fetch complete (45705 records). [2025-09-18T20:14:34.523378] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-09-18T20:14:34.923043] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-09-18T20:14:34.924138] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-09-18T20:14:34.924198] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-09-18T20:14:34.925070] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-09-18T20:14:34.925219] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-09-18T20:14:34.926532] [DEBUG] [LOCAL ] MEI: Trimmed 45705 records to 32951 (keeping 200 days of data) [2025-09-18T20:14:35.119542] [DEBUG] [LOCAL ] MEI: Primary data saved (32951 records). [2025-09-18T20:14:35.119726] [INFO ] [MAIN ] MEI: Full history saved. [2025-09-18T20:14:35.119862] [INFO ] [MAIN ] Update Progress: 1332/2372 symbols completed. MEI took 33.9s. Estimated remaining: 2h 31m 53s. Rate: 6.8 symbols/min [2025-09-18T20:14:35.302696] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:14:35.309144] [DEBUG] [LOCAL ] MFAO: Loaded 3834 existing records from primary storage. [2025-09-18T20:14:35.309261] [INFO ] [MAIN ] MFAO: Loaded 3834 existing records. [2025-09-18T20:14:35.501869] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:14:35.502213] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-09-18T20:14:35.502273] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-09-18T20:14:35.502549] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-09-18T20:14:35.502672] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-09-18T20:14:35.731015] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-11. [2025-09-18T20:14:35.895742] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:14:35.985243] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-18T20:14:36.248496] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-18T20:14:36.429690] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-18T20:14:36.519528] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-09-18T20:14:37.319554] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-11. [2025-09-18T20:14:38.106298] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-18T20:14:38.123991] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-09-18T20:14:38.141540] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-18T20:14:38.919609] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-09-18T20:14:39.299764] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-18T20:14:39.719551] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-09-18T20:14:39.987886] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-18T20:14:40.519559] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-09-18T20:14:41.229306] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-18T20:14:41.319573] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-09-18T20:14:41.639484] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-18T20:14:41.955665] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T20:14:42.119549] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-09-18T20:14:42.919544] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-09-18T20:14:43.352420] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-18T20:14:43.702358] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-18T20:14:43.719521] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-09-18T20:14:44.519582] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-09-18T20:14:44.924415] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-18T20:14:45.319548] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-09-18T20:14:45.493507] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-18T20:14:45.779857] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-18T20:14:46.119552] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-09-18T20:14:46.743316] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-18T20:14:46.919599] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-09-18T20:14:47.411937] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-18T20:14:47.719861] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-09-18T20:14:48.288576] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-18T20:14:48.519542] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-09-18T20:14:49.319598] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-09-18T20:14:50.119542] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-09-18T20:14:50.919973] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-09-18T20:14:50.946369] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-18T20:14:51.719553] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-09-18T20:14:53.257048] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T20:14:53.265998] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-09-18T20:15:05.256987] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (16.74 seconds). [2025-09-18T20:15:05.265353] [INFO ] [REMOTE ] MET: Full fetch complete (76945 records). [2025-09-18T20:15:05.265470] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-09-18T20:15:05.698096] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (14.78 seconds). [2025-09-18T20:15:05.722822] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-09-18T20:15:05.726621] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-09-18T20:15:05.727471] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-09-18T20:15:05.728487] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-09-18T20:15:05.728670] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-09-18T20:15:05.730389] [DEBUG] [LOCAL ] MET: Trimmed 76945 records to 53702 (keeping 200 days of data) [2025-09-18T20:15:06.065543] [DEBUG] [LOCAL ] MET: Primary data saved (53702 records). [2025-09-18T20:15:06.065746] [INFO ] [MAIN ] MET: Full history saved. [2025-09-18T20:15:06.065892] [INFO ] [MAIN ] Update Progress: 1333/2372 symbols completed. MET took 45.6s. Estimated remaining: 2h 32m 2s. Rate: 6.8 symbols/min [2025-09-18T20:15:06.247604] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:15:06.300418] [DEBUG] [LOCAL ] MFC: Loaded 51406 existing records from primary storage. [2025-09-18T20:15:06.300589] [INFO ] [MAIN ] MFC: Loaded 51406 existing records. [2025-09-18T20:15:06.415772] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-18T20:15:06.420264] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-09-18T20:15:06.505941] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:15:06.506176] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-09-18T20:15:06.506225] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-09-18T20:15:06.507408] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-09-18T20:15:06.507471] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-09-18T20:15:06.874719] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:15:06.875088] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-11. [2025-09-18T20:15:06.897362] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-18T20:15:06.898601] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-09-18T20:15:06.944597] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (13.68 seconds). [2025-09-18T20:15:06.955277] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-09-18T20:15:07.412370] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-18T20:15:07.415218] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-09-18T20:15:08.045403] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-18T20:15:08.047440] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-09-18T20:15:08.373963] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-18T20:15:08.384726] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-09-18T20:15:08.441391] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-18T20:15:08.451452] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-09-18T20:15:08.612537] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-18T20:15:08.614171] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-09-18T20:15:09.163199] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-18T20:15:09.164759] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-09-18T20:15:09.703819] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-18T20:15:09.705441] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-09-18T20:15:09.794871] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-18T20:15:09.801446] [INFO ] [REMOTE ] MFA: Full fetch complete (64458 records). [2025-09-18T20:15:09.801601] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-09-18T20:15:10.060677] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (19.94 seconds). [2025-09-18T20:15:10.098528] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-09-18T20:15:10.284746] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-18T20:15:10.286574] [INFO ] [REMOTE ] MFAO: Full fetch complete (5314 records). [2025-09-18T20:15:10.286961] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-09-18T20:15:10.288808] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-18T20:15:10.288970] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-09-18T20:15:10.287317] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-09-18T20:15:10.300894] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-09-18T20:15:10.323903] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-09-18T20:15:10.327795] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-09-18T20:15:10.412886] [DEBUG] [LOCAL ] MFA: Trimmed 64458 records to 45505 (keeping 200 days of data) [2025-09-18T20:15:10.757547] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-18T20:15:10.890209] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-09-18T20:15:10.940614] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-09-18T20:15:10.943400] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-09-18T20:15:10.945315] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-09-18T20:15:10.945499] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-09-18T20:15:10.947131] [DEBUG] [LOCAL ] MFAO: Trimmed 5314 records to 3859 (keeping 200 days of data) [2025-09-18T20:15:10.979379] [DEBUG] [LOCAL ] MFAO: Primary data saved (3859 records). [2025-09-18T20:15:10.988226] [INFO ] [MAIN ] MFAO: Full history saved. [2025-09-18T20:15:10.992789] [INFO ] [MAIN ] Update Progress: 1334/2372 symbols completed. MFAO took 35.9s. Estimated remaining: 2h 31m 50s. Rate: 6.8 symbols/min [2025-09-18T20:15:11.231805] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:15:11.236621] [DEBUG] [LOCAL ] MFA: Primary data saved (45505 records). [2025-09-18T20:15:11.237054] [INFO ] [MAIN ] MFA: Full history saved. [2025-09-18T20:15:11.237141] [INFO ] [MAIN ] Update Progress: 1335/2372 symbols completed. MFA took 44.5s. Estimated remaining: 2h 31m 34s. Rate: 6.8 symbols/min [2025-09-18T20:15:11.422744] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:15:11.445490] [DEBUG] [LOCAL ] MFG: Loaded 48945 existing records from primary storage. [2025-09-18T20:15:11.445719] [INFO ] [MAIN ] MFG: Loaded 48945 existing records. [2025-09-18T20:15:11.527147] [DEBUG] [LOCAL ] MFM: Loaded 14344 existing records from primary storage. [2025-09-18T20:15:11.543750] [INFO ] [MAIN ] MFM: Loaded 14344 existing records. [2025-09-18T20:15:11.636546] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-18T20:15:11.684412] [INFO ] [REMOTE ] MFAN: Full fetch complete (5530 records). [2025-09-18T20:15:11.703773] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-09-18T20:15:11.820566] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:15:11.892737] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-09-18T20:15:11.903336] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-09-18T20:15:11.937789] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-09-18T20:15:11.940979] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-09-18T20:15:11.969573] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:15:12.063392] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-09-18T20:15:12.119225] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-09-18T20:15:12.141361] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-09-18T20:15:12.141521] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-09-18T20:15:12.754148] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-09-18T20:15:12.863127] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-09-18T20:15:12.864669] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-09-18T20:15:12.880638] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-09-18T20:15:12.901379] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-09-18T20:15:12.930800] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-09-18T20:15:13.038503] [DEBUG] [LOCAL ] MFAN: Trimmed 5530 records to 4318 (keeping 200 days of data) [2025-09-18T20:15:13.032292] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:15:13.038254] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:15:13.038973] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-11. [2025-09-18T20:15:13.039694] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-11. [2025-09-18T20:15:13.067201] [DEBUG] [LOCAL ] MFAN: Primary data saved (4318 records). [2025-09-18T20:15:13.067304] [INFO ] [MAIN ] MFAN: Full history saved. [2025-09-18T20:15:13.067387] [INFO ] [MAIN ] Update Progress: 1336/2372 symbols completed. MFAN took 42.8s. Estimated remaining: 2h 31m 20s. Rate: 6.8 symbols/min [2025-09-18T20:15:13.237781] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:15:13.237974] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-09-18T20:15:13.238017] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-09-18T20:15:13.238164] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-09-18T20:15:13.238208] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-18T20:15:13.238250] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-18T20:15:13.238282] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-09-18T20:15:13.590167] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:15:13.590509] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-11. [2025-09-18T20:15:13.876335] [DEBUG] [REMOTE ] MFSB: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:15:13.876699] [WARN ] [REMOTE ] MFSB: No data returned for month 2024-11 [2025-09-18T20:15:13.877156] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-09-18T20:15:14.279565] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-18T20:15:14.280569] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-09-18T20:15:14.489500] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-18T20:15:14.498297] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-09-18T20:15:14.568624] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-18T20:15:14.571175] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-09-18T20:15:14.627624] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-18T20:15:14.628515] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-18T20:15:14.856287] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-18T20:15:14.867163] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-09-18T20:15:14.887094] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-18T20:15:14.887978] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-18T20:15:15.133206] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-18T20:15:15.134157] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-18T20:15:15.143543] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-18T20:15:15.147021] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-09-18T20:15:15.404576] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-18T20:15:15.673258] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-18T20:15:15.719508] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-09-18T20:15:15.765996] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-18T20:15:16.316292] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-18T20:15:16.349212] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T20:15:16.519520] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-09-18T20:15:17.319585] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-09-18T20:15:17.968406] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-18T20:15:18.119612] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-09-18T20:15:18.379706] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-18T20:15:18.919589] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-09-18T20:15:19.299533] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-18T20:15:19.719587] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-09-18T20:15:20.456003] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-18T20:15:20.485910] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-18T20:15:20.519491] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-09-18T20:15:21.319543] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-09-18T20:15:21.338305] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-18T20:15:22.119623] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-18T20:15:22.344706] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-18T20:15:22.703477] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T20:15:22.919545] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-18T20:15:23.384692] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-18T20:15:23.719580] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-09-18T20:15:24.469299] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-18T20:15:24.519566] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-09-18T20:15:25.319565] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-18T20:15:25.687370] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-18T20:15:26.119605] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-09-18T20:15:26.165374] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-18T20:15:26.919578] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-18T20:15:27.207330] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-18T20:15:27.240752] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-18T20:15:27.719564] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-09-18T20:15:28.519564] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-09-18T20:15:29.146177] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T20:15:29.301179] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-18T20:15:29.319500] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-09-18T20:15:30.119591] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-09-18T20:15:30.919524] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-09-18T20:15:31.077334] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-18T20:15:31.163437] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-18T20:15:31.166057] [INFO ] [REMOTE ] MFM: Full fetch complete (19163 records). [2025-09-18T20:15:31.166177] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-09-18T20:15:31.542371] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-09-18T20:15:31.542459] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-09-18T20:15:31.542879] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-09-18T20:15:31.542941] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-09-18T20:15:31.543663] [DEBUG] [LOCAL ] MFM: Trimmed 19163 records to 14511 (keeping 200 days of data) [2025-09-18T20:15:31.629190] [DEBUG] [LOCAL ] MFM: Primary data saved (14511 records). [2025-09-18T20:15:31.629354] [INFO ] [MAIN ] MFM: Full history saved. [2025-09-18T20:15:31.629446] [INFO ] [MAIN ] Update Progress: 1337/2372 symbols completed. MFM took 20.4s. Estimated remaining: 2h 31m 19s. Rate: 6.8 symbols/min [2025-09-18T20:15:31.726849] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-18T20:15:31.801594] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:15:31.801996] [DEBUG] [LOCAL ] MFSG: No existing data file found in primary storage. [2025-09-18T20:15:31.802051] [WARN ] [MAIN ] MFSG: No existing data found, performing full refresh instead. [2025-09-18T20:15:31.802191] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-09-18T20:15:31.802233] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-18T20:15:31.802274] [DEBUG] [LOCAL ] MFSG: No primary data file found to delete. [2025-09-18T20:15:31.802306] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-09-18T20:15:32.160825] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:15:32.415309] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-18T20:15:32.416463] [INFO ] [REMOTE ] MFSB: Full fetch complete (1474 records). [2025-09-18T20:15:32.416534] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-09-18T20:15:32.523294] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-09-18T20:15:32.620442] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-18T20:15:32.620765] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:15:32.642678] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:15:32.648498] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-18T20:15:32.648663] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-18T20:15:32.648891] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-09-18T20:15:32.651055] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-18T20:15:32.651123] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-09-18T20:15:32.662013] [INFO ] [MAIN ] Update Progress: 1338/2372 symbols completed. MFSB took 19.6s. Estimated remaining: 2h 31m 4s. Rate: 6.8 symbols/min [2025-09-18T20:15:32.853586] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:15:32.853884] [DEBUG] [LOCAL ] MFSI: No existing data file found in primary storage. [2025-09-18T20:15:32.853959] [WARN ] [MAIN ] MFSI: No existing data found, performing full refresh instead. [2025-09-18T20:15:32.854134] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-09-18T20:15:32.854188] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-18T20:15:32.854235] [DEBUG] [LOCAL ] MFSI: No primary data file found to delete. [2025-09-18T20:15:32.854291] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-09-18T20:15:33.234871] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:15:33.319581] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-11. [2025-09-18T20:15:33.506699] [DEBUG] [REMOTE ] MFSI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:15:33.507085] [WARN ] [REMOTE ] MFSI: No data returned for month 2024-11 [2025-09-18T20:15:34.127088] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-09-18T20:15:34.132913] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-18T20:15:34.919536] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-09-18T20:15:35.457808] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-18T20:15:35.719543] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-09-18T20:15:35.795893] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-18T20:15:36.209763] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-18T20:15:36.519571] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-09-18T20:15:37.081082] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-18T20:15:37.319626] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-09-18T20:15:38.119794] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-09-18T20:15:38.720446] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-18T20:15:38.859412] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-18T20:15:38.866544] [INFO ] [REMOTE ] MFC: Full fetch complete (74177 records). [2025-09-18T20:15:38.866697] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-09-18T20:15:38.929133] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-09-18T20:15:39.266002] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-09-18T20:15:39.266097] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-09-18T20:15:39.267180] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-09-18T20:15:39.267249] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-09-18T20:15:39.268805] [DEBUG] [LOCAL ] MFC: Trimmed 74177 records to 51764 (keeping 200 days of data) [2025-09-18T20:15:39.588864] [DEBUG] [LOCAL ] MFC: Primary data saved (51764 records). [2025-09-18T20:15:39.589027] [INFO ] [MAIN ] MFC: Full history saved. [2025-09-18T20:15:39.589112] [INFO ] [MAIN ] Update Progress: 1339/2372 symbols completed. MFC took 33.5s. Estimated remaining: 2h 30m 54s. Rate: 6.8 symbols/min [2025-09-18T20:15:39.729949] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-11. [2025-09-18T20:15:39.765213] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:15:39.765410] [DEBUG] [LOCAL ] MFSV: No existing data file found in primary storage. [2025-09-18T20:15:39.765476] [WARN ] [MAIN ] MFSV: No existing data found, performing full refresh instead. [2025-09-18T20:15:39.765669] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-09-18T20:15:39.765754] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-18T20:15:39.765803] [DEBUG] [LOCAL ] MFSV: No primary data file found to delete. [2025-09-18T20:15:39.765837] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-09-18T20:15:40.095802] [DEBUG] [REMOTE ] MFSG: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:15:40.139823] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:15:40.140415] [WARN ] [REMOTE ] MFSG: No data returned for month 2024-11 [2025-09-18T20:15:40.519558] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-11. [2025-09-18T20:15:40.610916] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-18T20:15:40.736173] [DEBUG] [REMOTE ] MFSV: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:15:40.736507] [WARN ] [REMOTE ] MFSV: No data returned for month 2024-11 [2025-09-18T20:15:41.319539] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-09-18T20:15:41.675771] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-18T20:15:42.119550] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-09-18T20:15:42.459826] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-18T20:15:42.919599] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-09-18T20:15:43.719574] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-09-18T20:15:44.143529] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-18T20:15:44.519583] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-09-18T20:15:44.593374] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-18T20:15:44.900577] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-18T20:15:45.319585] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-09-18T20:15:46.119566] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-09-18T20:15:46.551775] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-18T20:15:46.919576] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-09-18T20:15:47.038367] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-18T20:15:47.305525] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-18T20:15:47.719552] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-09-18T20:15:48.065048] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-18T20:15:48.519545] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-09-18T20:15:48.950834] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-18T20:15:49.319615] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-09-18T20:15:49.907104] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-18T20:15:50.119556] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-09-18T20:15:50.912271] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-18T20:15:50.919490] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-09-18T20:15:51.719590] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-09-18T20:15:51.837600] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-18T20:15:52.519554] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-09-18T20:15:52.950753] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-18T20:15:53.236516] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T20:15:53.243994] [INFO ] [REMOTE ] MFG: Full fetch complete (68355 records). [2025-09-18T20:15:53.244150] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-09-18T20:15:53.324733] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-09-18T20:15:53.654440] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-09-18T20:15:53.654568] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-09-18T20:15:53.655780] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-09-18T20:15:53.655854] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-09-18T20:15:53.657731] [DEBUG] [LOCAL ] MFG: Trimmed 68355 records to 49327 (keeping 200 days of data) [2025-09-18T20:15:53.959773] [DEBUG] [LOCAL ] MFG: Primary data saved (49327 records). [2025-09-18T20:15:53.959934] [INFO ] [MAIN ] MFG: Full history saved. [2025-09-18T20:15:53.961613] [INFO ] [MAIN ] Update Progress: 1340/2372 symbols completed. MFG took 43.0s. Estimated remaining: 2h 30m 50s. Rate: 6.8 symbols/min [2025-09-18T20:15:54.144966] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-09-18T20:15:54.150146] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:15:54.172683] [DEBUG] [LOCAL ] MG: Loaded 16904 existing records from primary storage. [2025-09-18T20:15:54.172854] [INFO ] [MAIN ] MG: Loaded 16904 existing records. [2025-09-18T20:15:54.364126] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:15:54.364501] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-09-18T20:15:54.364575] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-09-18T20:15:54.370723] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-09-18T20:15:54.375205] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-09-18T20:15:54.390788] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-18T20:15:54.480286] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-18T20:15:54.784169] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:15:54.919541] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-11. [2025-09-18T20:15:55.719608] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-09-18T20:15:55.924712] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T20:15:56.119973] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-18T20:15:56.519587] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-09-18T20:15:57.319585] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-09-18T20:15:57.410587] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-18T20:15:57.413552] [INFO ] [REMOTE ] MFSI: Full fetch complete (12730 records). [2025-09-18T20:15:57.413628] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-09-18T20:15:57.608765] [WARN ] [VALIDATOR ] MFSI: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-18T20:15:57.609140] [FATAL] [MAIN ] MFSI: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:15:57.609226] [WARN ] [MAIN ] MFSI: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:15:57.609320] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-18T20:15:57.609427] [DEBUG] [LOCAL ] MFSI: No primary data file found to delete. [2025-09-18T20:15:57.609507] [INFO ] [LOCAL ] MFSI: Starting deletion of derivative data. [2025-09-18T20:15:57.609578] [DEBUG] [LOCAL ] MFSI: No derivative data file found to delete. [2025-09-18T20:15:57.609736] [INFO ] [MAIN ] Update Progress: 1341/2372 symbols completed. MFSI took 24.9s. Estimated remaining: 2h 30m 37s. Rate: 6.8 symbols/min [2025-09-18T20:15:57.794543] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:15:57.871031] [DEBUG] [LOCAL ] MGA: Loaded 50683 existing records from primary storage. [2025-09-18T20:15:57.871192] [INFO ] [MAIN ] MGA: Loaded 50683 existing records. [2025-09-18T20:15:57.994198] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-18T20:15:58.068416] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:15:58.068727] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-09-18T20:15:58.068787] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-09-18T20:15:58.070574] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-09-18T20:15:58.070667] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-09-18T20:15:58.128407] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-09-18T20:15:58.465206] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:15:58.919509] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-09-18T20:15:59.097207] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-18T20:15:59.410589] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-18T20:15:59.719553] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-11. [2025-09-18T20:16:00.519547] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-09-18T20:16:01.002513] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-18T20:16:01.319572] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-09-18T20:16:01.451130] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-18T20:16:01.915498] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-18T20:16:02.119559] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-09-18T20:16:02.919568] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-09-18T20:16:03.167605] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-18T20:16:03.373117] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-18T20:16:03.719569] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-09-18T20:16:04.519566] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-09-18T20:16:05.143221] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-18T20:16:05.319530] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-09-18T20:16:05.383959] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-18T20:16:05.873030] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-18T20:16:05.874353] [INFO ] [REMOTE ] MFSV: Full fetch complete (2837 records). [2025-09-18T20:16:05.874425] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-09-18T20:16:06.157291] [WARN ] [VALIDATOR ] MFSV: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-18T20:16:06.150351] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-09-18T20:16:06.158347] [FATAL] [MAIN ] MFSV: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:16:06.158437] [WARN ] [MAIN ] MFSV: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:16:06.158517] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-18T20:16:06.158584] [DEBUG] [LOCAL ] MFSV: No primary data file found to delete. [2025-09-18T20:16:06.158684] [INFO ] [LOCAL ] MFSV: Starting deletion of derivative data. [2025-09-18T20:16:06.158768] [DEBUG] [LOCAL ] MFSV: No derivative data file found to delete. [2025-09-18T20:16:06.158853] [INFO ] [MAIN ] Update Progress: 1342/2372 symbols completed. MFSV took 26.6s. Estimated remaining: 2h 30m 28s. Rate: 6.8 symbols/min [2025-09-18T20:16:06.354316] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:16:06.364044] [DEBUG] [LOCAL ] MGF: Loaded 4157 existing records from primary storage. [2025-09-18T20:16:06.364190] [INFO ] [MAIN ] MGF: Loaded 4157 existing records. [2025-09-18T20:16:06.558936] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:16:06.559198] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-09-18T20:16:06.559248] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-09-18T20:16:06.559534] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-09-18T20:16:06.559594] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-09-18T20:16:06.855842] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-18T20:16:06.920234] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-09-18T20:16:06.950631] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:16:07.719541] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-11. [2025-09-18T20:16:08.298835] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-18T20:16:08.519554] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-09-18T20:16:08.812222] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-18T20:16:09.319521] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-09-18T20:16:09.426700] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-18T20:16:10.119570] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-09-18T20:16:10.921876] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-09-18T20:16:10.925984] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-18T20:16:11.351060] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T20:16:11.608080] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-18T20:16:11.719596] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-09-18T20:16:12.519610] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-09-18T20:16:13.149286] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T20:16:13.319551] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-09-18T20:16:13.353833] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-18T20:16:14.119571] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-09-18T20:16:14.472908] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-18T20:16:14.694394] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-18T20:16:14.919584] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-09-18T20:16:15.549167] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T20:16:15.719564] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-09-18T20:16:16.417820] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-18T20:16:16.419452] [INFO ] [REMOTE ] MFSG: Full fetch complete (5595 records). [2025-09-18T20:16:16.419522] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-09-18T20:16:16.526852] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-09-18T20:16:16.620080] [WARN ] [VALIDATOR ] MFSG: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-18T20:16:16.620316] [FATAL] [MAIN ] MFSG: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:16:16.620385] [WARN ] [MAIN ] MFSG: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:16:16.620457] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-18T20:16:16.620522] [DEBUG] [LOCAL ] MFSG: No primary data file found to delete. [2025-09-18T20:16:16.620558] [INFO ] [LOCAL ] MFSG: Starting deletion of derivative data. [2025-09-18T20:16:16.620599] [DEBUG] [LOCAL ] MFSG: No derivative data file found to delete. [2025-09-18T20:16:16.620721] [INFO ] [MAIN ] Update Progress: 1343/2372 symbols completed. MFSG took 45.0s. Estimated remaining: 2h 30m 21s. Rate: 6.8 symbols/min [2025-09-18T20:16:16.802676] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:16:16.803053] [DEBUG] [LOCAL ] MGM: No existing data file found in primary storage. [2025-09-18T20:16:16.803112] [WARN ] [MAIN ] MGM: No existing data found, performing full refresh instead. [2025-09-18T20:16:16.803330] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-09-18T20:16:16.803392] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-09-18T20:16:16.803438] [DEBUG] [LOCAL ] MGM: No primary data file found to delete. [2025-09-18T20:16:16.803472] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-09-18T20:16:17.197408] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:16:17.319505] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-11. [2025-09-18T20:16:18.119588] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-09-18T20:16:18.397935] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-18T20:16:18.791374] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-18T20:16:18.919521] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-09-18T20:16:19.008235] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T20:16:19.719596] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-09-18T20:16:20.519541] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-09-18T20:16:20.617554] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-18T20:16:21.083328] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-18T20:16:21.319640] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-09-18T20:16:21.470211] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-18T20:16:22.119530] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-09-18T20:16:22.208161] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-18T20:16:22.919557] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-09-18T20:16:23.719595] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-09-18T20:16:23.810639] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-18T20:16:24.519553] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-09-18T20:16:24.691400] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-18T20:16:24.809685] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-18T20:16:25.087346] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-18T20:16:25.319568] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-09-18T20:16:26.119596] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-09-18T20:16:26.919553] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-09-18T20:16:27.111470] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-18T20:16:27.351961] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-18T20:16:27.665146] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-18T20:16:27.719547] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-09-18T20:16:28.519560] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-09-18T20:16:29.319561] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-09-18T20:16:29.357198] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-18T20:16:29.359799] [INFO ] [REMOTE ] MG: Full fetch complete (24002 records). [2025-09-18T20:16:29.359878] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-09-18T20:16:29.758045] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-18T20:16:29.796299] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-09-18T20:16:29.796547] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-09-18T20:16:29.797189] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-09-18T20:16:29.797304] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-09-18T20:16:29.799400] [DEBUG] [LOCAL ] MG: Trimmed 24002 records to 17012 (keeping 200 days of data) [2025-09-18T20:16:29.911932] [DEBUG] [LOCAL ] MG: Primary data saved (17012 records). [2025-09-18T20:16:29.912122] [INFO ] [MAIN ] MG: Full history saved. [2025-09-18T20:16:29.912253] [INFO ] [MAIN ] Update Progress: 1344/2372 symbols completed. MG took 36.0s. Estimated remaining: 2h 30m 15s. Rate: 6.8 symbols/min [2025-09-18T20:16:30.091798] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:16:30.103878] [DEBUG] [LOCAL ] MGR: Loaded 5656 existing records from primary storage. [2025-09-18T20:16:30.104004] [INFO ] [MAIN ] MGR: Loaded 5656 existing records. [2025-09-18T20:16:30.124685] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-09-18T20:16:30.300373] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:16:30.300778] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-09-18T20:16:30.300887] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-09-18T20:16:30.301418] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-09-18T20:16:30.301479] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-09-18T20:16:30.674683] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:16:30.919549] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-11. [2025-09-18T20:16:31.209505] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-18T20:16:31.552789] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-18T20:16:31.719546] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-09-18T20:16:32.114686] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-18T20:16:32.269322] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-18T20:16:32.519578] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-09-18T20:16:33.319547] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-09-18T20:16:33.984184] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-18T20:16:34.119542] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-09-18T20:16:34.317894] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-18T20:16:34.536197] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-18T20:16:34.919556] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-09-18T20:16:35.561304] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-18T20:16:35.719553] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-09-18T20:16:36.519559] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-09-18T20:16:37.055515] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-18T20:16:37.319559] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-09-18T20:16:37.419628] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-18T20:16:38.119554] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-09-18T20:16:38.858588] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-18T20:16:38.867071] [INFO ] [REMOTE ] MGA: Full fetch complete (73540 records). [2025-09-18T20:16:38.867229] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-09-18T20:16:38.927893] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-09-18T20:16:39.270121] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-09-18T20:16:39.270215] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-09-18T20:16:39.271225] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-09-18T20:16:39.271294] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-09-18T20:16:39.273946] [DEBUG] [LOCAL ] MGA: Trimmed 73540 records to 51050 (keeping 200 days of data) [2025-09-18T20:16:39.613092] [DEBUG] [LOCAL ] MGA: Primary data saved (51050 records). [2025-09-18T20:16:39.613277] [INFO ] [MAIN ] MGA: Full history saved. [2025-09-18T20:16:39.613386] [INFO ] [MAIN ] Update Progress: 1345/2372 symbols completed. MGA took 42.0s. Estimated remaining: 2h 30m 7s. Rate: 6.8 symbols/min [2025-09-18T20:16:39.728043] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-09-18T20:16:39.745528] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-18T20:16:39.800768] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:16:39.809395] [DEBUG] [LOCAL ] MGRB: Loaded 4119 existing records from primary storage. [2025-09-18T20:16:39.809554] [INFO ] [MAIN ] MGRB: Loaded 4119 existing records. [2025-09-18T20:16:39.994611] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:16:40.007166] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-09-18T20:16:40.012410] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-09-18T20:16:40.024769] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-09-18T20:16:40.025297] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-09-18T20:16:40.058690] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-18T20:16:40.400476] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:16:40.446808] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-18T20:16:40.519500] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-09-18T20:16:41.294760] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-18T20:16:41.319506] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-09-18T20:16:41.854158] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-18T20:16:42.119557] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-09-18T20:16:42.882162] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-18T20:16:42.919498] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-09-18T20:16:43.724137] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-11. [2025-09-18T20:16:43.728072] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-18T20:16:44.294682] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-18T20:16:44.519559] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-09-18T20:16:45.154690] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-18T20:16:45.155931] [INFO ] [REMOTE ] MGF: Full fetch complete (5966 records). [2025-09-18T20:16:45.156021] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-09-18T20:16:45.334171] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-09-18T20:16:45.522871] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-09-18T20:16:45.522959] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-09-18T20:16:45.523120] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-09-18T20:16:45.523192] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-09-18T20:16:45.523612] [DEBUG] [LOCAL ] MGF: Trimmed 5966 records to 4177 (keeping 200 days of data) [2025-09-18T20:16:45.549694] [DEBUG] [LOCAL ] MGF: Primary data saved (4177 records). [2025-09-18T20:16:45.549820] [INFO ] [MAIN ] MGF: Full history saved. [2025-09-18T20:16:45.549928] [INFO ] [MAIN ] Update Progress: 1346/2372 symbols completed. MGF took 39.4s. Estimated remaining: 2h 29m 56s. Rate: 6.8 symbols/min [2025-09-18T20:16:45.718481] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:16:45.723867] [DEBUG] [LOCAL ] MGRD: Loaded 2250 existing records from primary storage. [2025-09-18T20:16:45.723991] [INFO ] [MAIN ] MGRD: Loaded 2250 existing records. [2025-09-18T20:16:45.904827] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:16:45.905122] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-09-18T20:16:45.905179] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-09-18T20:16:45.905471] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-09-18T20:16:45.905530] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-09-18T20:16:46.126456] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-09-18T20:16:46.286151] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:16:46.860082] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-18T20:16:46.919618] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-09-18T20:16:47.202695] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-18T20:16:47.498426] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-18T20:16:47.719581] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-09-18T20:16:48.519612] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-11. [2025-09-18T20:16:48.996345] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-18T20:16:49.319603] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-09-18T20:16:49.507514] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-18T20:16:49.937862] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-18T20:16:50.119563] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-09-18T20:16:50.677858] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-18T20:16:50.919551] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-09-18T20:16:51.493550] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-18T20:16:51.494909] [INFO ] [REMOTE ] MGR: Full fetch complete (8466 records). [2025-09-18T20:16:51.494982] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-09-18T20:16:51.724682] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-09-18T20:16:51.886370] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-09-18T20:16:51.886453] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-09-18T20:16:51.886702] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-09-18T20:16:51.886764] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-09-18T20:16:51.887277] [DEBUG] [LOCAL ] MGR: Trimmed 8466 records to 5715 (keeping 200 days of data) [2025-09-18T20:16:51.924690] [DEBUG] [LOCAL ] MGR: Primary data saved (5715 records). [2025-09-18T20:16:51.924886] [INFO ] [MAIN ] MGR: Full history saved. [2025-09-18T20:16:51.925000] [INFO ] [MAIN ] Update Progress: 1347/2372 symbols completed. MGR took 22.0s. Estimated remaining: 2h 29m 46s. Rate: 6.8 symbols/min [2025-09-18T20:16:52.108561] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:16:52.117444] [DEBUG] [LOCAL ] MGRE: Loaded 6503 existing records from primary storage. [2025-09-18T20:16:52.117581] [INFO ] [MAIN ] MGRE: Loaded 6503 existing records. [2025-09-18T20:16:52.310493] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:16:52.310908] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-09-18T20:16:52.311085] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-09-18T20:16:52.311533] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-09-18T20:16:52.311761] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-09-18T20:16:52.500861] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-18T20:16:52.526842] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-09-18T20:16:52.610218] [INFO ] [REMOTE ] MGM: Full fetch complete (77053 records). [2025-09-18T20:16:52.611564] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-09-18T20:16:52.637278] [FATAL] [VALIDATOR ] MGM: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T20:16:52.641200] [FATAL] [MAIN ] MGM: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:16:52.641285] [WARN ] [MAIN ] MGM: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:16:52.641734] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-09-18T20:16:52.662846] [DEBUG] [LOCAL ] MGM: No primary data file found to delete. [2025-09-18T20:16:52.683427] [INFO ] [LOCAL ] MGM: Starting deletion of derivative data. [2025-09-18T20:16:52.703532] [DEBUG] [LOCAL ] MGM: No derivative data file found to delete. [2025-09-18T20:16:52.705835] [INFO ] [MAIN ] Update Progress: 1348/2372 symbols completed. MGM took 36.1s. Estimated remaining: 2h 29m 31s. Rate: 6.8 symbols/min [2025-09-18T20:16:52.728079] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:16:52.898750] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:16:52.961634] [DEBUG] [LOCAL ] MGY: Loaded 52448 existing records from primary storage. [2025-09-18T20:16:52.961830] [INFO ] [MAIN ] MGY: Loaded 52448 existing records. [2025-09-18T20:16:53.149801] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:16:53.150068] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-09-18T20:16:53.150121] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-09-18T20:16:53.151611] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-09-18T20:16:53.151700] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-09-18T20:16:53.246381] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-18T20:16:53.330446] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-09-18T20:16:53.516308] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:16:53.953806] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-18T20:16:54.119604] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-09-18T20:16:54.662802] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-18T20:16:54.919561] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-09-18T20:16:55.534712] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-18T20:16:55.719558] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-11. [2025-09-18T20:16:56.263550] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-18T20:16:56.519549] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-11. [2025-09-18T20:16:57.319562] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-09-18T20:16:57.826432] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-18T20:16:58.053625] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-18T20:16:58.119621] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-09-18T20:16:58.828247] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-18T20:16:58.919574] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-09-18T20:16:59.483139] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-18T20:16:59.719564] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-09-18T20:17:00.190030] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-18T20:17:00.519549] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-09-18T20:17:00.986565] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-18T20:17:01.319566] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-09-18T20:17:01.956896] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-18T20:17:02.119598] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-09-18T20:17:02.819682] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-18T20:17:02.919557] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-09-18T20:17:03.546300] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-18T20:17:03.719598] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-09-18T20:17:04.349855] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-18T20:17:04.519618] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-09-18T20:17:05.319582] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-09-18T20:17:05.958967] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-18T20:17:06.119572] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-09-18T20:17:06.267736] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-18T20:17:06.781731] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-18T20:17:06.919583] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-09-18T20:17:07.562779] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-18T20:17:07.719568] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-09-18T20:17:08.367905] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-18T20:17:08.519611] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-09-18T20:17:09.278499] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-18T20:17:09.319529] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-09-18T20:17:10.018283] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-18T20:17:10.119607] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-09-18T20:17:10.683933] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-18T20:17:10.919592] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-09-18T20:17:11.384346] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-18T20:17:11.719590] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-09-18T20:17:12.519589] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-09-18T20:17:13.208977] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-18T20:17:13.319551] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-09-18T20:17:13.507151] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-18T20:17:13.891024] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-18T20:17:14.119570] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-09-18T20:17:14.760669] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-18T20:17:14.919548] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-09-18T20:17:15.719554] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-09-18T20:17:16.269140] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-18T20:17:16.270186] [INFO ] [REMOTE ] MGRB: Full fetch complete (6365 records). [2025-09-18T20:17:16.270260] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-09-18T20:17:16.524120] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-09-18T20:17:16.649961] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-09-18T20:17:16.650119] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-09-18T20:17:16.650381] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-09-18T20:17:16.650495] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-09-18T20:17:16.651167] [DEBUG] [LOCAL ] MGRB: Trimmed 6365 records to 4131 (keeping 200 days of data) [2025-09-18T20:17:16.701168] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-18T20:17:16.718193] [DEBUG] [LOCAL ] MGRB: Primary data saved (4131 records). [2025-09-18T20:17:16.718310] [INFO ] [MAIN ] MGRB: Full history saved. [2025-09-18T20:17:16.718400] [INFO ] [MAIN ] Update Progress: 1349/2372 symbols completed. MGRB took 37.1s. Estimated remaining: 2h 29m 34s. Rate: 6.8 symbols/min [2025-09-18T20:17:16.889737] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:17:16.889953] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-09-18T20:17:16.890009] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-09-18T20:17:16.890158] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-09-18T20:17:16.890203] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-18T20:17:16.890244] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-18T20:17:16.890277] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-09-18T20:17:17.287888] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-18T20:17:17.293512] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:17:17.295552] [INFO ] [REMOTE ] MGRE: Full fetch complete (9413 records). [2025-09-18T20:17:17.295976] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-09-18T20:17:17.325219] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-09-18T20:17:17.666512] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-09-18T20:17:17.666611] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-09-18T20:17:17.666980] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-09-18T20:17:17.667044] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-09-18T20:17:17.667683] [DEBUG] [LOCAL ] MGRE: Trimmed 9413 records to 6622 (keeping 200 days of data) [2025-09-18T20:17:17.710050] [DEBUG] [LOCAL ] MGRE: Primary data saved (6622 records). [2025-09-18T20:17:17.710199] [INFO ] [MAIN ] MGRE: Full history saved. [2025-09-18T20:17:17.710290] [INFO ] [MAIN ] Update Progress: 1350/2372 symbols completed. MGRE took 25.8s. Estimated remaining: 2h 29m 19s. Rate: 6.8 symbols/min [2025-09-18T20:17:17.828063] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-18T20:17:17.844704] [INFO ] [REMOTE ] MGRD: Full fetch complete (3552 records). [2025-09-18T20:17:17.865142] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-09-18T20:17:17.900597] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:17:18.126372] [DEBUG] [LOCAL ] MHD: Loaded 12269 existing records from primary storage. [2025-09-18T20:17:18.140985] [INFO ] [MAIN ] MHD: Loaded 12269 existing records. [2025-09-18T20:17:18.125851] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-11. [2025-09-18T20:17:18.449422] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-09-18T20:17:18.455691] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-09-18T20:17:18.470237] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-09-18T20:17:18.495510] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-09-18T20:17:18.495428] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:17:18.496296] [DEBUG] [LOCAL ] MGRD: Trimmed 3552 records to 2262 (keeping 200 days of data) [2025-09-18T20:17:18.496509] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-09-18T20:17:18.496929] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-09-18T20:17:18.497366] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-09-18T20:17:18.497428] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-09-18T20:17:18.572432] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:17:18.585956] [DEBUG] [LOCAL ] MGRD: Primary data saved (2262 records). [2025-09-18T20:17:18.605112] [WARN ] [REMOTE ] MH: No data returned for month 2024-11 [2025-09-18T20:17:18.630829] [INFO ] [MAIN ] MGRD: Full history saved. [2025-09-18T20:17:18.631950] [INFO ] [MAIN ] Update Progress: 1351/2372 symbols completed. MGRD took 33.1s. Estimated remaining: 2h 29m 4s. Rate: 6.8 symbols/min [2025-09-18T20:17:18.924467] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-09-18T20:17:19.013837] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:17:19.103471] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:17:19.107678] [DEBUG] [LOCAL ] MHF: Loaded 8551 existing records from primary storage. [2025-09-18T20:17:19.107881] [INFO ] [MAIN ] MHF: Loaded 8551 existing records. [2025-09-18T20:17:19.295318] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:17:19.295600] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-09-18T20:17:19.295710] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-09-18T20:17:19.296103] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-09-18T20:17:19.296163] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-09-18T20:17:19.658332] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:17:19.719550] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-09-18T20:17:20.000016] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:17:20.000403] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-09-18T20:17:20.519546] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-11. [2025-09-18T20:17:20.723748] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-18T20:17:21.319589] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-11. [2025-09-18T20:17:21.395499] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-18T20:17:21.927181] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-18T20:17:22.119557] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-01. [2025-09-18T20:17:22.426281] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:17:22.426623] [WARN ] [REMOTE ] MH: No data returned for month 2025-01 [2025-09-18T20:17:22.919603] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-09-18T20:17:23.719616] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-09-18T20:17:23.760085] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T20:17:24.519623] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-02. [2025-09-18T20:17:24.825954] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:17:24.826523] [WARN ] [REMOTE ] MH: No data returned for month 2025-02 [2025-09-18T20:17:25.319605] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-03. [2025-09-18T20:17:25.557391] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-18T20:17:25.633035] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:17:25.633546] [WARN ] [REMOTE ] MH: No data returned for month 2025-03 [2025-09-18T20:17:26.119585] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-09-18T20:17:26.919622] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-09-18T20:17:27.724814] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-04. [2025-09-18T20:17:27.765035] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-18T20:17:27.787442] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-18T20:17:28.056874] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:17:28.057364] [WARN ] [REMOTE ] MH: No data returned for month 2025-04 [2025-09-18T20:17:28.519626] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-09-18T20:17:29.319574] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-09-18T20:17:29.529422] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-18T20:17:30.007350] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-18T20:17:30.119582] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-09-18T20:17:30.919585] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-09-18T20:17:31.683896] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-18T20:17:31.724675] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-09-18T20:17:31.739585] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-18T20:17:32.519551] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-05. [2025-09-18T20:17:32.610912] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-18T20:17:32.807294] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:17:32.807635] [WARN ] [REMOTE ] MH: No data returned for month 2025-05 [2025-09-18T20:17:33.319565] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-06. [2025-09-18T20:17:33.589949] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:17:33.590295] [WARN ] [REMOTE ] MH: No data returned for month 2025-06 [2025-09-18T20:17:34.119536] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-07. [2025-09-18T20:17:34.919556] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-09-18T20:17:35.027429] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-18T20:17:35.686980] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-18T20:17:35.719532] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-08. [2025-09-18T20:17:36.519572] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-09-18T20:17:37.012732] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-18T20:17:37.196391] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-18T20:17:37.319616] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-09-18T20:17:38.119590] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-09. [2025-09-18T20:17:38.919629] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-09-18T20:17:39.238962] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-18T20:17:39.270945] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-18T20:17:39.276282] [INFO ] [REMOTE ] MH: Full fetch complete (11264 records). [2025-09-18T20:17:39.276394] [DEBUG] [VALIDATOR ] MH: Validating primary data. [2025-09-18T20:17:39.486834] [WARN ] [VALIDATOR ] MH: Validation failed - insufficient historical data. Have 40 unique days, need 200 days [2025-09-18T20:17:39.487217] [FATAL] [MAIN ] MH: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:17:39.487313] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:17:39.487383] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-18T20:17:39.487751] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-18T20:17:39.487930] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-09-18T20:17:39.495816] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-09-18T20:17:39.495962] [INFO ] [MAIN ] Update Progress: 1352/2372 symbols completed. MH took 22.8s. Estimated remaining: 2h 29m 5s. Rate: 6.8 symbols/min [2025-09-18T20:17:39.497463] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-18T20:17:39.687996] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:17:39.719580] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-09-18T20:17:39.735155] [DEBUG] [LOCAL ] MHK: Loaded 42541 existing records from primary storage. [2025-09-18T20:17:39.735312] [INFO ] [MAIN ] MHK: Loaded 42541 existing records. [2025-09-18T20:17:39.925055] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:17:39.925317] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-09-18T20:17:39.925368] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-09-18T20:17:39.926676] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-09-18T20:17:39.926745] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-09-18T20:17:40.308397] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:17:40.519594] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-11. [2025-09-18T20:17:40.693168] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-18T20:17:41.319777] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-09-18T20:17:42.036056] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-18T20:17:42.059896] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-18T20:17:42.119621] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-09-18T20:17:42.919608] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-09-18T20:17:43.726636] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-09-18T20:17:43.748023] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-18T20:17:43.819940] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-18T20:17:44.519553] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-09-18T20:17:45.197479] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-18T20:17:45.238473] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-18T20:17:45.319582] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-09-18T20:17:46.071523] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-18T20:17:46.119576] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-09-18T20:17:46.816452] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-18T20:17:46.919533] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-09-18T20:17:47.673448] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-18T20:17:47.719538] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-09-18T20:17:48.519615] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-09-18T20:17:48.530262] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-18T20:17:49.319573] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-09-18T20:17:50.070040] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T20:17:50.086560] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-18T20:17:50.119552] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-09-18T20:17:50.858139] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T20:17:50.860815] [INFO ] [REMOTE ] MHD: Full fetch complete (18842 records). [2025-09-18T20:17:50.860903] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-09-18T20:17:50.925086] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-09-18T20:17:51.255409] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-09-18T20:17:51.255499] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-09-18T20:17:51.255931] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-09-18T20:17:51.255994] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-09-18T20:17:51.256973] [DEBUG] [LOCAL ] MHD: Trimmed 18842 records to 12367 (keeping 200 days of data) [2025-09-18T20:17:51.338051] [DEBUG] [LOCAL ] MHD: Primary data saved (12367 records). [2025-09-18T20:17:51.338211] [INFO ] [MAIN ] MHD: Full history saved. [2025-09-18T20:17:51.338306] [INFO ] [MAIN ] Update Progress: 1353/2372 symbols completed. MHD took 33.6s. Estimated remaining: 2h 28m 58s. Rate: 6.8 symbols/min [2025-09-18T20:17:51.522328] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:17:51.522526] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-09-18T20:17:51.522568] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-18T20:17:51.522753] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-18T20:17:51.522805] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-18T20:17:51.522851] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-18T20:17:51.522887] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-18T20:17:51.725611] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-09-18T20:17:51.886240] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:17:52.447029] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-18T20:17:52.449382] [INFO ] [REMOTE ] MHF: Full fetch complete (12881 records). [2025-09-18T20:17:52.449507] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-09-18T20:17:52.522139] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-11. [2025-09-18T20:17:52.641873] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-18T20:17:52.875706] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-09-18T20:17:52.875806] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-09-18T20:17:52.876133] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-09-18T20:17:52.876174] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-09-18T20:17:52.876668] [DEBUG] [LOCAL ] MHF: Trimmed 12881 records to 8630 (keeping 200 days of data) [2025-09-18T20:17:52.929820] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-11 (0.41 seconds). [2025-09-18T20:17:52.938601] [DEBUG] [LOCAL ] MHF: Primary data saved (8630 records). [2025-09-18T20:17:52.938742] [INFO ] [MAIN ] MHF: Full history saved. [2025-09-18T20:17:52.938866] [INFO ] [MAIN ] Update Progress: 1354/2372 symbols completed. MHF took 34.3s. Estimated remaining: 2h 28m 44s. Rate: 6.8 symbols/min [2025-09-18T20:17:53.116180] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:17:53.128767] [DEBUG] [LOCAL ] MHN: Loaded 7824 existing records from primary storage. [2025-09-18T20:17:53.128897] [INFO ] [MAIN ] MHN: Loaded 7824 existing records. [2025-09-18T20:17:53.323532] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-09-18T20:17:53.323432] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:17:53.324797] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-09-18T20:17:53.324866] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-09-18T20:17:53.325225] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-09-18T20:17:53.325287] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-09-18T20:17:53.753624] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:17:54.119557] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-11. [2025-09-18T20:17:54.726964] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-18T20:17:54.761458] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-18T20:17:54.770140] [INFO ] [REMOTE ] MGY: Full fetch complete (75325 records). [2025-09-18T20:17:54.770304] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-09-18T20:17:54.933065] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-09-18T20:17:55.214767] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-09-18T20:17:55.214889] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-09-18T20:17:55.216011] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-09-18T20:17:55.216093] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-09-18T20:17:55.218009] [DEBUG] [LOCAL ] MGY: Trimmed 75325 records to 52836 (keeping 200 days of data) [2025-09-18T20:17:55.430239] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-18T20:17:55.578895] [DEBUG] [LOCAL ] MGY: Primary data saved (52836 records). [2025-09-18T20:17:55.579031] [INFO ] [MAIN ] MGY: Full history saved. [2025-09-18T20:17:55.579124] [INFO ] [MAIN ] Update Progress: 1355/2372 symbols completed. MGY took 1m 3s. Estimated remaining: 2h 28m 31s. Rate: 6.8 symbols/min [2025-09-18T20:17:55.736606] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-09-18T20:17:55.773131] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:17:55.802074] [DEBUG] [LOCAL ] MHO: Loaded 24450 existing records from primary storage. [2025-09-18T20:17:55.802223] [INFO ] [MAIN ] MHO: Loaded 24450 existing records. [2025-09-18T20:17:56.006078] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:17:56.006610] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-09-18T20:17:56.006693] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-09-18T20:17:56.008002] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-09-18T20:17:56.008066] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-09-18T20:17:56.185447] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-18T20:17:56.405324] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:17:56.519538] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-09-18T20:17:57.319550] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-09-18T20:17:57.378778] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-18T20:17:58.119619] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-18T20:17:58.505084] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-18T20:17:58.799178] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T20:17:58.919532] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-09-18T20:17:59.719557] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-11. [2025-09-18T20:18:00.530428] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-09-18T20:18:00.536715] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-18T20:18:01.320309] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-09-18T20:18:01.321491] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-18T20:18:01.397144] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-18T20:18:02.119588] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-18T20:18:02.919625] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-09-18T20:18:03.338244] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-18T20:18:03.719603] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-18T20:18:03.901900] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-18T20:18:04.029685] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-18T20:18:04.268031] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-18T20:18:04.519600] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-18T20:18:05.008568] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-18T20:18:05.319549] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-09-18T20:18:06.119591] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-18T20:18:06.169219] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-18T20:18:06.461410] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-18T20:18:06.919558] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-18T20:18:07.228400] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-18T20:18:07.719560] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-09-18T20:18:08.519594] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-09-18T20:18:09.212960] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T20:18:09.319622] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-09-18T20:18:09.899898] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T20:18:10.119550] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-18T20:18:10.357279] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-18T20:18:10.428437] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-18T20:18:10.919581] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-09-18T20:18:11.719596] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-18T20:18:12.164449] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-18T20:18:12.165209] [INFO ] [REMOTE ] MHLA: Full fetch complete (1500 records). [2025-09-18T20:18:12.165279] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-09-18T20:18:12.350285] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-18T20:18:12.350533] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:18:12.350614] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:18:12.350714] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-18T20:18:12.350792] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-18T20:18:12.350830] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-18T20:18:12.350886] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-09-18T20:18:12.350975] [INFO ] [MAIN ] Update Progress: 1356/2372 symbols completed. MHLA took 21.0s. Estimated remaining: 2h 28m 28s. Rate: 6.8 symbols/min [2025-09-18T20:18:12.527188] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:18:12.524687] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-09-18T20:18:12.528222] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-09-18T20:18:12.528280] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-09-18T20:18:12.528423] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-09-18T20:18:12.528467] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-18T20:18:12.528509] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-18T20:18:12.528544] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-09-18T20:18:12.903228] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:18:13.319549] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-11. [2025-09-18T20:18:13.413516] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-18T20:18:14.113571] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:18:14.114011] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-11 [2025-09-18T20:18:14.123589] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-09-18T20:18:14.126311] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-18T20:18:14.919570] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-09-18T20:18:15.676790] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-18T20:18:15.703983] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-18T20:18:15.719495] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-09-18T20:18:16.519560] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-09-18T20:18:16.820108] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:18:16.820468] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-09-18T20:18:17.155992] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-18T20:18:17.162911] [INFO ] [REMOTE ] MHK: Full fetch complete (60874 records). [2025-09-18T20:18:17.163088] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-09-18T20:18:17.329347] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-01. [2025-09-18T20:18:17.593291] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-09-18T20:18:17.593398] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-09-18T20:18:17.594294] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-09-18T20:18:17.594379] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-09-18T20:18:17.595854] [DEBUG] [LOCAL ] MHK: Trimmed 60874 records to 42873 (keeping 200 days of data) [2025-09-18T20:18:17.703636] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:18:17.707523] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-01 [2025-09-18T20:18:17.861551] [DEBUG] [LOCAL ] MHK: Primary data saved (42873 records). [2025-09-18T20:18:17.861711] [INFO ] [MAIN ] MHK: Full history saved. [2025-09-18T20:18:17.861826] [INFO ] [MAIN ] Update Progress: 1357/2372 symbols completed. MHK took 38.4s. Estimated remaining: 2h 28m 17s. Rate: 6.8 symbols/min [2025-09-18T20:18:18.119546] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-09-18T20:18:18.919559] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-09-18T20:18:19.256339] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T20:18:19.604611] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-18T20:18:19.719531] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-09-18T20:18:20.441090] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-18T20:18:20.519525] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-09-18T20:18:21.299673] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-18T20:18:21.319495] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-09-18T20:18:21.915729] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-18T20:18:21.917698] [INFO ] [REMOTE ] MHN: Full fetch complete (12001 records). [2025-09-18T20:18:21.917789] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-09-18T20:18:22.125693] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-09-18T20:18:22.300574] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-09-18T20:18:22.300687] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-09-18T20:18:22.301021] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-09-18T20:18:22.301082] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-09-18T20:18:22.301622] [DEBUG] [LOCAL ] MHN: Trimmed 12001 records to 7862 (keeping 200 days of data) [2025-09-18T20:18:22.356307] [DEBUG] [LOCAL ] MHN: Primary data saved (7862 records). [2025-09-18T20:18:22.356492] [INFO ] [MAIN ] MHN: Full history saved. [2025-09-18T20:18:22.356633] [INFO ] [MAIN ] Update Progress: 1358/2372 symbols completed. MHN took 29.4s. Estimated remaining: 2h 28m 5s. Rate: 6.8 symbols/min [2025-09-18T20:18:22.919549] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-02. [2025-09-18T20:18:23.306030] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:18:23.306390] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-02 [2025-09-18T20:18:23.657920] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T20:18:23.719576] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-03. [2025-09-18T20:18:23.975299] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:18:23.975680] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-03 [2025-09-18T20:18:24.519549] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-04. [2025-09-18T20:18:24.790497] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:18:24.790907] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-04 [2025-09-18T20:18:25.319560] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-09-18T20:18:26.119576] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-05. [2025-09-18T20:18:26.367882] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:18:26.368241] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-05 [2025-09-18T20:18:26.415305] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-18T20:18:26.919566] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-09-18T20:18:27.719572] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-06. [2025-09-18T20:18:28.117894] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:18:28.118249] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-06 [2025-09-18T20:18:28.139295] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-18T20:18:28.519606] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-09-18T20:18:29.319609] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-07. [2025-09-18T20:18:29.442198] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T20:18:29.608141] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:18:29.608531] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-07 [2025-09-18T20:18:30.119546] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-08. [2025-09-18T20:18:30.919571] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-09-18T20:18:31.500254] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-18T20:18:31.719730] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-09. [2025-09-18T20:18:32.064952] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-18T20:18:32.519553] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-09-18T20:18:32.893611] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-18T20:18:32.898733] [INFO ] [REMOTE ] MIAX: Full fetch complete (7586 records). [2025-09-18T20:18:32.898815] [DEBUG] [VALIDATOR ] MIAX: Validating primary data. [2025-09-18T20:18:33.082802] [WARN ] [VALIDATOR ] MIAX: Validation failed - insufficient historical data. Have 25 unique days, need 200 days [2025-09-18T20:18:33.083050] [FATAL] [MAIN ] MIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:18:33.083122] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:18:33.083191] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-18T20:18:33.083259] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-18T20:18:33.083297] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-09-18T20:18:33.083380] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-09-18T20:18:33.083458] [INFO ] [MAIN ] Update Progress: 1359/2372 symbols completed. MIAX took 20.7s. Estimated remaining: 2h 27m 57s. Rate: 6.8 symbols/min [2025-09-18T20:18:33.639125] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-18T20:18:33.645613] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-09-18T20:18:34.592433] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-18T20:18:34.596478] [INFO ] [REMOTE ] MHO: Full fetch complete (37385 records). [2025-09-18T20:18:34.596622] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-09-18T20:18:35.021283] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-09-18T20:18:35.021418] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-09-18T20:18:35.023372] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-09-18T20:18:35.023483] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-09-18T20:18:35.025030] [DEBUG] [LOCAL ] MHO: Trimmed 37385 records to 24676 (keeping 200 days of data) [2025-09-18T20:18:35.267824] [DEBUG] [LOCAL ] MHO: Primary data saved (24676 records). [2025-09-18T20:18:35.268036] [INFO ] [MAIN ] MHO: Full history saved. [2025-09-18T20:18:35.268178] [INFO ] [MAIN ] Update Progress: 1360/2372 symbols completed. MHO took 39.7s. Estimated remaining: 2h 27m 44s. Rate: 6.9 symbols/min [2025-09-18T20:18:36.195578] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:18:36.206863] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:18:36.302823] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:18:36.305702] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:18:36.307931] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-09-18T20:18:36.308040] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-09-18T20:18:36.309242] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-09-18T20:18:36.309438] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-18T20:18:36.309664] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-18T20:18:36.309988] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-09-18T20:18:36.314188] [DEBUG] [LOCAL ] MITP: Loaded 2357 existing records from primary storage. [2025-09-18T20:18:36.323351] [INFO ] [MAIN ] MITP: Loaded 2357 existing records. [2025-09-18T20:18:36.428085] [DEBUG] [LOCAL ] MIN: Loaded 13207 existing records from primary storage. [2025-09-18T20:18:36.474263] [INFO ] [MAIN ] MIN: Loaded 13207 existing records. [2025-09-18T20:18:36.922285] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:18:36.965540] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-09-18T20:18:37.054985] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-09-18T20:18:37.091716] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-09-18T20:18:37.127311] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-09-18T20:18:37.109966] [DEBUG] [LOCAL ] MIR: Loaded 50776 existing records from primary storage. [2025-09-18T20:18:37.148793] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:18:37.182019] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:18:37.182359] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-09-18T20:18:37.182841] [INFO ] [MAIN ] MIR: Loaded 50776 existing records. [2025-09-18T20:18:37.182728] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-11. [2025-09-18T20:18:37.215427] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-09-18T20:18:37.286557] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-09-18T20:18:37.325145] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-09-18T20:18:37.743272] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:18:37.829320] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-09-18T20:18:37.844122] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-09-18T20:18:37.843833] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-18T20:18:37.868577] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-09-18T20:18:37.909286] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-09-18T20:18:37.954368] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-09-18T20:18:38.096972] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:18:38.144838] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-11. [2025-09-18T20:18:38.418619] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:18:38.463944] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-11. [2025-09-18T20:18:38.528481] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-18T20:18:38.547950] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-09-18T20:18:38.642388] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:18:38.642935] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-11. [2025-09-18T20:18:38.937026] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-18T20:18:38.942194] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-09-18T20:18:38.942382] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-18T20:18:39.248693] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-18T20:18:39.381601] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-18T20:18:39.719600] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-18T20:18:40.098922] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-18T20:18:40.133311] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-18T20:18:40.519554] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-09-18T20:18:41.319571] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-09-18T20:18:42.007620] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-18T20:18:42.119593] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-18T20:18:42.614292] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-18T20:18:42.792749] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-18T20:18:42.919594] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-09-18T20:18:43.719586] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-18T20:18:43.974938] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-18T20:18:44.118269] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-18T20:18:44.519576] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-09-18T20:18:45.319597] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-18T20:18:45.389909] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-18T20:18:45.677584] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-18T20:18:46.119555] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-09-18T20:18:46.610265] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-18T20:18:46.919563] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-09-18T20:18:47.447374] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-18T20:18:47.719590] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-09-18T20:18:48.432086] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-18T20:18:48.519531] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-09-18T20:18:49.021370] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-18T20:18:49.319602] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-09-18T20:18:50.119570] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-09-18T20:18:50.762402] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-18T20:18:50.765482] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-18T20:18:50.919499] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-09-18T20:18:51.719550] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-09-18T20:18:52.189177] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-18T20:18:52.399845] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-18T20:18:52.519588] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-09-18T20:18:53.022441] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-18T20:18:53.319559] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-09-18T20:18:54.119572] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-09-18T20:18:54.771878] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-18T20:18:54.795539] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-18T20:18:54.919544] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-09-18T20:18:55.719571] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-18T20:18:56.122577] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-18T20:18:56.519610] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-09-18T20:18:56.800289] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-18T20:18:56.860795] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-18T20:18:57.319567] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-09-18T20:18:57.769857] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-18T20:18:57.771206] [INFO ] [REMOTE ] MITP: Full fetch complete (3309 records). [2025-09-18T20:18:57.771302] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-09-18T20:18:58.124723] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-09-18T20:18:58.131965] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-09-18T20:18:58.132065] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-09-18T20:18:58.132234] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-09-18T20:18:58.132316] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-09-18T20:18:58.132788] [DEBUG] [LOCAL ] MITP: Trimmed 3309 records to 2399 (keeping 200 days of data) [2025-09-18T20:18:58.149003] [DEBUG] [LOCAL ] MITP: Primary data saved (2399 records). [2025-09-18T20:18:58.149107] [INFO ] [MAIN ] MITP: Full history saved. [2025-09-18T20:18:58.149264] [INFO ] [MAIN ] Update Progress: 1361/2372 symbols completed. MITP took 22.9s. Estimated remaining: 2h 27m 46s. Rate: 6.8 symbols/min [2025-09-18T20:18:58.332294] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:18:58.364440] [DEBUG] [LOCAL ] MITT: Loaded 23028 existing records from primary storage. [2025-09-18T20:18:58.364671] [INFO ] [MAIN ] MITT: Loaded 23028 existing records. [2025-09-18T20:18:58.551461] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:18:58.551839] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-09-18T20:18:58.551910] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-09-18T20:18:58.552868] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-09-18T20:18:58.552939] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-09-18T20:18:58.921267] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-09-18T20:18:58.946145] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:18:58.986525] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-18T20:18:59.719548] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-11. [2025-09-18T20:19:00.519565] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-18T20:19:00.615388] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-18T20:19:00.641264] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-18T20:19:01.115812] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-18T20:19:01.319552] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-09-18T20:19:02.119551] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-09-18T20:19:02.925411] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-09-18T20:19:02.949475] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-18T20:19:03.009944] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-18T20:19:03.719573] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-09-18T20:19:04.195447] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-18T20:19:04.519547] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-18T20:19:05.004199] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-18T20:19:05.319552] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-09-18T20:19:05.456369] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-18T20:19:06.119550] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-09-18T20:19:06.231621] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-18T20:19:06.919585] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-09-18T20:19:07.702715] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-18T20:19:07.719494] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-09-18T20:19:08.036087] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-18T20:19:08.519584] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-18T20:19:08.923551] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-18T20:19:08.924520] [INFO ] [REMOTE ] MITN: Full fetch complete (2289 records). [2025-09-18T20:19:08.924688] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-09-18T20:19:09.106253] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-18T20:19:09.106482] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:19:09.106591] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:19:09.106712] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-18T20:19:09.106817] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-18T20:19:09.106888] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-09-18T20:19:09.106958] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-09-18T20:19:09.107037] [INFO ] [MAIN ] Update Progress: 1362/2372 symbols completed. MITN took 33.8s. Estimated remaining: 2h 27m 38s. Rate: 6.8 symbols/min [2025-09-18T20:19:09.286919] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:19:09.309450] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-18T20:19:09.318762] [INFO ] [REMOTE ] MIR: Full fetch complete (73248 records). [2025-09-18T20:19:09.318968] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-09-18T20:19:09.322617] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-09-18T20:19:09.322944] [DEBUG] [LOCAL ] MIY: Loaded 6046 existing records from primary storage. [2025-09-18T20:19:09.345142] [INFO ] [MAIN ] MIY: Loaded 6046 existing records. [2025-09-18T20:19:09.797333] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:19:09.830975] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-09-18T20:19:09.831262] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-09-18T20:19:09.842098] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-09-18T20:19:09.847297] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-09-18T20:19:10.034356] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-09-18T20:19:10.045019] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-09-18T20:19:10.045998] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-09-18T20:19:10.046083] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-09-18T20:19:10.121340] [DEBUG] [LOCAL ] MIR: Trimmed 73248 records to 51163 (keeping 200 days of data) [2025-09-18T20:19:10.128165] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-09-18T20:19:10.392106] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:19:10.401929] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-18T20:19:10.631072] [DEBUG] [LOCAL ] MIR: Primary data saved (51163 records). [2025-09-18T20:19:10.631261] [INFO ] [MAIN ] MIR: Full history saved. [2025-09-18T20:19:10.631407] [INFO ] [MAIN ] Update Progress: 1363/2372 symbols completed. MIR took 35.4s. Estimated remaining: 2h 27m 24s. Rate: 6.8 symbols/min [2025-09-18T20:19:10.802752] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:19:10.858771] [DEBUG] [LOCAL ] MKC: Loaded 52467 existing records from primary storage. [2025-09-18T20:19:10.858949] [INFO ] [MAIN ] MKC: Loaded 52467 existing records. [2025-09-18T20:19:10.924675] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-11. [2025-09-18T20:19:11.088428] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:19:11.089340] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-09-18T20:19:11.089396] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-09-18T20:19:11.092133] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-09-18T20:19:11.092195] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-09-18T20:19:11.447531] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:19:11.577332] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-18T20:19:11.655321] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-18T20:19:11.719555] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-11. [2025-09-18T20:19:12.519565] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-09-18T20:19:13.256922] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-18T20:19:13.319549] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-09-18T20:19:13.647039] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T20:19:14.022580] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-18T20:19:14.119538] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-09-18T20:19:14.919547] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-09-18T20:19:15.535747] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T20:19:15.719521] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-09-18T20:19:15.772361] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-18T20:19:16.519571] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-09-18T20:19:17.125455] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-18T20:19:17.319600] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-09-18T20:19:17.580737] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-18T20:19:18.036474] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-18T20:19:18.038534] [INFO ] [REMOTE ] MIN: Full fetch complete (17874 records). [2025-09-18T20:19:18.038629] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-09-18T20:19:18.124699] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-09-18T20:19:18.443006] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-09-18T20:19:18.443084] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-09-18T20:19:18.443463] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-09-18T20:19:18.443562] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-09-18T20:19:18.444267] [DEBUG] [LOCAL ] MIN: Trimmed 17874 records to 13246 (keeping 200 days of data) [2025-09-18T20:19:18.527222] [DEBUG] [LOCAL ] MIN: Primary data saved (13246 records). [2025-09-18T20:19:18.527365] [INFO ] [MAIN ] MIN: Full history saved. [2025-09-18T20:19:18.527469] [INFO ] [MAIN ] Update Progress: 1364/2372 symbols completed. MIN took 43.3s. Estimated remaining: 2h 27m 15s. Rate: 6.8 symbols/min [2025-09-18T20:19:18.699109] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:19:18.743150] [DEBUG] [LOCAL ] MKL: Loaded 34327 existing records from primary storage. [2025-09-18T20:19:18.743289] [INFO ] [MAIN ] MKL: Loaded 34327 existing records. [2025-09-18T20:19:18.925601] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-09-18T20:19:18.935007] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:19:18.934879] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-18T20:19:18.938506] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-09-18T20:19:18.938600] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-09-18T20:19:18.939751] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-09-18T20:19:18.939811] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-09-18T20:19:19.300083] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:19:19.719508] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-09-18T20:19:20.113896] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-18T20:19:20.353933] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-18T20:19:20.519541] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-09-18T20:19:21.319560] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-09-18T20:19:22.119588] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-11. [2025-09-18T20:19:22.311344] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-18T20:19:22.360803] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-18T20:19:22.919552] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-09-18T20:19:23.205188] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T20:19:23.395826] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-18T20:19:23.719553] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-09-18T20:19:24.519517] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-09-18T20:19:24.651141] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T20:19:24.991312] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-18T20:19:25.319560] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-09-18T20:19:26.119540] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-09-18T20:19:26.510726] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-18T20:19:26.919539] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-09-18T20:19:27.339683] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-18T20:19:27.719555] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-09-18T20:19:27.806354] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-18T20:19:27.809465] [INFO ] [REMOTE ] MITT: Full fetch complete (34803 records). [2025-09-18T20:19:27.809551] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-09-18T20:19:28.202813] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-09-18T20:19:28.202925] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-09-18T20:19:28.203605] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-09-18T20:19:28.203673] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-09-18T20:19:28.205844] [DEBUG] [LOCAL ] MITT: Trimmed 34803 records to 23196 (keeping 200 days of data) [2025-09-18T20:19:28.354784] [DEBUG] [LOCAL ] MITT: Primary data saved (23196 records). [2025-09-18T20:19:28.354941] [INFO ] [MAIN ] MITT: Full history saved. [2025-09-18T20:19:28.355059] [INFO ] [MAIN ] Update Progress: 1365/2372 symbols completed. MITT took 30.2s. Estimated remaining: 2h 27m 7s. Rate: 6.8 symbols/min [2025-09-18T20:19:28.525408] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-09-18T20:19:28.614738] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:19:28.668622] [DEBUG] [LOCAL ] MLI: Loaded 43959 existing records from primary storage. [2025-09-18T20:19:28.668854] [INFO ] [MAIN ] MLI: Loaded 43959 existing records. [2025-09-18T20:19:28.747706] [DEBUG] [REMOTE ] MKL: Error fetching primary data for 2025-01: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-18T20:19:28.763616] [WARN ] [REMOTE ] MKL: No data returned for month 2025-01 [2025-09-18T20:19:28.945921] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:19:28.946281] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-09-18T20:19:28.946354] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-09-18T20:19:28.947954] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-09-18T20:19:28.948046] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-09-18T20:19:29.328570] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-09-18T20:19:29.522587] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:19:29.524383] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-18T20:19:30.119546] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-09-18T20:19:30.919564] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-09-18T20:19:31.021763] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-18T20:19:31.022501] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-18T20:19:31.719592] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-11. [2025-09-18T20:19:32.381989] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-18T20:19:32.519587] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-09-18T20:19:33.194967] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-18T20:19:33.319538] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-09-18T20:19:33.482494] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-18T20:19:33.939839] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T20:19:33.941472] [INFO ] [REMOTE ] MIY: Full fetch complete (9140 records). [2025-09-18T20:19:33.941562] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-09-18T20:19:34.119712] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-09-18T20:19:34.343143] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-09-18T20:19:34.343299] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-09-18T20:19:34.343594] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-09-18T20:19:34.343638] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-09-18T20:19:34.344639] [DEBUG] [LOCAL ] MIY: Trimmed 9140 records to 6085 (keeping 200 days of data) [2025-09-18T20:19:34.391582] [DEBUG] [LOCAL ] MIY: Primary data saved (6085 records). [2025-09-18T20:19:34.391797] [INFO ] [MAIN ] MIY: Full history saved. [2025-09-18T20:19:34.391995] [INFO ] [MAIN ] Update Progress: 1366/2372 symbols completed. MIY took 25.3s. Estimated remaining: 2h 26m 56s. Rate: 6.8 symbols/min [2025-09-18T20:19:34.584439] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:19:34.638794] [DEBUG] [LOCAL ] MLM: Loaded 31541 existing records from primary storage. [2025-09-18T20:19:34.638938] [INFO ] [MAIN ] MLM: Loaded 31541 existing records. [2025-09-18T20:19:34.828488] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:19:34.828861] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-09-18T20:19:34.828946] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-09-18T20:19:34.829981] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-09-18T20:19:34.830040] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-09-18T20:19:34.927795] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-09-18T20:19:35.208970] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:19:35.719602] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-09-18T20:19:35.943904] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-18T20:19:36.381842] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-18T20:19:36.519563] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-11. [2025-09-18T20:19:37.319578] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-09-18T20:19:37.349311] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-18T20:19:37.954145] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T20:19:38.119580] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-09-18T20:19:38.927056] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-09-18T20:19:38.934978] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-18T20:19:39.571017] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-18T20:19:39.719581] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-09-18T20:19:40.519564] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-09-18T20:19:40.590619] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T20:19:41.082428] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-18T20:19:41.319565] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-09-18T20:19:42.072014] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-18T20:19:42.119509] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-09-18T20:19:42.901904] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-18T20:19:42.919494] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-09-18T20:19:43.719549] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-09-18T20:19:44.125305] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-18T20:19:44.519589] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-09-18T20:19:44.592087] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-18T20:19:45.050586] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-18T20:19:45.319598] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-09-18T20:19:45.793223] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-18T20:19:46.119568] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-09-18T20:19:46.677876] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-18T20:19:46.919547] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-09-18T20:19:47.527438] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-18T20:19:47.719603] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-09-18T20:19:48.491637] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-18T20:19:48.519512] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-09-18T20:19:48.704115] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-18T20:19:49.319553] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-09-18T20:19:50.119616] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-09-18T20:19:50.293113] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-18T20:19:50.919549] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-09-18T20:19:51.060448] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-18T20:19:51.500523] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-18T20:19:51.719566] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-09-18T20:19:52.459875] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-18T20:19:52.468230] [INFO ] [REMOTE ] MKC: Full fetch complete (75338 records). [2025-09-18T20:19:52.468405] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-09-18T20:19:52.529600] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-09-18T20:19:52.876542] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-09-18T20:19:52.876687] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-09-18T20:19:52.877754] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-09-18T20:19:52.877875] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-09-18T20:19:52.880011] [DEBUG] [LOCAL ] MKC: Trimmed 75338 records to 52837 (keeping 200 days of data) [2025-09-18T20:19:52.996902] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-18T20:19:53.236848] [DEBUG] [LOCAL ] MKC: Primary data saved (52837 records). [2025-09-18T20:19:53.237004] [INFO ] [MAIN ] MKC: Full history saved. [2025-09-18T20:19:53.237105] [INFO ] [MAIN ] Update Progress: 1367/2372 symbols completed. MKC took 42.6s. Estimated remaining: 2h 26m 55s. Rate: 6.8 symbols/min [2025-09-18T20:19:53.324745] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-09-18T20:19:53.425093] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:19:53.451929] [DEBUG] [LOCAL ] MLNK: Loaded 25665 existing records from primary storage. [2025-09-18T20:19:53.452072] [INFO ] [MAIN ] MLNK: Loaded 25665 existing records. [2025-09-18T20:19:53.634747] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:19:53.635009] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-09-18T20:19:53.635108] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-09-18T20:19:53.635780] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-09-18T20:19:53.635839] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-09-18T20:19:53.994512] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:19:54.109432] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T20:19:54.119573] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-09-18T20:19:54.668179] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T20:19:54.919552] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-11. [2025-09-18T20:19:55.509705] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-18T20:19:55.719506] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-09-18T20:19:55.737092] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-18T20:19:56.519612] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-09-18T20:19:57.319523] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-09-18T20:19:57.359072] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-18T20:19:57.469598] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-18T20:19:58.119583] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-09-18T20:19:58.697899] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-18T20:19:58.919551] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-09-18T20:19:59.114409] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-18T20:19:59.719578] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-09-18T20:20:00.000222] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-18T20:20:00.519557] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-09-18T20:20:01.246797] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T20:20:01.319610] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-09-18T20:20:02.119634] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-09-18T20:20:02.919600] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-09-18T20:20:03.979481] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (3.46 seconds). [2025-09-18T20:20:03.988363] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-09-18T20:20:04.440787] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-18T20:20:04.519505] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-09-18T20:20:04.556506] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (3.24 seconds). [2025-09-18T20:20:04.612680] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-18T20:20:04.617494] [INFO ] [REMOTE ] MKL: Full fetch complete (44772 records). [2025-09-18T20:20:04.617606] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-09-18T20:20:04.810946] [WARN ] [VALIDATOR ] MKL: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-18T20:20:04.811573] [FATAL] [MAIN ] MKL: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:20:04.811696] [WARN ] [MAIN ] MKL: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:20:04.811800] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-09-18T20:20:04.811918] [DEBUG] [LOCAL ] MKL: No primary data file found to delete. [2025-09-18T20:20:04.811977] [INFO ] [LOCAL ] MKL: Starting deletion of derivative data. [2025-09-18T20:20:04.812489] [DEBUG] [LOCAL ] MKL: Deleted derivative data file. [2025-09-18T20:20:04.812608] [INFO ] [MAIN ] Update Progress: 1368/2372 symbols completed. MKL took 46.3s. Estimated remaining: 2h 26m 48s. Rate: 6.8 symbols/min [2025-09-18T20:20:04.982756] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:20:04.987884] [DEBUG] [LOCAL ] MLP: Loaded 3015 existing records from primary storage. [2025-09-18T20:20:04.987981] [INFO ] [MAIN ] MLP: Loaded 3015 existing records. [2025-09-18T20:20:05.171012] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:20:05.171333] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-09-18T20:20:05.171390] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-09-18T20:20:05.171695] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-09-18T20:20:05.171757] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-09-18T20:20:05.327165] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-09-18T20:20:05.494797] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T20:20:05.545156] [INFO ] [REMOTE ] MLM: Full fetch complete (45790 records). [2025-09-18T20:20:05.550958] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-09-18T20:20:05.582814] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:20:05.762085] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T20:20:06.005333] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-09-18T20:20:06.005420] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-09-18T20:20:06.006192] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-09-18T20:20:06.006256] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-09-18T20:20:06.007453] [DEBUG] [LOCAL ] MLM: Trimmed 45790 records to 31723 (keeping 200 days of data) [2025-09-18T20:20:06.122827] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-09-18T20:20:06.221246] [DEBUG] [LOCAL ] MLM: Primary data saved (31723 records). [2025-09-18T20:20:06.221417] [INFO ] [MAIN ] MLM: Full history saved. [2025-09-18T20:20:06.222339] [INFO ] [MAIN ] Update Progress: 1369/2372 symbols completed. MLM took 31.8s. Estimated remaining: 2h 26m 34s. Rate: 6.8 symbols/min [2025-09-18T20:20:06.401422] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:20:06.422190] [DEBUG] [LOCAL ] MLR: Loaded 13118 existing records from primary storage. [2025-09-18T20:20:06.422372] [INFO ] [MAIN ] MLR: Loaded 13118 existing records. [2025-09-18T20:20:06.614525] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:20:06.615202] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-09-18T20:20:06.615388] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-09-18T20:20:06.615984] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-09-18T20:20:06.616096] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-09-18T20:20:06.818553] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T20:20:06.895425] [INFO ] [REMOTE ] MLI: Full fetch complete (63592 records). [2025-09-18T20:20:06.912343] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-09-18T20:20:06.924572] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-11. [2025-09-18T20:20:07.148145] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:20:07.422120] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-09-18T20:20:07.422514] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-09-18T20:20:07.424122] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-09-18T20:20:07.424491] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-09-18T20:20:07.444552] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-18T20:20:07.445201] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-18T20:20:07.451951] [DEBUG] [LOCAL ] MLI: Trimmed 63592 records to 44291 (keeping 200 days of data) [2025-09-18T20:20:07.722099] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-09-18T20:20:07.737004] [DEBUG] [LOCAL ] MLI: Primary data saved (44291 records). [2025-09-18T20:20:07.737159] [INFO ] [MAIN ] MLI: Full history saved. [2025-09-18T20:20:07.737250] [INFO ] [MAIN ] Update Progress: 1370/2372 symbols completed. MLI took 39.4s. Estimated remaining: 2h 26m 20s. Rate: 6.8 symbols/min [2025-09-18T20:20:07.910407] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:20:07.910605] [DEBUG] [LOCAL ] MMC: No existing data file found in primary storage. [2025-09-18T20:20:07.910680] [WARN ] [MAIN ] MMC: No existing data found, performing full refresh instead. [2025-09-18T20:20:07.910845] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-09-18T20:20:07.910890] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-09-18T20:20:07.910935] [DEBUG] [LOCAL ] MMC: No primary data file found to delete. [2025-09-18T20:20:07.910968] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-09-18T20:20:08.275344] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:20:08.519549] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-11. [2025-09-18T20:20:08.769661] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-18T20:20:09.319553] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-11. [2025-09-18T20:20:10.105268] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-18T20:20:10.119515] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-09-18T20:20:10.365916] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-18T20:20:10.919550] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-09-18T20:20:11.451207] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-18T20:20:11.719572] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-09-18T20:20:11.770809] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-18T20:20:12.519558] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-09-18T20:20:12.558975] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T20:20:13.319546] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-09-18T20:20:13.891996] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-18T20:20:14.119544] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-09-18T20:20:14.443600] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-18T20:20:14.533715] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-18T20:20:14.919549] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-09-18T20:20:15.719596] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-09-18T20:20:15.953042] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-18T20:20:16.177046] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-18T20:20:16.519550] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-09-18T20:20:17.319540] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-09-18T20:20:17.441842] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-18T20:20:18.003353] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-18T20:20:18.119560] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-09-18T20:20:18.919558] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-09-18T20:20:19.135266] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-18T20:20:19.719568] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-09-18T20:20:19.885075] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-18T20:20:20.139186] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-18T20:20:20.519549] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-09-18T20:20:21.319521] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-09-18T20:20:21.676340] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-18T20:20:22.119581] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-09-18T20:20:22.329033] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-18T20:20:22.919584] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-09-18T20:20:23.227288] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-18T20:20:23.719551] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-09-18T20:20:24.307379] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-18T20:20:24.519585] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-09-18T20:20:24.660432] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-18T20:20:25.319567] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-09-18T20:20:25.426134] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-18T20:20:25.430960] [INFO ] [REMOTE ] MLNK: Full fetch complete (35746 records). [2025-09-18T20:20:25.431049] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-09-18T20:20:25.815004] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-09-18T20:20:25.820158] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-09-18T20:20:25.820043] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-18T20:20:25.821168] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-09-18T20:20:25.821269] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-09-18T20:20:25.824578] [DEBUG] [LOCAL ] MLNK: Trimmed 35746 records to 25971 (keeping 200 days of data) [2025-09-18T20:20:25.985209] [DEBUG] [LOCAL ] MLNK: Primary data saved (25971 records). [2025-09-18T20:20:25.985373] [INFO ] [MAIN ] MLNK: Full history saved. [2025-09-18T20:20:25.985494] [INFO ] [MAIN ] Update Progress: 1371/2372 symbols completed. MLNK took 32.7s. Estimated remaining: 2h 26m 18s. Rate: 6.8 symbols/min [2025-09-18T20:20:26.124768] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-09-18T20:20:26.172176] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:20:26.185966] [DEBUG] [LOCAL ] MMD: Loaded 11157 existing records from primary storage. [2025-09-18T20:20:26.186242] [INFO ] [MAIN ] MMD: Loaded 11157 existing records. [2025-09-18T20:20:26.368056] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:20:26.368404] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-09-18T20:20:26.368475] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-09-18T20:20:26.368970] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-09-18T20:20:26.369031] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-09-18T20:20:26.722638] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:20:26.919565] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-11. [2025-09-18T20:20:27.719571] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-09-18T20:20:27.859749] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-18T20:20:28.115427] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-18T20:20:28.519557] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-09-18T20:20:28.714367] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-18T20:20:29.319539] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-09-18T20:20:29.352256] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-18T20:20:30.119588] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-09-18T20:20:30.324722] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-18T20:20:30.919560] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-09-18T20:20:31.719587] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-09-18T20:20:32.519700] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-09-18T20:20:32.662991] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-09-18T20:20:33.100839] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-18T20:20:33.123892] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-18T20:20:33.125259] [INFO ] [REMOTE ] MLP: Full fetch complete (4685 records). [2025-09-18T20:20:33.125334] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-09-18T20:20:33.325098] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-09-18T20:20:33.531935] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-09-18T20:20:33.532033] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-09-18T20:20:33.532200] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-09-18T20:20:33.532267] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-09-18T20:20:33.532837] [DEBUG] [LOCAL ] MLP: Trimmed 4685 records to 3044 (keeping 200 days of data) [2025-09-18T20:20:33.552219] [DEBUG] [LOCAL ] MLP: Primary data saved (3044 records). [2025-09-18T20:20:33.552386] [INFO ] [MAIN ] MLP: Full history saved. [2025-09-18T20:20:33.552486] [INFO ] [MAIN ] Update Progress: 1372/2372 symbols completed. MLP took 28.7s. Estimated remaining: 2h 26m 8s. Rate: 6.8 symbols/min [2025-09-18T20:20:33.737970] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:20:33.758744] [DEBUG] [LOCAL ] MMI: Loaded 15362 existing records from primary storage. [2025-09-18T20:20:33.758894] [INFO ] [MAIN ] MMI: Loaded 15362 existing records. [2025-09-18T20:20:33.954147] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:20:33.954438] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-09-18T20:20:33.954490] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-09-18T20:20:33.955111] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-09-18T20:20:33.955173] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-09-18T20:20:34.120287] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-09-18T20:20:34.331886] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:20:34.362434] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-18T20:20:34.419399] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-18T20:20:34.919524] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-09-18T20:20:34.986365] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-18T20:20:35.719561] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-09-18T20:20:36.519566] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-11. [2025-09-18T20:20:36.743383] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-18T20:20:36.967599] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-18T20:20:37.125942] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-18T20:20:37.319608] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-09-18T20:20:38.119566] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-09-18T20:20:38.217244] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-18T20:20:38.837438] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-18T20:20:38.839984] [INFO ] [REMOTE ] MLR: Full fetch complete (18414 records). [2025-09-18T20:20:38.840066] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-09-18T20:20:38.924689] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-09-18T20:20:39.235957] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-09-18T20:20:39.236068] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-09-18T20:20:39.236572] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-09-18T20:20:39.236671] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-09-18T20:20:39.237691] [DEBUG] [LOCAL ] MLR: Trimmed 18414 records to 13256 (keeping 200 days of data) [2025-09-18T20:20:39.327622] [DEBUG] [LOCAL ] MLR: Primary data saved (13256 records). [2025-09-18T20:20:39.327799] [INFO ] [MAIN ] MLR: Full history saved. [2025-09-18T20:20:39.327929] [INFO ] [MAIN ] Update Progress: 1373/2372 symbols completed. MLR took 33.1s. Estimated remaining: 2h 25m 57s. Rate: 6.8 symbols/min [2025-09-18T20:20:39.495675] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:20:39.495896] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-09-18T20:20:39.495940] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-09-18T20:20:39.496091] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-09-18T20:20:39.496134] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-18T20:20:39.496175] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-18T20:20:39.496208] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-09-18T20:20:39.728312] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-09-18T20:20:39.828727] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-18T20:20:39.910726] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:20:40.519607] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-09-18T20:20:40.698028] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-18T20:20:41.319615] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-09-18T20:20:41.620123] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-18T20:20:42.119566] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-11. [2025-09-18T20:20:42.919557] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-09-18T20:20:43.407729] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-18T20:20:43.568262] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-18T20:20:43.610459] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-18T20:20:43.719586] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-09-18T20:20:44.091993] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-18T20:20:44.519572] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-09-18T20:20:45.319556] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-09-18T20:20:45.363308] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-18T20:20:46.119549] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-09-18T20:20:46.892293] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-18T20:20:46.919492] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-09-18T20:20:47.042061] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-18T20:20:47.719553] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-09-18T20:20:47.860482] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-18T20:20:48.519574] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-09-18T20:20:48.823024] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-18T20:20:49.319576] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-09-18T20:20:49.843810] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-18T20:20:50.106988] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T20:20:50.119498] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-09-18T20:20:50.901166] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-18T20:20:50.908140] [INFO ] [REMOTE ] MMC: Full fetch complete (74111 records). [2025-09-18T20:20:50.908317] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-09-18T20:20:50.909164] [FATAL] [VALIDATOR ] MMC: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T20:20:50.909297] [FATAL] [MAIN ] MMC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:20:50.909374] [WARN ] [MAIN ] MMC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:20:50.909474] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-09-18T20:20:50.909612] [DEBUG] [LOCAL ] MMC: No primary data file found to delete. [2025-09-18T20:20:50.909701] [INFO ] [LOCAL ] MMC: Starting deletion of derivative data. [2025-09-18T20:20:50.909761] [DEBUG] [LOCAL ] MMC: No derivative data file found to delete. [2025-09-18T20:20:50.909827] [INFO ] [MAIN ] Update Progress: 1374/2372 symbols completed. MMC took 43.2s. Estimated remaining: 2h 25m 51s. Rate: 6.8 symbols/min [2025-09-18T20:20:50.924763] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-09-18T20:20:51.085672] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:20:51.085849] [DEBUG] [LOCAL ] MMM: No existing data file found in primary storage. [2025-09-18T20:20:51.085887] [WARN ] [MAIN ] MMM: No existing data found, performing full refresh instead. [2025-09-18T20:20:51.086034] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-09-18T20:20:51.086076] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-09-18T20:20:51.086119] [DEBUG] [LOCAL ] MMM: No primary data file found to delete. [2025-09-18T20:20:51.086151] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-09-18T20:20:51.505901] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:20:51.698487] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-18T20:20:51.701536] [INFO ] [REMOTE ] MMD: Full fetch complete (17972 records). [2025-09-18T20:20:51.701612] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-09-18T20:20:51.724683] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-11. [2025-09-18T20:20:52.081265] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-09-18T20:20:52.081351] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-09-18T20:20:52.081761] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-09-18T20:20:52.081824] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-09-18T20:20:52.082381] [DEBUG] [LOCAL ] MMD: Trimmed 17972 records to 11198 (keeping 200 days of data) [2025-09-18T20:20:52.153104] [DEBUG] [LOCAL ] MMD: Primary data saved (11198 records). [2025-09-18T20:20:52.153246] [INFO ] [MAIN ] MMD: Full history saved. [2025-09-18T20:20:52.153347] [INFO ] [MAIN ] Update Progress: 1375/2372 symbols completed. MMD took 26.2s. Estimated remaining: 2h 25m 36s. Rate: 6.8 symbols/min [2025-09-18T20:20:52.336940] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:20:52.376192] [DEBUG] [LOCAL ] MMS: Loaded 34156 existing records from primary storage. [2025-09-18T20:20:52.376359] [INFO ] [MAIN ] MMS: Loaded 34156 existing records. [2025-09-18T20:20:52.525238] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-18T20:20:52.569152] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:20:52.569503] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-09-18T20:20:52.569566] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-09-18T20:20:52.570744] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-09-18T20:20:52.570820] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-09-18T20:20:52.984307] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:20:53.285049] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-18T20:20:53.319529] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-18T20:20:53.866220] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-18T20:20:54.119571] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-11. [2025-09-18T20:20:54.234309] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-11 (2.51 seconds). [2025-09-18T20:20:54.919590] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-18T20:20:55.399914] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-18T20:20:55.476248] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-18T20:20:55.719574] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-09-18T20:20:56.519553] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-18T20:20:56.999952] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-18T20:20:57.319726] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-09-18T20:20:57.419598] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-18T20:20:58.021870] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-18T20:20:58.119586] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-18T20:20:58.575384] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-18T20:20:58.919556] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-18T20:20:59.288548] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-18T20:20:59.719554] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-09-18T20:21:00.519577] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-18T20:21:00.934174] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-18T20:21:01.319564] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-09-18T20:21:01.846187] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-18T20:21:02.119510] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-09-18T20:21:02.220815] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-18T20:21:02.919567] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-18T20:21:03.307899] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-18T20:21:03.308794] [INFO ] [REMOTE ] MMKT: Full fetch complete (2140 records). [2025-09-18T20:21:03.308872] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-09-18T20:21:03.513222] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-18T20:21:03.513464] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:21:03.513572] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:21:03.513694] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-18T20:21:03.513806] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-18T20:21:03.513922] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-18T20:21:03.513989] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-09-18T20:21:03.514077] [INFO ] [MAIN ] Update Progress: 1376/2372 symbols completed. MMKT took 24.2s. Estimated remaining: 2h 25m 30s. Rate: 6.8 symbols/min [2025-09-18T20:21:03.705698] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:21:03.721674] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-09-18T20:21:03.729349] [DEBUG] [LOCAL ] MMT: Loaded 11445 existing records from primary storage. [2025-09-18T20:21:03.729528] [INFO ] [MAIN ] MMT: Loaded 11445 existing records. [2025-09-18T20:21:03.918632] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:21:03.919203] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-09-18T20:21:03.919326] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-09-18T20:21:03.919926] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-09-18T20:21:03.919991] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-09-18T20:21:04.175790] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-18T20:21:04.361944] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:21:04.519736] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-09-18T20:21:04.861867] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-18T20:21:05.319556] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-09-18T20:21:06.119588] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-09-18T20:21:06.133613] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-18T20:21:06.733522] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-18T20:21:06.919569] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-09-18T20:21:07.563010] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-18T20:21:07.571757] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-18T20:21:07.719543] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-11. [2025-09-18T20:21:08.519573] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-09-18T20:21:08.600548] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-18T20:21:09.319577] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-09-18T20:21:10.119584] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-09-18T20:21:10.145387] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-18T20:21:10.887014] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-18T20:21:10.919506] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-09-18T20:21:11.335916] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-18T20:21:11.559461] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-18T20:21:11.719546] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-09-18T20:21:12.519553] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-09-18T20:21:13.134087] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-18T20:21:13.319549] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-09-18T20:21:14.061023] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-18T20:21:14.119504] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-09-18T20:21:14.401490] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-18T20:21:14.919552] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-09-18T20:21:15.719551] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-09-18T20:21:15.746340] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-18T20:21:16.330204] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-18T20:21:16.362280] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-18T20:21:16.519551] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-09-18T20:21:17.182236] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-18T20:21:17.319550] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-09-18T20:21:18.119545] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-09-18T20:21:18.919554] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-09-18T20:21:18.970766] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-18T20:21:19.690985] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-18T20:21:19.693822] [INFO ] [REMOTE ] MMI: Full fetch complete (20806 records). [2025-09-18T20:21:19.694034] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-09-18T20:21:19.729565] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-09-18T20:21:20.100402] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-09-18T20:21:20.100498] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-09-18T20:21:20.101065] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-09-18T20:21:20.101153] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-09-18T20:21:20.102057] [DEBUG] [LOCAL ] MMI: Trimmed 20806 records to 15493 (keeping 200 days of data) [2025-09-18T20:21:20.213095] [DEBUG] [LOCAL ] MMI: Primary data saved (15493 records). [2025-09-18T20:21:20.213389] [INFO ] [MAIN ] MMI: Full history saved. [2025-09-18T20:21:20.213688] [INFO ] [MAIN ] Update Progress: 1377/2372 symbols completed. MMI took 46.7s. Estimated remaining: 2h 25m 27s. Rate: 6.8 symbols/min [2025-09-18T20:21:20.399713] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:21:20.437927] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-18T20:21:20.461363] [DEBUG] [LOCAL ] MMU: Loaded 16992 existing records from primary storage. [2025-09-18T20:21:20.461498] [INFO ] [MAIN ] MMU: Loaded 16992 existing records. [2025-09-18T20:21:20.531818] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-09-18T20:21:20.658002] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:21:20.658400] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-09-18T20:21:20.658503] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-09-18T20:21:20.659416] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-09-18T20:21:20.659482] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-09-18T20:21:21.019485] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:21:21.085387] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T20:21:21.319556] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-11. [2025-09-18T20:21:22.119542] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-09-18T20:21:22.343776] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-18T20:21:22.525566] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-18T20:21:22.788784] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-18T20:21:22.919510] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-09-18T20:21:23.719605] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-09-18T20:21:23.869632] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-18T20:21:24.519598] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-09-18T20:21:24.957619] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-18T20:21:25.319557] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-09-18T20:21:25.843061] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-18T20:21:25.849874] [INFO ] [REMOTE ] MMM: Full fetch complete (76651 records). [2025-09-18T20:21:25.850010] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-09-18T20:21:25.851099] [FATAL] [VALIDATOR ] MMM: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T20:21:25.851193] [FATAL] [MAIN ] MMM: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:21:25.851237] [WARN ] [MAIN ] MMM: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:21:25.851281] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-09-18T20:21:25.851342] [DEBUG] [LOCAL ] MMM: No primary data file found to delete. [2025-09-18T20:21:25.851392] [INFO ] [LOCAL ] MMM: Starting deletion of derivative data. [2025-09-18T20:21:25.851461] [DEBUG] [LOCAL ] MMM: No derivative data file found to delete. [2025-09-18T20:21:25.851536] [INFO ] [MAIN ] Update Progress: 1378/2372 symbols completed. MMM took 34.9s. Estimated remaining: 2h 25m 15s. Rate: 6.8 symbols/min [2025-09-18T20:21:26.039034] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:21:26.063962] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T20:21:26.094106] [DEBUG] [LOCAL ] MNR: Loaded 24820 existing records from primary storage. [2025-09-18T20:21:26.094246] [INFO ] [MAIN ] MNR: Loaded 24820 existing records. [2025-09-18T20:21:26.124717] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-09-18T20:21:26.289013] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:21:26.289330] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-09-18T20:21:26.289386] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-09-18T20:21:26.290200] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-09-18T20:21:26.290262] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-09-18T20:21:26.643673] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:21:26.919531] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-11. [2025-09-18T20:21:27.038941] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-18T20:21:27.719578] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-09-18T20:21:27.978212] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-18T20:21:28.519553] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-09-18T20:21:28.931323] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T20:21:29.203054] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-18T20:21:29.319567] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-09-18T20:21:30.119619] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-09-18T20:21:30.322673] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-18T20:21:30.919564] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-09-18T20:21:31.150946] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-18T20:21:31.719705] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-09-18T20:21:31.769902] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-18T20:21:32.519552] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-09-18T20:21:32.666959] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-18T20:21:33.319613] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-09-18T20:21:33.661799] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-18T20:21:33.826696] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-18T20:21:33.829585] [INFO ] [REMOTE ] MMT: Full fetch complete (16602 records). [2025-09-18T20:21:33.829777] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-09-18T20:21:34.129414] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-09-18T20:21:34.362327] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-09-18T20:21:34.362440] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-09-18T20:21:34.362880] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-09-18T20:21:34.362943] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-09-18T20:21:34.363805] [DEBUG] [LOCAL ] MMT: Trimmed 16602 records to 11565 (keeping 200 days of data) [2025-09-18T20:21:34.440994] [DEBUG] [LOCAL ] MMT: Primary data saved (11565 records). [2025-09-18T20:21:34.441147] [INFO ] [MAIN ] MMT: Full history saved. [2025-09-18T20:21:34.441284] [INFO ] [MAIN ] Update Progress: 1379/2372 symbols completed. MMT took 30.9s. Estimated remaining: 2h 25m 7s. Rate: 6.8 symbols/min [2025-09-18T20:21:34.622877] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:21:34.688954] [DEBUG] [LOCAL ] MNSO: Loaded 44426 existing records from primary storage. [2025-09-18T20:21:34.689138] [INFO ] [MAIN ] MNSO: Loaded 44426 existing records. [2025-09-18T20:21:34.876314] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:21:34.876570] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-09-18T20:21:34.876619] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-09-18T20:21:34.878249] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-09-18T20:21:34.878328] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-09-18T20:21:34.924684] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-09-18T20:21:35.283875] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-18T20:21:35.289817] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:21:35.719572] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-09-18T20:21:36.519616] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-09-18T20:21:36.521481] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-18T20:21:36.681395] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-18T20:21:37.314813] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-18T20:21:37.319520] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-09-18T20:21:38.119519] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-11. [2025-09-18T20:21:38.483240] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-18T20:21:38.919542] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-09-18T20:21:39.724741] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-09-18T20:21:39.740555] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-18T20:21:39.795217] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-18T20:21:40.519551] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-09-18T20:21:41.314684] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T20:21:41.322161] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-09-18T20:21:41.477039] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-18T20:21:41.481538] [INFO ] [REMOTE ] MMU: Full fetch complete (25789 records). [2025-09-18T20:21:41.481803] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-09-18T20:21:41.857280] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-09-18T20:21:41.857551] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-09-18T20:21:41.858215] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-09-18T20:21:41.858278] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-09-18T20:21:41.858981] [DEBUG] [LOCAL ] MMU: Trimmed 25789 records to 17176 (keeping 200 days of data) [2025-09-18T20:21:41.961891] [DEBUG] [LOCAL ] MMU: Primary data saved (17176 records). [2025-09-18T20:21:41.962047] [INFO ] [MAIN ] MMU: Full history saved. [2025-09-18T20:21:41.962158] [INFO ] [MAIN ] Update Progress: 1380/2372 symbols completed. MMU took 21.7s. Estimated remaining: 2h 24m 57s. Rate: 6.8 symbols/min [2025-09-18T20:21:42.126678] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-09-18T20:21:42.147264] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:21:42.147562] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-09-18T20:21:42.147623] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-09-18T20:21:42.147816] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-09-18T20:21:42.147859] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-18T20:21:42.147902] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-18T20:21:42.147935] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-09-18T20:21:42.547136] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:21:42.568720] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T20:21:42.919562] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-11. [2025-09-18T20:21:43.284898] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2024-11 (0.37 seconds). [2025-09-18T20:21:43.719524] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-09-18T20:21:44.089405] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-18T20:21:44.519568] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-09-18T20:21:45.165736] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T20:21:45.171611] [INFO ] [REMOTE ] MMS: Full fetch complete (52373 records). [2025-09-18T20:21:45.171757] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-09-18T20:21:45.323446] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-09-18T20:21:45.596188] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-09-18T20:21:45.596299] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-09-18T20:21:45.597320] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-09-18T20:21:45.597436] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-09-18T20:21:45.606171] [DEBUG] [LOCAL ] MMS: Trimmed 52373 records to 34432 (keeping 200 days of data) [2025-09-18T20:21:45.614234] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-18T20:21:45.857012] [DEBUG] [LOCAL ] MMS: Primary data saved (34432 records). [2025-09-18T20:21:45.857172] [INFO ] [MAIN ] MMS: Full history saved. [2025-09-18T20:21:45.857296] [INFO ] [MAIN ] Update Progress: 1381/2372 symbols completed. MMS took 53.7s. Estimated remaining: 2h 24m 45s. Rate: 6.8 symbols/min [2025-09-18T20:21:46.058182] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:21:46.058440] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-09-18T20:21:46.058510] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-09-18T20:21:46.058789] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-18T20:21:46.058868] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-18T20:21:46.058964] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-18T20:21:46.059038] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-18T20:21:46.131490] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-09-18T20:21:46.450633] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:21:46.919594] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-11. [2025-09-18T20:21:47.064690] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-18T20:21:47.195902] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-18T20:21:47.719567] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-09-18T20:21:48.519552] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-09-18T20:21:48.978376] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:21:48.978769] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-09-18T20:21:49.026153] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-11 (2.11 seconds). [2025-09-18T20:21:49.051788] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T20:21:49.319569] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-09-18T20:21:50.119551] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-09-18T20:21:50.919564] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-01. [2025-09-18T20:21:51.160942] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-18T20:21:51.217415] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:21:51.217763] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-01 [2025-09-18T20:21:51.719572] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-09-18T20:21:51.767440] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-18T20:21:52.519697] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-09-18T20:21:53.319533] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-09-18T20:21:53.410316] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-18T20:21:54.119561] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-09-18T20:21:54.645234] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-18T20:21:54.763490] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-18T20:21:54.919582] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-02. [2025-09-18T20:21:55.163952] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:21:55.164300] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-02 [2025-09-18T20:21:55.725219] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-18T20:21:55.729100] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T20:21:56.519551] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-09-18T20:21:57.319568] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-03. [2025-09-18T20:21:57.628785] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:21:57.629109] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-03 [2025-09-18T20:21:57.782913] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-18T20:21:57.958394] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-18T20:21:58.119522] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-18T20:21:58.919581] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-09-18T20:21:59.719604] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-04. [2025-09-18T20:21:59.976863] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-18T20:21:59.980459] [INFO ] [REMOTE ] MNR: Full fetch complete (37108 records). [2025-09-18T20:21:59.980554] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-09-18T20:22:00.027632] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:22:00.067663] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-04 [2025-09-18T20:22:00.377512] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-09-18T20:22:00.377620] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-09-18T20:22:00.378541] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-09-18T20:22:00.378719] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-09-18T20:22:00.379921] [DEBUG] [LOCAL ] MNR: Trimmed 37108 records to 25053 (keeping 200 days of data) [2025-09-18T20:22:00.511297] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-18T20:22:00.522664] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-05. [2025-09-18T20:22:00.584960] [DEBUG] [LOCAL ] MNR: Primary data saved (25053 records). [2025-09-18T20:22:00.585089] [INFO ] [MAIN ] MNR: Full history saved. [2025-09-18T20:22:00.585175] [INFO ] [MAIN ] Update Progress: 1382/2372 symbols completed. MNR took 34.7s. Estimated remaining: 2h 24m 40s. Rate: 6.8 symbols/min [2025-09-18T20:22:00.761567] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:22:00.761821] [DEBUG] [LOCAL ] MOD: No existing data file found in primary storage. [2025-09-18T20:22:00.761881] [WARN ] [MAIN ] MOD: No existing data found, performing full refresh instead. [2025-09-18T20:22:00.762053] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-09-18T20:22:00.762111] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-09-18T20:22:00.762186] [DEBUG] [LOCAL ] MOD: No primary data file found to delete. [2025-09-18T20:22:00.762240] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-09-18T20:22:01.150592] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:22:01.325838] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-11. [2025-09-18T20:22:01.327713] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-18T20:22:02.119609] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-09-18T20:22:02.929728] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-06. [2025-09-18T20:22:02.932179] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-18T20:22:03.719530] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-09-18T20:22:03.994482] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-18T20:22:04.144449] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-18T20:22:04.519541] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-18T20:22:05.086723] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-18T20:22:05.319545] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-09-18T20:22:06.119635] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-09-18T20:22:06.611448] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-18T20:22:06.757430] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-18T20:22:06.919553] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-09-18T20:22:07.719560] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-07. [2025-09-18T20:22:07.962571] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-18T20:22:08.407517] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T20:22:08.519517] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-09-18T20:22:09.204241] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T20:22:09.319559] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-08. [2025-09-18T20:22:10.119605] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-09-18T20:22:10.396073] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-18T20:22:10.800752] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-18T20:22:10.919548] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-18T20:22:11.560381] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T20:22:11.719547] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-09. [2025-09-18T20:22:12.519585] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-09-18T20:22:13.127223] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-18T20:22:13.191170] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-18T20:22:13.196937] [INFO ] [REMOTE ] MNTN: Full fetch complete (23816 records). [2025-09-18T20:22:13.197019] [DEBUG] [VALIDATOR ] MNTN: Validating primary data. [2025-09-18T20:22:13.324704] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-18T20:22:13.394251] [WARN ] [VALIDATOR ] MNTN: Validation failed - insufficient historical data. Have 82 unique days, need 200 days [2025-09-18T20:22:13.394700] [FATAL] [MAIN ] MNTN: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:22:13.394775] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:22:13.394854] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-18T20:22:13.394931] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-18T20:22:13.394971] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-18T20:22:13.395038] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-09-18T20:22:13.395157] [INFO ] [MAIN ] Update Progress: 1383/2372 symbols completed. MNTN took 31.4s. Estimated remaining: 2h 24m 34s. Rate: 6.8 symbols/min [2025-09-18T20:22:13.572135] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:22:13.630832] [DEBUG] [LOCAL ] MODG: Loaded 51616 existing records from primary storage. [2025-09-18T20:22:13.630979] [INFO ] [MAIN ] MODG: Loaded 51616 existing records. [2025-09-18T20:22:13.820811] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:22:13.821141] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-09-18T20:22:13.821290] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-09-18T20:22:13.822880] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-09-18T20:22:13.822948] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-09-18T20:22:14.068136] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-18T20:22:14.123172] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-09-18T20:22:14.237745] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:22:14.919542] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-09-18T20:22:15.477760] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-18T20:22:15.719566] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-18T20:22:15.761161] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T20:22:16.435391] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-18T20:22:16.519515] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-09-18T20:22:17.319556] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-09-18T20:22:18.082548] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-18T20:22:18.119504] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-11. [2025-09-18T20:22:18.338310] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-18T20:22:18.692453] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-18T20:22:18.699549] [INFO ] [REMOTE ] MNSO: Full fetch complete (64321 records). [2025-09-18T20:22:18.699711] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-09-18T20:22:18.924696] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-09-18T20:22:19.121094] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-09-18T20:22:19.121181] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-09-18T20:22:19.122069] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-09-18T20:22:19.122132] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-09-18T20:22:19.123563] [DEBUG] [LOCAL ] MNSO: Trimmed 64321 records to 44793 (keeping 200 days of data) [2025-09-18T20:22:19.413692] [DEBUG] [LOCAL ] MNSO: Primary data saved (44793 records). [2025-09-18T20:22:19.413835] [INFO ] [MAIN ] MNSO: Full history saved. [2025-09-18T20:22:19.415088] [INFO ] [MAIN ] Update Progress: 1384/2372 symbols completed. MNSO took 45.0s. Estimated remaining: 2h 24m 24s. Rate: 6.8 symbols/min [2025-09-18T20:22:19.597242] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:22:19.645370] [DEBUG] [LOCAL ] MOH: Loaded 41783 existing records from primary storage. [2025-09-18T20:22:19.645507] [INFO ] [MAIN ] MOH: Loaded 41783 existing records. [2025-09-18T20:22:19.724612] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-18T20:22:19.830036] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:22:19.830313] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-09-18T20:22:19.830450] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-09-18T20:22:19.831802] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-09-18T20:22:19.831866] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-09-18T20:22:20.210538] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:22:20.243754] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-11 (2.12 seconds). [2025-09-18T20:22:20.519543] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-11. [2025-09-18T20:22:20.734961] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-18T20:22:21.319749] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-09-18T20:22:21.820164] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-18T20:22:21.882088] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-18T20:22:22.119569] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-18T20:22:22.569013] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-18T20:22:22.576255] [INFO ] [REMOTE ] MO: Full fetch complete (77434 records). [2025-09-18T20:22:22.576415] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-09-18T20:22:22.577221] [FATAL] [VALIDATOR ] MO: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T20:22:22.577314] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:22:22.577358] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:22:22.577398] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-18T20:22:22.577460] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-18T20:22:22.577497] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-09-18T20:22:22.577560] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-09-18T20:22:22.577671] [INFO ] [MAIN ] Update Progress: 1385/2372 symbols completed. MO took 36.7s. Estimated remaining: 2h 24m 11s. Rate: 6.8 symbols/min [2025-09-18T20:22:22.754467] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:22:22.810806] [DEBUG] [LOCAL ] MOS: Loaded 53521 existing records from primary storage. [2025-09-18T20:22:22.810951] [INFO ] [MAIN ] MOS: Loaded 53521 existing records. [2025-09-18T20:22:22.924682] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-09-18T20:22:23.001883] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:22:23.002123] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-09-18T20:22:23.002172] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-09-18T20:22:23.003799] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-09-18T20:22:23.003895] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-09-18T20:22:23.377193] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:22:23.415803] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-18T20:22:23.719581] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-09-18T20:22:24.519609] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-09-18T20:22:24.664543] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-18T20:22:25.044006] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-18T20:22:25.319599] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-11. [2025-09-18T20:22:26.052127] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-18T20:22:26.119598] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-09-18T20:22:26.636198] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-18T20:22:26.645670] [INFO ] [REMOTE ] MOD: Full fetch complete (65642 records). [2025-09-18T20:22:26.645896] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-09-18T20:22:26.647111] [FATAL] [VALIDATOR ] MOD: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T20:22:26.647267] [FATAL] [MAIN ] MOD: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:22:26.647331] [WARN ] [MAIN ] MOD: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:22:26.647394] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-09-18T20:22:26.647498] [DEBUG] [LOCAL ] MOD: No primary data file found to delete. [2025-09-18T20:22:26.647574] [INFO ] [LOCAL ] MOD: Starting deletion of derivative data. [2025-09-18T20:22:26.647667] [DEBUG] [LOCAL ] MOD: No derivative data file found to delete. [2025-09-18T20:22:26.647781] [INFO ] [MAIN ] Update Progress: 1386/2372 symbols completed. MOD took 26.1s. Estimated remaining: 2h 23m 59s. Rate: 6.8 symbols/min [2025-09-18T20:22:26.922383] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:22:26.920077] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-09-18T20:22:26.988161] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-18T20:22:27.014751] [DEBUG] [LOCAL ] MOV: Loaded 22362 existing records from primary storage. [2025-09-18T20:22:27.014943] [INFO ] [MAIN ] MOV: Loaded 22362 existing records. [2025-09-18T20:22:27.232699] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:22:27.232992] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-09-18T20:22:27.233055] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-09-18T20:22:27.233936] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-09-18T20:22:27.234002] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-09-18T20:22:27.633198] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:22:27.719556] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-09-18T20:22:28.510533] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-18T20:22:28.519481] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-09-18T20:22:29.297990] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-18T20:22:29.319487] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-09-18T20:22:30.119550] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-09-18T20:22:30.250972] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-18T20:22:30.904268] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T20:22:30.919672] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-09-18T20:22:31.722869] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-09-18T20:22:31.729142] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T20:22:32.314231] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-18T20:22:32.519585] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-09-18T20:22:33.137716] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-18T20:22:33.319607] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-09-18T20:22:34.119600] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-11. [2025-09-18T20:22:34.696958] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-18T20:22:34.739726] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T20:22:34.919552] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-09-18T20:22:35.126627] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T20:22:35.719585] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-09-18T20:22:36.527986] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-09-18T20:22:36.533781] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-18T20:22:37.191484] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-18T20:22:37.319566] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-09-18T20:22:38.126597] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-09-18T20:22:38.129288] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-18T20:22:38.919615] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-09-18T20:22:39.036150] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-18T20:22:39.590199] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T20:22:39.719520] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-09-18T20:22:40.236387] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-18T20:22:40.519562] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-09-18T20:22:41.319589] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-09-18T20:22:41.556625] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-18T20:22:41.610230] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-18T20:22:42.119554] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-09-18T20:22:42.222237] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-18T20:22:42.919555] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-09-18T20:22:43.719516] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-09-18T20:22:43.966239] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-18T20:22:44.036137] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-18T20:22:44.519686] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-09-18T20:22:45.319541] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-09-18T20:22:45.394267] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-18T20:22:46.119540] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-09-18T20:22:46.398228] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-18T20:22:46.448358] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-18T20:22:46.919541] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-09-18T20:22:47.719575] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-09-18T20:22:47.928131] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-18T20:22:48.519525] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-09-18T20:22:48.610898] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-18T20:22:49.319548] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-09-18T20:22:49.698247] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-18T20:22:49.705040] [INFO ] [REMOTE ] MOH: Full fetch complete (57912 records). [2025-09-18T20:22:49.705183] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-09-18T20:22:50.115676] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-09-18T20:22:50.115875] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-09-18T20:22:50.117012] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-09-18T20:22:50.117094] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-09-18T20:22:50.136389] [DEBUG] [LOCAL ] MOH: Trimmed 57912 records to 42076 (keeping 200 days of data) [2025-09-18T20:22:50.136231] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-09-18T20:22:50.139498] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-18T20:22:50.417120] [DEBUG] [LOCAL ] MOH: Primary data saved (42076 records). [2025-09-18T20:22:50.417258] [INFO ] [MAIN ] MOH: Full history saved. [2025-09-18T20:22:50.418082] [INFO ] [MAIN ] Update Progress: 1387/2372 symbols completed. MOH took 31.0s. Estimated remaining: 2h 24m 1s. Rate: 6.8 symbols/min [2025-09-18T20:22:50.592216] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:22:50.592423] [DEBUG] [LOCAL ] MP: No existing data file found in primary storage. [2025-09-18T20:22:50.592468] [WARN ] [MAIN ] MP: No existing data found, performing full refresh instead. [2025-09-18T20:22:50.592626] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-09-18T20:22:50.592706] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-09-18T20:22:50.592807] [DEBUG] [LOCAL ] MP: No primary data file found to delete. [2025-09-18T20:22:50.592846] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-09-18T20:22:50.941028] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-09-18T20:22:50.975052] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:22:51.026543] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-18T20:22:51.719566] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-09-18T20:22:52.003430] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-18T20:22:52.095098] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-18T20:22:52.519582] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-11. [2025-09-18T20:22:53.198079] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-18T20:22:53.207402] [INFO ] [REMOTE ] MOS: Full fetch complete (77310 records). [2025-09-18T20:22:53.207560] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-09-18T20:22:53.324629] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-09-18T20:22:53.622142] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-09-18T20:22:53.622241] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-09-18T20:22:53.623256] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-09-18T20:22:53.623333] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-09-18T20:22:53.625171] [DEBUG] [LOCAL ] MOS: Trimmed 77310 records to 53909 (keeping 200 days of data) [2025-09-18T20:22:53.968772] [DEBUG] [LOCAL ] MOS: Primary data saved (53909 records). [2025-09-18T20:22:53.968931] [INFO ] [MAIN ] MOS: Full history saved. [2025-09-18T20:22:53.969024] [INFO ] [MAIN ] Update Progress: 1388/2372 symbols completed. MOS took 31.4s. Estimated remaining: 2h 23m 48s. Rate: 6.8 symbols/min [2025-09-18T20:22:54.127542] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-09-18T20:22:54.147384] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:22:54.157578] [DEBUG] [LOCAL ] MPA: Loaded 5255 existing records from primary storage. [2025-09-18T20:22:54.157792] [INFO ] [MAIN ] MPA: Loaded 5255 existing records. [2025-09-18T20:22:54.306607] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-18T20:22:54.394178] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:22:54.394514] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-09-18T20:22:54.394583] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-09-18T20:22:54.395027] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-09-18T20:22:54.395087] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-09-18T20:22:54.761145] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:22:54.919507] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-11. [2025-09-18T20:22:55.312032] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-18T20:22:55.339472] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-18T20:22:55.363353] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T20:22:55.719587] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-09-18T20:22:56.519548] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-09-18T20:22:56.557586] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-18T20:22:57.319573] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-09-18T20:22:58.119526] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-09-18T20:22:58.334239] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-18T20:22:58.733134] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-18T20:22:58.919529] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-09-18T20:22:59.597203] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-18T20:22:59.719591] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-09-18T20:23:00.519593] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-09-18T20:23:01.319555] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-09-18T20:23:01.835672] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-18T20:23:02.119612] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-09-18T20:23:03.024078] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-18T20:23:03.034598] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-09-18T20:23:03.366825] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-18T20:23:03.374025] [INFO ] [REMOTE ] MODG: Full fetch complete (74603 records). [2025-09-18T20:23:03.374163] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-09-18T20:23:03.790115] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-09-18T20:23:03.790212] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-09-18T20:23:03.791515] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-09-18T20:23:03.791584] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-09-18T20:23:03.793387] [DEBUG] [LOCAL ] MODG: Trimmed 74603 records to 52004 (keeping 200 days of data) [2025-09-18T20:23:04.017103] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (3.50 seconds). [2025-09-18T20:23:04.020100] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-09-18T20:23:04.128899] [DEBUG] [LOCAL ] MODG: Primary data saved (52004 records). [2025-09-18T20:23:04.129068] [INFO ] [MAIN ] MODG: Full history saved. [2025-09-18T20:23:04.129165] [INFO ] [MAIN ] Update Progress: 1389/2372 symbols completed. MODG took 50.7s. Estimated remaining: 2h 23m 40s. Rate: 6.8 symbols/min [2025-09-18T20:23:04.309588] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:23:04.360467] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (7.04 seconds). [2025-09-18T20:23:04.385032] [DEBUG] [LOCAL ] MPC: Loaded 52150 existing records from primary storage. [2025-09-18T20:23:04.385197] [INFO ] [MAIN ] MPC: Loaded 52150 existing records. [2025-09-18T20:23:04.529124] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-09-18T20:23:04.577978] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:23:04.578227] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-09-18T20:23:04.578277] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-09-18T20:23:04.579864] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-09-18T20:23:04.579928] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-09-18T20:23:04.722575] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-18T20:23:05.038164] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:23:05.093514] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-18T20:23:05.319596] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-09-18T20:23:05.616739] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-18T20:23:05.620559] [INFO ] [REMOTE ] MOV: Full fetch complete (30674 records). [2025-09-18T20:23:05.620745] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-09-18T20:23:05.928950] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-18T20:23:06.033797] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-09-18T20:23:06.033924] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-09-18T20:23:06.034724] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-09-18T20:23:06.034790] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-09-18T20:23:06.035664] [DEBUG] [LOCAL ] MOV: Trimmed 30674 records to 22496 (keeping 200 days of data) [2025-09-18T20:23:06.127558] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-11. [2025-09-18T20:23:06.181601] [DEBUG] [LOCAL ] MOV: Primary data saved (22496 records). [2025-09-18T20:23:06.181770] [INFO ] [MAIN ] MOV: Full history saved. [2025-09-18T20:23:06.181867] [INFO ] [MAIN ] Update Progress: 1390/2372 symbols completed. MOV took 39.5s. Estimated remaining: 2h 23m 27s. Rate: 6.8 symbols/min [2025-09-18T20:23:06.362753] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:23:06.421788] [DEBUG] [LOCAL ] MPLX: Loaded 50795 existing records from primary storage. [2025-09-18T20:23:06.422009] [INFO ] [MAIN ] MPLX: Loaded 50795 existing records. [2025-09-18T20:23:06.631083] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:23:06.631403] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-09-18T20:23:06.631452] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-09-18T20:23:06.632797] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-09-18T20:23:06.632861] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-09-18T20:23:06.924635] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-09-18T20:23:07.045665] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:23:07.634695] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-18T20:23:07.719568] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-09-18T20:23:07.990822] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-18T20:23:08.287968] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-18T20:23:08.519546] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-09-18T20:23:09.319587] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-11. [2025-09-18T20:23:10.092575] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-18T20:23:10.119572] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-09-18T20:23:10.807313] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-18T20:23:10.919556] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-09-18T20:23:11.084742] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-18T20:23:11.408945] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-18T20:23:11.719545] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-09-18T20:23:12.519561] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-09-18T20:23:13.232495] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-18T20:23:13.233823] [INFO ] [REMOTE ] MPA: Full fetch complete (7110 records). [2025-09-18T20:23:13.233928] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-09-18T20:23:13.324694] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-09-18T20:23:13.632958] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-09-18T20:23:13.633104] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-09-18T20:23:13.633350] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-09-18T20:23:13.633426] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-09-18T20:23:13.634362] [DEBUG] [LOCAL ] MPA: Trimmed 7110 records to 5277 (keeping 200 days of data) [2025-09-18T20:23:13.669338] [DEBUG] [LOCAL ] MPA: Primary data saved (5277 records). [2025-09-18T20:23:13.669706] [INFO ] [MAIN ] MPA: Full history saved. [2025-09-18T20:23:13.669829] [INFO ] [MAIN ] Update Progress: 1391/2372 symbols completed. MPA took 19.7s. Estimated remaining: 2h 23m 17s. Rate: 6.8 symbols/min [2025-09-18T20:23:13.845336] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-18T20:23:13.889293] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:23:13.897244] [DEBUG] [LOCAL ] MPV: Loaded 5203 existing records from primary storage. [2025-09-18T20:23:13.897367] [INFO ] [MAIN ] MPV: Loaded 5203 existing records. [2025-09-18T20:23:14.078002] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:23:14.078304] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-09-18T20:23:14.078363] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-09-18T20:23:14.078675] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-09-18T20:23:14.078737] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-09-18T20:23:14.124974] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-09-18T20:23:14.449425] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:23:14.919500] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-09-18T20:23:15.323138] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-18T20:23:15.719528] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-11. [2025-09-18T20:23:15.769086] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-18T20:23:16.358497] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-18T20:23:16.519551] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-09-18T20:23:16.883697] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-18T20:23:17.319586] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-09-18T20:23:17.941454] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-18T20:23:18.085583] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-18T20:23:18.119494] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-09-18T20:23:18.804147] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-18T20:23:18.919525] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-09-18T20:23:19.719613] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-09-18T20:23:19.849876] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-18T20:23:20.519711] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-09-18T20:23:21.319582] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-09-18T20:23:21.715755] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-18T20:23:22.119583] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-09-18T20:23:22.473404] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-18T20:23:22.872804] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-18T20:23:22.919578] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-09-18T20:23:22.994584] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-18T20:23:23.719594] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-09-18T20:23:24.519615] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-09-18T20:23:24.756261] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-18T20:23:25.328882] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-09-18T20:23:25.361735] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T20:23:26.119577] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-09-18T20:23:26.554171] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-18T20:23:26.919532] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-09-18T20:23:27.254367] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-18T20:23:27.459021] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-18T20:23:27.727398] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-09-18T20:23:27.733272] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-18T20:23:28.519568] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-09-18T20:23:29.213151] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-18T20:23:29.319561] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-09-18T20:23:30.119553] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-09-18T20:23:30.335850] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-09-18T20:23:30.635873] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-18T20:23:30.919530] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-09-18T20:23:31.005340] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-18T20:23:31.719592] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-09-18T20:23:32.519562] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-09-18T20:23:33.160356] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-18T20:23:33.268702] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-18T20:23:33.319518] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-09-18T20:23:33.375678] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-18T20:23:34.119591] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-09-18T20:23:34.919594] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-09-18T20:23:35.267664] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-18T20:23:35.470578] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-18T20:23:35.719556] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-09-18T20:23:36.519608] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-09-18T20:23:36.994859] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-18T20:23:37.252205] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T20:23:37.319502] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-09-18T20:23:37.481971] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-18T20:23:37.800604] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-18T20:23:37.802205] [INFO ] [REMOTE ] MPV: Full fetch complete (8046 records). [2025-09-18T20:23:37.802360] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-09-18T20:23:38.124768] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-09-18T20:23:38.194725] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-09-18T20:23:38.194821] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-09-18T20:23:38.195070] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-09-18T20:23:38.195130] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-09-18T20:23:38.195593] [DEBUG] [LOCAL ] MPV: Trimmed 8046 records to 5223 (keeping 200 days of data) [2025-09-18T20:23:38.227317] [DEBUG] [LOCAL ] MPV: Primary data saved (5223 records). [2025-09-18T20:23:38.227436] [INFO ] [MAIN ] MPV: Full history saved. [2025-09-18T20:23:38.227571] [INFO ] [MAIN ] Update Progress: 1392/2372 symbols completed. MPV took 24.6s. Estimated remaining: 2h 23m 20s. Rate: 6.8 symbols/min [2025-09-18T20:23:38.410071] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:23:38.469948] [DEBUG] [LOCAL ] MPW: Loaded 53501 existing records from primary storage. [2025-09-18T20:23:38.470137] [INFO ] [MAIN ] MPW: Loaded 53501 existing records. [2025-09-18T20:23:38.652348] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:23:38.652615] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-09-18T20:23:38.652691] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-09-18T20:23:38.653916] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-09-18T20:23:38.653980] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-09-18T20:23:38.928156] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-09-18T20:23:39.026667] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:23:39.719524] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-09-18T20:23:39.755563] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-18T20:23:39.767471] [INFO ] [REMOTE ] MP: Full fetch complete (76758 records). [2025-09-18T20:23:39.767631] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-09-18T20:23:39.771084] [FATAL] [VALIDATOR ] MP: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T20:23:39.771241] [FATAL] [MAIN ] MP: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:23:39.771308] [WARN ] [MAIN ] MP: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:23:39.771378] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-09-18T20:23:39.771459] [DEBUG] [LOCAL ] MP: No primary data file found to delete. [2025-09-18T20:23:39.771519] [INFO ] [LOCAL ] MP: Starting deletion of derivative data. [2025-09-18T20:23:39.771581] [DEBUG] [LOCAL ] MP: No derivative data file found to delete. [2025-09-18T20:23:39.771720] [INFO ] [MAIN ] Update Progress: 1393/2372 symbols completed. MP took 49.4s. Estimated remaining: 2h 23m 6s. Rate: 6.8 symbols/min [2025-09-18T20:23:39.961495] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:23:40.001566] [DEBUG] [LOCAL ] MPX: Loaded 4290 existing records from primary storage. [2025-09-18T20:23:40.004846] [INFO ] [MAIN ] MPX: Loaded 4290 existing records. [2025-09-18T20:23:40.087010] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-18T20:23:40.212748] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:23:40.213087] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-09-18T20:23:40.213161] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-09-18T20:23:40.213456] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-09-18T20:23:40.213533] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-09-18T20:23:40.524727] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-09-18T20:23:40.587094] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:23:41.319525] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-11. [2025-09-18T20:23:41.398554] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-18T20:23:42.061130] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-18T20:23:42.069384] [INFO ] [REMOTE ] MPLX: Full fetch complete (73843 records). [2025-09-18T20:23:42.069561] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-09-18T20:23:42.126803] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-11. [2025-09-18T20:23:42.483531] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-09-18T20:23:42.483669] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-09-18T20:23:42.485466] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-09-18T20:23:42.485573] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-09-18T20:23:42.491861] [DEBUG] [LOCAL ] MPLX: Trimmed 73843 records to 51168 (keeping 200 days of data) [2025-09-18T20:23:42.736716] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-18T20:23:42.834260] [DEBUG] [LOCAL ] MPLX: Primary data saved (51168 records). [2025-09-18T20:23:42.834459] [INFO ] [MAIN ] MPLX: Full history saved. [2025-09-18T20:23:42.834702] [INFO ] [MAIN ] Update Progress: 1394/2372 symbols completed. MPLX took 36.7s. Estimated remaining: 2h 22m 53s. Rate: 6.8 symbols/min [2025-09-18T20:23:42.926815] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-09-18T20:23:43.026463] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:23:43.037906] [DEBUG] [LOCAL ] MQT: Loaded 8445 existing records from primary storage. [2025-09-18T20:23:43.038049] [INFO ] [MAIN ] MQT: Loaded 8445 existing records. [2025-09-18T20:23:43.276865] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:23:43.281392] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-09-18T20:23:43.281134] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-11 (1.96 seconds). [2025-09-18T20:23:43.297936] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-09-18T20:23:43.298426] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-09-18T20:23:43.298499] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-09-18T20:23:43.584584] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-18T20:23:43.697719] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:23:43.719499] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-11. [2025-09-18T20:23:44.519583] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-09-18T20:23:44.606401] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-18T20:23:45.319613] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-09-18T20:23:46.119588] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-09-18T20:23:46.143231] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-18T20:23:46.397458] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-18T20:23:46.919587] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-09-18T20:23:47.559934] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-18T20:23:47.567306] [INFO ] [REMOTE ] MPC: Full fetch complete (75740 records). [2025-09-18T20:23:47.567436] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-09-18T20:23:47.747746] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-09-18T20:23:47.981119] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-09-18T20:23:47.981215] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-09-18T20:23:47.982223] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-09-18T20:23:47.982298] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-09-18T20:23:47.984523] [DEBUG] [LOCAL ] MPC: Trimmed 75740 records to 52530 (keeping 200 days of data) [2025-09-18T20:23:48.343306] [DEBUG] [LOCAL ] MPC: Primary data saved (52530 records). [2025-09-18T20:23:48.343595] [INFO ] [MAIN ] MPC: Full history saved. [2025-09-18T20:23:48.343783] [INFO ] [MAIN ] Update Progress: 1395/2372 symbols completed. MPC took 44.2s. Estimated remaining: 2h 22m 42s. Rate: 6.8 symbols/min [2025-09-18T20:23:48.468045] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-18T20:23:48.525561] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-09-18T20:23:48.529186] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:23:48.551679] [DEBUG] [LOCAL ] MQY: Loaded 16811 existing records from primary storage. [2025-09-18T20:23:48.551825] [INFO ] [MAIN ] MQY: Loaded 16811 existing records. [2025-09-18T20:23:48.749905] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:23:48.767549] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-09-18T20:23:48.769285] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-18T20:23:48.768075] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-09-18T20:23:48.779972] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-09-18T20:23:48.780069] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-09-18T20:23:49.154958] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:23:49.319574] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-11. [2025-09-18T20:23:49.462695] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-18T20:23:50.119554] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-09-18T20:23:50.198543] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-18T20:23:50.687259] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-18T20:23:50.919539] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-09-18T20:23:51.719629] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-09-18T20:23:52.170681] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-18T20:23:52.332841] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-18T20:23:52.519603] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-09-18T20:23:53.101630] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-18T20:23:53.319591] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-09-18T20:23:54.119554] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-09-18T20:23:54.919554] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-09-18T20:23:55.225249] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-18T20:23:55.331625] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-18T20:23:55.370371] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-18T20:23:55.719549] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-09-18T20:23:56.519545] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-09-18T20:23:56.545007] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-18T20:23:57.319560] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-09-18T20:23:57.393686] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-18T20:23:58.119623] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-09-18T20:23:58.633958] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-18T20:23:58.919548] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-09-18T20:23:59.322899] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-18T20:23:59.458926] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-18T20:23:59.719554] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-09-18T20:24:00.519514] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-09-18T20:24:00.892551] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-18T20:24:01.018008] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-18T20:24:01.319557] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-09-18T20:24:02.119601] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-09-18T20:24:02.919590] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-09-18T20:24:02.987866] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-18T20:24:03.719625] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-09-18T20:24:03.801665] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-18T20:24:03.803081] [INFO ] [REMOTE ] MPX: Full fetch complete (6855 records). [2025-09-18T20:24:03.803156] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-09-18T20:24:04.189171] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-09-18T20:24:04.189510] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-09-18T20:24:04.189844] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-09-18T20:24:04.189903] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-09-18T20:24:04.190328] [DEBUG] [LOCAL ] MPX: Trimmed 6855 records to 4318 (keeping 200 days of data) [2025-09-18T20:24:04.219984] [DEBUG] [LOCAL ] MPX: Primary data saved (4318 records). [2025-09-18T20:24:04.220103] [INFO ] [MAIN ] MPX: Full history saved. [2025-09-18T20:24:04.220205] [INFO ] [MAIN ] Update Progress: 1396/2372 symbols completed. MPX took 24.4s. Estimated remaining: 2h 22m 38s. Rate: 6.8 symbols/min [2025-09-18T20:24:04.388114] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:24:04.412736] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-18T20:24:04.451318] [DEBUG] [LOCAL ] MRC: Loaded 37525 existing records from primary storage. [2025-09-18T20:24:04.451490] [INFO ] [MAIN ] MRC: Loaded 37525 existing records. [2025-09-18T20:24:04.526611] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-09-18T20:24:04.638845] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:24:04.639295] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-09-18T20:24:04.639371] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-09-18T20:24:04.640473] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-09-18T20:24:04.640537] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-09-18T20:24:05.071998] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:24:05.319518] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-09-18T20:24:05.572038] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-18T20:24:05.596756] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-18T20:24:05.972149] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-18T20:24:06.119545] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-09-18T20:24:06.919551] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-09-18T20:24:07.719512] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-11. [2025-09-18T20:24:08.086939] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-18T20:24:08.307937] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-18T20:24:08.519559] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-09-18T20:24:08.963565] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-18T20:24:09.145511] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-18T20:24:09.319545] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-09-18T20:24:10.119514] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-09-18T20:24:10.287496] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-18T20:24:10.919561] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-09-18T20:24:11.567611] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-18T20:24:11.719539] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-09-18T20:24:12.510351] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T20:24:12.520470] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-09-18T20:24:13.319563] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-09-18T20:24:13.705839] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-18T20:24:14.044288] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-18T20:24:14.119493] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-09-18T20:24:14.919625] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-09-18T20:24:15.314520] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-18T20:24:15.558286] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-18T20:24:15.676905] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-18T20:24:15.719548] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-09-18T20:24:16.519574] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-09-18T20:24:17.324780] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-09-18T20:24:17.340873] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-18T20:24:17.876737] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-18T20:24:18.119592] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-09-18T20:24:18.164444] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T20:24:18.919594] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-09-18T20:24:19.448727] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-18T20:24:19.719610] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-09-18T20:24:20.447410] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-18T20:24:20.450847] [INFO ] [REMOTE ] MQY: Full fetch complete (27261 records). [2025-09-18T20:24:20.450944] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-09-18T20:24:20.528864] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-09-18T20:24:20.846883] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-09-18T20:24:20.847037] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-09-18T20:24:20.847731] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-09-18T20:24:20.847925] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-09-18T20:24:20.849709] [DEBUG] [LOCAL ] MQY: Trimmed 27261 records to 16962 (keeping 200 days of data) [2025-09-18T20:24:20.946711] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-18T20:24:20.976009] [INFO ] [REMOTE ] MPW: Full fetch complete (77439 records). [2025-09-18T20:24:20.982849] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-09-18T20:24:20.985483] [DEBUG] [LOCAL ] MQY: Primary data saved (16962 records). [2025-09-18T20:24:21.063777] [INFO ] [MAIN ] MQY: Full history saved. [2025-09-18T20:24:21.075132] [INFO ] [MAIN ] Update Progress: 1397/2372 symbols completed. MQY took 32.7s. Estimated remaining: 2h 22m 35s. Rate: 6.8 symbols/min [2025-09-18T20:24:21.324821] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-09-18T20:24:21.404896] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-09-18T20:24:21.405004] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-09-18T20:24:21.406215] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-09-18T20:24:21.406299] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-09-18T20:24:21.408283] [DEBUG] [LOCAL ] MPW: Trimmed 77439 records to 53890 (keeping 200 days of data) [2025-09-18T20:24:21.751198] [DEBUG] [LOCAL ] MPW: Primary data saved (53890 records). [2025-09-18T20:24:21.751341] [INFO ] [MAIN ] MPW: Full history saved. [2025-09-18T20:24:21.751428] [INFO ] [MAIN ] Update Progress: 1398/2372 symbols completed. MPW took 43.5s. Estimated remaining: 2h 22m 20s. Rate: 6.8 symbols/min [2025-09-18T20:24:21.801451] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-18T20:24:22.122548] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-09-18T20:24:22.123513] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-18T20:24:22.919586] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-09-18T20:24:23.466194] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-18T20:24:23.468126] [INFO ] [REMOTE ] MQT: Full fetch complete (13335 records). [2025-09-18T20:24:23.468196] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-09-18T20:24:23.878848] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-18T20:24:23.889618] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-09-18T20:24:23.896700] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-09-18T20:24:23.897789] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-09-18T20:24:23.898214] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-09-18T20:24:23.898309] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-09-18T20:24:23.900018] [DEBUG] [LOCAL ] MQT: Trimmed 13335 records to 8507 (keeping 200 days of data) [2025-09-18T20:24:23.954160] [DEBUG] [LOCAL ] MQT: Primary data saved (8507 records). [2025-09-18T20:24:23.954316] [INFO ] [MAIN ] MQT: Full history saved. [2025-09-18T20:24:23.954408] [INFO ] [MAIN ] Update Progress: 1399/2372 symbols completed. MQT took 41.1s. Estimated remaining: 2h 22m 7s. Rate: 6.8 symbols/min [2025-09-18T20:24:25.845578] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-18T20:24:25.855902] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-09-18T20:24:27.006045] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-18T20:24:27.014328] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-09-18T20:24:28.000033] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-18T20:24:28.005014] [INFO ] [REMOTE ] MRC: Full fetch complete (54079 records). [2025-09-18T20:24:28.005130] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-09-18T20:24:28.396469] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-09-18T20:24:28.396564] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-09-18T20:24:28.397500] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-09-18T20:24:28.397569] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-09-18T20:24:28.398869] [DEBUG] [LOCAL ] MRC: Trimmed 54079 records to 37863 (keeping 200 days of data) [2025-09-18T20:24:28.632186] [DEBUG] [LOCAL ] MRC: Primary data saved (37863 records). [2025-09-18T20:24:28.632378] [INFO ] [MAIN ] MRC: Full history saved. [2025-09-18T20:24:28.633360] [INFO ] [MAIN ] Update Progress: 1400/2372 symbols completed. MRC took 24.4s. Estimated remaining: 2h 21m 56s. Rate: 6.8 symbols/min [2025-09-18T20:24:29.198152] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:24:29.293468] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-09-18T20:24:29.369622] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:24:29.365768] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-09-18T20:24:29.370353] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-09-18T20:24:29.390221] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:24:29.391905] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-18T20:24:29.393884] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:24:29.398746] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-18T20:24:29.398887] [DEBUG] [LOCAL ] MRK: No existing data file found in primary storage. [2025-09-18T20:24:29.399064] [WARN ] [MAIN ] MRK: No existing data found, performing full refresh instead. [2025-09-18T20:24:29.399547] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-09-18T20:24:29.405094] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-09-18T20:24:29.414594] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-09-18T20:24:29.450372] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-09-18T20:24:29.450501] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-09-18T20:24:29.696852] [DEBUG] [LOCAL ] MSA: Loaded 18774 existing records from primary storage. [2025-09-18T20:24:29.750338] [INFO ] [MAIN ] MSA: Loaded 18774 existing records. [2025-09-18T20:24:30.080761] [DEBUG] [LOCAL ] MS: Loaded 53696 existing records from primary storage. [2025-09-18T20:24:30.107529] [INFO ] [MAIN ] MS: Loaded 53696 existing records. [2025-09-18T20:24:30.399933] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:24:30.442433] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:24:30.473942] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-11. [2025-09-18T20:24:30.493345] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-09-18T20:24:30.511911] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-09-18T20:24:30.524170] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-09-18T20:24:30.578234] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-09-18T20:24:30.602165] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:24:30.696294] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-11. [2025-09-18T20:24:30.701549] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:24:30.738405] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-09-18T20:24:30.738557] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-09-18T20:24:30.744672] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-09-18T20:24:30.749949] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-09-18T20:24:30.886551] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:24:30.945247] [WARN ] [REMOTE ] MRP: No data returned for month 2024-11 [2025-09-18T20:24:30.961118] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-09-18T20:24:31.361197] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:24:31.390919] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:24:31.454358] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-11. [2025-09-18T20:24:31.453829] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:24:31.455849] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-09-18T20:24:31.456114] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-11. [2025-09-18T20:24:31.456507] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-01. [2025-09-18T20:24:31.714101] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:24:31.714534] [WARN ] [REMOTE ] MRP: No data returned for month 2025-01 [2025-09-18T20:24:31.715114] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-02. [2025-09-18T20:24:32.583100] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-18T20:24:32.589408] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-09-18T20:24:32.695826] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-18T20:24:32.711600] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-09-18T20:24:32.972581] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-18T20:24:33.319565] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-03. [2025-09-18T20:24:33.424899] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T20:24:33.588840] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-11 (2.13 seconds). [2025-09-18T20:24:34.119557] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-09-18T20:24:34.779969] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-18T20:24:34.919535] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-09-18T20:24:35.181199] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-18T20:24:35.719591] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-09-18T20:24:35.833912] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-18T20:24:36.375988] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-18T20:24:36.519568] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-09-18T20:24:37.110812] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-18T20:24:37.319544] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-09-18T20:24:37.331819] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-18T20:24:38.119536] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-09-18T20:24:38.919559] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-09-18T20:24:39.218027] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-18T20:24:39.719608] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-09-18T20:24:39.884468] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-18T20:24:40.400912] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-18T20:24:40.519552] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-09-18T20:24:41.319555] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-04. [2025-09-18T20:24:41.380367] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-18T20:24:42.119590] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-09-18T20:24:42.511073] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-18T20:24:42.589171] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-18T20:24:42.919541] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-09-18T20:24:43.719544] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-09-18T20:24:43.859464] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-18T20:24:44.519552] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-09-18T20:24:44.777211] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-18T20:24:45.319542] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-05. [2025-09-18T20:24:45.366518] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-18T20:24:46.119612] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-09-18T20:24:46.374978] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-18T20:24:46.919595] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-09-18T20:24:47.137168] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-18T20:24:47.719553] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-09-18T20:24:48.270574] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-18T20:24:48.523920] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-06. [2025-09-18T20:24:48.526849] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-18T20:24:48.785137] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-18T20:24:49.319546] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-09-18T20:24:49.875040] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-18T20:24:50.119560] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-09-18T20:24:50.919554] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-07. [2025-09-18T20:24:51.220883] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-18T20:24:51.719590] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-09-18T20:24:52.067428] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-18T20:24:52.298758] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-18T20:24:52.519599] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-09-18T20:24:52.637530] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T20:24:53.319564] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-09-18T20:24:54.119565] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-08. [2025-09-18T20:24:54.637517] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-18T20:24:54.919532] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-09-18T20:24:55.183048] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-18T20:24:55.364374] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T20:24:55.719516] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-09-18T20:24:55.915725] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-18T20:24:56.519580] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-09. [2025-09-18T20:24:57.319568] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-09-18T20:24:57.491966] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-18T20:24:57.594105] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-18T20:24:57.600714] [INFO ] [REMOTE ] MRP: Full fetch complete (53192 records). [2025-09-18T20:24:57.600830] [DEBUG] [VALIDATOR ] MRP: Validating primary data. [2025-09-18T20:24:57.794548] [WARN ] [VALIDATOR ] MRP: Validation failed - insufficient historical data. Have 154 unique days, need 200 days [2025-09-18T20:24:57.795162] [FATAL] [MAIN ] MRP: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:24:57.795235] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:24:57.795310] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-18T20:24:57.795380] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-18T20:24:57.795418] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-09-18T20:24:57.795476] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-09-18T20:24:57.795566] [INFO ] [MAIN ] Update Progress: 1401/2372 symbols completed. MRP took 29.2s. Estimated remaining: 2h 22m 1s. Rate: 6.8 symbols/min [2025-09-18T20:24:57.970061] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:24:57.980024] [DEBUG] [LOCAL ] MSB: Loaded 7917 existing records from primary storage. [2025-09-18T20:24:57.980145] [INFO ] [MAIN ] MSB: Loaded 7917 existing records. [2025-09-18T20:24:58.130110] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-09-18T20:24:58.172806] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:24:58.173028] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-09-18T20:24:58.173076] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-09-18T20:24:58.173470] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-09-18T20:24:58.173532] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-09-18T20:24:58.548013] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:24:58.560203] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T20:24:58.919589] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-09-18T20:24:59.667018] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-18T20:24:59.670168] [INFO ] [REMOTE ] MSA: Full fetch complete (25499 records). [2025-09-18T20:24:59.670267] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-09-18T20:24:59.724736] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-09-18T20:25:00.075250] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-09-18T20:25:00.075375] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-09-18T20:25:00.075998] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-09-18T20:25:00.076136] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-09-18T20:25:00.077325] [DEBUG] [LOCAL ] MSA: Trimmed 25499 records to 18855 (keeping 200 days of data) [2025-09-18T20:25:00.187792] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-18T20:25:00.198364] [INFO ] [REMOTE ] MS: Full fetch complete (77581 records). [2025-09-18T20:25:00.198987] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-09-18T20:25:00.490039] [DEBUG] [LOCAL ] MSA: Primary data saved (18855 records). [2025-09-18T20:25:00.512070] [INFO ] [MAIN ] MSA: Full history saved. [2025-09-18T20:25:00.517815] [INFO ] [MAIN ] Update Progress: 1402/2372 symbols completed. MSA took 31.9s. Estimated remaining: 2h 21m 48s. Rate: 6.8 symbols/min [2025-09-18T20:25:00.524140] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-11. [2025-09-18T20:25:00.839590] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-09-18T20:25:00.839423] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:25:00.839835] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-09-18T20:25:00.839790] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-09-18T20:25:00.839940] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-09-18T20:25:00.840942] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-09-18T20:25:00.841192] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-09-18T20:25:00.841315] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-18T20:25:00.841260] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-09-18T20:25:00.841434] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-18T20:25:00.841600] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-09-18T20:25:00.954406] [DEBUG] [LOCAL ] MS: Trimmed 77581 records to 54082 (keeping 200 days of data) [2025-09-18T20:25:01.260033] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-18T20:25:01.324179] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-09-18T20:25:01.366261] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:25:01.602942] [DEBUG] [LOCAL ] MS: Primary data saved (54082 records). [2025-09-18T20:25:01.603150] [INFO ] [MAIN ] MS: Full history saved. [2025-09-18T20:25:01.603272] [INFO ] [MAIN ] Update Progress: 1403/2372 symbols completed. MS took 33.0s. Estimated remaining: 2h 21m 34s. Rate: 6.8 symbols/min [2025-09-18T20:25:01.780805] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:25:01.821673] [DEBUG] [LOCAL ] MSCI: Loaded 34787 existing records from primary storage. [2025-09-18T20:25:01.821860] [INFO ] [MAIN ] MSCI: Loaded 34787 existing records. [2025-09-18T20:25:02.011518] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:25:02.012446] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-09-18T20:25:02.012502] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-09-18T20:25:02.013916] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-09-18T20:25:02.013981] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-09-18T20:25:02.151132] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-11. [2025-09-18T20:25:02.185352] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-18T20:25:02.439597] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:25:02.472865] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-18T20:25:02.747770] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-18T20:25:02.919527] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-09-18T20:25:03.417250] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-18T20:25:03.719540] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-09-18T20:25:04.510247] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-18T20:25:04.517558] [INFO ] [REMOTE ] MRK: Full fetch complete (77377 records). [2025-09-18T20:25:04.517774] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-09-18T20:25:04.518705] [FATAL] [VALIDATOR ] MRK: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T20:25:04.518806] [FATAL] [MAIN ] MRK: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:25:04.518878] [WARN ] [MAIN ] MRK: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:25:04.518957] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-09-18T20:25:04.519027] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-09-18T20:25:04.519065] [INFO ] [LOCAL ] MRK: Starting deletion of derivative data. [2025-09-18T20:25:04.519111] [DEBUG] [LOCAL ] MRK: No derivative data file found to delete. [2025-09-18T20:25:04.519173] [INFO ] [MAIN ] Update Progress: 1404/2372 symbols completed. MRK took 35.9s. Estimated remaining: 2h 21m 21s. Rate: 6.8 symbols/min [2025-09-18T20:25:04.524755] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-09-18T20:25:04.698355] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:25:04.719362] [DEBUG] [LOCAL ] MSD: Loaded 15677 existing records from primary storage. [2025-09-18T20:25:04.719531] [INFO ] [MAIN ] MSD: Loaded 15677 existing records. [2025-09-18T20:25:04.902307] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:25:04.902584] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-09-18T20:25:04.902664] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-09-18T20:25:04.903367] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-09-18T20:25:04.903428] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-09-18T20:25:05.179780] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-18T20:25:05.304120] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:25:05.319491] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-11. [2025-09-18T20:25:06.104221] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-18T20:25:06.119492] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-09-18T20:25:06.919565] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-09-18T20:25:07.094970] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-18T20:25:07.638395] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-18T20:25:07.719564] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-11. [2025-09-18T20:25:08.519549] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-09-18T20:25:09.301552] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-18T20:25:09.323540] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-18T20:25:09.328364] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-18T20:25:09.980067] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-18T20:25:10.119535] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-09-18T20:25:10.919548] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-18T20:25:11.253443] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-18T20:25:11.293447] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-18T20:25:11.719561] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-18T20:25:12.046181] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-18T20:25:12.519587] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-09-18T20:25:13.319553] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-09-18T20:25:13.847425] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-18T20:25:14.119535] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-18T20:25:14.346571] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-18T20:25:14.510610] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-18T20:25:14.919557] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-09-18T20:25:15.690175] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-18T20:25:15.719488] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-09-18T20:25:16.405073] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-18T20:25:16.519525] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-09-18T20:25:17.319587] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-09-18T20:25:17.427716] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-18T20:25:18.119552] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-09-18T20:25:18.142178] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-18T20:25:18.919572] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-09-18T20:25:19.719607] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-09-18T20:25:19.957230] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-18T20:25:19.996009] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-18T20:25:20.242796] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-18T20:25:20.519559] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-09-18T20:25:21.319691] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-18T20:25:21.412208] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T20:25:21.650129] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-18T20:25:22.119553] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-18T20:25:22.466592] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-18T20:25:22.919560] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-09-18T20:25:23.719608] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-09-18T20:25:24.493699] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-18T20:25:24.529756] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-18T20:25:24.536410] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-18T20:25:24.957374] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-18T20:25:25.319637] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-18T20:25:25.785879] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-18T20:25:25.787116] [INFO ] [REMOTE ] MSC: Full fetch complete (2502 records). [2025-09-18T20:25:25.787198] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-09-18T20:25:25.970254] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-18T20:25:25.970470] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:25:25.970540] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:25:25.970613] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-18T20:25:25.970714] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-18T20:25:25.970763] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-09-18T20:25:25.970805] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-09-18T20:25:25.970875] [INFO ] [MAIN ] Update Progress: 1405/2372 symbols completed. MSC took 25.4s. Estimated remaining: 2h 21m 21s. Rate: 6.8 symbols/min [2025-09-18T20:25:26.128759] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-09-18T20:25:26.157545] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:25:26.205073] [DEBUG] [LOCAL ] MSDL: Loaded 38113 existing records from primary storage. [2025-09-18T20:25:26.205231] [INFO ] [MAIN ] MSDL: Loaded 38113 existing records. [2025-09-18T20:25:26.394341] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:25:26.394726] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-09-18T20:25:26.394784] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-09-18T20:25:26.395958] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-09-18T20:25:26.396020] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-09-18T20:25:26.773346] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:25:26.780362] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-18T20:25:26.919571] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-09-18T20:25:27.719691] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-09-18T20:25:28.388227] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-18T20:25:28.519568] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-09-18T20:25:28.573687] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-18T20:25:29.072511] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-18T20:25:29.319715] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-11. [2025-09-18T20:25:30.119594] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-09-18T20:25:30.731490] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-18T20:25:30.733551] [INFO ] [REMOTE ] MSB: Full fetch complete (12829 records). [2025-09-18T20:25:30.733878] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-09-18T20:25:30.931616] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-09-18T20:25:30.931515] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-18T20:25:31.205956] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-09-18T20:25:31.206100] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-09-18T20:25:31.206510] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-09-18T20:25:31.206560] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-09-18T20:25:31.207229] [DEBUG] [LOCAL ] MSB: Trimmed 12829 records to 7972 (keeping 200 days of data) [2025-09-18T20:25:31.261305] [DEBUG] [LOCAL ] MSB: Primary data saved (7972 records). [2025-09-18T20:25:31.261454] [INFO ] [MAIN ] MSB: Full history saved. [2025-09-18T20:25:31.261560] [INFO ] [MAIN ] Update Progress: 1406/2372 symbols completed. MSB took 33.5s. Estimated remaining: 2h 21m 10s. Rate: 6.8 symbols/min [2025-09-18T20:25:31.457524] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:25:31.488873] [DEBUG] [LOCAL ] MSGE: Loaded 27040 existing records from primary storage. [2025-09-18T20:25:31.489052] [INFO ] [MAIN ] MSGE: Loaded 27040 existing records. [2025-09-18T20:25:31.682888] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:25:31.683150] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-09-18T20:25:31.683200] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-09-18T20:25:31.684291] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-09-18T20:25:31.684352] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-09-18T20:25:31.729004] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-09-18T20:25:32.089514] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:25:32.119009] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-18T20:25:32.519905] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-09-18T20:25:32.980948] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T20:25:33.319597] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-11. [2025-09-18T20:25:33.635034] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-18T20:25:34.119633] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-09-18T20:25:34.417083] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-18T20:25:34.919577] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-09-18T20:25:35.311063] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-18T20:25:35.719559] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-09-18T20:25:36.519594] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-09-18T20:25:36.558817] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-18T20:25:36.792339] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-18T20:25:37.319561] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-09-18T20:25:37.887213] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-18T20:25:38.119578] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-09-18T20:25:38.677301] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-18T20:25:38.921090] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-09-18T20:25:38.922505] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-18T20:25:38.927308] [INFO ] [REMOTE ] MSD: Full fetch complete (21928 records). [2025-09-18T20:25:38.927404] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-09-18T20:25:39.308156] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-09-18T20:25:39.308248] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-09-18T20:25:39.308738] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-09-18T20:25:39.308812] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-09-18T20:25:39.309440] [DEBUG] [LOCAL ] MSD: Trimmed 21928 records to 15767 (keeping 200 days of data) [2025-09-18T20:25:39.398888] [DEBUG] [LOCAL ] MSD: Primary data saved (15767 records). [2025-09-18T20:25:39.399044] [INFO ] [MAIN ] MSD: Full history saved. [2025-09-18T20:25:39.399134] [INFO ] [MAIN ] Update Progress: 1407/2372 symbols completed. MSD took 34.9s. Estimated remaining: 2h 21m 1s. Rate: 6.8 symbols/min [2025-09-18T20:25:39.570718] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:25:39.591311] [DEBUG] [LOCAL ] MSGS: Loaded 16784 existing records from primary storage. [2025-09-18T20:25:39.591450] [INFO ] [MAIN ] MSGS: Loaded 16784 existing records. [2025-09-18T20:25:39.724764] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-09-18T20:25:39.785990] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:25:39.786407] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-09-18T20:25:39.786482] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-09-18T20:25:39.787187] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-09-18T20:25:39.787248] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-09-18T20:25:40.157033] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:25:40.174893] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T20:25:40.519558] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-09-18T20:25:41.319563] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-11. [2025-09-18T20:25:41.350197] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-18T20:25:41.356302] [INFO ] [REMOTE ] MSCI: Full fetch complete (49951 records). [2025-09-18T20:25:41.356426] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-09-18T20:25:41.671876] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-18T20:25:41.781306] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-09-18T20:25:41.781415] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-09-18T20:25:41.782326] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-09-18T20:25:41.782393] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-09-18T20:25:41.783586] [DEBUG] [LOCAL ] MSCI: Trimmed 49951 records to 35155 (keeping 200 days of data) [2025-09-18T20:25:41.921916] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-18T20:25:42.043485] [DEBUG] [LOCAL ] MSCI: Primary data saved (35155 records). [2025-09-18T20:25:42.043666] [INFO ] [MAIN ] MSCI: Full history saved. [2025-09-18T20:25:42.043796] [INFO ] [MAIN ] Update Progress: 1408/2372 symbols completed. MSCI took 40.4s. Estimated remaining: 2h 20m 48s. Rate: 6.8 symbols/min [2025-09-18T20:25:42.124802] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-09-18T20:25:42.217812] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:25:42.262308] [DEBUG] [LOCAL ] MSI: Loaded 40671 existing records from primary storage. [2025-09-18T20:25:42.262456] [INFO ] [MAIN ] MSI: Loaded 40671 existing records. [2025-09-18T20:25:42.439970] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:25:42.440272] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-09-18T20:25:42.440323] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-09-18T20:25:42.441637] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-09-18T20:25:42.441744] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-09-18T20:25:42.802095] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:25:42.814146] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-18T20:25:42.919564] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-11. [2025-09-18T20:25:43.719565] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-09-18T20:25:44.523096] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-09-18T20:25:44.543531] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-18T20:25:44.840291] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-18T20:25:45.319553] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-09-18T20:25:45.676634] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T20:25:46.119557] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-09-18T20:25:46.197232] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-18T20:25:46.919562] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-09-18T20:25:47.560186] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-18T20:25:47.719599] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-09-18T20:25:47.741262] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-18T20:25:48.519604] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-09-18T20:25:49.319542] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-09-18T20:25:49.380859] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-18T20:25:49.457137] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-18T20:25:50.119536] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-09-18T20:25:50.672132] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-18T20:25:50.919533] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-09-18T20:25:51.340534] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-18T20:25:51.719548] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-09-18T20:25:52.439264] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T20:25:52.519508] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-09-18T20:25:52.608981] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-18T20:25:53.319571] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-09-18T20:25:53.649816] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-18T20:25:54.119556] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-09-18T20:25:54.771127] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T20:25:54.919558] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-09-18T20:25:55.336858] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-18T20:25:55.719532] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-09-18T20:25:55.744462] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-18T20:25:56.519577] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-09-18T20:25:56.778533] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-18T20:25:57.319555] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-09-18T20:25:57.686775] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T20:25:58.119568] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-09-18T20:25:58.919565] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-09-18T20:25:59.089435] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-18T20:25:59.136586] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-18T20:25:59.719630] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-09-18T20:25:59.903871] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-18T20:26:00.519556] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-09-18T20:26:01.290993] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-18T20:26:01.319545] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-09-18T20:26:01.799527] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-18T20:26:02.119554] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-09-18T20:26:02.920588] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-18T20:26:02.920693] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-09-18T20:26:02.944867] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-18T20:26:03.719541] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-09-18T20:26:04.350760] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-18T20:26:04.519507] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-09-18T20:26:04.901608] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-18T20:26:05.291389] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-18T20:26:05.319533] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-09-18T20:26:06.020674] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-18T20:26:06.119527] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-09-18T20:26:06.919528] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-09-18T20:26:07.578767] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T20:26:07.584576] [INFO ] [REMOTE ] MSDL: Full fetch complete (54007 records). [2025-09-18T20:26:07.584788] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-09-18T20:26:07.727280] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-09-18T20:26:07.926991] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T20:26:07.980567] [INFO ] [REMOTE ] MSGS: Full fetch complete (22021 records). [2025-09-18T20:26:07.999533] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-09-18T20:26:07.999717] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-09-18T20:26:07.999793] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-09-18T20:26:08.000705] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-09-18T20:26:08.000803] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-09-18T20:26:08.104423] [DEBUG] [LOCAL ] MSDL: Trimmed 54007 records to 38441 (keeping 200 days of data) [2025-09-18T20:26:08.516353] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-09-18T20:26:08.517009] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-09-18T20:26:08.517837] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-09-18T20:26:08.517918] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-09-18T20:26:08.521519] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-09-18T20:26:08.526019] [DEBUG] [LOCAL ] MSGS: Trimmed 22021 records to 16933 (keeping 200 days of data) [2025-09-18T20:26:08.651048] [DEBUG] [LOCAL ] MSGS: Primary data saved (16933 records). [2025-09-18T20:26:08.651892] [INFO ] [MAIN ] MSGS: Full history saved. [2025-09-18T20:26:08.652422] [INFO ] [MAIN ] Update Progress: 1409/2372 symbols completed. MSGS took 29.3s. Estimated remaining: 2h 20m 51s. Rate: 6.8 symbols/min [2025-09-18T20:26:08.942630] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:26:08.943628] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-09-18T20:26:08.943975] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-09-18T20:26:08.944774] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-09-18T20:26:08.945128] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-18T20:26:08.945202] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-18T20:26:08.945872] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-09-18T20:26:09.371000] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:26:09.371375] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-11. [2025-09-18T20:26:09.384519] [DEBUG] [LOCAL ] MSDL: Primary data saved (38441 records). [2025-09-18T20:26:09.384868] [INFO ] [MAIN ] MSDL: Full history saved. [2025-09-18T20:26:09.395265] [INFO ] [MAIN ] Update Progress: 1410/2372 symbols completed. MSDL took 43.4s. Estimated remaining: 2h 20m 37s. Rate: 6.8 symbols/min [2025-09-18T20:26:09.443125] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-18T20:26:09.619514] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:26:09.663969] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:26:09.664591] [DEBUG] [LOCAL ] MSM: Loaded 35320 existing records from primary storage. [2025-09-18T20:26:09.664854] [INFO ] [MAIN ] MSM: Loaded 35320 existing records. [2025-09-18T20:26:09.664941] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-11 [2025-09-18T20:26:09.848222] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:26:09.848600] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-09-18T20:26:09.848809] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-09-18T20:26:09.855394] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-09-18T20:26:09.859634] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-09-18T20:26:09.886096] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-18T20:26:09.950458] [INFO ] [REMOTE ] MSGE: Full fetch complete (40122 records). [2025-09-18T20:26:09.970477] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-09-18T20:26:10.122715] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-09-18T20:26:10.585849] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:26:10.556835] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:26:10.636047] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-09-18T20:26:10.675343] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-09-18T20:26:10.675420] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-09-18T20:26:10.676167] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-09-18T20:26:10.676255] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-09-18T20:26:10.677680] [DEBUG] [LOCAL ] MSGE: Trimmed 40122 records to 27326 (keeping 200 days of data) [2025-09-18T20:26:10.839549] [DEBUG] [LOCAL ] MSGE: Primary data saved (27326 records). [2025-09-18T20:26:10.839715] [INFO ] [MAIN ] MSGE: Full history saved. [2025-09-18T20:26:10.839846] [INFO ] [MAIN ] Update Progress: 1411/2372 symbols completed. MSGE took 39.6s. Estimated remaining: 2h 20m 23s. Rate: 6.8 symbols/min [2025-09-18T20:26:10.924673] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-09-18T20:26:11.013210] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:26:11.068296] [DEBUG] [LOCAL ] MT: Loaded 50868 existing records from primary storage. [2025-09-18T20:26:11.068446] [INFO ] [MAIN ] MT: Loaded 50868 existing records. [2025-09-18T20:26:11.245624] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:26:11.245908] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-09-18T20:26:11.245956] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-09-18T20:26:11.247312] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-09-18T20:26:11.247373] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-09-18T20:26:11.609243] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:26:11.719522] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-11. [2025-09-18T20:26:12.519596] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-11. [2025-09-18T20:26:12.664749] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-18T20:26:13.152185] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T20:26:13.319547] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-01. [2025-09-18T20:26:13.757246] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-18T20:26:13.890149] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-18T20:26:14.119553] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-02. [2025-09-18T20:26:14.830055] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-18T20:26:14.919521] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-09-18T20:26:15.719553] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-09-18T20:26:16.519902] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-09-18T20:26:16.628504] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-18T20:26:16.871396] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-18T20:26:17.319558] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-03. [2025-09-18T20:26:18.119710] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-09-18T20:26:18.182213] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-18T20:26:18.214628] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-18T20:26:18.919569] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-04. [2025-09-18T20:26:19.436312] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-18T20:26:19.680345] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-18T20:26:19.719575] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-09-18T20:26:20.519571] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-09-18T20:26:20.888575] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-18T20:26:21.319575] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-09-18T20:26:22.030537] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T20:26:22.037484] [INFO ] [REMOTE ] MSI: Full fetch complete (58412 records). [2025-09-18T20:26:22.037606] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-09-18T20:26:22.124681] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-09-18T20:26:22.439111] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-09-18T20:26:22.439232] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-09-18T20:26:22.440455] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-09-18T20:26:22.440538] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-09-18T20:26:22.442125] [DEBUG] [LOCAL ] MSI: Trimmed 58412 records to 40955 (keeping 200 days of data) [2025-09-18T20:26:22.578954] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-18T20:26:22.761716] [DEBUG] [LOCAL ] MSI: Primary data saved (40955 records). [2025-09-18T20:26:22.761893] [INFO ] [MAIN ] MSI: Full history saved. [2025-09-18T20:26:22.762125] [INFO ] [MAIN ] Update Progress: 1412/2372 symbols completed. MSI took 40.7s. Estimated remaining: 2h 20m 17s. Rate: 6.8 symbols/min [2025-09-18T20:26:22.936279] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:26:22.932022] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-05. [2025-09-18T20:26:22.980002] [DEBUG] [LOCAL ] MTAL: Loaded 36124 existing records from primary storage. [2025-09-18T20:26:22.980171] [INFO ] [MAIN ] MTAL: Loaded 36124 existing records. [2025-09-18T20:26:23.158696] [WARN ] [MAIN ] MTAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:26:23.158984] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-09-18T20:26:23.159054] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-09-18T20:26:23.160003] [DEBUG] [LOCAL ] MTAL: Deleted primary data file. [2025-09-18T20:26:23.160063] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-09-18T20:26:23.437849] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-18T20:26:23.534900] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:26:23.623409] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-18T20:26:23.719592] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-06. [2025-09-18T20:26:24.519553] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-11. [2025-09-18T20:26:24.752615] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-18T20:26:25.319547] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-09-18T20:26:25.521453] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-18T20:26:26.119568] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-09-18T20:26:26.919551] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-07. [2025-09-18T20:26:26.993805] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-18T20:26:27.520293] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-18T20:26:27.719578] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-08. [2025-09-18T20:26:27.899391] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-18T20:26:28.519538] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-09-18T20:26:28.577862] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-18T20:26:29.319552] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-12. [2025-09-18T20:26:30.119556] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-09-18T20:26:30.312742] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-18T20:26:30.493005] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-18T20:26:30.906397] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-18T20:26:30.909720] [INFO ] [REMOTE ] MSIF: Full fetch complete (15721 records). [2025-09-18T20:26:30.909795] [DEBUG] [VALIDATOR ] MSIF: Validating primary data. [2025-09-18T20:26:30.924700] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-09-18T20:26:31.116063] [WARN ] [VALIDATOR ] MSIF: Validation failed - insufficient historical data. Have 160 unique days, need 200 days [2025-09-18T20:26:31.116627] [FATAL] [MAIN ] MSIF: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:26:31.116734] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:26:31.116799] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-18T20:26:31.116906] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-18T20:26:31.116991] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-09-18T20:26:31.117092] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-09-18T20:26:31.117238] [INFO ] [MAIN ] Update Progress: 1413/2372 symbols completed. MSIF took 22.5s. Estimated remaining: 2h 20m 8s. Rate: 6.8 symbols/min [2025-09-18T20:26:31.299838] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:26:31.370957] [DEBUG] [LOCAL ] MTB: Loaded 47240 existing records from primary storage. [2025-09-18T20:26:31.371106] [INFO ] [MAIN ] MTB: Loaded 47240 existing records. [2025-09-18T20:26:31.548018] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:26:31.548285] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-09-18T20:26:31.548333] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-09-18T20:26:31.549809] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-09-18T20:26:31.549870] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-09-18T20:26:31.726564] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-09-18T20:26:31.914835] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:26:32.443812] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-18T20:26:32.519541] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-11. [2025-09-18T20:26:33.319565] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-09-18T20:26:33.552552] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-18T20:26:33.767836] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-18T20:26:34.119544] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-09-18T20:26:34.738785] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-18T20:26:34.919521] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-09-18T20:26:35.719724] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-09-18T20:26:36.283746] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-18T20:26:36.519556] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-09-18T20:26:36.804848] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-18T20:26:37.319562] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-01. [2025-09-18T20:26:37.697075] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-18T20:26:38.119614] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-09-18T20:26:38.285978] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-18T20:26:38.342373] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-18T20:26:38.919624] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-09-18T20:26:39.685307] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-18T20:26:39.712639] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-18T20:26:39.719493] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-09-18T20:26:40.519546] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-09-18T20:26:40.910413] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-18T20:26:41.319551] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-09-18T20:26:42.119533] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-09-18T20:26:42.448387] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-18T20:26:42.508271] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-18T20:26:42.919549] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-09-18T20:26:43.261752] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-18T20:26:43.719545] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-09-18T20:26:44.519567] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-09-18T20:26:45.245247] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-18T20:26:45.319579] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-09-18T20:26:45.688955] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-18T20:26:46.119586] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-09-18T20:26:46.381186] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-18T20:26:46.496258] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-18T20:26:46.501388] [INFO ] [REMOTE ] MSM: Full fetch complete (51775 records). [2025-09-18T20:26:46.501499] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-09-18T20:26:46.885975] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-09-18T20:26:46.886069] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-09-18T20:26:46.886965] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-09-18T20:26:46.887034] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-09-18T20:26:46.888281] [DEBUG] [LOCAL ] MSM: Trimmed 51775 records to 35589 (keeping 200 days of data) [2025-09-18T20:26:46.954737] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-09-18T20:26:47.117953] [DEBUG] [LOCAL ] MSM: Primary data saved (35589 records). [2025-09-18T20:26:47.118103] [INFO ] [MAIN ] MSM: Full history saved. [2025-09-18T20:26:47.118974] [INFO ] [MAIN ] Update Progress: 1414/2372 symbols completed. MSM took 37.7s. Estimated remaining: 2h 20m 4s. Rate: 6.8 symbols/min [2025-09-18T20:26:47.346218] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:26:47.365764] [DEBUG] [LOCAL ] MTD: Loaded 15361 existing records from primary storage. [2025-09-18T20:26:47.365898] [INFO ] [MAIN ] MTD: Loaded 15361 existing records. [2025-09-18T20:26:47.545176] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:26:47.545504] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-09-18T20:26:47.545552] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-09-18T20:26:47.546312] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-09-18T20:26:47.546373] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-09-18T20:26:47.729860] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-09-18T20:26:47.913582] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:26:47.932936] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-18T20:26:47.939955] [INFO ] [REMOTE ] MT: Full fetch complete (73360 records). [2025-09-18T20:26:47.940086] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-09-18T20:26:48.331924] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-09-18T20:26:48.332026] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-09-18T20:26:48.332972] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-09-18T20:26:48.333038] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-09-18T20:26:48.335446] [DEBUG] [LOCAL ] MT: Trimmed 73360 records to 51235 (keeping 200 days of data) [2025-09-18T20:26:48.527207] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-11. [2025-09-18T20:26:48.690076] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-18T20:26:48.705018] [DEBUG] [LOCAL ] MT: Primary data saved (51235 records). [2025-09-18T20:26:48.705136] [INFO ] [MAIN ] MT: Full history saved. [2025-09-18T20:26:48.705216] [INFO ] [MAIN ] Update Progress: 1415/2372 symbols completed. MT took 37.9s. Estimated remaining: 2h 19m 50s. Rate: 6.8 symbols/min [2025-09-18T20:26:48.873985] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:26:48.929726] [DEBUG] [LOCAL ] MTDR: Loaded 51586 existing records from primary storage. [2025-09-18T20:26:48.929881] [INFO ] [MAIN ] MTDR: Loaded 51586 existing records. [2025-09-18T20:26:49.106954] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:26:49.107241] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-09-18T20:26:49.107312] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-09-18T20:26:49.108590] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-09-18T20:26:49.108676] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-09-18T20:26:49.330039] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-09-18T20:26:49.474096] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-18T20:26:49.513953] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:26:49.531447] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-18T20:26:50.119549] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-09-18T20:26:50.919553] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-09-18T20:26:51.010776] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-18T20:26:51.257523] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-18T20:26:51.719593] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-09-18T20:26:52.177478] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-18T20:26:52.509035] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-18T20:26:52.519496] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-09-18T20:26:53.319564] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-09-18T20:26:53.563952] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-18T20:26:54.119543] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-11. [2025-09-18T20:26:54.919529] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-09-18T20:26:55.481439] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-18T20:26:55.618296] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-18T20:26:55.719552] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-09-18T20:26:56.519569] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-09-18T20:26:56.776302] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-18T20:26:57.324233] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-09-18T20:26:57.329522] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-18T20:26:57.441242] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-18T20:26:58.119554] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-09-18T20:26:58.654634] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T20:26:58.659971] [INFO ] [REMOTE ] MTAL: Full fetch complete (46309 records). [2025-09-18T20:26:58.660086] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-09-18T20:26:58.924709] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-09-18T20:26:59.038552] [DEBUG] [VALIDATOR ] MTAL: All expected trading days are present. [2025-09-18T20:26:59.038633] [DEBUG] [VALIDATOR ] MTAL: Primary data validation passed. [2025-09-18T20:26:59.039408] [INFO ] [MAIN ] MTAL: Fetched primary data is valid. [2025-09-18T20:26:59.039457] [DEBUG] [LOCAL ] MTAL: Saving primary data. [2025-09-18T20:26:59.040469] [DEBUG] [LOCAL ] MTAL: Trimmed 46309 records to 36390 (keeping 200 days of data) [2025-09-18T20:26:59.255910] [DEBUG] [LOCAL ] MTAL: Primary data saved (36390 records). [2025-09-18T20:26:59.256116] [INFO ] [MAIN ] MTAL: Full history saved. [2025-09-18T20:26:59.256241] [INFO ] [MAIN ] Update Progress: 1416/2372 symbols completed. MTAL took 36.5s. Estimated remaining: 2h 19m 42s. Rate: 6.8 symbols/min [2025-09-18T20:26:59.429432] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:26:59.482980] [DEBUG] [LOCAL ] MTG: Loaded 51357 existing records from primary storage. [2025-09-18T20:26:59.483206] [INFO ] [MAIN ] MTG: Loaded 51357 existing records. [2025-09-18T20:26:59.667025] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:26:59.667287] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-09-18T20:26:59.667359] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-09-18T20:26:59.668532] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-09-18T20:26:59.668593] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-09-18T20:26:59.732173] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-09-18T20:27:00.037615] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:27:00.169554] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-18T20:27:00.519605] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-09-18T20:27:01.269780] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-18T20:27:01.319504] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-09-18T20:27:01.587967] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-18T20:27:02.119562] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-11. [2025-09-18T20:27:02.919514] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-09-18T20:27:03.660703] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (3.14 seconds). [2025-09-18T20:27:03.719509] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-09-18T20:27:04.907028] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (3.59 seconds). [2025-09-18T20:27:04.916981] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-09-18T20:27:04.931105] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-18T20:27:05.086846] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-11 (2.97 seconds). [2025-09-18T20:27:05.150694] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T20:27:05.319548] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-09-18T20:27:06.119561] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-09-18T20:27:06.567618] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-18T20:27:06.574157] [INFO ] [REMOTE ] MTB: Full fetch complete (68325 records). [2025-09-18T20:27:06.574319] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-09-18T20:27:06.922414] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-09-18T20:27:06.988415] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-09-18T20:27:06.988583] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-09-18T20:27:06.989830] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-09-18T20:27:06.988283] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-18T20:27:06.990106] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-09-18T20:27:06.995852] [DEBUG] [LOCAL ] MTB: Trimmed 68325 records to 47605 (keeping 200 days of data) [2025-09-18T20:27:07.129806] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-18T20:27:07.336919] [DEBUG] [LOCAL ] MTB: Primary data saved (47605 records). [2025-09-18T20:27:07.337055] [INFO ] [MAIN ] MTB: Full history saved. [2025-09-18T20:27:07.337136] [INFO ] [MAIN ] Update Progress: 1417/2372 symbols completed. MTB took 36.2s. Estimated remaining: 2h 19m 33s. Rate: 6.8 symbols/min [2025-09-18T20:27:07.507292] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:27:07.548133] [DEBUG] [LOCAL ] MTH: Loaded 43964 existing records from primary storage. [2025-09-18T20:27:07.548274] [INFO ] [MAIN ] MTH: Loaded 43964 existing records. [2025-09-18T20:27:07.726187] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-09-18T20:27:07.726356] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:27:07.727475] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-09-18T20:27:07.727542] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-09-18T20:27:07.728864] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-09-18T20:27:07.728929] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-09-18T20:27:08.090387] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:27:08.519558] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-11. [2025-09-18T20:27:08.673129] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-18T20:27:09.319613] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-09-18T20:27:09.822002] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-18T20:27:10.120546] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-09-18T20:27:10.122951] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-18T20:27:10.919593] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-09-18T20:27:11.295820] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-18T20:27:11.721176] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-09-18T20:27:11.725498] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-18T20:27:12.519615] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-09-18T20:27:13.012761] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-18T20:27:13.319512] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-09-18T20:27:13.475829] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-09-18T20:27:14.119550] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-09-18T20:27:14.929413] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-09-18T20:27:14.952941] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-18T20:27:15.002767] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-18T20:27:15.719618] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-09-18T20:27:15.878343] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-18T20:27:15.947114] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-18T20:27:16.519604] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-09-18T20:27:17.133257] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-18T20:27:17.135123] [INFO ] [REMOTE ] MTD: Full fetch complete (21032 records). [2025-09-18T20:27:17.135197] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-09-18T20:27:17.324749] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-09-18T20:27:17.518937] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-09-18T20:27:17.519016] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-09-18T20:27:17.519456] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-09-18T20:27:17.519495] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-09-18T20:27:17.520155] [DEBUG] [LOCAL ] MTD: Trimmed 21032 records to 15446 (keeping 200 days of data) [2025-09-18T20:27:17.624209] [DEBUG] [LOCAL ] MTD: Primary data saved (15446 records). [2025-09-18T20:27:17.624397] [INFO ] [MAIN ] MTD: Full history saved. [2025-09-18T20:27:17.624504] [INFO ] [MAIN ] Update Progress: 1418/2372 symbols completed. MTD took 30.5s. Estimated remaining: 2h 19m 25s. Rate: 6.8 symbols/min [2025-09-18T20:27:17.801188] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:27:17.833098] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-18T20:27:17.888949] [DEBUG] [LOCAL ] MTN: Loaded 39038 existing records from primary storage. [2025-09-18T20:27:17.889114] [INFO ] [MAIN ] MTN: Loaded 39038 existing records. [2025-09-18T20:27:18.066585] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:27:18.066841] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-09-18T20:27:18.066890] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-09-18T20:27:18.067913] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-09-18T20:27:18.067976] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-09-18T20:27:18.130378] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-09-18T20:27:18.433416] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:27:18.894033] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-18T20:27:18.919505] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-09-18T20:27:19.719583] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-11. [2025-09-18T20:27:19.840872] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-18T20:27:20.440229] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-18T20:27:20.519553] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-09-18T20:27:21.029064] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-18T20:27:21.319552] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-09-18T20:27:22.119545] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-09-18T20:27:22.148344] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-18T20:27:22.567547] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-18T20:27:22.919572] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-09-18T20:27:23.733978] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-09-18T20:27:23.740190] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-18T20:27:24.521837] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-09-18T20:27:24.534047] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T20:27:25.262294] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T20:27:25.319558] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-09-18T20:27:26.119553] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-09-18T20:27:26.212352] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-18T20:27:26.776031] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T20:27:26.919575] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-09-18T20:27:27.661691] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-18T20:27:27.719548] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-09-18T20:27:28.519590] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-09-18T20:27:28.735059] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-18T20:27:29.229253] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-18T20:27:29.319549] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-09-18T20:27:29.948440] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-18T20:27:30.119547] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-09-18T20:27:30.679107] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-18T20:27:30.919575] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-09-18T20:27:31.444139] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-18T20:27:31.719563] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-09-18T20:27:32.519508] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-09-18T20:27:32.594217] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-18T20:27:32.601298] [INFO ] [REMOTE ] MTG: Full fetch complete (73729 records). [2025-09-18T20:27:32.601451] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-09-18T20:27:32.999150] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-09-18T20:27:32.999241] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-09-18T20:27:33.000183] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-09-18T20:27:33.000247] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-09-18T20:27:33.001785] [DEBUG] [LOCAL ] MTG: Trimmed 73729 records to 51744 (keeping 200 days of data) [2025-09-18T20:27:33.320563] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-09-18T20:27:33.324816] [DEBUG] [LOCAL ] MTG: Primary data saved (51744 records). [2025-09-18T20:27:33.325966] [INFO ] [MAIN ] MTG: Full history saved. [2025-09-18T20:27:33.326130] [INFO ] [MAIN ] Update Progress: 1419/2372 symbols completed. MTG took 34.1s. Estimated remaining: 2h 19m 21s. Rate: 6.8 symbols/min [2025-09-18T20:27:33.507802] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:27:33.508118] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-09-18T20:27:33.508189] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-09-18T20:27:33.508472] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-09-18T20:27:33.508545] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-18T20:27:33.508684] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-18T20:27:33.508756] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-09-18T20:27:33.867103] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-18T20:27:33.919941] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:27:33.944627] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-18T20:27:34.119589] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-09-18T20:27:34.919511] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-09-18T20:27:35.007934] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-18T20:27:35.269032] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-18T20:27:35.719553] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-11. [2025-09-18T20:27:36.095624] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-11 (0.38 seconds). [2025-09-18T20:27:36.519588] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-09-18T20:27:36.577327] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-18T20:27:37.319613] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-09-18T20:27:38.119522] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-09-18T20:27:38.206115] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-18T20:27:38.213422] [INFO ] [REMOTE ] MTDR: Full fetch complete (73183 records). [2025-09-18T20:27:38.213596] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-09-18T20:27:38.525834] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-18T20:27:38.622110] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-09-18T20:27:38.622248] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-09-18T20:27:38.623546] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-09-18T20:27:38.623687] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-09-18T20:27:38.625604] [DEBUG] [LOCAL ] MTDR: Trimmed 73183 records to 51956 (keeping 200 days of data) [2025-09-18T20:27:38.751094] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-18T20:27:38.761231] [INFO ] [REMOTE ] MTH: Full fetch complete (62148 records). [2025-09-18T20:27:38.762972] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-09-18T20:27:38.932875] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-09-18T20:27:39.378628] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-09-18T20:27:39.379140] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-09-18T20:27:39.395104] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-09-18T20:27:39.396155] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-09-18T20:27:39.404738] [DEBUG] [LOCAL ] MTH: Trimmed 62148 records to 44331 (keeping 200 days of data) [2025-09-18T20:27:39.511662] [DEBUG] [LOCAL ] MTDR: Primary data saved (51956 records). [2025-09-18T20:27:39.514213] [INFO ] [MAIN ] MTDR: Full history saved. [2025-09-18T20:27:39.514363] [INFO ] [MAIN ] Update Progress: 1420/2372 symbols completed. MTDR took 50.8s. Estimated remaining: 2h 19m 11s. Rate: 6.8 symbols/min [2025-09-18T20:27:39.608976] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-18T20:27:39.722274] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-09-18T20:27:39.721721] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:27:39.844582] [DEBUG] [LOCAL ] MTRN: Loaded 17880 existing records from primary storage. [2025-09-18T20:27:39.846854] [INFO ] [MAIN ] MTRN: Loaded 17880 existing records. [2025-09-18T20:27:40.053974] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:27:40.055118] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-09-18T20:27:40.055430] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-09-18T20:27:40.056715] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-09-18T20:27:40.057012] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-09-18T20:27:40.499249] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:27:40.503272] [DEBUG] [LOCAL ] MTH: Primary data saved (44331 records). [2025-09-18T20:27:40.503438] [INFO ] [MAIN ] MTH: Full history saved. [2025-09-18T20:27:40.503556] [INFO ] [MAIN ] Update Progress: 1421/2372 symbols completed. MTH took 33.2s. Estimated remaining: 2h 18m 57s. Rate: 6.8 symbols/min [2025-09-18T20:27:40.524686] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-18T20:27:40.679799] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:27:40.712309] [DEBUG] [LOCAL ] MTUS: Loaded 29010 existing records from primary storage. [2025-09-18T20:27:40.712448] [INFO ] [MAIN ] MTUS: Loaded 29010 existing records. [2025-09-18T20:27:40.894628] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:27:40.894955] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-09-18T20:27:40.895022] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-09-18T20:27:40.895804] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-09-18T20:27:40.895870] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-09-18T20:27:41.083492] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-18T20:27:41.279911] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:27:41.306381] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-18T20:27:41.319511] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-11. [2025-09-18T20:27:42.119553] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-18T20:27:42.405810] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-18T20:27:42.620017] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-18T20:27:42.919559] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-18T20:27:43.321360] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-18T20:27:43.719543] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-18T20:27:44.184633] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-18T20:27:44.519554] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-11. [2025-09-18T20:27:45.319607] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-18T20:27:45.468161] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-18T20:27:45.907355] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-18T20:27:46.119555] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-09-18T20:27:46.919544] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-09-18T20:27:47.547049] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-18T20:27:47.719546] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-09-18T20:27:48.150003] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T20:27:48.519600] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-18T20:27:49.032284] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-18T20:27:49.194690] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-18T20:27:49.200319] [INFO ] [REMOTE ] MTN: Full fetch complete (56162 records). [2025-09-18T20:27:49.200425] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-09-18T20:27:49.324717] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-18T20:27:49.602342] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-09-18T20:27:49.602428] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-09-18T20:27:49.603352] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-09-18T20:27:49.603416] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-09-18T20:27:49.604715] [DEBUG] [LOCAL ] MTN: Trimmed 56162 records to 39301 (keeping 200 days of data) [2025-09-18T20:27:49.861556] [DEBUG] [LOCAL ] MTN: Primary data saved (39301 records). [2025-09-18T20:27:49.861724] [INFO ] [MAIN ] MTN: Full history saved. [2025-09-18T20:27:49.862518] [INFO ] [MAIN ] Update Progress: 1422/2372 symbols completed. MTN took 32.2s. Estimated remaining: 2h 18m 48s. Rate: 6.8 symbols/min [2025-09-18T20:27:49.959179] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T20:27:50.041445] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:27:50.069760] [DEBUG] [LOCAL ] MTW: Loaded 26664 existing records from primary storage. [2025-09-18T20:27:50.069901] [INFO ] [MAIN ] MTW: Loaded 26664 existing records. [2025-09-18T20:27:50.124738] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-09-18T20:27:50.256796] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:27:50.257113] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-09-18T20:27:50.257184] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-09-18T20:27:50.257858] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-09-18T20:27:50.257920] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-09-18T20:27:50.634477] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:27:50.893061] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-18T20:27:50.919491] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-09-18T20:27:51.719583] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-11. [2025-09-18T20:27:51.836152] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-18T20:27:52.519568] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-09-18T20:27:52.774597] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-18T20:27:53.319539] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-18T20:27:53.656806] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-18T20:27:53.657557] [INFO ] [REMOTE ] MTR: Full fetch complete (2605 records). [2025-09-18T20:27:53.657625] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-09-18T20:27:53.837974] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-18T20:27:53.838260] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:27:53.838508] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:27:53.838626] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-18T20:27:53.838845] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-18T20:27:53.838951] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-09-18T20:27:53.839088] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-09-18T20:27:53.839184] [INFO ] [MAIN ] Update Progress: 1423/2372 symbols completed. MTR took 20.5s. Estimated remaining: 2h 18m 37s. Rate: 6.8 symbols/min [2025-09-18T20:27:54.040842] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T20:27:54.091591] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:27:54.114860] [DEBUG] [LOCAL ] MTX: Loaded 22852 existing records from primary storage. [2025-09-18T20:27:54.115006] [INFO ] [MAIN ] MTX: Loaded 22852 existing records. [2025-09-18T20:27:54.125940] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-09-18T20:27:54.299778] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:27:54.300079] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-09-18T20:27:54.300131] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-09-18T20:27:54.300880] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-09-18T20:27:54.300943] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-09-18T20:27:54.662258] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:27:54.919541] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-11. [2025-09-18T20:27:55.222686] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-18T20:27:55.581243] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-18T20:27:55.719536] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-09-18T20:27:56.519509] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-09-18T20:27:56.562261] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T20:27:57.153601] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-18T20:27:57.319554] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-09-18T20:27:58.119572] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-09-18T20:27:58.323115] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-18T20:27:58.919553] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-09-18T20:27:59.193899] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-18T20:27:59.719547] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-09-18T20:27:59.937159] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-18T20:28:00.519540] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-09-18T20:28:00.852108] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-18T20:28:01.224923] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-18T20:28:01.319563] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-09-18T20:28:02.119540] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-09-18T20:28:02.291687] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-18T20:28:02.919570] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-09-18T20:28:03.075353] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-18T20:28:03.719541] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-09-18T20:28:04.209301] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-18T20:28:04.519534] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-09-18T20:28:05.135274] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-18T20:28:05.319548] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-09-18T20:28:05.404879] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-18T20:28:06.119545] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-09-18T20:28:06.403572] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-18T20:28:06.919508] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-09-18T20:28:07.009448] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-18T20:28:07.719634] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-09-18T20:28:07.943892] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-18T20:28:08.519596] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-09-18T20:28:08.806604] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-18T20:28:09.319587] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-09-18T20:28:09.863411] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T20:28:10.119569] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-09-18T20:28:10.168941] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-18T20:28:10.919546] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-09-18T20:28:11.104277] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-18T20:28:11.719720] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-09-18T20:28:11.899357] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-18T20:28:12.519547] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-09-18T20:28:12.563361] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-18T20:28:13.206780] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-18T20:28:13.319583] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-09-18T20:28:14.119544] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-09-18T20:28:14.552757] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-18T20:28:14.919562] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-09-18T20:28:15.046032] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T20:28:15.719548] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-09-18T20:28:15.923958] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-18T20:28:16.519597] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-09-18T20:28:16.947732] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-18T20:28:17.319525] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-09-18T20:28:17.348229] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-18T20:28:18.119576] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-09-18T20:28:18.180454] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-18T20:28:18.919572] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-09-18T20:28:19.449063] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-18T20:28:19.719584] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-09-18T20:28:19.761181] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-18T20:28:20.519520] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-09-18T20:28:20.664759] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-18T20:28:20.668904] [INFO ] [REMOTE ] MTUS: Full fetch complete (42905 records). [2025-09-18T20:28:20.669060] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-09-18T20:28:21.054241] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-09-18T20:28:21.054361] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-09-18T20:28:21.055287] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-09-18T20:28:21.055368] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-09-18T20:28:21.056339] [DEBUG] [LOCAL ] MTUS: Trimmed 42905 records to 29230 (keeping 200 days of data) [2025-09-18T20:28:21.225227] [DEBUG] [LOCAL ] MTUS: Primary data saved (29230 records). [2025-09-18T20:28:21.225383] [INFO ] [MAIN ] MTUS: Full history saved. [2025-09-18T20:28:21.225533] [INFO ] [MAIN ] Update Progress: 1424/2372 symbols completed. MTUS took 40.7s. Estimated remaining: 2h 18m 40s. Rate: 6.8 symbols/min [2025-09-18T20:28:21.324661] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-09-18T20:28:21.398873] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:28:21.441541] [DEBUG] [LOCAL ] MTZ: Loaded 43609 existing records from primary storage. [2025-09-18T20:28:21.441751] [INFO ] [MAIN ] MTZ: Loaded 43609 existing records. [2025-09-18T20:28:21.621288] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:28:21.621532] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-09-18T20:28:21.621606] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-09-18T20:28:21.622788] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-09-18T20:28:21.622849] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-09-18T20:28:21.967167] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T20:28:22.007972] [INFO ] [REMOTE ] MTW: Full fetch complete (38390 records). [2025-09-18T20:28:22.007832] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:28:22.008171] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-09-18T20:28:22.128868] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-09-18T20:28:22.171889] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-18T20:28:22.213064] [INFO ] [REMOTE ] MTRN: Full fetch complete (23123 records). [2025-09-18T20:28:22.258185] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-09-18T20:28:22.628344] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-09-18T20:28:22.652803] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-09-18T20:28:22.668468] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-09-18T20:28:22.680844] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-09-18T20:28:22.717088] [DEBUG] [LOCAL ] MTW: Trimmed 38390 records to 26862 (keeping 200 days of data) [2025-09-18T20:28:22.882356] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-09-18T20:28:22.887061] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-09-18T20:28:22.888314] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-09-18T20:28:22.888905] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-09-18T20:28:22.894575] [DEBUG] [LOCAL ] MTRN: Trimmed 23123 records to 18110 (keeping 200 days of data) [2025-09-18T20:28:22.951949] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-11. [2025-09-18T20:28:23.100322] [DEBUG] [LOCAL ] MTW: Primary data saved (26862 records). [2025-09-18T20:28:23.104941] [INFO ] [MAIN ] MTW: Full history saved. [2025-09-18T20:28:23.108838] [DEBUG] [LOCAL ] MTRN: Primary data saved (18110 records). [2025-09-18T20:28:23.109115] [INFO ] [MAIN ] MTRN: Full history saved. [2025-09-18T20:28:23.108994] [INFO ] [MAIN ] Update Progress: 1425/2372 symbols completed. MTW took 33.2s. Estimated remaining: 2h 18m 27s. Rate: 6.8 symbols/min [2025-09-18T20:28:23.109559] [INFO ] [MAIN ] Update Progress: 1426/2372 symbols completed. MTRN took 43.6s. Estimated remaining: 2h 18m 12s. Rate: 6.8 symbols/min [2025-09-18T20:28:23.648333] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-18T20:28:23.704586] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:28:23.729249] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-09-18T20:28:23.738502] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:28:23.773536] [DEBUG] [LOCAL ] MUA: Loaded 12449 existing records from primary storage. [2025-09-18T20:28:23.774460] [INFO ] [MAIN ] MUA: Loaded 12449 existing records. [2025-09-18T20:28:23.788013] [DEBUG] [LOCAL ] MUC: Loaded 20141 existing records from primary storage. [2025-09-18T20:28:23.817339] [INFO ] [MAIN ] MUC: Loaded 20141 existing records. [2025-09-18T20:28:24.316946] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:28:24.317086] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:28:24.317430] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-09-18T20:28:24.317634] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-09-18T20:28:24.317706] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-09-18T20:28:24.317805] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-09-18T20:28:24.318357] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-09-18T20:28:24.318419] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-09-18T20:28:24.323566] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-09-18T20:28:24.392453] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-09-18T20:28:24.772564] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-18T20:28:24.837885] [INFO ] [REMOTE ] MTX: Full fetch complete (30949 records). [2025-09-18T20:28:24.843816] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-09-18T20:28:25.120190] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:28:25.174287] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-11. [2025-09-18T20:28:25.241909] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:28:25.323323] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-11. [2025-09-18T20:28:25.428313] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-11 (2.48 seconds). [2025-09-18T20:28:25.533445] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-09-18T20:28:25.533527] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-09-18T20:28:25.534217] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-09-18T20:28:25.534280] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-09-18T20:28:25.535039] [DEBUG] [LOCAL ] MTX: Trimmed 30949 records to 23011 (keeping 200 days of data) [2025-09-18T20:28:25.678004] [DEBUG] [LOCAL ] MTX: Primary data saved (23011 records). [2025-09-18T20:28:25.678139] [INFO ] [MAIN ] MTX: Full history saved. [2025-09-18T20:28:25.678262] [INFO ] [MAIN ] Update Progress: 1427/2372 symbols completed. MTX took 31.8s. Estimated remaining: 2h 17m 59s. Rate: 6.8 symbols/min [2025-09-18T20:28:25.851931] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:28:25.864965] [DEBUG] [LOCAL ] MUE: Loaded 11938 existing records from primary storage. [2025-09-18T20:28:25.865101] [INFO ] [MAIN ] MUE: Loaded 11938 existing records. [2025-09-18T20:28:26.043866] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:28:26.044139] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-09-18T20:28:26.044197] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-09-18T20:28:26.044704] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-09-18T20:28:26.044770] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-09-18T20:28:26.134193] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-09-18T20:28:26.239449] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-18T20:28:26.444569] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T20:28:26.454783] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:28:26.919627] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-09-18T20:28:27.536382] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-18T20:28:27.719568] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-09-18T20:28:27.749843] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-18T20:28:28.519547] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-09-18T20:28:28.996952] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-18T20:28:29.239025] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-18T20:28:29.319519] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-09-18T20:28:30.119560] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-09-18T20:28:30.226871] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-18T20:28:30.919605] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-09-18T20:28:31.581291] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-18T20:28:31.719565] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-09-18T20:28:31.900910] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-18T20:28:32.519573] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-09-18T20:28:33.092556] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-18T20:28:33.319564] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-09-18T20:28:33.618451] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-18T20:28:34.119557] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-09-18T20:28:34.905987] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T20:28:34.919508] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-09-18T20:28:34.937142] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-18T20:28:35.719566] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-09-18T20:28:36.519576] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-09-18T20:28:36.710850] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-18T20:28:36.751200] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-18T20:28:37.269862] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-18T20:28:37.319509] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-11. [2025-09-18T20:28:38.119552] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-09-18T20:28:38.203589] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-18T20:28:38.919565] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-09-18T20:28:38.941935] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-18T20:28:39.719699] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-09-18T20:28:40.446365] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T20:28:40.470211] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-18T20:28:40.519568] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-09-18T20:28:41.319597] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-09-18T20:28:41.729758] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-18T20:28:42.119554] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-09-18T20:28:42.681049] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-18T20:28:42.919598] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-09-18T20:28:43.211806] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-18T20:28:43.719623] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-09-18T20:28:44.399744] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-18T20:28:44.519552] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-09-18T20:28:44.638569] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-18T20:28:45.117930] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-18T20:28:45.319591] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-09-18T20:28:46.119550] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-09-18T20:28:46.919511] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-09-18T20:28:47.033029] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-18T20:28:47.073204] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-18T20:28:47.719548] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-09-18T20:28:47.846103] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-18T20:28:48.260736] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-18T20:28:48.519599] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-09-18T20:28:49.319545] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-09-18T20:28:49.848859] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T20:28:49.859827] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-18T20:28:49.862780] [INFO ] [REMOTE ] MTZ: Full fetch complete (63254 records). [2025-09-18T20:28:49.862923] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-09-18T20:28:50.129375] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-09-18T20:28:50.277137] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-09-18T20:28:50.277234] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-09-18T20:28:50.278858] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-09-18T20:28:50.278955] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-09-18T20:28:50.280790] [DEBUG] [LOCAL ] MTZ: Trimmed 63254 records to 43951 (keeping 200 days of data) [2025-09-18T20:28:50.560135] [DEBUG] [LOCAL ] MTZ: Primary data saved (43951 records). [2025-09-18T20:28:50.560272] [INFO ] [MAIN ] MTZ: Full history saved. [2025-09-18T20:28:50.560396] [INFO ] [MAIN ] Update Progress: 1428/2372 symbols completed. MTZ took 29.3s. Estimated remaining: 2h 18m 1s. Rate: 6.8 symbols/min [2025-09-18T20:28:50.743181] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:28:50.754678] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-18T20:28:50.812170] [DEBUG] [LOCAL ] MUFG: Loaded 52665 existing records from primary storage. [2025-09-18T20:28:50.812328] [INFO ] [MAIN ] MUFG: Loaded 52665 existing records. [2025-09-18T20:28:50.924794] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-09-18T20:28:51.008765] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:28:51.009108] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-09-18T20:28:51.009208] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-09-18T20:28:51.010367] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-09-18T20:28:51.010488] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-09-18T20:28:51.387633] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:28:51.719588] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-09-18T20:28:51.829058] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-18T20:28:52.519519] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-09-18T20:28:52.726153] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-18T20:28:53.134461] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-18T20:28:53.319570] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-09-18T20:28:54.120343] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-09-18T20:28:54.122718] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-18T20:28:54.919556] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-09-18T20:28:55.016834] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-18T20:28:55.719516] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-09-18T20:28:55.978565] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-18T20:28:56.519553] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-09-18T20:28:56.550543] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-18T20:28:56.553878] [INFO ] [REMOTE ] MUA: Full fetch complete (18710 records). [2025-09-18T20:28:56.554000] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-09-18T20:28:56.961464] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-09-18T20:28:56.961555] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-09-18T20:28:56.962167] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-09-18T20:28:56.962232] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-09-18T20:28:56.962860] [DEBUG] [LOCAL ] MUA: Trimmed 18710 records to 12502 (keeping 200 days of data) [2025-09-18T20:28:57.058501] [DEBUG] [LOCAL ] MUA: Primary data saved (12502 records). [2025-09-18T20:28:57.058679] [INFO ] [MAIN ] MUA: Full history saved. [2025-09-18T20:28:57.058844] [INFO ] [MAIN ] Update Progress: 1429/2372 symbols completed. MUA took 33.9s. Estimated remaining: 2h 17m 51s. Rate: 6.8 symbols/min [2025-09-18T20:28:57.278059] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:28:57.291602] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-18T20:28:57.306299] [DEBUG] [LOCAL ] MUJ: Loaded 13165 existing records from primary storage. [2025-09-18T20:28:57.306459] [INFO ] [MAIN ] MUJ: Loaded 13165 existing records. [2025-09-18T20:28:57.326878] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-09-18T20:28:57.491688] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:28:57.491938] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-09-18T20:28:57.491989] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-09-18T20:28:57.492517] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-09-18T20:28:57.492577] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-09-18T20:28:57.855695] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:28:58.119540] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-11. [2025-09-18T20:28:58.448711] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T20:28:58.452066] [INFO ] [REMOTE ] MUC: Full fetch complete (29974 records). [2025-09-18T20:28:58.452148] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-09-18T20:28:58.852521] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-09-18T20:28:58.852735] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-09-18T20:28:58.853528] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-09-18T20:28:58.853635] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-09-18T20:28:58.854814] [DEBUG] [LOCAL ] MUC: Trimmed 29974 records to 20267 (keeping 200 days of data) [2025-09-18T20:28:58.865447] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-18T20:28:58.935466] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-09-18T20:28:59.011322] [DEBUG] [LOCAL ] MUC: Primary data saved (20267 records). [2025-09-18T20:28:59.011461] [INFO ] [MAIN ] MUC: Full history saved. [2025-09-18T20:28:59.011569] [INFO ] [MAIN ] Update Progress: 1430/2372 symbols completed. MUC took 35.9s. Estimated remaining: 2h 17m 38s. Rate: 6.8 symbols/min [2025-09-18T20:28:59.180482] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:28:59.243769] [DEBUG] [LOCAL ] MUR: Loaded 52946 existing records from primary storage. [2025-09-18T20:28:59.243955] [INFO ] [MAIN ] MUR: Loaded 52946 existing records. [2025-09-18T20:28:59.428096] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:28:59.428428] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-09-18T20:28:59.428487] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-09-18T20:28:59.429678] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-09-18T20:28:59.429739] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-09-18T20:28:59.724724] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-09-18T20:28:59.789516] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:28:59.804046] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-18T20:29:00.373400] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-18T20:29:00.375764] [INFO ] [REMOTE ] MUE: Full fetch complete (16312 records). [2025-09-18T20:29:00.375846] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-09-18T20:29:00.526074] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-09-18T20:29:00.742864] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-09-18T20:29:00.742940] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-09-18T20:29:00.743283] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-09-18T20:29:00.743322] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-09-18T20:29:00.743900] [DEBUG] [LOCAL ] MUE: Trimmed 16312 records to 12020 (keeping 200 days of data) [2025-09-18T20:29:00.822243] [DEBUG] [LOCAL ] MUE: Primary data saved (12020 records). [2025-09-18T20:29:00.822374] [INFO ] [MAIN ] MUE: Full history saved. [2025-09-18T20:29:00.822472] [INFO ] [MAIN ] Update Progress: 1431/2372 symbols completed. MUE took 35.1s. Estimated remaining: 2h 17m 24s. Rate: 6.8 symbols/min [2025-09-18T20:29:00.990638] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:29:01.019559] [DEBUG] [LOCAL ] MUSA: Loaded 25119 existing records from primary storage. [2025-09-18T20:29:01.019717] [INFO ] [MAIN ] MUSA: Loaded 25119 existing records. [2025-09-18T20:29:01.204123] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:29:01.205533] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-09-18T20:29:01.205592] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-09-18T20:29:01.206876] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-09-18T20:29:01.206944] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-09-18T20:29:01.324747] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-11. [2025-09-18T20:29:01.584608] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-18T20:29:01.611341] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:29:02.119542] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-11. [2025-09-18T20:29:02.919543] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-11. [2025-09-18T20:29:03.099953] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-18T20:29:03.154569] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-18T20:29:03.719561] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-09-18T20:29:04.519572] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-09-18T20:29:04.705472] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-18T20:29:04.813233] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-18T20:29:05.319500] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-09-18T20:29:05.497316] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-18T20:29:05.899200] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-18T20:29:06.119556] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-09-18T20:29:06.919573] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-09-18T20:29:07.057980] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-18T20:29:07.719513] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-09-18T20:29:07.879823] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-18T20:29:08.519577] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-09-18T20:29:09.179486] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-18T20:29:09.319542] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-09-18T20:29:10.119547] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-09-18T20:29:10.332101] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-18T20:29:10.919545] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-09-18T20:29:11.217058] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-18T20:29:11.280178] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-18T20:29:11.719603] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-09-18T20:29:11.811846] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-18T20:29:12.519612] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-09-18T20:29:13.071048] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T20:29:13.319575] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-09-18T20:29:13.557618] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-18T20:29:14.119609] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-09-18T20:29:14.886488] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-18T20:29:14.919488] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-09-18T20:29:15.606527] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-18T20:29:15.719549] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-09-18T20:29:16.184907] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-18T20:29:16.519610] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-09-18T20:29:17.246763] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-18T20:29:17.319616] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-09-18T20:29:18.133801] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-09-18T20:29:18.163369] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T20:29:18.608825] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-18T20:29:18.919573] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-09-18T20:29:19.719588] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-09-18T20:29:19.825108] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-18T20:29:19.928986] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-18T20:29:20.464511] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-18T20:29:20.519500] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-09-18T20:29:21.253184] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-18T20:29:21.319495] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-09-18T20:29:22.119561] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-09-18T20:29:22.379961] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-18T20:29:22.382749] [INFO ] [REMOTE ] MUJ: Full fetch complete (20413 records). [2025-09-18T20:29:22.382822] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-09-18T20:29:22.764835] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-09-18T20:29:22.764942] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-09-18T20:29:22.765368] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-09-18T20:29:22.765412] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-09-18T20:29:22.766143] [DEBUG] [LOCAL ] MUJ: Trimmed 20413 records to 13307 (keeping 200 days of data) [2025-09-18T20:29:22.848502] [DEBUG] [LOCAL ] MUJ: Primary data saved (13307 records). [2025-09-18T20:29:22.848675] [INFO ] [MAIN ] MUJ: Full history saved. [2025-09-18T20:29:22.848803] [INFO ] [MAIN ] Update Progress: 1432/2372 symbols completed. MUJ took 25.8s. Estimated remaining: 2h 17m 24s. Rate: 6.8 symbols/min [2025-09-18T20:29:22.928806] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-09-18T20:29:23.031570] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:29:23.031827] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-09-18T20:29:23.031886] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-09-18T20:29:23.032051] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-09-18T20:29:23.032098] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-18T20:29:23.032144] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-18T20:29:23.032221] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-09-18T20:29:23.405688] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:29:23.719557] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-11. [2025-09-18T20:29:24.047627] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-18T20:29:24.083575] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-18T20:29:24.113343] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-18T20:29:24.519578] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-09-18T20:29:25.319557] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-09-18T20:29:25.792235] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-18T20:29:26.119555] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-09-18T20:29:26.352067] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:29:26.352508] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-09-18T20:29:26.528340] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-18T20:29:26.919568] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-02. [2025-09-18T20:29:27.176025] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:29:27.176415] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-02 [2025-09-18T20:29:27.719592] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-03. [2025-09-18T20:29:28.013220] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-18T20:29:28.519544] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-09-18T20:29:29.319567] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-09-18T20:29:29.821923] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T20:29:30.119537] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-09-18T20:29:30.863672] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T20:29:30.919517] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-09-18T20:29:31.719514] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-04. [2025-09-18T20:29:31.811958] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-18T20:29:31.999724] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-18T20:29:32.043254] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-18T20:29:32.519542] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-09-18T20:29:33.319549] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-05. [2025-09-18T20:29:33.629607] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-18T20:29:34.119543] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-09-18T20:29:34.449810] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-18T20:29:34.919517] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-09-18T20:29:35.319430] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-18T20:29:35.719563] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-09-18T20:29:36.519508] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-09-18T20:29:36.613776] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-18T20:29:36.692844] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-18T20:29:36.697027] [INFO ] [REMOTE ] MUSA: Full fetch complete (34973 records). [2025-09-18T20:29:36.697150] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-09-18T20:29:37.101738] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-09-18T20:29:37.101831] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-09-18T20:29:37.102481] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-09-18T20:29:37.102553] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-09-18T20:29:37.104765] [DEBUG] [LOCAL ] MUSA: Trimmed 34973 records to 25316 (keeping 200 days of data) [2025-09-18T20:29:37.273794] [DEBUG] [LOCAL ] MUSA: Primary data saved (25316 records). [2025-09-18T20:29:37.274009] [INFO ] [MAIN ] MUSA: Full history saved. [2025-09-18T20:29:37.274117] [INFO ] [MAIN ] Update Progress: 1433/2372 symbols completed. MUSA took 36.5s. Estimated remaining: 2h 17m 19s. Rate: 6.8 symbols/min [2025-09-18T20:29:37.327414] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-09-18T20:29:37.460436] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:29:37.507103] [DEBUG] [LOCAL ] MUX: Loaded 42198 existing records from primary storage. [2025-09-18T20:29:37.507254] [INFO ] [MAIN ] MUX: Loaded 42198 existing records. [2025-09-18T20:29:37.691426] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:29:37.691757] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-09-18T20:29:37.691815] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-09-18T20:29:37.692717] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-09-18T20:29:37.692779] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-09-18T20:29:38.052034] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:29:38.119528] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-11. [2025-09-18T20:29:38.377121] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-18T20:29:38.919566] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-09-18T20:29:39.171750] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-18T20:29:39.180833] [INFO ] [REMOTE ] MUR: Full fetch complete (76146 records). [2025-09-18T20:29:39.181021] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-09-18T20:29:39.593685] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-18T20:29:39.626160] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-09-18T20:29:39.626248] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-09-18T20:29:39.627249] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-09-18T20:29:39.627317] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-09-18T20:29:39.628932] [DEBUG] [LOCAL ] MUR: Trimmed 76146 records to 53332 (keeping 200 days of data) [2025-09-18T20:29:39.722819] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-06. [2025-09-18T20:29:39.957802] [DEBUG] [LOCAL ] MUR: Primary data saved (53332 records). [2025-09-18T20:29:39.957950] [INFO ] [MAIN ] MUR: Full history saved. [2025-09-18T20:29:39.958037] [INFO ] [MAIN ] Update Progress: 1434/2372 symbols completed. MUR took 40.9s. Estimated remaining: 2h 17m 6s. Rate: 6.8 symbols/min [2025-09-18T20:29:40.038284] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-18T20:29:40.138535] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:29:40.152425] [DEBUG] [LOCAL ] MVF: Loaded 12892 existing records from primary storage. [2025-09-18T20:29:40.152539] [INFO ] [MAIN ] MVF: Loaded 12892 existing records. [2025-09-18T20:29:40.343120] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:29:40.343371] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-09-18T20:29:40.343420] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-09-18T20:29:40.343869] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-09-18T20:29:40.343935] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-09-18T20:29:40.528303] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-09-18T20:29:40.708667] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:29:40.740344] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-18T20:29:41.319617] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-11. [2025-09-18T20:29:42.023599] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T20:29:42.037717] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-18T20:29:42.119560] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-09-18T20:29:42.919562] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-09-18T20:29:42.941602] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-18T20:29:43.719560] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-07. [2025-09-18T20:29:43.977270] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-18T20:29:44.351502] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T20:29:44.519578] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-09-18T20:29:45.319546] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-08. [2025-09-18T20:29:45.592767] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-18T20:29:45.982203] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-18T20:29:46.119535] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-09-18T20:29:46.919596] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-09. [2025-09-18T20:29:47.196260] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:29:47.196593] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-09 [2025-09-18T20:29:47.196725] [INFO ] [REMOTE ] MUSE: Full fetch complete (107 records). [2025-09-18T20:29:47.196801] [DEBUG] [VALIDATOR ] MUSE: Validating primary data. [2025-09-18T20:29:47.197401] [FATAL] [VALIDATOR ] MUSE: Data is stale - most recent date (2025-08-05) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T20:29:47.197481] [FATAL] [MAIN ] MUSE: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:29:47.197548] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:29:47.197620] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-18T20:29:47.197720] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-18T20:29:47.197766] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-09-18T20:29:47.197833] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-09-18T20:29:47.197916] [INFO ] [MAIN ] Update Progress: 1435/2372 symbols completed. MUSE took 24.3s. Estimated remaining: 2h 16m 57s. Rate: 6.8 symbols/min [2025-09-18T20:29:47.378205] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:29:47.389055] [DEBUG] [LOCAL ] MVO: Loaded 9104 existing records from primary storage. [2025-09-18T20:29:47.389172] [INFO ] [MAIN ] MVO: Loaded 9104 existing records. [2025-09-18T20:29:47.574994] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:29:47.575298] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-09-18T20:29:47.575353] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-09-18T20:29:47.575786] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-09-18T20:29:47.575846] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-09-18T20:29:47.726424] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-09-18T20:29:47.943974] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:29:47.971791] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-18T20:29:48.519536] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-11. [2025-09-18T20:29:48.670018] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-18T20:29:49.122251] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-18T20:29:49.319612] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-09-18T20:29:50.119602] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-09-18T20:29:50.328430] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T20:29:50.838992] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-18T20:29:50.919556] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-09-18T20:29:51.719516] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-09-18T20:29:51.966739] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-18T20:29:52.519570] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-09-18T20:29:53.135386] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T20:29:53.151941] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-18T20:29:53.319511] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-09-18T20:29:54.119545] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-09-18T20:29:54.569256] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-18T20:29:54.919542] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-09-18T20:29:55.060433] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T20:29:55.580194] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-18T20:29:55.719574] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-09-18T20:29:56.519556] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-09-18T20:29:56.838501] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-18T20:29:57.319509] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-09-18T20:29:57.591403] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-18T20:29:58.119550] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-09-18T20:29:58.730239] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-18T20:29:58.919515] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-09-18T20:29:58.985530] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-18T20:29:59.459591] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-18T20:29:59.719538] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-09-18T20:30:00.399151] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-18T20:30:00.519540] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-09-18T20:30:01.319555] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-09-18T20:30:02.131411] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-09-18T20:30:02.143248] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-18T20:30:02.919592] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-09-18T20:30:03.621683] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-18T20:30:03.628892] [INFO ] [REMOTE ] MUFG: Full fetch complete (75253 records). [2025-09-18T20:30:03.629026] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-09-18T20:30:03.724757] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-09-18T20:30:04.026048] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-09-18T20:30:04.026135] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-09-18T20:30:04.027102] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-09-18T20:30:04.027167] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-09-18T20:30:04.028684] [DEBUG] [LOCAL ] MUFG: Trimmed 75253 records to 53032 (keeping 200 days of data) [2025-09-18T20:30:04.346706] [DEBUG] [LOCAL ] MUFG: Primary data saved (53032 records). [2025-09-18T20:30:04.346845] [INFO ] [MAIN ] MUFG: Full history saved. [2025-09-18T20:30:04.346943] [INFO ] [MAIN ] Update Progress: 1436/2372 symbols completed. MUFG took 1m 14s. Estimated remaining: 2h 16m 53s. Rate: 6.8 symbols/min [2025-09-18T20:30:04.520987] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:30:04.532487] [DEBUG] [LOCAL ] MVT: Loaded 10102 existing records from primary storage. [2025-09-18T20:30:04.532613] [INFO ] [MAIN ] MVT: Loaded 10102 existing records. [2025-09-18T20:30:04.710596] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:30:04.710895] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-09-18T20:30:04.710942] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-09-18T20:30:04.711325] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-09-18T20:30:04.711384] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-09-18T20:30:05.093049] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:30:05.109792] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-11. [2025-09-18T20:30:05.111931] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-18T20:30:05.118866] [INFO ] [REMOTE ] MUX: Full fetch complete (58308 records). [2025-09-18T20:30:05.118976] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-09-18T20:30:05.418203] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (3.29 seconds). [2025-09-18T20:30:05.434993] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-18T20:30:05.438510] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-09-18T20:30:05.546710] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-09-18T20:30:05.546797] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-09-18T20:30:05.547607] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-09-18T20:30:05.547670] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-09-18T20:30:05.548879] [DEBUG] [LOCAL ] MUX: Trimmed 58308 records to 42565 (keeping 200 days of data) [2025-09-18T20:30:05.801729] [DEBUG] [LOCAL ] MUX: Primary data saved (42565 records). [2025-09-18T20:30:05.801885] [INFO ] [MAIN ] MUX: Full history saved. [2025-09-18T20:30:05.801981] [INFO ] [MAIN ] Update Progress: 1437/2372 symbols completed. MUX took 28.5s. Estimated remaining: 2h 16m 40s. Rate: 6.8 symbols/min [2025-09-18T20:30:06.000821] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-18T20:30:06.089055] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-18T20:30:06.091735] [INFO ] [REMOTE ] MVF: Full fetch complete (19276 records). [2025-09-18T20:30:06.091810] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-09-18T20:30:06.127873] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-09-18T20:30:06.472933] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-09-18T20:30:06.473012] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-09-18T20:30:06.473425] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-09-18T20:30:06.473465] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-09-18T20:30:06.474071] [DEBUG] [LOCAL ] MVF: Trimmed 19276 records to 13036 (keeping 200 days of data) [2025-09-18T20:30:06.547477] [DEBUG] [LOCAL ] MVF: Primary data saved (13036 records). [2025-09-18T20:30:06.547616] [INFO ] [MAIN ] MVF: Full history saved. [2025-09-18T20:30:06.547729] [INFO ] [MAIN ] Update Progress: 1438/2372 symbols completed. MVF took 26.6s. Estimated remaining: 2h 16m 26s. Rate: 6.8 symbols/min [2025-09-18T20:30:06.919507] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-09-18T20:30:07.235279] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T20:30:07.719601] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-09-18T20:30:07.733045] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-18T20:30:08.519609] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-09-18T20:30:08.644828] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-18T20:30:09.155228] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-18T20:30:09.319609] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-09-18T20:30:09.911167] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-18T20:30:10.119568] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-09-18T20:30:10.601880] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-18T20:30:10.919584] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-09-18T20:30:11.416191] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-18T20:30:11.418516] [INFO ] [REMOTE ] MVO: Full fetch complete (14599 records). [2025-09-18T20:30:11.418673] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-09-18T20:30:11.724825] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-09-18T20:30:11.799051] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-09-18T20:30:11.799131] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-09-18T20:30:11.799472] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-09-18T20:30:11.799511] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-09-18T20:30:11.800023] [DEBUG] [LOCAL ] MVO: Trimmed 14599 records to 9152 (keeping 200 days of data) [2025-09-18T20:30:11.858097] [DEBUG] [LOCAL ] MVO: Primary data saved (9152 records). [2025-09-18T20:30:11.858218] [INFO ] [MAIN ] MVO: Full history saved. [2025-09-18T20:30:11.858314] [INFO ] [MAIN ] Update Progress: 1439/2372 symbols completed. MVO took 24.7s. Estimated remaining: 2h 16m 15s. Rate: 6.8 symbols/min [2025-09-18T20:30:12.538596] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-18T20:30:12.540683] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-09-18T20:30:13.754401] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-18T20:30:13.757048] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-09-18T20:30:15.688533] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-18T20:30:15.691727] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-09-18T20:30:16.566704] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-18T20:30:16.569539] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-09-18T20:30:17.562429] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-18T20:30:17.570696] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-09-18T20:30:18.412596] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-18T20:30:18.415213] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-09-18T20:30:19.092021] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-18T20:30:19.094804] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-09-18T20:30:19.915504] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-18T20:30:19.917702] [INFO ] [REMOTE ] MVT: Full fetch complete (14581 records). [2025-09-18T20:30:19.917786] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-09-18T20:30:20.335834] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-09-18T20:30:20.335923] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-09-18T20:30:20.336265] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-09-18T20:30:20.336347] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-09-18T20:30:20.337051] [DEBUG] [LOCAL ] MVT: Trimmed 14581 records to 10161 (keeping 200 days of data) [2025-09-18T20:30:20.399712] [DEBUG] [LOCAL ] MVT: Primary data saved (10161 records). [2025-09-18T20:30:20.399857] [INFO ] [MAIN ] MVT: Full history saved. [2025-09-18T20:30:20.399941] [INFO ] [MAIN ] Update Progress: 1440/2372 symbols completed. MVT took 16.1s. Estimated remaining: 2h 16m 6s. Rate: 6.8 symbols/min [2025-09-18T20:30:20.896881] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:30:21.027042] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:30:21.122484] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:30:21.126050] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:30:21.126321] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-09-18T20:30:21.126432] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-09-18T20:30:21.130620] [DEBUG] [LOCAL ] MXF: Loaded 6127 existing records from primary storage. [2025-09-18T20:30:21.131026] [INFO ] [MAIN ] MXF: Loaded 6127 existing records. [2025-09-18T20:30:21.131185] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-09-18T20:30:21.152582] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-18T20:30:21.162125] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-18T20:30:21.167553] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-09-18T20:30:21.357569] [DEBUG] [LOCAL ] MX: Loaded 22963 existing records from primary storage. [2025-09-18T20:30:21.424883] [INFO ] [MAIN ] MX: Loaded 22963 existing records. [2025-09-18T20:30:21.478732] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:30:21.565182] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-09-18T20:30:21.587972] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-09-18T20:30:21.626626] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-09-18T20:30:21.668554] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-09-18T20:30:21.874198] [DEBUG] [LOCAL ] MWA: Loaded 47233 existing records from primary storage. [2025-09-18T20:30:21.982935] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:30:21.907522] [INFO ] [MAIN ] MWA: Loaded 47233 existing records. [2025-09-18T20:30:21.999342] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-09-18T20:30:22.085715] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-09-18T20:30:22.276898] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-09-18T20:30:22.287663] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-09-18T20:30:22.290813] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:30:22.318734] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-11. [2025-09-18T20:30:22.534334] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:30:22.573661] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-09-18T20:30:22.595255] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-09-18T20:30:22.662871] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-09-18T20:30:22.680418] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-09-18T20:30:22.812621] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:30:22.905608] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-11. [2025-09-18T20:30:23.078482] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:30:23.140941] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-11. [2025-09-18T20:30:23.160783] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-18T20:30:23.178198] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-09-18T20:30:23.324866] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:30:23.325232] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-11. [2025-09-18T20:30:23.770248] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-18T20:30:23.771603] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-09-18T20:30:23.843452] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-18T20:30:23.846215] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-09-18T20:30:24.133725] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-18T20:30:24.135057] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-18T20:30:24.529855] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T20:30:24.535131] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-09-18T20:30:24.577685] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-18T20:30:24.589269] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-18T20:30:24.950707] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-18T20:30:25.319562] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-09-18T20:30:25.455076] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-18T20:30:26.119563] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-09-18T20:30:26.527738] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-18T20:30:26.653467] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-18T20:30:26.919607] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-09-18T20:30:27.403905] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-18T20:30:27.719546] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-09-18T20:30:28.519554] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-09-18T20:30:28.593988] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-18T20:30:29.319596] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-09-18T20:30:29.362245] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T20:30:30.119610] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-09-18T20:30:30.919577] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-09-18T20:30:31.118311] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-18T20:30:31.184333] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-18T20:30:31.719555] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-18T20:30:31.849100] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-18T20:30:32.152301] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-18T20:30:32.519558] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-18T20:30:33.018091] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-18T20:30:33.319551] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-09-18T20:30:34.119563] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-09-18T20:30:34.681268] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T20:30:34.764433] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-18T20:30:34.919605] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-09-18T20:30:35.719551] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-18T20:30:36.098977] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-18T20:30:36.186231] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-18T20:30:36.519561] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-18T20:30:36.967863] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-18T20:30:37.319557] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-18T20:30:37.903717] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-18T20:30:38.119563] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-18T20:30:38.632160] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-18T20:30:38.919555] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-18T20:30:39.333296] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-18T20:30:39.334346] [INFO ] [REMOTE ] MXE: Full fetch complete (2697 records). [2025-09-18T20:30:39.334415] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-09-18T20:30:39.516266] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-18T20:30:39.516499] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:30:39.516583] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:30:39.516704] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-18T20:30:39.516824] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-18T20:30:39.516898] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-09-18T20:30:39.517006] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-09-18T20:30:39.517115] [INFO ] [MAIN ] Update Progress: 1441/2372 symbols completed. MXE took 19.1s. Estimated remaining: 2h 16m 4s. Rate: 6.8 symbols/min [2025-09-18T20:30:39.689453] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:30:39.705837] [DEBUG] [LOCAL ] MYD: Loaded 13861 existing records from primary storage. [2025-09-18T20:30:39.705979] [INFO ] [MAIN ] MYD: Loaded 13861 existing records. [2025-09-18T20:30:39.726512] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-09-18T20:30:39.890373] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:30:39.890595] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-09-18T20:30:39.890665] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-09-18T20:30:39.891386] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-09-18T20:30:39.891448] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-09-18T20:30:40.254353] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:30:40.519559] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-11. [2025-09-18T20:30:41.319570] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-09-18T20:30:41.342036] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-18T20:30:41.473414] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-18T20:30:42.119512] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-09-18T20:30:42.170789] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-18T20:30:42.864245] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-18T20:30:42.919496] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-09-18T20:30:43.719558] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-09-18T20:30:44.519508] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-09-18T20:30:44.566267] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-18T20:30:44.635610] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-18T20:30:45.207617] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-18T20:30:45.319498] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-09-18T20:30:46.119550] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-09-18T20:30:46.832629] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-18T20:30:46.919525] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-09-18T20:30:46.969316] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-18T20:30:47.719578] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-09-18T20:30:48.050151] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T20:30:48.519612] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-09-18T20:30:49.218017] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-18T20:30:49.278170] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T20:30:49.319501] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-09-18T20:30:50.119549] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-09-18T20:30:50.620796] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T20:30:50.919540] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-09-18T20:30:51.054003] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-18T20:30:51.719549] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-09-18T20:30:51.909865] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-18T20:30:52.519560] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-09-18T20:30:53.280147] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-18T20:30:53.327122] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-09-18T20:30:53.330466] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-18T20:30:53.334812] [INFO ] [REMOTE ] MX: Full fetch complete (31719 records). [2025-09-18T20:30:53.334917] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-09-18T20:30:53.748330] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-09-18T20:30:53.748422] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-09-18T20:30:53.749151] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-09-18T20:30:53.749233] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-09-18T20:30:53.750559] [DEBUG] [LOCAL ] MX: Trimmed 31719 records to 23141 (keeping 200 days of data) [2025-09-18T20:30:53.889407] [DEBUG] [LOCAL ] MX: Primary data saved (23141 records). [2025-09-18T20:30:53.889563] [INFO ] [MAIN ] MX: Full history saved. [2025-09-18T20:30:53.889687] [INFO ] [MAIN ] Update Progress: 1442/2372 symbols completed. MX took 33.5s. Estimated remaining: 2h 15m 59s. Rate: 6.8 symbols/min [2025-09-18T20:30:54.079669] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:30:54.108205] [DEBUG] [LOCAL ] MYE: Loaded 25560 existing records from primary storage. [2025-09-18T20:30:54.108368] [INFO ] [MAIN ] MYE: Loaded 25560 existing records. [2025-09-18T20:30:54.130237] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-09-18T20:30:54.308272] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:30:54.308544] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-09-18T20:30:54.308597] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-09-18T20:30:54.309569] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-09-18T20:30:54.309630] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-09-18T20:30:54.684923] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:30:54.919535] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-11. [2025-09-18T20:30:54.999249] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-18T20:30:55.033167] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-18T20:30:55.719548] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-09-18T20:30:56.097913] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-18T20:30:56.519561] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-09-18T20:30:57.247797] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-18T20:30:57.254268] [INFO ] [REMOTE ] MWA: Full fetch complete (67688 records). [2025-09-18T20:30:57.254450] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-09-18T20:30:57.324851] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-09-18T20:30:57.417307] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-18T20:30:57.693700] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-09-18T20:30:57.693833] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-09-18T20:30:57.694831] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-09-18T20:30:57.694917] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-09-18T20:30:57.696868] [DEBUG] [LOCAL ] MWA: Trimmed 67688 records to 47595 (keeping 200 days of data) [2025-09-18T20:30:58.009262] [DEBUG] [LOCAL ] MWA: Primary data saved (47595 records). [2025-09-18T20:30:58.009431] [INFO ] [MAIN ] MWA: Full history saved. [2025-09-18T20:30:58.009566] [INFO ] [MAIN ] Update Progress: 1443/2372 symbols completed. MWA took 37.6s. Estimated remaining: 2h 15m 47s. Rate: 6.8 symbols/min [2025-09-18T20:30:58.124735] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-09-18T20:30:58.190255] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:30:58.190459] [DEBUG] [LOCAL ] MYI: No existing data file found in primary storage. [2025-09-18T20:30:58.190518] [WARN ] [MAIN ] MYI: No existing data found, performing full refresh instead. [2025-09-18T20:30:58.190726] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-09-18T20:30:58.190782] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-09-18T20:30:58.190832] [DEBUG] [LOCAL ] MYI: No primary data file found to delete. [2025-09-18T20:30:58.190867] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-09-18T20:30:58.565195] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:30:58.813184] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-18T20:30:58.814338] [INFO ] [REMOTE ] MXF: Full fetch complete (10603 records). [2025-09-18T20:30:58.814410] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-09-18T20:30:58.922047] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-09-18T20:30:59.180890] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-18T20:30:59.219401] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-09-18T20:30:59.219470] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-09-18T20:30:59.219742] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-09-18T20:30:59.219804] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-09-18T20:30:59.220234] [DEBUG] [LOCAL ] MXF: Trimmed 10603 records to 6134 (keeping 200 days of data) [2025-09-18T20:30:59.258287] [DEBUG] [LOCAL ] MXF: Primary data saved (6134 records). [2025-09-18T20:30:59.258430] [INFO ] [MAIN ] MXF: Full history saved. [2025-09-18T20:30:59.258535] [INFO ] [MAIN ] Update Progress: 1444/2372 symbols completed. MXF took 38.9s. Estimated remaining: 2h 15m 33s. Rate: 6.8 symbols/min [2025-09-18T20:30:59.431597] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:30:59.445443] [DEBUG] [LOCAL ] MYN: Loaded 10421 existing records from primary storage. [2025-09-18T20:30:59.445559] [INFO ] [MAIN ] MYN: Loaded 10421 existing records. [2025-09-18T20:30:59.622806] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:30:59.623059] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-09-18T20:30:59.623108] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-09-18T20:30:59.623492] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-09-18T20:30:59.623584] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-09-18T20:30:59.725020] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-09-18T20:31:00.003040] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:31:00.082326] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-18T20:31:00.519604] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-11. [2025-09-18T20:31:00.674092] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T20:31:01.206179] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-18T20:31:01.319586] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-09-18T20:31:02.089156] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-18T20:31:02.119764] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-09-18T20:31:02.919599] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-09-18T20:31:03.051590] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-18T20:31:03.719571] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-09-18T20:31:03.791494] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-18T20:31:04.523639] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-11. [2025-09-18T20:31:04.526360] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-18T20:31:05.319587] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-09-18T20:31:05.599393] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-18T20:31:06.041068] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T20:31:06.119588] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-09-18T20:31:06.919569] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-09-18T20:31:07.592496] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-18T20:31:07.719561] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-09-18T20:31:07.854801] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-18T20:31:08.237052] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-18T20:31:08.519609] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-09-18T20:31:09.319558] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-09-18T20:31:09.505431] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-18T20:31:10.119627] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-09-18T20:31:10.193204] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-18T20:31:10.919620] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-09-18T20:31:10.970137] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-18T20:31:11.426491] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-18T20:31:11.719604] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-09-18T20:31:12.519603] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-09-18T20:31:13.014338] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-18T20:31:13.262918] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-18T20:31:13.319536] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-09-18T20:31:14.119595] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-09-18T20:31:14.515147] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-18T20:31:14.661310] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-18T20:31:14.663794] [INFO ] [REMOTE ] MYD: Full fetch complete (21025 records). [2025-09-18T20:31:14.663922] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-09-18T20:31:14.922683] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-09-18T20:31:15.080585] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-09-18T20:31:15.080728] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-09-18T20:31:15.081279] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-09-18T20:31:15.081353] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-09-18T20:31:15.082093] [DEBUG] [LOCAL ] MYD: Trimmed 21025 records to 13935 (keeping 200 days of data) [2025-09-18T20:31:15.182040] [DEBUG] [LOCAL ] MYD: Primary data saved (13935 records). [2025-09-18T20:31:15.182263] [INFO ] [MAIN ] MYD: Full history saved. [2025-09-18T20:31:15.182505] [INFO ] [MAIN ] Update Progress: 1445/2372 symbols completed. MYD took 35.7s. Estimated remaining: 2h 15m 29s. Rate: 6.8 symbols/min [2025-09-18T20:31:15.381460] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:31:15.446798] [DEBUG] [LOCAL ] NABL: Loaded 40412 existing records from primary storage. [2025-09-18T20:31:15.446984] [INFO ] [MAIN ] NABL: Loaded 40412 existing records. [2025-09-18T20:31:15.629110] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:31:15.629406] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-09-18T20:31:15.629472] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-09-18T20:31:15.630577] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-09-18T20:31:15.630671] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-09-18T20:31:15.729499] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-09-18T20:31:16.013047] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-18T20:31:16.041237] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:31:16.519546] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-09-18T20:31:16.928877] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-18T20:31:17.319559] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-09-18T20:31:17.394260] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-18T20:31:18.119584] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-09-18T20:31:18.682150] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-18T20:31:18.867058] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-18T20:31:18.919502] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-09-18T20:31:19.719627] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-11. [2025-09-18T20:31:20.138511] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-18T20:31:20.519572] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-09-18T20:31:20.799811] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-18T20:31:21.319569] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-09-18T20:31:21.659182] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-18T20:31:21.663099] [INFO ] [REMOTE ] MYE: Full fetch complete (37109 records). [2025-09-18T20:31:21.663203] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-09-18T20:31:22.044117] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-09-18T20:31:22.044199] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-09-18T20:31:22.044932] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-09-18T20:31:22.044995] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-09-18T20:31:22.046181] [DEBUG] [LOCAL ] MYE: Trimmed 37109 records to 25748 (keeping 200 days of data) [2025-09-18T20:31:22.121087] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-09-18T20:31:22.223148] [DEBUG] [LOCAL ] MYE: Primary data saved (25748 records). [2025-09-18T20:31:22.223288] [INFO ] [MAIN ] MYE: Full history saved. [2025-09-18T20:31:22.223420] [INFO ] [MAIN ] Update Progress: 1446/2372 symbols completed. MYE took 28.3s. Estimated remaining: 2h 15m 19s. Rate: 6.8 symbols/min [2025-09-18T20:31:22.412342] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:31:22.439960] [DEBUG] [LOCAL ] NAC: Loaded 24830 existing records from primary storage. [2025-09-18T20:31:22.440099] [INFO ] [MAIN ] NAC: Loaded 24830 existing records. [2025-09-18T20:31:22.651614] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:31:22.652119] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-09-18T20:31:22.652473] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-09-18T20:31:22.660139] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-09-18T20:31:22.672547] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-09-18T20:31:22.719315] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-18T20:31:22.811056] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-18T20:31:22.927990] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-09-18T20:31:23.055837] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:31:23.719546] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-11. [2025-09-18T20:31:24.402612] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-18T20:31:24.519495] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-09-18T20:31:24.977507] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-18T20:31:25.319553] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-09-18T20:31:25.694056] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-18T20:31:26.119551] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-09-18T20:31:26.710738] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T20:31:26.773958] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-18T20:31:26.919560] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-09-18T20:31:27.719569] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-09-18T20:31:28.527572] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-09-18T20:31:28.533822] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T20:31:28.572111] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-18T20:31:29.319566] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-09-18T20:31:29.870883] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-18T20:31:29.939174] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-18T20:31:30.119560] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-09-18T20:31:30.919574] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-09-18T20:31:31.704547] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T20:31:31.719492] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-09-18T20:31:31.756362] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-18T20:31:32.519551] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-09-18T20:31:33.049767] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T20:31:33.319568] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-09-18T20:31:33.677545] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-18T20:31:34.119508] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-09-18T20:31:34.189006] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-18T20:31:34.919600] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-09-18T20:31:35.186031] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-18T20:31:35.719596] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-09-18T20:31:36.290304] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-18T20:31:36.519549] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-09-18T20:31:37.256968] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T20:31:37.319509] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-09-18T20:31:37.346142] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-18T20:31:38.119549] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-09-18T20:31:38.446834] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T20:31:38.919560] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-09-18T20:31:39.230389] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-18T20:31:39.235553] [INFO ] [REMOTE ] MYI: Full fetch complete (29607 records). [2025-09-18T20:31:39.235727] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-09-18T20:31:39.621866] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-09-18T20:31:39.621957] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-09-18T20:31:39.622865] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-09-18T20:31:39.622935] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-09-18T20:31:39.623802] [DEBUG] [LOCAL ] MYI: Trimmed 29607 records to 19575 (keeping 200 days of data) [2025-09-18T20:31:39.734553] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-09-18T20:31:39.777934] [DEBUG] [LOCAL ] MYI: Primary data saved (19575 records). [2025-09-18T20:31:39.778182] [INFO ] [MAIN ] MYI: Full history saved. [2025-09-18T20:31:39.778333] [INFO ] [MAIN ] Update Progress: 1447/2372 symbols completed. MYI took 41.8s. Estimated remaining: 2h 15m 16s. Rate: 6.8 symbols/min [2025-09-18T20:31:39.846023] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-18T20:31:39.890824] [INFO ] [REMOTE ] MYN: Full fetch complete (15621 records). [2025-09-18T20:31:39.903161] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-09-18T20:31:40.113023] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:31:40.396995] [DEBUG] [LOCAL ] NAD: Loaded 34208 existing records from primary storage. [2025-09-18T20:31:40.420937] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-09-18T20:31:40.421062] [INFO ] [MAIN ] NAD: Loaded 34208 existing records. [2025-09-18T20:31:40.421176] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-09-18T20:31:40.453632] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-09-18T20:31:40.465183] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-09-18T20:31:40.524804] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-09-18T20:31:40.527850] [DEBUG] [LOCAL ] MYN: Trimmed 15621 records to 10499 (keeping 200 days of data) [2025-09-18T20:31:40.662231] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:31:40.681398] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-09-18T20:31:40.680842] [DEBUG] [LOCAL ] MYN: Primary data saved (10499 records). [2025-09-18T20:31:40.681840] [INFO ] [MAIN ] MYN: Full history saved. [2025-09-18T20:31:40.681773] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-09-18T20:31:40.682046] [INFO ] [MAIN ] Update Progress: 1448/2372 symbols completed. MYN took 41.4s. Estimated remaining: 2h 15m 2s. Rate: 6.8 symbols/min [2025-09-18T20:31:40.714560] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-09-18T20:31:40.752732] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-09-18T20:31:41.033400] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:31:41.205138] [DEBUG] [LOCAL ] NAN: Loaded 9127 existing records from primary storage. [2025-09-18T20:31:41.231489] [INFO ] [MAIN ] NAN: Loaded 9127 existing records. [2025-09-18T20:31:41.301333] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:31:41.325921] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-11. [2025-09-18T20:31:41.419024] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-18T20:31:41.518089] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:31:41.518367] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-09-18T20:31:41.518419] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-09-18T20:31:41.518815] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-09-18T20:31:41.518878] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-09-18T20:31:41.837878] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-18T20:31:41.909163] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:31:42.119546] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-11. [2025-09-18T20:31:42.822123] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-18T20:31:42.879289] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-18T20:31:42.919509] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-09-18T20:31:43.719568] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-09-18T20:31:44.524684] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-09-18T20:31:44.538492] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-18T20:31:44.558026] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T20:31:45.319561] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-09-18T20:31:45.913086] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-18T20:31:45.919364] [INFO ] [REMOTE ] NABL: Full fetch complete (56654 records). [2025-09-18T20:31:45.919514] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-09-18T20:31:46.078028] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-18T20:31:46.130666] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-09-18T20:31:46.377256] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-09-18T20:31:46.377345] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-09-18T20:31:46.378318] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-09-18T20:31:46.378401] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-09-18T20:31:46.380555] [DEBUG] [LOCAL ] NABL: Trimmed 56654 records to 40697 (keeping 200 days of data) [2025-09-18T20:31:46.643534] [DEBUG] [LOCAL ] NABL: Primary data saved (40697 records). [2025-09-18T20:31:46.643698] [INFO ] [MAIN ] NABL: Full history saved. [2025-09-18T20:31:46.644955] [INFO ] [MAIN ] Update Progress: 1449/2372 symbols completed. NABL took 31.5s. Estimated remaining: 2h 14m 52s. Rate: 6.8 symbols/min [2025-09-18T20:31:46.831044] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:31:46.884803] [DEBUG] [LOCAL ] NAT: Loaded 49155 existing records from primary storage. [2025-09-18T20:31:46.884986] [INFO ] [MAIN ] NAT: Loaded 49155 existing records. [2025-09-18T20:31:46.924745] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-09-18T20:31:47.101851] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:31:47.110531] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-18T20:31:47.110686] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-09-18T20:31:47.114115] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-09-18T20:31:47.115621] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-09-18T20:31:47.115706] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-09-18T20:31:47.499615] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:31:47.719540] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-11. [2025-09-18T20:31:48.200876] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-18T20:31:48.519570] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-09-18T20:31:49.319553] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-09-18T20:31:49.431355] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-18T20:31:49.589468] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-18T20:31:50.119551] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-09-18T20:31:50.267089] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-18T20:31:50.704000] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-18T20:31:50.919538] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-09-18T20:31:51.719544] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-09-18T20:31:51.986307] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-18T20:31:52.519560] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-09-18T20:31:52.618046] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-18T20:31:53.319558] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-09-18T20:31:53.582895] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-18T20:31:54.119550] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-09-18T20:31:54.532935] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-18T20:31:54.716153] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-18T20:31:54.919543] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-09-18T20:31:55.719532] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-09-18T20:31:56.086278] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-18T20:31:56.090530] [INFO ] [REMOTE ] NAC: Full fetch complete (36343 records). [2025-09-18T20:31:56.090627] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-09-18T20:31:56.473623] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-09-18T20:31:56.473737] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-09-18T20:31:56.474437] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-09-18T20:31:56.474507] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-09-18T20:31:56.475495] [DEBUG] [LOCAL ] NAC: Trimmed 36343 records to 25000 (keeping 200 days of data) [2025-09-18T20:31:56.529401] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-09-18T20:31:56.634625] [DEBUG] [LOCAL ] NAC: Primary data saved (25000 records). [2025-09-18T20:31:56.634797] [INFO ] [MAIN ] NAC: Full history saved. [2025-09-18T20:31:56.634885] [INFO ] [MAIN ] Update Progress: 1450/2372 symbols completed. NAC took 34.4s. Estimated remaining: 2h 14m 44s. Rate: 6.8 symbols/min [2025-09-18T20:31:56.806908] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:31:56.845536] [DEBUG] [LOCAL ] NATL: Loaded 32892 existing records from primary storage. [2025-09-18T20:31:56.845727] [INFO ] [MAIN ] NATL: Loaded 32892 existing records. [2025-09-18T20:31:57.038148] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:31:57.038758] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-09-18T20:31:57.038860] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-09-18T20:31:57.039784] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-09-18T20:31:57.039849] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-09-18T20:31:57.241489] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T20:31:57.329557] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-09-18T20:31:57.310711] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-18T20:31:57.464302] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:31:58.119619] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-09-18T20:31:58.919567] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-11. [2025-09-18T20:31:59.411086] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-18T20:31:59.559256] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-18T20:31:59.719586] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-09-18T20:32:00.011442] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T20:32:00.159630] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-18T20:32:00.519553] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-09-18T20:32:01.319568] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-09-18T20:32:02.118364] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-18T20:32:02.124802] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-09-18T20:32:02.560130] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-18T20:32:02.919583] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-09-18T20:32:03.719586] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-09-18T20:32:04.519708] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-09-18T20:32:04.844673] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-09-18T20:32:05.319620] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-09-18T20:32:05.372750] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-18T20:32:06.119614] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-09-18T20:32:06.566357] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (2.85 seconds). [2025-09-18T20:32:06.647954] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-18T20:32:06.663853] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-18T20:32:06.769439] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T20:32:06.919540] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-09-18T20:32:07.719597] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-09-18T20:32:08.519544] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-09-18T20:32:08.697541] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-18T20:32:08.945662] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-18T20:32:09.242427] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-18T20:32:09.319490] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-09-18T20:32:10.119594] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-09-18T20:32:10.262121] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T20:32:10.919572] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-09-18T20:32:11.454110] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T20:32:11.459187] [INFO ] [REMOTE ] NAD: Full fetch complete (50314 records). [2025-09-18T20:32:11.459312] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-09-18T20:32:11.724746] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-09-18T20:32:11.854271] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-09-18T20:32:11.854410] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-09-18T20:32:11.855241] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-09-18T20:32:11.855344] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-09-18T20:32:11.861321] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-18T20:32:11.863696] [INFO ] [REMOTE ] NAN: Full fetch complete (14257 records). [2025-09-18T20:32:11.863781] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-09-18T20:32:11.896424] [DEBUG] [LOCAL ] NAD: Trimmed 50314 records to 34426 (keeping 200 days of data) [2025-09-18T20:32:12.447218] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-09-18T20:32:12.453892] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-09-18T20:32:12.459067] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-09-18T20:32:12.461667] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-09-18T20:32:12.464504] [DEBUG] [LOCAL ] NAN: Trimmed 14257 records to 9175 (keeping 200 days of data) [2025-09-18T20:32:12.523283] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-09-18T20:32:12.526729] [DEBUG] [LOCAL ] NAD: Primary data saved (34426 records). [2025-09-18T20:32:12.527671] [INFO ] [MAIN ] NAD: Full history saved. [2025-09-18T20:32:12.528101] [INFO ] [MAIN ] Update Progress: 1451/2372 symbols completed. NAD took 32.7s. Estimated remaining: 2h 14m 40s. Rate: 6.8 symbols/min [2025-09-18T20:32:12.636554] [DEBUG] [LOCAL ] NAN: Primary data saved (9175 records). [2025-09-18T20:32:12.639193] [INFO ] [MAIN ] NAN: Full history saved. [2025-09-18T20:32:12.639308] [INFO ] [MAIN ] Update Progress: 1452/2372 symbols completed. NAN took 32.0s. Estimated remaining: 2h 14m 25s. Rate: 6.8 symbols/min [2025-09-18T20:32:12.815761] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:32:12.872450] [DEBUG] [LOCAL ] NAZ: Loaded 2738 existing records from primary storage. [2025-09-18T20:32:12.892388] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:32:12.892879] [INFO ] [MAIN ] NAZ: Loaded 2738 existing records. [2025-09-18T20:32:13.018855] [DEBUG] [LOCAL ] NBB: Loaded 8927 existing records from primary storage. [2025-09-18T20:32:13.047525] [INFO ] [MAIN ] NBB: Loaded 8927 existing records. [2025-09-18T20:32:13.172425] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:32:13.197297] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-09-18T20:32:13.197483] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-09-18T20:32:13.223979] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-09-18T20:32:13.238499] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-09-18T20:32:13.305160] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:32:13.362322] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-09-18T20:32:13.373084] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-09-18T20:32:13.392195] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-09-18T20:32:13.392344] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-09-18T20:32:13.902483] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-18T20:32:13.908857] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:32:13.960227] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-11. [2025-09-18T20:32:14.127298] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-09-18T20:32:14.137119] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:32:14.168854] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-18T20:32:14.919603] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-09-18T20:32:15.408558] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-18T20:32:15.719549] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-09-18T20:32:16.519604] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-11. [2025-09-18T20:32:16.580325] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-18T20:32:16.681546] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-09-18T20:32:16.728940] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-18T20:32:17.157090] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-18T20:32:17.319509] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-09-18T20:32:17.873921] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-18T20:32:18.119548] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-09-18T20:32:18.665583] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-18T20:32:18.919569] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-09-18T20:32:19.719583] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-09-18T20:32:19.796472] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-18T20:32:20.519548] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-09-18T20:32:21.319566] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-09-18T20:32:21.757962] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-18T20:32:21.861944] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-18T20:32:21.933866] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-18T20:32:22.119554] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-09-18T20:32:22.736849] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-18T20:32:22.919558] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-09-18T20:32:23.701329] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-18T20:32:23.719503] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-09-18T20:32:24.519559] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-09-18T20:32:24.889877] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T20:32:25.319552] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-09-18T20:32:26.119569] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-09-18T20:32:26.341987] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-18T20:32:26.676877] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-18T20:32:26.919547] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-09-18T20:32:27.719566] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-09-18T20:32:28.000010] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-18T20:32:28.025849] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-18T20:32:28.030976] [INFO ] [REMOTE ] NATL: Full fetch complete (45492 records). [2025-09-18T20:32:28.031078] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-09-18T20:32:28.142161] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-18T20:32:28.417713] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-09-18T20:32:28.417799] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-09-18T20:32:28.418481] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-09-18T20:32:28.418576] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-09-18T20:32:28.419577] [DEBUG] [LOCAL ] NATL: Trimmed 45492 records to 33165 (keeping 200 days of data) [2025-09-18T20:32:28.521403] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-09-18T20:32:28.623982] [DEBUG] [LOCAL ] NATL: Primary data saved (33165 records). [2025-09-18T20:32:28.624139] [INFO ] [MAIN ] NATL: Full history saved. [2025-09-18T20:32:28.624232] [INFO ] [MAIN ] Update Progress: 1453/2372 symbols completed. NATL took 32.0s. Estimated remaining: 2h 14m 21s. Rate: 6.8 symbols/min [2025-09-18T20:32:28.819364] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:32:28.843491] [DEBUG] [LOCAL ] NBHC: Loaded 22916 existing records from primary storage. [2025-09-18T20:32:28.843679] [INFO ] [MAIN ] NBHC: Loaded 22916 existing records. [2025-09-18T20:32:29.040136] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:32:29.040414] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-09-18T20:32:29.040462] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-09-18T20:32:29.041115] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-09-18T20:32:29.041177] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-09-18T20:32:29.324709] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-09-18T20:32:29.445373] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:32:30.119579] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-09-18T20:32:30.727335] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-18T20:32:30.919600] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-09-18T20:32:31.262184] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-18T20:32:31.508874] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-18T20:32:31.719607] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-09-18T20:32:32.307260] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-18T20:32:32.519556] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-09-18T20:32:32.941720] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (4.42 seconds). [2025-09-18T20:32:33.319556] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-11. [2025-09-18T20:32:34.119539] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-09-18T20:32:34.367268] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-18T20:32:34.374466] [INFO ] [REMOTE ] NAT: Full fetch complete (72145 records). [2025-09-18T20:32:34.374603] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-09-18T20:32:34.766880] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-18T20:32:34.846001] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-18T20:32:34.846274] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-09-18T20:32:34.848698] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-09-18T20:32:34.850002] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-09-18T20:32:34.850379] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-09-18T20:32:34.852298] [DEBUG] [LOCAL ] NAT: Trimmed 72145 records to 49532 (keeping 200 days of data) [2025-09-18T20:32:34.940962] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-09-18T20:32:35.163037] [DEBUG] [LOCAL ] NAT: Primary data saved (49532 records). [2025-09-18T20:32:35.163201] [INFO ] [MAIN ] NAT: Full history saved. [2025-09-18T20:32:35.164045] [INFO ] [MAIN ] Update Progress: 1454/2372 symbols completed. NAT took 48.5s. Estimated remaining: 2h 14m 11s. Rate: 6.8 symbols/min [2025-09-18T20:32:35.350769] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:32:35.388330] [DEBUG] [LOCAL ] NBR: Loaded 35033 existing records from primary storage. [2025-09-18T20:32:35.388481] [INFO ] [MAIN ] NBR: Loaded 35033 existing records. [2025-09-18T20:32:35.600590] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:32:35.601052] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-09-18T20:32:35.601136] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-09-18T20:32:35.602380] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-09-18T20:32:35.602452] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-09-18T20:32:35.724626] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-09-18T20:32:35.892352] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-18T20:32:35.970558] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:32:36.447878] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-18T20:32:36.519498] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-09-18T20:32:37.059000] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-18T20:32:37.319573] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-09-18T20:32:37.969333] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-18T20:32:37.970609] [INFO ] [REMOTE ] NAZ: Full fetch complete (4428 records). [2025-09-18T20:32:37.970706] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-09-18T20:32:38.144687] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-09-18T20:32:38.333427] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-09-18T20:32:38.333507] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-09-18T20:32:38.333673] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-09-18T20:32:38.333735] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-09-18T20:32:38.334127] [DEBUG] [LOCAL ] NAZ: Trimmed 4428 records to 2749 (keeping 200 days of data) [2025-09-18T20:32:38.351319] [DEBUG] [LOCAL ] NAZ: Primary data saved (2749 records). [2025-09-18T20:32:38.351381] [INFO ] [MAIN ] NAZ: Full history saved. [2025-09-18T20:32:38.351453] [INFO ] [MAIN ] Update Progress: 1455/2372 symbols completed. NAZ took 25.8s. Estimated remaining: 2h 13m 59s. Rate: 6.8 symbols/min [2025-09-18T20:32:38.525222] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:32:38.548474] [DEBUG] [LOCAL ] NBXG: Loaded 22876 existing records from primary storage. [2025-09-18T20:32:38.548604] [INFO ] [MAIN ] NBXG: Loaded 22876 existing records. [2025-09-18T20:32:38.724809] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:32:38.725056] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-09-18T20:32:38.725113] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-09-18T20:32:38.725829] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-09-18T20:32:38.725887] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-09-18T20:32:38.928108] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-09-18T20:32:39.096426] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:32:39.358079] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-18T20:32:39.599851] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-18T20:32:39.719608] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-09-18T20:32:40.519619] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-11. [2025-09-18T20:32:40.526633] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-18T20:32:40.528551] [INFO ] [REMOTE ] NBB: Full fetch complete (13994 records). [2025-09-18T20:32:40.528671] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-09-18T20:32:40.911878] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-09-18T20:32:40.911967] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-09-18T20:32:40.912318] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-09-18T20:32:40.912360] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-09-18T20:32:40.912929] [DEBUG] [LOCAL ] NBB: Trimmed 13994 records to 8992 (keeping 200 days of data) [2025-09-18T20:32:40.969404] [DEBUG] [LOCAL ] NBB: Primary data saved (8992 records). [2025-09-18T20:32:40.969547] [INFO ] [MAIN ] NBB: Full history saved. [2025-09-18T20:32:40.969635] [INFO ] [MAIN ] Update Progress: 1456/2372 symbols completed. NBB took 28.3s. Estimated remaining: 2h 13m 46s. Rate: 6.8 symbols/min [2025-09-18T20:32:41.144573] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:32:41.149208] [DEBUG] [LOCAL ] NC: Loaded 1920 existing records from primary storage. [2025-09-18T20:32:41.149297] [INFO ] [MAIN ] NC: Loaded 1920 existing records. [2025-09-18T20:32:41.325580] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-09-18T20:32:41.325469] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:32:41.327081] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-09-18T20:32:41.327143] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-09-18T20:32:41.327332] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-09-18T20:32:41.327391] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-09-18T20:32:41.686528] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:32:41.717190] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-18T20:32:42.119596] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-11. [2025-09-18T20:32:42.641854] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-18T20:32:42.656707] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-18T20:32:42.919550] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-11. [2025-09-18T20:32:43.719555] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-09-18T20:32:44.004552] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T20:32:44.519571] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-09-18T20:32:44.634823] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-18T20:32:45.319616] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-09-18T20:32:45.665989] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-18T20:32:46.119564] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-09-18T20:32:46.395225] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-18T20:32:46.919560] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-09-18T20:32:47.040533] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-18T20:32:47.719594] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-09-18T20:32:47.964456] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-18T20:32:48.519545] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-09-18T20:32:48.670277] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-18T20:32:48.970240] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-18T20:32:49.319550] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-09-18T20:32:49.733768] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-18T20:32:50.119577] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-09-18T20:32:50.919563] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-09-18T20:32:51.631955] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-18T20:32:51.719526] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-09-18T20:32:51.770914] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-18T20:32:52.519613] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-09-18T20:32:52.915831] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-18T20:32:53.319558] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-09-18T20:32:53.623089] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-18T20:32:54.119597] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-09-18T20:32:54.837357] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T20:32:54.919620] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-09-18T20:32:55.456992] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-18T20:32:55.719565] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-09-18T20:32:56.295105] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-18T20:32:56.519696] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-09-18T20:32:57.060515] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-18T20:32:57.113425] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T20:32:57.319565] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-09-18T20:32:58.119558] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-09-18T20:32:58.466830] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-18T20:32:58.919527] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-09-18T20:32:59.293754] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-18T20:32:59.298162] [INFO ] [REMOTE ] NBHC: Full fetch complete (31511 records). [2025-09-18T20:32:59.298248] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-09-18T20:32:59.687285] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-09-18T20:32:59.687370] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-09-18T20:32:59.688004] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-09-18T20:32:59.688068] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-09-18T20:32:59.689209] [DEBUG] [LOCAL ] NBHC: Trimmed 31511 records to 23207 (keeping 200 days of data) [2025-09-18T20:32:59.741945] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-09-18T20:32:59.836066] [DEBUG] [LOCAL ] NBHC: Primary data saved (23207 records). [2025-09-18T20:32:59.836200] [INFO ] [MAIN ] NBHC: Full history saved. [2025-09-18T20:32:59.836283] [INFO ] [MAIN ] Update Progress: 1457/2372 symbols completed. NBHC took 31.2s. Estimated remaining: 2h 13m 44s. Rate: 6.8 symbols/min [2025-09-18T20:33:00.012955] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:33:00.024674] [DEBUG] [LOCAL ] NCA: Loaded 9980 existing records from primary storage. [2025-09-18T20:33:00.024794] [INFO ] [MAIN ] NCA: Loaded 9980 existing records. [2025-09-18T20:33:00.206294] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:33:00.206910] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-09-18T20:33:00.206988] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-09-18T20:33:00.207483] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-09-18T20:33:00.207568] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-09-18T20:33:00.391909] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-18T20:33:00.525277] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-09-18T20:33:00.614106] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:33:00.628860] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-18T20:33:01.319549] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-09-18T20:33:02.119566] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-09-18T20:33:02.212120] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-18T20:33:02.919561] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-11. [2025-09-18T20:33:03.574282] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-18T20:33:03.719568] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-09-18T20:33:03.817100] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-18T20:33:04.249807] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-18T20:33:04.267373] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-18T20:33:04.519553] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-09-18T20:33:05.319560] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-09-18T20:33:05.453008] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-18T20:33:05.850057] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-18T20:33:06.119546] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-09-18T20:33:06.919572] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-09-18T20:33:07.056633] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-18T20:33:07.593330] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-18T20:33:07.719744] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-09-18T20:33:08.519709] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-09-18T20:33:08.557601] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-18T20:33:09.319553] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-09-18T20:33:09.626325] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-18T20:33:09.631557] [INFO ] [REMOTE ] NBR: Full fetch complete (49133 records). [2025-09-18T20:33:09.631677] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-09-18T20:33:09.949149] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-18T20:33:10.041692] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-09-18T20:33:10.041784] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-09-18T20:33:10.042615] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-09-18T20:33:10.042689] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-09-18T20:33:10.043848] [DEBUG] [LOCAL ] NBR: Trimmed 49133 records to 35282 (keeping 200 days of data) [2025-09-18T20:33:10.127580] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-09-18T20:33:10.256195] [DEBUG] [LOCAL ] NBR: Primary data saved (35282 records). [2025-09-18T20:33:10.256359] [INFO ] [MAIN ] NBR: Full history saved. [2025-09-18T20:33:10.256465] [INFO ] [MAIN ] Update Progress: 1458/2372 symbols completed. NBR took 35.1s. Estimated remaining: 2h 13m 36s. Rate: 6.8 symbols/min [2025-09-18T20:33:10.430901] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:33:10.453422] [DEBUG] [LOCAL ] NCDL: Loaded 21844 existing records from primary storage. [2025-09-18T20:33:10.453574] [INFO ] [MAIN ] NCDL: Loaded 21844 existing records. [2025-09-18T20:33:10.637175] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:33:10.637411] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-09-18T20:33:10.637473] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-09-18T20:33:10.638234] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-09-18T20:33:10.638301] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-09-18T20:33:10.741585] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-18T20:33:10.924695] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-09-18T20:33:11.027349] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:33:11.306850] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-18T20:33:11.719608] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-11. [2025-09-18T20:33:12.519615] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-09-18T20:33:13.177152] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-18T20:33:13.319581] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-09-18T20:33:14.119549] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-09-18T20:33:14.806205] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T20:33:14.807153] [INFO ] [REMOTE ] NC: Full fetch complete (2704 records). [2025-09-18T20:33:14.807226] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-09-18T20:33:14.923267] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-09-18T20:33:15.216834] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-09-18T20:33:15.217062] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-09-18T20:33:15.217243] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-09-18T20:33:15.217356] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-09-18T20:33:15.218256] [DEBUG] [LOCAL ] NC: Trimmed 2704 records to 1936 (keeping 200 days of data) [2025-09-18T20:33:15.240973] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-09-18T20:33:15.248958] [DEBUG] [LOCAL ] NC: Primary data saved (1936 records). [2025-09-18T20:33:15.249398] [INFO ] [MAIN ] NC: Full history saved. [2025-09-18T20:33:15.249519] [INFO ] [MAIN ] Update Progress: 1459/2372 symbols completed. NC took 34.3s. Estimated remaining: 2h 13m 25s. Rate: 6.8 symbols/min [2025-09-18T20:33:15.426219] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:33:15.426475] [DEBUG] [LOCAL ] NCLH: No existing data file found in primary storage. [2025-09-18T20:33:15.426543] [WARN ] [MAIN ] NCLH: No existing data found, performing full refresh instead. [2025-09-18T20:33:15.426777] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-09-18T20:33:15.426847] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-09-18T20:33:15.426967] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-09-18T20:33:15.427042] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-09-18T20:33:15.723999] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-09-18T20:33:15.762801] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T20:33:15.821826] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:33:16.519505] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-11. [2025-09-18T20:33:16.569816] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-18T20:33:17.200486] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T20:33:17.319546] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-09-18T20:33:18.089761] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-18T20:33:18.134115] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-09-18T20:33:18.140226] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-18T20:33:18.919558] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-09-18T20:33:18.986960] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-18T20:33:19.719576] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-09-18T20:33:20.519522] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-09-18T20:33:20.762874] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-18T20:33:20.766023] [INFO ] [REMOTE ] NBXG: Full fetch complete (33241 records). [2025-09-18T20:33:20.766104] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-09-18T20:33:21.140664] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-09-18T20:33:21.147557] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-09-18T20:33:21.148666] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-09-18T20:33:21.147852] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-18T20:33:21.148887] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-09-18T20:33:21.153054] [DEBUG] [LOCAL ] NBXG: Trimmed 33241 records to 23058 (keeping 200 days of data) [2025-09-18T20:33:21.284361] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-18T20:33:21.325968] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-09-18T20:33:21.337501] [DEBUG] [LOCAL ] NBXG: Primary data saved (23058 records). [2025-09-18T20:33:21.337578] [INFO ] [MAIN ] NBXG: Full history saved. [2025-09-18T20:33:21.337674] [INFO ] [MAIN ] Update Progress: 1460/2372 symbols completed. NBXG took 43.0s. Estimated remaining: 2h 13m 14s. Rate: 6.8 symbols/min [2025-09-18T20:33:21.508361] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:33:21.524636] [DEBUG] [LOCAL ] NCV: Loaded 13420 existing records from primary storage. [2025-09-18T20:33:21.524834] [INFO ] [MAIN ] NCV: Loaded 13420 existing records. [2025-09-18T20:33:21.708420] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:33:21.708728] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-09-18T20:33:21.708785] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-09-18T20:33:21.709430] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-09-18T20:33:21.709492] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-09-18T20:33:22.062401] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:33:22.119491] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-11. [2025-09-18T20:33:22.919624] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-09-18T20:33:22.939594] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T20:33:23.509980] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T20:33:23.719549] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-09-18T20:33:24.502788] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-18T20:33:24.519509] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-09-18T20:33:24.931518] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-18T20:33:25.299447] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-18T20:33:25.319499] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-09-18T20:33:25.992873] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-18T20:33:26.119545] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-09-18T20:33:26.919556] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-09-18T20:33:27.085284] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-18T20:33:27.660458] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-18T20:33:27.719555] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-09-18T20:33:28.519564] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-09-18T20:33:28.935166] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-18T20:33:29.309405] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-18T20:33:29.319503] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-09-18T20:33:30.119586] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-09-18T20:33:30.164481] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-18T20:33:30.919561] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-09-18T20:33:31.592850] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-18T20:33:31.719520] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-09-18T20:33:31.832328] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-18T20:33:32.370579] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-18T20:33:32.519569] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-09-18T20:33:33.140415] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-18T20:33:33.319561] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-09-18T20:33:34.119545] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-09-18T20:33:34.284883] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-18T20:33:34.919550] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-09-18T20:33:34.960264] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-18T20:33:35.719553] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-09-18T20:33:35.944936] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-18T20:33:36.519628] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-09-18T20:33:37.319528] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-09-18T20:33:37.591057] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-18T20:33:37.714041] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-18T20:33:38.119553] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-09-18T20:33:38.196955] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-18T20:33:38.919558] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-09-18T20:33:39.628479] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-18T20:33:39.719525] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-09-18T20:33:40.513182] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-18T20:33:40.523781] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-09-18T20:33:40.924220] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-18T20:33:40.926813] [INFO ] [REMOTE ] NCV: Full fetch complete (23237 records). [2025-09-18T20:33:40.926919] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-09-18T20:33:41.306093] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-09-18T20:33:41.306178] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-09-18T20:33:41.306686] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-09-18T20:33:41.306768] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-09-18T20:33:41.307466] [DEBUG] [LOCAL ] NCV: Trimmed 23237 records to 13525 (keeping 200 days of data) [2025-09-18T20:33:41.342300] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-09-18T20:33:41.396980] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-18T20:33:41.407802] [DEBUG] [LOCAL ] NCV: Primary data saved (13525 records). [2025-09-18T20:33:41.407902] [INFO ] [MAIN ] NCV: Full history saved. [2025-09-18T20:33:41.408026] [INFO ] [MAIN ] Update Progress: 1461/2372 symbols completed. NCV took 20.1s. Estimated remaining: 2h 13m 13s. Rate: 6.8 symbols/min [2025-09-18T20:33:41.587975] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:33:41.601636] [DEBUG] [LOCAL ] NCZ: Loaded 11777 existing records from primary storage. [2025-09-18T20:33:41.601787] [INFO ] [MAIN ] NCZ: Loaded 11777 existing records. [2025-09-18T20:33:41.825987] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:33:41.826229] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-09-18T20:33:41.826278] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-09-18T20:33:41.826716] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-09-18T20:33:41.826778] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-09-18T20:33:42.124677] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-09-18T20:33:42.218499] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:33:42.489351] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-18T20:33:42.919549] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-09-18T20:33:43.487820] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-18T20:33:43.719556] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-09-18T20:33:43.971033] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-18T20:33:44.519552] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-11. [2025-09-18T20:33:44.793965] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-18T20:33:45.319603] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-09-18T20:33:45.621316] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-18T20:33:46.119567] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-09-18T20:33:46.919558] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-09-18T20:33:46.980709] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-18T20:33:47.192304] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-18T20:33:47.719542] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-09-18T20:33:48.116342] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-18T20:33:48.118241] [INFO ] [REMOTE ] NCA: Full fetch complete (15882 records). [2025-09-18T20:33:48.118312] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-09-18T20:33:48.507785] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-09-18T20:33:48.507889] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-09-18T20:33:48.508445] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-09-18T20:33:48.508525] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-09-18T20:33:48.509557] [DEBUG] [LOCAL ] NCA: Trimmed 15882 records to 10087 (keeping 200 days of data) [2025-09-18T20:33:48.535160] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-09-18T20:33:48.575821] [DEBUG] [LOCAL ] NCA: Primary data saved (10087 records). [2025-09-18T20:33:48.575975] [INFO ] [MAIN ] NCA: Full history saved. [2025-09-18T20:33:48.576101] [INFO ] [MAIN ] Update Progress: 1462/2372 symbols completed. NCA took 48.7s. Estimated remaining: 2h 13m 3s. Rate: 6.8 symbols/min [2025-09-18T20:33:48.761570] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:33:48.780984] [DEBUG] [LOCAL ] NDMO: Loaded 16496 existing records from primary storage. [2025-09-18T20:33:48.781123] [INFO ] [MAIN ] NDMO: Loaded 16496 existing records. [2025-09-18T20:33:48.957783] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:33:48.958045] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-09-18T20:33:48.958094] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-09-18T20:33:48.958750] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-09-18T20:33:48.958811] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-09-18T20:33:49.325005] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-09-18T20:33:49.331940] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:33:49.746418] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-18T20:33:49.751120] [INFO ] [REMOTE ] NCDL: Full fetch complete (33619 records). [2025-09-18T20:33:49.751215] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-09-18T20:33:50.120763] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-11. [2025-09-18T20:33:50.145158] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-09-18T20:33:50.145449] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-09-18T20:33:50.146343] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-09-18T20:33:50.146468] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-09-18T20:33:50.148282] [DEBUG] [LOCAL ] NCDL: Trimmed 33619 records to 22014 (keeping 200 days of data) [2025-09-18T20:33:50.286450] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-18T20:33:50.343512] [DEBUG] [LOCAL ] NCDL: Primary data saved (22014 records). [2025-09-18T20:33:50.343673] [INFO ] [MAIN ] NCDL: Full history saved. [2025-09-18T20:33:50.343795] [INFO ] [MAIN ] Update Progress: 1463/2372 symbols completed. NCDL took 40.1s. Estimated remaining: 2h 12m 50s. Rate: 6.8 symbols/min [2025-09-18T20:33:50.544482] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-18T20:33:50.543773] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:33:50.613617] [DEBUG] [LOCAL ] NE: Loaded 52394 existing records from primary storage. [2025-09-18T20:33:50.613821] [INFO ] [MAIN ] NE: Loaded 52394 existing records. [2025-09-18T20:33:50.801353] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:33:50.801683] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-09-18T20:33:50.801741] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-09-18T20:33:50.803247] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-09-18T20:33:50.803308] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-09-18T20:33:50.924806] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-09-18T20:33:51.162337] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:33:51.327881] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-18T20:33:51.671851] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-18T20:33:51.719512] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-09-18T20:33:52.519578] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-09-18T20:33:52.741366] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-18T20:33:53.319563] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-11. [2025-09-18T20:33:54.119508] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-09-18T20:33:54.380358] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-18T20:33:54.911265] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-18T20:33:54.921707] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-09-18T20:33:55.428459] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T20:33:55.719533] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-09-18T20:33:56.467496] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-18T20:33:56.519519] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-09-18T20:33:56.713136] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-18T20:33:57.185374] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-18T20:33:57.319562] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-09-18T20:33:57.754473] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-18T20:33:57.761395] [INFO ] [REMOTE ] NCLH: Full fetch complete (77330 records). [2025-09-18T20:33:57.761547] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-09-18T20:33:57.762455] [FATAL] [VALIDATOR ] NCLH: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T20:33:57.762548] [FATAL] [MAIN ] NCLH: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:33:57.762614] [WARN ] [MAIN ] NCLH: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:33:57.762719] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-09-18T20:33:57.762788] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-09-18T20:33:57.762824] [INFO ] [LOCAL ] NCLH: Starting deletion of derivative data. [2025-09-18T20:33:57.762890] [DEBUG] [LOCAL ] NCLH: No derivative data file found to delete. [2025-09-18T20:33:57.762991] [INFO ] [MAIN ] Update Progress: 1464/2372 symbols completed. NCLH took 42.5s. Estimated remaining: 2h 12m 40s. Rate: 6.8 symbols/min [2025-09-18T20:33:57.942399] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:33:57.993437] [DEBUG] [LOCAL ] NEA: Loaded 35408 existing records from primary storage. [2025-09-18T20:33:57.993595] [INFO ] [MAIN ] NEA: Loaded 35408 existing records. [2025-09-18T20:33:58.128417] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-09-18T20:33:58.196084] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:33:58.196431] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-09-18T20:33:58.196514] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-09-18T20:33:58.197774] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-09-18T20:33:58.197837] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-09-18T20:33:58.559459] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:33:58.820439] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-18T20:33:58.919547] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-11. [2025-09-18T20:33:59.719554] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-09-18T20:34:00.455137] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-18T20:34:00.519685] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-09-18T20:34:00.911997] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-18T20:34:01.319632] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-09-18T20:34:02.119598] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-09-18T20:34:02.258344] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-18T20:34:02.291931] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-18T20:34:02.919561] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-09-18T20:34:03.484765] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-18T20:34:03.635101] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T20:34:03.719524] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-09-18T20:34:04.527171] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-09-18T20:34:04.531576] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-18T20:34:05.319555] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-09-18T20:34:06.097989] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-18T20:34:06.119541] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-09-18T20:34:06.167240] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-18T20:34:06.867228] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-18T20:34:06.870450] [INFO ] [REMOTE ] NDMO: Full fetch complete (25136 records). [2025-09-18T20:34:06.870548] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-09-18T20:34:06.924802] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-09-18T20:34:07.274297] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-09-18T20:34:07.274385] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-09-18T20:34:07.274982] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-09-18T20:34:07.275046] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-09-18T20:34:07.275761] [DEBUG] [LOCAL ] NDMO: Trimmed 25136 records to 16619 (keeping 200 days of data) [2025-09-18T20:34:07.395401] [DEBUG] [LOCAL ] NDMO: Primary data saved (16619 records). [2025-09-18T20:34:07.395582] [INFO ] [MAIN ] NDMO: Full history saved. [2025-09-18T20:34:07.395770] [INFO ] [MAIN ] Update Progress: 1465/2372 symbols completed. NDMO took 18.8s. Estimated remaining: 2h 12m 32s. Rate: 6.8 symbols/min [2025-09-18T20:34:07.577706] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:34:07.577909] [DEBUG] [LOCAL ] NEE: No existing data file found in primary storage. [2025-09-18T20:34:07.577964] [WARN ] [MAIN ] NEE: No existing data found, performing full refresh instead. [2025-09-18T20:34:07.578108] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-09-18T20:34:07.578151] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-09-18T20:34:07.578193] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-09-18T20:34:07.578237] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-09-18T20:34:07.724758] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-09-18T20:34:07.941944] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:34:08.431386] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-18T20:34:08.519515] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-09-18T20:34:08.780410] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-18T20:34:09.319558] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-11. [2025-09-18T20:34:09.925338] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-18T20:34:10.119587] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-09-18T20:34:10.919511] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-09-18T20:34:11.204517] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-18T20:34:11.487129] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-11 (2.17 seconds). [2025-09-18T20:34:11.719568] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-09-18T20:34:12.150941] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T20:34:12.371340] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-18T20:34:12.519609] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-09-18T20:34:13.319598] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-09-18T20:34:14.119544] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-09-18T20:34:14.483170] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-18T20:34:14.919564] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-09-18T20:34:15.198110] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-18T20:34:15.422896] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-18T20:34:15.660674] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T20:34:15.719566] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-09-18T20:34:16.519571] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-09-18T20:34:17.276156] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T20:34:17.319557] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-09-18T20:34:18.119557] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-09-18T20:34:18.351415] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-18T20:34:18.919730] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-09-18T20:34:19.208477] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-18T20:34:19.235845] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-18T20:34:19.719558] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-09-18T20:34:20.519585] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-09-18T20:34:20.575874] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-18T20:34:20.594041] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-18T20:34:21.319609] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-09-18T20:34:21.483064] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-18T20:34:22.119581] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-09-18T20:34:22.181726] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-18T20:34:22.183999] [INFO ] [REMOTE ] NCZ: Full fetch complete (21519 records). [2025-09-18T20:34:22.184073] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-09-18T20:34:22.564343] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-09-18T20:34:22.564660] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-09-18T20:34:22.565146] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-09-18T20:34:22.565190] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-09-18T20:34:22.565867] [DEBUG] [LOCAL ] NCZ: Trimmed 21519 records to 11855 (keeping 200 days of data) [2025-09-18T20:34:22.650919] [DEBUG] [LOCAL ] NCZ: Primary data saved (11855 records). [2025-09-18T20:34:22.651048] [INFO ] [MAIN ] NCZ: Full history saved. [2025-09-18T20:34:22.651161] [INFO ] [MAIN ] Update Progress: 1466/2372 symbols completed. NCZ took 41.2s. Estimated remaining: 2h 12m 27s. Rate: 6.8 symbols/min [2025-09-18T20:34:22.823196] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:34:22.823358] [DEBUG] [LOCAL ] NEM: No existing data file found in primary storage. [2025-09-18T20:34:22.823394] [WARN ] [MAIN ] NEM: No existing data found, performing full refresh instead. [2025-09-18T20:34:22.823621] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-09-18T20:34:22.823694] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-09-18T20:34:22.823751] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-09-18T20:34:22.823786] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-09-18T20:34:22.924596] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-09-18T20:34:23.190730] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:34:23.719564] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-11. [2025-09-18T20:34:23.977862] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-18T20:34:24.519586] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-09-18T20:34:24.791218] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-18T20:34:25.319578] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-09-18T20:34:25.633892] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-18T20:34:25.810574] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-11 (2.09 seconds). [2025-09-18T20:34:26.119580] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-09-18T20:34:26.919548] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-09-18T20:34:27.325751] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-18T20:34:27.375174] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-18T20:34:27.719569] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-09-18T20:34:28.519600] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-09-18T20:34:28.833504] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-18T20:34:28.859960] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-18T20:34:28.865550] [INFO ] [REMOTE ] NEA: Full fetch complete (52415 records). [2025-09-18T20:34:28.865678] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-09-18T20:34:29.264831] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-09-18T20:34:29.264917] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-09-18T20:34:29.265699] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-09-18T20:34:29.265764] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-09-18T20:34:29.266890] [DEBUG] [LOCAL ] NEA: Trimmed 52415 records to 35699 (keeping 200 days of data) [2025-09-18T20:34:29.330991] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-09-18T20:34:29.499638] [DEBUG] [LOCAL ] NEA: Primary data saved (35699 records). [2025-09-18T20:34:29.499808] [INFO ] [MAIN ] NEA: Full history saved. [2025-09-18T20:34:29.499926] [INFO ] [MAIN ] Update Progress: 1467/2372 symbols completed. NEA took 31.7s. Estimated remaining: 2h 12m 17s. Rate: 6.8 symbols/min [2025-09-18T20:34:29.675720] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:34:29.729572] [DEBUG] [LOCAL ] NET: Loaded 53095 existing records from primary storage. [2025-09-18T20:34:29.729778] [INFO ] [MAIN ] NET: Loaded 53095 existing records. [2025-09-18T20:34:29.921639] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:34:29.921938] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-09-18T20:34:29.921990] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-09-18T20:34:29.924342] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-09-18T20:34:29.924404] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-09-18T20:34:30.126747] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-09-18T20:34:30.309031] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:34:30.362839] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-18T20:34:30.919523] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-09-18T20:34:31.362805] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-18T20:34:31.719569] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-11. [2025-09-18T20:34:31.947054] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-18T20:34:32.519559] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-09-18T20:34:32.630270] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-18T20:34:33.319617] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-09-18T20:34:33.879532] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-11 (2.16 seconds). [2025-09-18T20:34:34.119548] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-09-18T20:34:34.409578] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-18T20:34:34.919548] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-09-18T20:34:35.514456] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-18T20:34:35.719547] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-09-18T20:34:35.923463] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-18T20:34:36.519585] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-09-18T20:34:36.939455] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-18T20:34:37.319549] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-09-18T20:34:37.919999] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-18T20:34:38.119548] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-09-18T20:34:38.464872] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-18T20:34:38.494275] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-18T20:34:38.501094] [INFO ] [REMOTE ] NEE: Full fetch complete (77243 records). [2025-09-18T20:34:38.501214] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-09-18T20:34:38.502038] [FATAL] [VALIDATOR ] NEE: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T20:34:38.502148] [FATAL] [MAIN ] NEE: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:34:38.502243] [WARN ] [MAIN ] NEE: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:34:38.502351] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-09-18T20:34:38.502438] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-09-18T20:34:38.502494] [INFO ] [LOCAL ] NEE: Starting deletion of derivative data. [2025-09-18T20:34:38.502580] [DEBUG] [LOCAL ] NEE: No derivative data file found to delete. [2025-09-18T20:34:38.502727] [INFO ] [MAIN ] Update Progress: 1468/2372 symbols completed. NEE took 31.1s. Estimated remaining: 2h 12m 9s. Rate: 6.8 symbols/min [2025-09-18T20:34:38.677069] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:34:38.687372] [DEBUG] [LOCAL ] NEU: Loaded 8121 existing records from primary storage. [2025-09-18T20:34:38.687502] [INFO ] [MAIN ] NEU: Loaded 8121 existing records. [2025-09-18T20:34:38.830850] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T20:34:38.896572] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:34:38.891548] [INFO ] [REMOTE ] NE: Full fetch complete (75172 records). [2025-09-18T20:34:38.896804] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-09-18T20:34:38.897075] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-09-18T20:34:38.897182] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-09-18T20:34:38.926985] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-09-18T20:34:38.944444] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-09-18T20:34:38.926892] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-09-18T20:34:39.659782] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:34:39.684473] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-09-18T20:34:39.684608] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-09-18T20:34:39.685973] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-09-18T20:34:39.686053] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-09-18T20:34:39.688584] [DEBUG] [LOCAL ] NE: Trimmed 75172 records to 52783 (keeping 200 days of data) [2025-09-18T20:34:39.755236] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-11. [2025-09-18T20:34:40.035881] [DEBUG] [LOCAL ] NE: Primary data saved (52783 records). [2025-09-18T20:34:40.036029] [INFO ] [MAIN ] NE: Full history saved. [2025-09-18T20:34:40.037575] [INFO ] [MAIN ] Update Progress: 1469/2372 symbols completed. NE took 49.7s. Estimated remaining: 2h 11m 55s. Rate: 6.8 symbols/min [2025-09-18T20:34:40.214329] [INFO ] [MAIN ] NEUE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:34:40.218546] [DEBUG] [LOCAL ] NEUE: Loaded 2256 existing records from primary storage. [2025-09-18T20:34:40.218635] [INFO ] [MAIN ] NEUE: Loaded 2256 existing records. [2025-09-18T20:34:40.407282] [WARN ] [MAIN ] NEUE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:34:40.407631] [INFO ] [MAIN ] NEUE: Wiping existing primary data before full refresh. [2025-09-18T20:34:40.407728] [INFO ] [LOCAL ] NEUE: Starting deletion of primary data. [2025-09-18T20:34:40.407958] [DEBUG] [LOCAL ] NEUE: Deleted primary data file. [2025-09-18T20:34:40.408020] [INFO ] [MAIN ] NEUE: Starting full primary refresh. [2025-09-18T20:34:40.524693] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-09-18T20:34:40.764323] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T20:34:40.785726] [INFO ] [REMOTE ] NEUE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:34:41.140118] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-18T20:34:41.319538] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2024-11. [2025-09-18T20:34:41.815692] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-18T20:34:42.119547] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-09-18T20:34:42.795259] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-18T20:34:42.919546] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-09-18T20:34:43.719588] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2024-12. [2025-09-18T20:34:44.051471] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-18T20:34:44.262311] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-18T20:34:44.519556] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-01. [2025-09-18T20:34:44.828945] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-18T20:34:45.175758] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-18T20:34:45.319587] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-09-18T20:34:46.119547] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-09-18T20:34:46.919545] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-02. [2025-09-18T20:34:47.579278] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-18T20:34:47.594156] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-18T20:34:47.719548] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-03. [2025-09-18T20:34:48.049135] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-18T20:34:48.188044] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-18T20:34:48.519548] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-04. [2025-09-18T20:34:49.042490] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-18T20:34:49.319621] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-09-18T20:34:49.847335] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-18T20:34:50.119720] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-09-18T20:34:50.919580] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-09-18T20:34:51.719635] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-05. [2025-09-18T20:34:52.097635] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-18T20:34:52.132498] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-18T20:34:52.519587] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-09-18T20:34:53.132322] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-18T20:34:53.300061] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-18T20:34:53.319585] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-09-18T20:34:54.119582] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-09-18T20:34:54.919598] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-09-18T20:34:55.499688] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-18T20:34:55.601810] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-18T20:34:55.719554] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-09-18T20:34:56.030888] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-18T20:34:56.086040] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-18T20:34:56.092849] [INFO ] [REMOTE ] NEM: Full fetch complete (77262 records). [2025-09-18T20:34:56.092961] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-09-18T20:34:56.093677] [FATAL] [VALIDATOR ] NEM: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T20:34:56.093767] [FATAL] [MAIN ] NEM: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:34:56.093811] [WARN ] [MAIN ] NEM: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:34:56.093852] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-09-18T20:34:56.093937] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-09-18T20:34:56.093994] [INFO ] [LOCAL ] NEM: Starting deletion of derivative data. [2025-09-18T20:34:56.094037] [DEBUG] [LOCAL ] NEM: No derivative data file found to delete. [2025-09-18T20:34:56.094096] [INFO ] [MAIN ] Update Progress: 1470/2372 symbols completed. NEM took 33.4s. Estimated remaining: 2h 11m 51s. Rate: 6.8 symbols/min [2025-09-18T20:34:56.262415] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:34:56.267812] [DEBUG] [LOCAL ] NEXA: Loaded 3923 existing records from primary storage. [2025-09-18T20:34:56.267893] [INFO ] [MAIN ] NEXA: Loaded 3923 existing records. [2025-09-18T20:34:56.450265] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:34:56.450612] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-09-18T20:34:56.450693] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-09-18T20:34:56.451026] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-09-18T20:34:56.451085] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-09-18T20:34:56.524714] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-09-18T20:34:56.804610] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:34:57.319558] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-11. [2025-09-18T20:34:57.835068] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-18T20:34:58.119598] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-09-18T20:34:58.780246] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-18T20:34:58.805833] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-18T20:34:58.919503] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-09-18T20:34:59.719587] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-09-18T20:35:00.311972] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-18T20:35:00.519610] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-09-18T20:35:01.239067] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-18T20:35:01.319582] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-06. [2025-09-18T20:35:01.387458] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-18T20:35:01.729869] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-18T20:35:02.119558] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-07. [2025-09-18T20:35:02.628608] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-18T20:35:02.919554] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-09-18T20:35:03.523451] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-18T20:35:03.719562] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-09-18T20:35:04.519555] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-09-18T20:35:04.577956] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-18T20:35:05.319607] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-09-18T20:35:05.936125] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-18T20:35:06.119557] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-09-18T20:35:06.473265] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-18T20:35:06.809033] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-18T20:35:06.919539] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-08. [2025-09-18T20:35:07.254842] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-18T20:35:07.719549] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-09-18T20:35:08.519607] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-09-18T20:35:08.927488] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-18T20:35:09.319552] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-09-18T20:35:09.711496] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-18T20:35:10.119588] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-09. [2025-09-18T20:35:10.408563] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-18T20:35:10.409387] [INFO ] [REMOTE ] NEUE: Full fetch complete (3994 records). [2025-09-18T20:35:10.409457] [DEBUG] [VALIDATOR ] NEUE: Validating primary data. [2025-09-18T20:35:10.700122] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-18T20:35:10.734923] [INFO ] [REMOTE ] NET: Full fetch complete (76783 records). [2025-09-18T20:35:10.745378] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-09-18T20:35:10.915741] [DEBUG] [VALIDATOR ] NEUE: All expected trading days are present. [2025-09-18T20:35:10.918677] [DEBUG] [VALIDATOR ] NEUE: Primary data validation passed. [2025-09-18T20:35:10.918835] [INFO ] [MAIN ] NEUE: Fetched primary data is valid. [2025-09-18T20:35:10.918906] [DEBUG] [LOCAL ] NEUE: Saving primary data. [2025-09-18T20:35:10.924603] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-09-18T20:35:10.961029] [DEBUG] [LOCAL ] NEUE: Trimmed 3994 records to 2262 (keeping 200 days of data) [2025-09-18T20:35:11.155043] [DEBUG] [LOCAL ] NEUE: Primary data saved (2262 records). [2025-09-18T20:35:11.160832] [INFO ] [MAIN ] NEUE: Full history saved. [2025-09-18T20:35:11.176509] [INFO ] [MAIN ] Update Progress: 1471/2372 symbols completed. NEUE took 31.1s. Estimated remaining: 2h 11m 46s. Rate: 6.8 symbols/min [2025-09-18T20:35:11.359834] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-09-18T20:35:11.360200] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-09-18T20:35:11.361307] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-09-18T20:35:11.366805] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-09-18T20:35:11.434497] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:35:11.430752] [DEBUG] [LOCAL ] NET: Trimmed 76783 records to 53481 (keeping 200 days of data) [2025-09-18T20:35:11.573323] [DEBUG] [LOCAL ] NFG: Loaded 38837 existing records from primary storage. [2025-09-18T20:35:11.574043] [INFO ] [MAIN ] NFG: Loaded 38837 existing records. [2025-09-18T20:35:11.721935] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-09-18T20:35:11.776024] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:35:11.778178] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-09-18T20:35:11.778481] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-09-18T20:35:11.782581] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-09-18T20:35:11.832333] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-09-18T20:35:11.997560] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-18T20:35:12.193603] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-18T20:35:12.307781] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:35:12.409134] [DEBUG] [LOCAL ] NET: Primary data saved (53481 records). [2025-09-18T20:35:12.409296] [INFO ] [MAIN ] NET: Full history saved. [2025-09-18T20:35:12.409388] [INFO ] [MAIN ] Update Progress: 1472/2372 symbols completed. NET took 42.9s. Estimated remaining: 2h 11m 33s. Rate: 6.8 symbols/min [2025-09-18T20:35:12.524799] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-09-18T20:35:12.600638] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:35:12.622920] [DEBUG] [LOCAL ] NFJ: Loaded 20489 existing records from primary storage. [2025-09-18T20:35:12.623068] [INFO ] [MAIN ] NFJ: Loaded 20489 existing records. [2025-09-18T20:35:12.851616] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:35:12.851914] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-09-18T20:35:12.851963] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-09-18T20:35:12.852638] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-09-18T20:35:12.852731] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-09-18T20:35:13.216952] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:35:13.319535] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-11. [2025-09-18T20:35:13.515912] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-18T20:35:14.119558] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-09-18T20:35:14.356302] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-18T20:35:14.919548] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-09-18T20:35:14.937719] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-18T20:35:14.939371] [INFO ] [REMOTE ] NEU: Full fetch complete (10131 records). [2025-09-18T20:35:14.939443] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-09-18T20:35:15.316027] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-09-18T20:35:15.316111] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-09-18T20:35:15.316348] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-09-18T20:35:15.316386] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-09-18T20:35:15.316860] [DEBUG] [LOCAL ] NEU: Trimmed 10131 records to 8172 (keeping 200 days of data) [2025-09-18T20:35:15.370498] [DEBUG] [LOCAL ] NEU: Primary data saved (8172 records). [2025-09-18T20:35:15.370668] [INFO ] [MAIN ] NEU: Full history saved. [2025-09-18T20:35:15.370780] [INFO ] [MAIN ] Update Progress: 1473/2372 symbols completed. NEU took 36.9s. Estimated remaining: 2h 11m 20s. Rate: 6.8 symbols/min [2025-09-18T20:35:15.540223] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:35:15.578242] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-18T20:35:15.593094] [DEBUG] [LOCAL ] NGG: Loaded 46212 existing records from primary storage. [2025-09-18T20:35:15.593206] [INFO ] [MAIN ] NGG: Loaded 46212 existing records. [2025-09-18T20:35:15.724708] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-11. [2025-09-18T20:35:15.779168] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:35:15.779369] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-09-18T20:35:15.779417] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-09-18T20:35:15.780400] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-09-18T20:35:15.780460] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-09-18T20:35:16.136536] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:35:16.519593] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-11. [2025-09-18T20:35:17.019185] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-18T20:35:17.319560] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-09-18T20:35:17.740743] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-18T20:35:18.119600] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-09-18T20:35:18.852499] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-18T20:35:18.919495] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-09-18T20:35:19.301081] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-18T20:35:19.719564] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-09-18T20:35:20.146295] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-18T20:35:20.519511] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-09-18T20:35:20.919420] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-18T20:35:21.041245] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-18T20:35:21.319552] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-09-18T20:35:22.119571] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-09-18T20:35:22.485124] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T20:35:22.919551] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-09-18T20:35:23.719532] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-09-18T20:35:23.750760] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-18T20:35:24.223856] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-18T20:35:24.519568] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-09-18T20:35:24.575328] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-18T20:35:25.146154] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-18T20:35:25.147586] [INFO ] [REMOTE ] NEXA: Full fetch complete (7484 records). [2025-09-18T20:35:25.147712] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-09-18T20:35:25.329262] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-09-18T20:35:25.534383] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-09-18T20:35:25.534484] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-09-18T20:35:25.534739] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-09-18T20:35:25.534802] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-09-18T20:35:25.535237] [DEBUG] [LOCAL ] NEXA: Trimmed 7484 records to 4023 (keeping 200 days of data) [2025-09-18T20:35:25.561601] [DEBUG] [LOCAL ] NEXA: Primary data saved (4023 records). [2025-09-18T20:35:25.561779] [INFO ] [MAIN ] NEXA: Full history saved. [2025-09-18T20:35:25.561892] [INFO ] [MAIN ] Update Progress: 1474/2372 symbols completed. NEXA took 29.5s. Estimated remaining: 2h 11m 13s. Rate: 6.8 symbols/min [2025-09-18T20:35:25.742146] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:35:25.781977] [DEBUG] [LOCAL ] NGL: Loaded 30422 existing records from primary storage. [2025-09-18T20:35:25.782144] [INFO ] [MAIN ] NGL: Loaded 30422 existing records. [2025-09-18T20:35:25.975859] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:35:25.976217] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-09-18T20:35:25.976276] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-09-18T20:35:25.977014] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-09-18T20:35:25.977077] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-09-18T20:35:26.124680] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-09-18T20:35:26.370141] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:35:26.609046] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-18T20:35:26.871951] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-18T20:35:26.919575] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-09-18T20:35:27.719601] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-09-18T20:35:28.519533] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-11. [2025-09-18T20:35:28.670807] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-18T20:35:28.902828] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-18T20:35:29.259748] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-18T20:35:29.319501] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-09-18T20:35:30.119567] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-09-18T20:35:30.137671] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-18T20:35:30.919516] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-09-18T20:35:30.959443] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-18T20:35:31.719565] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-09-18T20:35:32.421813] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-18T20:35:32.519537] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-09-18T20:35:33.319556] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-09-18T20:35:33.602574] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-18T20:35:33.653109] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-18T20:35:34.119625] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-09-18T20:35:34.156914] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-18T20:35:34.919546] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-09-18T20:35:35.042031] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-18T20:35:35.719553] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-09-18T20:35:35.976573] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-18T20:35:36.519587] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-09-18T20:35:36.976871] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-18T20:35:37.319561] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-09-18T20:35:37.393416] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-18T20:35:38.119531] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-09-18T20:35:38.924729] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-09-18T20:35:38.939797] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-18T20:35:38.995904] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-18T20:35:39.719544] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-09-18T20:35:39.866389] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T20:35:40.519602] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-09-18T20:35:40.947745] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-18T20:35:41.319550] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-09-18T20:35:42.065008] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-18T20:35:42.119550] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-09-18T20:35:42.540049] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-18T20:35:42.919554] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-09-18T20:35:43.141396] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-18T20:35:43.719552] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-09-18T20:35:43.921597] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-18T20:35:43.927999] [INFO ] [REMOTE ] NFG: Full fetch complete (56389 records). [2025-09-18T20:35:43.928248] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-09-18T20:35:44.314956] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-09-18T20:35:44.315045] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-09-18T20:35:44.315888] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-09-18T20:35:44.315952] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-09-18T20:35:44.317210] [DEBUG] [LOCAL ] NFG: Trimmed 56389 records to 39072 (keeping 200 days of data) [2025-09-18T20:35:44.528588] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-09-18T20:35:44.571866] [DEBUG] [LOCAL ] NFG: Primary data saved (39072 records). [2025-09-18T20:35:44.572059] [INFO ] [MAIN ] NFG: Full history saved. [2025-09-18T20:35:44.572874] [INFO ] [MAIN ] Update Progress: 1475/2372 symbols completed. NFG took 33.4s. Estimated remaining: 2h 11m 10s. Rate: 6.8 symbols/min [2025-09-18T20:35:44.749836] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:35:44.765470] [DEBUG] [LOCAL ] NGS: Loaded 11774 existing records from primary storage. [2025-09-18T20:35:44.765599] [INFO ] [MAIN ] NGS: Loaded 11774 existing records. [2025-09-18T20:35:44.948552] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:35:44.948855] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-09-18T20:35:44.949061] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-09-18T20:35:44.954696] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-09-18T20:35:44.962052] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-09-18T20:35:45.027799] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-18T20:35:45.326929] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-09-18T20:35:45.332867] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:35:45.966850] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T20:35:46.067122] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-18T20:35:46.119527] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-09-18T20:35:46.919563] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-11. [2025-09-18T20:35:47.292335] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-18T20:35:47.483744] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-18T20:35:47.719587] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-09-18T20:35:48.519561] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-09-18T20:35:49.218008] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-18T20:35:49.319615] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-09-18T20:35:50.022746] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-18T20:35:50.119494] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-09-18T20:35:50.385099] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-18T20:35:50.919572] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-09-18T20:35:51.719594] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-09-18T20:35:51.891365] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-18T20:35:51.896733] [INFO ] [REMOTE ] NGL: Full fetch complete (40475 records). [2025-09-18T20:35:51.896998] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-09-18T20:35:52.042384] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-18T20:35:52.325490] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-09-18T20:35:52.325637] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-09-18T20:35:52.326418] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-09-18T20:35:52.326500] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-09-18T20:35:52.334437] [DEBUG] [LOCAL ] NGL: Trimmed 40475 records to 30690 (keeping 200 days of data) [2025-09-18T20:35:52.335184] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-18T20:35:52.510024] [DEBUG] [LOCAL ] NGL: Primary data saved (30690 records). [2025-09-18T20:35:52.510165] [INFO ] [MAIN ] NGL: Full history saved. [2025-09-18T20:35:52.510251] [INFO ] [MAIN ] Update Progress: 1476/2372 symbols completed. NGL took 26.9s. Estimated remaining: 2h 11m 1s. Rate: 6.8 symbols/min [2025-09-18T20:35:52.524706] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-09-18T20:35:52.682405] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:35:52.705297] [DEBUG] [LOCAL ] NGVC: Loaded 22449 existing records from primary storage. [2025-09-18T20:35:52.705437] [INFO ] [MAIN ] NGVC: Loaded 22449 existing records. [2025-09-18T20:35:52.882440] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:35:52.882720] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-09-18T20:35:52.882825] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-09-18T20:35:52.883495] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-09-18T20:35:52.883557] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-09-18T20:35:53.279048] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:35:53.319522] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-11. [2025-09-18T20:35:53.930797] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-18T20:35:53.939935] [INFO ] [REMOTE ] NGG: Full fetch complete (66144 records). [2025-09-18T20:35:53.940114] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-09-18T20:35:54.124729] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-09-18T20:35:54.280855] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-18T20:35:54.364259] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-09-18T20:35:54.364351] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-09-18T20:35:54.365272] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-09-18T20:35:54.365339] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-09-18T20:35:54.366820] [DEBUG] [LOCAL ] NGG: Trimmed 66144 records to 46495 (keeping 200 days of data) [2025-09-18T20:35:54.653229] [DEBUG] [LOCAL ] NGG: Primary data saved (46495 records). [2025-09-18T20:35:54.653370] [INFO ] [MAIN ] NGG: Full history saved. [2025-09-18T20:35:54.653456] [INFO ] [MAIN ] Update Progress: 1477/2372 symbols completed. NGG took 39.3s. Estimated remaining: 2h 10m 48s. Rate: 6.8 symbols/min [2025-09-18T20:35:54.919734] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-09-18T20:35:55.240053] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T20:35:55.243179] [INFO ] [REMOTE ] NFJ: Full fetch complete (30474 records). [2025-09-18T20:35:55.243282] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-09-18T20:35:55.636859] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-09-18T20:35:55.636942] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-09-18T20:35:55.637604] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-09-18T20:35:55.637835] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-09-18T20:35:55.638891] [DEBUG] [LOCAL ] NFJ: Trimmed 30474 records to 20587 (keeping 200 days of data) [2025-09-18T20:35:55.710014] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-18T20:35:55.741522] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-09-18T20:35:55.783905] [DEBUG] [LOCAL ] NFJ: Primary data saved (20587 records). [2025-09-18T20:35:55.784091] [INFO ] [MAIN ] NFJ: Full history saved. [2025-09-18T20:35:55.784181] [INFO ] [MAIN ] Update Progress: 1478/2372 symbols completed. NFJ took 43.4s. Estimated remaining: 2h 10m 35s. Rate: 6.8 symbols/min [2025-09-18T20:35:56.519707] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-09-18T20:35:56.748969] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-18T20:35:57.319551] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-09-18T20:35:57.337556] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T20:35:58.119614] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-09-18T20:35:58.541607] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T20:35:58.919552] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-09-18T20:35:58.985760] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-18T20:35:59.719602] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-09-18T20:36:00.087876] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-18T20:36:00.464331] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-18T20:36:00.519513] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-09-18T20:36:01.319607] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-09-18T20:36:01.799171] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-18T20:36:02.119567] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-09-18T20:36:03.926952] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-18T20:36:03.930753] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-09-18T20:36:04.480121] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-18T20:36:04.485330] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-09-18T20:36:04.850975] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-18T20:36:04.856069] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-09-18T20:36:05.755076] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-18T20:36:05.761066] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-09-18T20:36:05.808328] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-18T20:36:06.119600] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-09-18T20:36:06.724232] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-18T20:36:06.919579] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-09-18T20:36:07.008793] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-18T20:36:07.719596] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-09-18T20:36:08.042592] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-18T20:36:08.333998] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-18T20:36:08.519544] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-09-18T20:36:09.096073] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-18T20:36:09.097932] [INFO ] [REMOTE ] NGS: Full fetch complete (17104 records). [2025-09-18T20:36:09.098033] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-09-18T20:36:09.326064] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-09-18T20:36:09.492637] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-09-18T20:36:09.492750] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-09-18T20:36:09.493174] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-09-18T20:36:09.493272] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-09-18T20:36:09.494008] [DEBUG] [LOCAL ] NGS: Trimmed 17104 records to 11842 (keeping 200 days of data) [2025-09-18T20:36:09.574877] [DEBUG] [LOCAL ] NGS: Primary data saved (11842 records). [2025-09-18T20:36:09.575019] [INFO ] [MAIN ] NGS: Full history saved. [2025-09-18T20:36:09.575134] [INFO ] [MAIN ] Update Progress: 1479/2372 symbols completed. NGS took 25.0s. Estimated remaining: 2h 10m 29s. Rate: 6.8 symbols/min [2025-09-18T20:36:10.477510] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-18T20:36:10.481023] [INFO ] [REMOTE ] NGVC: Full fetch complete (30201 records). [2025-09-18T20:36:10.481106] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-09-18T20:36:10.861404] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-09-18T20:36:10.861520] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-09-18T20:36:10.862160] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-09-18T20:36:10.862223] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-09-18T20:36:10.862993] [DEBUG] [LOCAL ] NGVC: Trimmed 30201 records to 22615 (keeping 200 days of data) [2025-09-18T20:36:11.003147] [DEBUG] [LOCAL ] NGVC: Primary data saved (22615 records). [2025-09-18T20:36:11.003277] [INFO ] [MAIN ] NGVC: Full history saved. [2025-09-18T20:36:11.003391] [INFO ] [MAIN ] Update Progress: 1480/2372 symbols completed. NGVC took 18.5s. Estimated remaining: 2h 10m 16s. Rate: 6.8 symbols/min [2025-09-18T20:36:11.619530] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:36:11.707476] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-09-18T20:36:11.730935] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:36:11.669768] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:36:11.732270] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:36:11.732633] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-09-18T20:36:11.733423] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-09-18T20:36:11.733830] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-18T20:36:11.733900] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-09-18T20:36:11.733975] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-09-18T20:36:11.872281] [DEBUG] [LOCAL ] NIC: Loaded 8913 existing records from primary storage. [2025-09-18T20:36:11.918586] [INFO ] [MAIN ] NIC: Loaded 8913 existing records. [2025-09-18T20:36:11.942983] [DEBUG] [LOCAL ] NHI: Loaded 22149 existing records from primary storage. [2025-09-18T20:36:12.049579] [INFO ] [MAIN ] NHI: Loaded 22149 existing records. [2025-09-18T20:36:12.034634] [DEBUG] [LOCAL ] NGVT: Loaded 24542 existing records from primary storage. [2025-09-18T20:36:12.076795] [INFO ] [MAIN ] NGVT: Loaded 24542 existing records. [2025-09-18T20:36:12.568032] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:36:12.618595] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:36:12.738037] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-11. [2025-09-18T20:36:12.748522] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:36:12.750693] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-09-18T20:36:12.750820] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-09-18T20:36:12.750776] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-09-18T20:36:12.748373] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:36:12.750941] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-09-18T20:36:12.751496] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-09-18T20:36:12.751557] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-09-18T20:36:12.751784] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-09-18T20:36:12.751725] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-09-18T20:36:12.763451] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-09-18T20:36:12.763630] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-09-18T20:36:12.763343] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-09-18T20:36:12.799022] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-09-18T20:36:13.718724] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:36:13.729587] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-11. [2025-09-18T20:36:13.834158] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:36:13.854176] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-11. [2025-09-18T20:36:13.895724] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:36:13.896027] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-11. [2025-09-18T20:36:15.854501] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-11 (2.12 seconds). [2025-09-18T20:36:15.856960] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-09-18T20:36:15.951359] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-11 (3.21 seconds). [2025-09-18T20:36:15.962973] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-09-18T20:36:16.069160] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-11 (2.17 seconds). [2025-09-18T20:36:16.074508] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-09-18T20:36:16.199131] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-11 (2.34 seconds). [2025-09-18T20:36:16.205423] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-09-18T20:36:16.791412] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-18T20:36:16.793527] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-09-18T20:36:17.024301] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-18T20:36:17.044989] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-18T20:36:17.319559] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-09-18T20:36:17.387607] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-18T20:36:17.404521] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-18T20:36:18.119513] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-09-18T20:36:18.180621] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-18T20:36:18.919556] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-09-18T20:36:19.719562] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-09-18T20:36:19.904215] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-18T20:36:19.975715] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-18T20:36:20.519598] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-09-18T20:36:20.786521] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-18T20:36:21.319557] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-09-18T20:36:21.890895] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-18T20:36:22.119570] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-09-18T20:36:22.163444] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-18T20:36:22.919550] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-09-18T20:36:23.442722] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-18T20:36:23.719558] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-09-18T20:36:24.430499] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-18T20:36:24.519554] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-09-18T20:36:25.319548] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-09-18T20:36:25.728371] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T20:36:26.054455] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-18T20:36:26.119564] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-09-18T20:36:26.205716] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-18T20:36:26.919591] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-09-18T20:36:27.719522] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-09-18T20:36:27.750893] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-18T20:36:28.228286] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-18T20:36:28.519584] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-09-18T20:36:28.599371] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-18T20:36:29.319583] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-09-18T20:36:29.836445] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-18T20:36:30.119564] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-09-18T20:36:30.331213] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-18T20:36:30.669357] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-18T20:36:30.919557] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-09-18T20:36:31.457742] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-18T20:36:31.719550] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-09-18T20:36:32.519557] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-09-18T20:36:32.928628] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T20:36:33.319614] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-09-18T20:36:34.120310] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-09-18T20:36:34.126762] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-18T20:36:34.156862] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-18T20:36:34.919500] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-09-18T20:36:34.955336] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-18T20:36:35.719571] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-09-18T20:36:36.168222] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T20:36:36.519550] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-09-18T20:36:36.590253] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-18T20:36:37.319549] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-09-18T20:36:37.740576] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-18T20:36:37.969380] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-18T20:36:38.119543] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-09-18T20:36:38.919511] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-09-18T20:36:39.090124] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-18T20:36:39.439702] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-18T20:36:39.719573] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-09-18T20:36:40.519549] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-09-18T20:36:40.612816] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-18T20:36:40.616624] [INFO ] [REMOTE ] NGVT: Full fetch complete (34533 records). [2025-09-18T20:36:40.616785] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-09-18T20:36:41.036231] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-09-18T20:36:41.036457] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-09-18T20:36:41.037184] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-09-18T20:36:41.037253] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-09-18T20:36:41.038075] [DEBUG] [LOCAL ] NGVT: Trimmed 34533 records to 24732 (keeping 200 days of data) [2025-09-18T20:36:41.182130] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-18T20:36:41.186235] [INFO ] [REMOTE ] NIC: Full fetch complete (12085 records). [2025-09-18T20:36:41.186315] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-09-18T20:36:41.322298] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-09-18T20:36:41.498112] [DEBUG] [LOCAL ] NGVT: Primary data saved (24732 records). [2025-09-18T20:36:41.508698] [INFO ] [MAIN ] NGVT: Full history saved. [2025-09-18T20:36:41.508939] [INFO ] [MAIN ] Update Progress: 1481/2372 symbols completed. NGVT took 30.5s. Estimated remaining: 2h 10m 20s. Rate: 6.8 symbols/min [2025-09-18T20:36:41.701256] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-09-18T20:36:41.701700] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-09-18T20:36:41.702021] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-09-18T20:36:41.702099] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-09-18T20:36:41.752954] [DEBUG] [LOCAL ] NIC: Trimmed 12085 records to 9008 (keeping 200 days of data) [2025-09-18T20:36:41.778691] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:36:41.836146] [DEBUG] [LOCAL ] NIE: Loaded 11673 existing records from primary storage. [2025-09-18T20:36:41.837015] [INFO ] [MAIN ] NIE: Loaded 11673 existing records. [2025-09-18T20:36:42.032065] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:36:42.032871] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-09-18T20:36:42.033449] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-09-18T20:36:42.034798] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-09-18T20:36:42.035144] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-09-18T20:36:42.123370] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-09-18T20:36:42.131398] [DEBUG] [LOCAL ] NIC: Primary data saved (9008 records). [2025-09-18T20:36:42.138305] [INFO ] [MAIN ] NIC: Full history saved. [2025-09-18T20:36:42.150379] [INFO ] [MAIN ] Update Progress: 1482/2372 symbols completed. NIC took 31.1s. Estimated remaining: 2h 10m 6s. Rate: 6.8 symbols/min [2025-09-18T20:36:42.465283] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-18T20:36:42.557135] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:36:42.563329] [INFO ] [REMOTE ] NHI: Full fetch complete (31662 records). [2025-09-18T20:36:42.573857] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-09-18T20:36:42.658996] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:36:42.674080] [DEBUG] [LOCAL ] NIM: Loaded 4158 existing records from primary storage. [2025-09-18T20:36:42.715510] [INFO ] [MAIN ] NIM: Loaded 4158 existing records. [2025-09-18T20:36:42.923525] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-11. [2025-09-18T20:36:43.049505] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:36:43.117487] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-09-18T20:36:43.148154] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-09-18T20:36:43.156613] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-09-18T20:36:43.161985] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-09-18T20:36:43.360113] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-09-18T20:36:43.370467] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-09-18T20:36:43.394535] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-09-18T20:36:43.413446] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-09-18T20:36:43.541262] [DEBUG] [LOCAL ] NHI: Trimmed 31662 records to 22340 (keeping 200 days of data) [2025-09-18T20:36:43.718613] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:36:43.729458] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-11. [2025-09-18T20:36:43.768549] [DEBUG] [LOCAL ] NHI: Primary data saved (22340 records). [2025-09-18T20:36:43.769382] [INFO ] [MAIN ] NHI: Full history saved. [2025-09-18T20:36:43.769609] [INFO ] [MAIN ] Update Progress: 1483/2372 symbols completed. NHI took 32.8s. Estimated remaining: 2h 9m 53s. Rate: 6.8 symbols/min [2025-09-18T20:36:43.923473] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-18T20:36:43.993308] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:36:44.004603] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-18T20:36:44.034210] [DEBUG] [LOCAL ] NINE: Loaded 29062 existing records from primary storage. [2025-09-18T20:36:44.034362] [INFO ] [MAIN ] NINE: Loaded 29062 existing records. [2025-09-18T20:36:44.195433] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-18T20:36:44.232148] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:36:44.232470] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-09-18T20:36:44.232530] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-09-18T20:36:44.234123] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-09-18T20:36:44.234189] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-09-18T20:36:44.524722] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-09-18T20:36:44.614719] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:36:45.319546] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-09-18T20:36:46.083235] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-18T20:36:46.119515] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-09-18T20:36:46.233155] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-18T20:36:46.919528] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-11. [2025-09-18T20:36:46.974965] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-18T20:36:47.719608] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-09-18T20:36:48.519585] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-09-18T20:36:48.599370] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-18T20:36:49.109125] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-18T20:36:49.246832] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-18T20:36:49.319568] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-09-18T20:36:50.088637] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-18T20:36:50.095708] [INFO ] [REMOTE ] NI: Full fetch complete (76708 records). [2025-09-18T20:36:50.095869] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-09-18T20:36:50.096787] [FATAL] [VALIDATOR ] NI: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T20:36:50.096894] [FATAL] [MAIN ] NI: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:36:50.096938] [WARN ] [MAIN ] NI: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:36:50.096976] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-18T20:36:50.097034] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-09-18T20:36:50.097084] [INFO ] [LOCAL ] NI: Starting deletion of derivative data. [2025-09-18T20:36:50.097166] [DEBUG] [LOCAL ] NI: No derivative data file found to delete. [2025-09-18T20:36:50.097250] [INFO ] [MAIN ] Update Progress: 1484/2372 symbols completed. NI took 39.1s. Estimated remaining: 2h 9m 43s. Rate: 6.8 symbols/min [2025-09-18T20:36:50.126727] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-09-18T20:36:50.269188] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:36:50.337691] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-09-18T20:36:50.337862] [INFO ] [MAIN ] NIO: Loaded 53802 existing records. [2025-09-18T20:36:50.533118] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:36:50.533405] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-09-18T20:36:50.533460] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-09-18T20:36:50.534800] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-09-18T20:36:50.534861] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-09-18T20:36:50.891555] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:36:50.919505] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-11. [2025-09-18T20:36:51.460384] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T20:36:51.719584] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-09-18T20:36:52.519595] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-09-18T20:36:52.536857] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-18T20:36:53.197781] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-18T20:36:53.319609] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-09-18T20:36:53.475012] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-11 (2.56 seconds). [2025-09-18T20:36:54.119585] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-09-18T20:36:54.661677] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-18T20:36:54.919544] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-09-18T20:36:55.150904] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-18T20:36:55.604474] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-18T20:36:55.719538] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-09-18T20:36:56.519551] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-09-18T20:36:57.319596] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-09-18T20:36:57.898294] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T20:36:58.119722] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-09-18T20:36:58.372481] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-09-18T20:36:58.401110] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-18T20:36:58.698189] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-18T20:36:58.919513] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-09-18T20:36:59.399814] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-18T20:36:59.719610] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-09-18T20:37:00.519585] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-09-18T20:37:01.166390] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-18T20:37:01.319550] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-09-18T20:37:02.119556] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-09-18T20:37:02.373458] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-18T20:37:02.409076] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-18T20:37:02.919602] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-09-18T20:37:03.174791] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-18T20:37:03.617800] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-18T20:37:03.719539] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-09-18T20:37:04.466429] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-18T20:37:04.519529] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-09-18T20:37:05.174193] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-18T20:37:05.319534] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-09-18T20:37:06.119540] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-09-18T20:37:06.919563] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-09-18T20:37:06.982081] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-18T20:37:07.719511] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-09-18T20:37:07.792194] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-18T20:37:07.794207] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-18T20:37:08.519604] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-09-18T20:37:08.815678] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-18T20:37:08.908239] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-18T20:37:09.319589] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-09-18T20:37:09.830605] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-18T20:37:09.831764] [INFO ] [REMOTE ] NIM: Full fetch complete (6884 records). [2025-09-18T20:37:09.831836] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-09-18T20:37:10.124608] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-09-18T20:37:10.206558] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-09-18T20:37:10.206679] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-09-18T20:37:10.206877] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-09-18T20:37:10.206943] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-09-18T20:37:10.207375] [DEBUG] [LOCAL ] NIM: Trimmed 6884 records to 4167 (keeping 200 days of data) [2025-09-18T20:37:10.234002] [DEBUG] [LOCAL ] NIM: Primary data saved (4167 records). [2025-09-18T20:37:10.234112] [INFO ] [MAIN ] NIM: Full history saved. [2025-09-18T20:37:10.234195] [INFO ] [MAIN ] Update Progress: 1485/2372 symbols completed. NIM took 28.1s. Estimated remaining: 2h 9m 41s. Rate: 6.8 symbols/min [2025-09-18T20:37:10.409291] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:37:10.409523] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-09-18T20:37:10.409574] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-09-18T20:37:10.409793] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-09-18T20:37:10.409858] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-18T20:37:10.409919] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-18T20:37:10.409985] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-09-18T20:37:10.770674] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:37:10.919543] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-11. [2025-09-18T20:37:11.171280] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:37:11.171619] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-11 [2025-09-18T20:37:11.719586] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-09-18T20:37:12.495319] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-18T20:37:12.497320] [INFO ] [REMOTE ] NIE: Full fetch complete (16343 records). [2025-09-18T20:37:12.497431] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-09-18T20:37:12.529479] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-09-18T20:37:12.882433] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-09-18T20:37:12.882604] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-09-18T20:37:12.883034] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-09-18T20:37:12.883110] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-09-18T20:37:12.884102] [DEBUG] [LOCAL ] NIE: Trimmed 16343 records to 11760 (keeping 200 days of data) [2025-09-18T20:37:12.971342] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-09-18T20:37:13.001179] [DEBUG] [LOCAL ] NIE: Primary data saved (11760 records). [2025-09-18T20:37:13.001339] [INFO ] [MAIN ] NIE: Full history saved. [2025-09-18T20:37:13.001435] [INFO ] [MAIN ] Update Progress: 1486/2372 symbols completed. NIE took 31.5s. Estimated remaining: 2h 9m 29s. Rate: 6.8 symbols/min [2025-09-18T20:37:13.169957] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:37:13.209983] [DEBUG] [LOCAL ] NJR: Loaded 37970 existing records from primary storage. [2025-09-18T20:37:13.210152] [INFO ] [MAIN ] NJR: Loaded 37970 existing records. [2025-09-18T20:37:13.324705] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-09-18T20:37:13.391954] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:37:13.392210] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-09-18T20:37:13.392262] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-09-18T20:37:13.393872] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-09-18T20:37:13.393972] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-09-18T20:37:13.651583] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:37:13.673225] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-09-18T20:37:13.759141] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:37:13.778817] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-18T20:37:14.119551] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-01. [2025-09-18T20:37:14.383190] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:37:14.383522] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-01 [2025-09-18T20:37:14.919559] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-09-18T20:37:15.719563] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-11. [2025-09-18T20:37:16.519547] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-02. [2025-09-18T20:37:16.837159] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:37:16.837559] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-02 [2025-09-18T20:37:16.866682] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-18T20:37:17.319589] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-09-18T20:37:17.577268] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-18T20:37:18.119559] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-09-18T20:37:18.505085] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-18T20:37:18.919573] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-09-18T20:37:19.022103] [DEBUG] [REMOTE ] NIO: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-18T20:37:19.022485] [WARN ] [REMOTE ] NIO: No data returned for month 2025-05 [2025-09-18T20:37:19.710956] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T20:37:19.719485] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-09-18T20:37:20.519570] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-09-18T20:37:21.301557] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-18T20:37:21.319489] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-09-18T20:37:22.119541] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-09-18T20:37:22.343428] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-18T20:37:22.594576] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-18T20:37:22.919542] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-09-18T20:37:23.243471] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-18T20:37:23.719570] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-09-18T20:37:24.519545] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-03. [2025-09-18T20:37:24.808082] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:37:24.808419] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-03 [2025-09-18T20:37:24.832811] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-18T20:37:25.150976] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-18T20:37:25.319548] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-04. [2025-09-18T20:37:25.565205] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:37:25.565587] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-04 [2025-09-18T20:37:26.119602] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-09-18T20:37:26.919548] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-09-18T20:37:27.719546] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-05. [2025-09-18T20:37:27.941867] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:37:27.942226] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-05 [2025-09-18T20:37:28.102207] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-18T20:37:28.105588] [INFO ] [REMOTE ] NINE: Full fetch complete (44593 records). [2025-09-18T20:37:28.105705] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-09-18T20:37:28.508804] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-09-18T20:37:28.509029] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-09-18T20:37:28.509806] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-09-18T20:37:28.509883] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-09-18T20:37:28.511316] [DEBUG] [LOCAL ] NINE: Trimmed 44593 records to 29234 (keeping 200 days of data) [2025-09-18T20:37:28.523083] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-06. [2025-09-18T20:37:28.648888] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-18T20:37:28.749004] [DEBUG] [LOCAL ] NINE: Primary data saved (29234 records). [2025-09-18T20:37:28.749148] [INFO ] [MAIN ] NINE: Full history saved. [2025-09-18T20:37:28.749234] [INFO ] [MAIN ] Update Progress: 1487/2372 symbols completed. NINE took 45.0s. Estimated remaining: 2h 9m 24s. Rate: 6.8 symbols/min [2025-09-18T20:37:28.830582] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:37:28.851669] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-06 [2025-09-18T20:37:28.921956] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:37:28.922161] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-09-18T20:37:28.922198] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-09-18T20:37:28.922352] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-09-18T20:37:28.922396] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-18T20:37:28.922438] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-18T20:37:28.922471] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-09-18T20:37:29.280364] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:37:29.319554] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-07. [2025-09-18T20:37:30.119542] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-09-18T20:37:30.196142] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-18T20:37:30.919584] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-09-18T20:37:31.719554] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-08. [2025-09-18T20:37:32.519092] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-18T20:37:32.526753] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-11. [2025-09-18T20:37:32.733050] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-18T20:37:32.740455] [INFO ] [REMOTE ] NIO: Full fetch complete (69780 records). [2025-09-18T20:37:32.740573] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-09-18T20:37:32.939483] [WARN ] [VALIDATOR ] NIO: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-18T20:37:32.940203] [FATAL] [MAIN ] NIO: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:37:32.940305] [WARN ] [MAIN ] NIO: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:37:32.940369] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-09-18T20:37:32.940434] [DEBUG] [LOCAL ] NIO: No primary data file found to delete. [2025-09-18T20:37:32.940472] [INFO ] [LOCAL ] NIO: Starting deletion of derivative data. [2025-09-18T20:37:32.940892] [DEBUG] [LOCAL ] NIO: Deleted derivative data file. [2025-09-18T20:37:32.941678] [INFO ] [MAIN ] Update Progress: 1488/2372 symbols completed. NIO took 42.8s. Estimated remaining: 2h 9m 13s. Rate: 6.8 symbols/min [2025-09-18T20:37:33.145203] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:37:33.161765] [DEBUG] [LOCAL ] NKX: Loaded 13635 existing records from primary storage. [2025-09-18T20:37:33.161894] [INFO ] [MAIN ] NKX: Loaded 13635 existing records. [2025-09-18T20:37:33.326062] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-09-18T20:37:33.339137] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:37:33.340083] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-09-18T20:37:33.340134] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-09-18T20:37:33.340552] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-09-18T20:37:33.340611] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-09-18T20:37:33.726639] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:37:33.741525] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-18T20:37:34.119589] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-09. [2025-09-18T20:37:34.669709] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-18T20:37:34.761909] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-11 (2.24 seconds). [2025-09-18T20:37:34.919551] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-09-18T20:37:35.670385] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-18T20:37:35.676392] [INFO ] [REMOTE ] NIQ: Full fetch complete (13984 records). [2025-09-18T20:37:35.676471] [DEBUG] [VALIDATOR ] NIQ: Validating primary data. [2025-09-18T20:37:35.731186] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-09-18T20:37:35.861133] [WARN ] [VALIDATOR ] NIQ: Validation failed - insufficient historical data. Have 41 unique days, need 200 days [2025-09-18T20:37:35.861448] [FATAL] [MAIN ] NIQ: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:37:35.861525] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:37:35.861575] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-18T20:37:35.861631] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-18T20:37:35.861704] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-09-18T20:37:35.861758] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-09-18T20:37:35.861816] [INFO ] [MAIN ] Update Progress: 1489/2372 symbols completed. NIQ took 25.6s. Estimated remaining: 2h 9m 0s. Rate: 6.8 symbols/min [2025-09-18T20:37:36.030594] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:37:36.030827] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-09-18T20:37:36.030870] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-09-18T20:37:36.031016] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-09-18T20:37:36.031059] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-18T20:37:36.031174] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-18T20:37:36.031224] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-09-18T20:37:36.390051] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:37:36.519559] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-11. [2025-09-18T20:37:37.235714] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-18T20:37:37.319502] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-09-18T20:37:37.414930] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-18T20:37:37.461475] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-18T20:37:38.119545] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-09-18T20:37:38.919563] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-09-18T20:37:39.719561] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-11. [2025-09-18T20:37:39.903567] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-18T20:37:40.105284] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-18T20:37:40.137712] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-18T20:37:40.499486] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (3.18 seconds). [2025-09-18T20:37:40.519493] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-09-18T20:37:41.212227] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-18T20:37:41.319549] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-09-18T20:37:41.778988] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-18T20:37:42.119553] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-09-18T20:37:42.919557] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-09-18T20:37:43.444127] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-18T20:37:43.719537] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-09-18T20:37:44.158153] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-18T20:37:44.519601] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-09-18T20:37:44.618887] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-18T20:37:44.965804] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-18T20:37:45.319571] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-09-18T20:37:46.119524] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-09-18T20:37:46.394677] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-18T20:37:46.919577] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-09-18T20:37:47.719599] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-09-18T20:37:47.856815] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-18T20:37:48.519570] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-09-18T20:37:48.647868] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-18T20:37:48.955808] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-18T20:37:49.232428] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-18T20:37:49.319562] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-09-18T20:37:50.119503] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-09-18T20:37:50.510364] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-18T20:37:50.919561] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-09-18T20:37:51.331519] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-18T20:37:51.719606] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-09-18T20:37:51.953068] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-18T20:37:52.519602] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-09-18T20:37:53.319602] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-09-18T20:37:53.345020] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-18T20:37:53.933158] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-18T20:37:54.119572] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-09-18T20:37:54.405837] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-09-18T20:37:54.906214] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-18T20:37:54.919489] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-09-18T20:37:55.719556] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-09-18T20:37:55.976804] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-18T20:37:56.519550] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-09-18T20:37:56.838407] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T20:37:56.843713] [INFO ] [REMOTE ] NJR: Full fetch complete (54056 records). [2025-09-18T20:37:56.843839] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-09-18T20:37:57.229190] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-09-18T20:37:57.229281] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-09-18T20:37:57.230109] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-09-18T20:37:57.230175] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-09-18T20:37:57.231419] [DEBUG] [LOCAL ] NJR: Trimmed 54056 records to 38276 (keeping 200 days of data) [2025-09-18T20:37:57.321136] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-09-18T20:37:57.460607] [DEBUG] [LOCAL ] NJR: Primary data saved (38276 records). [2025-09-18T20:37:57.460792] [INFO ] [MAIN ] NJR: Full history saved. [2025-09-18T20:37:57.460887] [INFO ] [MAIN ] Update Progress: 1490/2372 symbols completed. NJR took 44.5s. Estimated remaining: 2h 8m 59s. Rate: 6.8 symbols/min [2025-09-18T20:37:57.628141] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:37:57.640788] [DEBUG] [LOCAL ] NLOP: Loaded 11797 existing records from primary storage. [2025-09-18T20:37:57.640922] [INFO ] [MAIN ] NLOP: Loaded 11797 existing records. [2025-09-18T20:37:57.868572] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:37:57.868874] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-09-18T20:37:57.868923] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-09-18T20:37:57.869334] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-09-18T20:37:57.869394] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-09-18T20:37:58.139619] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-18T20:37:58.122247] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-09-18T20:37:58.243865] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:37:58.919584] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-11. [2025-09-18T20:37:58.927688] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-18T20:37:59.358380] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-09-18T20:37:59.719569] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-09-18T20:37:59.976619] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-18T20:38:00.213518] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-18T20:38:00.519548] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-18T20:38:00.955205] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-18T20:38:00.956442] [INFO ] [REMOTE ] NL: Full fetch complete (6976 records). [2025-09-18T20:38:00.956515] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-09-18T20:38:01.139126] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-18T20:38:01.139392] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:38:01.139480] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:38:01.139558] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-18T20:38:01.139672] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-18T20:38:01.139744] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-09-18T20:38:01.139825] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-09-18T20:38:01.139935] [INFO ] [MAIN ] Update Progress: 1491/2372 symbols completed. NL took 25.3s. Estimated remaining: 2h 8m 47s. Rate: 6.8 symbols/min [2025-09-18T20:38:01.319694] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-09-18T20:38:01.319572] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:38:01.389255] [DEBUG] [LOCAL ] NLY: Loaded 53581 existing records from primary storage. [2025-09-18T20:38:01.389401] [INFO ] [MAIN ] NLY: Loaded 53581 existing records. [2025-09-18T20:38:01.574765] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:38:01.575019] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-09-18T20:38:01.575117] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-09-18T20:38:01.576991] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-09-18T20:38:01.577075] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-09-18T20:38:01.941499] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:38:02.119500] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-11. [2025-09-18T20:38:02.177449] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-18T20:38:02.919558] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-09-18T20:38:03.719511] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-09-18T20:38:03.951527] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-18T20:38:04.519563] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-09-18T20:38:04.612386] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-18T20:38:04.615094] [INFO ] [REMOTE ] NKX: Full fetch complete (19515 records). [2025-09-18T20:38:04.615172] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-09-18T20:38:05.001356] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-09-18T20:38:05.001487] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-09-18T20:38:05.001931] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-09-18T20:38:05.001998] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-09-18T20:38:05.002771] [DEBUG] [LOCAL ] NKX: Trimmed 19515 records to 13718 (keeping 200 days of data) [2025-09-18T20:38:05.089240] [DEBUG] [LOCAL ] NKX: Primary data saved (13718 records). [2025-09-18T20:38:05.089385] [INFO ] [MAIN ] NKX: Full history saved. [2025-09-18T20:38:05.089477] [INFO ] [MAIN ] Update Progress: 1492/2372 symbols completed. NKX took 32.1s. Estimated remaining: 2h 8m 36s. Rate: 6.8 symbols/min [2025-09-18T20:38:05.274278] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:38:05.289837] [DEBUG] [LOCAL ] NMAI: Loaded 13194 existing records from primary storage. [2025-09-18T20:38:05.289969] [INFO ] [MAIN ] NMAI: Loaded 13194 existing records. [2025-09-18T20:38:05.321686] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-09-18T20:38:05.520870] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:38:05.523558] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-18T20:38:05.533850] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-09-18T20:38:05.534361] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-09-18T20:38:05.535135] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-09-18T20:38:05.535205] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-09-18T20:38:05.885266] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-18T20:38:05.929335] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:38:06.119537] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-11. [2025-09-18T20:38:06.726270] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-18T20:38:06.919581] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-09-18T20:38:07.478671] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-18T20:38:07.519317] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-18T20:38:07.719532] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-09-18T20:38:08.519796] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-09-18T20:38:09.168216] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-18T20:38:09.319708] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-09-18T20:38:09.765049] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-18T20:38:10.119520] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-09-18T20:38:10.193358] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-18T20:38:10.919732] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-09-18T20:38:11.719598] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-09-18T20:38:12.519573] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-09-18T20:38:12.762128] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-18T20:38:12.882749] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-09-18T20:38:12.905223] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-18T20:38:13.211933] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-18T20:38:13.319523] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-09-18T20:38:14.119538] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-09-18T20:38:14.202298] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-18T20:38:14.919567] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-09-18T20:38:15.719520] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-09-18T20:38:16.104489] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-18T20:38:16.380588] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-18T20:38:16.519554] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-09-18T20:38:16.990875] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-18T20:38:17.115466] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-18T20:38:17.319543] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-09-18T20:38:18.119560] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-18T20:38:18.190249] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-18T20:38:18.919546] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-09-18T20:38:19.719559] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-09-18T20:38:20.308152] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-18T20:38:20.315191] [INFO ] [REMOTE ] NKE: Full fetch complete (77178 records). [2025-09-18T20:38:20.315376] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-09-18T20:38:20.456969] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-18T20:38:20.520326] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-09-18T20:38:20.539625] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-18T20:38:20.542529] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:38:20.542868] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:38:20.543110] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-18T20:38:20.543277] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-18T20:38:20.543441] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-09-18T20:38:20.543557] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-09-18T20:38:20.543801] [INFO ] [MAIN ] Update Progress: 1493/2372 symbols completed. NKE took 51.8s. Estimated remaining: 2h 8m 31s. Rate: 6.8 symbols/min [2025-09-18T20:38:20.737791] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:38:20.738202] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-09-18T20:38:20.738405] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-09-18T20:38:20.738709] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-09-18T20:38:20.738871] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-18T20:38:20.739036] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-18T20:38:20.739130] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-09-18T20:38:20.941066] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-18T20:38:21.163310] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:38:21.319569] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-11. [2025-09-18T20:38:21.349577] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-18T20:38:21.575186] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:38:21.575529] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-11 [2025-09-18T20:38:22.119579] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-09-18T20:38:22.919537] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-09-18T20:38:23.116867] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-18T20:38:23.157704] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:38:23.157924] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-09-18T20:38:23.719574] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-01. [2025-09-18T20:38:23.984859] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:38:23.985190] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-01 [2025-09-18T20:38:24.519562] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-09-18T20:38:25.045280] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-18T20:38:25.047581] [INFO ] [REMOTE ] NLOP: Full fetch complete (17553 records). [2025-09-18T20:38:25.047676] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-09-18T20:38:25.324733] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-02. [2025-09-18T20:38:25.422624] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-09-18T20:38:25.422753] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-09-18T20:38:25.423192] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-09-18T20:38:25.423247] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-09-18T20:38:25.423882] [DEBUG] [LOCAL ] NLOP: Trimmed 17553 records to 11885 (keeping 200 days of data) [2025-09-18T20:38:25.497266] [DEBUG] [LOCAL ] NLOP: Primary data saved (11885 records). [2025-09-18T20:38:25.497400] [INFO ] [MAIN ] NLOP: Full history saved. [2025-09-18T20:38:25.497486] [INFO ] [MAIN ] Update Progress: 1494/2372 symbols completed. NLOP took 28.0s. Estimated remaining: 2h 8m 20s. Rate: 6.8 symbols/min [2025-09-18T20:38:25.667599] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:38:25.668200] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:38:25.668947] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-02 [2025-09-18T20:38:25.686472] [DEBUG] [LOCAL ] NMCO: Loaded 16453 existing records from primary storage. [2025-09-18T20:38:25.686609] [INFO ] [MAIN ] NMCO: Loaded 16453 existing records. [2025-09-18T20:38:25.866854] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:38:25.867156] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-09-18T20:38:25.867206] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-09-18T20:38:25.867719] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-09-18T20:38:25.867782] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-09-18T20:38:26.124702] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-03. [2025-09-18T20:38:26.232660] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:38:26.513588] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-18T20:38:26.919597] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-09-18T20:38:27.719602] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-04. [2025-09-18T20:38:28.519561] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-11. [2025-09-18T20:38:29.036973] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-18T20:38:29.319556] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-09-18T20:38:29.344246] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-18T20:38:29.852553] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-18T20:38:30.119512] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-09-18T20:38:30.702152] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-18T20:38:30.919519] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-05. [2025-09-18T20:38:31.050897] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-18T20:38:31.719540] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-09-18T20:38:32.449132] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-18T20:38:32.519501] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-09-18T20:38:32.559476] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-18T20:38:33.319512] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-06. [2025-09-18T20:38:33.382908] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-18T20:38:34.119543] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-09-18T20:38:34.919540] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-09-18T20:38:35.039208] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-18T20:38:35.329855] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-18T20:38:35.545296] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T20:38:35.719557] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-09-18T20:38:36.519527] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-09-18T20:38:36.729369] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-18T20:38:37.319551] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-09-18T20:38:37.996284] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-18T20:38:38.119548] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-09-18T20:38:38.479880] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-18T20:38:38.743128] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T20:38:38.745762] [INFO ] [REMOTE ] NMAI: Full fetch complete (19975 records). [2025-09-18T20:38:38.745871] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-09-18T20:38:38.926153] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-09-18T20:38:39.157314] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-09-18T20:38:39.157396] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-09-18T20:38:39.157890] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-09-18T20:38:39.157971] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-09-18T20:38:39.159010] [DEBUG] [LOCAL ] NMAI: Trimmed 19975 records to 13349 (keeping 200 days of data) [2025-09-18T20:38:39.251377] [DEBUG] [LOCAL ] NMAI: Primary data saved (13349 records). [2025-09-18T20:38:39.251532] [INFO ] [MAIN ] NMAI: Full history saved. [2025-09-18T20:38:39.251634] [INFO ] [MAIN ] Update Progress: 1495/2372 symbols completed. NMAI took 34.2s. Estimated remaining: 2h 8m 14s. Rate: 6.8 symbols/min [2025-09-18T20:38:39.429300] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:38:39.438400] [DEBUG] [LOCAL ] NMG: Loaded 7384 existing records from primary storage. [2025-09-18T20:38:39.438507] [INFO ] [MAIN ] NMG: Loaded 7384 existing records. [2025-09-18T20:38:39.618595] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:38:39.618926] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-09-18T20:38:39.618982] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-09-18T20:38:39.619335] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-09-18T20:38:39.619393] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-09-18T20:38:39.720907] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-09-18T20:38:39.984275] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:38:39.994201] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-18T20:38:40.519556] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-07. [2025-09-18T20:38:41.319539] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-09-18T20:38:41.707336] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-18T20:38:42.061226] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-18T20:38:42.119493] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-09-18T20:38:42.262189] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-18T20:38:42.919556] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-08. [2025-09-18T20:38:43.652198] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-18T20:38:43.660474] [INFO ] [REMOTE ] NLY: Full fetch complete (77423 records). [2025-09-18T20:38:43.660736] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-09-18T20:38:43.727511] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-09-18T20:38:44.081495] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-09-18T20:38:44.081582] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-09-18T20:38:44.082568] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-09-18T20:38:44.082671] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-09-18T20:38:44.084446] [DEBUG] [LOCAL ] NLY: Trimmed 77423 records to 53971 (keeping 200 days of data) [2025-09-18T20:38:44.479188] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-18T20:38:44.514173] [DEBUG] [LOCAL ] NLY: Primary data saved (53971 records). [2025-09-18T20:38:44.514396] [INFO ] [MAIN ] NLY: Full history saved. [2025-09-18T20:38:44.514556] [INFO ] [MAIN ] Update Progress: 1496/2372 symbols completed. NLY took 43.4s. Estimated remaining: 2h 8m 3s. Rate: 6.8 symbols/min [2025-09-18T20:38:44.520105] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-09. [2025-09-18T20:38:44.727572] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:38:44.735612] [DEBUG] [LOCAL ] NMI: Loaded 4116 existing records from primary storage. [2025-09-18T20:38:44.735794] [INFO ] [MAIN ] NMI: Loaded 4116 existing records. [2025-09-18T20:38:45.044075] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:38:45.044415] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-09-18T20:38:45.044490] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-09-18T20:38:45.044867] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-09-18T20:38:45.044947] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-09-18T20:38:45.037794] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-18T20:38:45.325292] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-11. [2025-09-18T20:38:45.577318] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:38:45.882635] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-18T20:38:45.900003] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-18T20:38:45.905712] [INFO ] [REMOTE ] NMAX: Full fetch complete (39105 records). [2025-09-18T20:38:45.905793] [DEBUG] [VALIDATOR ] NMAX: Validating primary data. [2025-09-18T20:38:46.111261] [WARN ] [VALIDATOR ] NMAX: Validation failed - insufficient historical data. Have 119 unique days, need 200 days [2025-09-18T20:38:46.111755] [FATAL] [MAIN ] NMAX: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:38:46.111828] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:38:46.111900] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-18T20:38:46.111965] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-18T20:38:46.112003] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-09-18T20:38:46.112061] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-09-18T20:38:46.112144] [INFO ] [MAIN ] Update Progress: 1497/2372 symbols completed. NMAX took 25.6s. Estimated remaining: 2h 7m 50s. Rate: 6.8 symbols/min [2025-09-18T20:38:46.124622] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-09-18T20:38:46.283119] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:38:46.298373] [DEBUG] [LOCAL ] NMM: Loaded 14353 existing records from primary storage. [2025-09-18T20:38:46.298487] [INFO ] [MAIN ] NMM: Loaded 14353 existing records. [2025-09-18T20:38:46.473825] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:38:46.474082] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-09-18T20:38:46.474132] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-09-18T20:38:46.474933] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-09-18T20:38:46.474994] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-09-18T20:38:46.827665] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:38:46.919491] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-11. [2025-09-18T20:38:47.211922] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-18T20:38:47.719560] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-09-18T20:38:47.823311] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-18T20:38:48.422268] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-18T20:38:48.519556] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-09-18T20:38:49.312072] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-18T20:38:49.319488] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-09-18T20:38:50.119498] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-09-18T20:38:50.515458] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T20:38:50.759377] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-18T20:38:50.919528] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-09-18T20:38:51.696904] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-18T20:38:51.719521] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-11. [2025-09-18T20:38:52.519540] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-09-18T20:38:52.672759] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-18T20:38:53.319532] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-09-18T20:38:53.353536] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-18T20:38:54.119575] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-09-18T20:38:54.351009] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-18T20:38:54.648947] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-18T20:38:54.919546] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-09-18T20:38:55.406113] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-18T20:38:55.719553] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-09-18T20:38:56.509729] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-18T20:38:56.519493] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-09-18T20:38:57.224844] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-18T20:38:57.319576] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-09-18T20:38:57.898671] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-18T20:38:58.119540] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-09-18T20:38:58.600936] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-18T20:38:58.919564] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-09-18T20:38:59.459338] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-18T20:38:59.719578] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-09-18T20:39:00.363772] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-18T20:39:00.519573] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-09-18T20:39:01.319535] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-09-18T20:39:01.539368] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-18T20:39:02.119577] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-09-18T20:39:02.919587] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-09-18T20:39:03.213623] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-18T20:39:03.719601] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-09-18T20:39:03.734835] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-18T20:39:03.813256] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-18T20:39:04.519563] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-09-18T20:39:04.666005] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-18T20:39:04.669010] [INFO ] [REMOTE ] NMCO: Full fetch complete (24544 records). [2025-09-18T20:39:04.669091] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-09-18T20:39:05.091148] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-09-18T20:39:05.091241] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-09-18T20:39:05.091895] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-09-18T20:39:05.091981] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-09-18T20:39:05.092729] [DEBUG] [LOCAL ] NMCO: Trimmed 24544 records to 16585 (keeping 200 days of data) [2025-09-18T20:39:05.200200] [DEBUG] [LOCAL ] NMCO: Primary data saved (16585 records). [2025-09-18T20:39:05.200354] [INFO ] [MAIN ] NMCO: Full history saved. [2025-09-18T20:39:05.200444] [INFO ] [MAIN ] Update Progress: 1498/2372 symbols completed. NMCO took 39.7s. Estimated remaining: 2h 7m 48s. Rate: 6.8 symbols/min [2025-09-18T20:39:05.324669] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-09-18T20:39:05.391467] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:39:05.428575] [DEBUG] [LOCAL ] NMR: Loaded 35265 existing records from primary storage. [2025-09-18T20:39:05.428775] [INFO ] [MAIN ] NMR: Loaded 35265 existing records. [2025-09-18T20:39:05.627890] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:39:05.628292] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-09-18T20:39:05.628515] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-09-18T20:39:05.634780] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-09-18T20:39:05.641329] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-09-18T20:39:05.650159] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-18T20:39:05.940803] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-18T20:39:06.025316] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:39:06.119520] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-09-18T20:39:06.760595] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-18T20:39:06.919633] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-09-18T20:39:07.578153] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-18T20:39:07.719600] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-09-18T20:39:08.519567] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-09-18T20:39:08.579805] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-18T20:39:08.965037] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-18T20:39:09.319543] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-09-18T20:39:09.791277] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-18T20:39:10.119542] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-09-18T20:39:10.628733] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-18T20:39:10.630536] [INFO ] [REMOTE ] NMG: Full fetch complete (12891 records). [2025-09-18T20:39:10.630622] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-09-18T20:39:10.922789] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-09-18T20:39:11.010510] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-09-18T20:39:11.010606] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-09-18T20:39:11.010954] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-09-18T20:39:11.011020] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-09-18T20:39:11.011601] [DEBUG] [LOCAL ] NMG: Trimmed 12891 records to 7492 (keeping 200 days of data) [2025-09-18T20:39:11.057824] [DEBUG] [LOCAL ] NMG: Primary data saved (7492 records). [2025-09-18T20:39:11.057965] [INFO ] [MAIN ] NMG: Full history saved. [2025-09-18T20:39:11.058096] [INFO ] [MAIN ] Update Progress: 1499/2372 symbols completed. NMG took 31.8s. Estimated remaining: 2h 7m 37s. Rate: 6.8 symbols/min [2025-09-18T20:39:11.238898] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:39:11.244935] [DEBUG] [LOCAL ] NMS: Loaded 2878 existing records from primary storage. [2025-09-18T20:39:11.245102] [INFO ] [MAIN ] NMS: Loaded 2878 existing records. [2025-09-18T20:39:11.446111] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-18T20:39:11.451455] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:39:11.454543] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-09-18T20:39:11.454816] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-09-18T20:39:11.454730] [INFO ] [REMOTE ] NMI: Full fetch complete (6315 records). [2025-09-18T20:39:11.454989] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-09-18T20:39:11.455197] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-09-18T20:39:11.455303] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-09-18T20:39:11.761868] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-11. [2025-09-18T20:39:12.239328] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-09-18T20:39:12.239606] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-09-18T20:39:12.240193] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-09-18T20:39:12.239529] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:39:12.240374] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-09-18T20:39:12.241346] [DEBUG] [LOCAL ] NMI: Trimmed 6315 records to 4138 (keeping 200 days of data) [2025-09-18T20:39:12.270461] [DEBUG] [LOCAL ] NMI: Primary data saved (4138 records). [2025-09-18T20:39:12.270609] [INFO ] [MAIN ] NMI: Full history saved. [2025-09-18T20:39:12.270903] [INFO ] [MAIN ] Update Progress: 1500/2372 symbols completed. NMI took 27.8s. Estimated remaining: 2h 7m 24s. Rate: 6.8 symbols/min [2025-09-18T20:39:12.445524] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:39:12.451116] [DEBUG] [LOCAL ] NMT: Loaded 2826 existing records from primary storage. [2025-09-18T20:39:12.451252] [INFO ] [MAIN ] NMT: Loaded 2826 existing records. [2025-09-18T20:39:12.525879] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-09-18T20:39:12.634850] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:39:12.635109] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-09-18T20:39:12.635160] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-09-18T20:39:12.635424] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-09-18T20:39:12.635486] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-09-18T20:39:13.002256] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:39:13.319601] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-11. [2025-09-18T20:39:14.119592] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-11. [2025-09-18T20:39:14.809986] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-11 (3.05 seconds). [2025-09-18T20:39:14.836591] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-18T20:39:14.919547] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-09-18T20:39:14.985566] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-18T20:39:15.145900] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-18T20:39:15.309915] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-18T20:39:15.719556] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-09-18T20:39:16.151083] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-18T20:39:16.519560] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-09-18T20:39:16.920179] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-18T20:39:17.319549] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-09-18T20:39:17.818212] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-18T20:39:18.119551] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-09-18T20:39:18.759334] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-18T20:39:18.919530] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-09-18T20:39:19.282606] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-18T20:39:19.719567] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-09-18T20:39:20.087437] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-18T20:39:20.519555] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-09-18T20:39:21.069867] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-18T20:39:21.319576] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-09-18T20:39:22.119584] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-09-18T20:39:22.249531] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-18T20:39:22.919595] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-09-18T20:39:23.538527] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-18T20:39:23.560521] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-18T20:39:23.719566] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-09-18T20:39:24.267248] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-18T20:39:24.519546] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-09-18T20:39:24.928477] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-18T20:39:25.319564] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-09-18T20:39:26.119534] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-09-18T20:39:26.479976] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-18T20:39:26.919563] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-09-18T20:39:27.028698] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-18T20:39:27.031029] [INFO ] [REMOTE ] NMM: Full fetch complete (22438 records). [2025-09-18T20:39:27.031109] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-09-18T20:39:27.428448] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-09-18T20:39:27.428570] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-09-18T20:39:27.429076] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-09-18T20:39:27.429154] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-09-18T20:39:27.429817] [DEBUG] [LOCAL ] NMM: Trimmed 22438 records to 14426 (keeping 200 days of data) [2025-09-18T20:39:27.532242] [DEBUG] [LOCAL ] NMM: Primary data saved (14426 records). [2025-09-18T20:39:27.532390] [INFO ] [MAIN ] NMM: Full history saved. [2025-09-18T20:39:27.532599] [INFO ] [MAIN ] Update Progress: 1501/2372 symbols completed. NMM took 41.4s. Estimated remaining: 2h 7m 19s. Rate: 6.8 symbols/min [2025-09-18T20:39:27.702253] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:39:27.725487] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-09-18T20:39:27.728575] [DEBUG] [LOCAL ] NMZ: Loaded 21499 existing records from primary storage. [2025-09-18T20:39:27.728814] [INFO ] [MAIN ] NMZ: Loaded 21499 existing records. [2025-09-18T20:39:27.913248] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:39:27.913745] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-09-18T20:39:27.913820] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-09-18T20:39:27.915884] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-09-18T20:39:27.916126] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-09-18T20:39:28.071079] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-18T20:39:28.314201] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:39:28.353760] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-18T20:39:28.519540] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-11. [2025-09-18T20:39:29.319537] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-09-18T20:39:29.735892] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-18T20:39:29.791891] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-18T20:39:30.119514] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-09-18T20:39:30.701528] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-18T20:39:30.919504] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-09-18T20:39:31.477318] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-18T20:39:31.719508] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-09-18T20:39:32.519552] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-09-18T20:39:33.256702] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T20:39:33.258155] [INFO ] [REMOTE ] NMS: Full fetch complete (4023 records). [2025-09-18T20:39:33.258395] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-09-18T20:39:33.324611] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-09-18T20:39:33.473890] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-18T20:39:33.674410] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-09-18T20:39:33.674557] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-09-18T20:39:33.674755] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-09-18T20:39:33.674817] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-09-18T20:39:33.675184] [DEBUG] [LOCAL ] NMS: Trimmed 4023 records to 2887 (keeping 200 days of data) [2025-09-18T20:39:33.694890] [DEBUG] [LOCAL ] NMS: Primary data saved (2887 records). [2025-09-18T20:39:33.694968] [INFO ] [MAIN ] NMS: Full history saved. [2025-09-18T20:39:33.695063] [INFO ] [MAIN ] Update Progress: 1502/2372 symbols completed. NMS took 22.6s. Estimated remaining: 2h 7m 9s. Rate: 6.8 symbols/min [2025-09-18T20:39:33.894337] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:39:33.899920] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-18T20:39:33.916140] [DEBUG] [LOCAL ] NNI: Loaded 9783 existing records from primary storage. [2025-09-18T20:39:33.916278] [INFO ] [MAIN ] NNI: Loaded 9783 existing records. [2025-09-18T20:39:34.099721] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:39:34.100052] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-09-18T20:39:34.100103] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-09-18T20:39:34.100781] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-09-18T20:39:34.100856] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-09-18T20:39:34.124739] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-09-18T20:39:34.476360] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:39:34.919539] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-09-18T20:39:35.571070] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-18T20:39:35.719521] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-09-18T20:39:35.882851] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-18T20:39:36.153852] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-18T20:39:36.519551] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-09-18T20:39:37.319551] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-09-18T20:39:37.781672] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-18T20:39:37.838596] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-18T20:39:38.119548] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-09-18T20:39:38.720876] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-18T20:39:38.721920] [INFO ] [REMOTE ] NMT: Full fetch complete (4323 records). [2025-09-18T20:39:38.722005] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-09-18T20:39:38.927014] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-11. [2025-09-18T20:39:39.109313] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-09-18T20:39:39.109425] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-09-18T20:39:39.109620] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-09-18T20:39:39.109730] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-09-18T20:39:39.110295] [DEBUG] [LOCAL ] NMT: Trimmed 4323 records to 2839 (keeping 200 days of data) [2025-09-18T20:39:39.130262] [DEBUG] [LOCAL ] NMT: Primary data saved (2839 records). [2025-09-18T20:39:39.130394] [INFO ] [MAIN ] NMT: Full history saved. [2025-09-18T20:39:39.130486] [INFO ] [MAIN ] Update Progress: 1503/2372 symbols completed. NMT took 26.9s. Estimated remaining: 2h 6m 58s. Rate: 6.8 symbols/min [2025-09-18T20:39:39.326539] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:39:39.394078] [DEBUG] [LOCAL ] NNN: Loaded 48485 existing records from primary storage. [2025-09-18T20:39:39.394248] [INFO ] [MAIN ] NNN: Loaded 48485 existing records. [2025-09-18T20:39:39.581389] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:39:39.582471] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-09-18T20:39:39.582528] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-09-18T20:39:39.584530] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-09-18T20:39:39.584592] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-09-18T20:39:39.725577] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-09-18T20:39:39.940713] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T20:39:39.969041] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:39:40.519544] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-11. [2025-09-18T20:39:41.054029] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-18T20:39:41.319567] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-09-18T20:39:42.034040] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-18T20:39:42.119514] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-09-18T20:39:42.205141] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-18T20:39:42.919547] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-09-18T20:39:43.536200] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-18T20:39:43.719524] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-09-18T20:39:44.005502] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-18T20:39:44.519544] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-09-18T20:39:44.985217] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-18T20:39:45.319576] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-09-18T20:39:45.501454] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-18T20:39:46.119581] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-09-18T20:39:46.722481] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-18T20:39:46.738296] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-18T20:39:46.919548] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-09-18T20:39:47.719556] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-09-18T20:39:48.308266] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-18T20:39:48.519548] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-09-18T20:39:49.213054] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-18T20:39:49.230388] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-18T20:39:49.319634] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-09-18T20:39:50.028712] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-18T20:39:50.119608] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-09-18T20:39:50.919720] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-09-18T20:39:51.594057] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-18T20:39:51.719586] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-09-18T20:39:51.995856] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-18T20:39:52.519570] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-09-18T20:39:52.966453] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T20:39:53.319558] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-09-18T20:39:53.639582] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-18T20:39:54.119634] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-09-18T20:39:54.919602] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-09-18T20:39:54.996597] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-18T20:39:55.019703] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-18T20:39:55.541310] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-18T20:39:55.719620] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-09-18T20:39:56.390295] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-18T20:39:56.519599] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-09-18T20:39:57.319550] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-09-18T20:39:57.638734] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-18T20:39:58.019248] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-18T20:39:58.119525] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-09-18T20:39:58.919561] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-09-18T20:39:59.655097] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-18T20:39:59.719504] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-09-18T20:39:59.951245] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-18T20:40:00.519601] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-09-18T20:40:00.725487] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T20:40:00.730290] [INFO ] [REMOTE ] NMR: Full fetch complete (50171 records). [2025-09-18T20:40:00.730378] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-09-18T20:40:01.113870] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-09-18T20:40:01.113993] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-09-18T20:40:01.114814] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-09-18T20:40:01.114876] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-09-18T20:40:01.117922] [DEBUG] [LOCAL ] NMR: Trimmed 50171 records to 35528 (keeping 200 days of data) [2025-09-18T20:40:01.320399] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-09-18T20:40:01.335629] [DEBUG] [LOCAL ] NMR: Primary data saved (35528 records). [2025-09-18T20:40:01.335745] [INFO ] [MAIN ] NMR: Full history saved. [2025-09-18T20:40:01.335843] [INFO ] [MAIN ] Update Progress: 1504/2372 symbols completed. NMR took 56.1s. Estimated remaining: 2h 6m 57s. Rate: 6.8 symbols/min [2025-09-18T20:40:01.529363] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:40:01.539499] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-18T20:40:01.556153] [DEBUG] [LOCAL ] NNY: Loaded 5683 existing records from primary storage. [2025-09-18T20:40:01.556347] [INFO ] [MAIN ] NNY: Loaded 5683 existing records. [2025-09-18T20:40:01.761190] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:40:01.761485] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-09-18T20:40:01.761554] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-09-18T20:40:01.761961] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-09-18T20:40:01.762033] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-09-18T20:40:02.124740] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-09-18T20:40:02.129380] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:40:02.919536] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-11. [2025-09-18T20:40:03.044517] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-18T20:40:03.272075] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-18T20:40:03.276616] [INFO ] [REMOTE ] NMZ: Full fetch complete (31910 records). [2025-09-18T20:40:03.276863] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-09-18T20:40:03.601546] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-18T20:40:03.687752] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-09-18T20:40:03.687825] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-09-18T20:40:03.688463] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-09-18T20:40:03.688503] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-09-18T20:40:03.689276] [DEBUG] [LOCAL ] NMZ: Trimmed 31910 records to 21608 (keeping 200 days of data) [2025-09-18T20:40:03.745847] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-09-18T20:40:03.827988] [DEBUG] [LOCAL ] NMZ: Primary data saved (21608 records). [2025-09-18T20:40:03.828120] [INFO ] [MAIN ] NMZ: Full history saved. [2025-09-18T20:40:03.828235] [INFO ] [MAIN ] Update Progress: 1505/2372 symbols completed. NMZ took 36.3s. Estimated remaining: 2h 6m 44s. Rate: 6.8 symbols/min [2025-09-18T20:40:04.008119] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:40:04.026513] [DEBUG] [LOCAL ] NOA: Loaded 16516 existing records from primary storage. [2025-09-18T20:40:04.026696] [INFO ] [MAIN ] NOA: Loaded 16516 existing records. [2025-09-18T20:40:04.211149] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:40:04.211456] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-09-18T20:40:04.211520] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-09-18T20:40:04.212145] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-09-18T20:40:04.212215] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-09-18T20:40:04.524623] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-09-18T20:40:04.579765] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:40:05.227140] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-18T20:40:05.319522] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-09-18T20:40:05.417530] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-18T20:40:05.860311] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-18T20:40:06.119527] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-09-18T20:40:06.745586] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-18T20:40:06.919565] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-09-18T20:40:07.480562] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-18T20:40:07.719601] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-11. [2025-09-18T20:40:08.519557] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-09-18T20:40:08.721717] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-18T20:40:08.988334] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-18T20:40:09.319574] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-09-18T20:40:10.119555] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-09-18T20:40:10.784482] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-18T20:40:10.919536] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-09-18T20:40:11.032554] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-18T20:40:11.488713] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-18T20:40:11.719565] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-09-18T20:40:12.519553] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-09-18T20:40:12.926618] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-18T20:40:13.319545] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-09-18T20:40:13.596043] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-18T20:40:13.814140] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-18T20:40:14.119563] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-09-18T20:40:14.919584] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-09-18T20:40:14.958057] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-18T20:40:14.960419] [INFO ] [REMOTE ] NNI: Full fetch complete (12447 records). [2025-09-18T20:40:14.960503] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-09-18T20:40:15.334383] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-09-18T20:40:15.334497] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-09-18T20:40:15.334816] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-09-18T20:40:15.334927] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-09-18T20:40:15.335425] [DEBUG] [LOCAL ] NNI: Trimmed 12447 records to 9909 (keeping 200 days of data) [2025-09-18T20:40:15.404917] [DEBUG] [LOCAL ] NNI: Primary data saved (9909 records). [2025-09-18T20:40:15.405070] [INFO ] [MAIN ] NNI: Full history saved. [2025-09-18T20:40:15.405168] [INFO ] [MAIN ] Update Progress: 1506/2372 symbols completed. NNI took 41.7s. Estimated remaining: 2h 6m 37s. Rate: 6.8 symbols/min [2025-09-18T20:40:15.574287] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:40:15.594897] [DEBUG] [LOCAL ] NOAH: Loaded 20033 existing records from primary storage. [2025-09-18T20:40:15.595049] [INFO ] [MAIN ] NOAH: Loaded 20033 existing records. [2025-09-18T20:40:15.736899] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-09-18T20:40:15.780420] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:40:15.780729] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-09-18T20:40:15.780790] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-09-18T20:40:15.781558] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-09-18T20:40:15.781685] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-09-18T20:40:16.146058] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:40:16.220133] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-18T20:40:16.226943] [INFO ] [REMOTE ] NNN: Full fetch complete (70008 records). [2025-09-18T20:40:16.227068] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-09-18T20:40:16.524373] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-09-18T20:40:16.673323] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-09-18T20:40:16.673410] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-09-18T20:40:16.674422] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-09-18T20:40:16.674489] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-09-18T20:40:16.676143] [DEBUG] [LOCAL ] NNN: Trimmed 70008 records to 48812 (keeping 200 days of data) [2025-09-18T20:40:16.787922] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-18T20:40:16.994940] [DEBUG] [LOCAL ] NNN: Primary data saved (48812 records). [2025-09-18T20:40:16.995080] [INFO ] [MAIN ] NNN: Full history saved. [2025-09-18T20:40:16.995167] [INFO ] [MAIN ] Update Progress: 1507/2372 symbols completed. NNN took 37.9s. Estimated remaining: 2h 6m 24s. Rate: 6.8 symbols/min [2025-09-18T20:40:17.178504] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:40:17.226673] [DEBUG] [LOCAL ] NOC: Loaded 42935 existing records from primary storage. [2025-09-18T20:40:17.231435] [INFO ] [MAIN ] NOC: Loaded 42935 existing records. [2025-09-18T20:40:17.237288] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-18T20:40:17.319681] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-09-18T20:40:17.432972] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:40:17.433377] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-09-18T20:40:17.433450] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-09-18T20:40:17.434993] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-09-18T20:40:17.435089] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-09-18T20:40:17.811780] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:40:18.119542] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-09-18T20:40:18.292968] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-18T20:40:18.691072] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-18T20:40:18.919552] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-09-18T20:40:19.460830] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-18T20:40:19.462465] [INFO ] [REMOTE ] NNY: Full fetch complete (9028 records). [2025-09-18T20:40:19.462536] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-09-18T20:40:19.724682] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-11. [2025-09-18T20:40:19.842031] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-09-18T20:40:19.842138] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-09-18T20:40:19.842402] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-09-18T20:40:19.842443] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-09-18T20:40:19.843013] [DEBUG] [LOCAL ] NNY: Trimmed 9028 records to 5753 (keeping 200 days of data) [2025-09-18T20:40:19.878864] [DEBUG] [LOCAL ] NNY: Primary data saved (5753 records). [2025-09-18T20:40:19.878999] [INFO ] [MAIN ] NNY: Full history saved. [2025-09-18T20:40:19.879088] [INFO ] [MAIN ] Update Progress: 1508/2372 symbols completed. NNY took 18.5s. Estimated remaining: 2h 6m 12s. Rate: 6.8 symbols/min [2025-09-18T20:40:20.052521] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:40:20.105993] [DEBUG] [LOCAL ] NOG: Loaded 51172 existing records from primary storage. [2025-09-18T20:40:20.106167] [INFO ] [MAIN ] NOG: Loaded 51172 existing records. [2025-09-18T20:40:20.282770] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:40:20.283045] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-09-18T20:40:20.283093] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-09-18T20:40:20.285265] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-09-18T20:40:20.285326] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-09-18T20:40:20.527198] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-11. [2025-09-18T20:40:20.657948] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:40:20.822474] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-18T20:40:21.319542] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-09-18T20:40:21.948036] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T20:40:22.119541] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-09-18T20:40:22.427829] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-18T20:40:22.919603] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-09-18T20:40:23.379568] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-18T20:40:23.721956] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-09-18T20:40:23.725579] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-18T20:40:24.519621] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-09-18T20:40:25.076382] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-18T20:40:25.319560] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-09-18T20:40:25.544696] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-18T20:40:26.119559] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-11. [2025-09-18T20:40:26.919591] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-09-18T20:40:26.960675] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-18T20:40:27.598418] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-18T20:40:27.719551] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-09-18T20:40:27.898997] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-18T20:40:28.519564] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-09-18T20:40:29.319517] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-09-18T20:40:29.431977] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-18T20:40:29.468703] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-18T20:40:30.119540] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-09-18T20:40:30.919551] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-09-18T20:40:31.004862] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-18T20:40:31.076291] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-18T20:40:31.596189] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-18T20:40:31.719538] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-09-18T20:40:32.519569] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-09-18T20:40:33.243133] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-18T20:40:33.319510] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-09-18T20:40:33.737985] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-18T20:40:34.109682] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-18T20:40:34.119493] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-09-18T20:40:34.919577] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-09-18T20:40:35.719563] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-09-18T20:40:35.984525] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-18T20:40:36.458959] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-18T20:40:36.519545] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-09-18T20:40:36.700228] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-18T20:40:37.319545] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-09-18T20:40:38.025300] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-18T20:40:38.119530] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-09-18T20:40:38.919568] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-09-18T20:40:39.233141] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-18T20:40:39.706638] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-18T20:40:39.724620] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-09-18T20:40:39.741822] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-18T20:40:40.519604] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-09-18T20:40:41.319500] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-09-18T20:40:41.408709] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T20:40:41.749863] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-18T20:40:42.119506] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-09-18T20:40:42.177138] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-18T20:40:42.898280] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-18T20:40:42.919499] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-09-18T20:40:43.719526] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-09-18T20:40:44.012592] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-18T20:40:44.488794] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-18T20:40:44.492721] [INFO ] [REMOTE ] NOA: Full fetch complete (21687 records). [2025-09-18T20:40:44.492835] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-09-18T20:40:44.526872] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-09-18T20:40:44.909024] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-09-18T20:40:44.909121] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-09-18T20:40:44.909634] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-09-18T20:40:44.909716] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-09-18T20:40:44.910558] [DEBUG] [LOCAL ] NOA: Trimmed 21687 records to 16596 (keeping 200 days of data) [2025-09-18T20:40:45.012554] [DEBUG] [LOCAL ] NOA: Primary data saved (16596 records). [2025-09-18T20:40:45.012733] [INFO ] [MAIN ] NOA: Full history saved. [2025-09-18T20:40:45.012834] [INFO ] [MAIN ] Update Progress: 1509/2372 symbols completed. NOA took 41.2s. Estimated remaining: 2h 6m 13s. Rate: 6.8 symbols/min [2025-09-18T20:40:45.182786] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:40:45.237901] [DEBUG] [LOCAL ] NOK: Loaded 53621 existing records from primary storage. [2025-09-18T20:40:45.238069] [INFO ] [MAIN ] NOK: Loaded 53621 existing records. [2025-09-18T20:40:45.324741] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-09-18T20:40:45.427324] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:40:45.427592] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-09-18T20:40:45.427671] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-09-18T20:40:45.429048] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-09-18T20:40:45.429112] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-09-18T20:40:45.787200] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:40:46.119508] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-11. [2025-09-18T20:40:46.175728] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-18T20:40:46.919554] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-09-18T20:40:47.104348] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-18T20:40:47.688509] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-18T20:40:47.692407] [INFO ] [REMOTE ] NOAH: Full fetch complete (28859 records). [2025-09-18T20:40:47.692969] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-09-18T20:40:47.724678] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-09-18T20:40:48.141412] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-09-18T20:40:48.141746] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-09-18T20:40:48.142909] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-09-18T20:40:48.165896] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-09-18T20:40:48.197428] [DEBUG] [LOCAL ] NOAH: Trimmed 28859 records to 20179 (keeping 200 days of data) [2025-09-18T20:40:48.197162] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-11 (2.08 seconds). [2025-09-18T20:40:48.398818] [DEBUG] [LOCAL ] NOAH: Primary data saved (20179 records). [2025-09-18T20:40:48.399002] [INFO ] [MAIN ] NOAH: Full history saved. [2025-09-18T20:40:48.399126] [INFO ] [MAIN ] Update Progress: 1510/2372 symbols completed. NOAH took 33.0s. Estimated remaining: 2h 6m 1s. Rate: 6.8 symbols/min [2025-09-18T20:40:48.524885] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-09-18T20:40:48.692565] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:40:48.692818] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-09-18T20:40:48.692936] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-09-18T20:40:48.693063] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-09-18T20:40:48.693104] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-18T20:40:48.693146] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-18T20:40:48.693179] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-09-18T20:40:49.152355] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:40:49.168169] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-18T20:40:49.173528] [INFO ] [REMOTE ] NOC: Full fetch complete (62089 records). [2025-09-18T20:40:49.173696] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-09-18T20:40:49.324747] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-11. [2025-09-18T20:40:49.593985] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-09-18T20:40:49.594124] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-09-18T20:40:49.595104] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-09-18T20:40:49.595172] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-09-18T20:40:49.596625] [DEBUG] [LOCAL ] NOC: Trimmed 62089 records to 43208 (keeping 200 days of data) [2025-09-18T20:40:49.879775] [DEBUG] [LOCAL ] NOC: Primary data saved (43208 records). [2025-09-18T20:40:49.879925] [INFO ] [MAIN ] NOC: Full history saved. [2025-09-18T20:40:49.880022] [INFO ] [MAIN ] Update Progress: 1511/2372 symbols completed. NOC took 32.9s. Estimated remaining: 2h 5m 48s. Rate: 6.8 symbols/min [2025-09-18T20:40:49.999436] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-18T20:40:50.070329] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:40:50.112811] [DEBUG] [LOCAL ] NOMD: Loaded 41492 existing records from primary storage. [2025-09-18T20:40:50.112957] [INFO ] [MAIN ] NOMD: Loaded 41492 existing records. [2025-09-18T20:40:50.124818] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-09-18T20:40:50.309398] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:40:50.309678] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-09-18T20:40:50.309736] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-09-18T20:40:50.310852] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-09-18T20:40:50.310930] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-09-18T20:40:50.699314] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:40:50.729430] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-18T20:40:50.763533] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-18T20:40:50.919547] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-09-18T20:40:51.264525] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-18T20:40:51.719548] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-11. [2025-09-18T20:40:52.519548] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-09-18T20:40:53.319615] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-09-18T20:40:53.430695] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-18T20:40:53.657756] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-18T20:40:54.119618] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-09-18T20:40:54.345437] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-18T20:40:54.919549] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-09-18T20:40:55.362760] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-18T20:40:55.680597] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T20:40:55.719530] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-09-18T20:40:56.519591] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-09-18T20:40:57.038257] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-18T20:40:57.319570] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-09-18T20:40:58.119711] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-09-18T20:40:58.386238] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-18T20:40:58.919526] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-09-18T20:40:59.095509] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-18T20:40:59.304424] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-18T20:40:59.719568] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-09-18T20:41:00.345178] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T20:41:00.519537] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-09-18T20:41:01.319615] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-09-18T20:41:01.662280] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-18T20:41:01.743905] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-18T20:41:02.119591] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-09-18T20:41:02.288781] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-18T20:41:02.467507] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-18T20:41:02.919564] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-09-18T20:41:03.719600] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-09-18T20:41:04.233409] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-18T20:41:04.256003] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-18T20:41:04.263120] [INFO ] [REMOTE ] NOG: Full fetch complete (73337 records). [2025-09-18T20:41:04.263293] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-09-18T20:41:04.528299] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-09-18T20:41:04.668481] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-09-18T20:41:04.668577] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-09-18T20:41:04.669551] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-09-18T20:41:04.669627] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-09-18T20:41:04.672102] [DEBUG] [LOCAL ] NOG: Trimmed 73337 records to 51549 (keeping 200 days of data) [2025-09-18T20:41:04.987474] [DEBUG] [LOCAL ] NOG: Primary data saved (51549 records). [2025-09-18T20:41:04.987794] [INFO ] [MAIN ] NOG: Full history saved. [2025-09-18T20:41:04.987962] [INFO ] [MAIN ] Update Progress: 1512/2372 symbols completed. NOG took 45.1s. Estimated remaining: 2h 5m 43s. Rate: 6.8 symbols/min [2025-09-18T20:41:05.110836] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-18T20:41:05.167666] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:41:05.208705] [DEBUG] [LOCAL ] NOTE: Loaded 43496 existing records from primary storage. [2025-09-18T20:41:05.208896] [INFO ] [MAIN ] NOTE: Loaded 43496 existing records. [2025-09-18T20:41:05.324732] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-09-18T20:41:05.405582] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:41:05.405867] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-09-18T20:41:05.405934] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-09-18T20:41:05.406861] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-09-18T20:41:05.406923] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-09-18T20:41:05.745159] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-18T20:41:05.787337] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:41:06.119554] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-18T20:41:06.505726] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-18T20:41:06.506663] [INFO ] [REMOTE ] NOM: Full fetch complete (1725 records). [2025-09-18T20:41:06.506742] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-09-18T20:41:06.698619] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-18T20:41:06.698892] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:41:06.698966] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:41:06.699037] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-18T20:41:06.699107] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-18T20:41:06.699147] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-09-18T20:41:06.699244] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-09-18T20:41:06.699337] [INFO ] [MAIN ] Update Progress: 1513/2372 symbols completed. NOM took 18.3s. Estimated remaining: 2h 5m 30s. Rate: 6.8 symbols/min [2025-09-18T20:41:06.868789] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:41:06.926636] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-09-18T20:41:06.929929] [DEBUG] [LOCAL ] NOV: Loaded 53200 existing records from primary storage. [2025-09-18T20:41:06.930081] [INFO ] [MAIN ] NOV: Loaded 53200 existing records. [2025-09-18T20:41:07.110906] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:41:07.111208] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-09-18T20:41:07.111259] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-09-18T20:41:07.112631] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-09-18T20:41:07.112716] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-09-18T20:41:07.476791] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:41:07.719618] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-09-18T20:41:08.519586] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-11. [2025-09-18T20:41:09.259636] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-18T20:41:09.294014] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-18T20:41:09.319524] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-09-18T20:41:09.513115] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-18T20:41:10.119694] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-09-18T20:41:10.657318] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-18T20:41:10.919592] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-09-18T20:41:11.719546] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-09-18T20:41:11.863537] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-18T20:41:12.365881] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-18T20:41:12.519550] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-09-18T20:41:12.871733] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-18T20:41:13.319567] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-09-18T20:41:14.129752] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-11. [2025-09-18T20:41:14.135227] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-18T20:41:14.919560] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-09-18T20:41:14.973117] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-18T20:41:15.719563] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-09-18T20:41:15.942228] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-18T20:41:16.450881] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-18T20:41:16.519546] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-09-18T20:41:16.942767] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-18T20:41:17.319550] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-09-18T20:41:17.992044] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-18T20:41:18.119568] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-09-18T20:41:18.919598] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-09-18T20:41:19.625840] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-18T20:41:19.692001] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-18T20:41:19.719496] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-09-18T20:41:20.378796] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-18T20:41:20.519548] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-09-18T20:41:21.331937] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-09-18T20:41:21.338258] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-18T20:41:21.852079] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T20:41:22.119547] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-09-18T20:41:22.462571] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T20:41:22.919546] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-09-18T20:41:23.719568] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-09-18T20:41:23.983111] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-18T20:41:24.330088] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-18T20:41:24.519517] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-09-18T20:41:24.855563] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T20:41:25.319542] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-09-18T20:41:26.046274] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-18T20:41:26.119492] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-09-18T20:41:26.455124] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-18T20:41:26.461435] [INFO ] [REMOTE ] NOMD: Full fetch complete (58672 records). [2025-09-18T20:41:26.461538] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-09-18T20:41:26.842838] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-09-18T20:41:26.842923] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-09-18T20:41:26.843760] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-09-18T20:41:26.843824] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-09-18T20:41:26.845014] [DEBUG] [LOCAL ] NOMD: Trimmed 58672 records to 41837 (keeping 200 days of data) [2025-09-18T20:41:26.935557] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-09-18T20:41:27.104784] [DEBUG] [LOCAL ] NOMD: Primary data saved (41837 records). [2025-09-18T20:41:27.104933] [INFO ] [MAIN ] NOMD: Full history saved. [2025-09-18T20:41:27.105117] [INFO ] [MAIN ] Update Progress: 1514/2372 symbols completed. NOMD took 37.2s. Estimated remaining: 2h 5m 28s. Rate: 6.8 symbols/min [2025-09-18T20:41:27.272404] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:41:27.272608] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-09-18T20:41:27.272689] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-09-18T20:41:27.272838] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-09-18T20:41:27.272885] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-18T20:41:27.272929] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-09-18T20:41:27.272962] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-09-18T20:41:27.624815] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:41:27.719495] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-11. [2025-09-18T20:41:28.075141] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-18T20:41:28.519593] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-09-18T20:41:28.739934] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-18T20:41:28.750287] [INFO ] [REMOTE ] NOK: Full fetch complete (77525 records). [2025-09-18T20:41:28.750428] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-09-18T20:41:29.150124] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-09-18T20:41:29.150223] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-09-18T20:41:29.151334] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-09-18T20:41:29.151410] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-09-18T20:41:29.155935] [DEBUG] [LOCAL ] NOK: Trimmed 77525 records to 54011 (keeping 200 days of data) [2025-09-18T20:41:29.320814] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-09-18T20:41:29.324363] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-18T20:41:29.545255] [DEBUG] [LOCAL ] NOK: Primary data saved (54011 records). [2025-09-18T20:41:29.545404] [INFO ] [MAIN ] NOK: Full history saved. [2025-09-18T20:41:29.545509] [INFO ] [MAIN ] Update Progress: 1515/2372 symbols completed. NOK took 44.5s. Estimated remaining: 2h 5m 16s. Rate: 6.8 symbols/min [2025-09-18T20:41:29.723509] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:41:29.723729] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-09-18T20:41:29.723778] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-09-18T20:41:29.723923] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-09-18T20:41:29.724003] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-18T20:41:29.724062] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-18T20:41:29.724095] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-09-18T20:41:30.108819] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:41:30.124615] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-11. [2025-09-18T20:41:30.142851] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-18T20:41:30.399735] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:41:30.400132] [WARN ] [REMOTE ] NPB: No data returned for month 2024-11 [2025-09-18T20:41:30.588802] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-18T20:41:30.919523] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-09-18T20:41:31.719542] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-09-18T20:41:32.519548] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-09-18T20:41:32.734069] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-18T20:41:32.782524] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:41:32.782976] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-09-18T20:41:33.319587] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-01. [2025-09-18T20:41:33.425667] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-18T20:41:33.569033] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:41:33.569536] [WARN ] [REMOTE ] NPB: No data returned for month 2025-01 [2025-09-18T20:41:34.119556] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-09-18T20:41:34.919595] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-02. [2025-09-18T20:41:35.672348] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-18T20:41:35.719537] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-03. [2025-09-18T20:41:35.949508] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-18T20:41:36.427725] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-18T20:41:36.519548] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-04. [2025-09-18T20:41:37.131937] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-18T20:41:37.319556] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-05. [2025-09-18T20:41:38.119535] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-09-18T20:41:38.157746] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-18T20:41:38.919598] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-09-18T20:41:39.719605] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-06. [2025-09-18T20:41:40.266791] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-18T20:41:40.379214] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-18T20:41:40.519575] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-09-18T20:41:40.643364] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-18T20:41:41.319608] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-07. [2025-09-18T20:41:42.063861] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-18T20:41:42.119618] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-09-18T20:41:42.385398] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-18T20:41:42.919687] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-09-18T20:41:43.639754] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-18T20:41:43.719508] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-09-18T20:41:44.519700] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-08. [2025-09-18T20:41:45.097973] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-18T20:41:45.108184] [INFO ] [REMOTE ] NOV: Full fetch complete (76805 records). [2025-09-18T20:41:45.108373] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-09-18T20:41:45.335804] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-09-18T20:41:45.459595] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-18T20:41:45.607196] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-09-18T20:41:45.607950] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-09-18T20:41:45.609244] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-18T20:41:45.620986] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-09-18T20:41:45.621541] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-09-18T20:41:45.623075] [DEBUG] [LOCAL ] NOV: Trimmed 76805 records to 53579 (keeping 200 days of data) [2025-09-18T20:41:45.969584] [DEBUG] [LOCAL ] NOV: Primary data saved (53579 records). [2025-09-18T20:41:45.969749] [INFO ] [MAIN ] NOV: Full history saved. [2025-09-18T20:41:45.971403] [INFO ] [MAIN ] Update Progress: 1516/2372 symbols completed. NOV took 39.3s. Estimated remaining: 2h 5m 11s. Rate: 6.8 symbols/min [2025-09-18T20:41:46.125461] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-09. [2025-09-18T20:41:46.154192] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:41:46.178718] [DEBUG] [LOCAL ] NPCT: Loaded 17050 existing records from primary storage. [2025-09-18T20:41:46.178900] [INFO ] [MAIN ] NPCT: Loaded 17050 existing records. [2025-09-18T20:41:46.367319] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:41:46.367618] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-09-18T20:41:46.367733] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-09-18T20:41:46.368403] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-09-18T20:41:46.368484] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-09-18T20:41:46.746699] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:41:46.919507] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-11. [2025-09-18T20:41:47.005947] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-18T20:41:47.010171] [INFO ] [REMOTE ] NPB: Full fetch complete (15696 records). [2025-09-18T20:41:47.010312] [DEBUG] [VALIDATOR ] NPB: Validating primary data. [2025-09-18T20:41:47.266341] [WARN ] [VALIDATOR ] NPB: Validation failed - insufficient historical data. Have 149 unique days, need 200 days [2025-09-18T20:41:47.266936] [FATAL] [MAIN ] NPB: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:41:47.267024] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:41:47.267163] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-18T20:41:47.267320] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-18T20:41:47.267560] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-09-18T20:41:47.267632] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-09-18T20:41:47.267746] [INFO ] [MAIN ] Update Progress: 1517/2372 symbols completed. NPB took 17.7s. Estimated remaining: 2h 4m 58s. Rate: 6.8 symbols/min [2025-09-18T20:41:47.326368] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-18T20:41:47.645141] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-18T20:41:47.719495] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-09-18T20:41:48.463296] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-18T20:41:48.519577] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-09-18T20:41:49.319503] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-09-18T20:41:49.711762] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-18T20:41:50.119548] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-09-18T20:41:50.919596] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-09-18T20:41:50.989683] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-18T20:41:51.513993] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-18T20:41:51.719707] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-09-18T20:41:52.100556] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-18T20:41:52.519622] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-09-18T20:41:52.879856] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-18T20:41:52.884021] [INFO ] [REMOTE ] NOTE: Full fetch complete (64839 records). [2025-09-18T20:41:52.884124] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-09-18T20:41:53.315609] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-09-18T20:41:53.315924] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-09-18T20:41:53.322227] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-09-18T20:41:53.322151] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-09-18T20:41:53.328547] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-09-18T20:41:53.330307] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-18T20:41:53.338922] [DEBUG] [LOCAL ] NOTE: Trimmed 64839 records to 43675 (keeping 200 days of data) [2025-09-18T20:41:53.610900] [DEBUG] [LOCAL ] NOTE: Primary data saved (43675 records). [2025-09-18T20:41:53.611039] [INFO ] [MAIN ] NOTE: Full history saved. [2025-09-18T20:41:53.611136] [INFO ] [MAIN ] Update Progress: 1518/2372 symbols completed. NOTE took 48.6s. Estimated remaining: 2h 4m 48s. Rate: 6.8 symbols/min [2025-09-18T20:41:54.119720] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-09-18T20:41:54.831003] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-18T20:41:54.919528] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-09-18T20:41:55.151609] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-18T20:41:55.692992] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-18T20:41:55.719503] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-09-18T20:41:56.496089] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-18T20:41:56.519491] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-09-18T20:41:57.234780] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-18T20:41:57.319550] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-09-18T20:41:58.119557] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-09-18T20:41:58.327799] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-18T20:41:58.919611] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-09-18T20:41:59.887564] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-18T20:41:59.890747] [INFO ] [REMOTE ] NPCT: Full fetch complete (25233 records). [2025-09-18T20:41:59.890994] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-09-18T20:42:00.287508] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-09-18T20:42:00.287693] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-09-18T20:42:00.288268] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-09-18T20:42:00.288348] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-09-18T20:42:00.311302] [DEBUG] [LOCAL ] NPCT: Trimmed 25233 records to 17118 (keeping 200 days of data) [2025-09-18T20:42:00.312829] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-18T20:42:00.322459] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-09-18T20:42:00.428512] [DEBUG] [LOCAL ] NPCT: Primary data saved (17118 records). [2025-09-18T20:42:00.428667] [INFO ] [MAIN ] NPCT: Full history saved. [2025-09-18T20:42:00.428784] [INFO ] [MAIN ] Update Progress: 1519/2372 symbols completed. NPCT took 14.5s. Estimated remaining: 2h 4m 38s. Rate: 6.8 symbols/min [2025-09-18T20:42:02.904112] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-18T20:42:02.918052] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-09-18T20:42:07.456475] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (4.54 seconds). [2025-09-18T20:42:07.471112] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-09-18T20:42:08.281099] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-18T20:42:08.287522] [INFO ] [REMOTE ] NOW: Full fetch complete (70359 records). [2025-09-18T20:42:08.287709] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-09-18T20:42:08.288755] [FATAL] [VALIDATOR ] NOW: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T20:42:08.288858] [FATAL] [MAIN ] NOW: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:42:08.288941] [WARN ] [MAIN ] NOW: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:42:08.289035] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-18T20:42:08.289147] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-09-18T20:42:08.289216] [INFO ] [LOCAL ] NOW: Starting deletion of derivative data. [2025-09-18T20:42:08.289280] [DEBUG] [LOCAL ] NOW: No derivative data file found to delete. [2025-09-18T20:42:08.289382] [INFO ] [MAIN ] Update Progress: 1520/2372 symbols completed. NOW took 41.2s. Estimated remaining: 2h 4m 29s. Rate: 6.8 symbols/min [2025-09-18T20:42:08.930073] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:42:09.009485] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:42:09.000920] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:42:09.037492] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-09-18T20:42:09.042300] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-09-18T20:42:09.042563] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-09-18T20:42:09.042121] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:42:09.043063] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-18T20:42:09.043241] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-18T20:42:09.043289] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-09-18T20:42:09.140819] [DEBUG] [LOCAL ] NPK: Loaded 8169 existing records from primary storage. [2025-09-18T20:42:09.164019] [INFO ] [MAIN ] NPK: Loaded 8169 existing records. [2025-09-18T20:42:09.176527] [DEBUG] [LOCAL ] NPFD: Loaded 9711 existing records from primary storage. [2025-09-18T20:42:09.182509] [DEBUG] [LOCAL ] NPO: Loaded 12875 existing records from primary storage. [2025-09-18T20:42:09.182243] [INFO ] [MAIN ] NPFD: Loaded 9711 existing records. [2025-09-18T20:42:09.198723] [INFO ] [MAIN ] NPO: Loaded 12875 existing records. [2025-09-18T20:42:09.969144] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:42:10.031502] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-09-18T20:42:09.984094] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:42:10.047812] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-09-18T20:42:10.031394] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:42:10.054003] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:42:10.054711] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-11. [2025-09-18T20:42:10.055700] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-09-18T20:42:10.055911] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-09-18T20:42:10.056040] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-09-18T20:42:10.054822] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-09-18T20:42:10.067228] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-09-18T20:42:10.067185] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-09-18T20:42:10.091410] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-09-18T20:42:10.097280] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-09-18T20:42:10.097132] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-09-18T20:42:10.107689] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-09-18T20:42:10.327704] [DEBUG] [REMOTE ] NPKI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:42:10.397220] [WARN ] [REMOTE ] NPKI: No data returned for month 2024-11 [2025-09-18T20:42:10.435603] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-09-18T20:42:11.162431] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:42:11.190809] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-11. [2025-09-18T20:42:11.210825] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:42:11.223478] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-11. [2025-09-18T20:42:11.303038] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-18T20:42:11.307107] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:42:11.310962] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-09-18T20:42:11.311282] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-11. [2025-09-18T20:42:11.780572] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-18T20:42:11.783182] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-09-18T20:42:11.963914] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-18T20:42:11.967207] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-09-18T20:42:12.087737] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-18T20:42:12.091163] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-09-18T20:42:12.329982] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-18T20:42:12.336880] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-09-18T20:42:12.343328] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-18T20:42:12.345924] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-09-18T20:42:12.574814] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-18T20:42:12.578237] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-09-18T20:42:13.021499] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-18T20:42:13.025439] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-09-18T20:42:13.031386] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-18T20:42:13.033692] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-09-18T20:42:13.500319] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-18T20:42:13.502999] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-09-18T20:42:13.864160] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-18T20:42:14.119566] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-09-18T20:42:14.253438] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T20:42:14.454478] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T20:42:14.919555] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-09-18T20:42:15.403363] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-18T20:42:15.719539] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-09-18T20:42:15.831811] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-18T20:42:15.905156] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-18T20:42:16.355006] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-18T20:42:16.519566] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-09-18T20:42:17.073025] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-18T20:42:17.319619] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-09-18T20:42:17.866974] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-18T20:42:18.119538] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-09-18T20:42:18.576448] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-18T20:42:18.919545] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-09-18T20:42:19.396129] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-18T20:42:19.719556] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-09-18T20:42:20.458411] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-18T20:42:20.519502] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-09-18T20:42:21.093712] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-18T20:42:21.319564] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-09-18T20:42:22.119571] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-09-18T20:42:22.585675] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-18T20:42:22.743288] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-18T20:42:22.919548] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-09-18T20:42:23.719569] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-09-18T20:42:24.519551] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-09-18T20:42:24.887347] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-18T20:42:25.033075] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-18T20:42:25.319542] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-09-18T20:42:26.119530] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-09-18T20:42:26.454608] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-18T20:42:26.919558] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-09-18T20:42:27.131606] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-18T20:42:27.643269] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-18T20:42:27.646143] [INFO ] [REMOTE ] NPFD: Full fetch complete (14824 records). [2025-09-18T20:42:27.646401] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-09-18T20:42:27.720234] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-09-18T20:42:27.970909] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-09-18T20:42:28.071670] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-09-18T20:42:28.071759] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-09-18T20:42:28.072091] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-09-18T20:42:28.072130] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-09-18T20:42:28.072750] [DEBUG] [LOCAL ] NPFD: Trimmed 14824 records to 9855 (keeping 200 days of data) [2025-09-18T20:42:28.136550] [DEBUG] [LOCAL ] NPFD: Primary data saved (9855 records). [2025-09-18T20:42:28.136721] [INFO ] [MAIN ] NPFD: Full history saved. [2025-09-18T20:42:28.136823] [INFO ] [MAIN ] Update Progress: 1521/2372 symbols completed. NPFD took 19.8s. Estimated remaining: 2h 4m 26s. Rate: 6.8 symbols/min [2025-09-18T20:42:28.306722] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:42:28.314136] [DEBUG] [LOCAL ] NPV: Loaded 4973 existing records from primary storage. [2025-09-18T20:42:28.314262] [INFO ] [MAIN ] NPV: Loaded 4973 existing records. [2025-09-18T20:42:28.494841] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:42:28.495091] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-09-18T20:42:28.495141] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-09-18T20:42:28.495496] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-09-18T20:42:28.495560] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-09-18T20:42:28.526563] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-09-18T20:42:28.858028] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:42:28.867907] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-18T20:42:29.319564] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-09-18T20:42:29.388823] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-18T20:42:30.119581] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-09-18T20:42:30.754071] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T20:42:30.855485] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-18T20:42:30.919561] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-09-18T20:42:31.719541] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-11. [2025-09-18T20:42:31.839465] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T20:42:32.464721] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-18T20:42:32.519503] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-09-18T20:42:33.319535] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-09-18T20:42:33.811228] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-18T20:42:33.972087] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-18T20:42:34.119604] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-09-18T20:42:34.731007] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-18T20:42:34.919600] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-09-18T20:42:35.719571] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-18T20:42:35.747541] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-18T20:42:36.519566] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-09-18T20:42:37.111827] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-18T20:42:37.117893] [INFO ] [REMOTE ] NPKI: Full fetch complete (52106 records). [2025-09-18T20:42:37.118084] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-09-18T20:42:37.230982] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-18T20:42:37.253422] [INFO ] [REMOTE ] NPK: Full fetch complete (11063 records). [2025-09-18T20:42:37.270913] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-09-18T20:42:37.330708] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-09-18T20:42:37.433707] [WARN ] [VALIDATOR ] NPKI: Validation failed - insufficient historical data. Have 186 unique days, need 200 days [2025-09-18T20:42:37.440049] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:42:37.450403] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:42:37.460819] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-18T20:42:37.503773] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-18T20:42:37.510838] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-09-18T20:42:37.548107] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-09-18T20:42:37.607348] [INFO ] [MAIN ] Update Progress: 1522/2372 symbols completed. NPKI took 29.3s. Estimated remaining: 2h 4m 18s. Rate: 6.8 symbols/min [2025-09-18T20:42:37.847491] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-09-18T20:42:37.848255] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-09-18T20:42:37.855218] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-09-18T20:42:37.862149] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-09-18T20:42:37.882796] [DEBUG] [LOCAL ] NPK: Trimmed 11063 records to 8234 (keeping 200 days of data) [2025-09-18T20:42:37.884493] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:42:37.933562] [DEBUG] [LOCAL ] NPK: Primary data saved (8234 records). [2025-09-18T20:42:37.933815] [INFO ] [MAIN ] NPK: Full history saved. [2025-09-18T20:42:37.933911] [INFO ] [MAIN ] Update Progress: 1523/2372 symbols completed. NPK took 29.6s. Estimated remaining: 2h 4m 5s. Rate: 6.8 symbols/min [2025-09-18T20:42:38.120828] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-09-18T20:42:38.124902] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:42:38.130919] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-18T20:42:38.146409] [DEBUG] [LOCAL ] NPWR: Loaded 42960 existing records from primary storage. [2025-09-18T20:42:38.146542] [INFO ] [MAIN ] NPWR: Loaded 42960 existing records. [2025-09-18T20:42:38.251208] [DEBUG] [LOCAL ] NQP: Loaded 9172 existing records from primary storage. [2025-09-18T20:42:38.253736] [INFO ] [MAIN ] NQP: Loaded 9172 existing records. [2025-09-18T20:42:38.454728] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:42:38.491421] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-09-18T20:42:38.509337] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-09-18T20:42:38.512947] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:42:38.513131] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-09-18T20:42:38.513186] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-09-18T20:42:38.513562] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-09-18T20:42:38.513622] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-09-18T20:42:38.545258] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-09-18T20:42:38.556969] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-09-18T20:42:38.925849] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-09-18T20:42:39.216608] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:42:39.244364] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:42:39.253106] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-18T20:42:39.467564] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-18T20:42:39.719495] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-11. [2025-09-18T20:42:40.519631] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-09-18T20:42:41.135136] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T20:42:41.137171] [INFO ] [REMOTE ] NPO: Full fetch complete (18172 records). [2025-09-18T20:42:41.137250] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-09-18T20:42:41.319520] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-09-18T20:42:41.518865] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-09-18T20:42:41.531717] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-09-18T20:42:41.540498] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-09-18T20:42:41.540637] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-09-18T20:42:41.542556] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-18T20:42:41.545681] [DEBUG] [LOCAL ] NPO: Trimmed 18172 records to 12975 (keeping 200 days of data) [2025-09-18T20:42:41.637564] [DEBUG] [LOCAL ] NPO: Primary data saved (12975 records). [2025-09-18T20:42:41.637744] [INFO ] [MAIN ] NPO: Full history saved. [2025-09-18T20:42:41.637859] [INFO ] [MAIN ] Update Progress: 1524/2372 symbols completed. NPO took 33.3s. Estimated remaining: 2h 3m 53s. Rate: 6.8 symbols/min [2025-09-18T20:42:41.809880] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:42:41.848671] [DEBUG] [LOCAL ] NRDY: Loaded 33268 existing records from primary storage. [2025-09-18T20:42:41.848839] [INFO ] [MAIN ] NRDY: Loaded 33268 existing records. [2025-09-18T20:42:42.037295] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:42:42.038331] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-18T20:42:42.040240] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-09-18T20:42:42.040300] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-09-18T20:42:42.041404] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-09-18T20:42:42.041466] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-09-18T20:42:42.124693] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-09-18T20:42:42.402896] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:42:42.714021] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-18T20:42:42.919544] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-11. [2025-09-18T20:42:43.719517] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-09-18T20:42:43.846340] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-18T20:42:44.205246] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-18T20:42:44.519554] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-09-18T20:42:45.319580] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-11. [2025-09-18T20:42:45.482266] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-18T20:42:46.119528] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-09-18T20:42:46.719378] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-18T20:42:46.919554] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-09-18T20:42:47.064232] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-18T20:42:47.719589] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-09-18T20:42:48.109388] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-18T20:42:48.158828] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-18T20:42:48.519603] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-09-18T20:42:49.319527] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-09-18T20:42:49.453436] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-18T20:42:49.887737] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-18T20:42:50.119589] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-09-18T20:42:50.919594] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-09-18T20:42:51.674461] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-18T20:42:51.719572] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-09-18T20:42:52.332444] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-18T20:42:52.519599] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-09-18T20:42:52.583479] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-18T20:42:53.319611] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-09-18T20:42:54.016954] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-18T20:42:54.119518] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-09-18T20:42:54.204601] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-18T20:42:54.919615] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-09-18T20:42:55.222171] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-18T20:42:55.400425] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-18T20:42:55.401916] [INFO ] [REMOTE ] NPV: Full fetch complete (6764 records). [2025-09-18T20:42:55.401988] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-09-18T20:42:55.731066] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-09-18T20:42:55.776080] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-09-18T20:42:55.776151] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-09-18T20:42:55.776324] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-09-18T20:42:55.776363] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-09-18T20:42:55.777279] [DEBUG] [LOCAL ] NPV: Trimmed 6764 records to 4999 (keeping 200 days of data) [2025-09-18T20:42:55.809048] [DEBUG] [LOCAL ] NPV: Primary data saved (4999 records). [2025-09-18T20:42:55.809160] [INFO ] [MAIN ] NPV: Full history saved. [2025-09-18T20:42:55.809243] [INFO ] [MAIN ] Update Progress: 1525/2372 symbols completed. NPV took 27.7s. Estimated remaining: 2h 3m 47s. Rate: 6.8 symbols/min [2025-09-18T20:42:55.980929] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:42:55.991118] [DEBUG] [LOCAL ] NREF: Loaded 7790 existing records from primary storage. [2025-09-18T20:42:55.991240] [INFO ] [MAIN ] NREF: Loaded 7790 existing records. [2025-09-18T20:42:56.171375] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:42:56.171675] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-09-18T20:42:56.171737] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-09-18T20:42:56.172126] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-09-18T20:42:56.172186] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-09-18T20:42:56.502155] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-18T20:42:56.521632] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-09-18T20:42:56.565269] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:42:57.319564] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-11. [2025-09-18T20:42:58.082443] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-18T20:42:58.108902] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-18T20:42:58.119480] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-09-18T20:42:58.919553] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-09-18T20:42:59.395869] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-18T20:42:59.476029] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-18T20:42:59.719558] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-09-18T20:43:00.519552] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-09-18T20:43:01.319582] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-09-18T20:43:01.507800] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-18T20:43:01.551520] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-18T20:43:02.119684] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-09-18T20:43:02.445091] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-18T20:43:02.647060] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-18T20:43:02.919577] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-09-18T20:43:03.720003] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-09-18T20:43:03.723725] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-18T20:43:04.519639] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-09-18T20:43:05.214192] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T20:43:05.227007] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-18T20:43:05.319554] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-09-18T20:43:06.119593] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-09-18T20:43:06.919579] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-09-18T20:43:07.003869] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-18T20:43:07.018565] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-18T20:43:07.472555] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-18T20:43:07.719542] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-09-18T20:43:08.519635] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-09-18T20:43:08.607901] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-18T20:43:09.319613] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-09-18T20:43:09.792486] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-18T20:43:10.119596] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-09-18T20:43:10.849130] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-18T20:43:10.851781] [INFO ] [REMOTE ] NQP: Full fetch complete (13473 records). [2025-09-18T20:43:10.851991] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-09-18T20:43:10.924771] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-09-18T20:43:11.007399] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-18T20:43:11.259483] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-09-18T20:43:11.259580] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-09-18T20:43:11.259953] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-09-18T20:43:11.260016] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-09-18T20:43:11.260506] [DEBUG] [LOCAL ] NQP: Trimmed 13473 records to 9232 (keeping 200 days of data) [2025-09-18T20:43:11.316360] [DEBUG] [LOCAL ] NQP: Primary data saved (9232 records). [2025-09-18T20:43:11.316497] [INFO ] [MAIN ] NQP: Full history saved. [2025-09-18T20:43:11.316584] [INFO ] [MAIN ] Update Progress: 1526/2372 symbols completed. NQP took 33.4s. Estimated remaining: 2h 3m 42s. Rate: 6.8 symbols/min [2025-09-18T20:43:11.484243] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:43:11.484435] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-09-18T20:43:11.484474] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-09-18T20:43:11.484731] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-09-18T20:43:11.484800] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-18T20:43:11.484859] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-09-18T20:43:11.484915] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-09-18T20:43:11.725124] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-09-18T20:43:11.844123] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:43:12.424567] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-18T20:43:12.439114] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-18T20:43:12.519511] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-09-18T20:43:13.319546] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-09-18T20:43:13.815254] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-18T20:43:14.119556] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-09-18T20:43:14.344987] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-18T20:43:14.919606] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-09-18T20:43:15.073457] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-18T20:43:15.719544] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-09-18T20:43:16.367386] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T20:43:16.519586] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-09-18T20:43:16.535349] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-18T20:43:16.539949] [INFO ] [REMOTE ] NRDY: Full fetch complete (52537 records). [2025-09-18T20:43:16.540080] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-09-18T20:43:16.936902] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-09-18T20:43:16.936990] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-09-18T20:43:16.937848] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-09-18T20:43:16.937913] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-09-18T20:43:16.939027] [DEBUG] [LOCAL ] NRDY: Trimmed 52537 records to 33506 (keeping 200 days of data) [2025-09-18T20:43:17.130273] [DEBUG] [LOCAL ] NRDY: Primary data saved (33506 records). [2025-09-18T20:43:17.130409] [INFO ] [MAIN ] NRDY: Full history saved. [2025-09-18T20:43:17.130496] [INFO ] [MAIN ] Update Progress: 1527/2372 symbols completed. NRDY took 35.5s. Estimated remaining: 2h 3m 32s. Rate: 6.8 symbols/min [2025-09-18T20:43:17.302156] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:43:17.324724] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-09-18T20:43:17.342487] [DEBUG] [LOCAL ] NRGV: Loaded 42685 existing records from primary storage. [2025-09-18T20:43:17.342689] [INFO ] [MAIN ] NRGV: Loaded 42685 existing records. [2025-09-18T20:43:17.521552] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:43:17.521855] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-09-18T20:43:17.521906] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-09-18T20:43:17.523234] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-09-18T20:43:17.523295] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-09-18T20:43:17.914545] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:43:18.123295] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-11. [2025-09-18T20:43:18.126455] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-18T20:43:18.185624] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-18T20:43:18.919556] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-11. [2025-09-18T20:43:19.719578] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-09-18T20:43:20.089334] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-18T20:43:20.229745] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-18T20:43:20.327360] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-18T20:43:20.519556] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-09-18T20:43:21.319598] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-09-18T20:43:22.108808] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-18T20:43:22.119781] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-09-18T20:43:22.248167] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-18T20:43:22.919549] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-09-18T20:43:23.640926] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-18T20:43:23.642819] [INFO ] [REMOTE ] NREF: Full fetch complete (10803 records). [2025-09-18T20:43:23.642892] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-09-18T20:43:23.724740] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-09-18T20:43:24.014751] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-09-18T20:43:24.014934] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-09-18T20:43:24.015273] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-09-18T20:43:24.015349] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-09-18T20:43:24.016198] [DEBUG] [LOCAL ] NREF: Trimmed 10803 records to 7841 (keeping 200 days of data) [2025-09-18T20:43:24.065674] [DEBUG] [LOCAL ] NREF: Primary data saved (7841 records). [2025-09-18T20:43:24.065950] [INFO ] [MAIN ] NREF: Full history saved. [2025-09-18T20:43:24.066071] [INFO ] [MAIN ] Update Progress: 1528/2372 symbols completed. NREF took 28.3s. Estimated remaining: 2h 3m 22s. Rate: 6.8 symbols/min [2025-09-18T20:43:24.208998] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-18T20:43:24.282402] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:43:24.308546] [DEBUG] [LOCAL ] NRK: Loaded 19512 existing records from primary storage. [2025-09-18T20:43:24.308744] [INFO ] [MAIN ] NRK: Loaded 19512 existing records. [2025-09-18T20:43:24.486728] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:43:24.486970] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-09-18T20:43:24.487019] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-09-18T20:43:24.487713] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-09-18T20:43:24.487774] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-09-18T20:43:24.529545] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-09-18T20:43:24.850673] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:43:24.864153] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-18T20:43:24.869448] [INFO ] [REMOTE ] NPWR: Full fetch complete (58773 records). [2025-09-18T20:43:24.869560] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-09-18T20:43:25.257614] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-09-18T20:43:25.257727] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-09-18T20:43:25.258480] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-09-18T20:43:25.258522] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-09-18T20:43:25.259751] [DEBUG] [LOCAL ] NPWR: Trimmed 58773 records to 43291 (keeping 200 days of data) [2025-09-18T20:43:25.322345] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-11. [2025-09-18T20:43:25.510232] [DEBUG] [LOCAL ] NPWR: Primary data saved (43291 records). [2025-09-18T20:43:25.510366] [INFO ] [MAIN ] NPWR: Full history saved. [2025-09-18T20:43:25.510449] [INFO ] [MAIN ] Update Progress: 1529/2372 symbols completed. NPWR took 47.9s. Estimated remaining: 2h 3m 9s. Rate: 6.8 symbols/min [2025-09-18T20:43:25.687733] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:43:25.693534] [DEBUG] [LOCAL ] NRP: Loaded 4153 existing records from primary storage. [2025-09-18T20:43:25.693619] [INFO ] [MAIN ] NRP: Loaded 4153 existing records. [2025-09-18T20:43:25.872628] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:43:25.872858] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-09-18T20:43:25.872918] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-09-18T20:43:25.873235] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-09-18T20:43:25.873293] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-09-18T20:43:26.124722] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-09-18T20:43:26.231971] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:43:26.323311] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-18T20:43:26.352219] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-18T20:43:26.919607] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-09-18T20:43:27.571920] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-18T20:43:27.622013] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-18T20:43:27.719553] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-09-18T20:43:28.519602] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-09-18T20:43:29.319523] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-11. [2025-09-18T20:43:29.765153] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-18T20:43:29.804138] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-18T20:43:29.818738] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-18T20:43:30.119529] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-09-18T20:43:30.919556] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-09-18T20:43:31.720510] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-18T20:43:31.719503] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-09-18T20:43:32.168105] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-18T20:43:32.225902] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-18T20:43:32.519548] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-09-18T20:43:33.319526] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-09-18T20:43:33.511364] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-18T20:43:34.119533] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-09-18T20:43:34.564602] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T20:43:34.584759] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-18T20:43:34.919549] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-09-18T20:43:35.719631] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-09-18T20:43:36.239109] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T20:43:36.519574] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-09-18T20:43:36.657662] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T20:43:37.174942] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-18T20:43:37.319505] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-09-18T20:43:37.990489] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-18T20:43:38.119558] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-09-18T20:43:38.639873] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-18T20:43:38.919566] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-09-18T20:43:39.307788] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-18T20:43:39.719572] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-09-18T20:43:40.519513] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-09-18T20:43:40.661736] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-18T20:43:41.319555] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-09-18T20:43:42.119557] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-09-18T20:43:42.288819] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-18T20:43:42.598574] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-18T20:43:42.928559] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-09-18T20:43:42.935618] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-18T20:43:43.719563] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-09-18T20:43:44.231723] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-18T20:43:44.519518] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-09-18T20:43:44.833814] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-18T20:43:45.319598] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-09-18T20:43:45.950402] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T20:43:46.119589] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-09-18T20:43:46.872691] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-18T20:43:46.919554] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-09-18T20:43:47.719588] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-09-18T20:43:47.767741] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-18T20:43:48.519601] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-09-18T20:43:48.665481] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-18T20:43:48.707846] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-18T20:43:49.011217] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-18T20:43:49.319599] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-09-18T20:43:50.119546] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-09-18T20:43:50.556125] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-18T20:43:50.919726] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-09-18T20:43:51.719504] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-09-18T20:43:51.805568] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-18T20:43:52.264696] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-18T20:43:52.519520] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-09-18T20:43:52.631694] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-18T20:43:53.319511] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-09-18T20:43:53.443477] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-18T20:43:53.836902] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-18T20:43:53.838168] [INFO ] [REMOTE ] NRP: Full fetch complete (6507 records). [2025-09-18T20:43:53.838264] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-09-18T20:43:54.127239] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-09-18T20:43:54.252138] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-09-18T20:43:54.252231] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-09-18T20:43:54.252426] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-09-18T20:43:54.252479] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-09-18T20:43:54.252970] [DEBUG] [LOCAL ] NRP: Trimmed 6507 records to 4191 (keeping 200 days of data) [2025-09-18T20:43:54.281451] [DEBUG] [LOCAL ] NRP: Primary data saved (4191 records). [2025-09-18T20:43:54.281584] [INFO ] [MAIN ] NRP: Full history saved. [2025-09-18T20:43:54.281707] [INFO ] [MAIN ] Update Progress: 1530/2372 symbols completed. NRP took 28.8s. Estimated remaining: 2h 3m 11s. Rate: 6.8 symbols/min [2025-09-18T20:43:54.468302] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:43:54.474987] [DEBUG] [LOCAL ] NRT: Loaded 4936 existing records from primary storage. [2025-09-18T20:43:54.475088] [INFO ] [MAIN ] NRT: Loaded 4936 existing records. [2025-09-18T20:43:54.660498] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:43:54.660880] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-09-18T20:43:54.660937] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-09-18T20:43:54.661496] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-09-18T20:43:54.661558] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-09-18T20:43:54.924682] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-09-18T20:43:55.024999] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:43:55.142779] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-18T20:43:55.146352] [INFO ] [REMOTE ] NRK: Full fetch complete (27755 records). [2025-09-18T20:43:55.146432] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-09-18T20:43:55.555844] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-09-18T20:43:55.555934] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-09-18T20:43:55.556552] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-09-18T20:43:55.556664] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-09-18T20:43:55.557462] [DEBUG] [LOCAL ] NRK: Trimmed 27755 records to 19672 (keeping 200 days of data) [2025-09-18T20:43:55.686427] [DEBUG] [LOCAL ] NRK: Primary data saved (19672 records). [2025-09-18T20:43:55.686575] [INFO ] [MAIN ] NRK: Full history saved. [2025-09-18T20:43:55.686686] [INFO ] [MAIN ] Update Progress: 1531/2372 symbols completed. NRK took 31.6s. Estimated remaining: 2h 2m 59s. Rate: 6.8 symbols/min [2025-09-18T20:43:55.724700] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-11. [2025-09-18T20:43:55.870636] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:43:55.875701] [DEBUG] [LOCAL ] NRUC: Loaded 3126 existing records from primary storage. [2025-09-18T20:43:55.875787] [INFO ] [MAIN ] NRUC: Loaded 3126 existing records. [2025-09-18T20:43:56.052768] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:43:56.053020] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-09-18T20:43:56.053069] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-09-18T20:43:56.053355] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-09-18T20:43:56.053415] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-09-18T20:43:56.427707] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:43:56.433623] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-18T20:43:56.519545] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-11. [2025-09-18T20:43:56.713438] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-18T20:43:56.720227] [INFO ] [REMOTE ] NRGV: Full fetch complete (61478 records). [2025-09-18T20:43:56.720385] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-09-18T20:43:57.116273] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-09-18T20:43:57.116369] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-09-18T20:43:57.117308] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-09-18T20:43:57.117418] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-09-18T20:43:57.122114] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-18T20:43:57.124467] [DEBUG] [LOCAL ] NRGV: Trimmed 61478 records to 43067 (keeping 200 days of data) [2025-09-18T20:43:57.320256] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-09-18T20:43:57.375851] [DEBUG] [LOCAL ] NRGV: Primary data saved (43067 records). [2025-09-18T20:43:57.375983] [INFO ] [MAIN ] NRGV: Full history saved. [2025-09-18T20:43:57.376070] [INFO ] [MAIN ] Update Progress: 1532/2372 symbols completed. NRGV took 40.2s. Estimated remaining: 2h 2m 46s. Rate: 6.8 symbols/min [2025-09-18T20:43:57.546782] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:43:57.588392] [DEBUG] [LOCAL ] NSA: Loaded 44818 existing records from primary storage. [2025-09-18T20:43:57.588551] [INFO ] [MAIN ] NSA: Loaded 44818 existing records. [2025-09-18T20:43:57.768224] [WARN ] [MAIN ] NSA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:43:57.768543] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-09-18T20:43:57.768591] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-09-18T20:43:57.769907] [DEBUG] [LOCAL ] NSA: Deleted primary data file. [2025-09-18T20:43:57.769970] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-09-18T20:43:58.119831] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-09-18T20:43:58.143203] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:43:58.163930] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-18T20:43:58.170909] [INFO ] [REMOTE ] NRG: Full fetch complete (76027 records). [2025-09-18T20:43:58.171015] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-09-18T20:43:58.171859] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T20:43:58.171947] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:43:58.172044] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:43:58.172116] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-18T20:43:58.172184] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-09-18T20:43:58.172222] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-09-18T20:43:58.172276] [DEBUG] [LOCAL ] NRG: No derivative data file found to delete. [2025-09-18T20:43:58.172358] [INFO ] [MAIN ] Update Progress: 1533/2372 symbols completed. NRG took 46.9s. Estimated remaining: 2h 2m 33s. Rate: 6.8 symbols/min [2025-09-18T20:43:58.347946] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:43:58.348134] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-09-18T20:43:58.348190] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-09-18T20:43:58.348341] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-09-18T20:43:58.348386] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-18T20:43:58.348429] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-09-18T20:43:58.348463] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-09-18T20:43:58.745454] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:43:58.750846] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-18T20:43:58.919528] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-11. [2025-09-18T20:43:59.719545] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-09-18T20:44:00.253128] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-18T20:44:00.253812] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-18T20:44:00.519522] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-11. [2025-09-18T20:44:01.319598] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-09-18T20:44:02.119603] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-09-18T20:44:02.181380] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-18T20:44:02.654048] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-18T20:44:02.919516] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-09-18T20:44:03.003957] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-18T20:44:03.327693] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-18T20:44:03.719557] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-09-18T20:44:04.519575] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-09-18T20:44:05.319583] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-09-18T20:44:05.331257] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-18T20:44:05.583397] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-18T20:44:05.750289] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-18T20:44:06.119539] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-09-18T20:44:06.919561] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-09-18T20:44:06.970743] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-18T20:44:07.719549] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-09-18T20:44:08.295138] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-18T20:44:08.383479] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-18T20:44:08.519567] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-09-18T20:44:09.319548] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-09-18T20:44:09.745869] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-18T20:44:10.025881] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-18T20:44:10.119535] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-09-18T20:44:10.758282] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-18T20:44:10.919547] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-09-18T20:44:11.377182] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-18T20:44:11.719567] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-09-18T20:44:12.519550] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-09-18T20:44:13.177781] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-18T20:44:13.319538] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-09-18T20:44:14.119532] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-09-18T20:44:14.226239] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-18T20:44:14.538163] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-18T20:44:14.919531] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-09-18T20:44:14.946987] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-18T20:44:15.439153] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-18T20:44:15.719709] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-09-18T20:44:16.519557] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-09-18T20:44:17.006291] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-18T20:44:17.204770] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-18T20:44:17.319527] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-09-18T20:44:18.119541] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-09-18T20:44:18.549916] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-18T20:44:18.589415] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-18T20:44:18.919547] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-09-18T20:44:19.472923] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-18T20:44:19.719560] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-09-18T20:44:20.295344] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-18T20:44:20.519541] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-09-18T20:44:21.144451] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-18T20:44:21.319549] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-09-18T20:44:21.855815] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-18T20:44:21.856848] [INFO ] [REMOTE ] NRUC: Full fetch complete (5562 records). [2025-09-18T20:44:21.856944] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-09-18T20:44:22.124695] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-09-18T20:44:22.237208] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-09-18T20:44:22.237290] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-09-18T20:44:22.237458] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-09-18T20:44:22.237514] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-09-18T20:44:22.237939] [DEBUG] [LOCAL ] NRUC: Trimmed 5562 records to 3157 (keeping 200 days of data) [2025-09-18T20:44:22.257518] [DEBUG] [LOCAL ] NRUC: Primary data saved (3157 records). [2025-09-18T20:44:22.257586] [INFO ] [MAIN ] NRUC: Full history saved. [2025-09-18T20:44:22.257757] [INFO ] [MAIN ] Update Progress: 1534/2372 symbols completed. NRUC took 26.6s. Estimated remaining: 2h 2m 32s. Rate: 6.8 symbols/min [2025-09-18T20:44:22.426731] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:44:22.468262] [DEBUG] [LOCAL ] NSP: Loaded 34929 existing records from primary storage. [2025-09-18T20:44:22.468437] [INFO ] [MAIN ] NSP: Loaded 34929 existing records. [2025-09-18T20:44:22.652755] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:44:22.653038] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-09-18T20:44:22.653089] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-09-18T20:44:22.654331] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-09-18T20:44:22.654393] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-09-18T20:44:22.924716] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-09-18T20:44:23.028991] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:44:23.719693] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-09-18T20:44:23.837156] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-18T20:44:24.335767] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T20:44:24.338142] [INFO ] [REMOTE ] NRT: Full fetch complete (8099 records). [2025-09-18T20:44:24.338215] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-09-18T20:44:24.519712] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-09-18T20:44:24.710543] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-09-18T20:44:24.710674] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-09-18T20:44:24.710972] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-09-18T20:44:24.711077] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-09-18T20:44:24.711638] [DEBUG] [LOCAL ] NRT: Trimmed 8099 records to 4960 (keeping 200 days of data) [2025-09-18T20:44:24.741148] [DEBUG] [LOCAL ] NRT: Primary data saved (4960 records). [2025-09-18T20:44:24.741327] [INFO ] [MAIN ] NRT: Full history saved. [2025-09-18T20:44:24.741519] [INFO ] [MAIN ] Update Progress: 1535/2372 symbols completed. NRT took 30.5s. Estimated remaining: 2h 2m 20s. Rate: 6.8 symbols/min [2025-09-18T20:44:24.873041] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-18T20:44:24.951897] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:44:24.978056] [DEBUG] [LOCAL ] NTB: Loaded 20852 existing records from primary storage. [2025-09-18T20:44:24.978210] [INFO ] [MAIN ] NTB: Loaded 20852 existing records. [2025-09-18T20:44:25.152474] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:44:25.152727] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-09-18T20:44:25.152791] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-09-18T20:44:25.153485] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-09-18T20:44:25.153545] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-09-18T20:44:25.324935] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-11. [2025-09-18T20:44:25.519709] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:44:25.886692] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-18T20:44:26.119552] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-09-18T20:44:26.850811] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-18T20:44:26.919489] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-09-18T20:44:27.436028] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-18T20:44:27.719599] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-09-18T20:44:28.008191] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-18T20:44:28.519615] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-09-18T20:44:29.319521] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-11. [2025-09-18T20:44:29.404518] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-18T20:44:30.119547] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-09-18T20:44:30.144791] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-18T20:44:30.151963] [INFO ] [REMOTE ] NSA: Full fetch complete (61425 records). [2025-09-18T20:44:30.152134] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-09-18T20:44:30.474834] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-18T20:44:30.582043] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-09-18T20:44:30.582133] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-09-18T20:44:30.583055] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-09-18T20:44:30.583147] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-09-18T20:44:30.584519] [DEBUG] [LOCAL ] NSA: Trimmed 61425 records to 45170 (keeping 200 days of data) [2025-09-18T20:44:30.877903] [DEBUG] [LOCAL ] NSA: Primary data saved (45170 records). [2025-09-18T20:44:30.878055] [INFO ] [MAIN ] NSA: Full history saved. [2025-09-18T20:44:30.878255] [INFO ] [MAIN ] Update Progress: 1536/2372 symbols completed. NSA took 33.5s. Estimated remaining: 2h 2m 10s. Rate: 6.8 symbols/min [2025-09-18T20:44:30.924740] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-09-18T20:44:31.051253] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:44:31.051440] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-09-18T20:44:31.051496] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-09-18T20:44:31.051662] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-09-18T20:44:31.051720] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-18T20:44:31.051767] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-18T20:44:31.051800] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-09-18T20:44:31.406197] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:44:31.719606] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-11. [2025-09-18T20:44:31.826253] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-18T20:44:31.912232] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-18T20:44:32.235743] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-18T20:44:32.519554] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-09-18T20:44:32.963469] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-18T20:44:33.319548] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-09-18T20:44:34.119522] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-09-18T20:44:34.280514] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-18T20:44:34.919568] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-09-18T20:44:35.458682] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-18T20:44:35.719569] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-09-18T20:44:35.897046] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-18T20:44:36.401888] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-18T20:44:36.519598] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-09-18T20:44:37.319545] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-09-18T20:44:38.083955] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-18T20:44:38.119591] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-09-18T20:44:38.919581] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-09-18T20:44:39.027331] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-18T20:44:39.322509] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-18T20:44:39.719583] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-09-18T20:44:40.161756] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T20:44:40.519560] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-09-18T20:44:40.917162] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-18T20:44:41.319553] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-09-18T20:44:41.636286] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-18T20:44:42.119564] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-09-18T20:44:42.613057] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-18T20:44:42.919594] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-09-18T20:44:43.194356] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-18T20:44:43.721245] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-09-18T20:44:43.724160] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-18T20:44:44.519554] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-09-18T20:44:45.319639] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-09-18T20:44:45.702185] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-18T20:44:45.731473] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-18T20:44:45.905923] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-18T20:44:46.119554] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-09-18T20:44:46.919552] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-09-18T20:44:47.042411] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-18T20:44:47.418585] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-18T20:44:47.719599] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-09-18T20:44:48.519563] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-09-18T20:44:48.922174] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-18T20:44:49.252240] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-18T20:44:49.319558] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-09-18T20:44:50.119544] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-09-18T20:44:50.553938] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-18T20:44:50.919552] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-09-18T20:44:51.287774] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-18T20:44:51.720096] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-09-18T20:44:52.391467] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-18T20:44:52.398499] [INFO ] [REMOTE ] NSC: Full fetch complete (70359 records). [2025-09-18T20:44:52.398781] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-09-18T20:44:52.399904] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T20:44:52.400103] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:44:52.400309] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:44:52.400427] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-18T20:44:52.400706] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-09-18T20:44:52.400820] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-09-18T20:44:52.401010] [DEBUG] [LOCAL ] NSC: No derivative data file found to delete. [2025-09-18T20:44:52.401274] [INFO ] [MAIN ] Update Progress: 1537/2372 symbols completed. NSC took 54.2s. Estimated remaining: 2h 2m 8s. Rate: 6.8 symbols/min [2025-09-18T20:44:52.519694] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-09-18T20:44:52.508161] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-18T20:44:52.615871] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:44:52.678892] [DEBUG] [LOCAL ] NTR: Loaded 52625 existing records from primary storage. [2025-09-18T20:44:52.679065] [INFO ] [MAIN ] NTR: Loaded 52625 existing records. [2025-09-18T20:44:52.860548] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:44:52.860836] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-09-18T20:44:52.860887] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-09-18T20:44:52.862420] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-09-18T20:44:52.862482] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-09-18T20:44:53.233535] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:44:53.319518] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-11. [2025-09-18T20:44:53.515136] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-18T20:44:53.519467] [INFO ] [REMOTE ] NTB: Full fetch complete (30935 records). [2025-09-18T20:44:53.519554] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-09-18T20:44:53.887851] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-09-18T20:44:53.887944] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-09-18T20:44:53.888593] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-09-18T20:44:53.888634] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-09-18T20:44:53.889406] [DEBUG] [LOCAL ] NTB: Trimmed 30935 records to 21077 (keeping 200 days of data) [2025-09-18T20:44:54.036763] [DEBUG] [LOCAL ] NTB: Primary data saved (21077 records). [2025-09-18T20:44:54.036899] [INFO ] [MAIN ] NTB: Full history saved. [2025-09-18T20:44:54.037019] [INFO ] [MAIN ] Update Progress: 1538/2372 symbols completed. NTB took 29.3s. Estimated remaining: 2h 1m 55s. Rate: 6.8 symbols/min [2025-09-18T20:44:54.124744] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-09-18T20:44:54.217404] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:44:54.275595] [DEBUG] [LOCAL ] NTST: Loaded 43391 existing records from primary storage. [2025-09-18T20:44:54.276376] [INFO ] [MAIN ] NTST: Loaded 43391 existing records. [2025-09-18T20:44:54.454635] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:44:54.455353] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-09-18T20:44:54.455409] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-09-18T20:44:54.457305] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-09-18T20:44:54.457367] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-09-18T20:44:54.810986] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:44:54.898683] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-18T20:44:54.919512] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-09-18T20:44:55.350187] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-18T20:44:55.719599] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-09-18T20:44:56.394180] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-18T20:44:56.519551] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-09-18T20:44:56.749912] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-18T20:44:56.756295] [INFO ] [REMOTE ] NSP: Full fetch complete (49251 records). [2025-09-18T20:44:56.756524] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-09-18T20:44:57.155512] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-09-18T20:44:57.158344] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-18T20:44:57.158420] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-09-18T20:44:57.160444] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-09-18T20:44:57.160510] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-09-18T20:44:57.161718] [DEBUG] [LOCAL ] NSP: Trimmed 49251 records to 35194 (keeping 200 days of data) [2025-09-18T20:44:57.350440] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-09-18T20:44:57.407892] [DEBUG] [LOCAL ] NSP: Primary data saved (35194 records). [2025-09-18T20:44:57.408049] [INFO ] [MAIN ] NSP: Full history saved. [2025-09-18T20:44:57.408177] [INFO ] [MAIN ] Update Progress: 1539/2372 symbols completed. NSP took 35.2s. Estimated remaining: 2h 1m 44s. Rate: 6.8 symbols/min [2025-09-18T20:44:57.577947] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:44:57.637134] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-09-18T20:44:57.637337] [INFO ] [MAIN ] NU: Loaded 53746 existing records. [2025-09-18T20:44:57.818118] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:44:57.818378] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-09-18T20:44:57.818425] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-09-18T20:44:57.820183] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-09-18T20:44:57.820259] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-09-18T20:44:58.124746] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-09-18T20:44:58.183945] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:44:58.746535] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-18T20:44:58.919548] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-11. [2025-09-18T20:44:59.147889] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-18T20:44:59.719575] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-09-18T20:45:00.292808] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-18T20:45:00.519579] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-11. [2025-09-18T20:45:01.148120] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-11 (2.23 seconds). [2025-09-18T20:45:01.319565] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-18T20:45:02.119555] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-09-18T20:45:02.665853] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-11 (2.15 seconds). [2025-09-18T20:45:02.809014] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T20:45:02.809791] [INFO ] [REMOTE ] NTEST: Full fetch complete (2021 records). [2025-09-18T20:45:02.809897] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-09-18T20:45:02.925200] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-09-18T20:45:03.023499] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-09-18T20:45:03.023750] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:45:03.023838] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:45:03.023955] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-18T20:45:03.024101] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-18T20:45:03.024165] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-09-18T20:45:03.024253] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-09-18T20:45:03.024446] [INFO ] [MAIN ] Update Progress: 1540/2372 symbols completed. NTEST took 32.1s. Estimated remaining: 2h 1m 33s. Rate: 6.8 symbols/min [2025-09-18T20:45:03.203456] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:45:03.203676] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-09-18T20:45:03.203733] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-09-18T20:45:03.203883] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-09-18T20:45:03.203928] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-18T20:45:03.203994] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-18T20:45:03.204051] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-09-18T20:45:03.562417] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:45:03.719580] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-11. [2025-09-18T20:45:04.519704] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-09-18T20:45:04.664619] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-18T20:45:05.246074] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-18T20:45:05.319500] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-09-18T20:45:05.426961] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-18T20:45:06.119591] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-09-18T20:45:06.151575] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-18T20:45:06.919576] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-09-18T20:45:07.455253] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-18T20:45:07.694725] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-18T20:45:07.719497] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-09-18T20:45:08.149621] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-18T20:45:08.519562] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-09-18T20:45:09.321390] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-09-18T20:45:09.325083] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-18T20:45:10.119556] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-09-18T20:45:10.392792] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-18T20:45:10.480772] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-18T20:45:10.919558] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-09-18T20:45:11.719551] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-09-18T20:45:12.046622] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-18T20:45:12.519553] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-09-18T20:45:13.319595] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-09-18T20:45:13.668592] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-09-18T20:45:14.119568] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-09-18T20:45:14.491963] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-09-18T20:45:14.919564] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-09-18T20:45:15.982999] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (3.46 seconds). [2025-09-18T20:45:16.024266] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-09-18T20:45:16.029753] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-18T20:45:16.460628] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T20:45:16.519557] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-09-18T20:45:16.887603] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (3.57 seconds). [2025-09-18T20:45:17.319540] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-09-18T20:45:17.664802] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-18T20:45:17.764544] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-18T20:45:18.119550] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-09-18T20:45:18.919554] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-09-18T20:45:19.379281] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-18T20:45:19.438423] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-18T20:45:19.719553] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-09-18T20:45:20.519559] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-09-18T20:45:20.567460] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-18T20:45:21.319587] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-09-18T20:45:21.943004] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-18T20:45:22.119577] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-09-18T20:45:22.349593] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-18T20:45:22.747400] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T20:45:22.919558] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-09-18T20:45:23.719553] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-09-18T20:45:24.223409] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-18T20:45:24.519546] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-09-18T20:45:24.559856] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T20:45:25.190405] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T20:45:25.319501] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-09-18T20:45:25.813042] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-18T20:45:25.822807] [INFO ] [REMOTE ] NTR: Full fetch complete (76138 records). [2025-09-18T20:45:25.822936] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-09-18T20:45:26.123681] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-09-18T20:45:26.222132] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-09-18T20:45:26.222215] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-09-18T20:45:26.223198] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-09-18T20:45:26.223261] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-09-18T20:45:26.224816] [DEBUG] [LOCAL ] NTR: Trimmed 76138 records to 53012 (keeping 200 days of data) [2025-09-18T20:45:26.547042] [DEBUG] [LOCAL ] NTR: Primary data saved (53012 records). [2025-09-18T20:45:26.547172] [INFO ] [MAIN ] NTR: Full history saved. [2025-09-18T20:45:26.547255] [INFO ] [MAIN ] Update Progress: 1541/2372 symbols completed. NTR took 34.1s. Estimated remaining: 2h 1m 32s. Rate: 6.8 symbols/min [2025-09-18T20:45:26.719190] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:45:26.769420] [DEBUG] [LOCAL ] NUS: Loaded 36439 existing records from primary storage. [2025-09-18T20:45:26.769606] [INFO ] [MAIN ] NUS: Loaded 36439 existing records. [2025-09-18T20:45:26.925999] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-09-18T20:45:26.971922] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:45:26.972588] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-09-18T20:45:26.972761] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-09-18T20:45:26.979900] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-09-18T20:45:26.991241] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-09-18T20:45:26.992783] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-18T20:45:27.071783] [INFO ] [REMOTE ] NTST: Full fetch complete (60474 records). [2025-09-18T20:45:27.085407] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-09-18T20:45:27.714777] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:45:27.724594] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-11. [2025-09-18T20:45:27.823148] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-09-18T20:45:27.823347] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-09-18T20:45:27.824413] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-09-18T20:45:27.824512] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-09-18T20:45:27.826507] [DEBUG] [LOCAL ] NTST: Trimmed 60474 records to 43718 (keeping 200 days of data) [2025-09-18T20:45:27.969614] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-18T20:45:28.144439] [DEBUG] [LOCAL ] NTST: Primary data saved (43718 records). [2025-09-18T20:45:28.144575] [INFO ] [MAIN ] NTST: Full history saved. [2025-09-18T20:45:28.146151] [INFO ] [MAIN ] Update Progress: 1542/2372 symbols completed. NTST took 34.1s. Estimated remaining: 2h 1m 20s. Rate: 6.8 symbols/min [2025-09-18T20:45:28.322445] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:45:28.346608] [DEBUG] [LOCAL ] NUV: Loaded 23086 existing records from primary storage. [2025-09-18T20:45:28.346805] [INFO ] [MAIN ] NUV: Loaded 23086 existing records. [2025-09-18T20:45:28.527915] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-09-18T20:45:28.534581] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:45:28.535003] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-09-18T20:45:28.535299] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-09-18T20:45:28.536784] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-09-18T20:45:28.536944] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-09-18T20:45:28.903888] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:45:29.103493] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-18T20:45:29.146899] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T20:45:29.319551] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-11. [2025-09-18T20:45:30.119567] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-09-18T20:45:30.301853] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-18T20:45:30.410553] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-18T20:45:30.919698] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-09-18T20:45:31.444366] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-18T20:45:31.719549] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-09-18T20:45:32.519502] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-09-18T20:45:32.763531] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-18T20:45:32.800310] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-18T20:45:33.319603] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-09-18T20:45:34.119605] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-09-18T20:45:34.568720] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-18T20:45:34.892324] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-18T20:45:34.919520] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-18T20:45:35.712612] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-18T20:45:35.720037] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-09-18T20:45:35.788524] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-18T20:45:35.794698] [INFO ] [REMOTE ] NUE: Full fetch complete (74384 records). [2025-09-18T20:45:35.794832] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-09-18T20:45:35.795532] [FATAL] [VALIDATOR ] NUE: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T20:45:35.795622] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:45:35.795704] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:45:35.795755] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-18T20:45:35.795815] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-18T20:45:35.795852] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-09-18T20:45:35.795892] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-09-18T20:45:35.795952] [INFO ] [MAIN ] Update Progress: 1543/2372 symbols completed. NUE took 32.8s. Estimated remaining: 2h 1m 10s. Rate: 6.8 symbols/min [2025-09-18T20:45:35.970786] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:45:36.031267] [DEBUG] [LOCAL ] NUVB: Loaded 51183 existing records from primary storage. [2025-09-18T20:45:36.031431] [INFO ] [MAIN ] NUVB: Loaded 51183 existing records. [2025-09-18T20:45:36.214238] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:45:36.214530] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-09-18T20:45:36.214583] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-09-18T20:45:36.216205] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-09-18T20:45:36.216265] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-09-18T20:45:36.524807] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-09-18T20:45:36.583005] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:45:37.319568] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-09-18T20:45:37.514207] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-18T20:45:37.746479] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-18T20:45:38.119542] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-09-18T20:45:38.843228] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-18T20:45:38.919552] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-11. [2025-09-18T20:45:39.200379] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-18T20:45:39.719555] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-09-18T20:45:40.426926] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-18T20:45:40.519498] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-09-18T20:45:41.319595] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-09-18T20:45:41.768353] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-18T20:45:41.775696] [INFO ] [REMOTE ] NU: Full fetch complete (77880 records). [2025-09-18T20:45:41.775819] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-09-18T20:45:42.156420] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-09-18T20:45:42.180398] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-09-18T20:45:42.180671] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-09-18T20:45:42.193203] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-09-18T20:45:42.195528] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-09-18T20:45:42.196730] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-18T20:45:42.204339] [DEBUG] [LOCAL ] NU: Trimmed 77880 records to 54136 (keeping 200 days of data) [2025-09-18T20:45:42.231830] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-18T20:45:42.555499] [DEBUG] [LOCAL ] NU: Primary data saved (54136 records). [2025-09-18T20:45:42.555638] [INFO ] [MAIN ] NU: Full history saved. [2025-09-18T20:45:42.555774] [INFO ] [MAIN ] Update Progress: 1544/2372 symbols completed. NU took 45.1s. Estimated remaining: 2h 1m 1s. Rate: 6.8 symbols/min [2025-09-18T20:45:42.724249] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:45:42.733443] [DEBUG] [LOCAL ] NUW: Loaded 7511 existing records from primary storage. [2025-09-18T20:45:42.733554] [INFO ] [MAIN ] NUW: Loaded 7511 existing records. [2025-09-18T20:45:42.919920] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-09-18T20:45:42.919780] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:45:42.921402] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-09-18T20:45:42.921460] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-09-18T20:45:42.921817] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-09-18T20:45:42.921882] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-09-18T20:45:43.288898] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:45:43.704078] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-18T20:45:43.719488] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-09-18T20:45:44.042340] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-18T20:45:44.519561] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-09-18T20:45:45.319562] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-09-18T20:45:45.414889] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-18T20:45:45.898350] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T20:45:46.105411] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-18T20:45:46.119492] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-09-18T20:45:46.919544] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-09-18T20:45:47.259571] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-18T20:45:47.719551] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-09-18T20:45:48.255838] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-18T20:45:48.519563] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-09-18T20:45:48.758485] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-18T20:45:49.319613] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-09-18T20:45:50.119557] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-09-18T20:45:50.152776] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-18T20:45:50.782070] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T20:45:50.919564] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-11. [2025-09-18T20:45:50.985351] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-18T20:45:51.530283] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-18T20:45:51.719559] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-09-18T20:45:52.395530] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-18T20:45:52.519584] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-09-18T20:45:53.319610] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-09-18T20:45:53.593952] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-18T20:45:54.119578] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-09-18T20:45:54.153621] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-18T20:45:54.919607] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-09-18T20:45:55.719628] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-09-18T20:45:55.773169] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-18T20:45:55.776519] [INFO ] [REMOTE ] NUV: Full fetch complete (34309 records). [2025-09-18T20:45:55.776608] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-09-18T20:45:56.176831] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-18T20:45:56.226726] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-09-18T20:45:56.226837] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-09-18T20:45:56.228129] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-09-18T20:45:56.228551] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-09-18T20:45:56.228452] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-18T20:45:56.232736] [DEBUG] [LOCAL ] NUV: Trimmed 34309 records to 23212 (keeping 200 days of data) [2025-09-18T20:45:56.374320] [DEBUG] [LOCAL ] NUV: Primary data saved (23212 records). [2025-09-18T20:45:56.374459] [INFO ] [MAIN ] NUV: Full history saved. [2025-09-18T20:45:56.374544] [INFO ] [MAIN ] Update Progress: 1545/2372 symbols completed. NUV took 28.2s. Estimated remaining: 2h 0m 55s. Rate: 6.8 symbols/min [2025-09-18T20:45:56.526678] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-09-18T20:45:56.547820] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:45:56.577325] [DEBUG] [LOCAL ] NVG: Loaded 27231 existing records from primary storage. [2025-09-18T20:45:56.577477] [INFO ] [MAIN ] NVG: Loaded 27231 existing records. [2025-09-18T20:45:56.766332] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:45:56.766603] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-09-18T20:45:56.766676] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-09-18T20:45:56.767542] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-09-18T20:45:56.767602] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-09-18T20:45:57.155441] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:45:57.319539] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-11. [2025-09-18T20:45:58.102275] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-18T20:45:58.119495] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-09-18T20:45:58.678025] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-18T20:45:58.919563] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-09-18T20:45:59.425453] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-18T20:45:59.719591] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-09-18T20:45:59.802708] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-18T20:46:00.519542] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-09-18T20:46:00.922834] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-18T20:46:01.319595] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-09-18T20:46:01.344676] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-18T20:46:02.119570] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-09-18T20:46:02.658979] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-18T20:46:02.664020] [INFO ] [REMOTE ] NUS: Full fetch complete (53745 records). [2025-09-18T20:46:02.664185] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-09-18T20:46:02.924703] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-09-18T20:46:03.056923] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-09-18T20:46:03.057023] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-09-18T20:46:03.057896] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-09-18T20:46:03.057962] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-09-18T20:46:03.059297] [DEBUG] [LOCAL ] NUS: Trimmed 53745 records to 36678 (keeping 200 days of data) [2025-09-18T20:46:03.186690] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-18T20:46:03.301008] [DEBUG] [LOCAL ] NUS: Primary data saved (36678 records). [2025-09-18T20:46:03.301152] [INFO ] [MAIN ] NUS: Full history saved. [2025-09-18T20:46:03.301241] [INFO ] [MAIN ] Update Progress: 1546/2372 symbols completed. NUS took 36.8s. Estimated remaining: 2h 0m 45s. Rate: 6.8 symbols/min [2025-09-18T20:46:03.470088] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:46:03.501857] [DEBUG] [LOCAL ] NVGS: Loaded 31383 existing records from primary storage. [2025-09-18T20:46:03.502020] [INFO ] [MAIN ] NVGS: Loaded 31383 existing records. [2025-09-18T20:46:03.679075] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:46:03.679291] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-09-18T20:46:03.679360] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-09-18T20:46:03.680208] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-09-18T20:46:03.680270] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-09-18T20:46:03.724791] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-09-18T20:46:04.040603] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:46:04.519568] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-09-18T20:46:04.579618] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-18T20:46:04.772284] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-18T20:46:05.320730] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-09-18T20:46:05.322638] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-18T20:46:06.119566] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-09-18T20:46:06.919512] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-11. [2025-09-18T20:46:07.048959] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-18T20:46:07.162103] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-18T20:46:07.719514] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-09-18T20:46:08.183800] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-18T20:46:08.211301] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-18T20:46:08.519582] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-09-18T20:46:09.319571] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-09-18T20:46:10.119556] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-09-18T20:46:10.362155] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-18T20:46:10.640546] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-18T20:46:10.700725] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-18T20:46:10.919545] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-09-18T20:46:11.719622] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-09-18T20:46:12.206397] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-18T20:46:12.220021] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-18T20:46:12.519561] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-09-18T20:46:13.319576] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-09-18T20:46:14.119578] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-09-18T20:46:14.249195] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-18T20:46:14.499437] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-18T20:46:14.893897] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-18T20:46:14.919491] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-09-18T20:46:15.719554] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-09-18T20:46:16.126042] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-18T20:46:16.183408] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-18T20:46:16.185089] [INFO ] [REMOTE ] NUW: Full fetch complete (11833 records). [2025-09-18T20:46:16.185164] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-09-18T20:46:16.524708] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-09-18T20:46:16.569749] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-09-18T20:46:16.569937] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-09-18T20:46:16.570237] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-09-18T20:46:16.570294] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-09-18T20:46:16.571329] [DEBUG] [LOCAL ] NUW: Trimmed 11833 records to 7549 (keeping 200 days of data) [2025-09-18T20:46:16.620538] [DEBUG] [LOCAL ] NUW: Primary data saved (7549 records). [2025-09-18T20:46:16.620806] [INFO ] [MAIN ] NUW: Full history saved. [2025-09-18T20:46:16.620936] [INFO ] [MAIN ] Update Progress: 1547/2372 symbols completed. NUW took 34.1s. Estimated remaining: 2h 0m 38s. Rate: 6.8 symbols/min [2025-09-18T20:46:16.792268] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:46:16.851133] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-09-18T20:46:16.851284] [INFO ] [MAIN ] NVO: Loaded 53784 existing records. [2025-09-18T20:46:17.032289] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:46:17.032580] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-09-18T20:46:17.032631] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-09-18T20:46:17.033967] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-09-18T20:46:17.034050] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-09-18T20:46:17.324621] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-09-18T20:46:17.394571] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:46:17.750713] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-18T20:46:18.119555] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-09-18T20:46:18.919628] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-11. [2025-09-18T20:46:19.428807] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-18T20:46:19.437916] [INFO ] [REMOTE ] NUVB: Full fetch complete (72243 records). [2025-09-18T20:46:19.438077] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-09-18T20:46:19.729583] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-09-18T20:46:19.857264] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-09-18T20:46:19.857461] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-09-18T20:46:19.858515] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-09-18T20:46:19.858601] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-09-18T20:46:19.878033] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-18T20:46:19.884717] [DEBUG] [LOCAL ] NUVB: Trimmed 72243 records to 51568 (keeping 200 days of data) [2025-09-18T20:46:20.174036] [DEBUG] [LOCAL ] NUVB: Primary data saved (51568 records). [2025-09-18T20:46:20.174168] [INFO ] [MAIN ] NUVB: Full history saved. [2025-09-18T20:46:20.174253] [INFO ] [MAIN ] Update Progress: 1548/2372 symbols completed. NUVB took 44.4s. Estimated remaining: 2h 0m 27s. Rate: 6.8 symbols/min [2025-09-18T20:46:20.346096] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:46:20.366280] [DEBUG] [LOCAL ] NVR: Loaded 19535 existing records from primary storage. [2025-09-18T20:46:20.366409] [INFO ] [MAIN ] NVR: Loaded 19535 existing records. [2025-09-18T20:46:20.521054] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-09-18T20:46:20.545322] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:46:20.545534] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-09-18T20:46:20.545583] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-09-18T20:46:20.546245] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-09-18T20:46:20.546305] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-09-18T20:46:20.921163] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:46:21.055922] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-18T20:46:21.091306] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-11 (2.17 seconds). [2025-09-18T20:46:21.319602] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-09-18T20:46:21.705894] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-18T20:46:22.119558] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-11. [2025-09-18T20:46:22.160853] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-18T20:46:22.840012] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-18T20:46:22.919492] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-09-18T20:46:23.719596] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-09-18T20:46:23.870034] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-18T20:46:24.519577] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-09-18T20:46:25.319549] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-09-18T20:46:25.525998] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-18T20:46:26.028296] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-18T20:46:26.119493] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-09-18T20:46:26.621953] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-18T20:46:26.919560] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-09-18T20:46:27.719578] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-09-18T20:46:27.849212] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-18T20:46:27.855391] [INFO ] [REMOTE ] NVG: Full fetch complete (40647 records). [2025-09-18T20:46:27.855601] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-09-18T20:46:28.278433] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-09-18T20:46:28.278576] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-09-18T20:46:28.279622] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-09-18T20:46:28.279735] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-09-18T20:46:28.280818] [DEBUG] [LOCAL ] NVG: Trimmed 40647 records to 27443 (keeping 200 days of data) [2025-09-18T20:46:28.459501] [DEBUG] [LOCAL ] NVG: Primary data saved (27443 records). [2025-09-18T20:46:28.459696] [INFO ] [MAIN ] NVG: Full history saved. [2025-09-18T20:46:28.459863] [INFO ] [MAIN ] Update Progress: 1549/2372 symbols completed. NVG took 32.1s. Estimated remaining: 2h 0m 18s. Rate: 6.8 symbols/min [2025-09-18T20:46:28.529411] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-09-18T20:46:28.652255] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:46:28.689035] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-18T20:46:28.732574] [DEBUG] [LOCAL ] NVRI: Loaded 38957 existing records from primary storage. [2025-09-18T20:46:28.732771] [INFO ] [MAIN ] NVRI: Loaded 38957 existing records. [2025-09-18T20:46:28.937125] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:46:28.937482] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-09-18T20:46:28.937544] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-09-18T20:46:28.943947] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-09-18T20:46:28.949007] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-09-18T20:46:28.965619] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T20:46:29.336052] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:46:29.329474] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-09-18T20:46:29.693479] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-18T20:46:30.119578] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-09-18T20:46:30.919555] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-09-18T20:46:31.451834] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-18T20:46:31.570313] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-18T20:46:31.719591] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-09-18T20:46:32.086626] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T20:46:32.519569] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-09-18T20:46:32.571059] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-18T20:46:33.319598] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-11. [2025-09-18T20:46:34.119564] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-09-18T20:46:34.787742] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-18T20:46:34.919524] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-09-18T20:46:35.065384] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-18T20:46:35.267823] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-09-18T20:46:35.719572] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-09-18T20:46:35.882053] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-18T20:46:36.519585] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-09-18T20:46:36.551588] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-18T20:46:37.319551] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-09-18T20:46:37.734564] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-18T20:46:38.119575] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-09-18T20:46:38.196277] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-18T20:46:38.911792] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-18T20:46:38.915945] [INFO ] [REMOTE ] NVGS: Full fetch complete (41467 records). [2025-09-18T20:46:38.916056] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-09-18T20:46:38.928148] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-09-18T20:46:39.359586] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-09-18T20:46:39.359739] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-09-18T20:46:39.360903] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-09-18T20:46:39.360979] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-09-18T20:46:39.362274] [DEBUG] [LOCAL ] NVGS: Trimmed 41467 records to 31523 (keeping 200 days of data) [2025-09-18T20:46:39.579485] [DEBUG] [LOCAL ] NVGS: Primary data saved (31523 records). [2025-09-18T20:46:39.579636] [INFO ] [MAIN ] NVGS: Full history saved. [2025-09-18T20:46:39.579805] [INFO ] [MAIN ] Update Progress: 1550/2372 symbols completed. NVGS took 36.3s. Estimated remaining: 2h 0m 10s. Rate: 6.8 symbols/min [2025-09-18T20:46:39.724634] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-09-18T20:46:39.777728] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:46:39.836725] [DEBUG] [LOCAL ] NVS: Loaded 51713 existing records from primary storage. [2025-09-18T20:46:39.836876] [INFO ] [MAIN ] NVS: Loaded 51713 existing records. [2025-09-18T20:46:40.049631] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:46:40.050076] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-09-18T20:46:40.050157] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-09-18T20:46:40.051258] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-09-18T20:46:40.051334] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-09-18T20:46:40.448460] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:46:40.519537] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-11. [2025-09-18T20:46:40.992124] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-18T20:46:41.298740] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-18T20:46:41.319520] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-09-18T20:46:42.119513] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-09-18T20:46:42.500165] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-18T20:46:42.658234] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-11 (2.14 seconds). [2025-09-18T20:46:42.804929] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-18T20:46:42.919530] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-09-18T20:46:43.719544] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-09-18T20:46:44.468822] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-18T20:46:44.519550] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-09-18T20:46:44.705260] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-18T20:46:44.708529] [INFO ] [REMOTE ] NVR: Full fetch complete (29814 records). [2025-09-18T20:46:44.708659] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-09-18T20:46:45.089757] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-09-18T20:46:45.089838] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-09-18T20:46:45.090458] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-09-18T20:46:45.090559] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-09-18T20:46:45.091355] [DEBUG] [LOCAL ] NVR: Trimmed 29814 records to 19706 (keeping 200 days of data) [2025-09-18T20:46:45.219261] [DEBUG] [LOCAL ] NVR: Primary data saved (19706 records). [2025-09-18T20:46:45.219416] [INFO ] [MAIN ] NVR: Full history saved. [2025-09-18T20:46:45.219529] [INFO ] [MAIN ] Update Progress: 1551/2372 symbols completed. NVR took 25.0s. Estimated remaining: 1h 59m 60s. Rate: 6.8 symbols/min [2025-09-18T20:46:45.319944] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-09-18T20:46:45.391929] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:46:45.444052] [DEBUG] [LOCAL ] NVST: Loaded 51698 existing records from primary storage. [2025-09-18T20:46:45.444209] [INFO ] [MAIN ] NVST: Loaded 51698 existing records. [2025-09-18T20:46:45.621172] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:46:45.621428] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-09-18T20:46:45.621475] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-09-18T20:46:45.622452] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-09-18T20:46:45.622512] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-09-18T20:46:46.026298] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:46:46.119536] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-09-18T20:46:46.368225] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-18T20:46:46.919582] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-11. [2025-09-18T20:46:47.391304] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-18T20:46:47.719539] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-09-18T20:46:48.040968] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-09-18T20:46:48.303581] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-18T20:46:48.519566] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-09-18T20:46:48.845104] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-18T20:46:49.319556] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-09-18T20:46:50.072322] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-18T20:46:50.119543] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-09-18T20:46:50.626509] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T20:46:50.919548] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-09-18T20:46:51.697575] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-18T20:46:51.719494] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-09-18T20:46:52.526706] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-09-18T20:46:52.544280] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-18T20:46:53.324714] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-09-18T20:46:53.345498] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-18T20:46:54.119544] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-09-18T20:46:54.816331] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T20:46:54.926354] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-09-18T20:46:54.946218] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-18T20:46:55.366698] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T20:46:55.719548] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-09-18T20:46:56.067619] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-18T20:46:56.519568] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-09-18T20:46:57.319613] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-09-18T20:46:57.990533] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-18T20:46:58.119552] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-09-18T20:46:58.497531] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-18T20:46:58.530688] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-18T20:46:58.919559] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-09-18T20:46:59.612372] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-18T20:46:59.719530] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-09-18T20:47:00.519567] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-09-18T20:47:00.765510] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-18T20:47:00.921175] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-18T20:47:01.319533] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-09-18T20:47:01.953344] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-18T20:47:02.119550] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-09-18T20:47:02.391800] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-18T20:47:02.397707] [INFO ] [REMOTE ] NVRI: Full fetch complete (55756 records). [2025-09-18T20:47:02.397843] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-09-18T20:47:02.780247] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-09-18T20:47:02.780330] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-09-18T20:47:02.781183] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-09-18T20:47:02.781246] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-09-18T20:47:02.782397] [DEBUG] [LOCAL ] NVRI: Trimmed 55756 records to 39272 (keeping 200 days of data) [2025-09-18T20:47:02.952262] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-09-18T20:47:03.023050] [DEBUG] [LOCAL ] NVRI: Primary data saved (39272 records). [2025-09-18T20:47:03.023195] [INFO ] [MAIN ] NVRI: Full history saved. [2025-09-18T20:47:03.025273] [INFO ] [MAIN ] Update Progress: 1552/2372 symbols completed. NVRI took 34.6s. Estimated remaining: 1h 59m 56s. Rate: 6.8 symbols/min [2025-09-18T20:47:03.209338] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:47:03.268331] [DEBUG] [LOCAL ] NVT: Loaded 51622 existing records from primary storage. [2025-09-18T20:47:03.268482] [INFO ] [MAIN ] NVT: Loaded 51622 existing records. [2025-09-18T20:47:03.446582] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:47:03.446839] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-09-18T20:47:03.446908] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-09-18T20:47:03.448057] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-09-18T20:47:03.448128] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-09-18T20:47:03.729241] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-09-18T20:47:03.813961] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:47:03.942477] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-18T20:47:04.519569] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-09-18T20:47:05.319668] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-11. [2025-09-18T20:47:05.444781] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-18T20:47:05.530034] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-18T20:47:06.119601] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-09-18T20:47:06.275475] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-18T20:47:06.857309] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-18T20:47:06.919499] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-09-18T20:47:07.719552] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-09-18T20:47:08.015243] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-18T20:47:08.286585] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-18T20:47:08.519562] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-09-18T20:47:09.076149] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-18T20:47:09.319562] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-09-18T20:47:10.119561] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-09-18T20:47:10.307817] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-18T20:47:10.597137] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-18T20:47:10.604243] [INFO ] [REMOTE ] NVST: Full fetch complete (73887 records). [2025-09-18T20:47:10.604380] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-09-18T20:47:10.924681] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-09-18T20:47:11.019422] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-09-18T20:47:11.019513] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-09-18T20:47:11.020493] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-09-18T20:47:11.020558] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-09-18T20:47:11.022016] [DEBUG] [LOCAL ] NVST: Trimmed 73887 records to 52081 (keeping 200 days of data) [2025-09-18T20:47:11.330622] [DEBUG] [LOCAL ] NVST: Primary data saved (52081 records). [2025-09-18T20:47:11.330784] [INFO ] [MAIN ] NVST: Full history saved. [2025-09-18T20:47:11.330874] [INFO ] [MAIN ] Update Progress: 1553/2372 symbols completed. NVST took 26.1s. Estimated remaining: 1h 59m 47s. Rate: 6.8 symbols/min [2025-09-18T20:47:11.508530] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:47:11.562411] [DEBUG] [LOCAL ] NWG: Loaded 51705 existing records from primary storage. [2025-09-18T20:47:11.562565] [INFO ] [MAIN ] NWG: Loaded 51705 existing records. [2025-09-18T20:47:11.720327] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-09-18T20:47:11.745827] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:47:11.747384] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-09-18T20:47:11.747703] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-09-18T20:47:11.749016] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-09-18T20:47:11.749080] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-09-18T20:47:12.049607] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-18T20:47:12.160069] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:47:12.519583] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-09-18T20:47:13.302450] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-09-18T20:47:13.319486] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-09-18T20:47:13.774803] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-18T20:47:13.782242] [INFO ] [REMOTE ] NVS: Full fetch complete (74664 records). [2025-09-18T20:47:13.782407] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-09-18T20:47:14.120491] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-11. [2025-09-18T20:47:14.201403] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-09-18T20:47:14.201532] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-09-18T20:47:14.202794] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-09-18T20:47:14.202966] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-09-18T20:47:14.212138] [DEBUG] [LOCAL ] NVS: Trimmed 74664 records to 52098 (keeping 200 days of data) [2025-09-18T20:47:14.225700] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-18T20:47:14.233376] [INFO ] [REMOTE ] NVO: Full fetch complete (77914 records). [2025-09-18T20:47:14.233545] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-09-18T20:47:14.868361] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-09-18T20:47:14.873376] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-09-18T20:47:14.875670] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-09-18T20:47:14.875760] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-09-18T20:47:14.900057] [DEBUG] [LOCAL ] NVO: Trimmed 77914 records to 54174 (keeping 200 days of data) [2025-09-18T20:47:15.072003] [DEBUG] [LOCAL ] NVS: Primary data saved (52098 records). [2025-09-18T20:47:15.074751] [INFO ] [MAIN ] NVS: Full history saved. [2025-09-18T20:47:15.075757] [INFO ] [MAIN ] Update Progress: 1554/2372 symbols completed. NVS took 35.5s. Estimated remaining: 1h 59m 35s. Rate: 6.8 symbols/min [2025-09-18T20:47:15.275151] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:47:15.427636] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-18T20:47:15.453051] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-09-18T20:47:15.457793] [DEBUG] [LOCAL ] NWN: Loaded 26970 existing records from primary storage. [2025-09-18T20:47:15.460361] [INFO ] [MAIN ] NWN: Loaded 26970 existing records. [2025-09-18T20:47:15.661446] [WARN ] [MAIN ] NWN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:47:15.663758] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-09-18T20:47:15.664806] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-09-18T20:47:15.666692] [DEBUG] [LOCAL ] NWN: Deleted primary data file. [2025-09-18T20:47:15.667113] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-09-18T20:47:15.885588] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-18T20:47:15.975876] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-09-18T20:47:16.160548] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:47:16.180781] [DEBUG] [LOCAL ] NVO: Primary data saved (54174 records). [2025-09-18T20:47:16.180920] [INFO ] [MAIN ] NVO: Full history saved. [2025-09-18T20:47:16.181036] [INFO ] [MAIN ] Update Progress: 1555/2372 symbols completed. NVO took 59.6s. Estimated remaining: 1h 59m 23s. Rate: 6.8 symbols/min [2025-09-18T20:47:16.354398] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:47:16.390952] [DEBUG] [LOCAL ] NX: Loaded 33389 existing records from primary storage. [2025-09-18T20:47:16.391163] [INFO ] [MAIN ] NX: Loaded 33389 existing records. [2025-09-18T20:47:16.530153] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-11. [2025-09-18T20:47:16.572523] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:47:16.572833] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-09-18T20:47:16.572885] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-09-18T20:47:16.573629] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-09-18T20:47:16.573719] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-09-18T20:47:16.942690] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:47:17.099346] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-18T20:47:17.323515] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-11. [2025-09-18T20:47:17.328829] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-18T20:47:17.416556] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-18T20:47:18.119518] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-09-18T20:47:18.145854] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-18T20:47:18.919524] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-09-18T20:47:19.248347] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-18T20:47:19.719567] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-09-18T20:47:20.504091] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T20:47:20.519491] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-09-18T20:47:20.887487] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-18T20:47:21.319544] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-09-18T20:47:22.119533] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-09-18T20:47:22.192515] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T20:47:22.219293] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-18T20:47:22.919562] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-09-18T20:47:22.970160] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-18T20:47:23.719545] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-09-18T20:47:24.239715] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T20:47:24.519554] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-09-18T20:47:24.847986] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-18T20:47:25.319560] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-09-18T20:47:26.119537] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-09-18T20:47:26.156144] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-18T20:47:26.265493] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-18T20:47:26.919600] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-09-18T20:47:27.570735] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-18T20:47:27.719547] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-09-18T20:47:28.074949] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-18T20:47:28.519559] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-09-18T20:47:29.319547] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-09-18T20:47:29.430774] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-18T20:47:29.820559] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-18T20:47:30.119556] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-09-18T20:47:30.484596] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-18T20:47:30.919558] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-09-18T20:47:31.719579] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-09-18T20:47:31.941666] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-18T20:47:32.519523] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-09-18T20:47:32.583563] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-18T20:47:32.673900] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-18T20:47:33.319609] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-09-18T20:47:34.119593] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-09-18T20:47:34.274112] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-18T20:47:34.348381] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-18T20:47:34.919557] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-09-18T20:47:35.724691] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-09-18T20:47:35.740494] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-18T20:47:36.287876] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-18T20:47:36.296927] [INFO ] [REMOTE ] NVT: Full fetch complete (74298 records). [2025-09-18T20:47:36.297121] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-09-18T20:47:36.524793] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-09-18T20:47:36.892804] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-09-18T20:47:36.892909] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-09-18T20:47:36.897495] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-09-18T20:47:36.897709] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-09-18T20:47:36.899753] [DEBUG] [LOCAL ] NVT: Trimmed 74298 records to 52007 (keeping 200 days of data) [2025-09-18T20:47:37.282376] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-18T20:47:37.295668] [DEBUG] [LOCAL ] NVT: Primary data saved (52007 records). [2025-09-18T20:47:37.296201] [INFO ] [MAIN ] NVT: Full history saved. [2025-09-18T20:47:37.296347] [INFO ] [MAIN ] Update Progress: 1556/2372 symbols completed. NVT took 34.3s. Estimated remaining: 1h 59m 20s. Rate: 6.8 symbols/min [2025-09-18T20:47:37.331430] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-09-18T20:47:37.493853] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:47:37.500587] [DEBUG] [LOCAL ] NXC: Loaded 4157 existing records from primary storage. [2025-09-18T20:47:37.500749] [INFO ] [MAIN ] NXC: Loaded 4157 existing records. [2025-09-18T20:47:37.701558] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:47:37.702089] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-09-18T20:47:37.702172] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-09-18T20:47:37.702700] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-09-18T20:47:37.702805] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-09-18T20:47:37.851095] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-18T20:47:38.128034] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-09-18T20:47:38.133631] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:47:38.919552] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-11. [2025-09-18T20:47:39.318959] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-18T20:47:39.345138] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-18T20:47:39.377514] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-18T20:47:39.719555] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-09-18T20:47:40.519542] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-09-18T20:47:41.051377] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-18T20:47:41.254307] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-18T20:47:41.319516] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-09-18T20:47:42.119603] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-09-18T20:47:42.821416] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-18T20:47:42.919501] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-09-18T20:47:43.052176] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-18T20:47:43.719624] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-09-18T20:47:44.067860] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-18T20:47:44.519626] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-09-18T20:47:44.951859] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-18T20:47:45.319516] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-09-18T20:47:45.394554] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-18T20:47:45.782221] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-18T20:47:46.119596] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-09-18T20:47:46.803867] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-18T20:47:46.919538] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-09-18T20:47:47.617693] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-18T20:47:47.719576] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-09-18T20:47:48.377067] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-18T20:47:48.519569] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-09-18T20:47:49.173766] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-18T20:47:49.319549] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-09-18T20:47:50.119548] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-09-18T20:47:50.843825] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T20:47:50.850424] [INFO ] [REMOTE ] NX: Full fetch complete (47940 records). [2025-09-18T20:47:50.850578] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-09-18T20:47:50.928408] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-09-18T20:47:51.248460] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-09-18T20:47:51.248552] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-09-18T20:47:51.249350] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-09-18T20:47:51.249421] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-09-18T20:47:51.250467] [DEBUG] [LOCAL ] NX: Trimmed 47940 records to 33687 (keeping 200 days of data) [2025-09-18T20:47:51.454211] [DEBUG] [LOCAL ] NX: Primary data saved (33687 records). [2025-09-18T20:47:51.454378] [INFO ] [MAIN ] NX: Full history saved. [2025-09-18T20:47:51.454478] [INFO ] [MAIN ] Update Progress: 1557/2372 symbols completed. NX took 35.3s. Estimated remaining: 1h 59m 14s. Rate: 6.8 symbols/min [2025-09-18T20:47:51.604978] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-18T20:47:51.626957] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T20:47:51.634162] [INFO ] [REMOTE ] NWG: Full fetch complete (72827 records). [2025-09-18T20:47:51.634325] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-09-18T20:47:51.724808] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-09-18T20:47:52.056599] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-09-18T20:47:52.056736] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-09-18T20:47:52.057812] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-09-18T20:47:52.057879] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-09-18T20:47:52.059556] [DEBUG] [LOCAL ] NWG: Trimmed 72827 records to 52059 (keeping 200 days of data) [2025-09-18T20:47:52.381959] [DEBUG] [LOCAL ] NWG: Primary data saved (52059 records). [2025-09-18T20:47:52.382112] [INFO ] [MAIN ] NWG: Full history saved. [2025-09-18T20:47:52.382223] [INFO ] [MAIN ] Update Progress: 1558/2372 symbols completed. NWG took 41.1s. Estimated remaining: 1h 59m 2s. Rate: 6.8 symbols/min [2025-09-18T20:47:52.519631] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-09-18T20:47:52.930599] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-18T20:47:52.998822] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-18T20:47:53.002749] [INFO ] [REMOTE ] NWN: Full fetch complete (36929 records). [2025-09-18T20:47:53.002871] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-09-18T20:47:53.328213] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-09-18T20:47:53.430174] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-09-18T20:47:53.430276] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-09-18T20:47:53.431072] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-09-18T20:47:53.431140] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-09-18T20:47:53.432625] [DEBUG] [LOCAL ] NWN: Trimmed 36929 records to 27211 (keeping 200 days of data) [2025-09-18T20:47:53.631311] [DEBUG] [LOCAL ] NWN: Primary data saved (27211 records). [2025-09-18T20:47:53.631487] [INFO ] [MAIN ] NWN: Full history saved. [2025-09-18T20:47:53.631599] [INFO ] [MAIN ] Update Progress: 1559/2372 symbols completed. NWN took 38.6s. Estimated remaining: 1h 58m 49s. Rate: 6.8 symbols/min [2025-09-18T20:47:54.008813] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-18T20:47:54.010134] [INFO ] [REMOTE ] NXC: Full fetch complete (5980 records). [2025-09-18T20:47:54.010207] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-09-18T20:47:54.368269] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-09-18T20:47:54.368349] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-09-18T20:47:54.368513] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-09-18T20:47:54.368552] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-09-18T20:47:54.368971] [DEBUG] [LOCAL ] NXC: Trimmed 5980 records to 4197 (keeping 200 days of data) [2025-09-18T20:47:54.394408] [DEBUG] [LOCAL ] NXC: Primary data saved (4197 records). [2025-09-18T20:47:54.394527] [INFO ] [MAIN ] NXC: Full history saved. [2025-09-18T20:47:54.394629] [INFO ] [MAIN ] Update Progress: 1560/2372 symbols completed. NXC took 17.1s. Estimated remaining: 1h 58m 36s. Rate: 6.8 symbols/min [2025-09-18T20:47:55.016102] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:47:55.100964] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:47:55.094317] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:47:55.126524] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:47:55.127107] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-09-18T20:47:55.127372] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-09-18T20:47:55.129279] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-09-18T20:47:55.129373] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-18T20:47:55.129503] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-18T20:47:55.129550] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-09-18T20:47:55.227580] [DEBUG] [LOCAL ] NXG: Loaded 10557 existing records from primary storage. [2025-09-18T20:47:55.251227] [INFO ] [MAIN ] NXG: Loaded 10557 existing records. [2025-09-18T20:47:55.244710] [DEBUG] [LOCAL ] NXDT: Loaded 16604 existing records from primary storage. [2025-09-18T20:47:55.286037] [INFO ] [MAIN ] NXDT: Loaded 16604 existing records. [2025-09-18T20:47:55.823412] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:47:55.860413] [DEBUG] [LOCAL ] NXE: Loaded 52981 existing records from primary storage. [2025-09-18T20:47:55.859287] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:47:55.859031] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-09-18T20:47:55.871331] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-09-18T20:47:55.876674] [INFO ] [MAIN ] NXE: Loaded 52981 existing records. [2025-09-18T20:47:55.900536] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-09-18T20:47:55.941909] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:47:55.938935] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-09-18T20:47:55.962324] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-09-18T20:47:55.952860] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-11. [2025-09-18T20:47:55.977500] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-09-18T20:47:56.010816] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-09-18T20:47:56.022842] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-09-18T20:47:56.357891] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:47:56.399895] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-11 [2025-09-18T20:47:56.399455] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:47:56.417105] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-09-18T20:47:56.490010] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-09-18T20:47:56.561377] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-09-18T20:47:56.584861] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-09-18T20:47:56.638718] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-09-18T20:47:56.817467] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:47:56.897576] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-09-18T20:47:57.009331] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-01. [2025-09-18T20:47:57.003687] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:47:57.075556] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-11. [2025-09-18T20:47:57.080189] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:47:57.302292] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:47:57.319489] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-11. [2025-09-18T20:47:57.336850] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:47:57.337178] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-01 [2025-09-18T20:47:57.912534] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-18T20:47:58.119589] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-09-18T20:47:58.919512] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-11. [2025-09-18T20:47:58.996187] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T20:47:59.190115] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-18T20:47:59.672910] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-18T20:47:59.719529] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-09-18T20:48:00.514313] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-18T20:48:00.519485] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-09-18T20:48:01.319545] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-09-18T20:48:01.355786] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T20:48:02.119550] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-09-18T20:48:02.861558] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-18T20:48:02.919532] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-09-18T20:48:03.719568] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-02. [2025-09-18T20:48:04.519604] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-09-18T20:48:04.648928] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:48:04.649275] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-02 [2025-09-18T20:48:05.014676] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-18T20:48:05.285746] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-18T20:48:05.319501] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-09-18T20:48:05.506091] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (3.39 seconds). [2025-09-18T20:48:06.080102] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-18T20:48:06.119566] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-09-18T20:48:06.919551] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-03. [2025-09-18T20:48:07.172020] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:48:07.172531] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-03 [2025-09-18T20:48:07.719582] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-09-18T20:48:08.108894] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-18T20:48:08.495885] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-18T20:48:08.519592] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-09-18T20:48:09.319595] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-09-18T20:48:10.119594] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-09-18T20:48:10.185898] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T20:48:10.216229] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-18T20:48:10.922079] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-09-18T20:48:10.925710] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-18T20:48:11.719555] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-09-18T20:48:12.534744] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-04. [2025-09-18T20:48:12.562912] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T20:48:12.914042] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:48:12.914609] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-04 [2025-09-18T20:48:12.926327] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T20:48:13.319542] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-09-18T20:48:14.119558] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-09-18T20:48:14.731213] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-18T20:48:14.919584] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-09-18T20:48:15.719574] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-09-18T20:48:16.519563] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-05. [2025-09-18T20:48:16.565986] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-18T20:48:16.650981] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-18T20:48:16.806137] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:48:16.806470] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-05 [2025-09-18T20:48:16.847674] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-09-18T20:48:17.319556] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-09-18T20:48:17.782493] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-18T20:48:18.119558] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-09-18T20:48:18.919542] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-09-18T20:48:19.611369] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T20:48:19.719548] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-09-18T20:48:19.876899] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-18T20:48:20.516756] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-18T20:48:20.520478] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-06. [2025-09-18T20:48:20.786546] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:48:20.786979] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-06 [2025-09-18T20:48:21.319552] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-07. [2025-09-18T20:48:22.119545] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-09-18T20:48:22.605912] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-18T20:48:22.771246] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-18T20:48:22.773749] [INFO ] [REMOTE ] NXDT: Full fetch complete (25810 records). [2025-09-18T20:48:22.773828] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-09-18T20:48:22.924635] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-08. [2025-09-18T20:48:23.173818] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-09-18T20:48:23.173906] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-09-18T20:48:23.174481] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-09-18T20:48:23.174578] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-09-18T20:48:23.175372] [DEBUG] [LOCAL ] NXDT: Trimmed 25810 records to 16690 (keeping 200 days of data) [2025-09-18T20:48:23.272339] [DEBUG] [LOCAL ] NXDT: Primary data saved (16690 records). [2025-09-18T20:48:23.272497] [INFO ] [MAIN ] NXDT: Full history saved. [2025-09-18T20:48:23.272590] [INFO ] [MAIN ] Update Progress: 1561/2372 symbols completed. NXDT took 28.9s. Estimated remaining: 1h 58m 38s. Rate: 6.8 symbols/min [2025-09-18T20:48:23.465098] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:48:23.482253] [DEBUG] [LOCAL ] NXJ: Loaded 14804 existing records from primary storage. [2025-09-18T20:48:23.482382] [INFO ] [MAIN ] NXJ: Loaded 14804 existing records. [2025-09-18T20:48:23.660541] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:48:23.660813] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-09-18T20:48:23.660864] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-09-18T20:48:23.661423] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-09-18T20:48:23.661482] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-09-18T20:48:23.724737] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-09-18T20:48:24.013884] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:48:24.519557] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-09-18T20:48:24.638491] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-18T20:48:24.675765] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-18T20:48:25.319551] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-09-18T20:48:25.869094] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-18T20:48:25.871213] [INFO ] [REMOTE ] NXG: Full fetch complete (14454 records). [2025-09-18T20:48:25.871286] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-09-18T20:48:26.119912] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-11. [2025-09-18T20:48:26.244263] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-09-18T20:48:26.244364] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-09-18T20:48:26.244769] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-09-18T20:48:26.244848] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-09-18T20:48:26.245711] [DEBUG] [LOCAL ] NXG: Trimmed 14454 records to 10679 (keeping 200 days of data) [2025-09-18T20:48:26.346003] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-18T20:48:26.344897] [DEBUG] [LOCAL ] NXG: Primary data saved (10679 records). [2025-09-18T20:48:26.356853] [INFO ] [MAIN ] NXG: Full history saved. [2025-09-18T20:48:26.357136] [INFO ] [MAIN ] Update Progress: 1562/2372 symbols completed. NXG took 32.0s. Estimated remaining: 1h 58m 26s. Rate: 6.8 symbols/min [2025-09-18T20:48:26.526590] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:48:26.531508] [DEBUG] [LOCAL ] NXN: Loaded 2339 existing records from primary storage. [2025-09-18T20:48:26.531607] [INFO ] [MAIN ] NXN: Loaded 2339 existing records. [2025-09-18T20:48:26.726791] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:48:26.727128] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-09-18T20:48:26.727188] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-09-18T20:48:26.727446] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-09-18T20:48:26.727505] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-09-18T20:48:26.925272] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-09-18T20:48:27.111635] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:48:27.326857] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-18T20:48:27.719553] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-11. [2025-09-18T20:48:28.219383] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-18T20:48:28.519599] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-09. [2025-09-18T20:48:28.784102] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-18T20:48:29.319605] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-09-18T20:48:30.114194] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-18T20:48:30.120486] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-09-18T20:48:30.122116] [INFO ] [REMOTE ] NXDR: Full fetch complete (15524 records). [2025-09-18T20:48:30.122189] [DEBUG] [VALIDATOR ] NXDR: Validating primary data. [2025-09-18T20:48:30.304225] [WARN ] [VALIDATOR ] NXDR: Validation failed - insufficient historical data. Have 43 unique days, need 200 days [2025-09-18T20:48:30.304585] [FATAL] [MAIN ] NXDR: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:48:30.304699] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:48:30.304791] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-18T20:48:30.304877] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-18T20:48:30.304930] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-09-18T20:48:30.305024] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-09-18T20:48:30.305137] [INFO ] [MAIN ] Update Progress: 1563/2372 symbols completed. NXDR took 35.9s. Estimated remaining: 1h 58m 15s. Rate: 6.8 symbols/min [2025-09-18T20:48:30.472567] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:48:30.488400] [DEBUG] [LOCAL ] NXP: Loaded 12248 existing records from primary storage. [2025-09-18T20:48:30.488520] [INFO ] [MAIN ] NXP: Loaded 12248 existing records. [2025-09-18T20:48:30.667513] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:48:30.667876] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-09-18T20:48:30.667971] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-09-18T20:48:30.671762] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-18T20:48:30.671807] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-09-18T20:48:30.673535] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-09-18T20:48:30.926685] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-09-18T20:48:31.054132] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:48:31.090607] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-18T20:48:31.719554] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-09-18T20:48:31.807277] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T20:48:32.519556] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-09-18T20:48:33.309039] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-18T20:48:33.317718] [INFO ] [REMOTE ] NXE: Full fetch complete (76499 records). [2025-09-18T20:48:33.317874] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-09-18T20:48:33.330993] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-09-18T20:48:33.712114] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-18T20:48:33.774332] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-09-18T20:48:33.774477] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-09-18T20:48:33.775953] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-09-18T20:48:33.776072] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-09-18T20:48:33.778492] [DEBUG] [LOCAL ] NXE: Trimmed 76499 records to 53370 (keeping 200 days of data) [2025-09-18T20:48:33.873772] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-18T20:48:34.097610] [DEBUG] [LOCAL ] NXE: Primary data saved (53370 records). [2025-09-18T20:48:34.097794] [INFO ] [MAIN ] NXE: Full history saved. [2025-09-18T20:48:34.097915] [INFO ] [MAIN ] Update Progress: 1564/2372 symbols completed. NXE took 39.7s. Estimated remaining: 1h 58m 3s. Rate: 6.8 symbols/min [2025-09-18T20:48:34.128608] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-11. [2025-09-18T20:48:34.282930] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:48:34.304988] [DEBUG] [LOCAL ] NXRT: Loaded 18912 existing records from primary storage. [2025-09-18T20:48:34.305130] [INFO ] [MAIN ] NXRT: Loaded 18912 existing records. [2025-09-18T20:48:34.487998] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:48:34.488270] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-09-18T20:48:34.488333] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-09-18T20:48:34.489087] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-09-18T20:48:34.489148] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-09-18T20:48:34.859075] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:48:34.919564] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-09-18T20:48:35.102222] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-18T20:48:35.388023] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-18T20:48:35.719565] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-09-18T20:48:36.519576] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-11. [2025-09-18T20:48:36.692417] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-18T20:48:37.255244] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-18T20:48:37.319508] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-09-18T20:48:38.119525] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-09-18T20:48:38.292359] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-18T20:48:38.919565] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-09-18T20:48:38.939258] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-18T20:48:39.679401] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-18T20:48:39.719520] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-09-18T20:48:40.519534] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-09-18T20:48:40.776456] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-18T20:48:41.146759] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-18T20:48:41.319593] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-09-18T20:48:42.119557] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-09-18T20:48:42.186049] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-18T20:48:42.569104] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-18T20:48:42.919552] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-09-18T20:48:43.719555] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-09-18T20:48:43.831830] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-18T20:48:44.124257] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-18T20:48:44.519565] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-09-18T20:48:44.961135] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-18T20:48:45.319578] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-09-18T20:48:45.956767] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-18T20:48:46.119546] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-09-18T20:48:46.919546] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-09-18T20:48:47.123568] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-18T20:48:47.267900] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-18T20:48:47.719552] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-09-18T20:48:48.519559] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-09-18T20:48:48.756796] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-18T20:48:48.938144] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-18T20:48:49.319565] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-09-18T20:48:50.082734] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-18T20:48:50.119521] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-09-18T20:48:50.898108] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-18T20:48:50.919501] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-09-18T20:48:51.719585] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-09-18T20:48:51.755079] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-18T20:48:52.050845] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-18T20:48:52.051775] [INFO ] [REMOTE ] NXN: Full fetch complete (3678 records). [2025-09-18T20:48:52.051845] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-09-18T20:48:52.429730] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-09-18T20:48:52.429832] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-09-18T20:48:52.430033] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-09-18T20:48:52.430117] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-09-18T20:48:52.430499] [DEBUG] [LOCAL ] NXN: Trimmed 3678 records to 2344 (keeping 200 days of data) [2025-09-18T20:48:52.447299] [DEBUG] [LOCAL ] NXN: Primary data saved (2344 records). [2025-09-18T20:48:52.447387] [INFO ] [MAIN ] NXN: Full history saved. [2025-09-18T20:48:52.447496] [INFO ] [MAIN ] Update Progress: 1565/2372 symbols completed. NXN took 26.1s. Estimated remaining: 1h 57m 59s. Rate: 6.8 symbols/min [2025-09-18T20:48:52.524682] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-09-18T20:48:52.619197] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:48:52.619348] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-09-18T20:48:52.619457] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-09-18T20:48:52.619569] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-09-18T20:48:52.619609] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-18T20:48:52.619679] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-18T20:48:52.619732] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-09-18T20:48:52.971941] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:48:53.199057] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-18T20:48:53.319544] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-09-18T20:48:54.119555] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-11. [2025-09-18T20:48:54.364362] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-18T20:48:54.635543] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-18T20:48:54.919552] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-09-18T20:48:55.362044] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-18T20:48:55.719545] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-09-18T20:48:56.519560] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-09-18T20:48:56.981105] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-18T20:48:57.319537] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-09-18T20:48:57.455072] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-18T20:48:58.119549] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-09-18T20:48:58.422778] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-18T20:48:58.912377] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T20:48:58.919488] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-09-18T20:48:59.719564] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-09-18T20:48:59.862702] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-18T20:48:59.869720] [INFO ] [REMOTE ] NXJ: Full fetch complete (21425 records). [2025-09-18T20:48:59.869949] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-09-18T20:49:00.282535] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-09-18T20:49:00.282671] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-09-18T20:49:00.283158] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-09-18T20:49:00.283203] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-09-18T20:49:00.283927] [DEBUG] [LOCAL ] NXJ: Trimmed 21425 records to 15048 (keeping 200 days of data) [2025-09-18T20:49:00.378949] [DEBUG] [LOCAL ] NXJ: Primary data saved (15048 records). [2025-09-18T20:49:00.379141] [INFO ] [MAIN ] NXJ: Full history saved. [2025-09-18T20:49:00.379246] [INFO ] [MAIN ] Update Progress: 1566/2372 symbols completed. NXJ took 37.1s. Estimated remaining: 1h 57m 50s. Rate: 6.8 symbols/min [2025-09-18T20:49:00.527632] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-09-18T20:49:00.555376] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:49:00.604495] [DEBUG] [LOCAL ] NYT: Loaded 50051 existing records from primary storage. [2025-09-18T20:49:00.604678] [INFO ] [MAIN ] NYT: Loaded 50051 existing records. [2025-09-18T20:49:00.805319] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:49:00.806448] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-18T20:49:00.811282] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-09-18T20:49:00.811368] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-09-18T20:49:00.813026] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-09-18T20:49:00.813089] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-09-18T20:49:01.068516] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-18T20:49:01.222574] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:49:01.319541] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-18T20:49:01.851429] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-18T20:49:02.119597] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-09-18T20:49:02.919567] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-11. [2025-09-18T20:49:03.156153] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-18T20:49:03.719564] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-09-18T20:49:04.393033] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-18T20:49:04.519553] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-09-18T20:49:04.677342] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-18T20:49:05.175454] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-18T20:49:05.319589] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-18T20:49:05.831238] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-18T20:49:06.119538] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-09-18T20:49:06.919542] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-18T20:49:07.468399] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-18T20:49:07.719542] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-09-18T20:49:08.014699] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-18T20:49:08.383575] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-18T20:49:08.519618] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-09-18T20:49:09.319597] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-09-18T20:49:09.780840] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-18T20:49:10.119614] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-09-18T20:49:10.479142] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-18T20:49:10.823335] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-18T20:49:10.826978] [INFO ] [REMOTE ] NXP: Full fetch complete (16811 records). [2025-09-18T20:49:10.827080] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-09-18T20:49:10.928145] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-09-18T20:49:11.208865] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-09-18T20:49:11.208945] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-09-18T20:49:11.209294] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-09-18T20:49:11.209337] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-09-18T20:49:11.210658] [DEBUG] [LOCAL ] NXP: Trimmed 16811 records to 12338 (keeping 200 days of data) [2025-09-18T20:49:11.294850] [DEBUG] [LOCAL ] NXP: Primary data saved (12338 records). [2025-09-18T20:49:11.295001] [INFO ] [MAIN ] NXP: Full history saved. [2025-09-18T20:49:11.295112] [INFO ] [MAIN ] Update Progress: 1567/2372 symbols completed. NXP took 41.0s. Estimated remaining: 1h 57m 43s. Rate: 6.8 symbols/min [2025-09-18T20:49:11.484550] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:49:11.526609] [DEBUG] [LOCAL ] NZF: Loaded 29303 existing records from primary storage. [2025-09-18T20:49:11.526816] [INFO ] [MAIN ] NZF: Loaded 29303 existing records. [2025-09-18T20:49:11.715745] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:49:11.716143] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-09-18T20:49:11.716220] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-09-18T20:49:11.717346] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-09-18T20:49:11.717432] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-09-18T20:49:11.729464] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-18T20:49:12.098712] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:49:12.252853] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-18T20:49:12.376851] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-18T20:49:12.519513] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-11. [2025-09-18T20:49:13.319538] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-09-18T20:49:14.065772] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-18T20:49:14.082776] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-18T20:49:14.086233] [INFO ] [REMOTE ] NXRT: Full fetch complete (24888 records). [2025-09-18T20:49:14.086362] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-09-18T20:49:14.124732] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-09-18T20:49:14.473582] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-09-18T20:49:14.473700] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-09-18T20:49:14.474260] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-09-18T20:49:14.474348] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-09-18T20:49:14.475430] [DEBUG] [LOCAL ] NXRT: Trimmed 24888 records to 19066 (keeping 200 days of data) [2025-09-18T20:49:14.607457] [DEBUG] [LOCAL ] NXRT: Primary data saved (19066 records). [2025-09-18T20:49:14.607599] [INFO ] [MAIN ] NXRT: Full history saved. [2025-09-18T20:49:14.607784] [INFO ] [MAIN ] Update Progress: 1568/2372 symbols completed. NXRT took 40.5s. Estimated remaining: 1h 57m 31s. Rate: 6.8 symbols/min [2025-09-18T20:49:14.781754] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:49:14.781951] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-09-18T20:49:14.781990] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-09-18T20:49:14.782140] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-09-18T20:49:14.782230] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-18T20:49:14.782311] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-18T20:49:14.782348] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-09-18T20:49:14.924681] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-18T20:49:15.171739] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:49:15.719559] [INFO ] [REMOTE ] O: Fetching primary data for 2024-11. [2025-09-18T20:49:15.734635] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-18T20:49:15.760295] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-18T20:49:16.519553] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-09-18T20:49:17.319607] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-18T20:49:17.408539] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-18T20:49:17.619795] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-18T20:49:18.119543] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-18T20:49:18.344584] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-11 (2.63 seconds). [2025-09-18T20:49:18.433701] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-18T20:49:18.919603] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-09-18T20:49:19.719556] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-09-18T20:49:20.519547] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-18T20:49:20.659123] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-18T20:49:20.789911] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-18T20:49:20.950333] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-18T20:49:20.951398] [INFO ] [REMOTE ] NYC: Full fetch complete (1903 records). [2025-09-18T20:49:20.951472] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-09-18T20:49:21.143218] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-18T20:49:21.143806] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:49:21.143897] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:49:21.143972] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-18T20:49:21.144099] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-18T20:49:21.144167] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-09-18T20:49:21.144237] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-09-18T20:49:21.144368] [INFO ] [MAIN ] Update Progress: 1569/2372 symbols completed. NYC took 28.7s. Estimated remaining: 1h 57m 21s. Rate: 6.8 symbols/min [2025-09-18T20:49:21.328896] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-09-18T20:49:21.333060] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:49:21.417659] [DEBUG] [LOCAL ] OBDC: Loaded 51636 existing records from primary storage. [2025-09-18T20:49:21.417850] [INFO ] [MAIN ] OBDC: Loaded 51636 existing records. [2025-09-18T20:49:21.684326] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:49:21.684722] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-09-18T20:49:21.684802] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-09-18T20:49:21.686688] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-09-18T20:49:21.686779] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-09-18T20:49:22.124790] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-09-18T20:49:22.192133] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:49:22.919560] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-11. [2025-09-18T20:49:23.136100] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-18T20:49:23.171570] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-18T20:49:23.719544] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-09-18T20:49:24.214556] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-18T20:49:24.519547] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-09-18T20:49:24.704855] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-18T20:49:25.319547] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-09-18T20:49:26.119620] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-09-18T20:49:26.893549] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-18T20:49:26.919506] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-09-18T20:49:27.103311] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-18T20:49:27.410518] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-18T20:49:27.719547] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-09-18T20:49:28.519546] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-09-18T20:49:29.319569] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-09-18T20:49:29.400684] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-09-18T20:49:29.566841] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-18T20:49:29.803445] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-18T20:49:30.119546] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-09-18T20:49:30.436708] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-18T20:49:30.919556] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-09-18T20:49:31.656996] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-18T20:49:31.719512] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-09-18T20:49:32.321202] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-18T20:49:32.519550] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-18T20:49:33.304216] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T20:49:33.319484] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-09-18T20:49:34.119600] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-09-18T20:49:34.924690] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-09-18T20:49:34.940887] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-18T20:49:35.121282] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-18T20:49:35.601440] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-18T20:49:35.719545] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-09-18T20:49:35.979749] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-18T20:49:36.519613] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-18T20:49:37.061444] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-18T20:49:37.068466] [INFO ] [REMOTE ] NYT: Full fetch complete (71960 records). [2025-09-18T20:49:37.068606] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-09-18T20:49:37.325171] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-09-18T20:49:37.476768] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-09-18T20:49:37.476881] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-09-18T20:49:37.477887] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-09-18T20:49:37.477969] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-09-18T20:49:37.479549] [DEBUG] [LOCAL ] NYT: Trimmed 71960 records to 50408 (keeping 200 days of data) [2025-09-18T20:49:37.791298] [DEBUG] [LOCAL ] NYT: Primary data saved (50408 records). [2025-09-18T20:49:37.791440] [INFO ] [MAIN ] NYT: Full history saved. [2025-09-18T20:49:37.791526] [INFO ] [MAIN ] Update Progress: 1570/2372 symbols completed. NYT took 37.4s. Estimated remaining: 1h 57m 16s. Rate: 6.8 symbols/min [2025-09-18T20:49:37.962580] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:49:37.981275] [DEBUG] [LOCAL ] OBK: Loaded 16181 existing records from primary storage. [2025-09-18T20:49:37.981424] [INFO ] [MAIN ] OBK: Loaded 16181 existing records. [2025-09-18T20:49:38.125517] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-09-18T20:49:38.168470] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:49:38.168840] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-09-18T20:49:38.168898] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-09-18T20:49:38.169935] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-09-18T20:49:38.169995] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-09-18T20:49:38.528581] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:49:38.919527] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-11. [2025-09-18T20:49:38.994807] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-18T20:49:39.057036] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-18T20:49:39.061627] [INFO ] [REMOTE ] NZF: Full fetch complete (43770 records). [2025-09-18T20:49:39.061745] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-09-18T20:49:39.458371] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-09-18T20:49:39.458490] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-09-18T20:49:39.459276] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-09-18T20:49:39.459452] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-09-18T20:49:39.460788] [DEBUG] [LOCAL ] NZF: Trimmed 43770 records to 29501 (keeping 200 days of data) [2025-09-18T20:49:39.588247] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-18T20:49:39.617294] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-18T20:49:39.707099] [DEBUG] [LOCAL ] NZF: Primary data saved (29501 records). [2025-09-18T20:49:39.707246] [INFO ] [MAIN ] NZF: Full history saved. [2025-09-18T20:49:39.707336] [INFO ] [MAIN ] Update Progress: 1571/2372 symbols completed. NZF took 28.4s. Estimated remaining: 1h 57m 4s. Rate: 6.8 symbols/min [2025-09-18T20:49:39.728216] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-18T20:49:39.883290] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:49:39.931419] [DEBUG] [LOCAL ] OC: Loaded 44873 existing records from primary storage. [2025-09-18T20:49:39.931597] [INFO ] [MAIN ] OC: Loaded 44873 existing records. [2025-09-18T20:49:40.111889] [WARN ] [MAIN ] OC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:49:40.112171] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-09-18T20:49:40.112227] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-09-18T20:49:40.113797] [DEBUG] [LOCAL ] OC: Deleted primary data file. [2025-09-18T20:49:40.113858] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-09-18T20:49:40.486717] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:49:40.519553] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-11. [2025-09-18T20:49:41.319594] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-09-18T20:49:41.906373] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T20:49:41.989700] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-18T20:49:42.119507] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-18T20:49:42.841752] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T20:49:42.919576] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-09-18T20:49:43.719556] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-09-18T20:49:44.519545] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-09-18T20:49:44.682194] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-09-18T20:49:44.770859] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-18T20:49:44.855804] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-18T20:49:45.319535] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-18T20:49:45.930202] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-18T20:49:46.119545] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-09-18T20:49:46.919555] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-09-18T20:49:47.609823] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-18T20:49:47.719568] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-09-18T20:49:47.826306] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-18T20:49:47.877982] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-18T20:49:48.519593] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-09-18T20:49:49.290268] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-18T20:49:49.319510] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-09-18T20:49:49.948001] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T20:49:50.119567] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-18T20:49:50.919576] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-09-18T20:49:51.232887] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-18T20:49:51.719565] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-09-18T20:49:51.865216] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-18T20:49:52.519547] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-09-18T20:49:52.717630] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-18T20:49:53.274132] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-18T20:49:53.319518] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-09-18T20:49:54.119589] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-09-18T20:49:54.212911] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-18T20:49:54.891502] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-18T20:49:54.919567] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-18T20:49:54.947146] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-18T20:49:55.719560] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-09-18T20:49:56.519596] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-09-18T20:49:57.243106] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T20:49:57.250372] [INFO ] [REMOTE ] OBDC: Full fetch complete (74661 records). [2025-09-18T20:49:57.250551] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-09-18T20:49:57.327456] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-09-18T20:49:57.676789] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-09-18T20:49:57.677018] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-09-18T20:49:57.678231] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-09-18T20:49:57.678364] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-09-18T20:49:57.680704] [DEBUG] [LOCAL ] OBDC: Trimmed 74661 records to 52021 (keeping 200 days of data) [2025-09-18T20:49:57.777296] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.86 seconds). [2025-09-18T20:49:58.084949] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T20:49:58.104273] [DEBUG] [LOCAL ] OBDC: Primary data saved (52021 records). [2025-09-18T20:49:58.104958] [INFO ] [MAIN ] OBDC: Full history saved. [2025-09-18T20:49:58.105094] [INFO ] [MAIN ] Update Progress: 1572/2372 symbols completed. OBDC took 37.0s. Estimated remaining: 1h 57m 0s. Rate: 6.8 symbols/min [2025-09-18T20:49:58.129051] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-18T20:49:58.314392] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-18T20:49:58.318196] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:49:58.333628] [DEBUG] [LOCAL ] OCFT: Loaded 9480 existing records from primary storage. [2025-09-18T20:49:58.333774] [INFO ] [MAIN ] OCFT: Loaded 9480 existing records. [2025-09-18T20:49:58.520183] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:49:58.520512] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-09-18T20:49:58.520567] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-09-18T20:49:58.520885] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-09-18T20:49:58.520948] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-09-18T20:49:58.876616] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:49:58.919505] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-11. [2025-09-18T20:49:59.590128] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-18T20:49:59.719517] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-09-18T20:50:00.403242] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-18T20:50:00.414609] [INFO ] [REMOTE ] O: Full fetch complete (77535 records). [2025-09-18T20:50:00.414818] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-09-18T20:50:00.521885] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-09-18T20:50:00.623434] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-18T20:50:00.624855] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:50:00.625030] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:50:00.625145] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-18T20:50:00.625297] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-18T20:50:00.625398] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-09-18T20:50:00.625574] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-09-18T20:50:00.636627] [INFO ] [MAIN ] Update Progress: 1573/2372 symbols completed. O took 46.0s. Estimated remaining: 1h 56m 48s. Rate: 6.8 symbols/min [2025-09-18T20:50:00.644966] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-18T20:50:00.823799] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:50:00.837578] [DEBUG] [LOCAL ] ODC: Loaded 8503 existing records from primary storage. [2025-09-18T20:50:00.837768] [INFO ] [MAIN ] ODC: Loaded 8503 existing records. [2025-09-18T20:50:01.017373] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:50:01.017636] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-09-18T20:50:01.017720] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-09-18T20:50:01.018115] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-09-18T20:50:01.018174] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-09-18T20:50:01.320327] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-09-18T20:50:01.331594] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-18T20:50:01.391109] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:50:02.119582] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-09-18T20:50:02.202093] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-18T20:50:02.919566] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-11. [2025-09-18T20:50:03.496771] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-18T20:50:03.719554] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-09-18T20:50:03.954334] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-18T20:50:04.249717] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-18T20:50:04.519559] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-09-18T20:50:05.127569] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-18T20:50:05.319557] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-09-18T20:50:06.021936] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-18T20:50:06.119543] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-09-18T20:50:06.841294] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-18T20:50:06.919552] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-09-18T20:50:07.358822] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-18T20:50:07.719576] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-09-18T20:50:08.519552] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-09-18T20:50:08.600763] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-18T20:50:09.319565] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-09-18T20:50:10.119552] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-09-18T20:50:10.252796] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-18T20:50:10.276090] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-18T20:50:10.804045] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-18T20:50:10.919544] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-09-18T20:50:11.659289] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-18T20:50:11.719507] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-09-18T20:50:12.519547] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-09-18T20:50:12.654776] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-18T20:50:12.658101] [INFO ] [REMOTE ] OBK: Full fetch complete (24034 records). [2025-09-18T20:50:12.658226] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-09-18T20:50:13.058007] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-09-18T20:50:13.058125] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-09-18T20:50:13.058844] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-09-18T20:50:13.058912] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-09-18T20:50:13.060058] [DEBUG] [LOCAL ] OBK: Trimmed 24034 records to 16369 (keeping 200 days of data) [2025-09-18T20:50:13.176919] [DEBUG] [LOCAL ] OBK: Primary data saved (16369 records). [2025-09-18T20:50:13.177192] [INFO ] [MAIN ] OBK: Full history saved. [2025-09-18T20:50:13.177338] [INFO ] [MAIN ] Update Progress: 1574/2372 symbols completed. OBK took 35.4s. Estimated remaining: 1h 56m 41s. Rate: 6.8 symbols/min [2025-09-18T20:50:13.329929] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-09-18T20:50:13.360561] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:50:13.388485] [DEBUG] [LOCAL ] ODV: Loaded 24855 existing records from primary storage. [2025-09-18T20:50:13.388740] [INFO ] [MAIN ] ODV: Loaded 24855 existing records. [2025-09-18T20:50:13.522445] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-18T20:50:13.589436] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:50:13.589844] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-09-18T20:50:13.589905] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-09-18T20:50:13.590920] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-09-18T20:50:13.590984] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-09-18T20:50:14.019925] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:50:14.119629] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-09-18T20:50:14.435560] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-18T20:50:14.919698] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-11. [2025-09-18T20:50:15.719591] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-09-18T20:50:15.789135] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-18T20:50:15.907139] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-18T20:50:16.308187] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-18T20:50:16.519600] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-09-18T20:50:17.319537] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-09-18T20:50:17.347560] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-18T20:50:18.119544] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-09-18T20:50:18.136685] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-18T20:50:18.919561] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-09-18T20:50:19.350235] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-18T20:50:19.357045] [INFO ] [REMOTE ] OC: Full fetch complete (63831 records). [2025-09-18T20:50:19.357200] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-09-18T20:50:19.547587] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-18T20:50:19.724741] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-09-18T20:50:19.794143] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-09-18T20:50:19.794234] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-09-18T20:50:19.795174] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-09-18T20:50:19.795240] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-09-18T20:50:19.796688] [DEBUG] [LOCAL ] OC: Trimmed 63831 records to 45202 (keeping 200 days of data) [2025-09-18T20:50:20.076560] [DEBUG] [LOCAL ] OC: Primary data saved (45202 records). [2025-09-18T20:50:20.076718] [INFO ] [MAIN ] OC: Full history saved. [2025-09-18T20:50:20.076811] [INFO ] [MAIN ] Update Progress: 1575/2372 symbols completed. OC took 40.4s. Estimated remaining: 1h 56m 32s. Rate: 6.8 symbols/min [2025-09-18T20:50:20.252291] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:50:20.288635] [DEBUG] [LOCAL ] OEC: Loaded 37489 existing records from primary storage. [2025-09-18T20:50:20.288799] [INFO ] [MAIN ] OEC: Loaded 37489 existing records. [2025-09-18T20:50:20.474010] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-18T20:50:20.479224] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:50:20.482293] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-09-18T20:50:20.482616] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-09-18T20:50:20.483729] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-09-18T20:50:20.483789] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-09-18T20:50:20.524795] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-09-18T20:50:20.841696] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:50:21.319549] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-09-18T20:50:21.423361] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-18T20:50:21.930366] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-18T20:50:22.119547] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-09-18T20:50:22.919550] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-11. [2025-09-18T20:50:23.130435] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-18T20:50:23.719705] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-09-18T20:50:24.399040] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-18T20:50:24.519552] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-09-18T20:50:24.595696] [DEBUG] [REMOTE ] OEC: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-18T20:50:24.595929] [WARN ] [REMOTE ] OEC: No data returned for month 2024-12 [2025-09-18T20:50:24.895146] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-18T20:50:25.319638] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-09-18T20:50:26.033461] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-18T20:50:26.119565] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-09-18T20:50:26.919548] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-09-18T20:50:27.317820] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T20:50:27.719547] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-09-18T20:50:28.207599] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-18T20:50:28.519611] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-09-18T20:50:29.012722] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-18T20:50:29.319521] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-09-18T20:50:29.678358] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-18T20:50:30.119547] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-09-18T20:50:30.681137] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T20:50:30.919584] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-09-18T20:50:31.037318] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T20:50:31.591816] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-18T20:50:31.719545] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-09-18T20:50:32.519600] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-09-18T20:50:33.319542] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-09-18T20:50:33.356513] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T20:50:33.520807] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-18T20:50:33.858036] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-18T20:50:33.859272] [INFO ] [REMOTE ] OCFT: Full fetch complete (11712 records). [2025-09-18T20:50:33.859344] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-09-18T20:50:34.124723] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-09-18T20:50:34.272548] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-09-18T20:50:34.272633] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-09-18T20:50:34.272967] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-09-18T20:50:34.273013] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-09-18T20:50:34.273497] [DEBUG] [LOCAL ] OCFT: Trimmed 11712 records to 9485 (keeping 200 days of data) [2025-09-18T20:50:34.325377] [DEBUG] [LOCAL ] OCFT: Primary data saved (9485 records). [2025-09-18T20:50:34.325511] [INFO ] [MAIN ] OCFT: Full history saved. [2025-09-18T20:50:34.325606] [INFO ] [MAIN ] Update Progress: 1576/2372 symbols completed. OCFT took 36.2s. Estimated remaining: 1h 56m 26s. Rate: 6.8 symbols/min [2025-09-18T20:50:34.499595] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:50:34.522032] [DEBUG] [LOCAL ] OFG: Loaded 22371 existing records from primary storage. [2025-09-18T20:50:34.522177] [INFO ] [MAIN ] OFG: Loaded 22371 existing records. [2025-09-18T20:50:34.708137] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:50:34.708452] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-09-18T20:50:34.708508] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-09-18T20:50:34.709248] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-09-18T20:50:34.709309] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-09-18T20:50:34.928571] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-09-18T20:50:35.067167] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:50:35.478960] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-18T20:50:35.719541] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-11. [2025-09-18T20:50:36.084027] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-18T20:50:36.519597] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-09-18T20:50:37.018065] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-18T20:50:37.319555] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-09-18T20:50:37.685507] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-18T20:50:38.119577] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-09-18T20:50:38.724065] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-18T20:50:38.729738] [INFO ] [REMOTE ] ODV: Full fetch complete (31145 records). [2025-09-18T20:50:38.729840] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-09-18T20:50:38.928558] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-09-18T20:50:39.129297] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-09-18T20:50:39.129376] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-09-18T20:50:39.130011] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-09-18T20:50:39.130073] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-09-18T20:50:39.130927] [DEBUG] [LOCAL ] ODV: Trimmed 31145 records to 25045 (keeping 200 days of data) [2025-09-18T20:50:39.276530] [DEBUG] [LOCAL ] ODV: Primary data saved (25045 records). [2025-09-18T20:50:39.276715] [INFO ] [MAIN ] ODV: Full history saved. [2025-09-18T20:50:39.276848] [INFO ] [MAIN ] Update Progress: 1577/2372 symbols completed. ODV took 26.1s. Estimated remaining: 1h 56m 15s. Rate: 6.8 symbols/min [2025-09-18T20:50:39.453309] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:50:39.487100] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-18T20:50:39.525233] [DEBUG] [LOCAL ] OGE: Loaded 46665 existing records from primary storage. [2025-09-18T20:50:39.525394] [INFO ] [MAIN ] OGE: Loaded 46665 existing records. [2025-09-18T20:50:39.703893] [WARN ] [MAIN ] OGE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:50:39.704178] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-09-18T20:50:39.704229] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-09-18T20:50:39.705345] [DEBUG] [LOCAL ] OGE: Deleted primary data file. [2025-09-18T20:50:39.705407] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-09-18T20:50:39.725696] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-09-18T20:50:40.102324] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:50:40.276105] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-18T20:50:40.519584] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-09-18T20:50:41.104078] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-18T20:50:41.319615] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-11. [2025-09-18T20:50:41.468698] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T20:50:42.119550] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-09-18T20:50:42.919565] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-09-18T20:50:43.050259] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-18T20:50:43.090972] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-18T20:50:43.719578] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-09-18T20:50:43.978633] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-18T20:50:44.519574] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-09-18T20:50:45.023191] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-18T20:50:45.028620] [INFO ] [REMOTE ] OEC: Full fetch complete (47763 records). [2025-09-18T20:50:45.028827] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-09-18T20:50:45.234694] [WARN ] [VALIDATOR ] OEC: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-18T20:50:45.235271] [FATAL] [MAIN ] OEC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:50:45.235346] [WARN ] [MAIN ] OEC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:50:45.235423] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-09-18T20:50:45.235493] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-09-18T20:50:45.235532] [INFO ] [LOCAL ] OEC: Starting deletion of derivative data. [2025-09-18T20:50:45.236042] [DEBUG] [LOCAL ] OEC: Deleted derivative data file. [2025-09-18T20:50:45.236153] [INFO ] [MAIN ] Update Progress: 1578/2372 symbols completed. OEC took 25.2s. Estimated remaining: 1h 56m 5s. Rate: 6.8 symbols/min [2025-09-18T20:50:45.324693] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-09-18T20:50:45.426449] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:50:45.485884] [DEBUG] [LOCAL ] OGN: Loaded 53130 existing records from primary storage. [2025-09-18T20:50:45.486087] [INFO ] [MAIN ] OGN: Loaded 53130 existing records. [2025-09-18T20:50:45.665330] [WARN ] [MAIN ] OGN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:50:45.665565] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-09-18T20:50:45.665613] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-09-18T20:50:45.667108] [DEBUG] [LOCAL ] OGN: Deleted primary data file. [2025-09-18T20:50:45.667168] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-09-18T20:50:46.019720] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:50:46.124721] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-09-18T20:50:46.142899] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-18T20:50:46.435866] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-18T20:50:46.873023] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-18T20:50:46.874910] [INFO ] [REMOTE ] ODC: Full fetch complete (10828 records). [2025-09-18T20:50:46.875081] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-09-18T20:50:46.928092] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-09-18T20:50:47.249507] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-09-18T20:50:47.249621] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-09-18T20:50:47.249957] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-09-18T20:50:47.250012] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-09-18T20:50:47.250815] [DEBUG] [LOCAL ] ODC: Trimmed 10828 records to 8577 (keeping 200 days of data) [2025-09-18T20:50:47.302666] [DEBUG] [LOCAL ] ODC: Primary data saved (8577 records). [2025-09-18T20:50:47.302823] [INFO ] [MAIN ] ODC: Full history saved. [2025-09-18T20:50:47.302913] [INFO ] [MAIN ] Update Progress: 1579/2372 symbols completed. ODC took 46.7s. Estimated remaining: 1h 55m 53s. Rate: 6.8 symbols/min [2025-09-18T20:50:47.478064] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:50:47.515961] [DEBUG] [LOCAL ] OGS: Loaded 33913 existing records from primary storage. [2025-09-18T20:50:47.516140] [INFO ] [MAIN ] OGS: Loaded 33913 existing records. [2025-09-18T20:50:47.700107] [WARN ] [MAIN ] OGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:50:47.700354] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-09-18T20:50:47.700420] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-09-18T20:50:47.701190] [DEBUG] [LOCAL ] OGS: Deleted primary data file. [2025-09-18T20:50:47.701251] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-09-18T20:50:47.724734] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-09-18T20:50:48.079591] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:50:48.287383] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-18T20:50:48.519555] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-09-18T20:50:49.228510] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-18T20:50:49.319551] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-09-18T20:50:49.680202] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-18T20:50:50.119608] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-11. [2025-09-18T20:50:50.731817] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T20:50:50.919557] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-11. [2025-09-18T20:50:51.653461] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-18T20:50:51.719558] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-09-18T20:50:52.027532] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-18T20:50:52.519575] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-09-18T20:50:53.319568] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-09-18T20:50:53.377923] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-18T20:50:54.007709] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T20:50:54.122265] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-09-18T20:50:54.127490] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-18T20:50:54.919565] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-09-18T20:50:55.351442] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-18T20:50:55.719542] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-09-18T20:50:56.409675] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-18T20:50:56.519557] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-09-18T20:50:56.950795] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-18T20:50:57.319553] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-09-18T20:50:58.119537] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-09-18T20:50:58.215870] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-18T20:50:58.696416] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T20:50:58.919554] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-09-18T20:50:58.952036] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-18T20:50:59.719561] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-09-18T20:50:59.969734] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-18T20:51:00.519551] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-09-18T20:51:00.856969] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-18T20:51:00.860080] [INFO ] [REMOTE ] OFG: Full fetch complete (34567 records). [2025-09-18T20:51:00.860173] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-09-18T20:51:01.254174] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-09-18T20:51:01.254264] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-09-18T20:51:01.255043] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-09-18T20:51:01.255120] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-09-18T20:51:01.256036] [DEBUG] [LOCAL ] OFG: Trimmed 34567 records to 22555 (keeping 200 days of data) [2025-09-18T20:51:01.322325] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-09-18T20:51:01.407921] [DEBUG] [LOCAL ] OFG: Primary data saved (22555 records). [2025-09-18T20:51:01.408094] [INFO ] [MAIN ] OFG: Full history saved. [2025-09-18T20:51:01.408217] [INFO ] [MAIN ] Update Progress: 1580/2372 symbols completed. OFG took 27.1s. Estimated remaining: 1h 55m 47s. Rate: 6.8 symbols/min [2025-09-18T20:51:01.581390] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:51:01.632053] [DEBUG] [LOCAL ] OHI: Loaded 52161 existing records from primary storage. [2025-09-18T20:51:01.632207] [INFO ] [MAIN ] OHI: Loaded 52161 existing records. [2025-09-18T20:51:01.812420] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:51:01.812744] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-09-18T20:51:01.812801] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-09-18T20:51:01.814044] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-09-18T20:51:01.814106] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-09-18T20:51:02.121564] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-09-18T20:51:02.184727] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:51:02.215435] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-18T20:51:02.919562] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-11. [2025-09-18T20:51:03.719583] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-09-18T20:51:04.172959] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (2.85 seconds). [2025-09-18T20:51:04.519563] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-09-18T20:51:04.797171] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-09-18T20:51:05.078439] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-11 (2.16 seconds). [2025-09-18T20:51:05.134352] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-18T20:51:05.319610] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-09-18T20:51:05.870246] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-18T20:51:06.119541] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-09-18T20:51:06.808542] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-18T20:51:06.919504] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-09-18T20:51:07.719531] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-09-18T20:51:07.778233] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-18T20:51:08.097396] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-18T20:51:08.519564] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-09-18T20:51:09.195140] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-18T20:51:09.319546] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-09-18T20:51:10.119523] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-09-18T20:51:10.485376] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-18T20:51:10.556054] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T20:51:10.919573] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-09-18T20:51:11.619625] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-18T20:51:11.719543] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-09-18T20:51:12.307731] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-18T20:51:12.519571] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-09-18T20:51:13.319522] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-09-18T20:51:13.624090] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-18T20:51:13.725899] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-18T20:51:14.119547] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-09-18T20:51:14.587566] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-18T20:51:14.594325] [INFO ] [REMOTE ] OGS: Full fetch complete (47714 records). [2025-09-18T20:51:14.594496] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-09-18T20:51:14.929243] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-09-18T20:51:14.985052] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-09-18T20:51:14.985253] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-09-18T20:51:14.986320] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-09-18T20:51:14.986413] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-09-18T20:51:14.987844] [DEBUG] [LOCAL ] OGS: Trimmed 47714 records to 34167 (keeping 200 days of data) [2025-09-18T20:51:15.218504] [DEBUG] [LOCAL ] OGS: Primary data saved (34167 records). [2025-09-18T20:51:15.218679] [INFO ] [MAIN ] OGS: Full history saved. [2025-09-18T20:51:15.218804] [INFO ] [MAIN ] Update Progress: 1581/2372 symbols completed. OGS took 27.9s. Estimated remaining: 1h 55m 40s. Rate: 6.8 symbols/min [2025-09-18T20:51:15.400668] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:51:15.448228] [DEBUG] [LOCAL ] OI: Loaded 47447 existing records from primary storage. [2025-09-18T20:51:15.448404] [INFO ] [MAIN ] OI: Loaded 47447 existing records. [2025-09-18T20:51:15.626568] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:51:15.626865] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-09-18T20:51:15.626930] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-09-18T20:51:15.627910] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-09-18T20:51:15.627982] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-09-18T20:51:15.730527] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-09-18T20:51:15.988475] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:51:16.519606] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-11. [2025-09-18T20:51:17.223322] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-18T20:51:17.230470] [INFO ] [REMOTE ] OGE: Full fetch complete (66646 records). [2025-09-18T20:51:17.230704] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-09-18T20:51:17.589975] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (3.47 seconds). [2025-09-18T20:51:17.650584] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-09-18T20:51:17.670940] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-09-18T20:51:17.671862] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-09-18T20:51:17.672841] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-09-18T20:51:17.672909] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-09-18T20:51:17.674419] [DEBUG] [LOCAL ] OGE: Trimmed 66646 records to 47015 (keeping 200 days of data) [2025-09-18T20:51:17.960087] [DEBUG] [LOCAL ] OGE: Primary data saved (47015 records). [2025-09-18T20:51:17.960228] [INFO ] [MAIN ] OGE: Full history saved. [2025-09-18T20:51:17.960334] [INFO ] [MAIN ] Update Progress: 1582/2372 symbols completed. OGE took 38.7s. Estimated remaining: 1h 55m 29s. Rate: 6.8 symbols/min [2025-09-18T20:51:18.163818] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-18T20:51:18.162310] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:51:18.175722] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-09-18T20:51:18.210799] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-18T20:51:18.225734] [DEBUG] [LOCAL ] OIA: Loaded 13771 existing records from primary storage. [2025-09-18T20:51:18.225838] [INFO ] [MAIN ] OIA: Loaded 13771 existing records. [2025-09-18T20:51:18.404170] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:51:18.404437] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-09-18T20:51:18.404488] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-09-18T20:51:18.404981] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-09-18T20:51:18.405041] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-09-18T20:51:18.756701] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:51:18.919526] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-09-18T20:51:19.289869] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-18T20:51:19.719551] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-09-18T20:51:20.137958] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-18T20:51:20.186049] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-18T20:51:20.519534] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-09-18T20:51:21.319522] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-11. [2025-09-18T20:51:21.688291] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-18T20:51:21.789024] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-18T20:51:22.119578] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-09-18T20:51:22.260311] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-18T20:51:22.919556] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-09-18T20:51:23.720123] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-09-18T20:51:23.724096] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-18T20:51:24.519551] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-09-18T20:51:24.772114] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-18T20:51:24.896153] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-18T20:51:25.287059] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-18T20:51:25.319497] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-09-18T20:51:26.119613] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-09-18T20:51:26.368172] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-18T20:51:26.919552] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-09-18T20:51:27.719564] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-09-18T20:51:28.297883] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-18T20:51:28.380962] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T20:51:28.524627] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-09-18T20:51:28.530919] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-18T20:51:29.319578] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-09-18T20:51:30.068685] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-18T20:51:30.077309] [INFO ] [REMOTE ] OGN: Full fetch complete (76638 records). [2025-09-18T20:51:30.077447] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-09-18T20:51:30.124699] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-09-18T20:51:30.501858] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-09-18T20:51:30.501940] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-09-18T20:51:30.502982] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-09-18T20:51:30.503049] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-09-18T20:51:30.504836] [DEBUG] [LOCAL ] OGN: Trimmed 76638 records to 53519 (keeping 200 days of data) [2025-09-18T20:51:30.848700] [DEBUG] [LOCAL ] OGN: Primary data saved (53519 records). [2025-09-18T20:51:30.848847] [INFO ] [MAIN ] OGN: Full history saved. [2025-09-18T20:51:30.848973] [INFO ] [MAIN ] Update Progress: 1583/2372 symbols completed. OGN took 45.6s. Estimated remaining: 1h 55m 22s. Rate: 6.8 symbols/min [2025-09-18T20:51:30.919521] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-09-18T20:51:31.040952] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:51:31.055095] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-18T20:51:31.092637] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-18T20:51:31.137984] [DEBUG] [LOCAL ] OII: Loaded 43182 existing records from primary storage. [2025-09-18T20:51:31.138130] [INFO ] [MAIN ] OII: Loaded 43182 existing records. [2025-09-18T20:51:31.335853] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:51:31.336263] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-09-18T20:51:31.336350] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-09-18T20:51:31.338164] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-09-18T20:51:31.338226] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-09-18T20:51:31.700072] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:51:31.719490] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-11. [2025-09-18T20:51:32.519608] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-09-18T20:51:32.790015] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-18T20:51:33.072575] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-18T20:51:33.178215] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-18T20:51:33.319612] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-09-18T20:51:34.119559] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-09-18T20:51:34.696013] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-18T20:51:34.919571] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-09-18T20:51:35.382374] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-18T20:51:35.719588] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-09-18T20:51:36.403194] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T20:51:36.430780] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-18T20:51:36.519559] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-09-18T20:51:37.319520] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-09-18T20:51:37.517459] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-18T20:51:38.119561] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-09-18T20:51:38.598868] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-18T20:51:38.919551] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-09-18T20:51:39.535317] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-18T20:51:39.719568] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-09-18T20:51:40.519604] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-09-18T20:51:40.832998] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-18T20:51:40.911707] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-18T20:51:41.319558] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-09-18T20:51:42.119550] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-09-18T20:51:42.233307] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-18T20:51:42.755262] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-18T20:51:42.814456] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-18T20:51:42.919552] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-09-18T20:51:43.719544] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-09-18T20:51:43.807375] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-18T20:51:44.519579] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-09-18T20:51:45.319540] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-09-18T20:51:45.384833] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-18T20:51:45.861023] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-18T20:51:46.051446] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-18T20:51:46.054588] [INFO ] [REMOTE ] OIA: Full fetch complete (20869 records). [2025-09-18T20:51:46.054705] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-09-18T20:51:46.124684] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-09-18T20:51:46.437732] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-09-18T20:51:46.437838] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-09-18T20:51:46.438280] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-09-18T20:51:46.438323] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-09-18T20:51:46.439785] [DEBUG] [LOCAL ] OIA: Trimmed 20869 records to 13868 (keeping 200 days of data) [2025-09-18T20:51:46.530092] [DEBUG] [LOCAL ] OIA: Primary data saved (13868 records). [2025-09-18T20:51:46.530230] [INFO ] [MAIN ] OIA: Full history saved. [2025-09-18T20:51:46.530384] [INFO ] [MAIN ] Update Progress: 1584/2372 symbols completed. OIA took 28.6s. Estimated remaining: 1h 55m 16s. Rate: 6.8 symbols/min [2025-09-18T20:51:46.701190] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:51:46.750119] [DEBUG] [LOCAL ] OIS: Loaded 41002 existing records from primary storage. [2025-09-18T20:51:46.750261] [INFO ] [MAIN ] OIS: Loaded 41002 existing records. [2025-09-18T20:51:46.924802] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-09-18T20:51:46.929730] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:51:46.930493] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-09-18T20:51:46.930540] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-09-18T20:51:46.931583] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-09-18T20:51:46.931745] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-09-18T20:51:47.300582] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:51:47.719605] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-09-18T20:51:47.927849] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-18T20:51:47.935193] [INFO ] [REMOTE ] OHI: Full fetch complete (74951 records). [2025-09-18T20:51:47.935362] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-09-18T20:51:48.362598] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-09-18T20:51:48.362869] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-09-18T20:51:48.363959] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-09-18T20:51:48.364080] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-09-18T20:51:48.383022] [DEBUG] [LOCAL ] OHI: Trimmed 74951 records to 52527 (keeping 200 days of data) [2025-09-18T20:51:48.385994] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T20:51:48.395309] [INFO ] [REMOTE ] OI: Full fetch complete (68123 records). [2025-09-18T20:51:48.395514] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-09-18T20:51:48.523147] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-11. [2025-09-18T20:51:48.907917] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-09-18T20:51:48.908265] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-09-18T20:51:48.909886] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-09-18T20:51:48.910238] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-09-18T20:51:48.914520] [DEBUG] [LOCAL ] OI: Trimmed 68123 records to 47781 (keeping 200 days of data) [2025-09-18T20:51:49.171887] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T20:51:49.343906] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-09-18T20:51:49.446007] [DEBUG] [LOCAL ] OI: Primary data saved (47781 records). [2025-09-18T20:51:49.447186] [INFO ] [MAIN ] OI: Full history saved. [2025-09-18T20:51:49.447951] [INFO ] [MAIN ] Update Progress: 1585/2372 symbols completed. OI took 34.2s. Estimated remaining: 1h 55m 5s. Rate: 6.8 symbols/min [2025-09-18T20:51:49.556874] [DEBUG] [LOCAL ] OHI: Primary data saved (52527 records). [2025-09-18T20:51:49.567866] [INFO ] [MAIN ] OHI: Full history saved. [2025-09-18T20:51:49.568116] [INFO ] [MAIN ] Update Progress: 1586/2372 symbols completed. OHI took 48.2s. Estimated remaining: 1h 54m 52s. Rate: 6.8 symbols/min [2025-09-18T20:51:49.756907] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:51:49.824575] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:51:49.824830] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-09-18T20:51:49.824939] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-09-18T20:51:49.825114] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-09-18T20:51:49.825159] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-18T20:51:49.825203] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-09-18T20:51:49.825238] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-09-18T20:51:50.162994] [DEBUG] [LOCAL ] OKE: Loaded 53536 existing records from primary storage. [2025-09-18T20:51:50.203703] [INFO ] [MAIN ] OKE: Loaded 53536 existing records. [2025-09-18T20:51:50.303043] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-18T20:51:50.301757] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:51:50.315748] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-09-18T20:51:50.465860] [WARN ] [MAIN ] OKE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:51:50.466223] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-09-18T20:51:50.466281] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-09-18T20:51:50.467902] [DEBUG] [LOCAL ] OKE: Deleted primary data file. [2025-09-18T20:51:50.467964] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-09-18T20:51:50.840078] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:51:50.862605] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-18T20:51:50.919496] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-09-18T20:51:51.719545] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-11. [2025-09-18T20:51:51.890037] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-18T20:51:52.519521] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-09-18T20:51:52.583292] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-18T20:51:53.319563] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-09-18T20:51:53.781988] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-18T20:51:54.029115] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-11 (2.31 seconds). [2025-09-18T20:51:54.119580] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-09-18T20:51:54.616730] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T20:51:54.919561] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-09-18T20:51:55.286689] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-18T20:51:55.719538] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-09-18T20:51:56.357383] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-18T20:51:56.363127] [INFO ] [REMOTE ] OII: Full fetch complete (62101 records). [2025-09-18T20:51:56.363239] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-09-18T20:51:56.538708] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-11. [2025-09-18T20:51:56.752254] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-09-18T20:51:56.752338] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-09-18T20:51:56.753217] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-09-18T20:51:56.753279] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-09-18T20:51:56.754560] [DEBUG] [LOCAL ] OII: Trimmed 62101 records to 43473 (keeping 200 days of data) [2025-09-18T20:51:57.010317] [DEBUG] [LOCAL ] OII: Primary data saved (43473 records). [2025-09-18T20:51:57.010474] [INFO ] [MAIN ] OII: Full history saved. [2025-09-18T20:51:57.010563] [INFO ] [MAIN ] Update Progress: 1587/2372 symbols completed. OII took 26.2s. Estimated remaining: 1h 54m 42s. Rate: 6.8 symbols/min [2025-09-18T20:51:57.183098] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:51:57.210544] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-18T20:51:57.267057] [DEBUG] [LOCAL ] OLN: Loaded 51713 existing records from primary storage. [2025-09-18T20:51:57.267218] [INFO ] [MAIN ] OLN: Loaded 51713 existing records. [2025-09-18T20:51:57.324794] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-09-18T20:51:57.455774] [WARN ] [MAIN ] OLN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:51:57.456023] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-09-18T20:51:57.456074] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-09-18T20:51:57.457336] [DEBUG] [LOCAL ] OLN: Deleted primary data file. [2025-09-18T20:51:57.457399] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-09-18T20:51:57.825466] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:51:58.119594] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-11. [2025-09-18T20:51:58.496927] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-11 (1.96 seconds). [2025-09-18T20:51:58.919576] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-09-18T20:51:59.074613] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-18T20:51:59.490717] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-18T20:51:59.719537] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-09-18T20:52:00.519561] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-09-18T20:52:01.319543] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-09-18T20:52:01.396436] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-18T20:52:01.835530] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.92 seconds). [2025-09-18T20:52:01.888611] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T20:52:02.119604] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-09-18T20:52:02.919535] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-09-18T20:52:03.025618] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-18T20:52:03.724713] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-09-18T20:52:03.742328] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-18T20:52:04.365089] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-18T20:52:04.519545] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-09-18T20:52:05.319517] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-09-18T20:52:05.366278] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-18T20:52:06.059032] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-18T20:52:06.119541] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-09-18T20:52:06.919548] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-09-18T20:52:07.719592] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-09-18T20:52:08.000106] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-09-18T20:52:08.092908] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-18T20:52:08.170117] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T20:52:08.519548] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-09-18T20:52:09.319528] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-09-18T20:52:09.386831] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T20:52:09.905253] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T20:52:10.119546] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-09-18T20:52:10.506467] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-18T20:52:10.919549] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-09-18T20:52:11.719545] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-09-18T20:52:11.932177] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-18T20:52:12.519554] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-09-18T20:52:12.650998] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-18T20:52:13.319555] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-09-18T20:52:14.006485] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-18T20:52:14.046171] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-18T20:52:14.119500] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-09-18T20:52:14.919515] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-09-18T20:52:15.393560] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-18T20:52:15.719545] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-09-18T20:52:16.519566] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-09-18T20:52:16.579712] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-18T20:52:16.657492] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-18T20:52:17.319541] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-09-18T20:52:17.363521] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-18T20:52:17.667374] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-18T20:52:17.672194] [INFO ] [REMOTE ] OIS: Full fetch complete (56805 records). [2025-09-18T20:52:17.672299] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-09-18T20:52:18.069964] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-09-18T20:52:18.070127] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-09-18T20:52:18.071014] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-09-18T20:52:18.071096] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-09-18T20:52:18.072408] [DEBUG] [LOCAL ] OIS: Trimmed 56805 records to 41276 (keeping 200 days of data) [2025-09-18T20:52:18.119560] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-09-18T20:52:18.309137] [DEBUG] [LOCAL ] OIS: Primary data saved (41276 records). [2025-09-18T20:52:18.309285] [INFO ] [MAIN ] OIS: Full history saved. [2025-09-18T20:52:18.309373] [INFO ] [MAIN ] Update Progress: 1588/2372 symbols completed. OIS took 31.8s. Estimated remaining: 1h 54m 40s. Rate: 6.8 symbols/min [2025-09-18T20:52:18.484461] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:52:18.495745] [DEBUG] [LOCAL ] OLP: Loaded 9634 existing records from primary storage. [2025-09-18T20:52:18.495873] [INFO ] [MAIN ] OLP: Loaded 9634 existing records. [2025-09-18T20:52:18.671264] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:52:18.671535] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-09-18T20:52:18.671624] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-09-18T20:52:18.672049] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-09-18T20:52:18.672109] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-09-18T20:52:18.932006] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-09-18T20:52:19.051681] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:52:19.719567] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-11. [2025-09-18T20:52:19.791897] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-18T20:52:20.206399] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.89 seconds). [2025-09-18T20:52:20.386814] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T20:52:20.498070] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-18T20:52:20.519490] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-09-18T20:52:21.319527] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-09-18T20:52:21.471067] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-18T20:52:22.119542] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-09-18T20:52:22.919555] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-09-18T20:52:23.719626] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-09-18T20:52:23.835761] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-18T20:52:23.851176] [INFO ] [REMOTE ] OLN: Full fetch complete (74226 records). [2025-09-18T20:52:23.851613] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-18T20:52:23.851908] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-09-18T20:52:23.998578] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-09-18T20:52:24.299466] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-09-18T20:52:24.299572] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-09-18T20:52:24.300570] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-09-18T20:52:24.300639] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-09-18T20:52:24.303127] [DEBUG] [LOCAL ] OLN: Trimmed 74226 records to 52099 (keeping 200 days of data) [2025-09-18T20:52:24.523957] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-09-18T20:52:24.619156] [DEBUG] [LOCAL ] OLN: Primary data saved (52099 records). [2025-09-18T20:52:24.619294] [INFO ] [MAIN ] OLN: Full history saved. [2025-09-18T20:52:24.619404] [INFO ] [MAIN ] Update Progress: 1589/2372 symbols completed. OLN took 27.6s. Estimated remaining: 1h 54m 30s. Rate: 6.8 symbols/min [2025-09-18T20:52:24.794579] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:52:24.845554] [DEBUG] [LOCAL ] OMC: Loaded 53293 existing records from primary storage. [2025-09-18T20:52:24.845752] [INFO ] [MAIN ] OMC: Loaded 53293 existing records. [2025-09-18T20:52:25.020843] [WARN ] [MAIN ] OMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:52:25.021123] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-09-18T20:52:25.021173] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-09-18T20:52:25.022415] [DEBUG] [LOCAL ] OMC: Deleted primary data file. [2025-09-18T20:52:25.022477] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-09-18T20:52:25.324769] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-09-18T20:52:25.379999] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:52:25.518263] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-18T20:52:25.552233] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-18T20:52:26.119550] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-09-18T20:52:26.919575] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-09-18T20:52:27.719553] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-11. [2025-09-18T20:52:27.796293] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-18T20:52:28.052628] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.73 seconds). [2025-09-18T20:52:28.130482] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-18T20:52:28.519540] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-09-18T20:52:29.130725] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-18T20:52:29.319561] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-09-18T20:52:30.119601] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-09-18T20:52:30.919519] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-09-18T20:52:31.029782] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-18T20:52:31.465430] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-09-18T20:52:31.512074] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-18T20:52:31.719520] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-09-18T20:52:31.777534] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-18T20:52:31.788134] [INFO ] [REMOTE ] OKE: Full fetch complete (77326 records). [2025-09-18T20:52:31.788270] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-09-18T20:52:32.182848] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-09-18T20:52:32.182930] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-09-18T20:52:32.183907] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-09-18T20:52:32.183981] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-09-18T20:52:32.185486] [DEBUG] [LOCAL ] OKE: Trimmed 77326 records to 53926 (keeping 200 days of data) [2025-09-18T20:52:32.419925] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-18T20:52:32.520107] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-09-18T20:52:32.538459] [DEBUG] [LOCAL ] OKE: Primary data saved (53926 records). [2025-09-18T20:52:32.538569] [INFO ] [MAIN ] OKE: Full history saved. [2025-09-18T20:52:32.538681] [INFO ] [MAIN ] Update Progress: 1590/2372 symbols completed. OKE took 43.1s. Estimated remaining: 1h 54m 21s. Rate: 6.8 symbols/min [2025-09-18T20:52:32.707809] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:52:32.753695] [DEBUG] [LOCAL ] OMF: Loaded 46331 existing records from primary storage. [2025-09-18T20:52:32.753859] [INFO ] [MAIN ] OMF: Loaded 46331 existing records. [2025-09-18T20:52:32.929550] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:52:32.929872] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-09-18T20:52:32.929934] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-09-18T20:52:32.931006] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-09-18T20:52:32.931067] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-09-18T20:52:33.292541] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:52:33.319500] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-11. [2025-09-18T20:52:34.119562] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-09-18T20:52:34.378745] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-18T20:52:34.664566] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-18T20:52:34.919502] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-09-18T20:52:35.641931] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T20:52:35.719541] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-09-18T20:52:36.484247] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-18T20:52:36.519487] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-09-18T20:52:36.875006] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-09-18T20:52:37.145553] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T20:52:37.319563] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-09-18T20:52:38.119601] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-09-18T20:52:38.819987] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T20:52:38.919506] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-09-18T20:52:39.719560] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-09-18T20:52:39.878957] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-18T20:52:40.470381] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T20:52:40.519532] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-09-18T20:52:40.639726] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-18T20:52:40.641803] [INFO ] [REMOTE ] OLP: Full fetch complete (13854 records). [2025-09-18T20:52:40.641878] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-09-18T20:52:41.039478] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-09-18T20:52:41.039609] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-09-18T20:52:41.040023] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-09-18T20:52:41.040127] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-09-18T20:52:41.041091] [DEBUG] [LOCAL ] OLP: Trimmed 13854 records to 9715 (keeping 200 days of data) [2025-09-18T20:52:41.108573] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-18T20:52:41.118123] [INFO ] [REMOTE ] OKLO: Full fetch complete (77587 records). [2025-09-18T20:52:41.118560] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-09-18T20:52:41.120380] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T20:52:41.120836] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:52:41.122315] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:52:41.123303] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-18T20:52:41.124293] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-09-18T20:52:41.124688] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-09-18T20:52:41.125665] [DEBUG] [LOCAL ] OKLO: No derivative data file found to delete. [2025-09-18T20:52:41.126637] [INFO ] [MAIN ] Update Progress: 1591/2372 symbols completed. OKLO took 51.6s. Estimated remaining: 1h 54m 12s. Rate: 6.8 symbols/min [2025-09-18T20:52:41.241319] [DEBUG] [LOCAL ] OLP: Primary data saved (9715 records). [2025-09-18T20:52:41.256811] [INFO ] [MAIN ] OLP: Full history saved. [2025-09-18T20:52:41.275335] [INFO ] [MAIN ] Update Progress: 1592/2372 symbols completed. OLP took 23.0s. Estimated remaining: 1h 53m 59s. Rate: 6.8 symbols/min [2025-09-18T20:52:41.318934] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:52:41.329159] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-09-18T20:52:41.515228] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:52:41.525204] [DEBUG] [LOCAL ] ONIT: Loaded 7821 existing records from primary storage. [2025-09-18T20:52:41.525923] [INFO ] [MAIN ] ONIT: Loaded 7821 existing records. [2025-09-18T20:52:41.622075] [DEBUG] [LOCAL ] OMI: Loaded 45865 existing records from primary storage. [2025-09-18T20:52:41.622201] [INFO ] [MAIN ] OMI: Loaded 45865 existing records. [2025-09-18T20:52:41.897456] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:52:41.929082] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-09-18T20:52:41.946678] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-09-18T20:52:41.971273] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:52:41.971512] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-09-18T20:52:41.971561] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-09-18T20:52:41.971623] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-09-18T20:52:41.971739] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-09-18T20:52:42.003947] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-09-18T20:52:42.036273] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-09-18T20:52:42.127766] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-09-18T20:52:42.722570] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:52:42.718018] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:52:42.919524] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-11. [2025-09-18T20:52:43.283145] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-18T20:52:43.494910] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-18T20:52:43.601628] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-18T20:52:43.719509] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-09-18T20:52:44.519546] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-09-18T20:52:45.319567] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-09-18T20:52:45.536961] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-18T20:52:45.940520] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-18T20:52:46.119521] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-09-18T20:52:46.139103] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-18T20:52:46.919542] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-09-18T20:52:47.719532] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-09-18T20:52:48.054941] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-18T20:52:48.395885] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-18T20:52:48.519507] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-09-18T20:52:48.554382] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-18T20:52:49.319537] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-09-18T20:52:50.119545] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-11. [2025-09-18T20:52:50.405125] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-18T20:52:50.772703] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T20:52:50.919507] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-09-18T20:52:51.236261] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T20:52:51.719548] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-09-18T20:52:52.304484] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T20:52:52.519551] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-09-18T20:52:53.319586] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-09-18T20:52:53.430318] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-18T20:52:53.531264] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-18T20:52:53.908842] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-18T20:52:54.119615] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-09-18T20:52:54.919552] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-09-18T20:52:54.945835] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-18T20:52:55.719556] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-09-18T20:52:56.372673] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-18T20:52:56.385348] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-18T20:52:56.519517] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-09-18T20:52:57.319524] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-09-18T20:52:57.399529] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-18T20:52:58.119545] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-09-18T20:52:58.922543] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-09-18T20:52:58.927953] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-18T20:52:59.690216] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-18T20:52:59.719506] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-09-18T20:53:00.421228] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-18T20:53:00.519553] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-09-18T20:53:01.319602] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-09-18T20:53:01.574045] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-18T20:53:01.585955] [INFO ] [REMOTE ] OMC: Full fetch complete (76577 records). [2025-09-18T20:53:01.586265] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-09-18T20:53:01.897996] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-18T20:53:02.004340] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-09-18T20:53:02.004483] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-09-18T20:53:02.005719] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-09-18T20:53:02.005800] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-09-18T20:53:02.007990] [DEBUG] [LOCAL ] OMC: Trimmed 76577 records to 53682 (keeping 200 days of data) [2025-09-18T20:53:02.127958] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-09-18T20:53:02.127848] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-18T20:53:02.385999] [DEBUG] [LOCAL ] OMC: Primary data saved (53682 records). [2025-09-18T20:53:02.386173] [INFO ] [MAIN ] OMC: Full history saved. [2025-09-18T20:53:02.386282] [INFO ] [MAIN ] Update Progress: 1593/2372 symbols completed. OMC took 37.8s. Estimated remaining: 1h 53m 56s. Rate: 6.8 symbols/min [2025-09-18T20:53:02.554351] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:53:02.587136] [DEBUG] [LOCAL ] ONL: Loaded 32236 existing records from primary storage. [2025-09-18T20:53:02.587279] [INFO ] [MAIN ] ONL: Loaded 32236 existing records. [2025-09-18T20:53:02.782039] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:53:02.782285] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-09-18T20:53:02.782344] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-09-18T20:53:02.783162] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-09-18T20:53:02.783222] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-09-18T20:53:02.924818] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-09-18T20:53:03.085342] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-18T20:53:03.157713] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:53:03.719591] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-09-18T20:53:04.519567] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-09-18T20:53:04.597745] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-18T20:53:04.603865] [INFO ] [REMOTE ] OMF: Full fetch complete (66439 records). [2025-09-18T20:53:04.603981] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-09-18T20:53:04.745913] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-18T20:53:05.016097] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-09-18T20:53:05.016203] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-09-18T20:53:05.017303] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-09-18T20:53:05.017369] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-09-18T20:53:05.018898] [DEBUG] [LOCAL ] OMF: Trimmed 66439 records to 46657 (keeping 200 days of data) [2025-09-18T20:53:05.311852] [DEBUG] [LOCAL ] OMF: Primary data saved (46657 records). [2025-09-18T20:53:05.312007] [INFO ] [MAIN ] OMF: Full history saved. [2025-09-18T20:53:05.312118] [INFO ] [MAIN ] Update Progress: 1594/2372 symbols completed. OMF took 32.8s. Estimated remaining: 1h 53m 44s. Rate: 6.8 symbols/min [2025-09-18T20:53:05.324692] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-11. [2025-09-18T20:53:05.490144] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:53:05.543591] [DEBUG] [LOCAL ] ONON: Loaded 53613 existing records from primary storage. [2025-09-18T20:53:05.543800] [INFO ] [MAIN ] ONON: Loaded 53613 existing records. [2025-09-18T20:53:05.725346] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:53:05.725612] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-09-18T20:53:05.725689] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-09-18T20:53:05.727263] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-09-18T20:53:05.727324] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-09-18T20:53:06.099604] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:53:06.123193] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-11. [2025-09-18T20:53:06.127806] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T20:53:06.792714] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-18T20:53:06.919518] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-09-18T20:53:07.719591] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-09-18T20:53:08.419670] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-11 (2.30 seconds). [2025-09-18T20:53:08.519583] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-09-18T20:53:08.586724] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-18T20:53:08.699957] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-18T20:53:09.319597] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-09-18T20:53:10.119554] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-09-18T20:53:10.482300] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-18T20:53:10.651089] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T20:53:10.919517] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-09-18T20:53:11.307090] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-18T20:53:11.719602] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-09-18T20:53:12.519852] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-09-18T20:53:12.612228] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-18T20:53:12.652333] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-18T20:53:13.319553] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-09-18T20:53:14.119547] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-09-18T20:53:14.502511] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-18T20:53:14.573549] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T20:53:14.677545] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-18T20:53:14.679768] [INFO ] [REMOTE ] ONIT: Full fetch complete (11221 records). [2025-09-18T20:53:14.679847] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-09-18T20:53:14.924736] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-09-18T20:53:15.045281] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-09-18T20:53:15.045373] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-09-18T20:53:15.045699] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-09-18T20:53:15.045762] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-09-18T20:53:15.046314] [DEBUG] [LOCAL ] ONIT: Trimmed 11221 records to 7870 (keeping 200 days of data) [2025-09-18T20:53:15.092261] [DEBUG] [LOCAL ] ONIT: Primary data saved (7870 records). [2025-09-18T20:53:15.092387] [INFO ] [MAIN ] ONIT: Full history saved. [2025-09-18T20:53:15.092500] [INFO ] [MAIN ] Update Progress: 1595/2372 symbols completed. ONIT took 33.8s. Estimated remaining: 1h 53m 36s. Rate: 6.8 symbols/min [2025-09-18T20:53:15.263332] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:53:15.284719] [DEBUG] [LOCAL ] ONTF: Loaded 23049 existing records from primary storage. [2025-09-18T20:53:15.284889] [INFO ] [MAIN ] ONTF: Loaded 23049 existing records. [2025-09-18T20:53:15.462935] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:53:15.463213] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-09-18T20:53:15.463263] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-09-18T20:53:15.463909] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-09-18T20:53:15.463969] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-09-18T20:53:15.724631] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-09-18T20:53:15.824551] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:53:16.519555] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-11. [2025-09-18T20:53:17.074489] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-18T20:53:17.242776] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-18T20:53:17.319550] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-09-18T20:53:17.471787] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-18T20:53:18.119545] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-09-18T20:53:18.919538] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-09-18T20:53:19.191364] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-18T20:53:19.719547] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-09-18T20:53:20.051614] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-18T20:53:20.179514] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-18T20:53:20.187864] [INFO ] [REMOTE ] OMI: Full fetch complete (63295 records). [2025-09-18T20:53:20.188055] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-09-18T20:53:20.519894] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-09-18T20:53:20.629094] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-09-18T20:53:20.630415] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-18T20:53:20.630525] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-09-18T20:53:20.632011] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-09-18T20:53:20.637796] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-09-18T20:53:20.639851] [DEBUG] [LOCAL ] OMI: Trimmed 63295 records to 46242 (keeping 200 days of data) [2025-09-18T20:53:20.915012] [DEBUG] [LOCAL ] OMI: Primary data saved (46242 records). [2025-09-18T20:53:20.915153] [INFO ] [MAIN ] OMI: Full history saved. [2025-09-18T20:53:20.915252] [INFO ] [MAIN ] Update Progress: 1596/2372 symbols completed. OMI took 39.8s. Estimated remaining: 1h 53m 26s. Rate: 6.8 symbols/min [2025-09-18T20:53:21.087850] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:53:21.135929] [DEBUG] [LOCAL ] ONTO: Loaded 46488 existing records from primary storage. [2025-09-18T20:53:21.136124] [INFO ] [MAIN ] ONTO: Loaded 46488 existing records. [2025-09-18T20:53:21.320042] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-09-18T20:53:21.320247] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:53:21.321314] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-09-18T20:53:21.321365] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-09-18T20:53:21.322383] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-09-18T20:53:21.322445] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-09-18T20:53:21.714322] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:53:22.032899] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-18T20:53:22.119604] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-09-18T20:53:22.435363] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-18T20:53:22.919678] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-09-18T20:53:23.719551] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-09-18T20:53:24.365773] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-18T20:53:24.398177] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-18T20:53:24.459459] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-18T20:53:24.519504] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-09-18T20:53:25.319575] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-09-18T20:53:25.776916] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-18T20:53:26.119557] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-09-18T20:53:26.603083] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-18T20:53:26.919574] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-09-18T20:53:27.719589] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-09-18T20:53:28.352238] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-18T20:53:28.380042] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-18T20:53:28.433440] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-18T20:53:28.519508] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-09-18T20:53:29.319571] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-09-18T20:53:29.701587] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-18T20:53:30.119696] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-11. [2025-09-18T20:53:30.919544] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-09-18T20:53:31.192823] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-18T20:53:31.719554] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-09-18T20:53:31.805832] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T20:53:31.863345] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-18T20:53:32.519603] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-09-18T20:53:32.701015] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-18T20:53:33.319574] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-09-18T20:53:34.119512] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-09-18T20:53:34.248902] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T20:53:34.275215] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-18T20:53:34.919508] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-09-18T20:53:34.959502] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-18T20:53:34.963295] [INFO ] [REMOTE ] ONL: Full fetch complete (43848 records). [2025-09-18T20:53:34.963380] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-09-18T20:53:35.341828] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-09-18T20:53:35.341910] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-09-18T20:53:35.342637] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-09-18T20:53:35.342722] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-09-18T20:53:35.343619] [DEBUG] [LOCAL ] ONL: Trimmed 43848 records to 32442 (keeping 200 days of data) [2025-09-18T20:53:35.538038] [DEBUG] [LOCAL ] ONL: Primary data saved (32442 records). [2025-09-18T20:53:35.538229] [INFO ] [MAIN ] ONL: Full history saved. [2025-09-18T20:53:35.538370] [INFO ] [MAIN ] Update Progress: 1597/2372 symbols completed. ONL took 33.2s. Estimated remaining: 1h 53m 20s. Rate: 6.8 symbols/min [2025-09-18T20:53:35.719627] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-09-18T20:53:36.383777] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-18T20:53:36.519557] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-09-18T20:53:36.798875] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-18T20:53:37.319596] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-09-18T20:53:37.891917] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-18T20:53:38.119562] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-09-18T20:53:38.439514] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T20:53:38.443380] [INFO ] [REMOTE ] ONTF: Full fetch complete (31854 records). [2025-09-18T20:53:38.443458] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-09-18T20:53:38.817627] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-09-18T20:53:38.817768] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-09-18T20:53:38.818493] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-09-18T20:53:38.818566] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-09-18T20:53:38.819404] [DEBUG] [LOCAL ] ONTF: Trimmed 31854 records to 23257 (keeping 200 days of data) [2025-09-18T20:53:38.921764] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-09-18T20:53:38.950108] [DEBUG] [LOCAL ] ONTF: Primary data saved (23257 records). [2025-09-18T20:53:38.950805] [INFO ] [MAIN ] ONTF: Full history saved. [2025-09-18T20:53:38.950934] [INFO ] [MAIN ] Update Progress: 1598/2372 symbols completed. ONTF took 23.9s. Estimated remaining: 1h 53m 8s. Rate: 6.8 symbols/min [2025-09-18T20:53:40.069053] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-18T20:53:40.080865] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-09-18T20:53:40.680986] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-18T20:53:40.691811] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-09-18T20:53:41.942978] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-18T20:53:41.955168] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-09-18T20:53:42.276226] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T20:53:42.286541] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-09-18T20:53:44.055878] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-18T20:53:44.063384] [INFO ] [REMOTE ] ONON: Full fetch complete (77414 records). [2025-09-18T20:53:44.063517] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-09-18T20:53:44.483747] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-09-18T20:53:44.483924] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-09-18T20:53:44.485026] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-09-18T20:53:44.485144] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-09-18T20:53:44.517470] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-18T20:53:44.515866] [DEBUG] [LOCAL ] ONON: Trimmed 77414 records to 54003 (keeping 200 days of data) [2025-09-18T20:53:44.530148] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-09-18T20:53:44.854173] [DEBUG] [LOCAL ] ONON: Primary data saved (54003 records). [2025-09-18T20:53:44.854364] [INFO ] [MAIN ] ONON: Full history saved. [2025-09-18T20:53:44.854498] [INFO ] [MAIN ] Update Progress: 1599/2372 symbols completed. ONON took 39.5s. Estimated remaining: 1h 52m 58s. Rate: 6.8 symbols/min [2025-09-18T20:53:46.087286] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-18T20:53:46.097096] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-09-18T20:53:47.890663] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-18T20:53:47.901003] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-09-18T20:53:49.676063] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-18T20:53:49.686090] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-09-18T20:53:51.340136] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-18T20:53:51.347004] [INFO ] [REMOTE ] ONTO: Full fetch complete (65235 records). [2025-09-18T20:53:51.347119] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-09-18T20:53:51.748899] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-09-18T20:53:51.748994] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-09-18T20:53:51.750593] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-09-18T20:53:51.750700] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-09-18T20:53:51.752127] [DEBUG] [LOCAL ] ONTO: Trimmed 65235 records to 46859 (keeping 200 days of data) [2025-09-18T20:53:52.041767] [DEBUG] [LOCAL ] ONTO: Primary data saved (46859 records). [2025-09-18T20:53:52.041906] [INFO ] [MAIN ] ONTO: Full history saved. [2025-09-18T20:53:52.042075] [INFO ] [MAIN ] Update Progress: 1600/2372 symbols completed. ONTO took 31.1s. Estimated remaining: 1h 52m 49s. Rate: 6.8 symbols/min [2025-09-18T20:53:52.695398] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:53:52.763634] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:53:52.768301] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:53:52.787856] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:53:52.805929] [DEBUG] [LOCAL ] OPAD: Loaded 18628 existing records from primary storage. [2025-09-18T20:53:52.806062] [INFO ] [MAIN ] OPAD: Loaded 18628 existing records. [2025-09-18T20:53:52.912207] [DEBUG] [LOCAL ] OPP: Loaded 11786 existing records from primary storage. [2025-09-18T20:53:52.912569] [INFO ] [MAIN ] OPP: Loaded 11786 existing records. [2025-09-18T20:53:52.929905] [DEBUG] [LOCAL ] OOMA: Loaded 19176 existing records from primary storage. [2025-09-18T20:53:52.945706] [INFO ] [MAIN ] OOMA: Loaded 19176 existing records. [2025-09-18T20:53:53.276158] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:53:53.299159] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-09-18T20:53:53.333829] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-09-18T20:53:53.354995] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-09-18T20:53:53.349676] [DEBUG] [LOCAL ] OPFI: Loaded 46831 existing records from primary storage. [2025-09-18T20:53:53.365702] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-09-18T20:53:53.397280] [INFO ] [MAIN ] OPFI: Loaded 46831 existing records. [2025-09-18T20:53:53.420706] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:53:53.479193] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:53:53.537008] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-09-18T20:53:53.572529] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-09-18T20:53:53.565949] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-09-18T20:53:53.617624] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-09-18T20:53:53.646591] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-09-18T20:53:53.651895] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-09-18T20:53:53.663953] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-09-18T20:53:53.652137] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-09-18T20:53:54.097612] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:53:54.270276] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-09-18T20:53:54.316138] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-09-18T20:53:54.385251] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-09-18T20:53:54.463218] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-09-18T20:53:54.686429] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:53:54.708083] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-11. [2025-09-18T20:53:54.834808] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:53:54.861324] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-11. [2025-09-18T20:53:55.050941] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:53:55.083698] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-11. [2025-09-18T20:53:55.190008] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:53:55.190323] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-11. [2025-09-18T20:53:55.394819] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-18T20:53:55.396639] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-09-18T20:53:55.984388] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-18T20:53:55.992556] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-09-18T20:53:55.996158] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-18T20:53:55.998963] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-09-18T20:53:56.010405] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-18T20:53:56.015021] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-09-18T20:53:56.317818] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-18T20:53:56.325221] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-09-18T20:53:56.555451] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-18T20:53:56.557456] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-09-18T20:53:56.692599] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-18T20:53:56.697032] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-09-18T20:53:56.829566] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T20:53:56.834277] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-09-18T20:53:57.061361] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-18T20:53:57.063352] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-09-18T20:53:57.351700] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-18T20:53:57.354689] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-09-18T20:53:57.484508] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-18T20:53:57.492489] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-09-18T20:53:57.541728] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-18T20:53:57.556199] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-18T20:53:57.915807] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-18T20:53:58.119561] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-09-18T20:53:58.830909] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-18T20:53:58.919520] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-09-18T20:53:59.187967] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-18T20:53:59.623143] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-18T20:53:59.719538] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-09-18T20:54:00.519541] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-09-18T20:54:00.713437] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-18T20:54:01.228775] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-18T20:54:01.319562] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-09-18T20:54:02.119599] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-09-18T20:54:02.919576] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-09-18T20:54:03.719604] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-09-18T20:54:04.488520] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (3.17 seconds). [2025-09-18T20:54:04.519538] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-09-18T20:54:04.709283] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-18T20:54:05.080811] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-18T20:54:05.105132] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (2.99 seconds). [2025-09-18T20:54:05.319630] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-09-18T20:54:06.119515] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-09-18T20:54:06.284033] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-18T20:54:06.621730] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-18T20:54:06.730958] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-18T20:54:06.919531] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-09-18T20:54:07.719574] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-09-18T20:54:08.278109] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T20:54:08.519547] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-09-18T20:54:09.202487] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-18T20:54:09.319536] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-09-18T20:54:10.119545] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-09-18T20:54:10.209711] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T20:54:10.394761] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-18T20:54:10.919562] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-09-18T20:54:11.003343] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-18T20:54:11.719578] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-09-18T20:54:12.519545] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-09-18T20:54:12.565452] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-18T20:54:13.188407] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-18T20:54:13.195673] [INFO ] [REMOTE ] OPAD: Full fetch complete (21871 records). [2025-09-18T20:54:13.195845] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-09-18T20:54:13.320321] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-09-18T20:54:13.532826] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-18T20:54:13.616405] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-09-18T20:54:13.616492] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-09-18T20:54:13.616976] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-09-18T20:54:13.617060] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-09-18T20:54:13.618907] [DEBUG] [LOCAL ] OPAD: Trimmed 21871 records to 19002 (keeping 200 days of data) [2025-09-18T20:54:13.745506] [DEBUG] [LOCAL ] OPAD: Primary data saved (19002 records). [2025-09-18T20:54:13.745746] [INFO ] [MAIN ] OPAD: Full history saved. [2025-09-18T20:54:13.745935] [INFO ] [MAIN ] Update Progress: 1601/2372 symbols completed. OPAD took 21.7s. Estimated remaining: 1h 52m 46s. Rate: 6.8 symbols/min [2025-09-18T20:54:13.926381] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:54:13.926592] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-09-18T20:54:13.926670] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-09-18T20:54:13.926827] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-09-18T20:54:13.926882] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-18T20:54:13.926950] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-18T20:54:13.926986] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-09-18T20:54:14.126835] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-09-18T20:54:14.361310] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:54:14.919555] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-11. [2025-09-18T20:54:15.220573] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-18T20:54:15.250682] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-18T20:54:15.582246] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-18T20:54:15.719573] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-09-18T20:54:16.519585] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-09-18T20:54:17.319559] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-09-18T20:54:18.119541] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-09-18T20:54:18.127096] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-18T20:54:18.165170] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-09-18T20:54:18.483624] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-18T20:54:18.485838] [INFO ] [REMOTE ] OPP: Full fetch complete (17964 records). [2025-09-18T20:54:18.485916] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-09-18T20:54:18.852881] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-09-18T20:54:18.852962] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-09-18T20:54:18.853364] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-09-18T20:54:18.853405] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-09-18T20:54:18.854036] [DEBUG] [LOCAL ] OPP: Trimmed 17964 records to 11864 (keeping 200 days of data) [2025-09-18T20:54:18.919711] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-09-18T20:54:18.926815] [DEBUG] [LOCAL ] OPP: Primary data saved (11864 records). [2025-09-18T20:54:18.927351] [INFO ] [MAIN ] OPP: Full history saved. [2025-09-18T20:54:18.928181] [INFO ] [MAIN ] Update Progress: 1602/2372 symbols completed. OPP took 26.9s. Estimated remaining: 1h 52m 36s. Rate: 6.8 symbols/min [2025-09-18T20:54:19.117956] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:54:19.125740] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-18T20:54:19.174784] [DEBUG] [LOCAL ] OR: Loaded 45904 existing records from primary storage. [2025-09-18T20:54:19.174939] [INFO ] [MAIN ] OR: Loaded 45904 existing records. [2025-09-18T20:54:19.360670] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:54:19.360977] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-09-18T20:54:19.361028] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-09-18T20:54:19.362787] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-09-18T20:54:19.362849] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-09-18T20:54:19.664480] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-18T20:54:19.730588] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-09-18T20:54:19.743932] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:54:20.371334] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-18T20:54:20.519556] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-11. [2025-09-18T20:54:21.319570] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-09-18T20:54:21.812074] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-18T20:54:22.119562] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-09-18T20:54:22.433431] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-18T20:54:22.919581] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-09-18T20:54:23.719555] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-09-18T20:54:23.934951] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-18T20:54:24.521697] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-09-18T20:54:24.538612] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-18T20:54:24.557084] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-18T20:54:24.560444] [INFO ] [REMOTE ] OOMA: Full fetch complete (26410 records). [2025-09-18T20:54:24.560524] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-09-18T20:54:24.952529] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-09-18T20:54:24.952700] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-09-18T20:54:24.953319] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-09-18T20:54:24.953362] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-09-18T20:54:24.954262] [DEBUG] [LOCAL ] OOMA: Trimmed 26410 records to 19339 (keeping 200 days of data) [2025-09-18T20:54:25.076856] [DEBUG] [LOCAL ] OOMA: Primary data saved (19339 records). [2025-09-18T20:54:25.077002] [INFO ] [MAIN ] OOMA: Full history saved. [2025-09-18T20:54:25.077128] [INFO ] [MAIN ] Update Progress: 1603/2372 symbols completed. OOMA took 33.0s. Estimated remaining: 1h 52m 26s. Rate: 6.8 symbols/min [2025-09-18T20:54:25.249590] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:54:25.288296] [DEBUG] [LOCAL ] ORA: Loaded 32661 existing records from primary storage. [2025-09-18T20:54:25.288459] [INFO ] [MAIN ] ORA: Loaded 32661 existing records. [2025-09-18T20:54:25.324769] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-09-18T20:54:25.473811] [WARN ] [MAIN ] ORA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:54:25.474159] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-09-18T20:54:25.474239] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-09-18T20:54:25.475347] [DEBUG] [LOCAL ] ORA: Deleted primary data file. [2025-09-18T20:54:25.475409] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-09-18T20:54:25.840157] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:54:26.119525] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-11. [2025-09-18T20:54:26.208752] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-18T20:54:26.229495] [DEBUG] [REMOTE ] ORA: Error fetching primary data for 2024-11: 'API call returned an empty response.' [2025-09-18T20:54:26.229844] [WARN ] [REMOTE ] ORA: No data returned for month 2024-11 [2025-09-18T20:54:26.592338] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-18T20:54:26.919552] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-09-18T20:54:27.719561] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-09-18T20:54:28.519531] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-09-18T20:54:28.700857] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-18T20:54:28.708883] [INFO ] [REMOTE ] OPFI: Full fetch complete (67211 records). [2025-09-18T20:54:28.709053] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-09-18T20:54:29.142458] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-09-18T20:54:29.142672] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-09-18T20:54:29.143884] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-09-18T20:54:29.143991] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-09-18T20:54:29.150014] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-18T20:54:29.155454] [DEBUG] [LOCAL ] OPFI: Trimmed 67211 records to 47184 (keeping 200 days of data) [2025-09-18T20:54:29.281497] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-18T20:54:29.321563] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-09-18T20:54:29.486326] [DEBUG] [LOCAL ] OPFI: Primary data saved (47184 records). [2025-09-18T20:54:29.486705] [INFO ] [MAIN ] OPFI: Full history saved. [2025-09-18T20:54:29.486820] [INFO ] [MAIN ] Update Progress: 1604/2372 symbols completed. OPFI took 37.4s. Estimated remaining: 1h 52m 15s. Rate: 6.8 symbols/min [2025-09-18T20:54:29.657426] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:54:29.711871] [DEBUG] [LOCAL ] ORC: Loaded 52262 existing records from primary storage. [2025-09-18T20:54:29.712023] [INFO ] [MAIN ] ORC: Loaded 52262 existing records. [2025-09-18T20:54:29.905788] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:54:29.906214] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-09-18T20:54:29.906300] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-09-18T20:54:29.908209] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-09-18T20:54:29.908278] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-09-18T20:54:30.127986] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-09-18T20:54:30.201219] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-18T20:54:30.294666] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:54:30.919586] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-11. [2025-09-18T20:54:31.719550] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-09-18T20:54:31.916877] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-18T20:54:32.519523] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-09-18T20:54:32.635496] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-18T20:54:32.995450] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-18T20:54:33.319595] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-09-18T20:54:33.780333] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-18T20:54:34.119544] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-09-18T20:54:34.919584] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-09-18T20:54:35.075805] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-18T20:54:35.235425] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-18T20:54:35.522882] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-18T20:54:35.719552] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-09-18T20:54:36.381401] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-18T20:54:36.519553] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-09-18T20:54:37.319556] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-09-18T20:54:38.119551] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-09-18T20:54:38.191629] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-18T20:54:38.919554] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-09-18T20:54:39.105526] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-18T20:54:39.436847] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T20:54:39.534457] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-18T20:54:39.719587] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-09-18T20:54:40.519581] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-09-18T20:54:41.261827] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-18T20:54:41.319500] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-09-18T20:54:42.119535] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-09-18T20:54:42.486827] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-18T20:54:42.677796] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-18T20:54:42.692494] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-18T20:54:42.919572] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-09-18T20:54:43.719598] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-09-18T20:54:44.410565] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-18T20:54:44.519557] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-18T20:54:44.942482] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-18T20:54:45.059481] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-18T20:54:45.061770] [INFO ] [REMOTE ] OPY: Full fetch complete (10168 records). [2025-09-18T20:54:45.061898] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-09-18T20:54:45.240573] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-18T20:54:45.240879] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:54:45.240950] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:54:45.241018] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-18T20:54:45.241083] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-18T20:54:45.241121] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-09-18T20:54:45.241161] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-09-18T20:54:45.241231] [INFO ] [MAIN ] Update Progress: 1605/2372 symbols completed. OPY took 31.5s. Estimated remaining: 1h 52m 9s. Rate: 6.8 symbols/min [2025-09-18T20:54:45.324676] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-09-18T20:54:45.415795] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:54:45.415963] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-09-18T20:54:45.416017] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-09-18T20:54:45.416190] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-09-18T20:54:45.416250] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-18T20:54:45.416318] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-18T20:54:45.416354] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-09-18T20:54:45.768782] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:54:46.119552] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-09-18T20:54:46.638623] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-18T20:54:46.919571] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-09-18T20:54:47.478836] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-18T20:54:47.719581] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-09-18T20:54:48.519560] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-11. [2025-09-18T20:54:48.833875] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-18T20:54:49.319538] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-09-18T20:54:49.425394] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-18T20:54:49.432317] [INFO ] [REMOTE ] OR: Full fetch complete (64580 records). [2025-09-18T20:54:49.432436] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-09-18T20:54:49.854515] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-09-18T20:54:49.854628] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-09-18T20:54:49.855671] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-09-18T20:54:49.855749] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-09-18T20:54:49.857163] [DEBUG] [LOCAL ] OR: Trimmed 64580 records to 46253 (keeping 200 days of data) [2025-09-18T20:54:50.126105] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-09-18T20:54:50.148751] [DEBUG] [LOCAL ] OR: Primary data saved (46253 records). [2025-09-18T20:54:50.149122] [INFO ] [MAIN ] OR: Full history saved. [2025-09-18T20:54:50.149316] [INFO ] [MAIN ] Update Progress: 1606/2372 symbols completed. OR took 31.2s. Estimated remaining: 1h 51m 59s. Rate: 6.8 symbols/min [2025-09-18T20:54:50.326564] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:54:50.326831] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-09-18T20:54:50.326887] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-09-18T20:54:50.327035] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-09-18T20:54:50.327078] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-18T20:54:50.327121] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-18T20:54:50.327155] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-09-18T20:54:50.706852] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:54:50.739842] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-11 (2.22 seconds). [2025-09-18T20:54:50.919499] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-09-18T20:54:51.481156] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-18T20:54:51.653725] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-18T20:54:51.719564] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-11. [2025-09-18T20:54:52.519544] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-09-18T20:54:53.260552] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-18T20:54:53.319489] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-09-18T20:54:53.414413] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-18T20:54:53.686066] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T20:54:54.119558] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-09-18T20:54:54.919595] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-09-18T20:54:55.721682] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-09-18T20:54:55.725143] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-18T20:54:55.944098] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-18T20:54:56.323474] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-18T20:54:56.519528] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-09-18T20:54:56.980333] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-18T20:54:57.319540] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-09-18T20:54:58.030992] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T20:54:58.119532] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-09-18T20:54:58.919570] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-09-18T20:54:59.565195] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-18T20:54:59.699535] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-18T20:54:59.719499] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-09-18T20:55:00.086326] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-18T20:55:00.091056] [INFO ] [REMOTE ] ORA: Full fetch complete (49115 records). [2025-09-18T20:55:00.091154] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-09-18T20:55:00.284264] [WARN ] [VALIDATOR ] ORA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-18T20:55:00.284933] [FATAL] [MAIN ] ORA: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:55:00.285029] [WARN ] [MAIN ] ORA: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:55:00.285123] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-09-18T20:55:00.285208] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-09-18T20:55:00.285284] [INFO ] [LOCAL ] ORA: Starting deletion of derivative data. [2025-09-18T20:55:00.285754] [DEBUG] [LOCAL ] ORA: Deleted derivative data file. [2025-09-18T20:55:00.285868] [INFO ] [MAIN ] Update Progress: 1607/2372 symbols completed. ORA took 35.2s. Estimated remaining: 1h 51m 51s. Rate: 6.8 symbols/min [2025-09-18T20:55:00.476380] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:55:00.507608] [DEBUG] [LOCAL ] ORN: Loaded 31858 existing records from primary storage. [2025-09-18T20:55:00.507770] [INFO ] [MAIN ] ORN: Loaded 31858 existing records. [2025-09-18T20:55:00.528477] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-09-18T20:55:00.692003] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:55:00.692270] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-09-18T20:55:00.692326] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-09-18T20:55:00.693008] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-09-18T20:55:00.693071] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-09-18T20:55:01.052153] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:55:01.319547] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-11. [2025-09-18T20:55:01.548722] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-18T20:55:02.119552] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-09-18T20:55:02.498748] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-18T20:55:02.919551] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-09-18T20:55:03.399164] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-09-18T20:55:03.504906] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T20:55:03.719551] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-09-18T20:55:04.519559] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-09-18T20:55:04.679140] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-18T20:55:05.319620] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-09-18T20:55:05.538552] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-18T20:55:05.588578] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-18T20:55:06.119554] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-09-18T20:55:06.919588] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-09-18T20:55:07.373928] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-18T20:55:07.515931] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-18T20:55:07.719541] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-09-18T20:55:08.519703] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-09-18T20:55:09.023311] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-18T20:55:09.319559] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-09-18T20:55:09.423466] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-18T20:55:10.124737] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-09-18T20:55:10.143483] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-18T20:55:10.919549] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-09-18T20:55:11.118980] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-18T20:55:11.719598] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-09-18T20:55:11.939258] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-18T20:55:12.411302] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-18T20:55:12.519507] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-09-18T20:55:13.319543] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-09-18T20:55:13.484667] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-18T20:55:14.119554] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-09-18T20:55:14.665516] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-18T20:55:14.794970] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-18T20:55:14.919566] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-18T20:55:15.719577] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-09-18T20:55:16.283900] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-18T20:55:16.296141] [INFO ] [REMOTE ] ORC: Full fetch complete (75026 records). [2025-09-18T20:55:16.296387] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-09-18T20:55:16.536700] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-09-18T20:55:16.790961] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-18T20:55:16.833903] [INFO ] [REMOTE ] ORI: Full fetch complete (69916 records). [2025-09-18T20:55:16.849579] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-09-18T20:55:17.038791] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-09-18T20:55:17.051864] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-09-18T20:55:17.068255] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-09-18T20:55:17.080921] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-09-18T20:55:17.143705] [DEBUG] [LOCAL ] ORC: Trimmed 75026 records to 52643 (keeping 200 days of data) [2025-09-18T20:55:17.182741] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-18T20:55:17.184731] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:55:17.184849] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:55:17.184937] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-18T20:55:17.185607] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-18T20:55:17.185843] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-09-18T20:55:17.185925] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-09-18T20:55:17.186131] [INFO ] [MAIN ] Update Progress: 1608/2372 symbols completed. ORI took 27.0s. Estimated remaining: 1h 51m 46s. Rate: 6.8 symbols/min [2025-09-18T20:55:17.488503] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-18T20:55:17.487686] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:55:17.504922] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-09-18T20:55:17.657744] [DEBUG] [LOCAL ] OSCR: Loaded 53695 existing records from primary storage. [2025-09-18T20:55:17.659276] [INFO ] [MAIN ] OSCR: Loaded 53695 existing records. [2025-09-18T20:55:17.912187] [WARN ] [MAIN ] OSCR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:55:17.940678] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-09-18T20:55:17.949185] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-09-18T20:55:17.951364] [DEBUG] [LOCAL ] OSCR: Deleted primary data file. [2025-09-18T20:55:17.952026] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-09-18T20:55:18.134757] [DEBUG] [LOCAL ] ORC: Primary data saved (52643 records). [2025-09-18T20:55:18.159978] [INFO ] [MAIN ] ORC: Full history saved. [2025-09-18T20:55:18.197191] [INFO ] [MAIN ] Update Progress: 1609/2372 symbols completed. ORC took 48.7s. Estimated remaining: 1h 51m 33s. Rate: 6.8 symbols/min [2025-09-18T20:55:18.482857] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:55:18.502464] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-11. [2025-09-18T20:55:18.537126] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:55:18.537240] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-09-18T20:55:18.537278] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-09-18T20:55:18.537506] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-09-18T20:55:18.537549] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-18T20:55:18.537592] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-18T20:55:18.537627] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-09-18T20:55:18.902022] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:55:18.919508] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-11. [2025-09-18T20:55:19.089873] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T20:55:19.588622] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (3.05 seconds). [2025-09-18T20:55:19.719584] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-09-18T20:55:20.231462] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-18T20:55:20.334842] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-18T20:55:20.519516] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-09-18T20:55:21.319567] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-09-18T20:55:22.124616] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-09-18T20:55:22.140882] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-18T20:55:22.437402] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-18T20:55:22.919640] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-09-18T20:55:23.059389] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-18T20:55:23.223941] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-18T20:55:23.719740] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-09-18T20:55:24.519595] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-09-18T20:55:24.664069] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-18T20:55:24.731200] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-18T20:55:25.319559] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-18T20:55:25.878163] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-18T20:55:26.044304] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-18T20:55:26.050701] [INFO ] [REMOTE ] ORCL: Full fetch complete (77060 records). [2025-09-18T20:55:26.050820] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-09-18T20:55:26.051493] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T20:55:26.051584] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:55:26.051696] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:55:26.051785] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-18T20:55:26.051867] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-18T20:55:26.051920] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-09-18T20:55:26.051978] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-09-18T20:55:26.052076] [INFO ] [MAIN ] Update Progress: 1610/2372 symbols completed. ORCL took 40.8s. Estimated remaining: 1h 51m 24s. Rate: 6.8 symbols/min [2025-09-18T20:55:26.124690] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-09-18T20:55:26.225359] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:55:26.225592] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-09-18T20:55:26.225677] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-09-18T20:55:26.225820] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-09-18T20:55:26.225866] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-18T20:55:26.225907] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-18T20:55:26.225939] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-09-18T20:55:26.592992] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:55:26.919604] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-09-18T20:55:27.719548] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-11. [2025-09-18T20:55:27.980775] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:55:27.981093] [WARN ] [REMOTE ] OTF: No data returned for month 2024-11 [2025-09-18T20:55:28.070291] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-18T20:55:28.498552] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-18T20:55:28.519501] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-09-18T20:55:29.319551] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-09-18T20:55:29.643397] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:55:29.643767] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-09-18T20:55:30.083225] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-18T20:55:30.119486] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-09-18T20:55:30.919546] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-09-18T20:55:31.573199] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T20:55:31.719578] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-01. [2025-09-18T20:55:32.029558] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:55:32.029937] [WARN ] [REMOTE ] OTF: No data returned for month 2025-01 [2025-09-18T20:55:32.519555] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-02. [2025-09-18T20:55:32.808411] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:55:32.824337] [WARN ] [REMOTE ] OTF: No data returned for month 2025-02 [2025-09-18T20:55:32.826749] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-18T20:55:33.319578] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-09-18T20:55:34.119557] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-09-18T20:55:34.919507] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-09-18T20:55:35.464588] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-18T20:55:35.503021] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-18T20:55:35.719603] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-03. [2025-09-18T20:55:35.968211] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:55:35.968542] [WARN ] [REMOTE ] OTF: No data returned for month 2025-03 [2025-09-18T20:55:36.120776] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-18T20:55:36.519551] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-04. [2025-09-18T20:55:36.801201] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:55:36.801531] [WARN ] [REMOTE ] OTF: No data returned for month 2025-04 [2025-09-18T20:55:37.319692] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-09-18T20:55:38.119558] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-09-18T20:55:38.881930] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-18T20:55:38.919501] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-09-18T20:55:39.719605] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-05. [2025-09-18T20:55:39.994929] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:55:39.995253] [WARN ] [REMOTE ] OTF: No data returned for month 2025-05 [2025-09-18T20:55:40.283467] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-18T20:55:40.519546] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-09-18T20:55:40.678533] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-18T20:55:41.319560] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-06. [2025-09-18T20:55:41.973520] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-18T20:55:42.119557] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-07. [2025-09-18T20:55:42.801052] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-18T20:55:42.919701] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-09-18T20:55:42.963041] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-18T20:55:43.719573] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-09-18T20:55:44.348850] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-18T20:55:44.353825] [INFO ] [REMOTE ] ORN: Full fetch complete (45545 records). [2025-09-18T20:55:44.353971] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-09-18T20:55:44.519599] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-08. [2025-09-18T20:55:44.794978] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-09-18T20:55:44.795079] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-09-18T20:55:44.795950] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-09-18T20:55:44.796023] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-09-18T20:55:44.797301] [DEBUG] [LOCAL ] ORN: Trimmed 45545 records to 32121 (keeping 200 days of data) [2025-09-18T20:55:44.973361] [DEBUG] [LOCAL ] ORN: Primary data saved (32121 records). [2025-09-18T20:55:44.973502] [INFO ] [MAIN ] ORN: Full history saved. [2025-09-18T20:55:44.973588] [INFO ] [MAIN ] Update Progress: 1611/2372 symbols completed. ORN took 44.7s. Estimated remaining: 1h 51m 20s. Rate: 6.8 symbols/min [2025-09-18T20:55:45.159816] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:55:45.213874] [DEBUG] [LOCAL ] OTIS: Loaded 52715 existing records from primary storage. [2025-09-18T20:55:45.214056] [INFO ] [MAIN ] OTIS: Loaded 52715 existing records. [2025-09-18T20:55:45.322361] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-09-18T20:55:45.404868] [WARN ] [MAIN ] OTIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:55:45.405118] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-09-18T20:55:45.405170] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-09-18T20:55:45.406663] [DEBUG] [LOCAL ] OTIS: Deleted primary data file. [2025-09-18T20:55:45.406726] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-09-18T20:55:45.798720] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:55:45.799982] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-18T20:55:46.119534] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-11. [2025-09-18T20:55:46.388776] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-09-18T20:55:46.855574] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-18T20:55:46.919498] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-18T20:55:47.594878] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-18T20:55:47.719554] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-09-18T20:55:48.111501] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-18T20:55:48.117802] [INFO ] [REMOTE ] OSK: Full fetch complete (61393 records). [2025-09-18T20:55:48.118018] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-09-18T20:55:48.312945] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-18T20:55:48.313990] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:55:48.314100] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:55:48.314171] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-18T20:55:48.314268] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-18T20:55:48.314310] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-09-18T20:55:48.314352] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-09-18T20:55:48.314436] [INFO ] [MAIN ] Update Progress: 1612/2372 symbols completed. OSK took 30.1s. Estimated remaining: 1h 51m 9s. Rate: 6.8 symbols/min [2025-09-18T20:55:48.486220] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:55:48.519603] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-09. [2025-09-18T20:55:48.536049] [DEBUG] [LOCAL ] OUT: Loaded 48280 existing records from primary storage. [2025-09-18T20:55:48.536198] [INFO ] [MAIN ] OUT: Loaded 48280 existing records. [2025-09-18T20:55:48.724360] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:55:48.724715] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-09-18T20:55:48.724810] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-09-18T20:55:48.726504] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-09-18T20:55:48.726566] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-09-18T20:55:49.082670] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:55:49.319534] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-11. [2025-09-18T20:55:49.811547] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-18T20:55:49.815744] [INFO ] [REMOTE ] OTF: Full fetch complete (7333 records). [2025-09-18T20:55:49.815820] [DEBUG] [VALIDATOR ] OTF: Validating primary data. [2025-09-18T20:55:49.996284] [WARN ] [VALIDATOR ] OTF: Validation failed - insufficient historical data. Have 68 unique days, need 200 days [2025-09-18T20:55:49.996782] [FATAL] [MAIN ] OTF: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:55:49.997012] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:55:49.997193] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-18T20:55:49.997406] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-18T20:55:49.997525] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-09-18T20:55:49.997673] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-09-18T20:55:49.997884] [INFO ] [MAIN ] Update Progress: 1613/2372 symbols completed. OTF took 23.9s. Estimated remaining: 1h 50m 57s. Rate: 6.8 symbols/min [2025-09-18T20:55:50.122175] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-09-18T20:55:50.179212] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:55:50.262720] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-09-18T20:55:50.276382] [DEBUG] [LOCAL ] OVV: Loaded 53517 existing records from primary storage. [2025-09-18T20:55:50.276732] [INFO ] [MAIN ] OVV: Loaded 53517 existing records. [2025-09-18T20:55:50.454868] [WARN ] [MAIN ] OVV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:55:50.455218] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-09-18T20:55:50.455301] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-09-18T20:55:50.456927] [DEBUG] [LOCAL ] OVV: Deleted primary data file. [2025-09-18T20:55:50.457022] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-09-18T20:55:50.823218] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:55:50.919600] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-11. [2025-09-18T20:55:51.132854] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-18T20:55:51.719574] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-09-18T20:55:51.942351] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-18T20:55:52.441207] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-18T20:55:52.519533] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-09-18T20:55:52.967904] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-18T20:55:53.319541] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-09-18T20:55:54.068618] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T20:55:54.119541] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-09-18T20:55:54.878472] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-18T20:55:54.919548] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-09-18T20:55:55.714420] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-18T20:55:55.724251] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-09-18T20:55:56.411806] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T20:55:56.519556] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-09-18T20:55:57.319583] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-09-18T20:55:57.462294] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-18T20:55:57.943235] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T20:55:58.119547] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-09-18T20:55:58.919551] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-09-18T20:55:59.462687] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-18T20:55:59.470360] [INFO ] [REMOTE ] OSCR: Full fetch complete (77317 records). [2025-09-18T20:55:59.470518] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-09-18T20:55:59.740330] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-09-18T20:55:59.878372] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-09-18T20:55:59.878512] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-09-18T20:55:59.879667] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-09-18T20:55:59.879786] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-09-18T20:55:59.881531] [DEBUG] [LOCAL ] OSCR: Trimmed 77317 records to 54085 (keeping 200 days of data) [2025-09-18T20:56:00.015535] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-18T20:56:00.267035] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T20:56:00.284603] [DEBUG] [LOCAL ] OSCR: Primary data saved (54085 records). [2025-09-18T20:56:00.284749] [INFO ] [MAIN ] OSCR: Full history saved. [2025-09-18T20:56:00.284850] [INFO ] [MAIN ] Update Progress: 1614/2372 symbols completed. OSCR took 43.1s. Estimated remaining: 1h 50m 49s. Rate: 6.8 symbols/min [2025-09-18T20:56:00.454312] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:56:00.511931] [DEBUG] [LOCAL ] OWL: Loaded 53556 existing records from primary storage. [2025-09-18T20:56:00.512073] [INFO ] [MAIN ] OWL: Loaded 53556 existing records. [2025-09-18T20:56:00.525298] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-09-18T20:56:00.699372] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:56:00.699692] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-09-18T20:56:00.699759] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-09-18T20:56:00.701203] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-09-18T20:56:00.701278] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-09-18T20:56:01.058709] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:56:01.319619] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-09-18T20:56:01.517676] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-18T20:56:02.070239] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-18T20:56:02.119508] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-09-18T20:56:02.919520] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-11. [2025-09-18T20:56:02.997457] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-18T20:56:03.719571] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-09-18T20:56:04.101493] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-18T20:56:04.464538] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-18T20:56:04.519495] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-09-18T20:56:05.264899] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-18T20:56:05.319521] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-09-18T20:56:06.119608] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-09-18T20:56:06.760686] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-18T20:56:06.919515] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-09-18T20:56:06.969222] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-18T20:56:07.719531] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-09-18T20:56:07.831559] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-18T20:56:08.449373] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-18T20:56:08.519599] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-09-18T20:56:09.142801] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T20:56:09.319611] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-09-18T20:56:10.119564] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-09-18T20:56:10.616223] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-18T20:56:10.657210] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-18T20:56:10.919562] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-09-18T20:56:11.499370] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T20:56:11.719573] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-09-18T20:56:12.359360] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T20:56:12.519560] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-09-18T20:56:13.327522] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-09-18T20:56:13.333605] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-18T20:56:14.119553] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-09-18T20:56:14.282909] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-18T20:56:14.786089] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-18T20:56:14.919520] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-09-18T20:56:15.682301] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-18T20:56:15.719499] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-09-18T20:56:16.290285] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-18T20:56:16.519570] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-09-18T20:56:17.319509] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-09-18T20:56:17.371938] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-18T20:56:18.020593] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-18T20:56:18.027951] [INFO ] [REMOTE ] OVV: Full fetch complete (77120 records). [2025-09-18T20:56:18.028080] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-09-18T20:56:18.129767] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-09-18T20:56:18.438037] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-09-18T20:56:18.438208] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-09-18T20:56:18.439545] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-09-18T20:56:18.439615] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-09-18T20:56:18.441256] [DEBUG] [LOCAL ] OVV: Trimmed 77120 records to 53906 (keeping 200 days of data) [2025-09-18T20:56:18.791825] [DEBUG] [LOCAL ] OVV: Primary data saved (53906 records). [2025-09-18T20:56:18.791987] [INFO ] [MAIN ] OVV: Full history saved. [2025-09-18T20:56:18.792100] [INFO ] [MAIN ] Update Progress: 1615/2372 symbols completed. OVV took 28.8s. Estimated remaining: 1h 50m 44s. Rate: 6.8 symbols/min [2025-09-18T20:56:18.924813] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-09-18T20:56:18.971150] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:56:18.982033] [DEBUG] [LOCAL ] OWLT: Loaded 8756 existing records from primary storage. [2025-09-18T20:56:18.982236] [INFO ] [MAIN ] OWLT: Loaded 8756 existing records. [2025-09-18T20:56:19.176551] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:56:19.177018] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-09-18T20:56:19.177079] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-09-18T20:56:19.177840] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-09-18T20:56:19.177971] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-09-18T20:56:19.575236] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:56:19.609778] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-18T20:56:19.719581] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-09-18T20:56:19.837507] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-18T20:56:20.162400] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-18T20:56:20.169186] [INFO ] [REMOTE ] OUT: Full fetch complete (69048 records). [2025-09-18T20:56:20.169359] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-09-18T20:56:20.533730] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-09-18T20:56:20.594761] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-09-18T20:56:20.594848] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-09-18T20:56:20.595814] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-09-18T20:56:20.595878] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-09-18T20:56:20.597240] [DEBUG] [LOCAL ] OUT: Trimmed 69048 records to 48633 (keeping 200 days of data) [2025-09-18T20:56:20.897572] [DEBUG] [LOCAL ] OUT: Primary data saved (48633 records). [2025-09-18T20:56:20.897736] [INFO ] [MAIN ] OUT: Full history saved. [2025-09-18T20:56:20.897883] [INFO ] [MAIN ] Update Progress: 1616/2372 symbols completed. OUT took 32.6s. Estimated remaining: 1h 50m 33s. Rate: 6.8 symbols/min [2025-09-18T20:56:21.081908] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:56:21.119594] [DEBUG] [LOCAL ] OXM: Loaded 33657 existing records from primary storage. [2025-09-18T20:56:21.119775] [INFO ] [MAIN ] OXM: Loaded 33657 existing records. [2025-09-18T20:56:21.320921] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-11. [2025-09-18T20:56:21.321537] [WARN ] [MAIN ] OXM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:56:21.323587] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-09-18T20:56:21.323719] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-09-18T20:56:21.324895] [DEBUG] [LOCAL ] OXM: Deleted primary data file. [2025-09-18T20:56:21.324970] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-09-18T20:56:21.630945] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-18T20:56:21.750441] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:56:21.926351] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-18T20:56:22.119513] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-11. [2025-09-18T20:56:22.153741] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-18T20:56:22.919576] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-09-18T20:56:23.251064] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-18T20:56:23.719571] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-09-18T20:56:24.399070] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-18T20:56:24.519545] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-09-18T20:56:24.627689] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-18T20:56:25.316272] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-18T20:56:25.319493] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-09-18T20:56:26.025367] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-18T20:56:26.119596] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-09-18T20:56:26.919547] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-09-18T20:56:27.719545] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-09-18T20:56:27.888260] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-18T20:56:28.382010] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T20:56:28.390020] [INFO ] [REMOTE ] OTIS: Full fetch complete (75548 records). [2025-09-18T20:56:28.390186] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-09-18T20:56:28.524731] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-09-18T20:56:28.804413] [DEBUG] [VALIDATOR ] OTIS: All expected trading days are present. [2025-09-18T20:56:28.804506] [DEBUG] [VALIDATOR ] OTIS: Primary data validation passed. [2025-09-18T20:56:28.805521] [INFO ] [MAIN ] OTIS: Fetched primary data is valid. [2025-09-18T20:56:28.805604] [DEBUG] [LOCAL ] OTIS: Saving primary data. [2025-09-18T20:56:28.807217] [DEBUG] [LOCAL ] OTIS: Trimmed 75548 records to 53104 (keeping 200 days of data) [2025-09-18T20:56:29.070917] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-18T20:56:29.204551] [DEBUG] [LOCAL ] OTIS: Primary data saved (53104 records). [2025-09-18T20:56:29.204770] [INFO ] [MAIN ] OTIS: Full history saved. [2025-09-18T20:56:29.205062] [INFO ] [MAIN ] Update Progress: 1617/2372 symbols completed. OTIS took 44.2s. Estimated remaining: 1h 50m 24s. Rate: 6.8 symbols/min [2025-09-18T20:56:29.320401] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-09-18T20:56:29.365598] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-18T20:56:29.400274] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:56:29.403054] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-09-18T20:56:29.403469] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-09-18T20:56:29.403628] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-09-18T20:56:29.403723] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-18T20:56:29.403792] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-18T20:56:29.403883] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-09-18T20:56:29.782390] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:56:30.119570] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-09-18T20:56:30.756777] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-18T20:56:30.919529] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-09-18T20:56:31.601188] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-18T20:56:31.608520] [INFO ] [REMOTE ] OWL: Full fetch complete (77348 records). [2025-09-18T20:56:31.608676] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-09-18T20:56:31.724835] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-11. [2025-09-18T20:56:31.725160] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-18T20:56:32.022282] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-09-18T20:56:32.022434] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-09-18T20:56:32.023552] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-09-18T20:56:32.023620] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-09-18T20:56:32.025318] [DEBUG] [LOCAL ] OWL: Trimmed 77348 records to 53946 (keeping 200 days of data) [2025-09-18T20:56:32.367664] [DEBUG] [LOCAL ] OWL: Primary data saved (53946 records). [2025-09-18T20:56:32.367808] [INFO ] [MAIN ] OWL: Full history saved. [2025-09-18T20:56:32.367927] [INFO ] [MAIN ] Update Progress: 1618/2372 symbols completed. OWL took 32.1s. Estimated remaining: 1h 50m 12s. Rate: 6.8 symbols/min [2025-09-18T20:56:32.519862] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-09-18T20:56:32.548949] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:56:32.606927] [DEBUG] [LOCAL ] PAAS: Loaded 53603 existing records from primary storage. [2025-09-18T20:56:32.607096] [INFO ] [MAIN ] PAAS: Loaded 53603 existing records. [2025-09-18T20:56:32.784216] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:56:32.784513] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-09-18T20:56:32.784569] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-09-18T20:56:32.786667] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-09-18T20:56:32.786729] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-09-18T20:56:33.136257] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:56:33.319513] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-11. [2025-09-18T20:56:33.671509] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-18T20:56:34.061954] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-11 (2.34 seconds). [2025-09-18T20:56:34.119601] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-09-18T20:56:34.930012] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-09-18T20:56:34.938678] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-18T20:56:35.407198] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-18T20:56:35.627950] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T20:56:35.719500] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-09-18T20:56:36.519576] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-09-18T20:56:37.169545] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T20:56:37.319533] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-09-18T20:56:38.119550] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-09-18T20:56:38.532592] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T20:56:38.802281] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-18T20:56:38.839146] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T20:56:38.919502] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-09-18T20:56:39.580154] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-18T20:56:39.719535] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-09-18T20:56:40.519549] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-09-18T20:56:40.626723] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-18T20:56:41.319582] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-09-18T20:56:41.921986] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-18T20:56:41.936883] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T20:56:41.938797] [INFO ] [REMOTE ] OWLT: Full fetch complete (11570 records). [2025-09-18T20:56:41.938868] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-09-18T20:56:42.124727] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-09-18T20:56:42.313627] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-09-18T20:56:42.313823] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-09-18T20:56:42.314141] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-09-18T20:56:42.314439] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-09-18T20:56:42.315663] [DEBUG] [LOCAL ] OWLT: Trimmed 11570 records to 8877 (keeping 200 days of data) [2025-09-18T20:56:42.373601] [DEBUG] [LOCAL ] OWLT: Primary data saved (8877 records). [2025-09-18T20:56:42.373763] [INFO ] [MAIN ] OWLT: Full history saved. [2025-09-18T20:56:42.373893] [INFO ] [MAIN ] Update Progress: 1619/2372 symbols completed. OWLT took 23.6s. Estimated remaining: 1h 50m 4s. Rate: 6.8 symbols/min [2025-09-18T20:56:42.547330] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:56:42.567089] [DEBUG] [LOCAL ] PAC: Loaded 11719 existing records from primary storage. [2025-09-18T20:56:42.567260] [INFO ] [MAIN ] PAC: Loaded 11719 existing records. [2025-09-18T20:56:42.746972] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:56:42.747224] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-09-18T20:56:42.747272] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-09-18T20:56:42.747874] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-09-18T20:56:42.747934] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-09-18T20:56:42.928907] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-09-18T20:56:43.105855] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:56:43.719579] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-09-18T20:56:44.519603] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-11. [2025-09-18T20:56:45.342613] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (3.22 seconds). [2025-09-18T20:56:45.350721] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-09-18T20:56:45.600725] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-18T20:56:45.861897] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-18T20:56:46.119604] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-09-18T20:56:46.379446] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-18T20:56:46.382305] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (3.45 seconds). [2025-09-18T20:56:46.919575] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-09-18T20:56:47.719562] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-09-18T20:56:47.834253] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-18T20:56:48.519609] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-09-18T20:56:49.063962] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-18T20:56:49.069359] [INFO ] [REMOTE ] OXM: Full fetch complete (46148 records). [2025-09-18T20:56:49.069477] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-09-18T20:56:49.337990] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-09-18T20:56:49.543095] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-18T20:56:49.543556] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-09-18T20:56:49.546732] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-09-18T20:56:49.547668] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-09-18T20:56:49.547752] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-09-18T20:56:49.559370] [DEBUG] [LOCAL ] OXM: Trimmed 46148 records to 33885 (keeping 200 days of data) [2025-09-18T20:56:49.578432] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-09-18T20:56:49.793685] [DEBUG] [LOCAL ] OXM: Primary data saved (33885 records). [2025-09-18T20:56:49.793839] [INFO ] [MAIN ] OXM: Full history saved. [2025-09-18T20:56:49.793931] [INFO ] [MAIN ] Update Progress: 1620/2372 symbols completed. OXM took 28.9s. Estimated remaining: 1h 49m 55s. Rate: 6.8 symbols/min [2025-09-18T20:56:49.970041] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:56:50.005857] [DEBUG] [LOCAL ] PACK: Loaded 31966 existing records from primary storage. [2025-09-18T20:56:50.005999] [INFO ] [MAIN ] PACK: Loaded 31966 existing records. [2025-09-18T20:56:50.124695] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-09-18T20:56:50.187590] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:56:50.187892] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-09-18T20:56:50.187950] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-09-18T20:56:50.188938] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-09-18T20:56:50.189000] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-09-18T20:56:50.542850] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:56:50.919545] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-11. [2025-09-18T20:56:51.066233] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-18T20:56:51.233185] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-18T20:56:51.719625] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-09-18T20:56:51.922819] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-18T20:56:52.519551] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-09-18T20:56:52.636024] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-18T20:56:53.319550] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-09-18T20:56:53.396316] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T20:56:54.119562] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-09-18T20:56:54.919627] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-09-18T20:56:55.728329] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-09-18T20:56:55.730328] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T20:56:56.519583] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-09-18T20:56:56.889301] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (3.57 seconds). [2025-09-18T20:56:56.909468] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-18T20:56:57.319556] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-09-18T20:56:57.591639] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-18T20:56:58.030042] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (3.11 seconds). [2025-09-18T20:56:58.119550] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-09-18T20:56:58.919577] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-09-18T20:56:59.154900] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-18T20:56:59.252923] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-18T20:56:59.719625] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-09-18T20:57:00.249624] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-18T20:57:00.519549] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-09-18T20:57:01.319539] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-09-18T20:57:01.803906] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-18T20:57:02.119744] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-09-18T20:57:02.916762] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (3.20 seconds). [2025-09-18T20:57:02.927728] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-09-18T20:57:03.719605] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-09-18T20:57:03.948684] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-18T20:57:04.519714] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-09-18T20:57:04.868080] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-09-18T20:57:04.994622] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (3.68 seconds). [2025-09-18T20:57:05.128018] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-18T20:57:05.319569] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-09-18T20:57:05.465153] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-18T20:57:06.119614] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-09-18T20:57:06.478318] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-18T20:57:06.919582] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-09-18T20:57:07.719591] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-09-18T20:57:08.305826] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-18T20:57:08.519621] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-09-18T20:57:08.734548] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-18T20:57:09.319547] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-09-18T20:57:09.666958] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-09-18T20:57:10.119503] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-09-18T20:57:10.220739] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-18T20:57:10.432128] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-18T20:57:10.919609] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-09-18T20:57:11.670595] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-18T20:57:11.719550] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-09-18T20:57:12.467687] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-18T20:57:12.519504] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-09-18T20:57:13.319536] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-09-18T20:57:13.355993] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T20:57:13.951629] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-18T20:57:13.953587] [INFO ] [REMOTE ] PAC: Full fetch complete (16499 records). [2025-09-18T20:57:13.953692] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-09-18T20:57:14.124718] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-09-18T20:57:14.371564] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-09-18T20:57:14.371678] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-09-18T20:57:14.372142] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-09-18T20:57:14.372184] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-09-18T20:57:14.372986] [DEBUG] [LOCAL ] PAC: Trimmed 16499 records to 11748 (keeping 200 days of data) [2025-09-18T20:57:14.477333] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-18T20:57:14.479822] [DEBUG] [LOCAL ] PAC: Primary data saved (11748 records). [2025-09-18T20:57:14.488078] [INFO ] [MAIN ] PAC: Full history saved. [2025-09-18T20:57:14.488213] [INFO ] [MAIN ] Update Progress: 1621/2372 symbols completed. PAC took 32.1s. Estimated remaining: 1h 49m 53s. Rate: 6.8 symbols/min [2025-09-18T20:57:14.522131] [INFO ] [REMOTE ] PAAS: Full fetch complete (77243 records). [2025-09-18T20:57:14.557912] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-09-18T20:57:14.807681] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:57:14.927319] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-09-18T20:57:15.130351] [DEBUG] [LOCAL ] PACS: Loaded 33788 existing records from primary storage. [2025-09-18T20:57:15.129355] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-09-18T20:57:15.130486] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-09-18T20:57:15.130579] [INFO ] [MAIN ] PACS: Loaded 33788 existing records. [2025-09-18T20:57:15.163600] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-09-18T20:57:15.196486] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-09-18T20:57:15.251927] [DEBUG] [LOCAL ] PAAS: Trimmed 77243 records to 53993 (keeping 200 days of data) [2025-09-18T20:57:15.372433] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:57:15.410037] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-09-18T20:57:15.412265] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-09-18T20:57:15.415051] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-09-18T20:57:15.415897] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-09-18T20:57:15.827061] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:57:15.833094] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-11. [2025-09-18T20:57:16.056596] [DEBUG] [LOCAL ] PAAS: Primary data saved (53993 records). [2025-09-18T20:57:16.056816] [INFO ] [MAIN ] PAAS: Full history saved. [2025-09-18T20:57:16.056926] [INFO ] [MAIN ] Update Progress: 1622/2372 symbols completed. PAAS took 43.7s. Estimated remaining: 1h 49m 41s. Rate: 6.8 symbols/min [2025-09-18T20:57:16.229281] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:57:16.252682] [DEBUG] [LOCAL ] PAG: Loaded 22112 existing records from primary storage. [2025-09-18T20:57:16.252847] [INFO ] [MAIN ] PAG: Loaded 22112 existing records. [2025-09-18T20:57:16.434238] [WARN ] [MAIN ] PAG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:57:16.434491] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-09-18T20:57:16.434541] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-09-18T20:57:16.435482] [DEBUG] [LOCAL ] PAG: Deleted primary data file. [2025-09-18T20:57:16.435543] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-09-18T20:57:16.715745] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-18T20:57:16.761532] [INFO ] [REMOTE ] PACK: Full fetch complete (42921 records). [2025-09-18T20:57:16.777166] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-09-18T20:57:16.933686] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:57:16.951840] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-11. [2025-09-18T20:57:17.256803] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-09-18T20:57:17.256910] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-09-18T20:57:17.257816] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-09-18T20:57:17.257900] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-09-18T20:57:17.259693] [DEBUG] [LOCAL ] PACK: Trimmed 42921 records to 32286 (keeping 200 days of data) [2025-09-18T20:57:17.381244] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (3.26 seconds). [2025-09-18T20:57:17.398890] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-09-18T20:57:17.509523] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-18T20:57:17.534279] [DEBUG] [LOCAL ] PACK: Primary data saved (32286 records). [2025-09-18T20:57:17.534463] [INFO ] [MAIN ] PACK: Full history saved. [2025-09-18T20:57:17.534587] [INFO ] [MAIN ] Update Progress: 1623/2372 symbols completed. PACK took 27.7s. Estimated remaining: 1h 49m 29s. Rate: 6.8 symbols/min [2025-09-18T20:57:17.710154] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:57:17.721829] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-18T20:57:17.772783] [DEBUG] [LOCAL ] PAGS: Loaded 52677 existing records from primary storage. [2025-09-18T20:57:17.772940] [INFO ] [MAIN ] PAGS: Loaded 52677 existing records. [2025-09-18T20:57:17.955572] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:57:17.955882] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-09-18T20:57:17.955935] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-09-18T20:57:17.957366] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-09-18T20:57:17.957430] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-09-18T20:57:18.122803] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-09-18T20:57:18.326778] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:57:18.919551] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-11. [2025-09-18T20:57:19.593308] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-18T20:57:19.719686] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-09-18T20:57:19.974452] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-18T20:57:20.418804] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-18T20:57:20.519568] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-18T20:57:20.750258] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-18T20:57:21.319537] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-09-18T20:57:22.119573] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-09-18T20:57:22.535552] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T20:57:22.637867] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-18T20:57:22.644993] [INFO ] [REMOTE ] OXY: Full fetch complete (77519 records). [2025-09-18T20:57:22.645122] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-09-18T20:57:22.854232] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-18T20:57:22.855134] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:57:22.855314] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:57:22.855392] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-18T20:57:22.855500] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-18T20:57:22.855827] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-09-18T20:57:22.856063] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-09-18T20:57:22.856189] [INFO ] [MAIN ] Update Progress: 1624/2372 symbols completed. OXY took 53.7s. Estimated remaining: 1h 49m 19s. Rate: 6.8 symbols/min [2025-09-18T20:57:22.934749] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-09-18T20:57:22.910494] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-18T20:57:23.052031] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:57:23.056906] [DEBUG] [LOCAL ] PAI: Loaded 2731 existing records from primary storage. [2025-09-18T20:57:23.056997] [INFO ] [MAIN ] PAI: Loaded 2731 existing records. [2025-09-18T20:57:23.238963] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:57:23.239225] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-09-18T20:57:23.239276] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-09-18T20:57:23.239535] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-09-18T20:57:23.239596] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-09-18T20:57:23.605808] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:57:23.719548] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-09-18T20:57:24.519590] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-09-18T20:57:24.735483] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-18T20:57:25.098890] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-18T20:57:25.207104] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-18T20:57:25.319536] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-09-18T20:57:26.119547] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-11. [2025-09-18T20:57:26.606825] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-18T20:57:26.758242] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-18T20:57:26.919554] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-09-18T20:57:27.719520] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-09-18T20:57:27.794123] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-18T20:57:28.519569] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-09-18T20:57:28.753714] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-18T20:57:29.089447] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-18T20:57:29.319546] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-09-18T20:57:30.119577] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-09-18T20:57:30.623915] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-18T20:57:30.886444] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-18T20:57:30.919486] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-09-18T20:57:31.563697] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-18T20:57:31.719574] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-09-18T20:57:32.519555] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-09-18T20:57:32.781529] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-18T20:57:33.028394] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-18T20:57:33.319536] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-09-18T20:57:34.119604] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-09-18T20:57:34.700131] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-18T20:57:34.919522] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-09-18T20:57:34.996556] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-18T20:57:35.369152] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-18T20:57:35.719572] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-09-18T20:57:36.519586] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-09-18T20:57:37.027213] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-18T20:57:37.077255] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-18T20:57:37.319539] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-09-18T20:57:38.119545] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-09-18T20:57:38.843671] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-18T20:57:38.919534] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-09-18T20:57:39.285201] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-18T20:57:39.719533] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-09-18T20:57:40.097469] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-18T20:57:40.223545] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-18T20:57:40.519545] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-09-18T20:57:41.052933] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-18T20:57:41.319527] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-09-18T20:57:42.119593] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-09-18T20:57:42.919508] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-09-18T20:57:43.121317] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-18T20:57:43.162686] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-18T20:57:43.358242] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-18T20:57:43.359793] [INFO ] [REMOTE ] PAI: Full fetch complete (4138 records). [2025-09-18T20:57:43.359863] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-09-18T20:57:43.723615] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-09-18T20:57:43.723858] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-09-18T20:57:43.725196] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-09-18T20:57:43.725363] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-09-18T20:57:43.725408] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-09-18T20:57:43.725828] [DEBUG] [LOCAL ] PAI: Trimmed 4138 records to 2759 (keeping 200 days of data) [2025-09-18T20:57:43.742523] [DEBUG] [LOCAL ] PAI: Primary data saved (2759 records). [2025-09-18T20:57:43.742590] [INFO ] [MAIN ] PAI: Full history saved. [2025-09-18T20:57:43.742685] [INFO ] [MAIN ] Update Progress: 1625/2372 symbols completed. PAI took 20.9s. Estimated remaining: 1h 49m 15s. Rate: 6.8 symbols/min [2025-09-18T20:57:43.912028] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:57:43.912208] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-09-18T20:57:43.912264] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-09-18T20:57:43.912412] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-09-18T20:57:43.912455] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-18T20:57:43.912496] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-18T20:57:43.912529] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-09-18T20:57:44.264591] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:57:44.519561] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-09-18T20:57:44.848194] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-18T20:57:45.319570] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-09-18T20:57:46.119586] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-09-18T20:57:46.314239] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-18T20:57:46.380486] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-18T20:57:46.919639] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-09-18T20:57:47.248440] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-18T20:57:47.607456] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-18T20:57:47.610198] [INFO ] [REMOTE ] PAG: Full fetch complete (29800 records). [2025-09-18T20:57:47.610288] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-09-18T20:57:47.722556] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-09-18T20:57:48.006411] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-09-18T20:57:48.006520] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-09-18T20:57:48.007258] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-09-18T20:57:48.007324] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-09-18T20:57:48.008875] [DEBUG] [LOCAL ] PAG: Trimmed 29800 records to 22228 (keeping 200 days of data) [2025-09-18T20:57:48.155870] [DEBUG] [LOCAL ] PAG: Primary data saved (22228 records). [2025-09-18T20:57:48.156007] [INFO ] [MAIN ] PAG: Full history saved. [2025-09-18T20:57:48.156120] [INFO ] [MAIN ] Update Progress: 1626/2372 symbols completed. PAG took 32.1s. Estimated remaining: 1h 49m 5s. Rate: 6.8 symbols/min [2025-09-18T20:57:48.328823] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:57:48.360330] [DEBUG] [LOCAL ] PAM: Loaded 27386 existing records from primary storage. [2025-09-18T20:57:48.360519] [INFO ] [MAIN ] PAM: Loaded 27386 existing records. [2025-09-18T20:57:48.541937] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-11. [2025-09-18T20:57:48.550030] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:57:48.550338] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-09-18T20:57:48.550391] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-09-18T20:57:48.551273] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-09-18T20:57:48.551340] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-09-18T20:57:48.889905] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:57:48.904404] [WARN ] [REMOTE ] PAII: No data returned for month 2024-11 [2025-09-18T20:57:48.933124] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:57:49.319552] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-11. [2025-09-18T20:57:49.372824] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-18T20:57:50.119563] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-09-18T20:57:50.919565] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-09-18T20:57:51.016913] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-18T20:57:51.207416] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:57:51.207792] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-09-18T20:57:51.256035] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-18T20:57:51.262065] [INFO ] [REMOTE ] PACS: Full fetch complete (50748 records). [2025-09-18T20:57:51.262170] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-09-18T20:57:51.661323] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-09-18T20:57:51.661458] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-09-18T20:57:51.662335] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-09-18T20:57:51.662403] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-09-18T20:57:51.663483] [DEBUG] [LOCAL ] PACS: Trimmed 50748 records to 34096 (keeping 200 days of data) [2025-09-18T20:57:51.725849] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-09-18T20:57:51.874121] [DEBUG] [LOCAL ] PACS: Primary data saved (34096 records). [2025-09-18T20:57:51.874282] [INFO ] [MAIN ] PACS: Full history saved. [2025-09-18T20:57:51.874411] [INFO ] [MAIN ] Update Progress: 1627/2372 symbols completed. PACS took 37.4s. Estimated remaining: 1h 48m 53s. Rate: 6.8 symbols/min [2025-09-18T20:57:52.049525] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:57:52.081092] [DEBUG] [LOCAL ] PAR: Loaded 32503 existing records from primary storage. [2025-09-18T20:57:52.081240] [INFO ] [MAIN ] PAR: Loaded 32503 existing records. [2025-09-18T20:57:52.264791] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:57:52.265062] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-09-18T20:57:52.265153] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-09-18T20:57:52.265965] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-09-18T20:57:52.266032] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-09-18T20:57:52.524755] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-01. [2025-09-18T20:57:52.625067] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:57:52.838960] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:57:52.839355] [WARN ] [REMOTE ] PAII: No data returned for month 2025-01 [2025-09-18T20:57:53.319563] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-02. [2025-09-18T20:57:53.586549] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:57:53.586933] [WARN ] [REMOTE ] PAII: No data returned for month 2025-02 [2025-09-18T20:57:53.638006] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-18T20:57:54.119538] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-03. [2025-09-18T20:57:54.389804] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:57:54.390171] [WARN ] [REMOTE ] PAII: No data returned for month 2025-03 [2025-09-18T20:57:54.919575] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-04. [2025-09-18T20:57:55.178144] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:57:55.178672] [WARN ] [REMOTE ] PAII: No data returned for month 2025-04 [2025-09-18T20:57:55.719579] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-11. [2025-09-18T20:57:56.519555] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-05. [2025-09-18T20:57:56.785680] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:57:56.785985] [WARN ] [REMOTE ] PAII: No data returned for month 2025-05 [2025-09-18T20:57:57.161384] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-18T20:57:57.319561] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-06. [2025-09-18T20:57:57.608319] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:57:57.608674] [WARN ] [REMOTE ] PAII: No data returned for month 2025-06 [2025-09-18T20:57:58.119602] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-09-18T20:57:58.919566] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-07. [2025-09-18T20:57:59.278443] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:57:59.278797] [WARN ] [REMOTE ] PAII: No data returned for month 2025-07 [2025-09-18T20:57:59.303816] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-18T20:57:59.719546] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-08. [2025-09-18T20:58:00.006422] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T20:58:00.006850] [WARN ] [REMOTE ] PAII: No data returned for month 2025-08 [2025-09-18T20:58:00.519562] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-09-18T20:58:01.319593] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-09-18T20:58:02.078227] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-18T20:58:02.119532] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-09-18T20:58:02.919556] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-09. [2025-09-18T20:58:02.976171] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-18T20:58:03.124111] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-18T20:58:03.221316] [INFO ] [REMOTE ] PAII: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-18T20:58:03.222231] [INFO ] [REMOTE ] PAII: Full fetch complete (49 records). [2025-09-18T20:58:03.222493] [DEBUG] [VALIDATOR ] PAII: Validating primary data. [2025-09-18T20:58:03.412286] [WARN ] [VALIDATOR ] PAII: Validation failed - insufficient historical data. Have 7 unique days, need 200 days [2025-09-18T20:58:03.412503] [FATAL] [MAIN ] PAII: Fetched primary data is invalid. Refusing to save it. [2025-09-18T20:58:03.412570] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to validation failure. [2025-09-18T20:58:03.412631] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-18T20:58:03.412754] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-18T20:58:03.412811] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-09-18T20:58:03.412870] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-09-18T20:58:03.412954] [INFO ] [MAIN ] Update Progress: 1628/2372 symbols completed. PAII took 19.7s. Estimated remaining: 1h 48m 46s. Rate: 6.8 symbols/min [2025-09-18T20:58:03.624295] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:58:03.677547] [DEBUG] [LOCAL ] PARR: Loaded 48445 existing records from primary storage. [2025-09-18T20:58:03.677748] [INFO ] [MAIN ] PARR: Loaded 48445 existing records. [2025-09-18T20:58:03.724726] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-09-18T20:58:03.867958] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:58:03.868196] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-09-18T20:58:03.868246] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-09-18T20:58:03.869614] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-09-18T20:58:03.869712] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-09-18T20:58:04.251056] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:58:04.519596] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-09-18T20:58:05.319585] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-11. [2025-09-18T20:58:05.430767] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-18T20:58:06.119590] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-09-18T20:58:06.421437] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-18T20:58:06.691060] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-18T20:58:06.919554] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-09-18T20:58:07.577814] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-18T20:58:07.719580] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-09-18T20:58:08.077758] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-18T20:58:08.519547] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-09-18T20:58:09.319553] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-09-18T20:58:09.355783] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-18T20:58:10.119543] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-09-18T20:58:10.300904] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-18T20:58:10.309878] [INFO ] [REMOTE ] PAGS: Full fetch complete (76182 records). [2025-09-18T20:58:10.310023] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-09-18T20:58:10.743354] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-09-18T20:58:10.762003] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-09-18T20:58:10.763355] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-09-18T20:58:10.763529] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-09-18T20:58:10.765543] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T20:58:10.773935] [DEBUG] [LOCAL ] PAGS: Trimmed 76182 records to 53067 (keeping 200 days of data) [2025-09-18T20:58:10.947869] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-09-18T20:58:11.096767] [DEBUG] [LOCAL ] PAGS: Primary data saved (53067 records). [2025-09-18T20:58:11.096914] [INFO ] [MAIN ] PAGS: Full history saved. [2025-09-18T20:58:11.097012] [INFO ] [MAIN ] Update Progress: 1629/2372 symbols completed. PAGS took 53.6s. Estimated remaining: 1h 48m 37s. Rate: 6.8 symbols/min [2025-09-18T20:58:11.266600] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:58:11.321372] [DEBUG] [LOCAL ] PATH: Loaded 53678 existing records from primary storage. [2025-09-18T20:58:11.321521] [INFO ] [MAIN ] PATH: Loaded 53678 existing records. [2025-09-18T20:58:11.500189] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:58:11.500599] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-09-18T20:58:11.500718] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-09-18T20:58:11.502612] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-09-18T20:58:11.502697] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-09-18T20:58:11.728450] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-09-18T20:58:11.766519] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-18T20:58:11.903523] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:58:12.448262] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-18T20:58:12.519509] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-09-18T20:58:12.989382] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-18T20:58:13.319589] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-09-18T20:58:13.466692] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-18T20:58:14.119542] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-11. [2025-09-18T20:58:14.566848] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-18T20:58:14.919542] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-09-18T20:58:15.719567] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-09-18T20:58:16.316461] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T20:58:16.356276] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-11 (2.24 seconds). [2025-09-18T20:58:16.519573] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-09-18T20:58:16.813981] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-18T20:58:17.319572] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-09-18T20:58:17.531765] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-18T20:58:18.119559] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-09-18T20:58:18.919553] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-09-18T20:58:19.391774] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-18T20:58:19.675676] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-18T20:58:19.719558] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-09-18T20:58:20.289898] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-18T20:58:20.519602] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-09-18T20:58:21.319595] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-09-18T20:58:21.453038] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-18T20:58:22.126191] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-09-18T20:58:22.133846] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-18T20:58:22.711905] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T20:58:22.919524] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-09-18T20:58:23.152980] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-18T20:58:23.719596] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-09-18T20:58:24.519561] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-09-18T20:58:24.711910] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-18T20:58:24.898123] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-18T20:58:24.904018] [INFO ] [REMOTE ] PAR: Full fetch complete (46817 records). [2025-09-18T20:58:24.904172] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-09-18T20:58:25.285439] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-09-18T20:58:25.285529] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-09-18T20:58:25.286401] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-09-18T20:58:25.286482] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-09-18T20:58:25.287581] [DEBUG] [LOCAL ] PAR: Trimmed 46817 records to 32810 (keeping 200 days of data) [2025-09-18T20:58:25.335495] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-09-18T20:58:25.482423] [DEBUG] [LOCAL ] PAR: Primary data saved (32810 records). [2025-09-18T20:58:25.482564] [INFO ] [MAIN ] PAR: Full history saved. [2025-09-18T20:58:25.482696] [INFO ] [MAIN ] Update Progress: 1630/2372 symbols completed. PAR took 33.6s. Estimated remaining: 1h 48m 31s. Rate: 6.8 symbols/min [2025-09-18T20:58:25.656031] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:58:25.677321] [DEBUG] [LOCAL ] PAXS: Loaded 21137 existing records from primary storage. [2025-09-18T20:58:25.677443] [INFO ] [MAIN ] PAXS: Loaded 21137 existing records. [2025-09-18T20:58:25.856122] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:58:25.856378] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-09-18T20:58:25.856426] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-09-18T20:58:25.857134] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-09-18T20:58:25.857195] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-09-18T20:58:26.129483] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-09-18T20:58:26.219286] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:58:26.707545] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-18T20:58:26.749271] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-18T20:58:26.919516] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-09-18T20:58:27.624189] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T20:58:27.719568] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-09-18T20:58:28.048025] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-18T20:58:28.053490] [INFO ] [REMOTE ] PAM: Full fetch complete (41742 records). [2025-09-18T20:58:28.053598] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-09-18T20:58:28.434773] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-09-18T20:58:28.434857] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-09-18T20:58:28.435709] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-09-18T20:58:28.435773] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-09-18T20:58:28.436787] [DEBUG] [LOCAL ] PAM: Trimmed 41742 records to 27742 (keeping 200 days of data) [2025-09-18T20:58:28.530472] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-09-18T20:58:28.612181] [DEBUG] [LOCAL ] PAM: Primary data saved (27742 records). [2025-09-18T20:58:28.612321] [INFO ] [MAIN ] PAM: Full history saved. [2025-09-18T20:58:28.612406] [INFO ] [MAIN ] Update Progress: 1631/2372 symbols completed. PAM took 40.5s. Estimated remaining: 1h 48m 19s. Rate: 6.8 symbols/min [2025-09-18T20:58:28.802030] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:58:28.847464] [DEBUG] [LOCAL ] PAY: Loaded 38157 existing records from primary storage. [2025-09-18T20:58:28.847638] [INFO ] [MAIN ] PAY: Loaded 38157 existing records. [2025-09-18T20:58:29.034881] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:58:29.035174] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-09-18T20:58:29.035235] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-09-18T20:58:29.036234] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-09-18T20:58:29.036299] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-09-18T20:58:29.324793] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-11. [2025-09-18T20:58:29.436463] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:58:29.462916] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-18T20:58:30.119552] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-09-18T20:58:30.265407] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-18T20:58:30.919576] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-11. [2025-09-18T20:58:31.098291] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-18T20:58:31.605215] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-18T20:58:31.719521] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-09-18T20:58:31.912308] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-18T20:58:32.519549] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-09-18T20:58:33.319549] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-09-18T20:58:33.776773] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-18T20:58:33.833787] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T20:58:34.119595] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-09-18T20:58:34.824723] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-18T20:58:34.919594] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-09-18T20:58:35.719538] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-09-18T20:58:36.205836] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-18T20:58:36.236917] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-18T20:58:36.244024] [INFO ] [REMOTE ] PARR: Full fetch complete (68272 records). [2025-09-18T20:58:36.244201] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-09-18T20:58:36.524734] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-09-18T20:58:36.679755] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-09-18T20:58:36.679844] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-09-18T20:58:36.681285] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-09-18T20:58:36.681390] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-09-18T20:58:36.682842] [DEBUG] [LOCAL ] PARR: Trimmed 68272 records to 48806 (keeping 200 days of data) [2025-09-18T20:58:36.987925] [DEBUG] [LOCAL ] PARR: Primary data saved (48806 records). [2025-09-18T20:58:36.988073] [INFO ] [MAIN ] PARR: Full history saved. [2025-09-18T20:58:36.988230] [INFO ] [MAIN ] Update Progress: 1632/2372 symbols completed. PARR took 33.6s. Estimated remaining: 1h 48m 10s. Rate: 6.8 symbols/min [2025-09-18T20:58:37.162145] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:58:37.203436] [DEBUG] [LOCAL ] PAYC: Loaded 36393 existing records from primary storage. [2025-09-18T20:58:37.203732] [INFO ] [MAIN ] PAYC: Loaded 36393 existing records. [2025-09-18T20:58:37.320768] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-09-18T20:58:37.347065] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-18T20:58:37.442799] [WARN ] [MAIN ] PAYC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:58:37.443046] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-09-18T20:58:37.443094] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-09-18T20:58:37.444088] [DEBUG] [LOCAL ] PAYC: Deleted primary data file. [2025-09-18T20:58:37.444161] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-09-18T20:58:37.823763] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:58:38.119570] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-09-18T20:58:38.625944] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-18T20:58:38.638765] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-18T20:58:38.919552] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-09-18T20:58:39.468236] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T20:58:39.719509] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-11. [2025-09-18T20:58:39.740945] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T20:58:40.519544] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-09-18T20:58:41.045313] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-18T20:58:41.319536] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-09-18T20:58:41.732720] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-18T20:58:42.119542] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-09-18T20:58:42.837677] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-18T20:58:42.919532] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-09-18T20:58:43.719547] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-09-18T20:58:44.343480] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-18T20:58:44.441160] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T20:58:44.519528] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-09-18T20:58:44.550570] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-18T20:58:45.319558] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-09-18T20:58:45.827959] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-18T20:58:46.119541] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-09-18T20:58:46.844382] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T20:58:46.919504] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-09-18T20:58:47.719544] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-09-18T20:58:48.134582] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-18T20:58:48.208276] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-18T20:58:48.519569] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-09-18T20:58:49.080200] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T20:58:49.257774] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-18T20:58:49.319520] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-09-18T20:58:50.119546] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-09-18T20:58:50.919545] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-09-18T20:58:51.315069] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-18T20:58:51.327028] [INFO ] [REMOTE ] PATH: Full fetch complete (77704 records). [2025-09-18T20:58:51.327261] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-09-18T20:58:51.674190] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-18T20:58:51.722550] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-09-18T20:58:51.783788] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-09-18T20:58:51.783880] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-09-18T20:58:51.784988] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-09-18T20:58:51.785063] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-09-18T20:58:51.786585] [DEBUG] [LOCAL ] PATH: Trimmed 77704 records to 54068 (keeping 200 days of data) [2025-09-18T20:58:52.135837] [DEBUG] [LOCAL ] PATH: Primary data saved (54068 records). [2025-09-18T20:58:52.135999] [INFO ] [MAIN ] PATH: Full history saved. [2025-09-18T20:58:52.136158] [INFO ] [MAIN ] Update Progress: 1633/2372 symbols completed. PATH took 41.0s. Estimated remaining: 1h 48m 4s. Rate: 6.8 symbols/min [2025-09-18T20:58:52.307609] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:58:52.353788] [DEBUG] [LOCAL ] PB: Loaded 41348 existing records from primary storage. [2025-09-18T20:58:52.353959] [INFO ] [MAIN ] PB: Loaded 41348 existing records. [2025-09-18T20:58:52.527593] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-09-18T20:58:52.565250] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-18T20:58:52.565538] [WARN ] [MAIN ] PB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:58:52.574732] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-09-18T20:58:52.574818] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-09-18T20:58:52.576231] [DEBUG] [LOCAL ] PB: Deleted primary data file. [2025-09-18T20:58:52.576292] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-09-18T20:58:52.958744] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:58:53.195892] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-18T20:58:53.324638] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-09-18T20:58:53.333622] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-18T20:58:54.119559] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-09-18T20:58:54.919527] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-11. [2025-09-18T20:58:54.944712] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-18T20:58:55.280242] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-18T20:58:55.719561] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-09-18T20:58:56.487747] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-18T20:58:56.519509] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-09-18T20:58:56.858638] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-18T20:58:57.319535] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-09-18T20:58:58.104685] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-18T20:58:58.119483] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-09-18T20:58:58.699320] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-18T20:58:58.919542] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-09-18T20:58:59.647924] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-18T20:58:59.719509] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-09-18T20:59:00.181559] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-18T20:59:00.519560] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-09-18T20:59:01.100917] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-18T20:59:01.106139] [INFO ] [REMOTE ] PAYC: Full fetch complete (52650 records). [2025-09-18T20:59:01.106249] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-09-18T20:59:01.329971] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-09-18T20:59:01.516893] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-09-18T20:59:01.517217] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-09-18T20:59:01.518097] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-09-18T20:59:01.518161] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-09-18T20:59:01.520524] [DEBUG] [LOCAL ] PAYC: Trimmed 52650 records to 36694 (keeping 200 days of data) [2025-09-18T20:59:01.760535] [DEBUG] [LOCAL ] PAYC: Primary data saved (36694 records). [2025-09-18T20:59:01.760824] [INFO ] [MAIN ] PAYC: Full history saved. [2025-09-18T20:59:01.761048] [INFO ] [MAIN ] Update Progress: 1634/2372 symbols completed. PAYC took 24.8s. Estimated remaining: 1h 47m 56s. Rate: 6.8 symbols/min [2025-09-18T20:59:01.965897] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:59:01.990241] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-18T20:59:02.041805] [DEBUG] [LOCAL ] PBA: Loaded 49065 existing records from primary storage. [2025-09-18T20:59:02.042001] [INFO ] [MAIN ] PBA: Loaded 49065 existing records. [2025-09-18T20:59:02.124621] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-09-18T20:59:02.233069] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:59:02.233360] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-09-18T20:59:02.233415] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-09-18T20:59:02.234572] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-09-18T20:59:02.234637] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-09-18T20:59:02.624312] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:59:02.642038] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-18T20:59:02.919567] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-11. [2025-09-18T20:59:03.334965] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-18T20:59:03.719566] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-09-18T20:59:04.519601] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-09-18T20:59:04.714497] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-18T20:59:04.767221] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-18T20:59:05.319557] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-09-18T20:59:05.818109] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T20:59:06.119578] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-09-18T20:59:06.229545] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-18T20:59:06.233435] [INFO ] [REMOTE ] PAXS: Full fetch complete (31580 records). [2025-09-18T20:59:06.233604] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-09-18T20:59:06.782120] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-09-18T20:59:06.782482] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-09-18T20:59:06.783756] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-09-18T20:59:06.783840] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-09-18T20:59:06.785831] [DEBUG] [LOCAL ] PAXS: Trimmed 31580 records to 21314 (keeping 200 days of data) [2025-09-18T20:59:06.919713] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-09-18T20:59:06.962676] [DEBUG] [LOCAL ] PAXS: Primary data saved (21314 records). [2025-09-18T20:59:06.963022] [INFO ] [MAIN ] PAXS: Full history saved. [2025-09-18T20:59:06.963137] [INFO ] [MAIN ] Update Progress: 1635/2372 symbols completed. PAXS took 41.5s. Estimated remaining: 1h 47m 46s. Rate: 6.8 symbols/min [2025-09-18T20:59:07.141668] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:59:07.199635] [DEBUG] [LOCAL ] PBF: Loaded 53095 existing records from primary storage. [2025-09-18T20:59:07.199813] [INFO ] [MAIN ] PBF: Loaded 53095 existing records. [2025-09-18T20:59:07.377734] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:59:07.378060] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-09-18T20:59:07.378109] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-09-18T20:59:07.379799] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-09-18T20:59:07.379864] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-09-18T20:59:07.724789] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-09-18T20:59:07.762731] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:59:07.787688] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-18T20:59:08.519532] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-11. [2025-09-18T20:59:08.729265] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-18T20:59:09.011360] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-18T20:59:09.017111] [INFO ] [REMOTE ] PAY: Full fetch complete (52937 records). [2025-09-18T20:59:09.017204] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-09-18T20:59:09.324765] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-09-18T20:59:09.406248] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-09-18T20:59:09.406331] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-09-18T20:59:09.407387] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-09-18T20:59:09.407451] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-09-18T20:59:09.408559] [DEBUG] [LOCAL ] PAY: Trimmed 52937 records to 38465 (keeping 200 days of data) [2025-09-18T20:59:09.641489] [DEBUG] [LOCAL ] PAY: Primary data saved (38465 records). [2025-09-18T20:59:09.641627] [INFO ] [MAIN ] PAY: Full history saved. [2025-09-18T20:59:09.641768] [INFO ] [MAIN ] Update Progress: 1636/2372 symbols completed. PAY took 41.0s. Estimated remaining: 1h 47m 34s. Rate: 6.8 symbols/min [2025-09-18T20:59:09.810509] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:59:09.846294] [DEBUG] [LOCAL ] PBH: Loaded 31378 existing records from primary storage. [2025-09-18T20:59:09.846454] [INFO ] [MAIN ] PBH: Loaded 31378 existing records. [2025-09-18T20:59:10.030669] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:59:10.031038] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-09-18T20:59:10.031131] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-09-18T20:59:10.032215] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-09-18T20:59:10.032280] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-09-18T20:59:10.124276] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-09-18T20:59:10.312841] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-18T20:59:10.439547] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:59:10.919575] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-09-18T20:59:11.087866] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-18T20:59:11.361392] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-18T20:59:11.719587] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-09-18T20:59:12.519563] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-11. [2025-09-18T20:59:12.566568] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-18T20:59:13.290309] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-18T20:59:13.319545] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-09-18T20:59:13.752108] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-18T20:59:14.119565] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-09-18T20:59:14.759828] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-18T20:59:14.863256] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-18T20:59:14.919549] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-09-18T20:59:15.719567] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-09-18T20:59:16.241519] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-18T20:59:16.519577] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-09-18T20:59:17.319833] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-09-18T20:59:17.322982] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-18T20:59:18.117125] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-18T20:59:18.126278] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-09-18T20:59:18.268063] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-18T20:59:18.919577] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-09-18T20:59:19.502337] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T20:59:19.719545] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-09-18T20:59:19.924792] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-18T20:59:20.519544] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-09-18T20:59:21.319560] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-09-18T20:59:21.597159] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-18T20:59:21.668909] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-18T20:59:22.119566] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-09-18T20:59:22.787110] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-18T20:59:22.919523] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-09-18T20:59:23.390172] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-18T20:59:23.719562] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-09-18T20:59:24.525463] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-09-18T20:59:24.545427] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-18T20:59:25.319597] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-09-18T20:59:25.426777] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-18T20:59:25.491715] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-18T20:59:26.119600] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-09-18T20:59:26.919523] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-09-18T20:59:27.048398] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-18T20:59:27.360340] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T20:59:27.719584] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-09-18T20:59:28.031295] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-18T20:59:28.519558] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-09-18T20:59:29.319518] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-09-18T20:59:29.570465] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-18T20:59:29.951334] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-18T20:59:29.957875] [INFO ] [REMOTE ] PB: Full fetch complete (57454 records). [2025-09-18T20:59:29.958003] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-09-18T20:59:30.135718] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-09-18T20:59:30.369881] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-09-18T20:59:30.370005] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-09-18T20:59:30.370909] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-09-18T20:59:30.370985] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-09-18T20:59:30.372243] [DEBUG] [LOCAL ] PB: Trimmed 57454 records to 41696 (keeping 200 days of data) [2025-09-18T20:59:30.637445] [DEBUG] [LOCAL ] PB: Primary data saved (41696 records). [2025-09-18T20:59:30.637576] [INFO ] [MAIN ] PB: Full history saved. [2025-09-18T20:59:30.637675] [INFO ] [MAIN ] Update Progress: 1637/2372 symbols completed. PB took 38.5s. Estimated remaining: 1h 47m 31s. Rate: 6.8 symbols/min [2025-09-18T20:59:30.774484] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T20:59:30.919525] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-09-18T20:59:31.719571] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-09-18T20:59:31.883889] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-18T20:59:32.519611] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-09-18T20:59:32.729970] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-18T20:59:32.802048] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-18T20:59:33.319533] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-09-18T20:59:34.119577] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-09-18T20:59:34.275802] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-18T20:59:34.665846] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-18T20:59:34.671418] [INFO ] [REMOTE ] PBH: Full fetch complete (42437 records). [2025-09-18T20:59:34.671519] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-09-18T20:59:34.933536] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-09-18T20:59:35.076602] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-09-18T20:59:35.076725] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-09-18T20:59:35.077473] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-09-18T20:59:35.077517] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-09-18T20:59:35.078555] [DEBUG] [LOCAL ] PBH: Trimmed 42437 records to 31667 (keeping 200 days of data) [2025-09-18T20:59:35.264769] [DEBUG] [LOCAL ] PBH: Primary data saved (31667 records). [2025-09-18T20:59:35.264909] [INFO ] [MAIN ] PBH: Full history saved. [2025-09-18T20:59:35.264995] [INFO ] [MAIN ] Update Progress: 1638/2372 symbols completed. PBH took 25.6s. Estimated remaining: 1h 47m 20s. Rate: 6.8 symbols/min [2025-09-18T20:59:35.712478] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-18T20:59:35.723351] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-09-18T20:59:36.849687] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-18T20:59:36.861546] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-09-18T20:59:37.310554] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T20:59:37.321734] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-09-18T20:59:38.347280] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T20:59:38.354998] [INFO ] [REMOTE ] PBF: Full fetch complete (76380 records). [2025-09-18T20:59:38.355185] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-09-18T20:59:38.809458] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-09-18T20:59:38.810295] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-09-18T20:59:38.812732] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-09-18T20:59:38.811134] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T20:59:38.812925] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-09-18T20:59:38.820484] [INFO ] [REMOTE ] PBA: Full fetch complete (71394 records). [2025-09-18T20:59:38.821139] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-09-18T20:59:38.877153] [DEBUG] [LOCAL ] PBF: Trimmed 76380 records to 53482 (keeping 200 days of data) [2025-09-18T20:59:39.530970] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-09-18T20:59:39.531157] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-09-18T20:59:39.532503] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-09-18T20:59:39.566752] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-09-18T20:59:39.610585] [DEBUG] [LOCAL ] PBA: Trimmed 71394 records to 49392 (keeping 200 days of data) [2025-09-18T20:59:39.717628] [DEBUG] [LOCAL ] PBF: Primary data saved (53482 records). [2025-09-18T20:59:39.718472] [INFO ] [MAIN ] PBF: Full history saved. [2025-09-18T20:59:39.719169] [INFO ] [MAIN ] Update Progress: 1639/2372 symbols completed. PBF took 32.8s. Estimated remaining: 1h 47m 9s. Rate: 6.8 symbols/min [2025-09-18T20:59:39.929224] [DEBUG] [LOCAL ] PBA: Primary data saved (49392 records). [2025-09-18T20:59:39.929373] [INFO ] [MAIN ] PBA: Full history saved. [2025-09-18T20:59:39.929478] [INFO ] [MAIN ] Update Progress: 1640/2372 symbols completed. PBA took 38.2s. Estimated remaining: 1h 46m 57s. Rate: 6.8 symbols/min [2025-09-18T20:59:40.601621] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:59:40.559487] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:59:40.633159] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:59:40.705988] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T20:59:40.735403] [DEBUG] [LOCAL ] PCF: Loaded 8754 existing records from primary storage. [2025-09-18T20:59:40.735830] [DEBUG] [LOCAL ] PBT: Loaded 17633 existing records from primary storage. [2025-09-18T20:59:40.735962] [INFO ] [MAIN ] PBT: Loaded 17633 existing records. [2025-09-18T20:59:40.736097] [INFO ] [MAIN ] PCF: Loaded 8754 existing records. [2025-09-18T20:59:41.105832] [DEBUG] [LOCAL ] PBR: Loaded 53715 existing records from primary storage. [2025-09-18T20:59:41.152406] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:59:41.168503] [INFO ] [MAIN ] PBR: Loaded 53715 existing records. [2025-09-18T20:59:41.193428] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-09-18T20:59:41.205488] [DEBUG] [LOCAL ] PBI: Loaded 50118 existing records from primary storage. [2025-09-18T20:59:41.229202] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:59:41.245755] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-09-18T20:59:41.258138] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-09-18T20:59:41.251356] [INFO ] [MAIN ] PBI: Loaded 50118 existing records. [2025-09-18T20:59:41.272784] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-09-18T20:59:41.318875] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-09-18T20:59:41.402104] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-09-18T20:59:41.504197] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-09-18T20:59:41.556992] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-09-18T20:59:41.759158] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:59:41.817427] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-09-18T20:59:41.851475] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-09-18T20:59:41.962350] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-09-18T20:59:41.962746] [WARN ] [MAIN ] PBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T20:59:41.975527] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-09-18T20:59:42.013677] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-09-18T20:59:42.126353] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-09-18T20:59:42.234201] [DEBUG] [LOCAL ] PBI: Deleted primary data file. [2025-09-18T20:59:42.270974] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-09-18T20:59:42.764837] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:59:42.831714] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-11. [2025-09-18T20:59:42.890143] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:59:42.958017] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-11. [2025-09-18T20:59:43.255940] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:59:43.261544] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-11. [2025-09-18T20:59:43.297674] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T20:59:43.297995] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-11. [2025-09-18T20:59:43.772313] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-18T20:59:43.775515] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-09-18T20:59:43.847319] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-18T20:59:43.852093] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-09-18T20:59:44.615605] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T20:59:44.620043] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-09-18T20:59:44.696378] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T20:59:44.701109] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-09-18T20:59:44.911960] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-18T20:59:44.921785] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-09-18T20:59:45.115300] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-18T20:59:45.319581] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-09-18T20:59:45.519455] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-18T20:59:45.607133] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-18T20:59:46.119561] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-09-18T20:59:46.640582] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-18T20:59:46.919575] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-09-18T20:59:47.046399] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-18T20:59:47.269687] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-18T20:59:47.719628] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-09-18T20:59:48.402905] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-18T20:59:48.430748] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T20:59:48.519492] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-09-18T20:59:49.319608] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-09-18T20:59:49.958036] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-18T20:59:50.119497] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-09-18T20:59:50.155673] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-18T20:59:50.919601] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-09-18T20:59:51.059427] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-18T20:59:51.719578] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-09-18T20:59:52.411235] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-18T20:59:52.519541] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-09-18T20:59:52.723613] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-18T20:59:53.319538] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-09-18T20:59:53.420882] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-18T20:59:54.119559] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-09-18T20:59:54.919548] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-09-18T20:59:55.281746] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-18T20:59:55.719604] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-09-18T20:59:55.748722] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-18T20:59:56.004900] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-18T20:59:56.519545] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-09-18T20:59:57.167241] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-18T20:59:57.319610] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-09-18T20:59:57.554095] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-18T20:59:57.819578] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-18T20:59:58.119599] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-09-18T20:59:58.919604] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-09-18T20:59:59.719541] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-09-18T20:59:59.950696] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-18T20:59:59.952977] [INFO ] [REMOTE ] PCF: Full fetch complete (14488 records). [2025-09-18T20:59:59.953166] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-09-18T21:00:00.362836] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-09-18T21:00:00.362952] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-09-18T21:00:00.363455] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-09-18T21:00:00.363534] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-09-18T21:00:00.394678] [DEBUG] [LOCAL ] PCF: Trimmed 14488 records to 8788 (keeping 200 days of data) [2025-09-18T21:00:00.402067] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-18T21:00:00.470083] [DEBUG] [LOCAL ] PCF: Primary data saved (8788 records). [2025-09-18T21:00:00.470247] [INFO ] [MAIN ] PCF: Full history saved. [2025-09-18T21:00:00.470340] [INFO ] [MAIN ] Update Progress: 1641/2372 symbols completed. PCF took 20.5s. Estimated remaining: 1h 46m 53s. Rate: 6.8 symbols/min [2025-09-18T21:00:00.531615] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-09-18T21:00:00.656438] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:00:00.656688] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-09-18T21:00:00.656745] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-09-18T21:00:00.656892] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-09-18T21:00:00.656956] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-18T21:00:00.657001] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-09-18T21:00:00.657035] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-09-18T21:00:01.014602] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:00:01.319558] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-11. [2025-09-18T21:00:02.119698] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-09-18T21:00:02.338564] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-18T21:00:02.795083] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (3.08 seconds). [2025-09-18T21:00:02.919553] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-09-18T21:00:03.651219] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-11 (2.33 seconds). [2025-09-18T21:00:03.719521] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-09-18T21:00:04.519696] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-09-18T21:00:05.633221] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-18T21:00:05.638512] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-09-18T21:00:05.807678] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (3.69 seconds). [2025-09-18T21:00:06.119553] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-09-18T21:00:06.487999] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-18T21:00:06.733560] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (3.01 seconds). [2025-09-18T21:00:06.919556] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-09-18T21:00:07.565946] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (3.05 seconds). [2025-09-18T21:00:07.719524] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-09-18T21:00:08.094323] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-18T21:00:08.148048] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-18T21:00:08.519554] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-09-18T21:00:09.319550] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-09-18T21:00:09.652862] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-18T21:00:10.119558] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-09-18T21:00:10.369132] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-18T21:00:10.532255] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-18T21:00:10.919541] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-09-18T21:00:11.719553] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-09-18T21:00:12.095659] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-18T21:00:12.519621] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-09-18T21:00:12.790716] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-18T21:00:13.319547] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-09-18T21:00:13.718043] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-18T21:00:13.721435] [INFO ] [REMOTE ] PBT: Full fetch complete (25319 records). [2025-09-18T21:00:13.721526] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-09-18T21:00:14.100710] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-09-18T21:00:14.100811] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-09-18T21:00:14.101345] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-09-18T21:00:14.101398] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-09-18T21:00:14.102238] [DEBUG] [LOCAL ] PBT: Trimmed 25319 records to 17706 (keeping 200 days of data) [2025-09-18T21:00:14.148036] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-09-18T21:00:14.215594] [DEBUG] [LOCAL ] PBT: Primary data saved (17706 records). [2025-09-18T21:00:14.215769] [INFO ] [MAIN ] PBT: Full history saved. [2025-09-18T21:00:14.215862] [INFO ] [MAIN ] Update Progress: 1642/2372 symbols completed. PBT took 34.3s. Estimated remaining: 1h 46m 47s. Rate: 6.8 symbols/min [2025-09-18T21:00:14.388076] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:00:14.398007] [DEBUG] [LOCAL ] PCM: Loaded 6807 existing records from primary storage. [2025-09-18T21:00:14.398133] [INFO ] [MAIN ] PCM: Loaded 6807 existing records. [2025-09-18T21:00:14.575837] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:00:14.576153] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-09-18T21:00:14.576224] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-09-18T21:00:14.576638] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-09-18T21:00:14.576723] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-09-18T21:00:14.946831] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:00:14.947374] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-11. [2025-09-18T21:00:15.035191] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (3.32 seconds). [2025-09-18T21:00:15.719717] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-09-18T21:00:15.917292] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-18T21:00:15.933638] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-18T21:00:16.519562] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-09-18T21:00:17.226993] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-18T21:00:17.324914] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-09-18T21:00:17.343238] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (3.20 seconds). [2025-09-18T21:00:17.570593] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-18T21:00:18.119552] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-09-18T21:00:18.919559] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-09-18T21:00:19.038000] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-18T21:00:19.054094] [INFO ] [REMOTE ] PBI: Full fetch complete (71773 records). [2025-09-18T21:00:19.054326] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-09-18T21:00:19.055514] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-18T21:00:19.518424] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-09-18T21:00:19.518540] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-09-18T21:00:19.519622] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-09-18T21:00:19.519724] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-09-18T21:00:19.522341] [DEBUG] [LOCAL ] PBI: Trimmed 71773 records to 50493 (keeping 200 days of data) [2025-09-18T21:00:19.731191] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-09-18T21:00:19.832974] [DEBUG] [LOCAL ] PBI: Primary data saved (50493 records). [2025-09-18T21:00:19.833145] [INFO ] [MAIN ] PBI: Full history saved. [2025-09-18T21:00:19.833261] [INFO ] [MAIN ] Update Progress: 1643/2372 symbols completed. PBI took 39.9s. Estimated remaining: 1h 46m 37s. Rate: 6.8 symbols/min [2025-09-18T21:00:20.012591] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:00:20.036742] [DEBUG] [LOCAL ] PCN: Loaded 24190 existing records from primary storage. [2025-09-18T21:00:20.036927] [INFO ] [MAIN ] PCN: Loaded 24190 existing records. [2025-09-18T21:00:20.227374] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:00:20.227731] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-09-18T21:00:20.227791] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-09-18T21:00:20.228712] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-09-18T21:00:20.228776] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-09-18T21:00:20.524785] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-09-18T21:00:20.598488] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:00:20.739039] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-18T21:00:21.188455] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-18T21:00:21.319533] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-11. [2025-09-18T21:00:21.453117] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-18T21:00:21.461638] [INFO ] [REMOTE ] PBR: Full fetch complete (77702 records). [2025-09-18T21:00:21.461824] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-09-18T21:00:21.929942] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-09-18T21:00:21.930032] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-09-18T21:00:21.931078] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-09-18T21:00:21.931146] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-09-18T21:00:21.933115] [DEBUG] [LOCAL ] PBR: Trimmed 77702 records to 54104 (keeping 200 days of data) [2025-09-18T21:00:22.123711] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-09-18T21:00:22.262856] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-18T21:00:22.292577] [DEBUG] [LOCAL ] PBR: Primary data saved (54104 records). [2025-09-18T21:00:22.292759] [INFO ] [MAIN ] PBR: Full history saved. [2025-09-18T21:00:22.292862] [INFO ] [MAIN ] Update Progress: 1644/2372 symbols completed. PBR took 42.4s. Estimated remaining: 1h 46m 25s. Rate: 6.8 symbols/min [2025-09-18T21:00:22.459659] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:00:22.503863] [DEBUG] [LOCAL ] PCOR: Loaded 48134 existing records from primary storage. [2025-09-18T21:00:22.504020] [INFO ] [MAIN ] PCOR: Loaded 48134 existing records. [2025-09-18T21:00:22.679089] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:00:22.679332] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-09-18T21:00:22.679389] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-09-18T21:00:22.680710] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-09-18T21:00:22.680772] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-09-18T21:00:22.923667] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-09-18T21:00:22.984350] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-18T21:00:23.043190] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:00:23.719597] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-09-18T21:00:24.097981] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-18T21:00:24.519617] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-11. [2025-09-18T21:00:25.319549] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-09-18T21:00:25.513039] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-18T21:00:25.966680] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-18T21:00:25.984562] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-18T21:00:26.119572] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-09-18T21:00:26.919582] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-09-18T21:00:27.719603] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-09-18T21:00:27.895421] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-18T21:00:28.519565] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-09-18T21:00:28.826160] [DEBUG] [REMOTE ] PCN: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-18T21:00:28.826553] [WARN ] [REMOTE ] PCN: No data returned for month 2025-02 [2025-09-18T21:00:29.319505] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-09-18T21:00:29.825780] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (2.91 seconds). [2025-09-18T21:00:29.954875] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-18T21:00:30.119508] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-09-18T21:00:30.173537] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-18T21:00:30.919550] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-09-18T21:00:31.719616] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-09-18T21:00:31.920427] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-18T21:00:31.955487] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-18T21:00:32.428500] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-18T21:00:32.519562] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-09-18T21:00:33.147092] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-18T21:00:33.319573] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-09-18T21:00:34.060271] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-18T21:00:34.119531] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-09-18T21:00:34.806177] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-18T21:00:34.919549] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-09-18T21:00:35.714717] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-18T21:00:35.717051] [INFO ] [REMOTE ] PCM: Full fetch complete (10431 records). [2025-09-18T21:00:35.717143] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-09-18T21:00:35.728279] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-09-18T21:00:36.106294] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-09-18T21:00:36.106403] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-09-18T21:00:36.106767] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-09-18T21:00:36.106851] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-09-18T21:00:36.107353] [DEBUG] [LOCAL ] PCM: Trimmed 10431 records to 6869 (keeping 200 days of data) [2025-09-18T21:00:36.149179] [DEBUG] [LOCAL ] PCM: Primary data saved (6869 records). [2025-09-18T21:00:36.149357] [INFO ] [MAIN ] PCM: Full history saved. [2025-09-18T21:00:36.149478] [INFO ] [MAIN ] Update Progress: 1645/2372 symbols completed. PCM took 21.9s. Estimated remaining: 1h 46m 18s. Rate: 6.8 symbols/min [2025-09-18T21:00:36.331397] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:00:36.344940] [DEBUG] [LOCAL ] PCQ: Loaded 12132 existing records from primary storage. [2025-09-18T21:00:36.345109] [INFO ] [MAIN ] PCQ: Loaded 12132 existing records. [2025-09-18T21:00:36.528517] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:00:36.524634] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-09-18T21:00:36.530592] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-09-18T21:00:36.530691] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-09-18T21:00:36.531226] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-09-18T21:00:36.531287] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-09-18T21:00:36.895531] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:00:36.912191] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-18T21:00:37.319556] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-09-18T21:00:38.119571] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-11. [2025-09-18T21:00:38.286948] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-18T21:00:38.345308] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-18T21:00:38.690515] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-18T21:00:38.919590] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-09-18T21:00:39.719611] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-09-18T21:00:40.241298] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T21:00:40.519555] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-09-18T21:00:41.100185] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T21:00:41.319570] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-09-18T21:00:41.779742] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-18T21:00:42.119542] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-09-18T21:00:42.820272] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-18T21:00:42.919588] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-09-18T21:00:43.413614] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-18T21:00:43.719552] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-09-18T21:00:43.742349] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T21:00:44.519540] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-09-18T21:00:44.935511] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-18T21:00:44.940093] [INFO ] [REMOTE ] PCN: Full fetch complete (30722 records). [2025-09-18T21:00:44.940235] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-09-18T21:00:45.133944] [WARN ] [VALIDATOR ] PCN: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-18T21:00:45.134432] [FATAL] [MAIN ] PCN: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:00:45.134542] [WARN ] [MAIN ] PCN: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:00:45.134705] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-09-18T21:00:45.134832] [DEBUG] [LOCAL ] PCN: No primary data file found to delete. [2025-09-18T21:00:45.134890] [INFO ] [LOCAL ] PCN: Starting deletion of derivative data. [2025-09-18T21:00:45.135368] [DEBUG] [LOCAL ] PCN: Deleted derivative data file. [2025-09-18T21:00:45.135546] [INFO ] [MAIN ] Update Progress: 1646/2372 symbols completed. PCN took 25.3s. Estimated remaining: 1h 46m 10s. Rate: 6.8 symbols/min [2025-09-18T21:00:45.316672] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:00:45.319543] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-09-18T21:00:45.372350] [DEBUG] [LOCAL ] PD: Loaded 47739 existing records from primary storage. [2025-09-18T21:00:45.372540] [INFO ] [MAIN ] PD: Loaded 47739 existing records. [2025-09-18T21:00:45.560214] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:00:45.560486] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-09-18T21:00:45.560545] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-09-18T21:00:45.561905] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-09-18T21:00:45.561968] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-09-18T21:00:45.930895] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:00:45.959495] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-18T21:00:45.970726] [INFO ] [REMOTE ] PCG: Full fetch complete (77191 records). [2025-09-18T21:00:45.970945] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-09-18T21:00:45.972475] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T21:00:45.972619] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:00:45.972724] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:00:45.972816] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-18T21:00:45.972928] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-09-18T21:00:45.972988] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-09-18T21:00:45.973036] [DEBUG] [LOCAL ] PCG: No derivative data file found to delete. [2025-09-18T21:00:45.973159] [INFO ] [MAIN ] Update Progress: 1647/2372 symbols completed. PCG took 45.5s. Estimated remaining: 1h 45m 58s. Rate: 6.8 symbols/min [2025-09-18T21:00:46.123289] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-11. [2025-09-18T21:00:46.161153] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:00:46.161673] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-09-18T21:00:46.161783] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-09-18T21:00:46.162060] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-09-18T21:00:46.162468] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-18T21:00:46.162565] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-18T21:00:46.162802] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-09-18T21:00:46.279995] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-18T21:00:46.600428] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:00:46.919582] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-09-18T21:00:47.719578] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-09-18T21:00:47.773321] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-18T21:00:47.959720] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-18T21:00:48.519559] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-09-18T21:00:49.319514] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-11. [2025-09-18T21:00:49.377021] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T21:00:49.395234] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-18T21:00:49.683168] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-11 (0.36 seconds). [2025-09-18T21:00:50.119547] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-09-18T21:00:50.391254] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-09-18T21:00:50.919586] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-09-18T21:00:51.227283] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-18T21:00:51.719604] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-09-18T21:00:52.282494] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-18T21:00:52.519623] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-09-18T21:00:53.319540] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-09-18T21:00:53.881009] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T21:00:54.119712] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-09-18T21:00:54.409957] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-18T21:00:54.919585] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-09-18T21:00:55.397522] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-18T21:00:55.571671] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T21:00:55.719538] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-09-18T21:00:56.519548] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-09-18T21:00:57.315894] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-18T21:00:57.319504] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-09-18T21:00:57.350270] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-18T21:00:57.840267] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-18T21:00:58.119542] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-09-18T21:00:58.919567] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-09-18T21:00:59.612635] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-18T21:00:59.638881] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T21:00:59.719560] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-09-18T21:01:00.076522] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-18T21:01:00.519552] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-09-18T21:01:00.912058] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-18T21:01:01.319564] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-09-18T21:01:02.119553] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-09-18T21:01:02.919548] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-09-18T21:01:03.054559] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-18T21:01:03.088898] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-18T21:01:03.305328] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-18T21:01:03.719541] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-09-18T21:01:04.121814] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-18T21:01:04.519602] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-18T21:01:04.873165] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-18T21:01:04.873918] [INFO ] [REMOTE ] PDCC: Full fetch complete (1319 records). [2025-09-18T21:01:04.873988] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-09-18T21:01:05.055944] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 186 unique days, need 200 days [2025-09-18T21:01:05.056168] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:01:05.056253] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:01:05.056342] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-18T21:01:05.056443] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-18T21:01:05.056523] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-09-18T21:01:05.056631] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-09-18T21:01:05.056799] [INFO ] [MAIN ] Update Progress: 1648/2372 symbols completed. PDCC took 19.1s. Estimated remaining: 1h 45m 53s. Rate: 6.8 symbols/min [2025-09-18T21:01:05.240219] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:01:05.309391] [DEBUG] [LOCAL ] PDI: Loaded 50272 existing records from primary storage. [2025-09-18T21:01:05.309594] [INFO ] [MAIN ] PDI: Loaded 50272 existing records. [2025-09-18T21:01:05.324672] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-09-18T21:01:05.493639] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:01:05.493942] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-09-18T21:01:05.494018] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-09-18T21:01:05.495341] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-09-18T21:01:05.495402] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-09-18T21:01:05.850264] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:01:06.119532] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-09-18T21:01:06.266619] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-18T21:01:06.919552] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-11. [2025-09-18T21:01:07.719551] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-09-18T21:01:07.903562] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-18T21:01:08.519562] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-09-18T21:01:08.607041] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-18T21:01:09.099890] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T21:01:09.319548] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-09-18T21:01:09.676058] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-18T21:01:09.683978] [INFO ] [REMOTE ] PCOR: Full fetch complete (69590 records). [2025-09-18T21:01:09.684143] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-09-18T21:01:10.084388] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-09-18T21:01:10.084470] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-09-18T21:01:10.085462] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-09-18T21:01:10.085551] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-09-18T21:01:10.086959] [DEBUG] [LOCAL ] PCOR: Trimmed 69590 records to 48499 (keeping 200 days of data) [2025-09-18T21:01:10.148306] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-09-18T21:01:10.392137] [DEBUG] [LOCAL ] PCOR: Primary data saved (48499 records). [2025-09-18T21:01:10.392277] [INFO ] [MAIN ] PCOR: Full history saved. [2025-09-18T21:01:10.392401] [INFO ] [MAIN ] Update Progress: 1649/2372 symbols completed. PCOR took 48.1s. Estimated remaining: 1h 45m 43s. Rate: 6.8 symbols/min [2025-09-18T21:01:10.562563] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:01:10.601453] [DEBUG] [LOCAL ] PDM: Loaded 39895 existing records from primary storage. [2025-09-18T21:01:10.601603] [INFO ] [MAIN ] PDM: Loaded 39895 existing records. [2025-09-18T21:01:10.780707] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:01:10.780994] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-09-18T21:01:10.781042] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-09-18T21:01:10.781974] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-09-18T21:01:10.782035] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-09-18T21:01:10.928868] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-09-18T21:01:11.090915] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-18T21:01:11.105850] [INFO ] [REMOTE ] PCQ: Full fetch complete (17461 records). [2025-09-18T21:01:11.133453] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-09-18T21:01:11.177949] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:01:11.508669] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-18T21:01:11.600028] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-09-18T21:01:11.600115] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-09-18T21:01:11.600482] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-09-18T21:01:11.600520] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-09-18T21:01:11.601292] [DEBUG] [LOCAL ] PCQ: Trimmed 17461 records to 12179 (keeping 200 days of data) [2025-09-18T21:01:11.683924] [DEBUG] [LOCAL ] PCQ: Primary data saved (12179 records). [2025-09-18T21:01:11.684063] [INFO ] [MAIN ] PCQ: Full history saved. [2025-09-18T21:01:11.684211] [INFO ] [MAIN ] Update Progress: 1650/2372 symbols completed. PCQ took 35.5s. Estimated remaining: 1h 45m 31s. Rate: 6.8 symbols/min [2025-09-18T21:01:11.726815] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-09-18T21:01:11.858591] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:01:11.904940] [DEBUG] [LOCAL ] PDO: Loaded 31940 existing records from primary storage. [2025-09-18T21:01:11.905084] [INFO ] [MAIN ] PDO: Loaded 31940 existing records. [2025-09-18T21:01:12.080933] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:01:12.081307] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-09-18T21:01:12.081396] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-09-18T21:01:12.082603] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-09-18T21:01:12.082719] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-09-18T21:01:12.462989] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:01:12.519515] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-11. [2025-09-18T21:01:12.781505] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-18T21:01:13.319597] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-11. [2025-09-18T21:01:13.514528] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-18T21:01:13.627244] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-18T21:01:14.119576] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-09-18T21:01:14.726241] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-18T21:01:14.919577] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-09-18T21:01:15.719562] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-09-18T21:01:15.902532] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-18T21:01:16.487353] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-18T21:01:16.519508] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-09-18T21:01:16.936431] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-18T21:01:17.319598] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-09-18T21:01:17.656952] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-18T21:01:18.119603] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-09-18T21:01:18.919547] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-09-18T21:01:18.954993] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-18T21:01:19.701843] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T21:01:19.719494] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-09-18T21:01:19.970618] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-18T21:01:20.519608] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-09-18T21:01:21.319582] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-09-18T21:01:21.601244] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-18T21:01:22.000974] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T21:01:22.119552] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-09-18T21:01:22.919539] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-09-18T21:01:22.970100] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-18T21:01:23.586842] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-18T21:01:23.719617] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-09-18T21:01:24.208330] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-18T21:01:24.519638] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-09-18T21:01:25.319583] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-09-18T21:01:25.768353] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-18T21:01:25.961624] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-18T21:01:26.119576] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-09-18T21:01:26.372778] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-18T21:01:26.919595] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-09-18T21:01:27.719547] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-09-18T21:01:28.139066] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-18T21:01:28.512427] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-18T21:01:28.521569] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-09-18T21:01:28.524744] [INFO ] [REMOTE ] PD: Full fetch complete (67278 records). [2025-09-18T21:01:28.524862] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-09-18T21:01:28.929467] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-09-18T21:01:28.929718] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-09-18T21:01:28.930787] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-09-18T21:01:28.930896] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-09-18T21:01:28.940258] [DEBUG] [LOCAL ] PD: Trimmed 67278 records to 48098 (keeping 200 days of data) [2025-09-18T21:01:28.956995] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T21:01:29.255053] [DEBUG] [LOCAL ] PD: Primary data saved (48098 records). [2025-09-18T21:01:29.255209] [INFO ] [MAIN ] PD: Full history saved. [2025-09-18T21:01:29.255300] [INFO ] [MAIN ] Update Progress: 1651/2372 symbols completed. PD took 44.1s. Estimated remaining: 1h 45m 26s. Rate: 6.8 symbols/min [2025-09-18T21:01:29.324688] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-09-18T21:01:29.432216] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:01:29.451573] [DEBUG] [LOCAL ] PDS: Loaded 18741 existing records from primary storage. [2025-09-18T21:01:29.451732] [INFO ] [MAIN ] PDS: Loaded 18741 existing records. [2025-09-18T21:01:29.637248] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:01:29.637628] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-09-18T21:01:29.637714] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-09-18T21:01:29.638391] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-09-18T21:01:29.638453] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-09-18T21:01:30.007970] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:01:30.121007] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-11. [2025-09-18T21:01:30.127114] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-18T21:01:30.828284] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-18T21:01:30.919518] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-09-18T21:01:31.259673] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-18T21:01:31.719591] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-09-18T21:01:32.348366] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-18T21:01:32.519552] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-09-18T21:01:32.544727] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-18T21:01:33.319559] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-09-18T21:01:34.043318] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-18T21:01:34.119512] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-09-18T21:01:34.921150] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-09-18T21:01:34.927019] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-18T21:01:35.466249] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-18T21:01:35.719543] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-09-18T21:01:36.025444] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-18T21:01:36.519565] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-09-18T21:01:37.319507] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-09-18T21:01:37.484164] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-18T21:01:37.523097] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-18T21:01:38.119559] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-09-18T21:01:38.401260] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-18T21:01:38.919570] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-09-18T21:01:39.719577] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-09-18T21:01:39.880107] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-18T21:01:39.913345] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-18T21:01:40.519599] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-09-18T21:01:40.738824] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-18T21:01:41.319549] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-09-18T21:01:42.119623] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-09-18T21:01:42.399523] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-18T21:01:42.407894] [INFO ] [REMOTE ] PDI: Full fetch complete (72988 records). [2025-09-18T21:01:42.408116] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-09-18T21:01:42.822146] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-18T21:01:42.888763] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-09-18T21:01:42.888857] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-09-18T21:01:42.889839] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-09-18T21:01:42.889905] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-09-18T21:01:42.893701] [DEBUG] [LOCAL ] PDI: Trimmed 72988 records to 50645 (keeping 200 days of data) [2025-09-18T21:01:42.955047] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-09-18T21:01:43.229490] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-18T21:01:43.245761] [DEBUG] [LOCAL ] PDI: Primary data saved (50645 records). [2025-09-18T21:01:43.245875] [INFO ] [MAIN ] PDI: Full history saved. [2025-09-18T21:01:43.245965] [INFO ] [MAIN ] Update Progress: 1652/2372 symbols completed. PDI took 38.2s. Estimated remaining: 1h 45m 20s. Rate: 6.8 symbols/min [2025-09-18T21:01:43.435411] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:01:43.454902] [DEBUG] [LOCAL ] PDT: Loaded 17595 existing records from primary storage. [2025-09-18T21:01:43.455055] [INFO ] [MAIN ] PDT: Loaded 17595 existing records. [2025-09-18T21:01:43.654020] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:01:43.654350] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-09-18T21:01:43.654413] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-09-18T21:01:43.655041] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-09-18T21:01:43.655104] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-09-18T21:01:43.729427] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-09-18T21:01:44.046727] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:01:44.141089] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-18T21:01:44.519594] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-11. [2025-09-18T21:01:45.034569] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-18T21:01:45.319631] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-09-18T21:01:45.622274] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-18T21:01:46.069751] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-18T21:01:46.119519] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-09-18T21:01:46.919575] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-09-18T21:01:46.969063] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-18T21:01:47.719591] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-09-18T21:01:48.045955] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-18T21:01:48.519579] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-09-18T21:01:48.604938] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-18T21:01:49.319536] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-09-18T21:01:49.644749] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-18T21:01:49.920819] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-18T21:01:50.119561] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-09-18T21:01:50.919557] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-09-18T21:01:51.124729] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T21:01:51.719558] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-09-18T21:01:52.061132] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-18T21:01:52.066177] [INFO ] [REMOTE ] PDO: Full fetch complete (48253 records). [2025-09-18T21:01:52.066273] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-09-18T21:01:52.461441] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-09-18T21:01:52.461541] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-09-18T21:01:52.462423] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-09-18T21:01:52.462501] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-09-18T21:01:52.463730] [DEBUG] [LOCAL ] PDO: Trimmed 48253 records to 32133 (keeping 200 days of data) [2025-09-18T21:01:52.520632] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-09-18T21:01:52.575144] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-18T21:01:52.688201] [DEBUG] [LOCAL ] PDO: Primary data saved (32133 records). [2025-09-18T21:01:52.688352] [INFO ] [MAIN ] PDO: Full history saved. [2025-09-18T21:01:52.688443] [INFO ] [MAIN ] Update Progress: 1653/2372 symbols completed. PDO took 41.0s. Estimated remaining: 1h 45m 11s. Rate: 6.8 symbols/min [2025-09-18T21:01:52.857440] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:01:52.873400] [DEBUG] [LOCAL ] PDX: Loaded 14557 existing records from primary storage. [2025-09-18T21:01:52.873512] [INFO ] [MAIN ] PDX: Loaded 14557 existing records. [2025-09-18T21:01:53.052952] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:01:53.053252] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-09-18T21:01:53.053302] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-09-18T21:01:53.053891] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-09-18T21:01:53.053954] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-09-18T21:01:53.324726] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-09-18T21:01:53.441187] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:01:53.450279] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-18T21:01:53.453050] [INFO ] [REMOTE ] PDS: Full fetch complete (25678 records). [2025-09-18T21:01:53.453149] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-09-18T21:01:53.836694] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-09-18T21:01:53.836790] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-09-18T21:01:53.837319] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-09-18T21:01:53.837361] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-09-18T21:01:53.838257] [DEBUG] [LOCAL ] PDS: Trimmed 25678 records to 18817 (keeping 200 days of data) [2025-09-18T21:01:53.956944] [DEBUG] [LOCAL ] PDS: Primary data saved (18817 records). [2025-09-18T21:01:53.957099] [INFO ] [MAIN ] PDS: Full history saved. [2025-09-18T21:01:53.957191] [INFO ] [MAIN ] Update Progress: 1654/2372 symbols completed. PDS took 24.7s. Estimated remaining: 1h 44m 59s. Rate: 6.8 symbols/min [2025-09-18T21:01:54.135445] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:01:54.131863] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-11. [2025-09-18T21:01:54.189275] [DEBUG] [LOCAL ] PEB: Loaded 50720 existing records from primary storage. [2025-09-18T21:01:54.189443] [INFO ] [MAIN ] PEB: Loaded 50720 existing records. [2025-09-18T21:01:54.381612] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-18T21:01:54.398620] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:01:54.399163] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-09-18T21:01:54.399218] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-09-18T21:01:54.400302] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-09-18T21:01:54.400377] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-09-18T21:01:54.777269] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:01:54.919549] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-09-18T21:01:55.137430] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T21:01:55.719568] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-11. [2025-09-18T21:01:55.856709] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-18T21:01:56.519561] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-09-18T21:01:57.155996] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-18T21:01:57.319511] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-09-18T21:01:57.660619] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-18T21:01:58.119552] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-09-18T21:01:58.369705] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-18T21:01:58.375557] [INFO ] [REMOTE ] PDM: Full fetch complete (57110 records). [2025-09-18T21:01:58.375710] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-09-18T21:01:58.757490] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-09-18T21:01:58.757572] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-09-18T21:01:58.758516] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-09-18T21:01:58.758570] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-09-18T21:01:58.759832] [DEBUG] [LOCAL ] PDM: Trimmed 57110 records to 40156 (keeping 200 days of data) [2025-09-18T21:01:58.926954] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-09-18T21:01:58.991681] [DEBUG] [LOCAL ] PDM: Primary data saved (40156 records). [2025-09-18T21:01:58.991855] [INFO ] [MAIN ] PDM: Full history saved. [2025-09-18T21:01:58.991954] [INFO ] [MAIN ] Update Progress: 1655/2372 symbols completed. PDM took 48.6s. Estimated remaining: 1h 44m 49s. Rate: 6.8 symbols/min [2025-09-18T21:01:59.167023] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:01:59.167223] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-09-18T21:01:59.167272] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-09-18T21:01:59.167429] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-09-18T21:01:59.167472] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-18T21:01:59.167515] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-09-18T21:01:59.167549] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-09-18T21:01:59.521316] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:01:59.719544] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-09-18T21:01:59.817154] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-18T21:02:00.390690] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-18T21:02:00.492180] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-18T21:02:00.519501] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-09-18T21:02:01.319556] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-09-18T21:02:01.362194] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-18T21:02:02.119635] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-09-18T21:02:02.446919] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-18T21:02:02.919570] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-09-18T21:02:02.936861] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-18T21:02:03.719578] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-09-18T21:02:04.519588] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-11. [2025-09-18T21:02:04.618400] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-18T21:02:04.620904] [INFO ] [REMOTE ] PDT: Full fetch complete (25197 records). [2025-09-18T21:02:04.620978] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-09-18T21:02:05.005005] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-09-18T21:02:05.005139] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-09-18T21:02:05.005809] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-09-18T21:02:05.005887] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-09-18T21:02:05.006924] [DEBUG] [LOCAL ] PDT: Trimmed 25197 records to 17689 (keeping 200 days of data) [2025-09-18T21:02:05.120771] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-18T21:02:05.163764] [DEBUG] [LOCAL ] PDT: Primary data saved (17689 records). [2025-09-18T21:02:05.163915] [INFO ] [MAIN ] PDT: Full history saved. [2025-09-18T21:02:05.164004] [INFO ] [MAIN ] Update Progress: 1656/2372 symbols completed. PDT took 21.9s. Estimated remaining: 1h 44m 39s. Rate: 6.8 symbols/min [2025-09-18T21:02:05.337168] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:02:05.333246] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-09-18T21:02:05.369579] [DEBUG] [LOCAL ] PEN: Loaded 30778 existing records from primary storage. [2025-09-18T21:02:05.369781] [INFO ] [MAIN ] PEN: Loaded 30778 existing records. [2025-09-18T21:02:05.582567] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:02:05.582897] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-09-18T21:02:05.582955] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-09-18T21:02:05.583861] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-09-18T21:02:05.583946] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-09-18T21:02:05.975521] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:02:06.133254] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-11. [2025-09-18T21:02:06.140268] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-18T21:02:06.160746] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-18T21:02:06.919552] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-09-18T21:02:07.382627] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-18T21:02:07.719547] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-09-18T21:02:07.803317] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-18T21:02:08.519564] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-09-18T21:02:09.116327] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T21:02:09.239781] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-18T21:02:09.319539] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-09-18T21:02:10.119584] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-09-18T21:02:10.334509] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-18T21:02:10.919583] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-09-18T21:02:11.318822] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-18T21:02:11.719538] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-09-18T21:02:12.519636] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-09-18T21:02:12.745050] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-18T21:02:13.328719] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-09-18T21:02:13.360816] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T21:02:13.640289] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-18T21:02:14.119600] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-09-18T21:02:14.166305] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-18T21:02:14.919573] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-09-18T21:02:15.557141] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-18T21:02:15.719519] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-09-18T21:02:16.439825] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T21:02:16.519547] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-09-18T21:02:17.042557] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T21:02:17.319608] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-09-18T21:02:18.119583] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-09-18T21:02:18.220536] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-18T21:02:18.644849] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-18T21:02:18.746763] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T21:02:18.919546] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-09-18T21:02:19.719594] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-09-18T21:02:20.423850] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-18T21:02:20.519546] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-09-18T21:02:21.269030] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-18T21:02:21.319505] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-09-18T21:02:21.888485] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-18T21:02:21.890861] [INFO ] [REMOTE ] PDX: Full fetch complete (24893 records). [2025-09-18T21:02:21.890941] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-09-18T21:02:22.124638] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-09-18T21:02:22.305979] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-18T21:02:22.323892] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-09-18T21:02:22.324504] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-09-18T21:02:22.325161] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-09-18T21:02:22.325542] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-09-18T21:02:22.326312] [DEBUG] [LOCAL ] PDX: Trimmed 24893 records to 14620 (keeping 200 days of data) [2025-09-18T21:02:22.422756] [DEBUG] [LOCAL ] PDX: Primary data saved (14620 records). [2025-09-18T21:02:22.422931] [INFO ] [MAIN ] PDX: Full history saved. [2025-09-18T21:02:22.423033] [INFO ] [MAIN ] Update Progress: 1657/2372 symbols completed. PDX took 29.7s. Estimated remaining: 1h 44m 34s. Rate: 6.8 symbols/min [2025-09-18T21:02:22.656789] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:02:22.669158] [DEBUG] [LOCAL ] PEO: Loaded 10901 existing records from primary storage. [2025-09-18T21:02:22.669279] [INFO ] [MAIN ] PEO: Loaded 10901 existing records. [2025-09-18T21:02:22.869951] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:02:22.870319] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-09-18T21:02:22.870384] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-09-18T21:02:22.870841] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-09-18T21:02:22.870903] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-09-18T21:02:22.929308] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-09-18T21:02:23.251919] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:02:23.719549] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-11. [2025-09-18T21:02:24.004808] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-18T21:02:24.235005] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-18T21:02:24.420014] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T21:02:24.519530] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-09-18T21:02:25.319553] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-09-18T21:02:26.008937] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-18T21:02:26.119596] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-09-18T21:02:26.354480] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-18T21:02:26.919570] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-09-18T21:02:27.719588] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-09-18T21:02:28.124557] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-18T21:02:28.519518] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-09-18T21:02:28.574775] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-18T21:02:28.822390] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-18T21:02:29.319577] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-09-18T21:02:30.119563] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-09-18T21:02:30.228979] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-18T21:02:30.327886] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T21:02:30.331944] [INFO ] [REMOTE ] PEN: Full fetch complete (43915 records). [2025-09-18T21:02:30.332057] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-09-18T21:02:30.719711] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-09-18T21:02:30.719812] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-09-18T21:02:30.720828] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-09-18T21:02:30.720895] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-09-18T21:02:30.722056] [DEBUG] [LOCAL ] PEN: Trimmed 43915 records to 30969 (keeping 200 days of data) [2025-09-18T21:02:30.912766] [DEBUG] [LOCAL ] PEN: Primary data saved (30969 records). [2025-09-18T21:02:30.912905] [INFO ] [MAIN ] PEN: Full history saved. [2025-09-18T21:02:30.912991] [INFO ] [MAIN ] Update Progress: 1658/2372 symbols completed. PEN took 25.7s. Estimated remaining: 1h 44m 25s. Rate: 6.8 symbols/min [2025-09-18T21:02:30.924689] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-09-18T21:02:31.086939] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:02:31.101766] [DEBUG] [LOCAL ] PERF: Loaded 14091 existing records from primary storage. [2025-09-18T21:02:31.101877] [INFO ] [MAIN ] PERF: Loaded 14091 existing records. [2025-09-18T21:02:31.284020] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:02:31.284327] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-09-18T21:02:31.284395] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-09-18T21:02:31.284852] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-09-18T21:02:31.284911] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-09-18T21:02:31.640914] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:02:31.657091] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-18T21:02:31.698051] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-18T21:02:31.719493] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-09-18T21:02:32.519563] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-11. [2025-09-18T21:02:32.755871] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-18T21:02:32.984177] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-18T21:02:33.319582] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-09-18T21:02:34.119595] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-09-18T21:02:34.919602] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-09-18T21:02:35.225151] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-18T21:02:35.568392] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T21:02:35.575608] [INFO ] [REMOTE ] PEB: Full fetch complete (72611 records). [2025-09-18T21:02:35.575825] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-09-18T21:02:35.724736] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-09-18T21:02:36.000448] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-09-18T21:02:35.996748] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-18T21:02:36.000669] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-09-18T21:02:36.005319] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-09-18T21:02:36.006136] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-09-18T21:02:36.008425] [DEBUG] [LOCAL ] PEB: Trimmed 72611 records to 51110 (keeping 200 days of data) [2025-09-18T21:02:36.325856] [DEBUG] [LOCAL ] PEB: Primary data saved (51110 records). [2025-09-18T21:02:36.326143] [INFO ] [MAIN ] PEB: Full history saved. [2025-09-18T21:02:36.326278] [INFO ] [MAIN ] Update Progress: 1659/2372 symbols completed. PEB took 42.4s. Estimated remaining: 1h 44m 15s. Rate: 6.8 symbols/min [2025-09-18T21:02:36.512359] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:02:36.512578] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-09-18T21:02:36.512628] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-09-18T21:02:36.512795] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-09-18T21:02:36.512839] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-18T21:02:36.512881] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-18T21:02:36.512914] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-09-18T21:02:36.524706] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-09-18T21:02:36.896361] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:02:37.319548] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-09-18T21:02:37.421964] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-18T21:02:37.723161] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-18T21:02:38.119559] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-09-18T21:02:38.414052] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-18T21:02:38.704431] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-18T21:02:38.919603] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-09-18T21:02:39.719595] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-09-18T21:02:40.519544] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-09-18T21:02:40.907831] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-18T21:02:40.934636] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-18T21:02:41.299233] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-18T21:02:41.319536] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-09-18T21:02:42.119538] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-09-18T21:02:42.156355] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-18T21:02:42.919547] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-09-18T21:02:42.940322] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-18T21:02:43.719591] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-09-18T21:02:43.827374] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-18T21:02:44.443259] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T21:02:44.519567] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-09-18T21:02:45.319548] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-09-18T21:02:45.444023] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-18T21:02:45.975319] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-18T21:02:45.983348] [INFO ] [REMOTE ] PEG: Full fetch complete (76117 records). [2025-09-18T21:02:45.983583] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-09-18T21:02:45.985132] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T21:02:45.985307] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:02:45.985379] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:02:45.985458] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-18T21:02:45.985542] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-09-18T21:02:45.985582] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-09-18T21:02:45.985912] [DEBUG] [LOCAL ] PEG: No derivative data file found to delete. [2025-09-18T21:02:45.986325] [INFO ] [MAIN ] Update Progress: 1660/2372 symbols completed. PEG took 47.0s. Estimated remaining: 1h 44m 6s. Rate: 6.8 symbols/min [2025-09-18T21:02:46.124756] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-09-18T21:02:46.186109] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:02:46.193556] [DEBUG] [LOCAL ] PFD: Loaded 5137 existing records from primary storage. [2025-09-18T21:02:46.193696] [INFO ] [MAIN ] PFD: Loaded 5137 existing records. [2025-09-18T21:02:46.400839] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:02:46.401146] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-09-18T21:02:46.401205] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-09-18T21:02:46.401542] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-09-18T21:02:46.401602] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-09-18T21:02:46.761762] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:02:46.919587] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-11. [2025-09-18T21:02:47.141337] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-18T21:02:47.644971] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-18T21:02:47.719592] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-09-18T21:02:48.519543] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-09-18T21:02:48.773130] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-18T21:02:49.248947] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-18T21:02:49.319552] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-09-18T21:02:49.901767] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-18T21:02:50.119582] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-09-18T21:02:50.919576] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-09-18T21:02:51.116324] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-18T21:02:51.386684] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-18T21:02:51.719566] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-09-18T21:02:52.429623] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-18T21:02:52.519555] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-11. [2025-09-18T21:02:52.796063] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:02:52.796379] [WARN ] [REMOTE ] PEW: No data returned for month 2024-11 [2025-09-18T21:02:53.319547] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-09-18T21:02:54.119545] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-09-18T21:02:54.148072] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-18T21:02:54.889235] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-18T21:02:54.891402] [INFO ] [REMOTE ] PERF: Full fetch complete (22074 records). [2025-09-18T21:02:54.891474] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-09-18T21:02:54.924772] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-09-18T21:02:55.276145] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-09-18T21:02:55.276264] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-09-18T21:02:55.276934] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-09-18T21:02:55.277001] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-09-18T21:02:55.278081] [DEBUG] [LOCAL ] PERF: Trimmed 22074 records to 14196 (keeping 200 days of data) [2025-09-18T21:02:55.362963] [DEBUG] [LOCAL ] PERF: Primary data saved (14196 records). [2025-09-18T21:02:55.363121] [INFO ] [MAIN ] PERF: Full history saved. [2025-09-18T21:02:55.363235] [INFO ] [MAIN ] Update Progress: 1661/2372 symbols completed. PERF took 24.5s. Estimated remaining: 1h 43m 58s. Rate: 6.8 symbols/min [2025-09-18T21:02:55.545180] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:02:55.550093] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-09-18T21:02:55.550280] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-18T21:02:55.551992] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-09-18T21:02:55.552828] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-09-18T21:02:55.552881] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-18T21:02:55.552927] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-09-18T21:02:55.552960] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-09-18T21:02:55.731540] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-09-18T21:02:55.932602] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:02:56.096209] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:02:56.096692] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-09-18T21:02:56.519624] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-09-18T21:02:57.103503] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-18T21:02:57.319594] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-11. [2025-09-18T21:02:58.119600] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-01. [2025-09-18T21:02:58.423177] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:02:58.423720] [WARN ] [REMOTE ] PEW: No data returned for month 2025-01 [2025-09-18T21:02:58.919564] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-09-18T21:02:59.719544] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-09-18T21:02:59.756732] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-18T21:02:59.790733] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-11 (2.47 seconds). [2025-09-18T21:03:00.397716] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-18T21:03:00.519585] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-09-18T21:03:01.319560] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-09-18T21:03:01.367778] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-18T21:03:01.370591] [INFO ] [REMOTE ] PEO: Full fetch complete (16355 records). [2025-09-18T21:03:01.370742] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-09-18T21:03:01.755515] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-09-18T21:03:01.755600] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-09-18T21:03:01.755986] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-09-18T21:03:01.756050] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-09-18T21:03:01.756586] [DEBUG] [LOCAL ] PEO: Trimmed 16355 records to 10954 (keeping 200 days of data) [2025-09-18T21:03:01.838584] [DEBUG] [LOCAL ] PEO: Primary data saved (10954 records). [2025-09-18T21:03:01.838763] [INFO ] [MAIN ] PEO: Full history saved. [2025-09-18T21:03:01.838879] [INFO ] [MAIN ] Update Progress: 1662/2372 symbols completed. PEO took 39.4s. Estimated remaining: 1h 43m 48s. Rate: 6.8 symbols/min [2025-09-18T21:03:02.035117] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:03:02.035384] [DEBUG] [LOCAL ] PFGC: No existing data file found in primary storage. [2025-09-18T21:03:02.035451] [WARN ] [MAIN ] PFGC: No existing data found, performing full refresh instead. [2025-09-18T21:03:02.035743] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-09-18T21:03:02.035822] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-09-18T21:03:02.035893] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-09-18T21:03:02.035957] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-09-18T21:03:02.124847] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-02. [2025-09-18T21:03:02.430542] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:03:02.919550] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-09-18T21:03:03.248684] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:03:03.249055] [WARN ] [REMOTE ] PEW: No data returned for month 2025-02 [2025-09-18T21:03:03.719544] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-03. [2025-09-18T21:03:04.519539] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-11. [2025-09-18T21:03:04.554072] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:03:04.554433] [WARN ] [REMOTE ] PEW: No data returned for month 2025-03 [2025-09-18T21:03:04.759882] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-18T21:03:05.027285] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (3.71 seconds). [2025-09-18T21:03:05.319602] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-09-18T21:03:06.119571] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-09-18T21:03:06.224861] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-18T21:03:06.919550] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-09-18T21:03:06.985386] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-18T21:03:07.719590] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-04. [2025-09-18T21:03:07.951354] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-09-18T21:03:07.995416] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:03:07.995874] [WARN ] [REMOTE ] PEW: No data returned for month 2025-04 [2025-09-18T21:03:08.483585] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-18T21:03:08.519502] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-09-18T21:03:09.319589] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-05. [2025-09-18T21:03:09.641446] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:03:09.641829] [WARN ] [REMOTE ] PEW: No data returned for month 2025-05 [2025-09-18T21:03:10.119597] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-09-18T21:03:10.207392] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-18T21:03:10.919585] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-09-18T21:03:11.475483] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-18T21:03:11.477137] [INFO ] [REMOTE ] PFD: Full fetch complete (7362 records). [2025-09-18T21:03:11.477211] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-09-18T21:03:11.729110] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-06. [2025-09-18T21:03:11.850365] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-09-18T21:03:11.850451] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-09-18T21:03:11.850690] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-09-18T21:03:11.850790] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-09-18T21:03:11.851228] [DEBUG] [LOCAL ] PFD: Trimmed 7362 records to 5191 (keeping 200 days of data) [2025-09-18T21:03:11.886998] [DEBUG] [LOCAL ] PFD: Primary data saved (5191 records). [2025-09-18T21:03:11.887129] [INFO ] [MAIN ] PFD: Full history saved. [2025-09-18T21:03:11.887275] [INFO ] [MAIN ] Update Progress: 1663/2372 symbols completed. PFD took 25.9s. Estimated remaining: 1h 43m 40s. Rate: 6.8 symbols/min [2025-09-18T21:03:12.026245] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:03:12.068918] [WARN ] [REMOTE ] PEW: No data returned for month 2025-06 [2025-09-18T21:03:12.073322] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:03:12.088947] [DEBUG] [LOCAL ] PFH: Loaded 6956 existing records from primary storage. [2025-09-18T21:03:12.089076] [INFO ] [MAIN ] PFH: Loaded 6956 existing records. [2025-09-18T21:03:12.276352] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:03:12.276975] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-09-18T21:03:12.277050] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-09-18T21:03:12.277731] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-09-18T21:03:12.277868] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-09-18T21:03:12.524941] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-07. [2025-09-18T21:03:12.659858] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:03:12.692198] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-18T21:03:13.319569] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-11. [2025-09-18T21:03:14.119548] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-09-18T21:03:14.157266] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-18T21:03:14.338453] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-18T21:03:14.919575] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-09-18T21:03:15.649917] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-18T21:03:15.719542] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-09-18T21:03:16.519584] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-08. [2025-09-18T21:03:16.528448] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-18T21:03:16.729842] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-09-18T21:03:17.319581] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-09-18T21:03:18.002720] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-18T21:03:18.119529] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-09-18T21:03:18.278904] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-18T21:03:18.919556] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-09. [2025-09-18T21:03:19.719618] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-09-18T21:03:20.246164] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-18T21:03:20.519616] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-09-18T21:03:20.755594] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-18T21:03:21.173260] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-18T21:03:21.179361] [INFO ] [REMOTE ] PEW: Full fetch complete (14646 records). [2025-09-18T21:03:21.179452] [DEBUG] [VALIDATOR ] PEW: Validating primary data. [2025-09-18T21:03:21.324674] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-09-18T21:03:21.366884] [WARN ] [VALIDATOR ] PEW: Validation failed - insufficient historical data. Have 46 unique days, need 200 days [2025-09-18T21:03:21.367351] [FATAL] [MAIN ] PEW: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:03:21.367441] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:03:21.367526] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-18T21:03:21.367605] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-18T21:03:21.367701] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-09-18T21:03:21.367785] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-09-18T21:03:21.367910] [INFO ] [MAIN ] Update Progress: 1664/2372 symbols completed. PEW took 45.0s. Estimated remaining: 1h 43m 31s. Rate: 6.8 symbols/min [2025-09-18T21:03:21.536808] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:03:21.556020] [DEBUG] [LOCAL ] PFL: Loaded 13840 existing records from primary storage. [2025-09-18T21:03:21.556206] [INFO ] [MAIN ] PFL: Loaded 13840 existing records. [2025-09-18T21:03:21.735833] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:03:21.736090] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-09-18T21:03:21.736147] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-09-18T21:03:21.736779] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-09-18T21:03:21.736894] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-09-18T21:03:22.106560] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:03:22.124691] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-09-18T21:03:22.141440] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-18T21:03:22.911677] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-18T21:03:22.919509] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-09-18T21:03:23.719599] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-11. [2025-09-18T21:03:24.401212] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (3.08 seconds). [2025-09-18T21:03:24.519567] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-09-18T21:03:24.693867] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-18T21:03:24.738889] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-18T21:03:25.234209] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-18T21:03:25.319495] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-09-18T21:03:26.119537] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-09-18T21:03:26.146186] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-18T21:03:26.919561] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-09-18T21:03:26.968713] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-18T21:03:27.438726] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-18T21:03:27.719539] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-09-18T21:03:28.519549] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-09-18T21:03:29.175084] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-18T21:03:29.321571] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-09-18T21:03:29.327201] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-18T21:03:30.119553] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-09-18T21:03:30.652426] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-18T21:03:30.653926] [INFO ] [REMOTE ] PFH: Full fetch complete (10754 records). [2025-09-18T21:03:30.654026] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-09-18T21:03:30.929195] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-09-18T21:03:31.032457] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-09-18T21:03:31.032546] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-09-18T21:03:31.032828] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-09-18T21:03:31.032903] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-09-18T21:03:31.033398] [DEBUG] [LOCAL ] PFH: Trimmed 10754 records to 6987 (keeping 200 days of data) [2025-09-18T21:03:31.077863] [DEBUG] [LOCAL ] PFH: Primary data saved (6987 records). [2025-09-18T21:03:31.078037] [INFO ] [MAIN ] PFH: Full history saved. [2025-09-18T21:03:31.078175] [INFO ] [MAIN ] Update Progress: 1665/2372 symbols completed. PFH took 19.2s. Estimated remaining: 1h 43m 23s. Rate: 6.8 symbols/min [2025-09-18T21:03:31.253401] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:03:31.308844] [DEBUG] [LOCAL ] PFLT: Loaded 43677 existing records from primary storage. [2025-09-18T21:03:31.309022] [INFO ] [MAIN ] PFLT: Loaded 43677 existing records. [2025-09-18T21:03:31.498134] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:03:31.498482] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-09-18T21:03:31.498537] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-09-18T21:03:31.500076] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-09-18T21:03:31.500138] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-09-18T21:03:31.725061] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-09-18T21:03:31.888366] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:03:31.898261] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-18T21:03:32.186215] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-09-18T21:03:32.519549] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-11. [2025-09-18T21:03:33.319577] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-09-18T21:03:34.124750] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-09-18T21:03:34.142368] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-18T21:03:34.319789] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-18T21:03:34.919564] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-09-18T21:03:34.957052] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-18T21:03:35.719607] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-09-18T21:03:36.260499] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.94 seconds). [2025-09-18T21:03:36.329867] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-18T21:03:36.447367] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-18T21:03:36.519516] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-09-18T21:03:37.319582] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-09-18T21:03:38.119545] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-09-18T21:03:38.295724] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-18T21:03:38.920888] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-09-18T21:03:38.927987] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T21:03:39.719583] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-09-18T21:03:40.478803] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-18T21:03:40.519579] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-09-18T21:03:40.592039] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-18T21:03:41.319612] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-09-18T21:03:41.404043] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-18T21:03:41.768197] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-18T21:03:41.775786] [INFO ] [REMOTE ] PFGC: Full fetch complete (67023 records). [2025-09-18T21:03:41.775957] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-09-18T21:03:42.128286] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-09-18T21:03:42.176174] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-09-18T21:03:42.176295] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-09-18T21:03:42.177562] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-09-18T21:03:42.177638] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-09-18T21:03:42.179912] [DEBUG] [LOCAL ] PFGC: Trimmed 67023 records to 47366 (keeping 200 days of data) [2025-09-18T21:03:42.483970] [DEBUG] [LOCAL ] PFGC: Primary data saved (47366 records). [2025-09-18T21:03:42.484176] [INFO ] [MAIN ] PFGC: Full history saved. [2025-09-18T21:03:42.484303] [INFO ] [MAIN ] Update Progress: 1666/2372 symbols completed. PFGC took 40.6s. Estimated remaining: 1h 43m 15s. Rate: 6.8 symbols/min [2025-09-18T21:03:42.666058] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:03:42.687910] [DEBUG] [LOCAL ] PFN: Loaded 21736 existing records from primary storage. [2025-09-18T21:03:42.688087] [INFO ] [MAIN ] PFN: Loaded 21736 existing records. [2025-09-18T21:03:42.889499] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:03:42.889813] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-09-18T21:03:42.889866] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-09-18T21:03:42.890575] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-09-18T21:03:42.890637] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-09-18T21:03:42.922971] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-09-18T21:03:43.264808] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-18T21:03:43.269450] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:03:43.719562] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-11. [2025-09-18T21:03:43.822301] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-18T21:03:44.361471] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-18T21:03:44.519545] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-09-18T21:03:44.721988] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-18T21:03:45.319581] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-09-18T21:03:46.078353] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-18T21:03:46.119510] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-09-18T21:03:46.406785] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-18T21:03:46.738227] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-18T21:03:46.919684] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-09-18T21:03:47.719691] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-09-18T21:03:48.477556] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T21:03:48.519536] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-09-18T21:03:48.858495] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-18T21:03:49.319622] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-09-18T21:03:49.978562] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T21:03:50.119616] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-09-18T21:03:50.473533] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T21:03:50.919570] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-09-18T21:03:51.470961] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-18T21:03:51.478344] [INFO ] [REMOTE ] PFE: Full fetch complete (77584 records). [2025-09-18T21:03:51.478604] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-09-18T21:03:51.479867] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T21:03:51.480512] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:03:51.480874] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:03:51.480985] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-18T21:03:51.481087] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-09-18T21:03:51.481135] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-09-18T21:03:51.481178] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-09-18T21:03:51.481268] [INFO ] [MAIN ] Update Progress: 1667/2372 symbols completed. PFE took 56.1s. Estimated remaining: 1h 43m 6s. Rate: 6.8 symbols/min [2025-09-18T21:03:51.683106] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:03:51.706672] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-18T21:03:51.723416] [DEBUG] [LOCAL ] PFO: Loaded 5773 existing records from primary storage. [2025-09-18T21:03:51.719482] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-09-18T21:03:51.723639] [INFO ] [MAIN ] PFO: Loaded 5773 existing records. [2025-09-18T21:03:51.921323] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:03:51.921607] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-09-18T21:03:51.921684] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-09-18T21:03:51.923272] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-09-18T21:03:51.923339] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-09-18T21:03:52.294135] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:03:52.519549] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-09-18T21:03:53.319524] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-09-18T21:03:53.442681] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-18T21:03:53.597011] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-18T21:03:53.987745] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-18T21:03:54.119571] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-09-18T21:03:54.919507] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-11. [2025-09-18T21:03:55.267803] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-18T21:03:55.368588] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-18T21:03:55.719550] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-09-18T21:03:56.331773] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-18T21:03:56.519561] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-09-18T21:03:57.319556] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-09-18T21:03:57.733587] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-18T21:03:57.736472] [INFO ] [REMOTE ] PFL: Full fetch complete (20223 records). [2025-09-18T21:03:57.736553] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-09-18T21:03:58.107169] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-09-18T21:03:58.107283] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-09-18T21:03:58.107744] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-09-18T21:03:58.107807] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-09-18T21:03:58.108463] [DEBUG] [LOCAL ] PFL: Trimmed 20223 records to 13911 (keeping 200 days of data) [2025-09-18T21:03:58.151554] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-09-18T21:03:58.207611] [DEBUG] [LOCAL ] PFL: Primary data saved (13911 records). [2025-09-18T21:03:58.207877] [INFO ] [MAIN ] PFL: Full history saved. [2025-09-18T21:03:58.208032] [INFO ] [MAIN ] Update Progress: 1668/2372 symbols completed. PFL took 36.8s. Estimated remaining: 1h 42m 57s. Rate: 6.8 symbols/min [2025-09-18T21:03:58.406440] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:03:58.451297] [DEBUG] [LOCAL ] PFS: Loaded 35805 existing records from primary storage. [2025-09-18T21:03:58.451466] [INFO ] [MAIN ] PFS: Loaded 35805 existing records. [2025-09-18T21:03:58.636433] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:03:58.636738] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-09-18T21:03:58.636799] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-09-18T21:03:58.637958] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-09-18T21:03:58.638021] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-09-18T21:03:58.748791] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-18T21:03:58.920850] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-09-18T21:03:59.042679] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-18T21:03:59.048737] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:03:59.056324] [INFO ] [REMOTE ] PFLT: Full fetch complete (63066 records). [2025-09-18T21:03:59.056502] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-09-18T21:03:59.501481] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-09-18T21:03:59.501580] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-09-18T21:03:59.502627] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-09-18T21:03:59.502716] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-09-18T21:03:59.504050] [DEBUG] [LOCAL ] PFLT: Trimmed 63066 records to 43987 (keeping 200 days of data) [2025-09-18T21:03:59.511819] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-18T21:03:59.720083] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-09-18T21:03:59.782356] [DEBUG] [LOCAL ] PFLT: Primary data saved (43987 records). [2025-09-18T21:03:59.782519] [INFO ] [MAIN ] PFLT: Full history saved. [2025-09-18T21:03:59.782610] [INFO ] [MAIN ] Update Progress: 1669/2372 symbols completed. PFLT took 28.7s. Estimated remaining: 1h 42m 45s. Rate: 6.8 symbols/min [2025-09-18T21:03:59.959609] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:03:59.989405] [DEBUG] [LOCAL ] PFSI: Loaded 28720 existing records from primary storage. [2025-09-18T21:03:59.989582] [INFO ] [MAIN ] PFSI: Loaded 28720 existing records. [2025-09-18T21:04:00.173043] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:04:00.173354] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-09-18T21:04:00.173406] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-09-18T21:04:00.174369] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-09-18T21:04:00.174432] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-09-18T21:04:00.457887] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-18T21:04:00.521786] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-11. [2025-09-18T21:04:00.545021] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:04:01.319560] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-09-18T21:04:01.888068] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-18T21:04:02.105612] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-18T21:04:02.119550] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-09-18T21:04:02.919552] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-11. [2025-09-18T21:04:03.454881] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-18T21:04:03.719551] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-09-18T21:04:04.014065] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T21:04:04.519533] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-09-18T21:04:04.880167] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-18T21:04:05.113144] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-18T21:04:05.319532] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-09-18T21:04:06.119620] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-09-18T21:04:06.404026] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-18T21:04:06.795559] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-18T21:04:06.919552] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-09-18T21:04:07.366394] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-18T21:04:07.719629] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-09-18T21:04:08.308046] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-18T21:04:08.519692] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-09-18T21:04:09.319565] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-09-18T21:04:10.123525] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-09-18T21:04:10.128711] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-18T21:04:10.520383] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-18T21:04:10.785725] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-18T21:04:10.919544] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-09-18T21:04:11.719588] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-09-18T21:04:12.452235] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-18T21:04:12.519558] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-09-18T21:04:12.989513] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-18T21:04:13.319519] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-09-18T21:04:13.405579] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-18T21:04:14.119555] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-09-18T21:04:14.427506] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-18T21:04:14.855514] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T21:04:14.857601] [INFO ] [REMOTE ] PFO: Full fetch complete (7775 records). [2025-09-18T21:04:14.857714] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-09-18T21:04:14.924681] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-09-18T21:04:15.225531] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-09-18T21:04:15.225609] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-09-18T21:04:15.225822] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-09-18T21:04:15.225883] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-09-18T21:04:15.226313] [DEBUG] [LOCAL ] PFO: Trimmed 7775 records to 5887 (keeping 200 days of data) [2025-09-18T21:04:15.260693] [DEBUG] [LOCAL ] PFO: Primary data saved (5887 records). [2025-09-18T21:04:15.260784] [INFO ] [MAIN ] PFO: Full history saved. [2025-09-18T21:04:15.260866] [INFO ] [MAIN ] Update Progress: 1670/2372 symbols completed. PFO took 23.8s. Estimated remaining: 1h 42m 39s. Rate: 6.8 symbols/min [2025-09-18T21:04:15.436220] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:04:15.436449] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-09-18T21:04:15.436509] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-09-18T21:04:15.436722] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-09-18T21:04:15.436785] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-18T21:04:15.436847] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-09-18T21:04:15.436894] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-09-18T21:04:15.727266] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-09-18T21:04:15.811014] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:04:16.059140] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-18T21:04:16.519560] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-09-18T21:04:16.580085] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-18T21:04:16.583723] [INFO ] [REMOTE ] PFN: Full fetch complete (30617 records). [2025-09-18T21:04:16.583807] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-09-18T21:04:16.953923] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-09-18T21:04:16.954005] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-09-18T21:04:16.957974] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-09-18T21:04:16.958101] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-09-18T21:04:16.959408] [DEBUG] [LOCAL ] PFN: Trimmed 30617 records to 21879 (keeping 200 days of data) [2025-09-18T21:04:17.094851] [DEBUG] [LOCAL ] PFN: Primary data saved (21879 records). [2025-09-18T21:04:17.094990] [INFO ] [MAIN ] PFN: Full history saved. [2025-09-18T21:04:17.095076] [INFO ] [MAIN ] Update Progress: 1671/2372 symbols completed. PFN took 34.6s. Estimated remaining: 1h 42m 27s. Rate: 6.8 symbols/min [2025-09-18T21:04:17.266531] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:04:17.274350] [DEBUG] [LOCAL ] PGP: Loaded 5420 existing records from primary storage. [2025-09-18T21:04:17.274464] [INFO ] [MAIN ] PGP: Loaded 5420 existing records. [2025-09-18T21:04:17.324743] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-11. [2025-09-18T21:04:17.471605] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:04:17.471939] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-09-18T21:04:17.471996] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-09-18T21:04:17.472357] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-09-18T21:04:17.472417] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-09-18T21:04:17.845062] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:04:17.865485] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T21:04:18.119569] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-09-18T21:04:18.919546] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-09-18T21:04:19.312719] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-18T21:04:19.631828] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-11 (2.31 seconds). [2025-09-18T21:04:19.719553] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-09-18T21:04:20.231898] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-18T21:04:20.519552] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-09-18T21:04:21.215740] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-18T21:04:21.319562] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-09-18T21:04:22.119551] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-09-18T21:04:22.308938] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-18T21:04:22.475919] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-18T21:04:22.919561] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-11. [2025-09-18T21:04:23.706858] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-18T21:04:23.719496] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-09-18T21:04:23.916866] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-18T21:04:24.411610] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-18T21:04:24.519579] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-09-18T21:04:25.319596] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-09-18T21:04:25.574602] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-18T21:04:26.119604] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-09-18T21:04:26.447616] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-18T21:04:26.919586] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-09-18T21:04:27.580619] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-18T21:04:27.719562] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-09-18T21:04:28.268314] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-18T21:04:28.519581] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-09-18T21:04:29.168480] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T21:04:29.319598] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-09-18T21:04:29.500480] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-18T21:04:29.773930] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-18T21:04:30.119536] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-09-18T21:04:30.919550] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-09-18T21:04:31.719509] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-09-18T21:04:32.228201] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-18T21:04:32.255148] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-18T21:04:32.286639] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-18T21:04:32.519566] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-09-18T21:04:33.319599] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-09-18T21:04:33.890575] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-18T21:04:34.119550] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-09-18T21:04:34.658359] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-18T21:04:34.919573] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-09-18T21:04:35.288744] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-18T21:04:35.719568] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-09-18T21:04:36.135922] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-18T21:04:36.203175] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-18T21:04:36.519559] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-09-18T21:04:37.319548] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-09-18T21:04:37.844452] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-18T21:04:37.849611] [INFO ] [REMOTE ] PFSI: Full fetch complete (40371 records). [2025-09-18T21:04:37.849741] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-09-18T21:04:37.971314] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-18T21:04:38.124789] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-09-18T21:04:38.252297] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-09-18T21:04:38.252433] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-09-18T21:04:38.253413] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-09-18T21:04:38.253482] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-09-18T21:04:38.255296] [DEBUG] [LOCAL ] PFSI: Trimmed 40371 records to 29042 (keeping 200 days of data) [2025-09-18T21:04:38.444396] [DEBUG] [LOCAL ] PFSI: Primary data saved (29042 records). [2025-09-18T21:04:38.444546] [INFO ] [MAIN ] PFSI: Full history saved. [2025-09-18T21:04:38.444680] [INFO ] [MAIN ] Update Progress: 1672/2372 symbols completed. PFSI took 38.7s. Estimated remaining: 1h 42m 24s. Rate: 6.8 symbols/min [2025-09-18T21:04:38.618831] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:04:38.619041] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-09-18T21:04:38.619099] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-09-18T21:04:38.619248] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-09-18T21:04:38.619291] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-18T21:04:38.619335] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-09-18T21:04:38.619370] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-09-18T21:04:38.924743] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-09-18T21:04:39.002326] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:04:39.720311] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-09-18T21:04:39.721961] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-18T21:04:40.325553] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-18T21:04:40.519584] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-09-18T21:04:40.724084] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-18T21:04:40.729580] [INFO ] [REMOTE ] PFS: Full fetch complete (51397 records). [2025-09-18T21:04:40.729751] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-09-18T21:04:41.148957] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-09-18T21:04:41.149090] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-09-18T21:04:41.150183] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-09-18T21:04:41.150256] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-09-18T21:04:41.151475] [DEBUG] [LOCAL ] PFS: Trimmed 51397 records to 36094 (keeping 200 days of data) [2025-09-18T21:04:41.347955] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-09-18T21:04:41.418175] [DEBUG] [LOCAL ] PFS: Primary data saved (36094 records). [2025-09-18T21:04:41.418403] [INFO ] [MAIN ] PFS: Full history saved. [2025-09-18T21:04:41.418559] [INFO ] [MAIN ] Update Progress: 1673/2372 symbols completed. PFS took 43.2s. Estimated remaining: 1h 42m 13s. Rate: 6.8 symbols/min [2025-09-18T21:04:41.699834] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:04:41.767952] [DEBUG] [LOCAL ] PGRE: Loaded 46142 existing records from primary storage. [2025-09-18T21:04:41.768162] [INFO ] [MAIN ] PGRE: Loaded 46142 existing records. [2025-09-18T21:04:42.064010] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:04:42.065357] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-18T21:04:42.069153] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-09-18T21:04:42.069286] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-09-18T21:04:42.070902] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-09-18T21:04:42.070990] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-09-18T21:04:42.125817] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-09-18T21:04:42.516072] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:04:42.637753] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-18T21:04:42.919564] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-09-18T21:04:42.973877] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-18T21:04:42.975366] [INFO ] [REMOTE ] PGP: Full fetch complete (7937 records). [2025-09-18T21:04:42.975437] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-09-18T21:04:43.332574] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-09-18T21:04:43.332684] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-09-18T21:04:43.332899] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-09-18T21:04:43.332951] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-09-18T21:04:43.333388] [DEBUG] [LOCAL ] PGP: Trimmed 7937 records to 5456 (keeping 200 days of data) [2025-09-18T21:04:43.365509] [DEBUG] [LOCAL ] PGP: Primary data saved (5456 records). [2025-09-18T21:04:43.365635] [INFO ] [MAIN ] PGP: Full history saved. [2025-09-18T21:04:43.365754] [INFO ] [MAIN ] Update Progress: 1674/2372 symbols completed. PGP took 26.3s. Estimated remaining: 1h 42m 1s. Rate: 6.8 symbols/min [2025-09-18T21:04:43.550175] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:04:43.557315] [DEBUG] [LOCAL ] PGZ: Loaded 5430 existing records from primary storage. [2025-09-18T21:04:43.557439] [INFO ] [MAIN ] PGZ: Loaded 5430 existing records. [2025-09-18T21:04:43.720006] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-11. [2025-09-18T21:04:43.742536] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:04:43.742887] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-09-18T21:04:43.742975] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-09-18T21:04:43.743307] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-09-18T21:04:43.743367] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-09-18T21:04:44.098438] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:04:44.519559] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-11. [2025-09-18T21:04:44.985887] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-18T21:04:45.320581] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-09-18T21:04:45.323198] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-18T21:04:46.119558] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-09-18T21:04:46.120576] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-18T21:04:46.919600] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-11. [2025-09-18T21:04:47.627165] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-18T21:04:47.645049] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-18T21:04:47.668949] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-18T21:04:47.719533] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-09-18T21:04:48.519578] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-09-18T21:04:49.253586] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-18T21:04:49.319547] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-09-18T21:04:50.119536] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-09-18T21:04:50.193690] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-18T21:04:50.301172] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-18T21:04:50.822117] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-18T21:04:50.919553] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-09-18T21:04:51.719545] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-09-18T21:04:52.519551] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-09-18T21:04:52.530320] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-18T21:04:52.791748] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-18T21:04:53.205280] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-18T21:04:53.319544] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-09-18T21:04:54.096006] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-18T21:04:54.103251] [INFO ] [REMOTE ] PG: Full fetch complete (77283 records). [2025-09-18T21:04:54.103373] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-09-18T21:04:54.104178] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T21:04:54.104270] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:04:54.104327] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:04:54.104419] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-18T21:04:54.104535] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-09-18T21:04:54.104618] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-09-18T21:04:54.104755] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-09-18T21:04:54.104865] [INFO ] [MAIN ] Update Progress: 1675/2372 symbols completed. PG took 38.8s. Estimated remaining: 1h 41m 53s. Rate: 6.8 symbols/min [2025-09-18T21:04:54.126176] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-09-18T21:04:54.279042] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:04:54.331781] [DEBUG] [LOCAL ] PH: Loaded 39455 existing records from primary storage. [2025-09-18T21:04:54.331923] [INFO ] [MAIN ] PH: Loaded 39455 existing records. [2025-09-18T21:04:54.514927] [WARN ] [MAIN ] PH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:04:54.515385] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-09-18T21:04:54.515467] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-09-18T21:04:54.517355] [DEBUG] [LOCAL ] PH: Deleted primary data file. [2025-09-18T21:04:54.517438] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-09-18T21:04:54.870713] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:04:54.919490] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-11. [2025-09-18T21:04:55.719548] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-09-18T21:04:55.835257] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-18T21:04:56.183395] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-18T21:04:56.336571] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T21:04:56.519538] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-09-18T21:04:57.319543] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-09-18T21:04:58.038187] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T21:04:58.119536] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-09-18T21:04:58.545494] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T21:04:58.919563] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-09-18T21:04:59.417271] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-18T21:04:59.719547] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-09-18T21:05:00.519553] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-09-18T21:05:00.565858] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-18T21:05:01.109118] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-18T21:05:01.319557] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-09-18T21:05:02.107334] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T21:05:02.119495] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-09-18T21:05:02.919592] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-09-18T21:05:03.249517] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-18T21:05:03.719514] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-09-18T21:05:03.874827] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-18T21:05:04.519571] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-09-18T21:05:04.588585] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T21:05:05.142945] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-18T21:05:05.319577] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-09-18T21:05:05.719491] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-18T21:05:06.119546] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-09-18T21:05:06.652576] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-18T21:05:06.919598] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-09-18T21:05:07.280097] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-18T21:05:07.571141] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-18T21:05:07.719590] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-09-18T21:05:08.519563] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-09-18T21:05:09.319546] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-09-18T21:05:09.691920] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-18T21:05:09.776321] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-18T21:05:10.055869] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-18T21:05:10.119551] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-09-18T21:05:10.919593] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-09-18T21:05:11.719551] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-09-18T21:05:11.805989] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-18T21:05:11.813147] [INFO ] [REMOTE ] PGRE: Full fetch complete (62924 records). [2025-09-18T21:05:11.813282] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-09-18T21:05:12.213667] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-09-18T21:05:12.213784] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-09-18T21:05:12.215278] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-09-18T21:05:12.215438] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-09-18T21:05:12.217674] [DEBUG] [LOCAL ] PGRE: Trimmed 62924 records to 46532 (keeping 200 days of data) [2025-09-18T21:05:12.305131] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-18T21:05:12.425316] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-18T21:05:12.522018] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-09-18T21:05:12.534284] [DEBUG] [LOCAL ] PGRE: Primary data saved (46532 records). [2025-09-18T21:05:12.534370] [INFO ] [MAIN ] PGRE: Full history saved. [2025-09-18T21:05:12.534480] [INFO ] [MAIN ] Update Progress: 1676/2372 symbols completed. PGRE took 31.1s. Estimated remaining: 1h 41m 48s. Rate: 6.8 symbols/min [2025-09-18T21:05:12.723088] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:05:12.734198] [DEBUG] [LOCAL ] PHD: Loaded 9577 existing records from primary storage. [2025-09-18T21:05:12.734328] [INFO ] [MAIN ] PHD: Loaded 9577 existing records. [2025-09-18T21:05:12.921556] [WARN ] [MAIN ] PHD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:05:12.922023] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-09-18T21:05:12.922104] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-09-18T21:05:12.922513] [DEBUG] [LOCAL ] PHD: Deleted primary data file. [2025-09-18T21:05:12.922589] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-09-18T21:05:13.279763] [INFO ] [REMOTE ] PHD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:05:13.286756] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-18T21:05:13.319524] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-09-18T21:05:14.002868] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-18T21:05:14.004575] [INFO ] [REMOTE ] PGZ: Full fetch complete (8995 records). [2025-09-18T21:05:14.004689] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-09-18T21:05:14.124763] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-11. [2025-09-18T21:05:14.380828] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-09-18T21:05:14.380916] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-09-18T21:05:14.381144] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-09-18T21:05:14.381226] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-09-18T21:05:14.382233] [DEBUG] [LOCAL ] PGZ: Trimmed 8995 records to 5462 (keeping 200 days of data) [2025-09-18T21:05:14.420461] [DEBUG] [LOCAL ] PGZ: Primary data saved (5462 records). [2025-09-18T21:05:14.420635] [INFO ] [MAIN ] PGZ: Full history saved. [2025-09-18T21:05:14.420815] [INFO ] [MAIN ] Update Progress: 1677/2372 symbols completed. PGZ took 31.1s. Estimated remaining: 1h 41m 37s. Rate: 6.8 symbols/min [2025-09-18T21:05:14.919590] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-09-18T21:05:15.008259] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-18T21:05:15.719547] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-09-18T21:05:16.519555] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-12. [2025-09-18T21:05:16.828459] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-18T21:05:17.111250] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-18T21:05:17.296807] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-18T21:05:17.319501] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-09-18T21:05:18.119545] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-01. [2025-09-18T21:05:18.830590] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-18T21:05:18.919571] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-09-18T21:05:19.277225] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-18T21:05:19.485142] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-18T21:05:19.719629] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-09-18T21:05:20.519579] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-09-18T21:05:20.551800] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-18T21:05:21.319550] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-09-18T21:05:22.061504] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-18T21:05:22.119560] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-09-18T21:05:22.676611] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-18T21:05:22.677757] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-18T21:05:22.919562] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-09-18T21:05:23.719576] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-09-18T21:05:23.776031] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-18T21:05:24.519584] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-09-18T21:05:25.220851] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-18T21:05:25.250420] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T21:05:25.319538] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-09-18T21:05:26.119572] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-09-18T21:05:26.904884] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T21:05:26.919485] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-09-18T21:05:26.948056] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-18T21:05:27.721687] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-09-18T21:05:27.724927] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-18T21:05:27.732588] [INFO ] [REMOTE ] PGR: Full fetch complete (76069 records). [2025-09-18T21:05:27.732819] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-09-18T21:05:27.733768] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T21:05:27.733862] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:05:27.733974] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:05:27.734061] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-18T21:05:27.734216] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-09-18T21:05:27.734276] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-09-18T21:05:27.734354] [DEBUG] [LOCAL ] PGR: No derivative data file found to delete. [2025-09-18T21:05:27.734476] [INFO ] [MAIN ] Update Progress: 1678/2372 symbols completed. PGR took 49.3s. Estimated remaining: 1h 41m 30s. Rate: 6.8 symbols/min [2025-09-18T21:05:28.519551] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-09-18T21:05:29.050622] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T21:05:29.062470] [INFO ] [REMOTE ] PH: Full fetch complete (56680 records). [2025-09-18T21:05:29.063322] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-18T21:05:29.063099] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-09-18T21:05:29.340470] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-09-18T21:05:29.486688] [DEBUG] [VALIDATOR ] PH: All expected trading days are present. [2025-09-18T21:05:29.486797] [DEBUG] [VALIDATOR ] PH: Primary data validation passed. [2025-09-18T21:05:29.487731] [INFO ] [MAIN ] PH: Fetched primary data is valid. [2025-09-18T21:05:29.487796] [DEBUG] [LOCAL ] PH: Saving primary data. [2025-09-18T21:05:29.489236] [DEBUG] [LOCAL ] PH: Trimmed 56680 records to 39699 (keeping 200 days of data) [2025-09-18T21:05:29.765132] [DEBUG] [LOCAL ] PH: Primary data saved (39699 records). [2025-09-18T21:05:29.765284] [INFO ] [MAIN ] PH: Full history saved. [2025-09-18T21:05:29.765398] [INFO ] [MAIN ] Update Progress: 1679/2372 symbols completed. PH took 35.7s. Estimated remaining: 1h 41m 18s. Rate: 6.8 symbols/min [2025-09-18T21:05:30.308415] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-18T21:05:30.310685] [INFO ] [REMOTE ] PHD: Full fetch complete (13775 records). [2025-09-18T21:05:30.310764] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-09-18T21:05:30.690311] [DEBUG] [VALIDATOR ] PHD: All expected trading days are present. [2025-09-18T21:05:30.690396] [DEBUG] [VALIDATOR ] PHD: Primary data validation passed. [2025-09-18T21:05:30.690720] [INFO ] [MAIN ] PHD: Fetched primary data is valid. [2025-09-18T21:05:30.690783] [DEBUG] [LOCAL ] PHD: Saving primary data. [2025-09-18T21:05:30.691852] [DEBUG] [LOCAL ] PHD: Trimmed 13775 records to 9688 (keeping 200 days of data) [2025-09-18T21:05:30.751585] [DEBUG] [LOCAL ] PHD: Primary data saved (9688 records). [2025-09-18T21:05:30.751758] [INFO ] [MAIN ] PHD: Full history saved. [2025-09-18T21:05:30.751882] [INFO ] [MAIN ] Update Progress: 1680/2372 symbols completed. PHD took 18.2s. Estimated remaining: 1h 41m 6s. Rate: 6.8 symbols/min [2025-09-18T21:05:31.328872] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:05:31.411893] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:05:31.470049] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:05:31.499739] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:05:31.519432] [DEBUG] [LOCAL ] PHI: Loaded 14878 existing records from primary storage. [2025-09-18T21:05:31.519743] [INFO ] [MAIN ] PHI: Loaded 14878 existing records. [2025-09-18T21:05:31.690158] [DEBUG] [LOCAL ] PHK: Loaded 26732 existing records from primary storage. [2025-09-18T21:05:31.765674] [INFO ] [MAIN ] PHK: Loaded 26732 existing records. [2025-09-18T21:05:31.794810] [DEBUG] [LOCAL ] PHIN: Loaded 33544 existing records from primary storage. [2025-09-18T21:05:31.794199] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:05:31.806477] [INFO ] [MAIN ] PHIN: Loaded 33544 existing records. [2025-09-18T21:05:31.861007] [DEBUG] [LOCAL ] PHG: Loaded 46280 existing records from primary storage. [2025-09-18T21:05:31.861089] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-09-18T21:05:31.876886] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-09-18T21:05:31.882258] [INFO ] [MAIN ] PHG: Loaded 46280 existing records. [2025-09-18T21:05:31.887733] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-09-18T21:05:31.939424] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-09-18T21:05:32.372427] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:05:32.425282] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-09-18T21:05:32.425508] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-09-18T21:05:32.511363] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-09-18T21:05:32.520145] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-09-18T21:05:32.510823] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:05:32.520267] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:05:32.591532] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-09-18T21:05:32.599883] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-09-18T21:05:32.615894] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-09-18T21:05:32.654005] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-09-18T21:05:32.661848] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-09-18T21:05:32.748771] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-09-18T21:05:32.774864] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-09-18T21:05:32.790902] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-09-18T21:05:33.477541] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:05:33.547465] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-11. [2025-09-18T21:05:33.815111] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:05:33.888709] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-11. [2025-09-18T21:05:34.006714] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:05:34.021766] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-11. [2025-09-18T21:05:34.063722] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:05:34.064049] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-11. [2025-09-18T21:05:34.622376] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-18T21:05:34.627945] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-09-18T21:05:35.014021] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-18T21:05:35.025526] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-09-18T21:05:35.160802] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-18T21:05:35.170030] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-09-18T21:05:35.315032] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-18T21:05:35.613170] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-18T21:05:35.719535] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-09-18T21:05:36.081583] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-18T21:05:36.385691] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-18T21:05:36.531277] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-09-18T21:05:36.533607] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T21:05:37.319571] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-09-18T21:05:38.075685] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-18T21:05:38.091919] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-18T21:05:38.119487] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-09-18T21:05:38.919541] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-09-18T21:05:39.719547] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-09-18T21:05:39.801523] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-18T21:05:40.085707] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T21:05:40.519590] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-09-18T21:05:40.865404] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T21:05:41.319559] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-09-18T21:05:41.623996] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-18T21:05:42.119624] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-09-18T21:05:42.783850] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-18T21:05:42.919549] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-09-18T21:05:43.675325] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-18T21:05:43.719500] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-09-18T21:05:44.486750] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T21:05:44.519496] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-09-18T21:05:44.886866] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-18T21:05:45.319601] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-09-18T21:05:46.074289] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-18T21:05:46.119514] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-09-18T21:05:46.428388] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-18T21:05:46.919588] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-09-18T21:05:47.680758] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T21:05:47.719498] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-09-18T21:05:47.934917] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-18T21:05:48.519567] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-09-18T21:05:49.319559] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-09-18T21:05:49.666620] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-18T21:05:49.720155] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-18T21:05:50.022807] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-18T21:05:50.119551] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-09-18T21:05:50.919607] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-09-18T21:05:51.724059] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-09-18T21:05:51.729748] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-18T21:05:52.014749] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-18T21:05:52.519590] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-09-18T21:05:52.957552] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-18T21:05:53.319540] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-09-18T21:05:54.057628] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-18T21:05:54.091970] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-18T21:05:54.119569] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-09-18T21:05:54.802304] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-18T21:05:54.919565] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-09-18T21:05:55.719602] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-09-18T21:05:56.477587] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-18T21:05:56.491903] [INFO ] [REMOTE ] PHG: Full fetch complete (65608 records). [2025-09-18T21:05:56.492502] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-09-18T21:05:56.492782] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-18T21:05:56.523671] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-09-18T21:05:56.897978] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-09-18T21:05:56.898091] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-09-18T21:05:56.899065] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-09-18T21:05:56.899129] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-09-18T21:05:56.900552] [DEBUG] [LOCAL ] PHG: Trimmed 65608 records to 46651 (keeping 200 days of data) [2025-09-18T21:05:57.187181] [DEBUG] [LOCAL ] PHG: Primary data saved (46651 records). [2025-09-18T21:05:57.187313] [INFO ] [MAIN ] PHG: Full history saved. [2025-09-18T21:05:57.187403] [INFO ] [MAIN ] Update Progress: 1681/2372 symbols completed. PHG took 26.4s. Estimated remaining: 1h 41m 5s. Rate: 6.8 symbols/min [2025-09-18T21:05:57.324670] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-09-18T21:05:57.384560] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:05:57.384750] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-09-18T21:05:57.384807] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-09-18T21:05:57.385013] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-09-18T21:05:57.385067] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-18T21:05:57.385112] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-09-18T21:05:57.385146] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-09-18T21:05:57.764832] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T21:05:57.770636] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:05:58.119543] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-09-18T21:05:58.484154] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-18T21:05:58.919553] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-11. [2025-09-18T21:05:59.032791] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-18T21:05:59.719583] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-09-18T21:06:00.519578] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-09-18T21:06:00.577385] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-18T21:06:00.665603] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-18T21:06:01.319549] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-09-18T21:06:01.543299] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-18T21:06:01.547389] [INFO ] [REMOTE ] PHI: Full fetch complete (20603 records). [2025-09-18T21:06:01.547549] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-09-18T21:06:01.969218] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-09-18T21:06:01.969300] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-09-18T21:06:01.969843] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-09-18T21:06:01.969919] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-09-18T21:06:01.970688] [DEBUG] [LOCAL ] PHI: Trimmed 20603 records to 15023 (keeping 200 days of data) [2025-09-18T21:06:02.072559] [DEBUG] [LOCAL ] PHI: Primary data saved (15023 records). [2025-09-18T21:06:02.072749] [INFO ] [MAIN ] PHI: Full history saved. [2025-09-18T21:06:02.072874] [INFO ] [MAIN ] Update Progress: 1682/2372 symbols completed. PHI took 31.3s. Estimated remaining: 1h 40m 54s. Rate: 6.8 symbols/min [2025-09-18T21:06:02.128697] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-09-18T21:06:02.249427] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:06:02.291528] [DEBUG] [LOCAL ] PHR: Loaded 37087 existing records from primary storage. [2025-09-18T21:06:02.291721] [INFO ] [MAIN ] PHR: Loaded 37087 existing records. [2025-09-18T21:06:02.468910] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:06:02.469173] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-09-18T21:06:02.469222] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-09-18T21:06:02.470339] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-09-18T21:06:02.470401] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-09-18T21:06:02.833677] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:06:02.919520] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-09-18T21:06:03.721786] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-11. [2025-09-18T21:06:03.726174] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-18T21:06:04.519551] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-09-18T21:06:04.862758] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-09-18T21:06:04.896140] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-18T21:06:05.055120] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-18T21:06:05.319557] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-09-18T21:06:05.496173] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-18T21:06:06.119558] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-09-18T21:06:06.919560] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-09-18T21:06:07.240785] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-18T21:06:07.286332] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-18T21:06:07.719571] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-09-18T21:06:07.912779] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-18T21:06:07.917378] [INFO ] [REMOTE ] PHK: Full fetch complete (39350 records). [2025-09-18T21:06:07.917498] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-09-18T21:06:08.299016] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-09-18T21:06:08.299097] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-09-18T21:06:08.299854] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-09-18T21:06:08.299917] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-09-18T21:06:08.300822] [DEBUG] [LOCAL ] PHK: Trimmed 39350 records to 26933 (keeping 200 days of data) [2025-09-18T21:06:08.473272] [DEBUG] [LOCAL ] PHK: Primary data saved (26933 records). [2025-09-18T21:06:08.473437] [INFO ] [MAIN ] PHK: Full history saved. [2025-09-18T21:06:08.473531] [INFO ] [MAIN ] Update Progress: 1683/2372 symbols completed. PHK took 37.7s. Estimated remaining: 1h 40m 45s. Rate: 6.8 symbols/min [2025-09-18T21:06:08.525350] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-09-18T21:06:08.672175] [INFO ] [MAIN ] PHT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:06:08.688567] [DEBUG] [LOCAL ] PHT: Loaded 15323 existing records from primary storage. [2025-09-18T21:06:08.688741] [INFO ] [MAIN ] PHT: Loaded 15323 existing records. [2025-09-18T21:06:08.872275] [WARN ] [MAIN ] PHT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:06:08.872521] [INFO ] [MAIN ] PHT: Wiping existing primary data before full refresh. [2025-09-18T21:06:08.872570] [INFO ] [LOCAL ] PHT: Starting deletion of primary data. [2025-09-18T21:06:08.873063] [DEBUG] [LOCAL ] PHT: Deleted primary data file. [2025-09-18T21:06:08.873122] [INFO ] [MAIN ] PHT: Starting full primary refresh. [2025-09-18T21:06:09.270764] [INFO ] [REMOTE ] PHT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:06:09.292453] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-18T21:06:09.319503] [INFO ] [REMOTE ] PHT: Fetching primary data for 2024-11. [2025-09-18T21:06:09.866133] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-18T21:06:09.871262] [INFO ] [REMOTE ] PHIN: Full fetch complete (48238 records). [2025-09-18T21:06:09.871412] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-09-18T21:06:10.000158] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-18T21:06:10.124634] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-09-18T21:06:10.275321] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-09-18T21:06:10.275408] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-09-18T21:06:10.276238] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-09-18T21:06:10.276313] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-09-18T21:06:10.277319] [DEBUG] [LOCAL ] PHIN: Trimmed 48238 records to 33825 (keeping 200 days of data) [2025-09-18T21:06:10.486795] [DEBUG] [LOCAL ] PHIN: Primary data saved (33825 records). [2025-09-18T21:06:10.486946] [INFO ] [MAIN ] PHIN: Full history saved. [2025-09-18T21:06:10.487056] [INFO ] [MAIN ] Update Progress: 1684/2372 symbols completed. PHIN took 39.7s. Estimated remaining: 1h 40m 33s. Rate: 6.8 symbols/min [2025-09-18T21:06:10.665148] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:06:10.712018] [DEBUG] [LOCAL ] PII: Loaded 49436 existing records from primary storage. [2025-09-18T21:06:10.712186] [INFO ] [MAIN ] PII: Loaded 49436 existing records. [2025-09-18T21:06:10.895539] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:06:10.895846] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-09-18T21:06:10.895900] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-09-18T21:06:10.897540] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-09-18T21:06:10.897618] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-09-18T21:06:10.929390] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-09-18T21:06:11.286934] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:06:11.719596] [INFO ] [REMOTE ] PHT: Fetching primary data for 2024-12. [2025-09-18T21:06:12.029610] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-18T21:06:12.249259] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-18T21:06:12.366515] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-18T21:06:12.519604] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-09-18T21:06:13.319553] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-11. [2025-09-18T21:06:14.119557] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-01. [2025-09-18T21:06:14.919722] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-09-18T21:06:15.102897] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-18T21:06:15.181522] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-18T21:06:15.286974] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T21:06:15.719599] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-09-18T21:06:16.319123] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T21:06:16.519574] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-09-18T21:06:17.270989] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-18T21:06:17.319508] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-09-18T21:06:18.119590] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-09-18T21:06:18.270892] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-18T21:06:18.922047] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-09-18T21:06:18.927578] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T21:06:19.719563] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-09-18T21:06:19.761760] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T21:06:20.519704] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-09-18T21:06:20.560183] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-18T21:06:21.277929] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-18T21:06:21.319493] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-09-18T21:06:21.794167] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-18T21:06:22.119547] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-09-18T21:06:22.901208] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-18T21:06:22.919498] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-09-18T21:06:23.613166] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-18T21:06:23.719571] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-09-18T21:06:24.519598] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-02. [2025-09-18T21:06:24.605408] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-18T21:06:25.319590] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-09-18T21:06:25.478832] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-18T21:06:25.746289] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-18T21:06:26.119554] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-09-18T21:06:26.501114] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-18T21:06:26.919569] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-09-18T21:06:27.719559] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-03. [2025-09-18T21:06:27.799034] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-18T21:06:28.348250] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-18T21:06:28.472858] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-18T21:06:28.519504] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-09-18T21:06:29.319577] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-09-18T21:06:29.360891] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-18T21:06:29.368238] [INFO ] [REMOTE ] PHM: Full fetch complete (74446 records). [2025-09-18T21:06:29.368431] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-09-18T21:06:29.371070] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T21:06:29.371255] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:06:29.371304] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:06:29.371375] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-18T21:06:29.371454] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-09-18T21:06:29.371493] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-09-18T21:06:29.371613] [DEBUG] [LOCAL ] PHM: No derivative data file found to delete. [2025-09-18T21:06:29.371741] [INFO ] [MAIN ] Update Progress: 1685/2372 symbols completed. PHM took 32.2s. Estimated remaining: 1h 40m 28s. Rate: 6.8 symbols/min [2025-09-18T21:06:29.550857] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:06:29.557760] [DEBUG] [LOCAL ] PIM: Loaded 4781 existing records from primary storage. [2025-09-18T21:06:29.557874] [INFO ] [MAIN ] PIM: Loaded 4781 existing records. [2025-09-18T21:06:29.741903] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:06:29.742180] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-09-18T21:06:29.742231] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-09-18T21:06:29.742477] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-09-18T21:06:29.742537] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-09-18T21:06:30.115759] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:06:30.119501] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-11. [2025-09-18T21:06:30.436882] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-18T21:06:30.653219] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-18T21:06:30.919592] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-04. [2025-09-18T21:06:31.719584] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-09-18T21:06:31.981686] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-18T21:06:32.273092] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-18T21:06:32.519558] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-05. [2025-09-18T21:06:33.319524] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-09-18T21:06:33.451894] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-18T21:06:34.119596] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-06. [2025-09-18T21:06:34.919521] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-09-18T21:06:35.047340] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-18T21:06:35.079194] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-18T21:06:35.338119] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-18T21:06:35.719603] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-09-18T21:06:36.519605] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-09-18T21:06:36.998531] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-18T21:06:37.140299] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-18T21:06:37.319547] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-09-18T21:06:38.039484] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-18T21:06:38.119519] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-09-18T21:06:38.919557] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-09-18T21:06:39.596944] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-18T21:06:39.719546] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-09-18T21:06:39.825775] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-18T21:06:40.172889] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-18T21:06:40.519601] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-09-18T21:06:41.319631] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-09-18T21:06:42.098267] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-18T21:06:42.119490] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-09-18T21:06:42.667104] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-18T21:06:42.919573] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-07. [2025-09-18T21:06:43.448450] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T21:06:43.456859] [INFO ] [REMOTE ] PHR: Full fetch complete (51913 records). [2025-09-18T21:06:43.457046] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-09-18T21:06:43.724831] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-09-18T21:06:43.852464] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-09-18T21:06:43.852549] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-09-18T21:06:43.853432] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-09-18T21:06:43.853497] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-09-18T21:06:43.854619] [DEBUG] [LOCAL ] PHR: Trimmed 51913 records to 37429 (keeping 200 days of data) [2025-09-18T21:06:43.967161] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-18T21:06:44.104968] [DEBUG] [LOCAL ] PHR: Primary data saved (37429 records). [2025-09-18T21:06:44.105125] [INFO ] [MAIN ] PHR: Full history saved. [2025-09-18T21:06:44.105215] [INFO ] [MAIN ] Update Progress: 1686/2372 symbols completed. PHR took 42.0s. Estimated remaining: 1h 40m 22s. Rate: 6.8 symbols/min [2025-09-18T21:06:44.288340] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:06:44.306274] [DEBUG] [LOCAL ] PINE: Loaded 14236 existing records from primary storage. [2025-09-18T21:06:44.306444] [INFO ] [MAIN ] PINE: Loaded 14236 existing records. [2025-09-18T21:06:44.498587] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:06:44.498875] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-09-18T21:06:44.498925] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-09-18T21:06:44.499462] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-09-18T21:06:44.499525] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-09-18T21:06:44.531738] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-09-18T21:06:44.859192] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:06:45.319524] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-11. [2025-09-18T21:06:45.449559] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T21:06:45.450848] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-18T21:06:45.459466] [INFO ] [REMOTE ] PII: Full fetch complete (70939 records). [2025-09-18T21:06:45.459595] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-09-18T21:06:45.867266] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-09-18T21:06:45.867350] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-09-18T21:06:45.868402] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-09-18T21:06:45.868481] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-09-18T21:06:45.872217] [DEBUG] [LOCAL ] PII: Trimmed 70939 records to 49751 (keeping 200 days of data) [2025-09-18T21:06:46.119618] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-09-18T21:06:46.188319] [DEBUG] [LOCAL ] PII: Primary data saved (49751 records). [2025-09-18T21:06:46.188478] [INFO ] [MAIN ] PII: Full history saved. [2025-09-18T21:06:46.188597] [INFO ] [MAIN ] Update Progress: 1687/2372 symbols completed. PII took 35.7s. Estimated remaining: 1h 40m 11s. Rate: 6.8 symbols/min [2025-09-18T21:06:46.361172] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:06:46.414863] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-09-18T21:06:46.415030] [INFO ] [MAIN ] PINS: Loaded 53693 existing records. [2025-09-18T21:06:46.598379] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:06:46.611503] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-09-18T21:06:46.611743] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-09-18T21:06:46.613314] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-18T21:06:46.618471] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-09-18T21:06:46.618569] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-09-18T21:06:46.928083] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-09-18T21:06:47.031179] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:06:47.610931] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-18T21:06:47.719717] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-08. [2025-09-18T21:06:48.519575] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-09-18T21:06:48.863627] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T21:06:48.938517] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-18T21:06:48.953792] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-18T21:06:49.319568] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-09. [2025-09-18T21:06:50.091613] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-18T21:06:50.094572] [INFO ] [REMOTE ] PHT: Full fetch complete (19216 records). [2025-09-18T21:06:50.094685] [DEBUG] [VALIDATOR ] PHT: Validating primary data. [2025-09-18T21:06:50.126793] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-09-18T21:06:50.482824] [DEBUG] [VALIDATOR ] PHT: All expected trading days are present. [2025-09-18T21:06:50.482906] [DEBUG] [VALIDATOR ] PHT: Primary data validation passed. [2025-09-18T21:06:50.483335] [INFO ] [MAIN ] PHT: Fetched primary data is valid. [2025-09-18T21:06:50.483374] [DEBUG] [LOCAL ] PHT: Saving primary data. [2025-09-18T21:06:50.483965] [DEBUG] [LOCAL ] PHT: Trimmed 19216 records to 15406 (keeping 200 days of data) [2025-09-18T21:06:50.574667] [DEBUG] [LOCAL ] PHT: Primary data saved (15406 records). [2025-09-18T21:06:50.574844] [INFO ] [MAIN ] PHT: Full history saved. [2025-09-18T21:06:50.574955] [INFO ] [MAIN ] Update Progress: 1688/2372 symbols completed. PHT took 42.1s. Estimated remaining: 1h 40m 0s. Rate: 6.8 symbols/min [2025-09-18T21:06:50.745078] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:06:50.762378] [DEBUG] [LOCAL ] PIPR: Loaded 15397 existing records from primary storage. [2025-09-18T21:06:50.762526] [INFO ] [MAIN ] PIPR: Loaded 15397 existing records. [2025-09-18T21:06:50.925685] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-11. [2025-09-18T21:06:50.958353] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:06:50.958588] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-09-18T21:06:50.958637] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-09-18T21:06:50.959272] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-09-18T21:06:50.959330] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-09-18T21:06:51.287599] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-18T21:06:51.349191] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:06:51.719565] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-11. [2025-09-18T21:06:52.519554] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-09-18T21:06:52.578588] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-18T21:06:53.137610] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-11 (2.21 seconds). [2025-09-18T21:06:53.154871] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-18T21:06:53.156622] [INFO ] [REMOTE ] PIM: Full fetch complete (6631 records). [2025-09-18T21:06:53.156716] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-09-18T21:06:53.324036] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-09-18T21:06:53.533782] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-09-18T21:06:53.533868] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-09-18T21:06:53.534054] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-09-18T21:06:53.534096] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-09-18T21:06:53.534580] [DEBUG] [LOCAL ] PIM: Trimmed 6631 records to 4811 (keeping 200 days of data) [2025-09-18T21:06:53.563059] [DEBUG] [LOCAL ] PIM: Primary data saved (4811 records). [2025-09-18T21:06:53.563192] [INFO ] [MAIN ] PIM: Full history saved. [2025-09-18T21:06:53.563293] [INFO ] [MAIN ] Update Progress: 1689/2372 symbols completed. PIM took 24.2s. Estimated remaining: 1h 39m 49s. Rate: 6.8 symbols/min [2025-09-18T21:06:53.731384] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:06:53.759993] [DEBUG] [LOCAL ] PJT: Loaded 22933 existing records from primary storage. [2025-09-18T21:06:53.760196] [INFO ] [MAIN ] PJT: Loaded 22933 existing records. [2025-09-18T21:06:53.939758] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:06:53.940027] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-09-18T21:06:53.940091] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-09-18T21:06:53.940896] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-09-18T21:06:53.940956] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-09-18T21:06:54.129783] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-09-18T21:06:54.303433] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:06:54.919569] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-09-18T21:06:55.103872] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-18T21:06:55.357112] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-18T21:06:55.553120] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-18T21:06:55.719551] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-09-18T21:06:56.519547] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-11. [2025-09-18T21:06:57.319629] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-09-18T21:06:57.517596] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-18T21:06:57.820766] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-18T21:06:58.042292] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-18T21:06:58.119539] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-09-18T21:06:58.919555] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-09-18T21:06:59.719549] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-09-18T21:07:00.519541] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-09-18T21:07:00.834872] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-18T21:07:00.915113] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-18T21:07:00.950052] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (2.83 seconds). [2025-09-18T21:07:01.251931] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-18T21:07:01.319580] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-09-18T21:07:02.119564] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-09-18T21:07:02.919515] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-09-18T21:07:03.072844] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-18T21:07:03.163733] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-18T21:07:03.659624] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-18T21:07:03.719521] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-09-18T21:07:04.519569] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-09-18T21:07:04.924991] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-18T21:07:05.319583] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-09-18T21:07:05.414333] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-18T21:07:06.118679] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-18T21:07:06.121542] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-09-18T21:07:06.919579] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-09-18T21:07:07.120359] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-18T21:07:07.719517] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-09-18T21:07:08.071911] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-18T21:07:08.519571] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-09-18T21:07:08.808625] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-18T21:07:09.319605] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-09-18T21:07:10.119518] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-09-18T21:07:10.194952] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-18T21:07:10.921193] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-09-18T21:07:10.924373] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-18T21:07:11.026623] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-18T21:07:11.719528] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-09-18T21:07:11.734821] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-18T21:07:12.474958] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-18T21:07:12.477205] [INFO ] [REMOTE ] PINE: Full fetch complete (21218 records). [2025-09-18T21:07:12.477280] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-09-18T21:07:12.524615] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-09-18T21:07:12.862344] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-09-18T21:07:12.862432] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-09-18T21:07:12.862964] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-09-18T21:07:12.863039] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-09-18T21:07:12.864027] [DEBUG] [LOCAL ] PINE: Trimmed 21218 records to 14351 (keeping 200 days of data) [2025-09-18T21:07:12.955189] [DEBUG] [LOCAL ] PINE: Primary data saved (14351 records). [2025-09-18T21:07:12.955331] [INFO ] [MAIN ] PINE: Full history saved. [2025-09-18T21:07:12.955419] [INFO ] [MAIN ] Update Progress: 1690/2372 symbols completed. PINE took 28.9s. Estimated remaining: 1h 39m 44s. Rate: 6.8 symbols/min [2025-09-18T21:07:13.125077] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:07:13.181310] [DEBUG] [LOCAL ] PK: Loaded 52900 existing records from primary storage. [2025-09-18T21:07:13.181462] [INFO ] [MAIN ] PK: Loaded 52900 existing records. [2025-09-18T21:07:13.328352] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-09-18T21:07:13.370251] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:07:13.370696] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-09-18T21:07:13.370790] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-09-18T21:07:13.372778] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-09-18T21:07:13.372842] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-09-18T21:07:13.730893] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:07:13.742482] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-18T21:07:14.119544] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-09-18T21:07:14.542306] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-18T21:07:14.899460] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-18T21:07:14.919507] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-11. [2025-09-18T21:07:15.719579] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-09-18T21:07:16.436840] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-18T21:07:16.519554] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-09-18T21:07:16.749344] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-18T21:07:17.319551] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-09-18T21:07:18.002507] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-18T21:07:18.004984] [INFO ] [REMOTE ] PIPR: Full fetch complete (20315 records). [2025-09-18T21:07:18.005081] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-09-18T21:07:18.124683] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-09-18T21:07:18.397618] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-09-18T21:07:18.397741] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-09-18T21:07:18.398183] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-09-18T21:07:18.398290] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-09-18T21:07:18.399163] [DEBUG] [LOCAL ] PIPR: Trimmed 20315 records to 15563 (keeping 200 days of data) [2025-09-18T21:07:18.497527] [DEBUG] [LOCAL ] PIPR: Primary data saved (15563 records). [2025-09-18T21:07:18.497711] [INFO ] [MAIN ] PIPR: Full history saved. [2025-09-18T21:07:18.497813] [INFO ] [MAIN ] Update Progress: 1691/2372 symbols completed. PIPR took 27.9s. Estimated remaining: 1h 39m 34s. Rate: 6.8 symbols/min [2025-09-18T21:07:18.672909] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:07:18.686934] [DEBUG] [LOCAL ] PKE: Loaded 12305 existing records from primary storage. [2025-09-18T21:07:18.687072] [INFO ] [MAIN ] PKE: Loaded 12305 existing records. [2025-09-18T21:07:18.873058] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:07:18.873595] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-09-18T21:07:18.873729] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-09-18T21:07:18.874348] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-09-18T21:07:18.874501] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-09-18T21:07:18.929627] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-09-18T21:07:19.028675] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-18T21:07:19.325839] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:07:19.345864] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-18T21:07:19.719560] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-11. [2025-09-18T21:07:20.519547] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-09-18T21:07:20.759898] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-18T21:07:20.941690] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-18T21:07:21.319509] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-09-18T21:07:21.345761] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-18T21:07:22.119550] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-09-18T21:07:22.919576] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-09-18T21:07:23.119701] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-18T21:07:23.368098] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T21:07:23.551068] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-18T21:07:23.719550] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-09-18T21:07:24.519525] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-09-18T21:07:24.706470] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-18T21:07:25.319619] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-09-18T21:07:25.398725] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-18T21:07:26.119551] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-09-18T21:07:26.919565] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-09-18T21:07:27.239963] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-18T21:07:27.719596] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-09-18T21:07:27.885876] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-18T21:07:27.923073] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-18T21:07:28.519564] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-09-18T21:07:29.197393] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-18T21:07:29.199997] [INFO ] [REMOTE ] PJT: Full fetch complete (32116 records). [2025-09-18T21:07:29.200075] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-09-18T21:07:29.324690] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-09-18T21:07:29.602566] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-09-18T21:07:29.602704] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-09-18T21:07:29.603548] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-09-18T21:07:29.603636] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-09-18T21:07:29.604791] [DEBUG] [LOCAL ] PJT: Trimmed 32116 records to 23067 (keeping 200 days of data) [2025-09-18T21:07:29.761304] [DEBUG] [LOCAL ] PJT: Primary data saved (23067 records). [2025-09-18T21:07:29.761440] [INFO ] [MAIN ] PJT: Full history saved. [2025-09-18T21:07:29.761576] [INFO ] [MAIN ] Update Progress: 1692/2372 symbols completed. PJT took 36.2s. Estimated remaining: 1h 39m 27s. Rate: 6.8 symbols/min [2025-09-18T21:07:29.952320] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:07:29.993620] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-18T21:07:30.011955] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-18T21:07:30.055545] [DEBUG] [LOCAL ] PKG: Loaded 39509 existing records from primary storage. [2025-09-18T21:07:30.055726] [INFO ] [MAIN ] PKG: Loaded 39509 existing records. [2025-09-18T21:07:30.124776] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-09-18T21:07:30.259439] [WARN ] [MAIN ] PKG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:07:30.259744] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-09-18T21:07:30.259805] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-09-18T21:07:30.261484] [DEBUG] [LOCAL ] PKG: Deleted primary data file. [2025-09-18T21:07:30.261548] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-09-18T21:07:30.645718] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:07:30.919565] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-09-18T21:07:31.639459] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-18T21:07:31.719537] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-09-18T21:07:32.526798] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-11. [2025-09-18T21:07:32.543105] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-18T21:07:32.551627] [INFO ] [REMOTE ] PINS: Full fetch complete (77650 records). [2025-09-18T21:07:32.551857] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-09-18T21:07:32.985792] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-09-18T21:07:32.985920] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-09-18T21:07:32.987947] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-09-18T21:07:32.988030] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-09-18T21:07:32.992099] [DEBUG] [LOCAL ] PINS: Trimmed 77650 records to 54083 (keeping 200 days of data) [2025-09-18T21:07:33.328585] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-09-18T21:07:33.376556] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-18T21:07:33.406131] [DEBUG] [LOCAL ] PINS: Primary data saved (54083 records). [2025-09-18T21:07:33.406304] [INFO ] [MAIN ] PINS: Full history saved. [2025-09-18T21:07:33.406416] [INFO ] [MAIN ] Update Progress: 1693/2372 symbols completed. PINS took 47.2s. Estimated remaining: 1h 39m 16s. Rate: 6.8 symbols/min [2025-09-18T21:07:33.577129] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:07:33.598236] [DEBUG] [LOCAL ] PKST: Loaded 19563 existing records from primary storage. [2025-09-18T21:07:33.598411] [INFO ] [MAIN ] PKST: Loaded 19563 existing records. [2025-09-18T21:07:33.781337] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:07:33.781614] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-09-18T21:07:33.781705] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-09-18T21:07:33.782422] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-09-18T21:07:33.782484] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-09-18T21:07:34.129191] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-09-18T21:07:34.177320] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:07:34.199893] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-18T21:07:34.235111] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-18T21:07:34.919566] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-09-18T21:07:35.719556] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-11. [2025-09-18T21:07:36.123270] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-18T21:07:36.202409] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-18T21:07:36.501794] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-18T21:07:36.519511] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-09-18T21:07:37.319566] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-09-18T21:07:37.758478] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-18T21:07:38.119551] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-09-18T21:07:38.700431] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-18T21:07:38.747900] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T21:07:38.919561] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-09-18T21:07:39.633997] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-18T21:07:39.719611] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-09-18T21:07:40.519553] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-09-18T21:07:40.807888] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-18T21:07:41.319581] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-09-18T21:07:42.119724] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-09-18T21:07:42.307738] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-18T21:07:42.805789] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T21:07:42.926201] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-09-18T21:07:42.931276] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-18T21:07:43.719560] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-09-18T21:07:44.225321] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T21:07:44.519522] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-09-18T21:07:44.559059] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-18T21:07:45.319567] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-09-18T21:07:46.110157] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T21:07:46.119486] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-09-18T21:07:46.764310] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T21:07:46.919635] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-09-18T21:07:47.616877] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-18T21:07:47.719543] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-09-18T21:07:47.844369] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-18T21:07:48.519543] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-09-18T21:07:49.319513] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-09-18T21:07:49.369029] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-18T21:07:49.476832] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-18T21:07:50.008327] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-18T21:07:50.011071] [INFO ] [REMOTE ] PKE: Full fetch complete (16759 records). [2025-09-18T21:07:50.011166] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-09-18T21:07:50.124631] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-09-18T21:07:50.389681] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-09-18T21:07:50.389773] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-09-18T21:07:50.390182] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-09-18T21:07:50.390268] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-09-18T21:07:50.390881] [DEBUG] [LOCAL ] PKE: Trimmed 16759 records to 12430 (keeping 200 days of data) [2025-09-18T21:07:50.470113] [DEBUG] [LOCAL ] PKE: Primary data saved (12430 records). [2025-09-18T21:07:50.470266] [INFO ] [MAIN ] PKE: Full history saved. [2025-09-18T21:07:50.470428] [INFO ] [MAIN ] Update Progress: 1694/2372 symbols completed. PKE took 32.0s. Estimated remaining: 1h 39m 10s. Rate: 6.8 symbols/min [2025-09-18T21:07:50.640248] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:07:50.666840] [DEBUG] [LOCAL ] PKX: Loaded 25446 existing records from primary storage. [2025-09-18T21:07:50.667038] [INFO ] [MAIN ] PKX: Loaded 25446 existing records. [2025-09-18T21:07:50.859676] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:07:50.860145] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-09-18T21:07:50.860242] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-09-18T21:07:50.861137] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-09-18T21:07:50.861207] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-09-18T21:07:50.926974] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-09-18T21:07:51.233413] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:07:51.719805] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-11. [2025-09-18T21:07:51.799905] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-18T21:07:51.813046] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-18T21:07:52.519552] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-09-18T21:07:53.089601] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-18T21:07:53.319613] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-09-18T21:07:54.119608] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-09-18T21:07:54.257899] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-18T21:07:54.535795] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-18T21:07:54.919576] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-09-18T21:07:55.264336] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-18T21:07:55.666185] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-18T21:07:55.719521] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-09-18T21:07:56.519518] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-09-18T21:07:56.802498] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-18T21:07:57.319537] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-09-18T21:07:57.976094] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T21:07:57.983272] [INFO ] [REMOTE ] PK: Full fetch complete (76210 records). [2025-09-18T21:07:57.983399] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-09-18T21:07:58.141489] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-09-18T21:07:58.326468] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-18T21:07:58.417670] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-09-18T21:07:58.417763] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-09-18T21:07:58.418790] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-09-18T21:07:58.418854] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-09-18T21:07:58.421174] [DEBUG] [LOCAL ] PK: Trimmed 76210 records to 53288 (keeping 200 days of data) [2025-09-18T21:07:58.748759] [DEBUG] [LOCAL ] PK: Primary data saved (53288 records). [2025-09-18T21:07:58.748900] [INFO ] [MAIN ] PK: Full history saved. [2025-09-18T21:07:58.749027] [INFO ] [MAIN ] Update Progress: 1695/2372 symbols completed. PK took 45.8s. Estimated remaining: 1h 39m 1s. Rate: 6.8 symbols/min [2025-09-18T21:07:58.921952] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:07:58.922034] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-09-18T21:07:58.977226] [DEBUG] [LOCAL ] PL: Loaded 53104 existing records from primary storage. [2025-09-18T21:07:58.977395] [INFO ] [MAIN ] PL: Loaded 53104 existing records. [2025-09-18T21:07:59.154392] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:07:59.154692] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-09-18T21:07:59.154753] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-09-18T21:07:59.155899] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-09-18T21:07:59.155959] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-09-18T21:07:59.521800] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:07:59.598414] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-18T21:07:59.719494] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-09-18T21:07:59.916890] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-18T21:07:59.921755] [INFO ] [REMOTE ] PKST: Full fetch complete (29726 records). [2025-09-18T21:07:59.921840] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-09-18T21:08:00.332361] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-09-18T21:08:00.332468] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-09-18T21:08:00.333183] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-09-18T21:08:00.333247] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-09-18T21:08:00.334031] [DEBUG] [LOCAL ] PKST: Trimmed 29726 records to 19749 (keeping 200 days of data) [2025-09-18T21:08:00.471027] [DEBUG] [LOCAL ] PKST: Primary data saved (19749 records). [2025-09-18T21:08:00.471182] [INFO ] [MAIN ] PKST: Full history saved. [2025-09-18T21:08:00.471325] [INFO ] [MAIN ] Update Progress: 1696/2372 symbols completed. PKST took 27.1s. Estimated remaining: 1h 38m 50s. Rate: 6.8 symbols/min [2025-09-18T21:08:00.531012] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-09-18T21:08:00.653522] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:08:00.716878] [DEBUG] [LOCAL ] PLD: Loaded 53486 existing records from primary storage. [2025-09-18T21:08:00.717048] [INFO ] [MAIN ] PLD: Loaded 53486 existing records. [2025-09-18T21:08:00.905051] [WARN ] [MAIN ] PLD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:08:00.905360] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-09-18T21:08:00.905410] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-09-18T21:08:00.906970] [DEBUG] [LOCAL ] PLD: Deleted primary data file. [2025-09-18T21:08:00.907034] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-09-18T21:08:01.356144] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-11. [2025-09-18T21:08:01.355976] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:08:01.383427] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-18T21:08:01.676550] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T21:08:02.119553] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-09-18T21:08:02.919518] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-11. [2025-09-18T21:08:03.033462] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-18T21:08:03.542929] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T21:08:03.719587] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-09-18T21:08:04.519605] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-09-18T21:08:04.569633] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T21:08:05.026967] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-18T21:08:05.319588] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-09-18T21:08:06.119565] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-09-18T21:08:06.643146] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-18T21:08:06.649214] [INFO ] [REMOTE ] PKG: Full fetch complete (57387 records). [2025-09-18T21:08:06.649429] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-09-18T21:08:06.919991] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-09-18T21:08:06.986747] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-18T21:08:07.116915] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present. [2025-09-18T21:08:07.117003] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed. [2025-09-18T21:08:07.117939] [INFO ] [MAIN ] PKG: Fetched primary data is valid. [2025-09-18T21:08:07.118005] [DEBUG] [LOCAL ] PKG: Saving primary data. [2025-09-18T21:08:07.119269] [DEBUG] [LOCAL ] PKG: Trimmed 57387 records to 39766 (keeping 200 days of data) [2025-09-18T21:08:07.396862] [DEBUG] [LOCAL ] PKG: Primary data saved (39766 records). [2025-09-18T21:08:07.413988] [INFO ] [MAIN ] PKG: Full history saved. [2025-09-18T21:08:07.414148] [INFO ] [MAIN ] Update Progress: 1697/2372 symbols completed. PKG took 37.7s. Estimated remaining: 1h 38m 40s. Rate: 6.8 symbols/min [2025-09-18T21:08:07.512471] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T21:08:07.618019] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:08:07.618239] [DEBUG] [LOCAL ] PLNT: No existing data file found in primary storage. [2025-09-18T21:08:07.618297] [WARN ] [MAIN ] PLNT: No existing data found, performing full refresh instead. [2025-09-18T21:08:07.618444] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-09-18T21:08:07.618487] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-09-18T21:08:07.618530] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-09-18T21:08:07.618562] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-09-18T21:08:07.724683] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-09-18T21:08:07.984282] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:08:08.519568] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-11. [2025-09-18T21:08:08.995824] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-18T21:08:09.319605] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-09-18T21:08:09.738165] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-18T21:08:10.095297] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-18T21:08:10.119499] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-09-18T21:08:10.919605] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-09-18T21:08:10.984829] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-18T21:08:11.705102] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-18T21:08:11.719498] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-09-18T21:08:12.519621] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-09-18T21:08:12.874097] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-18T21:08:13.319639] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-09-18T21:08:13.550900] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-18T21:08:13.987416] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-18T21:08:14.119591] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-09-18T21:08:14.919621] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-09-18T21:08:15.205876] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-18T21:08:15.719572] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-09-18T21:08:15.781031] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-18T21:08:16.519596] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-09-18T21:08:16.625246] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-18T21:08:16.701593] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-18T21:08:17.319585] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-09-18T21:08:18.119559] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-09-18T21:08:18.296138] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-18T21:08:18.351495] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-18T21:08:18.919575] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-09-18T21:08:19.601428] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T21:08:19.719581] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-09-18T21:08:20.058481] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-18T21:08:20.519539] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-09-18T21:08:21.211287] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-18T21:08:21.319581] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-09-18T21:08:22.107545] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T21:08:22.119499] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-09-18T21:08:22.584026] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-18T21:08:22.919592] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-09-18T21:08:23.168180] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-18T21:08:23.173929] [INFO ] [REMOTE ] PKX: Full fetch complete (38344 records). [2025-09-18T21:08:23.174075] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-09-18T21:08:23.563626] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-09-18T21:08:23.563758] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-09-18T21:08:23.564537] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-09-18T21:08:23.564612] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-09-18T21:08:23.566438] [DEBUG] [LOCAL ] PKX: Trimmed 38344 records to 25600 (keeping 200 days of data) [2025-09-18T21:08:23.726703] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-09-18T21:08:23.744947] [DEBUG] [LOCAL ] PKX: Primary data saved (25600 records). [2025-09-18T21:08:23.745395] [INFO ] [MAIN ] PKX: Full history saved. [2025-09-18T21:08:23.745496] [INFO ] [MAIN ] Update Progress: 1698/2372 symbols completed. PKX took 33.3s. Estimated remaining: 1h 38m 34s. Rate: 6.8 symbols/min [2025-09-18T21:08:23.914000] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:08:23.935466] [DEBUG] [LOCAL ] PLOW: Loaded 20777 existing records from primary storage. [2025-09-18T21:08:23.935621] [INFO ] [MAIN ] PLOW: Loaded 20777 existing records. [2025-09-18T21:08:24.118110] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:08:24.118414] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-09-18T21:08:24.118485] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-09-18T21:08:24.119160] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-09-18T21:08:24.119221] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-09-18T21:08:24.471685] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:08:24.519492] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-11. [2025-09-18T21:08:24.832988] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-18T21:08:25.236500] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-18T21:08:25.319545] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-09-18T21:08:25.511479] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-18T21:08:26.119555] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-09-18T21:08:26.919614] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-09-18T21:08:27.675237] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-18T21:08:27.719503] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-09-18T21:08:27.925122] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-18T21:08:27.957880] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-18T21:08:28.519572] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-09-18T21:08:29.319556] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-09-18T21:08:30.119588] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-09-18T21:08:30.260181] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-18T21:08:30.342112] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-18T21:08:30.415539] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-18T21:08:30.919552] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-09-18T21:08:31.732865] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-09-18T21:08:31.748291] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-18T21:08:32.519608] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-09-18T21:08:32.951145] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-18T21:08:33.319530] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-09-18T21:08:33.855341] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-18T21:08:33.938011] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-18T21:08:34.033985] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-18T21:08:34.119548] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-09-18T21:08:34.919539] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-09-18T21:08:34.995561] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-18T21:08:35.719560] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-09-18T21:08:36.434367] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-18T21:08:36.519531] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-09-18T21:08:36.655026] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-18T21:08:37.319561] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-09-18T21:08:37.872215] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-18T21:08:37.878785] [INFO ] [REMOTE ] PLNT: Full fetch complete (69922 records). [2025-09-18T21:08:37.878965] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-09-18T21:08:38.124749] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-09-18T21:08:38.281052] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present. [2025-09-18T21:08:38.281189] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed. [2025-09-18T21:08:38.282232] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-09-18T21:08:38.282296] [DEBUG] [LOCAL ] PLNT: Saving primary data. [2025-09-18T21:08:38.283779] [DEBUG] [LOCAL ] PLNT: Trimmed 69922 records to 48948 (keeping 200 days of data) [2025-09-18T21:08:38.582479] [DEBUG] [LOCAL ] PLNT: Primary data saved (48948 records). [2025-09-18T21:08:38.582616] [INFO ] [MAIN ] PLNT: Full history saved. [2025-09-18T21:08:38.582723] [INFO ] [MAIN ] Update Progress: 1699/2372 symbols completed. PLNT took 31.2s. Estimated remaining: 1h 38m 28s. Rate: 6.8 symbols/min [2025-09-18T21:08:38.752589] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:08:38.786465] [DEBUG] [LOCAL ] PLYM: Loaded 33009 existing records from primary storage. [2025-09-18T21:08:38.786600] [INFO ] [MAIN ] PLYM: Loaded 33009 existing records. [2025-09-18T21:08:38.929252] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-09-18T21:08:38.970380] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:08:38.970659] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-09-18T21:08:38.970739] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-09-18T21:08:38.971527] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-09-18T21:08:38.971587] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-09-18T21:08:39.341465] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:08:39.386965] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-18T21:08:39.395225] [INFO ] [REMOTE ] PL: Full fetch complete (76848 records). [2025-09-18T21:08:39.395405] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-09-18T21:08:39.720254] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-11. [2025-09-18T21:08:39.751970] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-18T21:08:39.858559] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-09-18T21:08:39.858737] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-09-18T21:08:39.860086] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-09-18T21:08:39.860180] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-09-18T21:08:39.862175] [DEBUG] [LOCAL ] PL: Trimmed 76848 records to 53494 (keeping 200 days of data) [2025-09-18T21:08:39.988394] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-18T21:08:40.220995] [DEBUG] [LOCAL ] PL: Primary data saved (53494 records). [2025-09-18T21:08:40.221156] [INFO ] [MAIN ] PL: Full history saved. [2025-09-18T21:08:40.221249] [INFO ] [MAIN ] Update Progress: 1700/2372 symbols completed. PL took 41.5s. Estimated remaining: 1h 38m 17s. Rate: 6.8 symbols/min [2025-09-18T21:08:40.417258] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:08:40.417488] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-09-18T21:08:40.417546] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-09-18T21:08:40.417729] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-09-18T21:08:40.417785] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-18T21:08:40.417828] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-09-18T21:08:40.417930] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-09-18T21:08:40.521738] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-09-18T21:08:40.781948] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:08:41.153384] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T21:08:41.319554] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-11. [2025-09-18T21:08:41.519131] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-18T21:08:42.119549] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-09-18T21:08:42.919526] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-09-18T21:08:43.181442] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-18T21:08:43.350272] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-11 (2.03 seconds). [2025-09-18T21:08:43.719617] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-09-18T21:08:44.519600] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-09-18T21:08:44.607580] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-18T21:08:44.615342] [INFO ] [REMOTE ] PLD: Full fetch complete (77282 records). [2025-09-18T21:08:44.615478] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-09-18T21:08:45.030520] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-09-18T21:08:45.030664] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-09-18T21:08:45.031876] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-09-18T21:08:45.032052] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-09-18T21:08:45.043915] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-18T21:08:45.049713] [DEBUG] [LOCAL ] PLD: Trimmed 77282 records to 53876 (keeping 200 days of data) [2025-09-18T21:08:45.346632] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-09-18T21:08:45.400615] [DEBUG] [LOCAL ] PLD: Primary data saved (53876 records). [2025-09-18T21:08:45.400807] [INFO ] [MAIN ] PLD: Full history saved. [2025-09-18T21:08:45.400900] [INFO ] [MAIN ] Update Progress: 1701/2372 symbols completed. PLD took 44.9s. Estimated remaining: 1h 38m 6s. Rate: 6.8 symbols/min [2025-09-18T21:08:45.572749] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:08:45.592861] [DEBUG] [LOCAL ] PML: Loaded 20318 existing records from primary storage. [2025-09-18T21:08:45.593002] [INFO ] [MAIN ] PML: Loaded 20318 existing records. [2025-09-18T21:08:45.780824] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:08:45.781372] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-09-18T21:08:45.781441] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-09-18T21:08:45.787331] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-09-18T21:08:45.797101] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-09-18T21:08:45.881229] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T21:08:46.124619] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-09-18T21:08:46.187839] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:08:46.371973] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-18T21:08:46.374726] [INFO ] [REMOTE ] PLOW: Full fetch complete (28885 records). [2025-09-18T21:08:46.374806] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-09-18T21:08:46.749577] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-09-18T21:08:46.749709] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-09-18T21:08:46.750393] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-09-18T21:08:46.750457] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-09-18T21:08:46.751506] [DEBUG] [LOCAL ] PLOW: Trimmed 28885 records to 20914 (keeping 200 days of data) [2025-09-18T21:08:46.889920] [DEBUG] [LOCAL ] PLOW: Primary data saved (20914 records). [2025-09-18T21:08:46.890124] [INFO ] [MAIN ] PLOW: Full history saved. [2025-09-18T21:08:46.890271] [INFO ] [MAIN ] Update Progress: 1702/2372 symbols completed. PLOW took 23.1s. Estimated remaining: 1h 37m 55s. Rate: 6.8 symbols/min [2025-09-18T21:08:46.924773] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-11. [2025-09-18T21:08:47.074631] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:08:47.087011] [DEBUG] [LOCAL ] PMM: Loaded 10771 existing records from primary storage. [2025-09-18T21:08:47.087141] [INFO ] [MAIN ] PMM: Loaded 10771 existing records. [2025-09-18T21:08:47.265377] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:08:47.265722] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-09-18T21:08:47.265782] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-09-18T21:08:47.266125] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-09-18T21:08:47.266183] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-09-18T21:08:47.626536] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:08:47.719513] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-11. [2025-09-18T21:08:47.960169] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-18T21:08:47.994841] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-18T21:08:48.519538] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-09-18T21:08:48.531780] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-18T21:08:49.319566] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-09-18T21:08:49.714110] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-18T21:08:50.119574] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-09-18T21:08:50.919535] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-09-18T21:08:51.269978] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-18T21:08:51.331691] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-18T21:08:51.722391] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-09-18T21:08:51.729690] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-18T21:08:52.519539] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-09-18T21:08:53.253391] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T21:08:53.319509] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-09-18T21:08:53.502142] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-18T21:08:54.119581] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-09-18T21:08:54.755947] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-18T21:08:54.782535] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-18T21:08:54.919759] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-09-18T21:08:55.719556] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-09-18T21:08:56.045708] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-18T21:08:56.379084] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-18T21:08:56.519547] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-09-18T21:08:57.319600] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-09-18T21:08:58.119562] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-09-18T21:08:58.322241] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-18T21:08:58.356234] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-18T21:08:58.919574] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-09-18T21:08:59.272243] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-18T21:08:59.719572] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-09-18T21:09:00.519570] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-09-18T21:09:00.742504] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-18T21:09:00.917785] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-18T21:09:01.319594] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-09-18T21:09:02.002108] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T21:09:02.119573] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-09-18T21:09:02.919558] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-09-18T21:09:03.497805] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-18T21:09:03.719587] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-09-18T21:09:04.519561] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-09-18T21:09:04.788702] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-18T21:09:04.941339] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-09-18T21:09:05.311219] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-18T21:09:05.319491] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-09-18T21:09:05.940183] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (3.02 seconds). [2025-09-18T21:09:06.099920] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-18T21:09:06.119582] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-09-18T21:09:06.919623] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-09-18T21:09:07.713317] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-18T21:09:07.719620] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-09-18T21:09:07.720006] [INFO ] [REMOTE ] PLYM: Full fetch complete (45981 records). [2025-09-18T21:09:07.720454] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-09-18T21:09:08.035694] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-18T21:09:08.165454] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-09-18T21:09:08.165560] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-09-18T21:09:08.166452] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-09-18T21:09:08.166521] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-09-18T21:09:08.167808] [DEBUG] [LOCAL ] PLYM: Trimmed 45981 records to 33320 (keeping 200 days of data) [2025-09-18T21:09:08.383440] [DEBUG] [LOCAL ] PLYM: Primary data saved (33320 records). [2025-09-18T21:09:08.383615] [INFO ] [MAIN ] PLYM: Full history saved. [2025-09-18T21:09:08.383747] [INFO ] [MAIN ] Update Progress: 1703/2372 symbols completed. PLYM took 29.8s. Estimated remaining: 1h 37m 51s. Rate: 6.8 symbols/min [2025-09-18T21:09:08.524635] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-09-18T21:09:08.597757] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:09:08.609338] [DEBUG] [LOCAL ] PMO: Loaded 10752 existing records from primary storage. [2025-09-18T21:09:08.609446] [INFO ] [MAIN ] PMO: Loaded 10752 existing records. [2025-09-18T21:09:08.789561] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:09:08.790028] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-09-18T21:09:08.790123] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-09-18T21:09:08.799261] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-09-18T21:09:08.799876] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-09-18T21:09:08.800174] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-18T21:09:09.163473] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:09:09.319541] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-11. [2025-09-18T21:09:10.119563] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-09-18T21:09:10.443740] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T21:09:10.565310] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-18T21:09:10.859878] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-18T21:09:10.919501] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-09-18T21:09:11.719589] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-09-18T21:09:11.771267] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-18T21:09:12.519537] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-09-18T21:09:13.319554] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-09-18T21:09:14.119518] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-09-18T21:09:14.417769] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-18T21:09:14.572682] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-18T21:09:14.606064] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (2.89 seconds). [2025-09-18T21:09:14.919601] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-09-18T21:09:15.013559] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-18T21:09:15.719564] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-09-18T21:09:16.078901] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-18T21:09:16.519560] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-09-18T21:09:17.319617] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-09-18T21:09:17.376550] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-18T21:09:17.744512] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-18T21:09:18.119559] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-09-18T21:09:18.185610] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-18T21:09:18.190190] [INFO ] [REMOTE ] PML: Full fetch complete (29602 records). [2025-09-18T21:09:18.190287] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-09-18T21:09:18.568947] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-09-18T21:09:18.569060] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-09-18T21:09:18.569704] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-09-18T21:09:18.569766] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-09-18T21:09:18.570556] [DEBUG] [LOCAL ] PML: Trimmed 29602 records to 20510 (keeping 200 days of data) [2025-09-18T21:09:18.667813] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-18T21:09:18.706265] [DEBUG] [LOCAL ] PML: Primary data saved (20510 records). [2025-09-18T21:09:18.706432] [INFO ] [MAIN ] PML: Full history saved. [2025-09-18T21:09:18.706535] [INFO ] [MAIN ] Update Progress: 1704/2372 symbols completed. PML took 33.3s. Estimated remaining: 1h 37m 43s. Rate: 6.8 symbols/min [2025-09-18T21:09:18.877323] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:09:18.919109] [DEBUG] [LOCAL ] PMT: Loaded 40272 existing records from primary storage. [2025-09-18T21:09:18.919265] [INFO ] [MAIN ] PMT: Loaded 40272 existing records. [2025-09-18T21:09:18.924675] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-09-18T21:09:19.122051] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:09:19.122311] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-09-18T21:09:19.122364] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-09-18T21:09:19.123740] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-09-18T21:09:19.123801] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-09-18T21:09:19.498038] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:09:19.680487] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-18T21:09:19.719542] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-09-18T21:09:20.484549] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-18T21:09:20.519518] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-09-18T21:09:21.330934] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-09-18T21:09:21.333740] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-18T21:09:21.341159] [INFO ] [REMOTE ] PM: Full fetch complete (77202 records). [2025-09-18T21:09:21.341299] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-09-18T21:09:21.342284] [FATAL] [VALIDATOR ] PM: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T21:09:21.342377] [FATAL] [MAIN ] PM: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:09:21.342423] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:09:21.342466] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-18T21:09:21.342571] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-09-18T21:09:21.342632] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-09-18T21:09:21.342735] [DEBUG] [LOCAL ] PM: No derivative data file found to delete. [2025-09-18T21:09:21.342822] [INFO ] [MAIN ] Update Progress: 1705/2372 symbols completed. PM took 41.1s. Estimated remaining: 1h 37m 32s. Rate: 6.8 symbols/min [2025-09-18T21:09:21.529049] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:09:21.529255] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-09-18T21:09:21.529313] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-09-18T21:09:21.529463] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-09-18T21:09:21.529507] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-18T21:09:21.529551] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-18T21:09:21.529586] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-09-18T21:09:21.910792] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:09:22.119530] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-11. [2025-09-18T21:09:22.200206] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-18T21:09:22.448292] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-18T21:09:22.919561] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-09-18T21:09:23.719575] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-11. [2025-09-18T21:09:24.519619] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-09-18T21:09:24.716371] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-18T21:09:25.039982] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-18T21:09:25.319621] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-09-18T21:09:25.957511] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-18T21:09:25.960138] [INFO ] [REMOTE ] PMM: Full fetch complete (18397 records). [2025-09-18T21:09:25.960241] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-09-18T21:09:26.127499] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-09-18T21:09:26.354566] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-09-18T21:09:26.354700] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-09-18T21:09:26.355134] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-09-18T21:09:26.355308] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-09-18T21:09:26.356220] [DEBUG] [LOCAL ] PMM: Trimmed 18397 records to 10814 (keeping 200 days of data) [2025-09-18T21:09:26.429532] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-11 (2.71 seconds). [2025-09-18T21:09:26.459702] [DEBUG] [LOCAL ] PMM: Primary data saved (10814 records). [2025-09-18T21:09:26.459865] [INFO ] [MAIN ] PMM: Full history saved. [2025-09-18T21:09:26.459960] [INFO ] [MAIN ] Update Progress: 1706/2372 symbols completed. PMM took 39.6s. Estimated remaining: 1h 37m 21s. Rate: 6.8 symbols/min [2025-09-18T21:09:26.612939] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-18T21:09:26.639919] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:09:26.640117] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-09-18T21:09:26.640171] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-09-18T21:09:26.640315] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-09-18T21:09:26.640358] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-18T21:09:26.640411] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-18T21:09:26.640483] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-09-18T21:09:26.924766] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-18T21:09:27.020910] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:09:27.315293] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-18T21:09:27.719597] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-09-18T21:09:28.391135] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-18T21:09:28.519576] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-09-18T21:09:29.319578] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-09-18T21:09:29.858522] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T21:09:29.965093] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-18T21:09:30.119546] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-09-18T21:09:30.919548] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-09-18T21:09:30.955062] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-18T21:09:31.719541] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-09-18T21:09:32.230490] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-18T21:09:32.256938] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-18T21:09:32.519546] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-09-18T21:09:33.319551] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-09-18T21:09:33.996675] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-18T21:09:34.041346] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-18T21:09:34.043544] [INFO ] [REMOTE ] PMO: Full fetch complete (17562 records). [2025-09-18T21:09:34.043673] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-09-18T21:09:34.124737] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-18T21:09:34.423449] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-09-18T21:09:34.423566] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-09-18T21:09:34.424066] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-09-18T21:09:34.424167] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-09-18T21:09:34.424750] [DEBUG] [LOCAL ] PMO: Trimmed 17562 records to 10785 (keeping 200 days of data) [2025-09-18T21:09:34.490276] [DEBUG] [LOCAL ] PMO: Primary data saved (10785 records). [2025-09-18T21:09:34.490434] [INFO ] [MAIN ] PMO: Full history saved. [2025-09-18T21:09:34.490548] [INFO ] [MAIN ] Update Progress: 1707/2372 symbols completed. PMO took 26.1s. Estimated remaining: 1h 37m 12s. Rate: 6.8 symbols/min [2025-09-18T21:09:34.569767] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-18T21:09:34.666349] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:09:34.666546] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-09-18T21:09:34.666583] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-09-18T21:09:34.666754] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-09-18T21:09:34.666802] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-18T21:09:34.666843] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-18T21:09:34.666874] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-09-18T21:09:34.924721] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-18T21:09:35.020192] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:09:35.448823] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-18T21:09:35.719556] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-09-18T21:09:36.519546] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-11. [2025-09-18T21:09:36.792092] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:09:36.792453] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-11 [2025-09-18T21:09:37.126992] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-18T21:09:37.319571] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-11. [2025-09-18T21:09:37.572880] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:09:37.573972] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-11 [2025-09-18T21:09:38.119553] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-09-18T21:09:38.437917] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:09:38.438270] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-09-18T21:09:38.919549] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-01. [2025-09-18T21:09:39.201347] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:09:39.201888] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-01 [2025-09-18T21:09:39.719575] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-09-18T21:09:40.519554] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-02. [2025-09-18T21:09:40.836578] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:09:40.836987] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-02 [2025-09-18T21:09:41.319591] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-03. [2025-09-18T21:09:41.560883] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-18T21:09:41.595331] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:09:41.595637] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-03 [2025-09-18T21:09:42.119544] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-04. [2025-09-18T21:09:42.434851] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:09:42.435178] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-04 [2025-09-18T21:09:42.919547] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-05. [2025-09-18T21:09:43.198401] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:09:43.198779] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-05 [2025-09-18T21:09:43.719553] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-09-18T21:09:44.015508] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:09:44.015879] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-09-18T21:09:44.519553] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-09-18T21:09:45.319558] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-18T21:09:45.704219] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-18T21:09:45.929039] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-18T21:09:46.119606] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-18T21:09:46.521046] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-18T21:09:46.919568] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-09-18T21:09:47.719558] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-18T21:09:48.162241] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-18T21:09:48.187694] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-18T21:09:48.519552] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-06. [2025-09-18T21:09:49.061533] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-18T21:09:49.319550] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-18T21:09:49.719141] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-18T21:09:50.119546] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-18T21:09:50.587559] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-18T21:09:50.588481] [INFO ] [REMOTE ] PMTU: Full fetch complete (1198 records). [2025-09-18T21:09:50.588558] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-09-18T21:09:50.770931] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-09-18T21:09:50.771155] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:09:50.771223] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:09:50.771297] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-18T21:09:50.771394] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-18T21:09:50.771451] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-09-18T21:09:50.771508] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-09-18T21:09:50.771609] [INFO ] [MAIN ] Update Progress: 1708/2372 symbols completed. PMTU took 29.4s. Estimated remaining: 1h 37m 6s. Rate: 6.8 symbols/min [2025-09-18T21:09:50.928517] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-09-18T21:09:50.946801] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:09:50.947054] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-09-18T21:09:50.947111] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-09-18T21:09:50.947254] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-09-18T21:09:50.947297] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-18T21:09:50.947339] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-09-18T21:09:50.947372] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-09-18T21:09:51.316051] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:09:51.719557] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-07. [2025-09-18T21:09:52.495351] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-18T21:09:52.519509] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-08. [2025-09-18T21:09:52.656991] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-18T21:09:53.057892] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-18T21:09:53.319547] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-01. [2025-09-18T21:09:53.578887] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:09:53.579323] [WARN ] [REMOTE ] PMTV: No data returned for month 2025-01 [2025-09-18T21:09:54.119551] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-02. [2025-09-18T21:09:54.753088] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-18T21:09:54.919541] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-03. [2025-09-18T21:09:55.472324] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-18T21:09:55.719541] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-04. [2025-09-18T21:09:56.305530] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-18T21:09:56.519556] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-09. [2025-09-18T21:09:57.077003] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-18T21:09:57.078306] [INFO ] [REMOTE ] PMTW: Full fetch complete (3617 records). [2025-09-18T21:09:57.078409] [DEBUG] [VALIDATOR ] PMTW: Validating primary data. [2025-09-18T21:09:57.270405] [WARN ] [VALIDATOR ] PMTW: Validation failed - insufficient historical data. Have 68 unique days, need 200 days [2025-09-18T21:09:57.270685] [FATAL] [MAIN ] PMTW: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:09:57.270749] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:09:57.270797] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-18T21:09:57.270909] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-18T21:09:57.270967] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-09-18T21:09:57.271010] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-09-18T21:09:57.271107] [INFO ] [MAIN ] Update Progress: 1709/2372 symbols completed. PMTW took 22.8s. Estimated remaining: 1h 36m 57s. Rate: 6.8 symbols/min [2025-09-18T21:09:57.326347] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-05. [2025-09-18T21:09:57.469797] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:09:57.478730] [DEBUG] [LOCAL ] PNI: Loaded 6795 existing records from primary storage. [2025-09-18T21:09:57.478845] [INFO ] [MAIN ] PNI: Loaded 6795 existing records. [2025-09-18T21:09:57.670260] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:09:57.670547] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-09-18T21:09:57.670597] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-09-18T21:09:57.671012] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-09-18T21:09:57.671073] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-09-18T21:09:58.059586] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:09:58.066523] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-18T21:09:58.119531] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-06. [2025-09-18T21:09:58.883153] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-18T21:09:58.919499] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-07. [2025-09-18T21:09:59.439531] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-18T21:09:59.719549] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-08. [2025-09-18T21:10:00.351368] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T21:10:00.519555] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-09. [2025-09-18T21:10:01.101919] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-18T21:10:01.103228] [INFO ] [REMOTE ] PMTV: Full fetch complete (6045 records). [2025-09-18T21:10:01.103370] [DEBUG] [VALIDATOR ] PMTV: Validating primary data. [2025-09-18T21:10:01.311787] [WARN ] [VALIDATOR ] PMTV: Validation failed - insufficient historical data. Have 149 unique days, need 200 days [2025-09-18T21:10:01.312149] [FATAL] [MAIN ] PMTV: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:10:01.312286] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:10:01.312376] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-18T21:10:01.312476] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-18T21:10:01.312517] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-09-18T21:10:01.312558] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-09-18T21:10:01.312673] [INFO ] [MAIN ] Update Progress: 1710/2372 symbols completed. PMTV took 34.9s. Estimated remaining: 1h 36m 46s. Rate: 6.8 symbols/min [2025-09-18T21:10:01.324758] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-09-18T21:10:01.518992] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:10:01.563196] [DEBUG] [LOCAL ] PNNT: Loaded 33012 existing records from primary storage. [2025-09-18T21:10:01.563364] [INFO ] [MAIN ] PNNT: Loaded 33012 existing records. [2025-09-18T21:10:01.754347] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:10:01.754621] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-09-18T21:10:01.754710] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-09-18T21:10:01.755859] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-09-18T21:10:01.755921] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-09-18T21:10:02.119002] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:10:02.119490] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-11. [2025-09-18T21:10:02.919558] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-11. [2025-09-18T21:10:03.088603] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-18T21:10:03.228676] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-18T21:10:03.719596] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-09-18T21:10:04.519588] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-09-18T21:10:04.649525] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-18T21:10:05.221709] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T21:10:05.319504] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-11. [2025-09-18T21:10:05.577382] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-18T21:10:05.582861] [INFO ] [REMOTE ] PMT: Full fetch complete (57954 records). [2025-09-18T21:10:05.582977] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-09-18T21:10:05.900992] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-18T21:10:05.985881] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-09-18T21:10:05.985969] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-09-18T21:10:05.986888] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-09-18T21:10:05.986974] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-09-18T21:10:05.989805] [DEBUG] [LOCAL ] PMT: Trimmed 57954 records to 40647 (keeping 200 days of data) [2025-09-18T21:10:06.119800] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-09-18T21:10:06.257632] [DEBUG] [LOCAL ] PMT: Primary data saved (40647 records). [2025-09-18T21:10:06.257792] [INFO ] [MAIN ] PMT: Full history saved. [2025-09-18T21:10:06.257918] [INFO ] [MAIN ] Update Progress: 1711/2372 symbols completed. PMT took 47.6s. Estimated remaining: 1h 36m 36s. Rate: 6.8 symbols/min [2025-09-18T21:10:06.433548] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:10:06.433848] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-09-18T21:10:06.433906] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-09-18T21:10:06.434062] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-09-18T21:10:06.434140] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-18T21:10:06.434210] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-18T21:10:06.434246] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-09-18T21:10:06.784253] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:10:06.919515] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-11. [2025-09-18T21:10:07.389153] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-18T21:10:07.719558] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-09-18T21:10:08.422978] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-18T21:10:08.519572] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-09-18T21:10:09.132080] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T21:10:09.319603] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-09-18T21:10:09.909573] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T21:10:10.119526] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-09-18T21:10:10.592477] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-18T21:10:10.919581] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-09-18T21:10:11.561782] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-18T21:10:11.606474] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-18T21:10:11.719594] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-09-18T21:10:12.519592] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-09-18T21:10:13.319520] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-09-18T21:10:13.395884] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-18T21:10:14.031950] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-18T21:10:14.059499] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T21:10:14.119531] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-09-18T21:10:14.919548] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-09-18T21:10:15.527859] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-18T21:10:15.719615] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-09-18T21:10:15.829154] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-18T21:10:16.519549] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-09-18T21:10:17.319549] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-09-18T21:10:17.470730] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-18T21:10:18.119577] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-09-18T21:10:18.251630] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-18T21:10:18.777521] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T21:10:18.919553] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-09-18T21:10:19.421662] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-18T21:10:19.724740] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-09-18T21:10:19.742595] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-18T21:10:20.349678] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-18T21:10:20.519522] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-09-18T21:10:21.319560] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-09-18T21:10:22.119580] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-09-18T21:10:22.391200] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-18T21:10:22.412743] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-18T21:10:22.919567] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-09-18T21:10:23.612692] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T21:10:23.719554] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-09-18T21:10:24.261393] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-18T21:10:24.519588] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-09-18T21:10:25.319595] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-09-18T21:10:25.727497] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-18T21:10:25.757135] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T21:10:26.119587] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-09-18T21:10:26.872106] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-18T21:10:26.919517] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-09-18T21:10:27.538219] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-18T21:10:27.543114] [INFO ] [REMOTE ] PNNT: Full fetch complete (47380 records). [2025-09-18T21:10:27.543232] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-09-18T21:10:27.721311] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-09-18T21:10:27.939712] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-09-18T21:10:27.939889] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-09-18T21:10:27.940727] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-09-18T21:10:27.940790] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-09-18T21:10:27.943718] [DEBUG] [LOCAL ] PNNT: Trimmed 47380 records to 33225 (keeping 200 days of data) [2025-09-18T21:10:28.146345] [DEBUG] [LOCAL ] PNNT: Primary data saved (33225 records). [2025-09-18T21:10:28.146490] [INFO ] [MAIN ] PNNT: Full history saved. [2025-09-18T21:10:28.146624] [INFO ] [MAIN ] Update Progress: 1712/2372 symbols completed. PNNT took 26.8s. Estimated remaining: 1h 36m 32s. Rate: 6.8 symbols/min [2025-09-18T21:10:28.320931] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:10:28.376556] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T21:10:28.400490] [DEBUG] [LOCAL ] PNW: Loaded 46133 existing records from primary storage. [2025-09-18T21:10:28.400631] [INFO ] [MAIN ] PNW: Loaded 46133 existing records. [2025-09-18T21:10:28.524625] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-09-18T21:10:28.586873] [WARN ] [MAIN ] PNW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:10:28.587131] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-09-18T21:10:28.587188] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-09-18T21:10:28.588518] [DEBUG] [LOCAL ] PNW: Deleted primary data file. [2025-09-18T21:10:28.588580] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-09-18T21:10:28.957961] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:10:29.319548] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-11. [2025-09-18T21:10:29.853388] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-18T21:10:30.000786] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T21:10:30.119498] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-09-18T21:10:30.886870] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-18T21:10:30.919498] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-09-18T21:10:31.578692] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-18T21:10:31.719583] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-09-18T21:10:31.860346] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-18T21:10:32.519586] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-09-18T21:10:33.319547] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-09-18T21:10:33.474594] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-18T21:10:34.119576] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-09-18T21:10:34.169507] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-18T21:10:34.202263] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-18T21:10:34.429201] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-18T21:10:34.435366] [INFO ] [REMOTE ] PNR: Full fetch complete (68827 records). [2025-09-18T21:10:34.435492] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-09-18T21:10:34.438238] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T21:10:34.438376] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:10:34.438462] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:10:34.438551] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-18T21:10:34.438667] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-18T21:10:34.438748] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-09-18T21:10:34.438817] [DEBUG] [LOCAL ] PNR: No derivative data file found to delete. [2025-09-18T21:10:34.438887] [INFO ] [MAIN ] Update Progress: 1713/2372 symbols completed. PNR took 28.2s. Estimated remaining: 1h 36m 23s. Rate: 6.8 symbols/min [2025-09-18T21:10:34.610126] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:10:34.654999] [DEBUG] [LOCAL ] POR: Loaded 46973 existing records from primary storage. [2025-09-18T21:10:34.655146] [INFO ] [MAIN ] POR: Loaded 46973 existing records. [2025-09-18T21:10:34.838556] [WARN ] [MAIN ] POR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:10:34.838845] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-09-18T21:10:34.838904] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-09-18T21:10:34.840377] [DEBUG] [LOCAL ] POR: Deleted primary data file. [2025-09-18T21:10:34.840439] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-09-18T21:10:34.924612] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-09-18T21:10:35.217007] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:10:35.719615] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-09-18T21:10:36.435501] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T21:10:36.519623] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-11. [2025-09-18T21:10:36.688770] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-18T21:10:37.319560] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-09-18T21:10:37.791975] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T21:10:38.119560] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-09-18T21:10:38.697495] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-18T21:10:38.701005] [INFO ] [REMOTE ] PNI: Full fetch complete (10100 records). [2025-09-18T21:10:38.701122] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-09-18T21:10:38.922782] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-09-18T21:10:38.919082] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-18T21:10:39.160317] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-09-18T21:10:39.160409] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-09-18T21:10:39.160702] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-09-18T21:10:39.160768] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-09-18T21:10:39.161228] [DEBUG] [LOCAL ] PNI: Trimmed 10100 records to 6842 (keeping 200 days of data) [2025-09-18T21:10:39.209148] [DEBUG] [LOCAL ] PNI: Primary data saved (6842 records). [2025-09-18T21:10:39.209295] [INFO ] [MAIN ] PNI: Full history saved. [2025-09-18T21:10:39.209436] [INFO ] [MAIN ] Update Progress: 1714/2372 symbols completed. PNI took 41.9s. Estimated remaining: 1h 36m 12s. Rate: 6.8 symbols/min [2025-09-18T21:10:39.401623] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:10:39.460972] [DEBUG] [LOCAL ] POST: Loaded 38969 existing records from primary storage. [2025-09-18T21:10:39.461147] [INFO ] [MAIN ] POST: Loaded 38969 existing records. [2025-09-18T21:10:39.656498] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:10:39.656840] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-09-18T21:10:39.656911] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-09-18T21:10:39.657976] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-09-18T21:10:39.658062] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-09-18T21:10:39.727313] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-09-18T21:10:40.061031] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:10:40.519556] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-11. [2025-09-18T21:10:40.680553] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-18T21:10:41.319512] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-09-18T21:10:41.457115] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-18T21:10:41.783141] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-18T21:10:42.119574] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-09-18T21:10:42.782852] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-18T21:10:42.919539] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-09-18T21:10:43.719539] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-09-18T21:10:43.784686] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-18T21:10:44.519548] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-09-18T21:10:44.641457] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-18T21:10:44.950670] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T21:10:45.080384] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-18T21:10:45.319553] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-09-18T21:10:45.827134] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-18T21:10:45.833697] [INFO ] [REMOTE ] PNC: Full fetch complete (75012 records). [2025-09-18T21:10:45.833822] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-09-18T21:10:45.834796] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T21:10:45.834888] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:10:45.834971] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:10:45.835045] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-18T21:10:45.835125] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-09-18T21:10:45.835185] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-09-18T21:10:45.835231] [DEBUG] [LOCAL ] PNC: No derivative data file found to delete. [2025-09-18T21:10:45.835293] [INFO ] [MAIN ] Update Progress: 1715/2372 symbols completed. PNC took 55.1s. Estimated remaining: 1h 36m 3s. Rate: 6.8 symbols/min [2025-09-18T21:10:46.008795] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:10:46.081137] [DEBUG] [LOCAL ] PPG: Loaded 50749 existing records from primary storage. [2025-09-18T21:10:46.081286] [INFO ] [MAIN ] PPG: Loaded 50749 existing records. [2025-09-18T21:10:46.124753] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-09-18T21:10:46.274279] [WARN ] [MAIN ] PPG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:10:46.274545] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-09-18T21:10:46.274595] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-09-18T21:10:46.275754] [DEBUG] [LOCAL ] PPG: Deleted primary data file. [2025-09-18T21:10:46.275813] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-09-18T21:10:46.646195] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:10:46.919550] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-09-18T21:10:47.701767] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T21:10:47.719490] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-09-18T21:10:48.524762] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-11. [2025-09-18T21:10:48.539173] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-18T21:10:48.910223] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-18T21:10:49.319555] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-09-18T21:10:49.850558] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-18T21:10:50.119602] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-09-18T21:10:50.869612] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-18T21:10:50.919496] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-09-18T21:10:51.719554] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-09-18T21:10:51.949216] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-18T21:10:52.344319] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-18T21:10:52.519539] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-09-18T21:10:53.162510] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-18T21:10:53.319541] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-09-18T21:10:53.873885] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-18T21:10:54.119565] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-09-18T21:10:54.682568] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T21:10:54.919567] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-09-18T21:10:55.719545] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-09-18T21:10:55.752884] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-18T21:10:56.505315] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-18T21:10:56.519485] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-09-18T21:10:56.997079] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-18T21:10:57.319534] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-09-18T21:10:58.119545] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-09-18T21:10:58.340837] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-18T21:10:58.563148] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-18T21:10:58.919546] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-09-18T21:10:59.510315] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-18T21:10:59.719563] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-09-18T21:11:00.519633] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-09-18T21:11:00.978580] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-18T21:11:01.241286] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-18T21:11:01.319527] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-09-18T21:11:01.634558] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-18T21:11:02.119611] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-09-18T21:11:02.919707] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-09-18T21:11:03.119048] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-18T21:11:03.427815] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-18T21:11:03.719562] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-09-18T21:11:04.501787] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-18T21:11:04.519495] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-09-18T21:11:05.319549] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-09-18T21:11:05.573520] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-18T21:11:05.867908] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-18T21:11:06.119555] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-09-18T21:11:06.919518] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-09-18T21:11:06.982570] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T21:11:07.280542] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-18T21:11:07.286496] [INFO ] [REMOTE ] POST: Full fetch complete (55629 records). [2025-09-18T21:11:07.286599] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-09-18T21:11:07.730416] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-09-18T21:11:07.727326] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-09-18T21:11:07.731628] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-09-18T21:11:07.732599] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-09-18T21:11:07.732811] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-09-18T21:11:07.734559] [DEBUG] [LOCAL ] POST: Trimmed 55629 records to 39219 (keeping 200 days of data) [2025-09-18T21:11:07.996496] [DEBUG] [LOCAL ] POST: Primary data saved (39219 records). [2025-09-18T21:11:07.996714] [INFO ] [MAIN ] POST: Full history saved. [2025-09-18T21:11:07.996838] [INFO ] [MAIN ] Update Progress: 1716/2372 symbols completed. POST took 28.8s. Estimated remaining: 1h 35m 59s. Rate: 6.8 symbols/min [2025-09-18T21:11:08.175214] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:11:08.175436] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-09-18T21:11:08.175492] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-09-18T21:11:08.175673] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-09-18T21:11:08.175729] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-18T21:11:08.175774] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-09-18T21:11:08.175807] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-09-18T21:11:08.527174] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-09-18T21:11:08.549728] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:11:08.605842] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-18T21:11:09.319591] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-09-18T21:11:09.564664] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-18T21:11:09.749293] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-18T21:11:09.757122] [INFO ] [REMOTE ] PNW: Full fetch complete (66125 records). [2025-09-18T21:11:09.757302] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-09-18T21:11:10.121138] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-09-18T21:11:10.152178] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-09-18T21:11:10.152299] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-09-18T21:11:10.153323] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-09-18T21:11:10.153518] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-09-18T21:11:10.155130] [DEBUG] [LOCAL ] PNW: Trimmed 66125 records to 46459 (keeping 200 days of data) [2025-09-18T21:11:10.446809] [DEBUG] [LOCAL ] PNW: Primary data saved (46459 records). [2025-09-18T21:11:10.446955] [INFO ] [MAIN ] PNW: Full history saved. [2025-09-18T21:11:10.447056] [INFO ] [MAIN ] Update Progress: 1717/2372 symbols completed. PNW took 42.3s. Estimated remaining: 1h 35m 48s. Rate: 6.8 symbols/min [2025-09-18T21:11:10.644159] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-18T21:11:10.651815] [INFO ] [REMOTE ] POR: Full fetch complete (67609 records). [2025-09-18T21:11:10.651978] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-09-18T21:11:10.924863] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-11. [2025-09-18T21:11:11.127816] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-09-18T21:11:11.127939] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-09-18T21:11:11.129288] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-09-18T21:11:11.129372] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-09-18T21:11:11.131629] [DEBUG] [LOCAL ] POR: Trimmed 67609 records to 47313 (keeping 200 days of data) [2025-09-18T21:11:11.431400] [DEBUG] [LOCAL ] POR: Primary data saved (47313 records). [2025-09-18T21:11:11.431543] [INFO ] [MAIN ] POR: Full history saved. [2025-09-18T21:11:11.431630] [INFO ] [MAIN ] Update Progress: 1718/2372 symbols completed. POR took 37.0s. Estimated remaining: 1h 35m 36s. Rate: 6.8 symbols/min [2025-09-18T21:11:11.993438] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-18T21:11:12.010035] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-09-18T21:11:12.715611] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-18T21:11:12.726534] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-09-18T21:11:13.575388] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-18T21:11:13.586624] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-09-18T21:11:14.272095] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-18T21:11:14.283803] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-09-18T21:11:15.423432] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-18T21:11:15.434343] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-09-18T21:11:15.845857] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-18T21:11:15.856459] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-09-18T21:11:17.192305] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-18T21:11:17.199429] [INFO ] [REMOTE ] PPG: Full fetch complete (73561 records). [2025-09-18T21:11:17.199566] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-09-18T21:11:17.612214] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-09-18T21:11:17.612409] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-09-18T21:11:17.613691] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-09-18T21:11:17.613779] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-09-18T21:11:17.643455] [DEBUG] [LOCAL ] PPG: Trimmed 73561 records to 51114 (keeping 200 days of data) [2025-09-18T21:11:17.644763] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-18T21:11:17.656357] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-09-18T21:11:18.002672] [DEBUG] [LOCAL ] PPG: Primary data saved (51114 records). [2025-09-18T21:11:18.002845] [INFO ] [MAIN ] PPG: Full history saved. [2025-09-18T21:11:18.002951] [INFO ] [MAIN ] Update Progress: 1719/2372 symbols completed. PPG took 32.2s. Estimated remaining: 1h 35m 26s. Rate: 6.8 symbols/min [2025-09-18T21:11:19.274243] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-18T21:11:19.285895] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-09-18T21:11:20.918432] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-18T21:11:20.932429] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-09-18T21:11:22.608026] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-18T21:11:22.619569] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-09-18T21:11:24.452234] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-18T21:11:24.463816] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-09-18T21:11:26.116835] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-18T21:11:26.129254] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-09-18T21:11:27.905454] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-18T21:11:27.917286] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-09-18T21:11:28.319542] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-18T21:11:28.327682] [INFO ] [REMOTE ] PPL: Full fetch complete (76865 records). [2025-09-18T21:11:28.327888] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-09-18T21:11:28.328888] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T21:11:28.329022] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:11:28.329067] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:11:28.329104] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-18T21:11:28.329245] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-09-18T21:11:28.329305] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-09-18T21:11:28.329376] [DEBUG] [LOCAL ] PPL: No derivative data file found to delete. [2025-09-18T21:11:28.329464] [INFO ] [MAIN ] Update Progress: 1720/2372 symbols completed. PPL took 20.3s. Estimated remaining: 1h 35m 18s. Rate: 6.8 symbols/min [2025-09-18T21:11:29.218594] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:11:29.309314] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:11:29.329034] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:11:29.395237] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:11:29.395878] [DEBUG] [LOCAL ] PRCS: No existing data file found in primary storage. [2025-09-18T21:11:29.395960] [WARN ] [MAIN ] PRCS: No existing data found, performing full refresh instead. [2025-09-18T21:11:29.396210] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-09-18T21:11:29.396266] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-18T21:11:29.396349] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-18T21:11:29.396428] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-09-18T21:11:29.551455] [DEBUG] [LOCAL ] PPT: Loaded 20368 existing records from primary storage. [2025-09-18T21:11:29.552679] [INFO ] [MAIN ] PPT: Loaded 20368 existing records. [2025-09-18T21:11:29.809370] [DEBUG] [LOCAL ] PRA: Loaded 34737 existing records from primary storage. [2025-09-18T21:11:29.849790] [INFO ] [MAIN ] PRA: Loaded 34737 existing records. [2025-09-18T21:11:30.110559] [DEBUG] [LOCAL ] PR: Loaded 53609 existing records from primary storage. [2025-09-18T21:11:30.115984] [INFO ] [MAIN ] PR: Loaded 53609 existing records. [2025-09-18T21:11:30.099388] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:11:30.198432] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-09-18T21:11:30.221755] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-09-18T21:11:30.239567] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:11:30.263634] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-11. [2025-09-18T21:11:30.290196] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-09-18T21:11:30.315911] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-09-18T21:11:30.584713] [DEBUG] [REMOTE ] PRCS: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:11:30.584856] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:11:30.566768] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:11:30.606556] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-09-18T21:11:30.590973] [WARN ] [REMOTE ] PRCS: No data returned for month 2024-11 [2025-09-18T21:11:30.625234] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-09-18T21:11:30.625600] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-09-18T21:11:30.636209] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-09-18T21:11:30.636274] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-09-18T21:11:30.647161] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-09-18T21:11:30.648626] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-09-18T21:11:30.666386] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-09-18T21:11:30.678812] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-09-18T21:11:31.312625] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:11:31.298832] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-18T21:11:31.352413] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-11. [2025-09-18T21:11:31.386285] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-09-18T21:11:31.633627] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:11:31.637974] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:11:31.638313] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-11. [2025-09-18T21:11:31.638548] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-11. [2025-09-18T21:11:31.976933] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-18T21:11:31.978175] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-09-18T21:11:32.367028] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T21:11:32.372089] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-09-18T21:11:32.449295] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-18T21:11:32.449420] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-18T21:11:32.454232] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-09-18T21:11:32.455575] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-09-18T21:11:32.851237] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-18T21:11:32.852935] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-09-18T21:11:33.201691] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-18T21:11:33.209002] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-09-18T21:11:33.258825] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-18T21:11:33.263954] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-09-18T21:11:33.294783] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-18T21:11:33.305152] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-09-18T21:11:33.312715] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-18T21:11:33.319488] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-09-18T21:11:33.768857] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-18T21:11:34.037929] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-18T21:11:34.083151] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T21:11:34.119527] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-09-18T21:11:34.919589] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-09-18T21:11:35.193356] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-18T21:11:35.232426] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-18T21:11:35.719525] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-09-18T21:11:35.842328] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-18T21:11:36.519549] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-09-18T21:11:37.128383] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-18T21:11:37.319505] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-09-18T21:11:37.462829] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T21:11:38.119577] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-09-18T21:11:38.927740] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-09-18T21:11:38.957829] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-18T21:11:39.719623] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-09-18T21:11:39.772912] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-18T21:11:39.812373] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-18T21:11:40.123304] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-18T21:11:40.519618] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-09-18T21:11:41.163223] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-18T21:11:41.319547] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-09-18T21:11:42.119597] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-09-18T21:11:42.527245] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T21:11:42.919606] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-09-18T21:11:43.487894] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T21:11:43.719560] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-09-18T21:11:44.519563] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-09-18T21:11:44.722789] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-18T21:11:44.785203] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-18T21:11:45.319575] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-09-18T21:11:45.556392] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-18T21:11:46.119564] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-09-18T21:11:46.919596] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-09-18T21:11:47.184407] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-18T21:11:47.260215] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-18T21:11:47.274355] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-18T21:11:47.719541] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-09-18T21:11:48.519534] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-09-18T21:11:48.849253] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-18T21:11:49.319534] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-09-18T21:11:49.664752] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-18T21:11:50.119520] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-09-18T21:11:50.166622] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-18T21:11:50.171184] [INFO ] [REMOTE ] PRA: Full fetch complete (43234 records). [2025-09-18T21:11:50.171295] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-09-18T21:11:50.590061] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-09-18T21:11:50.590193] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-09-18T21:11:50.591104] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-09-18T21:11:50.591170] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-09-18T21:11:50.592422] [DEBUG] [LOCAL ] PRA: Trimmed 43234 records to 34928 (keeping 200 days of data) [2025-09-18T21:11:50.811727] [DEBUG] [LOCAL ] PRA: Primary data saved (34928 records). [2025-09-18T21:11:50.811890] [INFO ] [MAIN ] PRA: Full history saved. [2025-09-18T21:11:50.812027] [INFO ] [MAIN ] Update Progress: 1721/2372 symbols completed. PRA took 22.5s. Estimated remaining: 1h 35m 15s. Rate: 6.8 symbols/min [2025-09-18T21:11:50.923786] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-09-18T21:11:50.999329] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:11:51.034227] [DEBUG] [LOCAL ] PRG: Loaded 30526 existing records from primary storage. [2025-09-18T21:11:51.034379] [INFO ] [MAIN ] PRG: Loaded 30526 existing records. [2025-09-18T21:11:51.217531] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:11:51.217803] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-09-18T21:11:51.217867] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-09-18T21:11:51.218789] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-09-18T21:11:51.218850] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-09-18T21:11:51.573287] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:11:51.719570] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-18T21:11:51.895903] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-18T21:11:51.934627] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-18T21:11:52.113322] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-18T21:11:52.114422] [INFO ] [REMOTE ] PRCS: Full fetch complete (3717 records). [2025-09-18T21:11:52.114496] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-09-18T21:11:52.296741] [WARN ] [VALIDATOR ] PRCS: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-09-18T21:11:52.296996] [FATAL] [MAIN ] PRCS: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:11:52.297084] [WARN ] [MAIN ] PRCS: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:11:52.297176] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-18T21:11:52.297262] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-18T21:11:52.297337] [INFO ] [LOCAL ] PRCS: Starting deletion of derivative data. [2025-09-18T21:11:52.297440] [DEBUG] [LOCAL ] PRCS: No derivative data file found to delete. [2025-09-18T21:11:52.297548] [INFO ] [MAIN ] Update Progress: 1722/2372 symbols completed. PRCS took 24.0s. Estimated remaining: 1h 35m 3s. Rate: 6.8 symbols/min [2025-09-18T21:11:52.468575] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:11:52.513615] [DEBUG] [LOCAL ] PRGO: Loaded 46960 existing records from primary storage. [2025-09-18T21:11:52.513799] [INFO ] [MAIN ] PRGO: Loaded 46960 existing records. [2025-09-18T21:11:52.524693] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-09-18T21:11:52.702870] [WARN ] [MAIN ] PRGO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:11:52.703176] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-09-18T21:11:52.703259] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-09-18T21:11:52.704749] [DEBUG] [LOCAL ] PRGO: Deleted primary data file. [2025-09-18T21:11:52.704813] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-09-18T21:11:53.062175] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:11:53.319516] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-11. [2025-09-18T21:11:53.418175] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-18T21:11:53.423168] [INFO ] [REMOTE ] PPT: Full fetch complete (29196 records). [2025-09-18T21:11:53.423299] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-09-18T21:11:53.876769] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-09-18T21:11:53.876860] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-09-18T21:11:53.877458] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-09-18T21:11:53.877511] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-09-18T21:11:53.878844] [DEBUG] [LOCAL ] PPT: Trimmed 29196 records to 20464 (keeping 200 days of data) [2025-09-18T21:11:54.005890] [DEBUG] [LOCAL ] PPT: Primary data saved (20464 records). [2025-09-18T21:11:54.006151] [INFO ] [MAIN ] PPT: Full history saved. [2025-09-18T21:11:54.006290] [INFO ] [MAIN ] Update Progress: 1723/2372 symbols completed. PPT took 25.7s. Estimated remaining: 1h 34m 52s. Rate: 6.8 symbols/min [2025-09-18T21:11:54.124781] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-09-18T21:11:54.184515] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:11:54.192511] [DEBUG] [LOCAL ] PRH: Loaded 4965 existing records from primary storage. [2025-09-18T21:11:54.192670] [INFO ] [MAIN ] PRH: Loaded 4965 existing records. [2025-09-18T21:11:54.376861] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:11:54.377226] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-09-18T21:11:54.377426] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-09-18T21:11:54.377874] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-09-18T21:11:54.377954] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-09-18T21:11:54.568777] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-18T21:11:54.769153] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:11:54.919535] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-11. [2025-09-18T21:11:55.553969] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-18T21:11:55.719545] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-09-18T21:11:55.864007] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-18T21:11:56.395864] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-18T21:11:56.519580] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-09-18T21:11:57.229932] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-18T21:11:57.319496] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-09-18T21:11:57.979248] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-18T21:11:58.119572] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-09-18T21:11:58.919613] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-09-18T21:11:59.313864] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-18T21:11:59.719563] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-11. [2025-09-18T21:12:00.519602] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-09-18T21:12:00.829070] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-18T21:12:00.954331] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-18T21:12:01.298878] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-18T21:12:01.319575] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-09-18T21:12:02.119617] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-09-18T21:12:02.919585] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-09-18T21:12:03.719562] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-09-18T21:12:03.867741] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-18T21:12:04.519560] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-09-18T21:12:05.276117] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-18T21:12:05.278872] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-18T21:12:05.319512] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-09-18T21:12:05.435121] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (3.32 seconds). [2025-09-18T21:12:05.758662] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-18T21:12:06.119547] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-09-18T21:12:06.354694] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-18T21:12:06.793409] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-18T21:12:06.919559] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-09-18T21:12:07.719569] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-09-18T21:12:08.291032] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-18T21:12:08.519565] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-09-18T21:12:08.976638] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-18T21:12:09.061355] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-18T21:12:09.062413] [INFO ] [REMOTE ] PRH: Full fetch complete (7728 records). [2025-09-18T21:12:09.062496] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-09-18T21:12:09.324837] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-09-18T21:12:09.436507] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-09-18T21:12:09.436602] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-09-18T21:12:09.436943] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-09-18T21:12:09.437025] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-09-18T21:12:09.437509] [DEBUG] [LOCAL ] PRH: Trimmed 7728 records to 4994 (keeping 200 days of data) [2025-09-18T21:12:09.469306] [DEBUG] [LOCAL ] PRH: Primary data saved (4994 records). [2025-09-18T21:12:09.469418] [INFO ] [MAIN ] PRH: Full history saved. [2025-09-18T21:12:09.469532] [INFO ] [MAIN ] Update Progress: 1724/2372 symbols completed. PRH took 15.5s. Estimated remaining: 1h 34m 45s. Rate: 6.8 symbols/min [2025-09-18T21:12:09.642975] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:12:09.663223] [DEBUG] [LOCAL ] PRI: Loaded 18455 existing records from primary storage. [2025-09-18T21:12:09.663358] [INFO ] [MAIN ] PRI: Loaded 18455 existing records. [2025-09-18T21:12:09.841836] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:12:09.842127] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-09-18T21:12:09.842176] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-09-18T21:12:09.842972] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-09-18T21:12:09.843032] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-09-18T21:12:10.127122] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-09-18T21:12:10.233926] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:12:10.646686] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-18T21:12:10.919556] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-09-18T21:12:11.618476] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T21:12:11.719544] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-09-18T21:12:12.519573] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-09-18T21:12:13.319724] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-11. [2025-09-18T21:12:13.524728] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-18T21:12:13.532545] [INFO ] [REMOTE ] PR: Full fetch complete (77421 records). [2025-09-18T21:12:13.532762] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-09-18T21:12:13.942179] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-09-18T21:12:13.942347] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-09-18T21:12:13.943469] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-09-18T21:12:13.943556] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-09-18T21:12:13.952786] [DEBUG] [LOCAL ] PR: Trimmed 77421 records to 53999 (keeping 200 days of data) [2025-09-18T21:12:13.966269] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-18T21:12:14.154507] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-09-18T21:12:14.336501] [DEBUG] [LOCAL ] PR: Primary data saved (53999 records). [2025-09-18T21:12:14.336678] [INFO ] [MAIN ] PR: Full history saved. [2025-09-18T21:12:14.336791] [INFO ] [MAIN ] Update Progress: 1725/2372 symbols completed. PR took 46.0s. Estimated remaining: 1h 34m 35s. Rate: 6.8 symbols/min [2025-09-18T21:12:14.520689] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:12:14.551957] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-18T21:12:14.572854] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-18T21:12:14.609433] [DEBUG] [LOCAL ] PRIM: Loaded 44530 existing records from primary storage. [2025-09-18T21:12:14.609619] [INFO ] [MAIN ] PRIM: Loaded 44530 existing records. [2025-09-18T21:12:14.786002] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:12:14.786262] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-09-18T21:12:14.786314] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-09-18T21:12:14.787823] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-09-18T21:12:14.787888] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-09-18T21:12:14.925613] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-09-18T21:12:15.144730] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:12:15.588343] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T21:12:15.719514] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-09-18T21:12:16.519592] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-11. [2025-09-18T21:12:16.853696] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-18T21:12:16.915861] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-18T21:12:17.319609] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-09-18T21:12:17.803603] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-18T21:12:18.119560] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-09-18T21:12:18.383251] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-18T21:12:18.850063] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-18T21:12:18.919542] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-09-18T21:12:19.719552] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-09-18T21:12:20.027099] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-18T21:12:20.519581] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-09-18T21:12:21.319634] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-09-18T21:12:21.407734] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-18T21:12:21.757472] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-18T21:12:22.119591] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-09-18T21:12:22.320120] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-18T21:12:22.919545] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-09-18T21:12:23.719597] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-09-18T21:12:23.927834] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-18T21:12:24.519555] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-09-18T21:12:25.319550] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-09-18T21:12:25.421005] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-09-18T21:12:25.683941] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-18T21:12:26.119589] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-09-18T21:12:26.233276] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-18T21:12:26.288570] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-18T21:12:26.919581] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-09-18T21:12:27.104197] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-18T21:12:27.719578] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-09-18T21:12:28.307882] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-18T21:12:28.519540] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-09-18T21:12:29.052040] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-18T21:12:29.319573] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-09-18T21:12:30.119557] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-09-18T21:12:30.258750] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-18T21:12:30.308790] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-18T21:12:30.919540] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-09-18T21:12:31.620031] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-18T21:12:31.719573] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-09-18T21:12:32.361194] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-18T21:12:32.519522] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-09-18T21:12:33.327270] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-09-18T21:12:33.346978] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-18T21:12:33.857447] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-18T21:12:34.119546] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-09-18T21:12:34.555924] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-18T21:12:34.559866] [INFO ] [REMOTE ] PRG: Full fetch complete (44014 records). [2025-09-18T21:12:34.559982] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-09-18T21:12:34.936230] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-09-18T21:12:34.958190] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-09-18T21:12:34.958283] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-09-18T21:12:34.959172] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-09-18T21:12:34.959252] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-09-18T21:12:34.962830] [DEBUG] [LOCAL ] PRG: Trimmed 44014 records to 30738 (keeping 200 days of data) [2025-09-18T21:12:35.159036] [DEBUG] [LOCAL ] PRG: Primary data saved (30738 records). [2025-09-18T21:12:35.159188] [INFO ] [MAIN ] PRG: Full history saved. [2025-09-18T21:12:35.159317] [INFO ] [MAIN ] Update Progress: 1726/2372 symbols completed. PRG took 44.3s. Estimated remaining: 1h 34m 31s. Rate: 6.8 symbols/min [2025-09-18T21:12:35.329910] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:12:35.370992] [DEBUG] [LOCAL ] PRKS: Loaded 42722 existing records from primary storage. [2025-09-18T21:12:35.371249] [INFO ] [MAIN ] PRKS: Loaded 42722 existing records. [2025-09-18T21:12:35.551969] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:12:35.552215] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-09-18T21:12:35.552263] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-09-18T21:12:35.553395] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-09-18T21:12:35.553456] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-09-18T21:12:35.745354] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-09-18T21:12:35.872222] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-18T21:12:35.961087] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:12:36.134614] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-18T21:12:36.519582] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-09-18T21:12:37.245697] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-18T21:12:37.253848] [INFO ] [REMOTE ] PRGO: Full fetch complete (68109 records). [2025-09-18T21:12:37.253986] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-09-18T21:12:37.324678] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-09-18T21:12:37.667627] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-09-18T21:12:37.667776] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-09-18T21:12:37.669897] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-09-18T21:12:37.670160] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-09-18T21:12:37.685379] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T21:12:37.691618] [DEBUG] [LOCAL ] PRGO: Trimmed 68109 records to 47312 (keeping 200 days of data) [2025-09-18T21:12:37.999263] [DEBUG] [LOCAL ] PRGO: Primary data saved (47312 records). [2025-09-18T21:12:37.999448] [INFO ] [MAIN ] PRGO: Full history saved. [2025-09-18T21:12:37.999668] [INFO ] [MAIN ] Update Progress: 1727/2372 symbols completed. PRGO took 45.7s. Estimated remaining: 1h 34m 20s. Rate: 6.8 symbols/min [2025-09-18T21:12:38.124700] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-11. [2025-09-18T21:12:38.178239] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:12:38.200352] [DEBUG] [LOCAL ] PRLB: Loaded 20907 existing records from primary storage. [2025-09-18T21:12:38.200476] [INFO ] [MAIN ] PRLB: Loaded 20907 existing records. [2025-09-18T21:12:38.390401] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:12:38.390637] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-09-18T21:12:38.390722] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-09-18T21:12:38.391507] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-09-18T21:12:38.391587] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-09-18T21:12:38.750715] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:12:38.917175] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-18T21:12:38.926560] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-11. [2025-09-18T21:12:39.532267] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-18T21:12:39.719565] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-09-18T21:12:40.311404] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-18T21:12:40.519555] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-09-18T21:12:40.549442] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-18T21:12:41.319581] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-09-18T21:12:42.070678] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-18T21:12:42.073467] [INFO ] [REMOTE ] PRI: Full fetch complete (25599 records). [2025-09-18T21:12:42.073544] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-09-18T21:12:42.127713] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-09-18T21:12:42.460015] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-09-18T21:12:42.460232] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-09-18T21:12:42.460944] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-09-18T21:12:42.461051] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-09-18T21:12:42.462625] [DEBUG] [LOCAL ] PRI: Trimmed 25599 records to 18546 (keeping 200 days of data) [2025-09-18T21:12:42.492569] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-18T21:12:42.622349] [DEBUG] [LOCAL ] PRI: Primary data saved (18546 records). [2025-09-18T21:12:42.622518] [INFO ] [MAIN ] PRI: Full history saved. [2025-09-18T21:12:42.622824] [INFO ] [MAIN ] Update Progress: 1728/2372 symbols completed. PRI took 33.2s. Estimated remaining: 1h 34m 10s. Rate: 6.8 symbols/min [2025-09-18T21:12:42.809669] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:12:42.865519] [DEBUG] [LOCAL ] PRM: Loaded 44724 existing records from primary storage. [2025-09-18T21:12:42.865700] [INFO ] [MAIN ] PRM: Loaded 44724 existing records. [2025-09-18T21:12:42.924622] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-09-18T21:12:43.061668] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:12:43.061954] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-09-18T21:12:43.062021] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-09-18T21:12:43.063024] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-09-18T21:12:43.063089] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-09-18T21:12:43.431770] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:12:43.546731] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-18T21:12:43.719539] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-09-18T21:12:44.274284] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-18T21:12:44.280866] [INFO ] [REMOTE ] PRIM: Full fetch complete (63001 records). [2025-09-18T21:12:44.280987] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-09-18T21:12:44.524929] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-11. [2025-09-18T21:12:44.705368] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-09-18T21:12:44.705467] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-09-18T21:12:44.706585] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-09-18T21:12:44.706685] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-09-18T21:12:44.711113] [DEBUG] [LOCAL ] PRIM: Trimmed 63001 records to 44891 (keeping 200 days of data) [2025-09-18T21:12:45.013245] [DEBUG] [LOCAL ] PRIM: Primary data saved (44891 records). [2025-09-18T21:12:45.013522] [INFO ] [MAIN ] PRIM: Full history saved. [2025-09-18T21:12:45.013635] [INFO ] [MAIN ] Update Progress: 1729/2372 symbols completed. PRIM took 30.7s. Estimated remaining: 1h 33m 58s. Rate: 6.8 symbols/min [2025-09-18T21:12:45.188007] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:12:45.241990] [DEBUG] [LOCAL ] PRMB: Loaded 53131 existing records from primary storage. [2025-09-18T21:12:45.242146] [INFO ] [MAIN ] PRMB: Loaded 53131 existing records. [2025-09-18T21:12:45.328783] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-09-18T21:12:45.469122] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-18T21:12:45.475012] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:12:45.484002] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-09-18T21:12:45.484063] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-09-18T21:12:45.485713] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-09-18T21:12:45.485791] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-09-18T21:12:45.836635] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:12:45.914349] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T21:12:46.119509] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-09-18T21:12:46.658711] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T21:12:46.919598] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-09-18T21:12:47.377327] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-18T21:12:47.719589] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-09-18T21:12:48.158609] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-18T21:12:48.519551] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-09-18T21:12:48.653077] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-18T21:12:49.319542] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-09-18T21:12:50.119535] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-09-18T21:12:50.266039] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-18T21:12:50.360744] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-18T21:12:50.919567] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-09-18T21:12:51.573865] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-18T21:12:51.719583] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-09-18T21:12:51.801880] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-18T21:12:52.519635] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-11. [2025-09-18T21:12:53.007860] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-18T21:12:53.319617] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-09-18T21:12:53.597195] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-18T21:12:54.119561] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-09-18T21:12:54.374217] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-18T21:12:54.919556] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-09-18T21:12:55.719599] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-09-18T21:12:55.845700] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-18T21:12:56.348503] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T21:12:56.508987] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-18T21:12:56.519496] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-09-18T21:12:57.319545] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-09-18T21:12:58.119637] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-09-18T21:12:58.185835] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-18T21:12:58.838017] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T21:12:58.919512] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-09-18T21:12:59.535024] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-18T21:12:59.719549] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-09-18T21:13:00.506633] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-18T21:13:00.519488] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-09-18T21:13:00.904503] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-18T21:13:01.319584] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-09-18T21:13:02.119604] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-09-18T21:13:02.590239] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-18T21:13:02.745887] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T21:13:02.919567] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-09-18T21:13:03.402813] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-18T21:13:03.719569] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-09-18T21:13:04.158284] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T21:13:04.519541] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-09-18T21:13:04.681675] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-18T21:13:05.319587] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-09-18T21:13:05.847443] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T21:13:06.119595] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-09-18T21:13:06.919505] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-09-18T21:13:07.014914] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-18T21:13:07.687920] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-18T21:13:07.704635] [INFO ] [REMOTE ] PRKS: Full fetch complete (60744 records). [2025-09-18T21:13:07.706465] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-09-18T21:13:07.707759] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-18T21:13:07.731395] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-09-18T21:13:08.118295] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-09-18T21:13:08.118635] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-09-18T21:13:08.119606] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-09-18T21:13:08.119677] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-09-18T21:13:08.121019] [DEBUG] [LOCAL ] PRKS: Trimmed 60744 records to 43039 (keeping 200 days of data) [2025-09-18T21:13:08.373935] [DEBUG] [LOCAL ] PRKS: Primary data saved (43039 records). [2025-09-18T21:13:08.374065] [INFO ] [MAIN ] PRKS: Full history saved. [2025-09-18T21:13:08.374169] [INFO ] [MAIN ] Update Progress: 1730/2372 symbols completed. PRKS took 33.2s. Estimated remaining: 1h 33m 55s. Rate: 6.8 symbols/min [2025-09-18T21:13:08.527839] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-09-18T21:13:08.552258] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:13:08.589682] [DEBUG] [LOCAL ] PRO: Loaded 37205 existing records from primary storage. [2025-09-18T21:13:08.589854] [INFO ] [MAIN ] PRO: Loaded 37205 existing records. [2025-09-18T21:13:08.766858] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:13:08.767157] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-09-18T21:13:08.767206] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-09-18T21:13:08.768379] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-09-18T21:13:08.768439] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-09-18T21:13:09.123115] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:13:09.306553] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-18T21:13:09.319483] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-09-18T21:13:09.366717] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-18T21:13:10.119576] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-09-18T21:13:10.810096] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-18T21:13:10.919549] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-09-18T21:13:11.719595] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-11. [2025-09-18T21:13:12.002211] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-18T21:13:12.020958] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-18T21:13:12.023792] [INFO ] [REMOTE ] PRLB: Full fetch complete (30984 records). [2025-09-18T21:13:12.023873] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-09-18T21:13:12.410260] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-09-18T21:13:12.410374] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-09-18T21:13:12.411026] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-09-18T21:13:12.411089] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-09-18T21:13:12.411830] [DEBUG] [LOCAL ] PRLB: Trimmed 30984 records to 21046 (keeping 200 days of data) [2025-09-18T21:13:12.519739] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-09-18T21:13:12.551451] [DEBUG] [LOCAL ] PRLB: Primary data saved (21046 records). [2025-09-18T21:13:12.551584] [INFO ] [MAIN ] PRLB: Full history saved. [2025-09-18T21:13:12.551691] [INFO ] [MAIN ] Update Progress: 1731/2372 symbols completed. PRLB took 34.6s. Estimated remaining: 1h 33m 45s. Rate: 6.8 symbols/min [2025-09-18T21:13:12.725614] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:13:12.725838] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-09-18T21:13:12.725893] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-09-18T21:13:12.726039] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-09-18T21:13:12.726081] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-18T21:13:12.726123] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-18T21:13:12.726155] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-09-18T21:13:13.090140] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:13:13.110407] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T21:13:13.319574] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-11. [2025-09-18T21:13:13.586022] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:13:13.586382] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-11 [2025-09-18T21:13:14.119628] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-09-18T21:13:14.273580] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-18T21:13:14.919565] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-09-18T21:13:15.719521] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-09-18T21:13:15.797235] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-18T21:13:16.017185] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:13:16.017558] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-09-18T21:13:16.045835] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-18T21:13:16.519548] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-01. [2025-09-18T21:13:17.319566] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-09-18T21:13:17.753560] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-18T21:13:18.119591] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-09-18T21:13:18.839368] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T21:13:18.845990] [INFO ] [REMOTE ] PRM: Full fetch complete (64092 records). [2025-09-18T21:13:18.846137] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-09-18T21:13:18.924628] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-09-18T21:13:19.235139] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-09-18T21:13:19.235225] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-09-18T21:13:19.236226] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-09-18T21:13:19.236291] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-09-18T21:13:19.240076] [DEBUG] [LOCAL ] PRM: Trimmed 64092 records to 45037 (keeping 200 days of data) [2025-09-18T21:13:19.509160] [DEBUG] [LOCAL ] PRM: Primary data saved (45037 records). [2025-09-18T21:13:19.509339] [INFO ] [MAIN ] PRM: Full history saved. [2025-09-18T21:13:19.509471] [INFO ] [MAIN ] Update Progress: 1732/2372 symbols completed. PRM took 36.9s. Estimated remaining: 1h 33m 35s. Rate: 6.8 symbols/min [2025-09-18T21:13:19.682159] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:13:19.689775] [DEBUG] [LOCAL ] PRT: Loaded 5402 existing records from primary storage. [2025-09-18T21:13:19.689907] [INFO ] [MAIN ] PRT: Loaded 5402 existing records. [2025-09-18T21:13:19.721538] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-02. [2025-09-18T21:13:19.877097] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:13:19.877581] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-09-18T21:13:19.877685] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-09-18T21:13:19.878055] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-09-18T21:13:19.878121] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-09-18T21:13:20.065452] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-18T21:13:20.294753] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:13:20.399981] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-18T21:13:20.519528] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-09-18T21:13:20.594981] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-18T21:13:21.319588] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-03. [2025-09-18T21:13:21.612413] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-18T21:13:22.119547] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-09-18T21:13:22.397667] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-18T21:13:22.919599] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-04. [2025-09-18T21:13:23.226790] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-18T21:13:23.719593] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-09-18T21:13:23.885534] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-18T21:13:24.519618] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-09-18T21:13:25.319721] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-05. [2025-09-18T21:13:25.567208] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-18T21:13:25.611071] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-18T21:13:26.119561] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-11. [2025-09-18T21:13:26.377356] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-18T21:13:26.681369] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-18T21:13:26.919600] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-09-18T21:13:27.719553] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-09-18T21:13:28.231042] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-18T21:13:28.248211] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-18T21:13:28.519546] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-09-18T21:13:29.319559] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-09-18T21:13:29.907307] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-18T21:13:29.914965] [INFO ] [REMOTE ] PRMB: Full fetch complete (75853 records). [2025-09-18T21:13:29.915169] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-09-18T21:13:30.125438] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-06. [2025-09-18T21:13:30.249253] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-18T21:13:30.326296] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-09-18T21:13:30.326381] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-09-18T21:13:30.327403] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-09-18T21:13:30.327471] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-09-18T21:13:30.328997] [DEBUG] [LOCAL ] PRMB: Trimmed 75853 records to 53517 (keeping 200 days of data) [2025-09-18T21:13:30.660385] [DEBUG] [LOCAL ] PRMB: Primary data saved (53517 records). [2025-09-18T21:13:30.660556] [INFO ] [MAIN ] PRMB: Full history saved. [2025-09-18T21:13:30.660708] [INFO ] [MAIN ] Update Progress: 1733/2372 symbols completed. PRMB took 45.6s. Estimated remaining: 1h 33m 27s. Rate: 6.8 symbols/min [2025-09-18T21:13:30.835182] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:13:30.889179] [DEBUG] [LOCAL ] PRU: Loaded 51572 existing records from primary storage. [2025-09-18T21:13:30.889342] [INFO ] [MAIN ] PRU: Loaded 51572 existing records. [2025-09-18T21:13:30.924818] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-09-18T21:13:31.079398] [WARN ] [MAIN ] PRU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:13:31.079705] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-09-18T21:13:31.079763] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-09-18T21:13:31.081342] [DEBUG] [LOCAL ] PRU: Deleted primary data file. [2025-09-18T21:13:31.081424] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-09-18T21:13:31.455534] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:13:31.470831] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-18T21:13:31.719556] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-07. [2025-09-18T21:13:32.180857] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-18T21:13:32.519508] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-09-18T21:13:32.620455] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-18T21:13:33.004627] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-18T21:13:33.319565] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-09-18T21:13:34.119559] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-11. [2025-09-18T21:13:34.679393] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T21:13:34.919564] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-08. [2025-09-18T21:13:35.587576] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-18T21:13:35.719545] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-09-18T21:13:35.820071] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-18T21:13:36.519552] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-09-18T21:13:37.068414] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-18T21:13:37.319592] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-09-18T21:13:37.527686] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-18T21:13:38.119614] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-09-18T21:13:38.694731] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-18T21:13:38.754722] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-18T21:13:38.919542] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-09. [2025-09-18T21:13:39.719519] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-09-18T21:13:39.956296] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-18T21:13:39.959679] [INFO ] [REMOTE ] PRSU: Full fetch complete (31458 records). [2025-09-18T21:13:39.959792] [DEBUG] [VALIDATOR ] PRSU: Validating primary data. [2025-09-18T21:13:40.152752] [WARN ] [VALIDATOR ] PRSU: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-18T21:13:40.153187] [FATAL] [MAIN ] PRSU: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:13:40.153258] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:13:40.153329] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-18T21:13:40.153394] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-18T21:13:40.153431] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-09-18T21:13:40.153471] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-09-18T21:13:40.153530] [INFO ] [MAIN ] Update Progress: 1734/2372 symbols completed. PRSU took 27.6s. Estimated remaining: 1h 33m 19s. Rate: 6.8 symbols/min [2025-09-18T21:13:40.325524] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:13:40.325746] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-09-18T21:13:40.325803] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-09-18T21:13:40.325943] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-09-18T21:13:40.325986] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-18T21:13:40.326029] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-18T21:13:40.326061] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-09-18T21:13:40.526592] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-09-18T21:13:40.688626] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:13:41.319535] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-11. [2025-09-18T21:13:41.447831] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-18T21:13:41.570598] [DEBUG] [REMOTE ] PRVS: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:13:41.570965] [WARN ] [REMOTE ] PRVS: No data returned for month 2024-11 [2025-09-18T21:13:41.675987] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-18T21:13:41.681573] [INFO ] [REMOTE ] PRO: Full fetch complete (50780 records). [2025-09-18T21:13:41.681700] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-09-18T21:13:42.082165] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-09-18T21:13:42.082248] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-09-18T21:13:42.083339] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-09-18T21:13:42.083403] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-09-18T21:13:42.084714] [DEBUG] [LOCAL ] PRO: Trimmed 50780 records to 37513 (keeping 200 days of data) [2025-09-18T21:13:42.133045] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-09-18T21:13:42.314933] [DEBUG] [LOCAL ] PRO: Primary data saved (37513 records). [2025-09-18T21:13:42.315130] [INFO ] [MAIN ] PRO: Full history saved. [2025-09-18T21:13:42.315269] [INFO ] [MAIN ] Update Progress: 1735/2372 symbols completed. PRO took 33.9s. Estimated remaining: 1h 33m 8s. Rate: 6.8 symbols/min [2025-09-18T21:13:42.489966] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:13:42.535534] [DEBUG] [LOCAL ] PSA: Loaded 41914 existing records from primary storage. [2025-09-18T21:13:42.535714] [INFO ] [MAIN ] PSA: Loaded 41914 existing records. [2025-09-18T21:13:42.740962] [WARN ] [MAIN ] PSA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:13:42.741243] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-09-18T21:13:42.741296] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-09-18T21:13:42.742824] [DEBUG] [LOCAL ] PSA: Deleted primary data file. [2025-09-18T21:13:42.742903] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-09-18T21:13:42.924799] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-09-18T21:13:43.143729] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:13:43.503872] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-18T21:13:43.675795] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-18T21:13:43.719494] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-09-18T21:13:44.519574] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-09-18T21:13:44.915453] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-18T21:13:45.324766] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-09-18T21:13:45.342489] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-18T21:13:45.694367] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-18T21:13:46.119579] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-09-18T21:13:46.919559] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-18T21:13:47.333276] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-18T21:13:47.719541] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-09-18T21:13:47.917136] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-18T21:13:48.276831] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-18T21:13:48.519548] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-11. [2025-09-18T21:13:49.319616] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-18T21:13:49.705617] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-18T21:13:50.125397] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-09-18T21:13:50.131139] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-18T21:13:50.919598] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-18T21:13:51.303054] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-18T21:13:51.719554] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-09-18T21:13:52.045084] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-18T21:13:52.519576] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-09-18T21:13:53.097596] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-18T21:13:53.319553] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-18T21:13:53.634399] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-18T21:13:54.058974] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T21:13:54.119511] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-09-18T21:13:54.919542] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-18T21:13:55.281479] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-18T21:13:55.719556] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-18T21:13:55.921060] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-18T21:13:56.042298] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-18T21:13:56.519543] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-09-18T21:13:57.319550] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-18T21:13:57.679387] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-18T21:13:58.119577] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-18T21:13:58.372870] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-18T21:13:58.472743] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-18T21:13:58.473425] [INFO ] [REMOTE ] PRVS: Full fetch complete (1234 records). [2025-09-18T21:13:58.473494] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-09-18T21:13:58.659139] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 184 unique days, need 200 days [2025-09-18T21:13:58.659384] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:13:58.659455] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:13:58.659531] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-18T21:13:58.659600] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-18T21:13:58.659638] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-09-18T21:13:58.659732] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-09-18T21:13:58.659799] [INFO ] [MAIN ] Update Progress: 1736/2372 symbols completed. PRVS took 18.5s. Estimated remaining: 1h 33m 2s. Rate: 6.8 symbols/min [2025-09-18T21:13:58.837685] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:13:58.846762] [DEBUG] [LOCAL ] PSBD: Loaded 6826 existing records from primary storage. [2025-09-18T21:13:58.846879] [INFO ] [MAIN ] PSBD: Loaded 6826 existing records. [2025-09-18T21:13:58.924703] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-09-18T21:13:59.040084] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:13:59.040494] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-09-18T21:13:59.040581] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-09-18T21:13:59.041037] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-09-18T21:13:59.041110] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-09-18T21:13:59.414065] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:13:59.541841] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-18T21:13:59.719551] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-09-18T21:14:00.409393] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-18T21:14:00.519563] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-11. [2025-09-18T21:14:01.120156] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-18T21:14:01.319549] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-09-18T21:14:01.954592] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-18T21:14:02.119568] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-09-18T21:14:02.765348] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-18T21:14:02.919569] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-09-18T21:14:03.448500] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-18T21:14:03.450070] [INFO ] [REMOTE ] PRT: Full fetch complete (9169 records). [2025-09-18T21:14:03.450145] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-09-18T21:14:03.724745] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-09-18T21:14:03.826916] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-09-18T21:14:03.827086] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-09-18T21:14:03.827339] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-09-18T21:14:03.827402] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-09-18T21:14:03.827924] [DEBUG] [LOCAL ] PRT: Trimmed 9169 records to 5448 (keeping 200 days of data) [2025-09-18T21:14:03.860048] [DEBUG] [LOCAL ] PRT: Primary data saved (5448 records). [2025-09-18T21:14:03.860139] [INFO ] [MAIN ] PRT: Full history saved. [2025-09-18T21:14:03.860221] [INFO ] [MAIN ] Update Progress: 1737/2372 symbols completed. PRT took 44.4s. Estimated remaining: 1h 32m 51s. Rate: 6.8 symbols/min [2025-09-18T21:14:04.033090] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:14:04.042195] [DEBUG] [LOCAL ] PSF: Loaded 6743 existing records from primary storage. [2025-09-18T21:14:04.042310] [INFO ] [MAIN ] PSF: Loaded 6743 existing records. [2025-09-18T21:14:04.242603] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:14:04.242976] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-09-18T21:14:04.243038] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-09-18T21:14:04.243515] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-09-18T21:14:04.243587] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-09-18T21:14:04.527559] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-09-18T21:14:04.609769] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:14:05.236859] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T21:14:05.319570] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-09-18T21:14:06.119571] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-09-18T21:14:06.281158] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-18T21:14:06.288360] [INFO ] [REMOTE ] PRU: Full fetch complete (74099 records). [2025-09-18T21:14:06.288490] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-09-18T21:14:06.579272] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-18T21:14:06.730753] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-09-18T21:14:06.730962] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-09-18T21:14:06.732439] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-09-18T21:14:06.732607] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-09-18T21:14:06.735450] [DEBUG] [LOCAL ] PRU: Trimmed 74099 records to 51940 (keeping 200 days of data) [2025-09-18T21:14:06.860438] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-18T21:14:06.956622] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-09-18T21:14:07.108376] [DEBUG] [LOCAL ] PRU: Primary data saved (51940 records). [2025-09-18T21:14:07.108530] [INFO ] [MAIN ] PRU: Full history saved. [2025-09-18T21:14:07.108620] [INFO ] [MAIN ] Update Progress: 1738/2372 symbols completed. PRU took 36.4s. Estimated remaining: 1h 32m 41s. Rate: 6.8 symbols/min [2025-09-18T21:14:07.277811] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:14:07.310449] [DEBUG] [LOCAL ] PSFE: Loaded 30902 existing records from primary storage. [2025-09-18T21:14:07.310599] [INFO ] [MAIN ] PSFE: Loaded 30902 existing records. [2025-09-18T21:14:07.491127] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:14:07.491413] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-09-18T21:14:07.491464] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-09-18T21:14:07.492250] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-09-18T21:14:07.492312] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-09-18T21:14:07.724694] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-09-18T21:14:07.861161] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:14:08.448041] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-18T21:14:08.512414] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-18T21:14:08.520794] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-11. [2025-09-18T21:14:09.283728] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-18T21:14:09.319538] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-09-18T21:14:09.920476] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-18T21:14:10.119544] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-09-18T21:14:10.919635] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-09-18T21:14:11.616976] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-18T21:14:11.719530] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-11. [2025-09-18T21:14:11.796385] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-18T21:14:12.519587] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-09-18T21:14:12.996930] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-18T21:14:13.319556] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-09-18T21:14:13.962907] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-18T21:14:14.119602] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-09-18T21:14:14.208795] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-18T21:14:14.579469] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-18T21:14:14.919566] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-09-18T21:14:15.719609] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-09-18T21:14:15.991208] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-18T21:14:16.353676] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-18T21:14:16.519604] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-09-18T21:14:17.319620] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-09-18T21:14:17.625599] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-18T21:14:18.119582] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-09-18T21:14:18.647042] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-18T21:14:18.919610] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-09-18T21:14:19.557027] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-18T21:14:19.719547] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-09-18T21:14:20.252542] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-18T21:14:20.281400] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T21:14:20.519539] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-09-18T21:14:21.134403] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-18T21:14:21.319565] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-09-18T21:14:21.895737] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-18T21:14:22.119549] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-09-18T21:14:22.902573] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-18T21:14:22.919494] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-09-18T21:14:23.719570] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-09-18T21:14:23.756590] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-18T21:14:24.347279] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T21:14:24.519592] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-09-18T21:14:25.319620] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-09-18T21:14:25.721610] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-18T21:14:25.954426] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T21:14:26.119566] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-09-18T21:14:26.919579] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-09-18T21:14:27.431979] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-18T21:14:27.438374] [INFO ] [REMOTE ] PSA: Full fetch complete (58896 records). [2025-09-18T21:14:27.438575] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-09-18T21:14:27.724662] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-09-18T21:14:27.851211] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-09-18T21:14:27.851297] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-09-18T21:14:27.852215] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-09-18T21:14:27.852280] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-09-18T21:14:27.853554] [DEBUG] [LOCAL ] PSA: Trimmed 58896 records to 42229 (keeping 200 days of data) [2025-09-18T21:14:28.076634] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-18T21:14:28.161659] [DEBUG] [LOCAL ] PSA: Primary data saved (42229 records). [2025-09-18T21:14:28.161826] [INFO ] [MAIN ] PSA: Full history saved. [2025-09-18T21:14:28.161939] [INFO ] [MAIN ] Update Progress: 1739/2372 symbols completed. PSA took 45.8s. Estimated remaining: 1h 32m 36s. Rate: 6.8 symbols/min [2025-09-18T21:14:28.355493] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:14:28.407993] [DEBUG] [LOCAL ] PSN: Loaded 46416 existing records from primary storage. [2025-09-18T21:14:28.408144] [INFO ] [MAIN ] PSN: Loaded 46416 existing records. [2025-09-18T21:14:28.524738] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-09-18T21:14:28.581841] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-18T21:14:28.609171] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:14:28.609394] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-09-18T21:14:28.609442] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-09-18T21:14:28.610567] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-09-18T21:14:28.610629] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-09-18T21:14:29.017849] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:14:29.078505] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-18T21:14:29.080184] [INFO ] [REMOTE ] PSBD: Full fetch complete (9095 records). [2025-09-18T21:14:29.080256] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-09-18T21:14:29.324772] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-11. [2025-09-18T21:14:29.472073] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-09-18T21:14:29.472153] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-09-18T21:14:29.472373] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-09-18T21:14:29.472413] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-09-18T21:14:29.472869] [DEBUG] [LOCAL ] PSBD: Trimmed 9095 records to 6865 (keeping 200 days of data) [2025-09-18T21:14:29.516120] [DEBUG] [LOCAL ] PSBD: Primary data saved (6865 records). [2025-09-18T21:14:29.516262] [INFO ] [MAIN ] PSBD: Full history saved. [2025-09-18T21:14:29.516350] [INFO ] [MAIN ] Update Progress: 1740/2372 symbols completed. PSBD took 30.9s. Estimated remaining: 1h 32m 25s. Rate: 6.8 symbols/min [2025-09-18T21:14:29.683759] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:14:29.723632] [DEBUG] [LOCAL ] PSO: Loaded 37818 existing records from primary storage. [2025-09-18T21:14:29.723839] [INFO ] [MAIN ] PSO: Loaded 37818 existing records. [2025-09-18T21:14:29.902427] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:14:29.902737] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-09-18T21:14:29.902796] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-09-18T21:14:29.903967] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-09-18T21:14:29.904029] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-09-18T21:14:30.124756] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-09-18T21:14:30.271741] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:14:30.919544] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-09-18T21:14:31.059018] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T21:14:31.086417] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-18T21:14:31.719544] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-09-18T21:14:32.194160] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-18T21:14:32.519594] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-09-18T21:14:33.063986] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-18T21:14:33.319549] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-09-18T21:14:33.434172] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-18T21:14:34.119547] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-11. [2025-09-18T21:14:34.420076] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-18T21:14:34.919552] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-09-18T21:14:35.518528] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-18T21:14:35.719587] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-09-18T21:14:36.366503] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-18T21:14:36.519677] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-09-18T21:14:36.835909] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-18T21:14:37.022120] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-18T21:14:37.023934] [INFO ] [REMOTE ] PSF: Full fetch complete (9627 records). [2025-09-18T21:14:37.024010] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-09-18T21:14:37.324737] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-09-18T21:14:37.417622] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-09-18T21:14:37.417748] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-09-18T21:14:37.418035] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-09-18T21:14:37.418087] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-09-18T21:14:37.418552] [DEBUG] [LOCAL ] PSF: Trimmed 9627 records to 6784 (keeping 200 days of data) [2025-09-18T21:14:37.460563] [DEBUG] [LOCAL ] PSF: Primary data saved (6784 records). [2025-09-18T21:14:37.460715] [INFO ] [MAIN ] PSF: Full history saved. [2025-09-18T21:14:37.460815] [INFO ] [MAIN ] Update Progress: 1741/2372 symbols completed. PSF took 33.6s. Estimated remaining: 1h 32m 16s. Rate: 6.8 symbols/min [2025-09-18T21:14:37.633424] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:14:37.670771] [DEBUG] [LOCAL ] PSQH: Loaded 34479 existing records from primary storage. [2025-09-18T21:14:37.670911] [INFO ] [MAIN ] PSQH: Loaded 34479 existing records. [2025-09-18T21:14:37.853021] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:14:37.853286] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-09-18T21:14:37.853357] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-09-18T21:14:37.854250] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-09-18T21:14:37.854312] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-09-18T21:14:38.124902] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-09-18T21:14:38.222564] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:14:38.419064] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-18T21:14:38.919556] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-09-18T21:14:39.159327] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-18T21:14:39.719548] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-09-18T21:14:40.327941] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T21:14:40.519507] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-09-18T21:14:40.848977] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-18T21:14:40.852817] [INFO ] [REMOTE ] PSFE: Full fetch complete (43351 records). [2025-09-18T21:14:40.852956] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-09-18T21:14:41.248168] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-09-18T21:14:41.248250] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-09-18T21:14:41.249130] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-09-18T21:14:41.249229] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-09-18T21:14:41.250224] [DEBUG] [LOCAL ] PSFE: Trimmed 43351 records to 31087 (keeping 200 days of data) [2025-09-18T21:14:41.332412] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-09-18T21:14:41.435091] [DEBUG] [LOCAL ] PSFE: Primary data saved (31087 records). [2025-09-18T21:14:41.435246] [INFO ] [MAIN ] PSFE: Full history saved. [2025-09-18T21:14:41.435336] [INFO ] [MAIN ] Update Progress: 1742/2372 symbols completed. PSFE took 34.3s. Estimated remaining: 1h 32m 5s. Rate: 6.8 symbols/min [2025-09-18T21:14:41.607388] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:14:41.661562] [DEBUG] [LOCAL ] PSTG: Loaded 52855 existing records from primary storage. [2025-09-18T21:14:41.661796] [INFO ] [MAIN ] PSTG: Loaded 52855 existing records. [2025-09-18T21:14:41.851524] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:14:41.851788] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-09-18T21:14:41.851840] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-09-18T21:14:41.853344] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-09-18T21:14:41.853405] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-09-18T21:14:42.128233] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-11. [2025-09-18T21:14:42.223182] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:14:42.255886] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-18T21:14:42.501317] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-18T21:14:42.919568] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-09-18T21:14:43.062315] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-18T21:14:43.719556] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-09-18T21:14:43.903273] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-18T21:14:44.519538] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-09-18T21:14:45.319542] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-09-18T21:14:45.915038] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-18T21:14:45.958627] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-18T21:14:46.119548] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-09-18T21:14:46.705745] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T21:14:46.919568] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-09-18T21:14:47.719534] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-11. [2025-09-18T21:14:47.923945] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-18T21:14:48.449429] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-18T21:14:48.519536] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-09-18T21:14:49.319588] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-09-18T21:14:49.449070] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-18T21:14:49.917610] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-18T21:14:50.119509] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-09-18T21:14:50.402315] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-18T21:14:50.919592] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-09-18T21:14:51.645982] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-18T21:14:51.719590] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-09-18T21:14:52.244346] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-18T21:14:52.519549] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-09-18T21:14:53.319547] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-09-18T21:14:53.714367] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-18T21:14:53.954303] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T21:14:54.119549] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-09-18T21:14:54.831930] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-18T21:14:54.919569] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-09-18T21:14:55.336325] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-18T21:14:55.719550] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-09-18T21:14:56.519561] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-09-18T21:14:56.678679] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-18T21:14:56.983839] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-18T21:14:57.319576] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-09-18T21:14:57.826964] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-18T21:14:58.119544] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-09-18T21:14:58.919550] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-09-18T21:14:59.182756] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-18T21:14:59.255919] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T21:14:59.719583] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-09-18T21:15:00.245728] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-18T21:15:00.519551] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-09-18T21:15:01.072154] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-18T21:15:01.077265] [INFO ] [REMOTE ] PSO: Full fetch complete (51682 records). [2025-09-18T21:15:01.077419] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-09-18T21:15:01.327413] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-09-18T21:15:01.456334] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-09-18T21:15:01.456427] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-09-18T21:15:01.457274] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-09-18T21:15:01.457356] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-09-18T21:15:01.458492] [DEBUG] [LOCAL ] PSO: Trimmed 51682 records to 38132 (keeping 200 days of data) [2025-09-18T21:15:01.688605] [DEBUG] [LOCAL ] PSO: Primary data saved (38132 records). [2025-09-18T21:15:01.688772] [INFO ] [MAIN ] PSO: Full history saved. [2025-09-18T21:15:01.688888] [INFO ] [MAIN ] Update Progress: 1743/2372 symbols completed. PSO took 32.2s. Estimated remaining: 1h 32m 1s. Rate: 6.8 symbols/min [2025-09-18T21:15:01.859752] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:15:01.880671] [DEBUG] [LOCAL ] PSTL: Loaded 20594 existing records from primary storage. [2025-09-18T21:15:01.880795] [INFO ] [MAIN ] PSTL: Loaded 20594 existing records. [2025-09-18T21:15:02.070068] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:15:02.070373] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-09-18T21:15:02.070464] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-09-18T21:15:02.071271] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-09-18T21:15:02.071335] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-09-18T21:15:02.138414] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-09-18T21:15:02.441402] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:15:02.465851] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-18T21:15:02.919587] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-11. [2025-09-18T21:15:03.719584] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-09-18T21:15:04.982310] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-11 (2.06 seconds). [2025-09-18T21:15:04.986546] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-09-18T21:15:05.344557] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (4.02 seconds). [2025-09-18T21:15:05.356360] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-09-18T21:15:05.374921] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-18T21:15:05.857732] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (3.72 seconds). [2025-09-18T21:15:05.864721] [INFO ] [REMOTE ] PSN: Full fetch complete (66648 records). [2025-09-18T21:15:05.864884] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-09-18T21:15:06.142588] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-09-18T21:15:06.346933] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-09-18T21:15:06.347669] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-09-18T21:15:06.348111] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T21:15:06.349871] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-09-18T21:15:06.350096] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-09-18T21:15:06.363918] [DEBUG] [LOCAL ] PSN: Trimmed 66648 records to 46785 (keeping 200 days of data) [2025-09-18T21:15:06.648404] [DEBUG] [LOCAL ] PSN: Primary data saved (46785 records). [2025-09-18T21:15:06.648557] [INFO ] [MAIN ] PSN: Full history saved. [2025-09-18T21:15:06.648695] [INFO ] [MAIN ] Update Progress: 1744/2372 symbols completed. PSN took 38.5s. Estimated remaining: 1h 31m 51s. Rate: 6.8 symbols/min [2025-09-18T21:15:06.819952] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:15:06.877757] [DEBUG] [LOCAL ] PSX: Loaded 53135 existing records from primary storage. [2025-09-18T21:15:06.877936] [INFO ] [MAIN ] PSX: Loaded 53135 existing records. [2025-09-18T21:15:06.924666] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-09-18T21:15:07.066707] [WARN ] [MAIN ] PSX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:15:07.066957] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-09-18T21:15:07.067005] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-09-18T21:15:07.068270] [DEBUG] [LOCAL ] PSX: Deleted primary data file. [2025-09-18T21:15:07.068333] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-09-18T21:15:07.461875] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:15:07.498815] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-18T21:15:07.529440] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-18T21:15:07.725084] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-09-18T21:15:07.734010] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-18T21:15:08.519588] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-09-18T21:15:08.984221] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-18T21:15:09.319613] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-09-18T21:15:10.089533] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T21:15:10.119510] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-09-18T21:15:10.535321] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T21:15:10.919568] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-09-18T21:15:11.719543] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-09-18T21:15:11.863665] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-18T21:15:12.172319] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-18T21:15:12.177966] [INFO ] [REMOTE ] PSQH: Full fetch complete (53462 records). [2025-09-18T21:15:12.178094] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-09-18T21:15:12.525352] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-09-18T21:15:12.582281] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-09-18T21:15:12.582359] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-09-18T21:15:12.583236] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-09-18T21:15:12.583326] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-09-18T21:15:12.584693] [DEBUG] [LOCAL ] PSQH: Trimmed 53462 records to 34746 (keeping 200 days of data) [2025-09-18T21:15:12.798560] [DEBUG] [LOCAL ] PSQH: Primary data saved (34746 records). [2025-09-18T21:15:12.798747] [INFO ] [MAIN ] PSQH: Full history saved. [2025-09-18T21:15:12.798947] [INFO ] [MAIN ] Update Progress: 1745/2372 symbols completed. PSQH took 35.3s. Estimated remaining: 1h 31m 41s. Rate: 6.8 symbols/min [2025-09-18T21:15:12.998674] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:15:13.014789] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-18T21:15:13.035526] [DEBUG] [LOCAL ] PTA: Loaded 15083 existing records from primary storage. [2025-09-18T21:15:13.035686] [INFO ] [MAIN ] PTA: Loaded 15083 existing records. [2025-09-18T21:15:13.222891] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:15:13.223247] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-09-18T21:15:13.223326] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-09-18T21:15:13.223847] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-09-18T21:15:13.223910] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-09-18T21:15:13.324637] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-11. [2025-09-18T21:15:13.588527] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:15:14.119549] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-09-18T21:15:14.919539] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-11. [2025-09-18T21:15:15.447306] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-09-18T21:15:15.719521] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-09-18T21:15:15.824599] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-11 (2.50 seconds). [2025-09-18T21:15:15.850412] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-18T21:15:15.945972] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-18T21:15:16.519537] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-09-18T21:15:17.319685] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-09-18T21:15:17.458872] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-18T21:15:18.119596] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-09-18T21:15:18.214219] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-18T21:15:18.555338] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-18T21:15:18.919556] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-09-18T21:15:19.712140] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-18T21:15:19.719517] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-09-18T21:15:19.720972] [INFO ] [REMOTE ] PSTG: Full fetch complete (76393 records). [2025-09-18T21:15:19.721054] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-09-18T21:15:20.120971] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-09-18T21:15:20.121108] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-09-18T21:15:20.122144] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-09-18T21:15:20.122209] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-09-18T21:15:20.124220] [DEBUG] [LOCAL ] PSTG: Trimmed 76393 records to 53241 (keeping 200 days of data) [2025-09-18T21:15:20.451251] [DEBUG] [LOCAL ] PSTG: Primary data saved (53241 records). [2025-09-18T21:15:20.451398] [INFO ] [MAIN ] PSTG: Full history saved. [2025-09-18T21:15:20.451671] [INFO ] [MAIN ] Update Progress: 1746/2372 symbols completed. PSTG took 39.0s. Estimated remaining: 1h 31m 32s. Rate: 6.8 symbols/min [2025-09-18T21:15:20.522134] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-09-18T21:15:20.639021] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:15:20.654174] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-18T21:15:20.688859] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-18T21:15:20.728198] [DEBUG] [LOCAL ] PTY: Loaded 37374 existing records from primary storage. [2025-09-18T21:15:20.728418] [INFO ] [MAIN ] PTY: Loaded 37374 existing records. [2025-09-18T21:15:20.911815] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:15:20.912073] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-09-18T21:15:20.912138] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-09-18T21:15:20.913288] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-09-18T21:15:20.913350] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-09-18T21:15:21.273028] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:15:21.319498] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-11. [2025-09-18T21:15:21.908043] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T21:15:22.119539] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-09-18T21:15:22.552707] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-18T21:15:22.919534] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-09-18T21:15:23.067594] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T21:15:23.721562] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-18T21:15:23.720488] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-09-18T21:15:24.519598] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-09-18T21:15:25.319568] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-09-18T21:15:25.351290] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-18T21:15:26.119576] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-09-18T21:15:26.332369] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-18T21:15:26.354202] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-18T21:15:26.919576] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-09-18T21:15:27.719560] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-09-18T21:15:27.818961] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-18T21:15:27.908279] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-18T21:15:28.510340] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-18T21:15:28.513966] [INFO ] [REMOTE ] PSTL: Full fetch complete (29442 records). [2025-09-18T21:15:28.514049] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-09-18T21:15:28.526916] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-09-18T21:15:28.902962] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-09-18T21:15:28.903080] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-09-18T21:15:28.904216] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-09-18T21:15:28.904300] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-09-18T21:15:28.905508] [DEBUG] [LOCAL ] PSTL: Trimmed 29442 records to 20779 (keeping 200 days of data) [2025-09-18T21:15:29.056164] [DEBUG] [LOCAL ] PSTL: Primary data saved (20779 records). [2025-09-18T21:15:29.056296] [INFO ] [MAIN ] PSTL: Full history saved. [2025-09-18T21:15:29.056422] [INFO ] [MAIN ] Update Progress: 1747/2372 symbols completed. PSTL took 27.4s. Estimated remaining: 1h 31m 23s. Rate: 6.8 symbols/min [2025-09-18T21:15:29.229563] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:15:29.277944] [DEBUG] [LOCAL ] PUK: Loaded 45055 existing records from primary storage. [2025-09-18T21:15:29.278094] [INFO ] [MAIN ] PUK: Loaded 45055 existing records. [2025-09-18T21:15:29.324679] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-09-18T21:15:29.460305] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:15:29.460574] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-09-18T21:15:29.460629] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-09-18T21:15:29.461911] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-09-18T21:15:29.461983] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-09-18T21:15:29.827031] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:15:30.119577] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-09-18T21:15:30.309392] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-18T21:15:30.330373] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-18T21:15:30.919600] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-09-18T21:15:31.719528] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-11. [2025-09-18T21:15:31.978465] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-18T21:15:32.080520] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-18T21:15:32.519610] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-09-18T21:15:33.091997] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-18T21:15:33.319613] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-09-18T21:15:34.119526] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-09-18T21:15:34.371343] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-18T21:15:34.392355] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-18T21:15:34.919553] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-09-18T21:15:35.363919] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T21:15:35.640938] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-18T21:15:35.719515] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-09-18T21:15:36.519537] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-09-18T21:15:37.319591] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-09-18T21:15:37.431413] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-18T21:15:37.992169] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-18T21:15:38.119602] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-09-18T21:15:38.224958] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-18T21:15:38.730625] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-18T21:15:38.919548] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-09-18T21:15:39.719604] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-09-18T21:15:40.519543] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-09-18T21:15:41.017184] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-18T21:15:41.063019] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-18T21:15:41.319584] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-09-18T21:15:41.900223] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T21:15:42.119570] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-09-18T21:15:42.238073] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-18T21:15:42.919570] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-09-18T21:15:43.719556] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-09-18T21:15:43.925251] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-18T21:15:43.960526] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-18T21:15:44.327810] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-18T21:15:44.330513] [INFO ] [REMOTE ] PTA: Full fetch complete (23622 records). [2025-09-18T21:15:44.330586] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-09-18T21:15:44.524952] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-09-18T21:15:44.709796] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-09-18T21:15:44.709881] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-09-18T21:15:44.710378] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-09-18T21:15:44.710420] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-09-18T21:15:44.711197] [DEBUG] [LOCAL ] PTA: Trimmed 23622 records to 15157 (keeping 200 days of data) [2025-09-18T21:15:44.808382] [DEBUG] [LOCAL ] PTA: Primary data saved (15157 records). [2025-09-18T21:15:44.808521] [INFO ] [MAIN ] PTA: Full history saved. [2025-09-18T21:15:44.808635] [INFO ] [MAIN ] Update Progress: 1748/2372 symbols completed. PTA took 32.0s. Estimated remaining: 1h 31m 17s. Rate: 6.8 symbols/min [2025-09-18T21:15:44.982990] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:15:45.037779] [DEBUG] [LOCAL ] PUMP: Loaded 49492 existing records from primary storage. [2025-09-18T21:15:45.037950] [INFO ] [MAIN ] PUMP: Loaded 49492 existing records. [2025-09-18T21:15:45.219968] [WARN ] [MAIN ] PUMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:15:45.220257] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-09-18T21:15:45.220306] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-09-18T21:15:45.221350] [DEBUG] [LOCAL ] PUMP: Deleted primary data file. [2025-09-18T21:15:45.221411] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-09-18T21:15:45.324322] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-09-18T21:15:45.584882] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:15:46.022885] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T21:15:46.119499] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-09-18T21:15:46.919606] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-09-18T21:15:47.001560] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-18T21:15:47.305883] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-18T21:15:47.719590] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-09-18T21:15:48.454728] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-18T21:15:48.462825] [INFO ] [REMOTE ] PSX: Full fetch complete (76882 records). [2025-09-18T21:15:48.463017] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-09-18T21:15:48.524745] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-09-18T21:15:48.880543] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-09-18T21:15:48.880664] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-09-18T21:15:48.881745] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-09-18T21:15:48.881809] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-09-18T21:15:48.883512] [DEBUG] [LOCAL ] PSX: Trimmed 76882 records to 53519 (keeping 200 days of data) [2025-09-18T21:15:49.135591] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-18T21:15:49.270418] [DEBUG] [LOCAL ] PSX: Primary data saved (53519 records). [2025-09-18T21:15:49.270625] [INFO ] [MAIN ] PSX: Full history saved. [2025-09-18T21:15:49.270829] [INFO ] [MAIN ] Update Progress: 1749/2372 symbols completed. PSX took 42.6s. Estimated remaining: 1h 31m 6s. Rate: 6.8 symbols/min [2025-09-18T21:15:49.330904] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-09-18T21:15:49.457715] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:15:49.504528] [DEBUG] [LOCAL ] PVH: Loaded 50403 existing records from primary storage. [2025-09-18T21:15:49.504721] [INFO ] [MAIN ] PVH: Loaded 50403 existing records. [2025-09-18T21:15:49.681765] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:15:49.682031] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-09-18T21:15:49.682080] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-09-18T21:15:49.683198] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-09-18T21:15:49.683282] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-09-18T21:15:50.047429] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:15:50.119539] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-11. [2025-09-18T21:15:50.353572] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-18T21:15:50.546896] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-18T21:15:50.552491] [INFO ] [REMOTE ] PTY: Full fetch complete (53741 records). [2025-09-18T21:15:50.552604] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-09-18T21:15:50.922679] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-09-18T21:15:50.947501] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-09-18T21:15:50.947575] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-09-18T21:15:50.948534] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-09-18T21:15:50.948599] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-09-18T21:15:50.949774] [DEBUG] [LOCAL ] PTY: Trimmed 53741 records to 37652 (keeping 200 days of data) [2025-09-18T21:15:51.206825] [DEBUG] [LOCAL ] PTY: Primary data saved (37652 records). [2025-09-18T21:15:51.206997] [INFO ] [MAIN ] PTY: Full history saved. [2025-09-18T21:15:51.207122] [INFO ] [MAIN ] Update Progress: 1750/2372 symbols completed. PTY took 30.8s. Estimated remaining: 1h 30m 55s. Rate: 6.8 symbols/min [2025-09-18T21:15:51.378229] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:15:51.384505] [DEBUG] [LOCAL ] PVL: Loaded 4690 existing records from primary storage. [2025-09-18T21:15:51.384587] [INFO ] [MAIN ] PVL: Loaded 4690 existing records. [2025-09-18T21:15:51.566612] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:15:51.567075] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-09-18T21:15:51.567176] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-09-18T21:15:51.567565] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-09-18T21:15:51.567752] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-09-18T21:15:51.736299] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-11. [2025-09-18T21:15:51.840041] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-18T21:15:51.984980] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:15:52.521504] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-09-18T21:15:52.525336] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-18T21:15:53.319558] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-09-18T21:15:53.546147] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-18T21:15:54.001809] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-18T21:15:54.119527] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-09-18T21:15:54.769132] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T21:15:54.919537] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-09-18T21:15:55.506426] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-18T21:15:55.719557] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-09-18T21:15:56.397781] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-18T21:15:56.519553] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-09-18T21:15:57.070799] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T21:15:57.319593] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-11. [2025-09-18T21:15:57.839498] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-18T21:15:58.119546] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-09-18T21:15:58.343857] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-18T21:15:58.919572] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-09-18T21:15:59.547617] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-18T21:15:59.591211] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-18T21:15:59.719510] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-09-18T21:16:00.519529] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-09-18T21:16:01.126112] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-18T21:16:01.319611] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-09-18T21:16:01.380577] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-18T21:16:02.119570] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-09-18T21:16:02.852444] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-18T21:16:02.919518] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-09-18T21:16:03.290162] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-18T21:16:03.296667] [INFO ] [REMOTE ] PUK: Full fetch complete (64934 records). [2025-09-18T21:16:03.296836] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-09-18T21:16:03.710464] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-09-18T21:16:03.710566] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-09-18T21:16:03.711528] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-09-18T21:16:03.711596] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-09-18T21:16:03.713054] [DEBUG] [LOCAL ] PUK: Trimmed 64934 records to 45398 (keeping 200 days of data) [2025-09-18T21:16:03.767231] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-09-18T21:16:04.016872] [DEBUG] [LOCAL ] PUK: Primary data saved (45398 records). [2025-09-18T21:16:04.017084] [INFO ] [MAIN ] PUK: Full history saved. [2025-09-18T21:16:04.017212] [INFO ] [MAIN ] Update Progress: 1751/2372 symbols completed. PUK took 35.0s. Estimated remaining: 1h 30m 48s. Rate: 6.8 symbols/min [2025-09-18T21:16:04.186668] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:16:04.238308] [DEBUG] [LOCAL ] PWR: Loaded 47616 existing records from primary storage. [2025-09-18T21:16:04.238456] [INFO ] [MAIN ] PWR: Loaded 47616 existing records. [2025-09-18T21:16:04.445521] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-18T21:16:04.450210] [WARN ] [MAIN ] PWR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:16:04.460810] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-09-18T21:16:04.460888] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-09-18T21:16:04.461997] [DEBUG] [LOCAL ] PWR: Deleted primary data file. [2025-09-18T21:16:04.462063] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-09-18T21:16:04.524675] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-09-18T21:16:04.829787] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:16:05.319563] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-11. [2025-09-18T21:16:05.603540] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-18T21:16:06.067826] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-18T21:16:06.119561] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-09-18T21:16:06.861809] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-18T21:16:06.874840] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-18T21:16:06.919509] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-09-18T21:16:07.553046] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-18T21:16:07.719557] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-09-18T21:16:08.218204] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-18T21:16:08.519548] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-09-18T21:16:09.319578] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-09-18T21:16:10.129114] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-09-18T21:16:10.154395] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-18T21:16:10.882477] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-18T21:16:10.919621] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-09-18T21:16:11.719559] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-09-18T21:16:11.733007] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-18T21:16:11.776550] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-18T21:16:12.519547] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-09-18T21:16:13.095718] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-18T21:16:13.319579] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-09-18T21:16:13.662526] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-18T21:16:13.771237] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-18T21:16:14.119598] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-09-18T21:16:14.919574] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-09-18T21:16:15.719565] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-09-18T21:16:16.055178] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-18T21:16:16.318846] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-18T21:16:16.382064] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-18T21:16:16.519522] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-09-18T21:16:17.319556] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-09-18T21:16:17.875954] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-18T21:16:17.877153] [INFO ] [REMOTE ] PVL: Full fetch complete (7528 records). [2025-09-18T21:16:17.877225] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-09-18T21:16:18.134340] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-09-18T21:16:18.264967] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-09-18T21:16:18.286690] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-09-18T21:16:18.289670] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-09-18T21:16:18.289951] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-09-18T21:16:18.291449] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-18T21:16:18.301250] [DEBUG] [LOCAL ] PVL: Trimmed 7528 records to 4742 (keeping 200 days of data) [2025-09-18T21:16:18.328387] [DEBUG] [LOCAL ] PVL: Primary data saved (4742 records). [2025-09-18T21:16:18.328474] [INFO ] [MAIN ] PVL: Full history saved. [2025-09-18T21:16:18.328556] [INFO ] [MAIN ] Update Progress: 1752/2372 symbols completed. PVL took 27.1s. Estimated remaining: 1h 30m 41s. Rate: 6.8 symbols/min [2025-09-18T21:16:18.496905] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:16:18.533622] [DEBUG] [LOCAL ] PX: Loaded 34737 existing records from primary storage. [2025-09-18T21:16:18.533792] [INFO ] [MAIN ] PX: Loaded 34737 existing records. [2025-09-18T21:16:18.714412] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:16:18.714738] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-09-18T21:16:18.714808] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-09-18T21:16:18.715722] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-09-18T21:16:18.715785] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-09-18T21:16:18.926209] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-09-18T21:16:19.092209] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:16:19.719598] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-09-18T21:16:19.887146] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-18T21:16:20.373700] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T21:16:20.519536] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-11. [2025-09-18T21:16:21.319521] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-09-18T21:16:21.382586] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-18T21:16:21.748112] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-18T21:16:22.119547] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-09-18T21:16:22.919586] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-09-18T21:16:23.427601] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-18T21:16:23.680427] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-18T21:16:23.719523] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-09-18T21:16:23.979467] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-18T21:16:24.519541] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-09-18T21:16:25.321575] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-09-18T21:16:25.323873] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-18T21:16:25.331227] [INFO ] [REMOTE ] PUMP: Full fetch complete (71414 records). [2025-09-18T21:16:25.331336] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-09-18T21:16:25.740053] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-09-18T21:16:25.740135] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-09-18T21:16:25.741132] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-09-18T21:16:25.741199] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-09-18T21:16:25.743565] [DEBUG] [LOCAL ] PUMP: Trimmed 71414 records to 49869 (keeping 200 days of data) [2025-09-18T21:16:26.024462] [DEBUG] [LOCAL ] PUMP: Primary data saved (49869 records). [2025-09-18T21:16:26.024760] [INFO ] [MAIN ] PUMP: Full history saved. [2025-09-18T21:16:26.024867] [INFO ] [MAIN ] Update Progress: 1753/2372 symbols completed. PUMP took 41.2s. Estimated remaining: 1h 30m 32s. Rate: 6.8 symbols/min [2025-09-18T21:16:26.119864] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-09-18T21:16:26.126223] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T21:16:26.237402] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:16:26.237999] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-09-18T21:16:26.238056] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-09-18T21:16:26.238295] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-09-18T21:16:26.238376] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-18T21:16:26.238455] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-09-18T21:16:26.238504] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-09-18T21:16:26.613730] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:16:26.919506] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-11. [2025-09-18T21:16:27.184179] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-18T21:16:27.719521] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-09-18T21:16:27.782842] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-18T21:16:28.519561] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-09-18T21:16:29.091712] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-11 (2.17 seconds). [2025-09-18T21:16:29.235898] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-18T21:16:29.319504] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-09-18T21:16:30.119566] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-09-18T21:16:30.154498] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-18T21:16:30.919554] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-09-18T21:16:31.719544] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-09-18T21:16:32.100677] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-18T21:16:32.222819] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.90 seconds). [2025-09-18T21:16:32.253288] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T21:16:32.261718] [INFO ] [REMOTE ] PVH: Full fetch complete (70592 records). [2025-09-18T21:16:32.261858] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-09-18T21:16:32.527751] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-09-18T21:16:32.664078] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-09-18T21:16:32.664180] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-09-18T21:16:32.665241] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-09-18T21:16:32.665305] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-09-18T21:16:32.666747] [DEBUG] [LOCAL ] PVH: Trimmed 70592 records to 50759 (keeping 200 days of data) [2025-09-18T21:16:32.925157] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-18T21:16:33.012262] [DEBUG] [LOCAL ] PVH: Primary data saved (50759 records). [2025-09-18T21:16:33.012402] [INFO ] [MAIN ] PVH: Full history saved. [2025-09-18T21:16:33.012509] [INFO ] [MAIN ] Update Progress: 1754/2372 symbols completed. PVH took 43.7s. Estimated remaining: 1h 30m 22s. Rate: 6.8 symbols/min [2025-09-18T21:16:33.187281] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:16:33.217243] [DEBUG] [LOCAL ] QD: Loaded 27932 existing records from primary storage. [2025-09-18T21:16:33.217396] [INFO ] [MAIN ] QD: Loaded 27932 existing records. [2025-09-18T21:16:33.322171] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-09-18T21:16:33.402039] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:16:33.402305] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-09-18T21:16:33.402355] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-09-18T21:16:33.402991] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-09-18T21:16:33.403067] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-09-18T21:16:33.765195] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:16:34.119558] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-09-18T21:16:34.919520] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-11. [2025-09-18T21:16:35.137482] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-18T21:16:35.211161] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-09-18T21:16:35.250983] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-18T21:16:35.719554] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-09-18T21:16:35.910764] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-18T21:16:36.519593] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-09-18T21:16:37.319560] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-09-18T21:16:37.865044] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-18T21:16:37.971499] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-18T21:16:38.009879] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-18T21:16:38.119512] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-09-18T21:16:38.919556] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-09-18T21:16:39.719531] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-09-18T21:16:39.839152] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-18T21:16:39.845475] [INFO ] [REMOTE ] PWR: Full fetch complete (68843 records). [2025-09-18T21:16:39.845619] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-09-18T21:16:40.237037] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-09-18T21:16:40.237126] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-09-18T21:16:40.238124] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-09-18T21:16:40.238190] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-09-18T21:16:40.239712] [DEBUG] [LOCAL ] PWR: Trimmed 68843 records to 47954 (keeping 200 days of data) [2025-09-18T21:16:40.530280] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-09-18T21:16:40.546990] [DEBUG] [LOCAL ] PWR: Primary data saved (47954 records). [2025-09-18T21:16:40.547096] [INFO ] [MAIN ] PWR: Full history saved. [2025-09-18T21:16:40.548637] [INFO ] [MAIN ] Update Progress: 1755/2372 symbols completed. PWR took 36.5s. Estimated remaining: 1h 30m 13s. Rate: 6.8 symbols/min [2025-09-18T21:16:40.719511] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:16:40.765938] [DEBUG] [LOCAL ] QGEN: Loaded 49212 existing records from primary storage. [2025-09-18T21:16:40.766106] [INFO ] [MAIN ] QGEN: Loaded 49212 existing records. [2025-09-18T21:16:40.945947] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:16:40.946229] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-09-18T21:16:40.946292] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-09-18T21:16:40.947265] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-09-18T21:16:40.947325] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-09-18T21:16:41.312033] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:16:41.324623] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-11. [2025-09-18T21:16:41.336066] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-18T21:16:41.750980] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-09-18T21:16:41.796218] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-18T21:16:42.119573] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-09-18T21:16:42.633224] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-18T21:16:42.919569] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-09-18T21:16:43.332571] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T21:16:43.719542] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-09-18T21:16:44.383106] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-18T21:16:44.519533] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-09-18T21:16:44.754771] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-18T21:16:45.319553] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-09-18T21:16:46.026039] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T21:16:46.119522] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-09-18T21:16:46.804688] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-18T21:16:46.919509] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-09-18T21:16:47.705785] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-18T21:16:47.719504] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-09-18T21:16:48.410057] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-18T21:16:48.519522] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-09-18T21:16:49.249552] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T21:16:49.319508] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-09-18T21:16:49.662322] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-18T21:16:50.119577] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-09-18T21:16:50.919514] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-09-18T21:16:50.949769] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-18T21:16:51.719595] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-09-18T21:16:52.404836] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T21:16:52.491616] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-18T21:16:52.519497] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-09-18T21:16:52.598794] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-18T21:16:53.320147] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-09-18T21:16:53.411331] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-18T21:16:53.416532] [INFO ] [REMOTE ] PX: Full fetch complete (51154 records). [2025-09-18T21:16:53.416701] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-09-18T21:16:53.802733] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-09-18T21:16:53.802826] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-09-18T21:16:53.803760] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-09-18T21:16:53.803828] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-09-18T21:16:53.805049] [DEBUG] [LOCAL ] PX: Trimmed 51154 records to 35019 (keeping 200 days of data) [2025-09-18T21:16:54.023579] [DEBUG] [LOCAL ] PX: Primary data saved (35019 records). [2025-09-18T21:16:54.023765] [INFO ] [MAIN ] PX: Full history saved. [2025-09-18T21:16:54.023892] [INFO ] [MAIN ] Update Progress: 1756/2372 symbols completed. PX took 35.7s. Estimated remaining: 1h 30m 6s. Rate: 6.8 symbols/min [2025-09-18T21:16:54.129733] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-09-18T21:16:54.206445] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:16:54.263869] [DEBUG] [LOCAL ] QS: Loaded 53742 existing records from primary storage. [2025-09-18T21:16:54.264032] [INFO ] [MAIN ] QS: Loaded 53742 existing records. [2025-09-18T21:16:54.448659] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:16:54.448932] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-09-18T21:16:54.448982] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-09-18T21:16:54.450116] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-09-18T21:16:54.450178] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-09-18T21:16:54.820097] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:16:54.919527] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-11. [2025-09-18T21:16:55.719554] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-09-18T21:16:56.035719] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-18T21:16:56.150361] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-09-18T21:16:56.519533] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-09-18T21:16:56.633870] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-18T21:16:56.837614] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-18T21:16:57.319593] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-09-18T21:16:58.119544] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-09-18T21:16:58.919621] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-09-18T21:16:59.049622] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-09-18T21:16:59.424247] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T21:16:59.719511] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-09-18T21:16:59.831267] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-18T21:16:59.882513] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-18T21:17:00.519563] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-09-18T21:17:01.319555] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-09-18T21:17:02.119605] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-09-18T21:17:02.240750] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-18T21:17:02.708533] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.99 seconds). [2025-09-18T21:17:02.919541] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-09-18T21:17:02.955817] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-18T21:17:03.561792] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-18T21:17:03.719628] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-09-18T21:17:04.519534] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-09-18T21:17:05.320103] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-09-18T21:17:05.610180] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-09-18T21:17:05.697751] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-18T21:17:06.119523] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-09-18T21:17:06.227232] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-18T21:17:06.333944] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-18T21:17:06.919545] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-09-18T21:17:07.719551] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-09-18T21:17:07.970078] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-18T21:17:07.974306] [INFO ] [REMOTE ] QD: Full fetch complete (40723 records). [2025-09-18T21:17:07.974457] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-09-18T21:17:08.425094] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-09-18T21:17:08.425213] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-09-18T21:17:08.426082] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-09-18T21:17:08.426162] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-09-18T21:17:08.437929] [DEBUG] [LOCAL ] QD: Trimmed 40723 records to 28239 (keeping 200 days of data) [2025-09-18T21:17:08.461191] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-18T21:17:08.528142] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-09-18T21:17:08.594985] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-18T21:17:08.604066] [INFO ] [REMOTE ] QBTS: Full fetch complete (77532 records). [2025-09-18T21:17:08.604800] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-09-18T21:17:08.606562] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T21:17:08.607532] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:17:08.607923] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:17:08.608336] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-18T21:17:08.608709] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-09-18T21:17:08.608779] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-09-18T21:17:08.609462] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-09-18T21:17:08.609903] [INFO ] [MAIN ] Update Progress: 1757/2372 symbols completed. QBTS took 42.6s. Estimated remaining: 1h 29m 59s. Rate: 6.8 symbols/min [2025-09-18T21:17:08.664959] [DEBUG] [LOCAL ] QD: Primary data saved (28239 records). [2025-09-18T21:17:08.665108] [INFO ] [MAIN ] QD: Full history saved. [2025-09-18T21:17:08.665199] [INFO ] [MAIN ] Update Progress: 1758/2372 symbols completed. QD took 35.7s. Estimated remaining: 1h 29m 47s. Rate: 6.8 symbols/min [2025-09-18T21:17:09.319606] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-09-18T21:17:10.231637] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-18T21:17:10.238451] [INFO ] [REMOTE ] QGEN: Full fetch complete (69800 records). [2025-09-18T21:17:10.238568] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-09-18T21:17:10.631953] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-09-18T21:17:10.632050] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-09-18T21:17:10.633042] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-09-18T21:17:10.633106] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-09-18T21:17:10.634505] [DEBUG] [LOCAL ] QGEN: Trimmed 69800 records to 49545 (keeping 200 days of data) [2025-09-18T21:17:10.928379] [DEBUG] [LOCAL ] QGEN: Primary data saved (49545 records). [2025-09-18T21:17:10.928515] [INFO ] [MAIN ] QGEN: Full history saved. [2025-09-18T21:17:10.928622] [INFO ] [MAIN ] Update Progress: 1759/2372 symbols completed. QGEN took 30.4s. Estimated remaining: 1h 29m 36s. Rate: 6.8 symbols/min [2025-09-18T21:17:11.425292] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-18T21:17:11.436612] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-09-18T21:17:13.541556] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-18T21:17:13.552964] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-09-18T21:17:15.776568] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-18T21:17:15.787894] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-09-18T21:17:18.629269] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-09-18T21:17:18.644489] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-09-18T21:17:21.251092] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-18T21:17:21.262609] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-09-18T21:17:23.831889] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-18T21:17:23.843454] [INFO ] [REMOTE ] QS: Full fetch complete (77811 records). [2025-09-18T21:17:23.843677] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-09-18T21:17:24.258161] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-09-18T21:17:24.258251] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-09-18T21:17:24.259333] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-09-18T21:17:24.259422] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-09-18T21:17:24.262618] [DEBUG] [LOCAL ] QS: Trimmed 77811 records to 54132 (keeping 200 days of data) [2025-09-18T21:17:24.612918] [DEBUG] [LOCAL ] QS: Primary data saved (54132 records). [2025-09-18T21:17:24.613106] [INFO ] [MAIN ] QS: Full history saved. [2025-09-18T21:17:24.613327] [INFO ] [MAIN ] Update Progress: 1760/2372 symbols completed. QS took 30.6s. Estimated remaining: 1h 29m 29s. Rate: 6.8 symbols/min [2025-09-18T21:17:25.360622] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:17:25.338169] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:17:25.365705] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:17:25.391668] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:17:25.430075] [DEBUG] [LOCAL ] QVCC: Loaded 9120 existing records from primary storage. [2025-09-18T21:17:25.430247] [INFO ] [MAIN ] QVCC: Loaded 9120 existing records. [2025-09-18T21:17:25.569579] [DEBUG] [LOCAL ] QUAD: Loaded 24247 existing records from primary storage. [2025-09-18T21:17:25.603889] [INFO ] [MAIN ] QUAD: Loaded 24247 existing records. [2025-09-18T21:17:25.707552] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:17:25.807742] [DEBUG] [LOCAL ] QTWO: Loaded 39001 existing records from primary storage. [2025-09-18T21:17:25.808159] [INFO ] [MAIN ] QTWO: Loaded 39001 existing records. [2025-09-18T21:17:25.820228] [DEBUG] [LOCAL ] QSR: Loaded 52402 existing records from primary storage. [2025-09-18T21:17:25.825600] [INFO ] [MAIN ] QSR: Loaded 52402 existing records. [2025-09-18T21:17:25.835465] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-09-18T21:17:25.864672] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-09-18T21:17:25.928507] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-09-18T21:17:25.958729] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-09-18T21:17:26.124027] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:17:26.310415] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-09-18T21:17:26.324405] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-09-18T21:17:26.387010] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-09-18T21:17:26.394773] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-09-18T21:17:26.394608] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:17:26.408742] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:17:26.415138] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-09-18T21:17:26.437013] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-09-18T21:17:26.437089] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-09-18T21:17:26.482283] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-09-18T21:17:26.491847] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-09-18T21:17:26.525556] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-09-18T21:17:26.559497] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-09-18T21:17:26.579002] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-09-18T21:17:27.390857] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:17:27.468931] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-11. [2025-09-18T21:17:27.721961] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:17:27.782767] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-11. [2025-09-18T21:17:27.782409] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:17:27.815187] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:17:27.815579] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-11. [2025-09-18T21:17:27.815899] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-11. [2025-09-18T21:17:28.208735] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-18T21:17:28.210605] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-09-18T21:17:28.826301] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-18T21:17:28.829034] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-09-18T21:17:29.016897] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-18T21:17:29.022780] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-09-18T21:17:29.155451] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-18T21:17:29.163833] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-09-18T21:17:29.198047] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T21:17:29.208160] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-09-18T21:17:29.293369] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-18T21:17:29.295490] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-09-18T21:17:29.931703] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-18T21:17:29.933290] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-09-18T21:17:30.176754] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-18T21:17:30.182723] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-09-18T21:17:30.453780] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-18T21:17:30.462376] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-09-18T21:17:30.624820] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-18T21:17:30.637409] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-09-18T21:17:30.651158] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-18T21:17:30.656101] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-09-18T21:17:31.020286] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T21:17:31.025345] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-09-18T21:17:31.161350] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-18T21:17:31.163824] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-09-18T21:17:31.777553] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-18T21:17:31.786355] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-09-18T21:17:31.794733] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-18T21:17:31.797886] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-09-18T21:17:31.857049] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-18T21:17:31.862430] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-09-18T21:17:32.062736] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T21:17:32.073011] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-09-18T21:17:32.479470] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-18T21:17:32.482742] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-09-18T21:17:32.741334] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-18T21:17:32.746934] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-09-18T21:17:33.067192] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-18T21:17:33.069743] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-09-18T21:17:33.093467] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-18T21:17:33.319535] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-09-18T21:17:33.420967] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T21:17:33.678130] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-18T21:17:33.938238] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-18T21:17:34.119543] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-09-18T21:17:34.843720] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-18T21:17:34.919534] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-09-18T21:17:35.634582] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-18T21:17:35.719549] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-09-18T21:17:36.177485] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-18T21:17:36.519528] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-09-18T21:17:37.138056] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T21:17:37.139858] [INFO ] [REMOTE ] QVCC: Full fetch complete (11995 records). [2025-09-18T21:17:37.139933] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-09-18T21:17:37.321883] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-09-18T21:17:37.536580] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-09-18T21:17:37.536919] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-09-18T21:17:37.537479] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-09-18T21:17:37.537567] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-09-18T21:17:37.538474] [DEBUG] [LOCAL ] QVCC: Trimmed 11995 records to 9166 (keeping 200 days of data) [2025-09-18T21:17:37.614828] [DEBUG] [LOCAL ] QVCC: Primary data saved (9166 records). [2025-09-18T21:17:37.615108] [INFO ] [MAIN ] QVCC: Full history saved. [2025-09-18T21:17:37.615571] [INFO ] [MAIN ] Update Progress: 1761/2372 symbols completed. QVCC took 13.0s. Estimated remaining: 1h 29m 22s. Rate: 6.8 symbols/min [2025-09-18T21:17:37.752024] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-18T21:17:37.836364] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:17:37.843678] [DEBUG] [LOCAL ] QVCD: Loaded 4668 existing records from primary storage. [2025-09-18T21:17:37.843799] [INFO ] [MAIN ] QVCD: Loaded 4668 existing records. [2025-09-18T21:17:38.020310] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:17:38.020580] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-09-18T21:17:38.020631] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-09-18T21:17:38.021031] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-09-18T21:17:38.021092] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-09-18T21:17:38.122607] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-09-18T21:17:38.383849] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:17:38.919575] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-11. [2025-09-18T21:17:39.200566] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-18T21:17:39.714117] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-18T21:17:39.728280] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-09-18T21:17:39.748090] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-18T21:17:40.519589] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-09-18T21:17:41.299490] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T21:17:41.319957] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-09-18T21:17:41.357973] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-18T21:17:41.985634] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-18T21:17:42.119560] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-09-18T21:17:42.919561] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-09-18T21:17:43.719554] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-09-18T21:17:43.835425] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-18T21:17:44.084195] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-18T21:17:44.519526] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-09-18T21:17:44.652017] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T21:17:45.319633] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-09-18T21:17:45.647889] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T21:17:45.980559] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-18T21:17:46.119529] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-09-18T21:17:46.919605] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-09-18T21:17:47.242226] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-18T21:17:47.719548] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-09-18T21:17:48.519536] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-09-18T21:17:48.774151] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-18T21:17:49.082261] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-18T21:17:49.226378] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-18T21:17:49.229669] [INFO ] [REMOTE ] QUAD: Full fetch complete (35188 records). [2025-09-18T21:17:49.229764] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-09-18T21:17:49.324669] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-09-18T21:17:49.615113] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-09-18T21:17:49.615203] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-09-18T21:17:49.615916] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-09-18T21:17:49.615980] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-09-18T21:17:49.616915] [DEBUG] [LOCAL ] QUAD: Trimmed 35188 records to 24380 (keeping 200 days of data) [2025-09-18T21:17:49.770817] [DEBUG] [LOCAL ] QUAD: Primary data saved (24380 records). [2025-09-18T21:17:49.770957] [INFO ] [MAIN ] QUAD: Full history saved. [2025-09-18T21:17:49.771044] [INFO ] [MAIN ] Update Progress: 1762/2372 symbols completed. QUAD took 25.2s. Estimated remaining: 1h 29m 14s. Rate: 6.8 symbols/min [2025-09-18T21:17:49.944367] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:17:50.003757] [DEBUG] [LOCAL ] QXO: Loaded 53142 existing records from primary storage. [2025-09-18T21:17:50.003915] [INFO ] [MAIN ] QXO: Loaded 53142 existing records. [2025-09-18T21:17:50.124727] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-09-18T21:17:50.183856] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:17:50.184209] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-09-18T21:17:50.184267] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-09-18T21:17:50.186054] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-09-18T21:17:50.186119] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-09-18T21:17:50.547719] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:17:50.613442] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-18T21:17:50.636161] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-18T21:17:50.642774] [INFO ] [REMOTE ] QTWO: Full fetch complete (56958 records). [2025-09-18T21:17:50.642891] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-09-18T21:17:50.924672] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-09-18T21:17:51.048857] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-09-18T21:17:51.048935] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-09-18T21:17:51.049824] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-09-18T21:17:51.049887] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-09-18T21:17:51.051126] [DEBUG] [LOCAL ] QTWO: Trimmed 56958 records to 39386 (keeping 200 days of data) [2025-09-18T21:17:51.302321] [DEBUG] [LOCAL ] QTWO: Primary data saved (39386 records). [2025-09-18T21:17:51.302477] [INFO ] [MAIN ] QTWO: Full history saved. [2025-09-18T21:17:51.302568] [INFO ] [MAIN ] Update Progress: 1763/2372 symbols completed. QTWO took 26.7s. Estimated remaining: 1h 29m 3s. Rate: 6.8 symbols/min [2025-09-18T21:17:51.475819] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:17:51.507810] [DEBUG] [LOCAL ] R: Loaded 29855 existing records from primary storage. [2025-09-18T21:17:51.508013] [INFO ] [MAIN ] R: Loaded 29855 existing records. [2025-09-18T21:17:51.697582] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:17:51.697944] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-09-18T21:17:51.698004] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-09-18T21:17:51.699344] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-09-18T21:17:51.699404] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-09-18T21:17:51.730757] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-11. [2025-09-18T21:17:52.061269] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:17:52.519533] [INFO ] [REMOTE ] R: Fetching primary data for 2024-11. [2025-09-18T21:17:52.956225] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-18T21:17:53.319554] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-09-18T21:17:53.489985] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-18T21:17:53.552462] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-18T21:17:53.735051] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-18T21:17:54.119546] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-09-18T21:17:54.665405] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-18T21:17:54.919554] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-09-18T21:17:55.719545] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-09-18T21:17:56.495120] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-18T21:17:56.519501] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-09-18T21:17:57.223198] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-18T21:17:57.232052] [INFO ] [REMOTE ] QSR: Full fetch complete (75650 records). [2025-09-18T21:17:57.232194] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-09-18T21:17:57.325050] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-09-18T21:17:57.629855] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-09-18T21:17:57.629940] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-09-18T21:17:57.630981] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-09-18T21:17:57.631048] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-09-18T21:17:57.632511] [DEBUG] [LOCAL ] QSR: Trimmed 75650 records to 52780 (keeping 200 days of data) [2025-09-18T21:17:57.993675] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-18T21:17:58.012183] [DEBUG] [LOCAL ] QSR: Primary data saved (52780 records). [2025-09-18T21:17:58.012304] [INFO ] [MAIN ] QSR: Full history saved. [2025-09-18T21:17:58.012436] [INFO ] [MAIN ] Update Progress: 1764/2372 symbols completed. QSR took 33.4s. Estimated remaining: 1h 28m 54s. Rate: 6.8 symbols/min [2025-09-18T21:17:58.124724] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-09-18T21:17:58.190679] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:17:58.196859] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-18T21:17:58.219690] [DEBUG] [LOCAL ] RA: Loaded 21808 existing records from primary storage. [2025-09-18T21:17:58.219864] [INFO ] [MAIN ] RA: Loaded 21808 existing records. [2025-09-18T21:17:58.400227] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:17:58.400549] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-09-18T21:17:58.400624] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-09-18T21:17:58.401979] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-09-18T21:17:58.402043] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-09-18T21:17:58.810540] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:17:58.919604] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-09-18T21:17:59.422192] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-18T21:17:59.719564] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-09-18T21:17:59.961500] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-18T21:18:00.519559] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-11. [2025-09-18T21:18:00.824639] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T21:18:01.319568] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-09-18T21:18:01.723053] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-18T21:18:02.046957] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-18T21:18:02.119612] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-09-18T21:18:02.919607] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-09-18T21:18:03.719590] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-09-18T21:18:04.276726] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-18T21:18:04.519563] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-09-18T21:18:04.668910] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-18T21:18:05.323059] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-09-18T21:18:05.327769] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T21:18:06.050107] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T21:18:06.119493] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-09-18T21:18:06.507673] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-18T21:18:06.919544] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-09-18T21:18:07.719597] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-09-18T21:18:07.871331] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-18T21:18:07.895976] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-18T21:18:08.519551] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-09-18T21:18:08.880789] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-18T21:18:09.319584] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-09-18T21:18:09.726852] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-18T21:18:09.727894] [INFO ] [REMOTE ] QVCD: Full fetch complete (6193 records). [2025-09-18T21:18:09.727965] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-09-18T21:18:10.109992] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-09-18T21:18:10.110154] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-09-18T21:18:10.110371] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-09-18T21:18:10.110477] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-09-18T21:18:10.111385] [DEBUG] [LOCAL ] QVCD: Trimmed 6193 records to 4676 (keeping 200 days of data) [2025-09-18T21:18:10.124190] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-09-18T21:18:10.177537] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-18T21:18:10.176218] [DEBUG] [LOCAL ] QVCD: Primary data saved (4676 records). [2025-09-18T21:18:10.188615] [INFO ] [MAIN ] QVCD: Full history saved. [2025-09-18T21:18:10.189296] [INFO ] [MAIN ] Update Progress: 1765/2372 symbols completed. QVCD took 32.6s. Estimated remaining: 1h 28m 46s. Rate: 6.8 symbols/min [2025-09-18T21:18:10.362181] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:18:10.395915] [DEBUG] [LOCAL ] RACE: Loaded 33145 existing records from primary storage. [2025-09-18T21:18:10.396089] [INFO ] [MAIN ] RACE: Loaded 33145 existing records. [2025-09-18T21:18:10.578597] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:18:10.578887] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-09-18T21:18:10.578936] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-09-18T21:18:10.579978] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-09-18T21:18:10.580039] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-09-18T21:18:10.932214] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-09-18T21:18:10.938452] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:18:11.719554] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-11. [2025-09-18T21:18:11.823168] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-18T21:18:11.968521] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-18T21:18:12.519550] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-09-18T21:18:13.319543] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-09-18T21:18:14.123935] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-09-18T21:18:14.133191] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-11 (2.41 seconds). [2025-09-18T21:18:14.919628] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-09-18T21:18:15.482042] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (2.96 seconds). [2025-09-18T21:18:15.719773] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-09-18T21:18:16.340838] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-18T21:18:16.445220] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-18T21:18:16.519594] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-09-18T21:18:16.825921] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (3.51 seconds). [2025-09-18T21:18:16.859621] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-18T21:18:17.319590] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-09-18T21:18:17.700069] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-18T21:18:18.119552] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-09-18T21:18:18.327482] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-18T21:18:18.919583] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-09-18T21:18:19.598909] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-18T21:18:19.719556] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-09-18T21:18:20.519568] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-09-18T21:18:20.881109] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-18T21:18:21.118242] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-18T21:18:21.319597] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-09-18T21:18:21.386748] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-18T21:18:22.119566] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-09-18T21:18:22.315524] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-18T21:18:22.919543] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-09-18T21:18:23.719567] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-09-18T21:18:23.929328] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T21:18:23.934074] [INFO ] [REMOTE ] R: Full fetch complete (41874 records). [2025-09-18T21:18:23.934258] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-09-18T21:18:24.390955] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-09-18T21:18:24.391227] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-09-18T21:18:24.392077] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-09-18T21:18:24.392162] [DEBUG] [LOCAL ] R: Saving primary data. [2025-09-18T21:18:24.393482] [DEBUG] [LOCAL ] R: Trimmed 41874 records to 30064 (keeping 200 days of data) [2025-09-18T21:18:24.427969] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-18T21:18:24.526247] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-09-18T21:18:24.628824] [DEBUG] [LOCAL ] R: Primary data saved (30064 records). [2025-09-18T21:18:24.628961] [INFO ] [MAIN ] R: Full history saved. [2025-09-18T21:18:24.629048] [INFO ] [MAIN ] Update Progress: 1766/2372 symbols completed. R took 33.3s. Estimated remaining: 1h 28m 39s. Rate: 6.8 symbols/min [2025-09-18T21:18:24.799237] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:18:24.836748] [DEBUG] [LOCAL ] RAMP: Loaded 37699 existing records from primary storage. [2025-09-18T21:18:24.836904] [INFO ] [MAIN ] RAMP: Loaded 37699 existing records. [2025-09-18T21:18:25.037859] [WARN ] [MAIN ] RAMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:18:25.038164] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-09-18T21:18:25.038217] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-09-18T21:18:25.039419] [DEBUG] [LOCAL ] RAMP: Deleted primary data file. [2025-09-18T21:18:25.039484] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-09-18T21:18:25.337664] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-09-18T21:18:25.427689] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:18:25.454761] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-18T21:18:25.515573] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-18T21:18:26.119572] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-11. [2025-09-18T21:18:26.919517] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-09-18T21:18:27.320445] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-18T21:18:27.328110] [INFO ] [REMOTE ] QXO: Full fetch complete (75269 records). [2025-09-18T21:18:27.328245] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-09-18T21:18:27.734299] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-09-18T21:18:27.760196] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-09-18T21:18:27.760263] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-09-18T21:18:27.761595] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-09-18T21:18:27.761870] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-09-18T21:18:27.783247] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-18T21:18:27.791924] [DEBUG] [LOCAL ] QXO: Trimmed 75269 records to 53532 (keeping 200 days of data) [2025-09-18T21:18:28.112259] [DEBUG] [LOCAL ] QXO: Primary data saved (53532 records). [2025-09-18T21:18:28.112403] [INFO ] [MAIN ] QXO: Full history saved. [2025-09-18T21:18:28.112490] [INFO ] [MAIN ] Update Progress: 1767/2372 symbols completed. QXO took 38.3s. Estimated remaining: 1h 28m 29s. Rate: 6.8 symbols/min [2025-09-18T21:18:28.287620] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:18:28.331272] [DEBUG] [LOCAL ] RBA: Loaded 46138 existing records from primary storage. [2025-09-18T21:18:28.331417] [INFO ] [MAIN ] RBA: Loaded 46138 existing records. [2025-09-18T21:18:28.514384] [WARN ] [MAIN ] RBA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:18:28.514747] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-09-18T21:18:28.514920] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-09-18T21:18:28.516051] [DEBUG] [LOCAL ] RBA: Deleted primary data file. [2025-09-18T21:18:28.516113] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-09-18T21:18:28.537457] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-09-18T21:18:28.787578] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-18T21:18:28.913478] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:18:28.929325] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-18T21:18:29.319596] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-09-18T21:18:29.918787] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-18T21:18:30.119526] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-09-18T21:18:30.526812] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T21:18:30.919551] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-11. [2025-09-18T21:18:31.277526] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-18T21:18:31.719548] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-09-18T21:18:32.519557] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-09-18T21:18:32.560211] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-18T21:18:32.618849] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-18T21:18:33.319570] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-09-18T21:18:33.861681] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T21:18:34.119526] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-09-18T21:18:34.336699] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-18T21:18:34.339669] [INFO ] [REMOTE ] RA: Full fetch complete (31931 records). [2025-09-18T21:18:34.339751] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-09-18T21:18:34.717621] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-09-18T21:18:34.717733] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-09-18T21:18:34.718375] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-09-18T21:18:34.718416] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-09-18T21:18:34.719258] [DEBUG] [LOCAL ] RA: Trimmed 31931 records to 21939 (keeping 200 days of data) [2025-09-18T21:18:34.853160] [DEBUG] [LOCAL ] RA: Primary data saved (21939 records). [2025-09-18T21:18:34.853294] [INFO ] [MAIN ] RA: Full history saved. [2025-09-18T21:18:34.853380] [INFO ] [MAIN ] Update Progress: 1768/2372 symbols completed. RA took 36.8s. Estimated remaining: 1h 28m 19s. Rate: 6.8 symbols/min [2025-09-18T21:18:34.927491] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-09-18T21:18:35.026141] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:18:35.042620] [DEBUG] [LOCAL ] RBC: Loaded 15055 existing records from primary storage. [2025-09-18T21:18:35.042798] [INFO ] [MAIN ] RBC: Loaded 15055 existing records. [2025-09-18T21:18:35.219000] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:18:35.219252] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-09-18T21:18:35.219299] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-09-18T21:18:35.219889] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-09-18T21:18:35.219949] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-09-18T21:18:35.589896] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:18:35.632947] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-18T21:18:35.719529] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-11. [2025-09-18T21:18:36.321993] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T21:18:36.519559] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-09-18T21:18:36.821080] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-18T21:18:37.319553] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-09-18T21:18:38.004683] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T21:18:38.119495] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-09-18T21:18:38.475047] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-18T21:18:38.919594] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-09-18T21:18:39.449521] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T21:18:39.454118] [INFO ] [REMOTE ] RACE: Full fetch complete (47547 records). [2025-09-18T21:18:39.454242] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-09-18T21:18:39.727231] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-09-18T21:18:39.850362] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-09-18T21:18:39.850453] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-09-18T21:18:39.851441] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-09-18T21:18:39.851510] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-09-18T21:18:39.852929] [DEBUG] [LOCAL ] RACE: Trimmed 47547 records to 33413 (keeping 200 days of data) [2025-09-18T21:18:40.064011] [DEBUG] [LOCAL ] RACE: Primary data saved (33413 records). [2025-09-18T21:18:40.064189] [INFO ] [MAIN ] RACE: Full history saved. [2025-09-18T21:18:40.064297] [INFO ] [MAIN ] Update Progress: 1769/2372 symbols completed. RACE took 29.9s. Estimated remaining: 1h 28m 9s. Rate: 6.8 symbols/min [2025-09-18T21:18:40.239710] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:18:40.295382] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T21:18:40.320338] [DEBUG] [LOCAL ] RBLX: Loaded 53722 existing records from primary storage. [2025-09-18T21:18:40.320478] [INFO ] [MAIN ] RBLX: Loaded 53722 existing records. [2025-09-18T21:18:40.496967] [WARN ] [MAIN ] RBLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:18:40.497271] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-09-18T21:18:40.497325] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-09-18T21:18:40.498901] [DEBUG] [LOCAL ] RBLX: Deleted primary data file. [2025-09-18T21:18:40.498962] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-09-18T21:18:40.524629] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-09-18T21:18:40.872033] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:18:41.130162] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-18T21:18:41.319542] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-09-18T21:18:41.748261] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-18T21:18:42.119553] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-09-18T21:18:42.688841] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-18T21:18:42.919540] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-09-18T21:18:43.465763] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T21:18:43.719533] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-09-18T21:18:44.519517] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-09-18T21:18:44.607838] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-18T21:18:45.207996] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-18T21:18:45.242105] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-18T21:18:45.319633] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-09-18T21:18:46.090218] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-18T21:18:46.119564] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-09-18T21:18:46.919612] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-11. [2025-09-18T21:18:47.548673] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T21:18:47.719579] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-09-18T21:18:48.519564] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-09-18T21:18:48.902872] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-11 (1.98 seconds). [2025-09-18T21:18:48.930443] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-18T21:18:49.319592] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-09-18T21:18:50.054516] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-18T21:18:50.119595] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-09-18T21:18:50.484035] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-18T21:18:50.919585] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-09-18T21:18:51.719543] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-09-18T21:18:52.351397] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-18T21:18:52.519553] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-09-18T21:18:52.751568] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-18T21:18:52.799834] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-18T21:18:53.319564] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-09-18T21:18:54.119604] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-09-18T21:18:54.178915] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-18T21:18:54.467552] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-18T21:18:54.919552] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-09-18T21:18:55.322422] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-18T21:18:55.719587] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-09-18T21:18:55.778091] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-18T21:18:56.519580] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-09-18T21:18:57.319570] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-09-18T21:18:57.689471] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-18T21:18:57.694731] [INFO ] [REMOTE ] RAMP: Full fetch complete (52890 records). [2025-09-18T21:18:57.694824] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-09-18T21:18:58.092594] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-09-18T21:18:58.092809] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-09-18T21:18:58.093712] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-09-18T21:18:58.093795] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-09-18T21:18:58.095303] [DEBUG] [LOCAL ] RAMP: Trimmed 52890 records to 37978 (keeping 200 days of data) [2025-09-18T21:18:58.121676] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-09-18T21:18:58.123805] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-09-18T21:18:58.351082] [DEBUG] [LOCAL ] RAMP: Primary data saved (37978 records). [2025-09-18T21:18:58.351230] [INFO ] [MAIN ] RAMP: Full history saved. [2025-09-18T21:18:58.352090] [INFO ] [MAIN ] Update Progress: 1770/2372 symbols completed. RAMP took 33.7s. Estimated remaining: 1h 28m 4s. Rate: 6.8 symbols/min [2025-09-18T21:18:58.524930] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:18:58.532683] [DEBUG] [LOCAL ] RBOT: Loaded 5066 existing records from primary storage. [2025-09-18T21:18:58.532825] [INFO ] [MAIN ] RBOT: Loaded 5066 existing records. [2025-09-18T21:18:58.713136] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:18:58.713393] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-09-18T21:18:58.713443] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-09-18T21:18:58.713788] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-09-18T21:18:58.713849] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-09-18T21:18:58.931730] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-09-18T21:18:59.100127] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:18:59.116072] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-18T21:18:59.148237] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-18T21:18:59.719568] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-09-18T21:19:00.519617] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-09-18T21:19:00.971276] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-18T21:19:01.293216] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-18T21:19:01.319499] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-09-18T21:19:01.389573] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-18T21:19:02.119578] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-09-18T21:19:02.866731] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-18T21:19:02.869529] [INFO ] [REMOTE ] RBC: Full fetch complete (21941 records). [2025-09-18T21:19:02.869619] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-09-18T21:19:02.927580] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-09-18T21:19:03.269941] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-09-18T21:19:03.270046] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-09-18T21:19:03.270892] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-09-18T21:19:03.270968] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-09-18T21:19:03.274198] [DEBUG] [LOCAL ] RBC: Trimmed 21941 records to 15135 (keeping 200 days of data) [2025-09-18T21:19:03.368662] [DEBUG] [LOCAL ] RBC: Primary data saved (15135 records). [2025-09-18T21:19:03.368842] [INFO ] [MAIN ] RBC: Full history saved. [2025-09-18T21:19:03.368974] [INFO ] [MAIN ] Update Progress: 1771/2372 symbols completed. RBC took 28.5s. Estimated remaining: 1h 27m 54s. Rate: 6.8 symbols/min [2025-09-18T21:19:03.577981] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-18T21:19:03.581596] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:19:03.650158] [DEBUG] [LOCAL ] RBRK: Loaded 53071 existing records from primary storage. [2025-09-18T21:19:03.650359] [INFO ] [MAIN ] RBRK: Loaded 53071 existing records. [2025-09-18T21:19:03.724707] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-11. [2025-09-18T21:19:03.841427] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:19:03.841726] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-09-18T21:19:03.841800] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-09-18T21:19:03.843184] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-09-18T21:19:03.843247] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-09-18T21:19:04.213588] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:19:04.352000] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-18T21:19:04.519559] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-09-18T21:19:04.663015] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-18T21:19:05.319601] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-09-18T21:19:06.119598] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-09-18T21:19:06.164306] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T21:19:06.480453] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-18T21:19:06.919562] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-09-18T21:19:07.380863] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-18T21:19:07.389389] [INFO ] [REMOTE ] RBA: Full fetch complete (65159 records). [2025-09-18T21:19:07.389748] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-09-18T21:19:07.638124] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-18T21:19:07.724815] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-09-18T21:19:08.030237] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-09-18T21:19:08.030421] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-09-18T21:19:08.032680] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-09-18T21:19:08.032870] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-09-18T21:19:08.035727] [DEBUG] [LOCAL ] RBA: Trimmed 65159 records to 46441 (keeping 200 days of data) [2025-09-18T21:19:08.428872] [DEBUG] [LOCAL ] RBA: Primary data saved (46441 records). [2025-09-18T21:19:08.429051] [INFO ] [MAIN ] RBA: Full history saved. [2025-09-18T21:19:08.429155] [INFO ] [MAIN ] Update Progress: 1772/2372 symbols completed. RBA took 40.3s. Estimated remaining: 1h 27m 44s. Rate: 6.8 symbols/min [2025-09-18T21:19:08.527445] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-09-18T21:19:08.669991] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:19:08.723889] [DEBUG] [LOCAL ] RC: Loaded 49129 existing records from primary storage. [2025-09-18T21:19:08.730620] [INFO ] [MAIN ] RC: Loaded 49129 existing records. [2025-09-18T21:19:08.730882] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T21:19:08.924122] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:19:08.924451] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-09-18T21:19:08.924501] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-09-18T21:19:08.926339] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-09-18T21:19:08.926400] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-09-18T21:19:09.279426] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:19:09.319556] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-11. [2025-09-18T21:19:10.119609] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-11. [2025-09-18T21:19:10.919522] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-09-18T21:19:11.051120] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-18T21:19:11.110564] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-18T21:19:11.435604] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-18T21:19:11.462856] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-18T21:19:11.719542] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-09-18T21:19:12.519555] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-09-18T21:19:13.319594] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-09-18T21:19:13.450117] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-18T21:19:13.487717] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-18T21:19:14.119557] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-09-18T21:19:14.919564] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-09-18T21:19:15.719600] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-09-18T21:19:15.871761] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-09-18T21:19:15.911266] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-18T21:19:16.223181] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-18T21:19:16.519520] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-09-18T21:19:16.741914] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-18T21:19:17.319574] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-09-18T21:19:18.119544] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-09-18T21:19:18.207520] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-18T21:19:18.541088] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-18T21:19:18.919515] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-09-18T21:19:18.965945] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-18T21:19:19.719592] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-09-18T21:19:19.781117] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-18T21:19:20.519555] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-09-18T21:19:21.319556] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-09-18T21:19:21.523157] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-18T21:19:21.554568] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-18T21:19:22.119549] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-09-18T21:19:22.919602] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-09-18T21:19:23.619039] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-18T21:19:23.710300] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T21:19:23.707447] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-18T21:19:23.722158] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-09-18T21:19:23.723408] [INFO ] [REMOTE ] RBOT: Full fetch complete (8723 records). [2025-09-18T21:19:23.726331] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-09-18T21:19:24.103819] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-09-18T21:19:24.103903] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-09-18T21:19:24.104190] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-09-18T21:19:24.104270] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-09-18T21:19:24.104783] [DEBUG] [LOCAL ] RBOT: Trimmed 8723 records to 5141 (keeping 200 days of data) [2025-09-18T21:19:24.134361] [DEBUG] [LOCAL ] RBOT: Primary data saved (5141 records). [2025-09-18T21:19:24.134490] [INFO ] [MAIN ] RBOT: Full history saved. [2025-09-18T21:19:24.134607] [INFO ] [MAIN ] Update Progress: 1773/2372 symbols completed. RBOT took 25.8s. Estimated remaining: 1h 27m 37s. Rate: 6.8 symbols/min [2025-09-18T21:19:24.312151] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:19:24.312386] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-09-18T21:19:24.312462] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-09-18T21:19:24.312729] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-09-18T21:19:24.312802] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-18T21:19:24.312857] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-18T21:19:24.312894] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-09-18T21:19:24.526932] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-09-18T21:19:24.677953] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:19:25.319555] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-11. [2025-09-18T21:19:25.657186] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-11 (0.34 seconds). [2025-09-18T21:19:26.119547] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-09-18T21:19:26.169468] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-18T21:19:26.179196] [INFO ] [REMOTE ] RBLX: Full fetch complete (77702 records). [2025-09-18T21:19:26.179362] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-09-18T21:19:26.503149] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-18T21:19:26.637413] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-09-18T21:19:26.637528] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-09-18T21:19:26.638717] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-09-18T21:19:26.639450] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-09-18T21:19:26.641485] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-18T21:19:26.654871] [DEBUG] [LOCAL ] RBLX: Trimmed 77702 records to 54112 (keeping 200 days of data) [2025-09-18T21:19:26.925564] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-09-18T21:19:26.979490] [DEBUG] [LOCAL ] RBLX: Primary data saved (54112 records). [2025-09-18T21:19:26.979666] [INFO ] [MAIN ] RBLX: Full history saved. [2025-09-18T21:19:26.979774] [INFO ] [MAIN ] Update Progress: 1774/2372 symbols completed. RBLX took 46.9s. Estimated remaining: 1h 27m 26s. Rate: 6.8 symbols/min [2025-09-18T21:19:27.153809] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:19:27.154095] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-09-18T21:19:27.154188] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-09-18T21:19:27.154365] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-09-18T21:19:27.154423] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-18T21:19:27.154485] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-18T21:19:27.154535] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-09-18T21:19:27.511198] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:19:27.719546] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-11. [2025-09-18T21:19:27.991903] [DEBUG] [REMOTE ] RCD: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:19:27.992258] [WARN ] [REMOTE ] RCD: No data returned for month 2024-11 [2025-09-18T21:19:28.519577] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-09-18T21:19:28.731888] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-18T21:19:28.906117] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-18T21:19:29.319547] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-09-18T21:19:30.004278] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-18T21:19:30.119502] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-09-18T21:19:30.697263] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-18T21:19:30.919542] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-09-18T21:19:31.659891] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-18T21:19:31.719495] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-09-18T21:19:32.497096] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-18T21:19:32.519495] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-09-18T21:19:33.027379] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-18T21:19:33.319831] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-09-18T21:19:34.119556] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-09-18T21:19:34.919559] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-09-18T21:19:35.140269] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-18T21:19:35.503063] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-18T21:19:35.719745] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-09-18T21:19:36.232719] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-18T21:19:36.300351] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-18T21:19:36.519555] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-09-18T21:19:37.140705] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-18T21:19:37.319576] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-09-18T21:19:37.654018] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-18T21:19:38.119546] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-09-18T21:19:38.516137] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-18T21:19:38.919557] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-09-18T21:19:39.719585] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-09-18T21:19:40.519557] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-09-18T21:19:40.860056] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-18T21:19:40.897674] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-18T21:19:41.319553] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-09-18T21:19:41.485031] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-18T21:19:41.825622] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-18T21:19:42.119561] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-09-18T21:19:42.919542] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-18T21:19:43.270462] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-18T21:19:43.271342] [INFO ] [REMOTE ] RCB: Full fetch complete (3770 records). [2025-09-18T21:19:43.271413] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-09-18T21:19:43.480731] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-18T21:19:43.480971] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:19:43.481044] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:19:43.481095] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-18T21:19:43.481181] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-18T21:19:43.481238] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-09-18T21:19:43.481300] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-09-18T21:19:43.481388] [INFO ] [MAIN ] Update Progress: 1775/2372 symbols completed. RCB took 19.3s. Estimated remaining: 1h 27m 20s. Rate: 6.8 symbols/min [2025-09-18T21:19:43.659496] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:19:43.717226] [DEBUG] [LOCAL ] RCI: Loaded 48852 existing records from primary storage. [2025-09-18T21:19:43.717386] [INFO ] [MAIN ] RCI: Loaded 48852 existing records. [2025-09-18T21:19:43.728517] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-09-18T21:19:43.908960] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:19:43.909493] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-09-18T21:19:43.909627] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-09-18T21:19:43.911323] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-09-18T21:19:43.911413] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-09-18T21:19:44.090083] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-18T21:19:44.312753] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:19:44.519533] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-09-18T21:19:45.319543] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-11. [2025-09-18T21:19:45.687392] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-18T21:19:46.119614] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-09-18T21:19:46.314816] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-18T21:19:46.602474] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-18T21:19:46.919565] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-09-18T21:19:47.719578] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-09-18T21:19:48.183214] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-18T21:19:48.188771] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-18T21:19:48.328035] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-18T21:19:48.519603] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-09-18T21:19:48.917422] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-18T21:19:49.319539] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-09-18T21:19:50.119601] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-09-18T21:19:50.919593] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-09-18T21:19:51.405329] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-18T21:19:51.513912] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-18T21:19:51.586696] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-18T21:19:51.719507] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-09-18T21:19:52.357734] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-18T21:19:52.519560] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-09-18T21:19:53.319609] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-09-18T21:19:53.887465] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-18T21:19:53.898220] [INFO ] [REMOTE ] RC: Full fetch complete (70655 records). [2025-09-18T21:19:53.898374] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-09-18T21:19:54.139600] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-09-18T21:19:54.390080] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-09-18T21:19:54.390224] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-09-18T21:19:54.391851] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-09-18T21:19:54.391920] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-09-18T21:19:54.394321] [DEBUG] [LOCAL ] RC: Trimmed 70655 records to 49495 (keeping 200 days of data) [2025-09-18T21:19:54.697765] [DEBUG] [LOCAL ] RC: Primary data saved (49495 records). [2025-09-18T21:19:54.697926] [INFO ] [MAIN ] RC: Full history saved. [2025-09-18T21:19:54.698070] [INFO ] [MAIN ] Update Progress: 1776/2372 symbols completed. RC took 46.3s. Estimated remaining: 1h 27m 12s. Rate: 6.8 symbols/min [2025-09-18T21:19:54.868687] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:19:54.868973] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-09-18T21:19:54.869046] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-09-18T21:19:54.869277] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-09-18T21:19:54.869354] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-18T21:19:54.869435] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-09-18T21:19:54.869560] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-09-18T21:19:54.926259] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-18T21:19:55.275983] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-18T21:19:55.298787] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:19:55.511662] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-18T21:19:55.513746] [INFO ] [REMOTE ] RCD: Full fetch complete (6727 records). [2025-09-18T21:19:55.513830] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-09-18T21:19:55.700017] [WARN ] [VALIDATOR ] RCD: Validation failed - insufficient historical data. Have 186 unique days, need 200 days [2025-09-18T21:19:55.700260] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:19:55.700329] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:19:55.700408] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-18T21:19:55.700488] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-18T21:19:55.700554] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-09-18T21:19:55.700623] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-09-18T21:19:55.700716] [INFO ] [MAIN ] Update Progress: 1777/2372 symbols completed. RCD took 28.7s. Estimated remaining: 1h 27m 1s. Rate: 6.8 symbols/min [2025-09-18T21:19:55.729614] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-09-18T21:19:55.874078] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:19:55.891873] [DEBUG] [LOCAL ] RCS: Loaded 11571 existing records from primary storage. [2025-09-18T21:19:55.892000] [INFO ] [MAIN ] RCS: Loaded 11571 existing records. [2025-09-18T21:19:56.074774] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:19:56.075773] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-09-18T21:19:56.076037] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-09-18T21:19:56.076730] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-09-18T21:19:56.076828] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-09-18T21:19:56.265867] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-18T21:19:56.368301] [INFO ] [REMOTE ] RBRK: Full fetch complete (76287 records). [2025-09-18T21:19:56.380928] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-09-18T21:19:56.532539] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-11. [2025-09-18T21:19:56.614077] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:19:56.899781] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-09-18T21:19:56.899866] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-09-18T21:19:56.900919] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-09-18T21:19:56.900986] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-09-18T21:19:56.902475] [DEBUG] [LOCAL ] RBRK: Trimmed 76287 records to 53461 (keeping 200 days of data) [2025-09-18T21:19:57.240342] [DEBUG] [LOCAL ] RBRK: Primary data saved (53461 records). [2025-09-18T21:19:57.240495] [INFO ] [MAIN ] RBRK: Full history saved. [2025-09-18T21:19:57.240602] [INFO ] [MAIN ] Update Progress: 1778/2372 symbols completed. RBRK took 53.9s. Estimated remaining: 1h 26m 50s. Rate: 6.8 symbols/min [2025-09-18T21:19:57.331080] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-11. [2025-09-18T21:19:57.411996] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:19:57.454542] [DEBUG] [LOCAL ] RCUS: Loaded 42918 existing records from primary storage. [2025-09-18T21:19:57.454723] [INFO ] [MAIN ] RCUS: Loaded 42918 existing records. [2025-09-18T21:19:57.636996] [WARN ] [MAIN ] RCUS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:19:57.637491] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-09-18T21:19:57.637572] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-09-18T21:19:57.638997] [DEBUG] [LOCAL ] RCUS: Deleted primary data file. [2025-09-18T21:19:57.639115] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-09-18T21:19:57.824331] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-18T21:19:58.047663] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:19:58.056395] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-18T21:19:58.119503] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-11. [2025-09-18T21:19:58.357605] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-18T21:19:58.919607] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-09-18T21:19:59.365540] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-18T21:19:59.719518] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-09-18T21:19:59.956264] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-18T21:20:00.519618] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-09-18T21:20:01.104531] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-18T21:20:01.319614] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-09-18T21:20:02.031454] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-18T21:20:02.119600] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-09-18T21:20:02.919619] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-09-18T21:20:03.127531] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-18T21:20:03.267585] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T21:20:03.719611] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-09-18T21:20:04.519566] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-09-18T21:20:04.665923] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T21:20:04.746148] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-18T21:20:05.319593] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-09-18T21:20:05.738062] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T21:20:06.119560] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-09-18T21:20:06.749994] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-18T21:20:06.857440] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T21:20:06.919572] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-09-18T21:20:07.719538] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-09-18T21:20:08.038062] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-18T21:20:08.519550] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-09-18T21:20:08.999053] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-18T21:20:09.318526] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-18T21:20:09.320183] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-09-18T21:20:10.119558] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-09-18T21:20:10.894261] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-18T21:20:10.919491] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-09-18T21:20:11.066715] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-18T21:20:11.548957] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-18T21:20:11.719517] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-09-18T21:20:12.519591] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-09-18T21:20:13.319566] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-09-18T21:20:13.495764] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-18T21:20:13.536486] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-18T21:20:14.119541] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-09-18T21:20:14.889401] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-18T21:20:14.919493] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-09-18T21:20:15.719535] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-09-18T21:20:16.364381] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-18T21:20:16.372306] [INFO ] [REMOTE ] RCI: Full fetch complete (70439 records). [2025-09-18T21:20:16.372430] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-09-18T21:20:16.535019] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-09-18T21:20:16.663237] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-18T21:20:16.812123] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-09-18T21:20:16.812406] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-09-18T21:20:16.813410] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-09-18T21:20:16.823704] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-09-18T21:20:16.843240] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-18T21:20:16.853795] [DEBUG] [LOCAL ] RCI: Trimmed 70439 records to 49208 (keeping 200 days of data) [2025-09-18T21:20:17.178195] [DEBUG] [LOCAL ] RCI: Primary data saved (49208 records). [2025-09-18T21:20:17.178359] [INFO ] [MAIN ] RCI: Full history saved. [2025-09-18T21:20:17.179208] [INFO ] [MAIN ] Update Progress: 1779/2372 symbols completed. RCI took 33.7s. Estimated remaining: 1h 26m 45s. Rate: 6.8 symbols/min [2025-09-18T21:20:17.337337] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-09-18T21:20:17.369806] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:20:17.467371] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-18T21:20:17.482305] [DEBUG] [LOCAL ] RDDT: Loaded 53784 existing records from primary storage. [2025-09-18T21:20:17.482756] [INFO ] [MAIN ] RDDT: Loaded 53784 existing records. [2025-09-18T21:20:17.676001] [WARN ] [MAIN ] RDDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:20:17.676372] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-09-18T21:20:17.676429] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-09-18T21:20:17.678412] [DEBUG] [LOCAL ] RDDT: Deleted primary data file. [2025-09-18T21:20:17.678474] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-09-18T21:20:18.030840] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:20:18.119572] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-09-18T21:20:18.555925] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-18T21:20:18.828897] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-18T21:20:18.919604] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-09-18T21:20:19.719562] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-11. [2025-09-18T21:20:19.816611] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-18T21:20:20.519605] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-09-18T21:20:21.319545] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-09-18T21:20:21.385733] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-18T21:20:22.023589] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-11 (2.30 seconds). [2025-09-18T21:20:22.119514] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-09-18T21:20:22.793445] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-18T21:20:22.919529] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-09-18T21:20:23.719552] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-09-18T21:20:24.152411] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-18T21:20:24.271370] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-18T21:20:24.517687] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-18T21:20:24.527316] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-09-18T21:20:25.319566] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-09-18T21:20:26.119550] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-09-18T21:20:26.204191] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-18T21:20:26.619816] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-18T21:20:26.705415] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-18T21:20:26.919525] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-09-18T21:20:27.719605] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-09-18T21:20:28.519608] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-09-18T21:20:29.132601] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-18T21:20:29.138618] [INFO ] [REMOTE ] RCUS: Full fetch complete (60177 records). [2025-09-18T21:20:29.138839] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-09-18T21:20:29.328726] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-09-18T21:20:29.448769] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-09-18T21:20:29.582524] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-09-18T21:20:29.582702] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-09-18T21:20:29.583798] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-09-18T21:20:29.583865] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-09-18T21:20:29.585250] [DEBUG] [LOCAL ] RCUS: Trimmed 60177 records to 43205 (keeping 200 days of data) [2025-09-18T21:20:29.702868] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-18T21:20:29.876997] [DEBUG] [LOCAL ] RCUS: Primary data saved (43205 records). [2025-09-18T21:20:29.877162] [INFO ] [MAIN ] RCUS: Full history saved. [2025-09-18T21:20:29.877263] [INFO ] [MAIN ] Update Progress: 1780/2372 symbols completed. RCUS took 32.6s. Estimated remaining: 1h 26m 37s. Rate: 6.8 symbols/min [2025-09-18T21:20:30.061293] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:20:30.068174] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T21:20:30.070996] [INFO ] [REMOTE ] RCS: Full fetch complete (19206 records). [2025-09-18T21:20:30.071083] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-09-18T21:20:30.137936] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-09-18T21:20:30.404104] [DEBUG] [LOCAL ] RDN: Loaded 45139 existing records from primary storage. [2025-09-18T21:20:30.414810] [INFO ] [MAIN ] RDN: Loaded 45139 existing records. [2025-09-18T21:20:30.646972] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-09-18T21:20:30.679925] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-09-18T21:20:30.680526] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-09-18T21:20:30.679715] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:20:30.680753] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-09-18T21:20:30.681201] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-09-18T21:20:30.681329] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-09-18T21:20:30.682536] [DEBUG] [LOCAL ] RCS: Trimmed 19206 records to 11657 (keeping 200 days of data) [2025-09-18T21:20:30.683538] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-09-18T21:20:30.683604] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-09-18T21:20:30.920093] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-18T21:20:30.933711] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-09-18T21:20:30.960091] [DEBUG] [LOCAL ] RCS: Primary data saved (11657 records). [2025-09-18T21:20:30.974747] [INFO ] [MAIN ] RCS: Full history saved. [2025-09-18T21:20:30.985118] [INFO ] [MAIN ] Update Progress: 1781/2372 symbols completed. RCS took 35.3s. Estimated remaining: 1h 26m 26s. Rate: 6.8 symbols/min [2025-09-18T21:20:31.054918] [INFO ] [REMOTE ] RCL: Full fetch complete (74988 records). [2025-09-18T21:20:31.079127] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-09-18T21:20:31.160933] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T21:20:31.176572] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:20:31.209589] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:20:31.221554] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-18T21:20:31.246423] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-09-18T21:20:31.308978] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:20:31.323186] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-09-18T21:20:31.337887] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-09-18T21:20:31.357854] [INFO ] [MAIN ] Update Progress: 1782/2372 symbols completed. RCL took 36.7s. Estimated remaining: 1h 26m 14s. Rate: 6.8 symbols/min [2025-09-18T21:20:31.357679] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:20:31.555743] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:20:31.596382] [DEBUG] [LOCAL ] RDW: Loaded 51988 existing records from primary storage. [2025-09-18T21:20:31.596555] [INFO ] [MAIN ] RDW: Loaded 51988 existing records. [2025-09-18T21:20:31.720946] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-11. [2025-09-18T21:20:31.800820] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:20:31.815132] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-09-18T21:20:31.815307] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-09-18T21:20:31.816514] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-09-18T21:20:31.816578] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-09-18T21:20:31.829464] [DEBUG] [LOCAL ] RDY: Loaded 47024 existing records from primary storage. [2025-09-18T21:20:31.863193] [INFO ] [MAIN ] RDY: Loaded 47024 existing records. [2025-09-18T21:20:32.273859] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:20:32.296275] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-09-18T21:20:32.296347] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-09-18T21:20:32.302792] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-09-18T21:20:32.307985] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-09-18T21:20:32.503094] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:20:32.524598] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-11. [2025-09-18T21:20:32.767275] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:20:33.319517] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-11. [2025-09-18T21:20:33.437283] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-18T21:20:33.497794] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-18T21:20:34.096840] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-18T21:20:34.119503] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-09-18T21:20:34.423368] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-18T21:20:34.919537] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-09-18T21:20:35.719558] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-09-18T21:20:36.048819] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-18T21:20:36.285680] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-18T21:20:36.519552] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-09-18T21:20:37.319588] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-09-18T21:20:38.067840] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T21:20:38.119488] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-09-18T21:20:38.222598] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-18T21:20:38.746273] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-18T21:20:38.919554] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-09-18T21:20:39.516508] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T21:20:39.719545] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-09-18T21:20:40.519565] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-09-18T21:20:40.589276] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-18T21:20:41.303192] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-18T21:20:41.319529] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-09-18T21:20:42.119522] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-09-18T21:20:42.500588] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-18T21:20:42.657899] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-18T21:20:42.919596] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-09-18T21:20:43.288054] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-18T21:20:43.719552] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-09-18T21:20:44.519608] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-09-18T21:20:45.176264] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-18T21:20:45.277178] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-18T21:20:45.319500] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-09-18T21:20:45.813588] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-18T21:20:46.119542] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-09-18T21:20:46.919596] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-09-18T21:20:47.609618] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-18T21:20:47.646413] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-18T21:20:47.719497] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-09-18T21:20:48.272276] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-18T21:20:48.519541] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-09-18T21:20:49.099725] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-18T21:20:49.319534] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-09-18T21:20:50.119631] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-09-18T21:20:50.621016] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-18T21:20:50.776012] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-18T21:20:50.919540] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-09-18T21:20:51.719580] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-09-18T21:20:51.933779] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-18T21:20:52.519564] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-09-18T21:20:53.253876] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-18T21:20:53.319562] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-09-18T21:20:53.390403] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-18T21:20:53.721212] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-18T21:20:54.119592] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-09-18T21:20:54.919625] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-09-18T21:20:55.223883] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-18T21:20:55.719547] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-09-18T21:20:56.263796] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-18T21:20:56.519513] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-09-18T21:20:56.597926] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-18T21:20:56.605997] [INFO ] [REMOTE ] RDDT: Full fetch complete (77835 records). [2025-09-18T21:20:56.606182] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-09-18T21:20:57.014706] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-09-18T21:20:57.014816] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-09-18T21:20:57.015891] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-09-18T21:20:57.015991] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-09-18T21:20:57.017585] [DEBUG] [LOCAL ] RDDT: Trimmed 77835 records to 54174 (keeping 200 days of data) [2025-09-18T21:20:57.330311] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-09-18T21:20:57.383080] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T21:20:57.398438] [DEBUG] [LOCAL ] RDDT: Primary data saved (54174 records). [2025-09-18T21:20:57.398553] [INFO ] [MAIN ] RDDT: Full history saved. [2025-09-18T21:20:57.399313] [INFO ] [MAIN ] Update Progress: 1783/2372 symbols completed. RDDT took 40.2s. Estimated remaining: 1h 26m 11s. Rate: 6.8 symbols/min [2025-09-18T21:20:57.569454] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:20:57.596875] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-18T21:20:57.646842] [DEBUG] [LOCAL ] RELX: Loaded 47843 existing records from primary storage. [2025-09-18T21:20:57.647017] [INFO ] [MAIN ] RELX: Loaded 47843 existing records. [2025-09-18T21:20:57.823501] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:20:57.823795] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-09-18T21:20:57.823849] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-09-18T21:20:57.824881] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-09-18T21:20:57.824952] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-09-18T21:20:58.124691] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-09-18T21:20:58.188769] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:20:58.513478] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-18T21:20:58.519427] [INFO ] [REMOTE ] RDY: Full fetch complete (69036 records). [2025-09-18T21:20:58.519540] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-09-18T21:20:58.921956] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-11. [2025-09-18T21:20:58.922360] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-09-18T21:20:58.923355] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-09-18T21:20:58.924571] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-09-18T21:20:58.924799] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-09-18T21:20:58.926304] [DEBUG] [LOCAL ] RDY: Trimmed 69036 records to 47286 (keeping 200 days of data) [2025-09-18T21:20:59.220889] [DEBUG] [LOCAL ] RDY: Primary data saved (47286 records). [2025-09-18T21:20:59.221066] [INFO ] [MAIN ] RDY: Full history saved. [2025-09-18T21:20:59.221172] [INFO ] [MAIN ] Update Progress: 1784/2372 symbols completed. RDY took 27.9s. Estimated remaining: 1h 26m 0s. Rate: 6.8 symbols/min [2025-09-18T21:20:59.395200] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:20:59.411783] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-18T21:20:59.417804] [INFO ] [REMOTE ] RDN: Full fetch complete (65405 records). [2025-09-18T21:20:59.417942] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-09-18T21:20:59.732937] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-09-18T21:20:59.751989] [DEBUG] [LOCAL ] RERE: Loaded 40834 existing records from primary storage. [2025-09-18T21:20:59.752169] [INFO ] [MAIN ] RERE: Loaded 40834 existing records. [2025-09-18T21:20:59.955344] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-09-18T21:20:59.955465] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-09-18T21:20:59.956462] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-09-18T21:20:59.956864] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-09-18T21:21:00.017861] [DEBUG] [LOCAL ] RDN: Trimmed 65405 records to 45529 (keeping 200 days of data) [2025-09-18T21:21:00.039034] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:21:00.039431] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-09-18T21:21:00.039487] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-09-18T21:21:00.040349] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-09-18T21:21:00.040439] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-09-18T21:21:00.554436] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:21:00.561434] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-11. [2025-09-18T21:21:00.686579] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-18T21:21:00.758080] [DEBUG] [LOCAL ] RDN: Primary data saved (45529 records). [2025-09-18T21:21:00.758257] [INFO ] [MAIN ] RDN: Full history saved. [2025-09-18T21:21:00.758373] [INFO ] [MAIN ] Update Progress: 1785/2372 symbols completed. RDN took 30.9s. Estimated remaining: 1h 25m 49s. Rate: 6.8 symbols/min [2025-09-18T21:21:00.951155] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:21:00.999179] [DEBUG] [LOCAL ] RES: Loaded 47570 existing records from primary storage. [2025-09-18T21:21:00.999397] [INFO ] [MAIN ] RES: Loaded 47570 existing records. [2025-09-18T21:21:01.227635] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:21:01.227946] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-09-18T21:21:01.227994] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-09-18T21:21:01.229026] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-09-18T21:21:01.229087] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-09-18T21:21:01.327506] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-09-18T21:21:01.589301] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:21:01.972344] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-18T21:21:02.029385] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-18T21:21:02.119558] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-11. [2025-09-18T21:21:02.919584] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-09-18T21:21:03.719592] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-09-18T21:21:03.912084] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-09-18T21:21:04.519571] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-09-18T21:21:05.055575] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-11 (2.94 seconds). [2025-09-18T21:21:05.319624] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-09-18T21:21:05.403126] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-18T21:21:05.472772] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-18T21:21:05.727810] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-18T21:21:06.119600] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-09-18T21:21:06.639241] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-18T21:21:06.919622] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-09-18T21:21:07.254822] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T21:21:07.719626] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-09-18T21:21:08.162272] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-18T21:21:08.519587] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-09-18T21:21:08.655383] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-18T21:21:09.319547] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-09-18T21:21:10.119568] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-09-18T21:21:10.597094] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-18T21:21:10.841416] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-18T21:21:10.919563] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-09-18T21:21:11.051328] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-18T21:21:11.719593] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-09-18T21:21:12.284927] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-18T21:21:12.519544] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-09-18T21:21:13.319628] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-09-18T21:21:14.119515] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-09-18T21:21:14.168689] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-18T21:21:14.252541] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-18T21:21:14.754750] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-18T21:21:14.919555] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-09-18T21:21:15.281078] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-18T21:21:15.719580] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-09-18T21:21:16.519587] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-09-18T21:21:16.599604] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-18T21:21:16.804990] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-18T21:21:17.319572] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-09-18T21:21:18.119547] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-09-18T21:21:18.919607] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-09-18T21:21:19.063847] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-09-18T21:21:19.071254] [INFO ] [REMOTE ] RDW: Full fetch complete (74134 records). [2025-09-18T21:21:19.071374] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-09-18T21:21:19.462727] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-09-18T21:21:19.462837] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-09-18T21:21:19.463903] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-09-18T21:21:19.463969] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-09-18T21:21:19.465714] [DEBUG] [LOCAL ] RDW: Trimmed 74134 records to 52378 (keeping 200 days of data) [2025-09-18T21:21:19.789310] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-18T21:21:19.800606] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-09-18T21:21:19.819662] [DEBUG] [LOCAL ] RDW: Primary data saved (52378 records). [2025-09-18T21:21:19.819757] [INFO ] [MAIN ] RDW: Full history saved. [2025-09-18T21:21:19.819837] [INFO ] [MAIN ] Update Progress: 1786/2372 symbols completed. RDW took 48.8s. Estimated remaining: 1h 25m 44s. Rate: 6.8 symbols/min [2025-09-18T21:21:20.002974] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:21:20.066474] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (2.75 seconds). [2025-09-18T21:21:20.067265] [DEBUG] [LOCAL ] REVG: Loaded 41303 existing records from primary storage. [2025-09-18T21:21:20.076435] [INFO ] [MAIN ] REVG: Loaded 41303 existing records. [2025-09-18T21:21:20.263876] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:21:20.264322] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-09-18T21:21:20.264432] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-09-18T21:21:20.265424] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-09-18T21:21:20.265493] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-09-18T21:21:20.421721] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-18T21:21:20.520676] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-09-18T21:21:20.682281] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:21:21.125271] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-18T21:21:21.319553] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-09-18T21:21:21.895141] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T21:21:22.119625] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-11. [2025-09-18T21:21:22.838334] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-18T21:21:22.919549] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-09-18T21:21:23.458081] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-18T21:21:23.719559] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-09-18T21:21:24.520683] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-09-18T21:21:24.530254] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-18T21:21:25.207209] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T21:21:25.319548] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-09-18T21:21:26.119543] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-09-18T21:21:26.187325] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-18T21:21:26.723128] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-18T21:21:26.919563] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-09-18T21:21:27.582003] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T21:21:27.719557] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-09-18T21:21:28.166086] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-18T21:21:28.172798] [INFO ] [REMOTE ] RERE: Full fetch complete (57311 records). [2025-09-18T21:21:28.172941] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-09-18T21:21:28.526474] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-09-18T21:21:28.573047] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-09-18T21:21:28.573156] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-09-18T21:21:28.574098] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-09-18T21:21:28.574191] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-09-18T21:21:28.575480] [DEBUG] [LOCAL ] RERE: Trimmed 57311 records to 41126 (keeping 200 days of data) [2025-09-18T21:21:28.807586] [DEBUG] [LOCAL ] RERE: Primary data saved (41126 records). [2025-09-18T21:21:28.807774] [INFO ] [MAIN ] RERE: Full history saved. [2025-09-18T21:21:28.807922] [INFO ] [MAIN ] Update Progress: 1787/2372 symbols completed. RERE took 29.6s. Estimated remaining: 1h 25m 35s. Rate: 6.8 symbols/min [2025-09-18T21:21:28.992448] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:21:29.008501] [DEBUG] [LOCAL ] REX: Loaded 13762 existing records from primary storage. [2025-09-18T21:21:29.008633] [INFO ] [MAIN ] REX: Loaded 13762 existing records. [2025-09-18T21:21:29.243528] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:21:29.244249] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-09-18T21:21:29.244310] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-09-18T21:21:29.247152] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-09-18T21:21:29.247063] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T21:21:29.247392] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-09-18T21:21:29.322969] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-09-18T21:21:29.624866] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:21:30.048751] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-18T21:21:30.119529] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-09-18T21:21:30.446972] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-18T21:21:30.919572] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-11. [2025-09-18T21:21:31.719619] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-09-18T21:21:31.782712] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-18T21:21:31.841581] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-18T21:21:31.848739] [INFO ] [REMOTE ] RELX: Full fetch complete (66735 records). [2025-09-18T21:21:31.848898] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-09-18T21:21:32.259798] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-09-18T21:21:32.259908] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-09-18T21:21:32.260888] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-09-18T21:21:32.260953] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-09-18T21:21:32.262506] [DEBUG] [LOCAL ] RELX: Trimmed 66735 records to 48209 (keeping 200 days of data) [2025-09-18T21:21:32.528025] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-09-18T21:21:32.558897] [DEBUG] [LOCAL ] RELX: Primary data saved (48209 records). [2025-09-18T21:21:32.558997] [INFO ] [MAIN ] RELX: Full history saved. [2025-09-18T21:21:32.559589] [INFO ] [MAIN ] Update Progress: 1788/2372 symbols completed. RELX took 35.2s. Estimated remaining: 1h 25m 24s. Rate: 6.8 symbols/min [2025-09-18T21:21:32.736968] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:21:32.789919] [DEBUG] [LOCAL ] REXR: Loaded 52021 existing records from primary storage. [2025-09-18T21:21:32.790089] [INFO ] [MAIN ] REXR: Loaded 52021 existing records. [2025-09-18T21:21:32.972188] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:21:32.972460] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-09-18T21:21:32.972519] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-09-18T21:21:32.973671] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-09-18T21:21:32.973731] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-09-18T21:21:33.333256] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-09-18T21:21:33.339391] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:21:33.900799] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-18T21:21:34.119529] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-09-18T21:21:34.326836] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-18T21:21:34.693336] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T21:21:34.919571] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-11. [2025-09-18T21:21:35.294575] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-18T21:21:35.301665] [INFO ] [REMOTE ] RES: Full fetch complete (68623 records). [2025-09-18T21:21:35.301843] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-09-18T21:21:35.695810] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-09-18T21:21:35.695907] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-09-18T21:21:35.696930] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-09-18T21:21:35.697041] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-09-18T21:21:35.698562] [DEBUG] [LOCAL ] RES: Trimmed 68623 records to 47909 (keeping 200 days of data) [2025-09-18T21:21:35.746815] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-09-18T21:21:35.982258] [DEBUG] [LOCAL ] RES: Primary data saved (47909 records). [2025-09-18T21:21:35.982400] [INFO ] [MAIN ] RES: Full history saved. [2025-09-18T21:21:35.982500] [INFO ] [MAIN ] Update Progress: 1789/2372 symbols completed. RES took 35.2s. Estimated remaining: 1h 25m 14s. Rate: 6.8 symbols/min [2025-09-18T21:21:36.151701] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:21:36.196710] [DEBUG] [LOCAL ] REZI: Loaded 46796 existing records from primary storage. [2025-09-18T21:21:36.196858] [INFO ] [MAIN ] REZI: Loaded 46796 existing records. [2025-09-18T21:21:36.375599] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:21:36.375981] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-09-18T21:21:36.376086] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-09-18T21:21:36.377144] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-09-18T21:21:36.377206] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-09-18T21:21:36.534854] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-09-18T21:21:36.633856] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-18T21:21:36.737331] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-18T21:21:36.808797] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:21:37.319608] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-09-18T21:21:38.055609] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-18T21:21:38.119506] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-09-18T21:21:38.262406] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-18T21:21:38.775354] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-18T21:21:38.919546] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-09-18T21:21:39.719582] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-09-18T21:21:39.837229] [DEBUG] [REMOTE ] REVG: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-18T21:21:39.837713] [WARN ] [REMOTE ] REVG: No data returned for month 2025-05 [2025-09-18T21:21:40.519590] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-11. [2025-09-18T21:21:40.702229] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-18T21:21:41.319624] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-09-18T21:21:41.811897] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-18T21:21:42.119590] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-09-18T21:21:42.559736] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T21:21:42.919604] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-09-18T21:21:43.522687] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-18T21:21:43.719606] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-09-18T21:21:44.006103] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-18T21:21:44.519683] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-09-18T21:21:45.094336] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-18T21:21:45.263847] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-18T21:21:45.319547] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-09-18T21:21:46.119581] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-09-18T21:21:46.524016] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-18T21:21:46.919690] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-09-18T21:21:47.675876] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-18T21:21:47.719598] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-09-18T21:21:47.875318] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-18T21:21:48.519607] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-09-18T21:21:49.158229] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-18T21:21:49.164834] [INFO ] [REMOTE ] REVG: Full fetch complete (52143 records). [2025-09-18T21:21:49.165026] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-09-18T21:21:49.327227] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-09-18T21:21:49.362923] [WARN ] [VALIDATOR ] REVG: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-18T21:21:49.363521] [FATAL] [MAIN ] REVG: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:21:49.363593] [WARN ] [MAIN ] REVG: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:21:49.363712] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-09-18T21:21:49.363815] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-09-18T21:21:49.363872] [INFO ] [LOCAL ] REVG: Starting deletion of derivative data. [2025-09-18T21:21:49.364428] [DEBUG] [LOCAL ] REVG: Deleted derivative data file. [2025-09-18T21:21:49.364568] [INFO ] [MAIN ] Update Progress: 1790/2372 symbols completed. REVG took 29.5s. Estimated remaining: 1h 25m 7s. Rate: 6.8 symbols/min [2025-09-18T21:21:49.536904] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:21:49.590324] [DEBUG] [LOCAL ] RF: Loaded 53630 existing records from primary storage. [2025-09-18T21:21:49.590485] [INFO ] [MAIN ] RF: Loaded 53630 existing records. [2025-09-18T21:21:49.771151] [WARN ] [MAIN ] RF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:21:49.771389] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-09-18T21:21:49.771512] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-09-18T21:21:49.772978] [DEBUG] [LOCAL ] RF: Deleted primary data file. [2025-09-18T21:21:49.773038] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-09-18T21:21:50.094762] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-18T21:21:50.122326] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-09-18T21:21:50.156587] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:21:50.186494] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T21:21:50.919577] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-11. [2025-09-18T21:21:51.601674] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-18T21:21:51.719500] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-09-18T21:21:52.385421] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-18T21:21:52.519587] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-09-18T21:21:52.961084] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T21:21:53.319562] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-09-18T21:21:54.052178] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-18T21:21:54.119551] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-09-18T21:21:54.691108] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-18T21:21:54.919554] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-09-18T21:21:55.573075] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-18T21:21:55.616877] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-18T21:21:55.719568] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-09-18T21:21:56.519564] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-09-18T21:21:57.319580] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-09-18T21:21:57.561475] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-18T21:21:57.581882] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-18T21:21:58.119558] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-09-18T21:21:58.675441] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-18T21:21:58.919589] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-09-18T21:21:59.672783] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-18T21:21:59.719498] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-09-18T21:22:00.525776] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-09-18T21:22:00.532204] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-18T21:22:01.176964] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T21:22:01.319633] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-09-18T21:22:02.030383] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-18T21:22:02.119539] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-09-18T21:22:02.919548] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-09-18T21:22:03.228909] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-18T21:22:03.582140] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T21:22:03.600118] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-18T21:22:03.604014] [INFO ] [REMOTE ] REX: Full fetch complete (21116 records). [2025-09-18T21:22:03.604136] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-09-18T21:22:03.724664] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-09-18T21:22:03.978840] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-09-18T21:22:03.978923] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-09-18T21:22:03.979373] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-09-18T21:22:03.979414] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-09-18T21:22:03.980171] [DEBUG] [LOCAL ] REX: Trimmed 21116 records to 13927 (keeping 200 days of data) [2025-09-18T21:22:04.064247] [DEBUG] [LOCAL ] REX: Primary data saved (13927 records). [2025-09-18T21:22:04.064402] [INFO ] [MAIN ] REX: Full history saved. [2025-09-18T21:22:04.064492] [INFO ] [MAIN ] Update Progress: 1791/2372 symbols completed. REX took 35.3s. Estimated remaining: 1h 24m 60s. Rate: 6.8 symbols/min [2025-09-18T21:22:04.252897] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:22:04.268506] [DEBUG] [LOCAL ] RFI: Loaded 10573 existing records from primary storage. [2025-09-18T21:22:04.268638] [INFO ] [MAIN ] RFI: Loaded 10573 existing records. [2025-09-18T21:22:04.452167] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:22:04.452428] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-09-18T21:22:04.452475] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-09-18T21:22:04.452903] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-09-18T21:22:04.452962] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-09-18T21:22:04.524767] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-09-18T21:22:04.865166] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:22:05.319557] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-11. [2025-09-18T21:22:05.370802] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-18T21:22:05.942911] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-18T21:22:06.117755] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-18T21:22:06.125503] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-09-18T21:22:06.919604] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-09-18T21:22:07.719709] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-09-18T21:22:07.766479] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-18T21:22:08.238862] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-18T21:22:08.436522] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-18T21:22:08.519568] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-09-18T21:22:09.319587] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-09-18T21:22:10.119572] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-09-18T21:22:10.161781] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-18T21:22:10.630008] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-18T21:22:10.919546] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-09-18T21:22:11.497110] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-18T21:22:11.719579] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-09-18T21:22:12.516476] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-18T21:22:12.527341] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-09-18T21:22:13.319557] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-09-18T21:22:13.353531] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-18T21:22:13.368700] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T21:22:13.368389] [INFO ] [REMOTE ] REZI: Full fetch complete (65339 records). [2025-09-18T21:22:13.371497] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-09-18T21:22:13.779074] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-09-18T21:22:13.779158] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-09-18T21:22:13.780161] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-09-18T21:22:13.780259] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-09-18T21:22:13.782745] [DEBUG] [LOCAL ] REZI: Trimmed 65339 records to 47178 (keeping 200 days of data) [2025-09-18T21:22:14.071744] [DEBUG] [LOCAL ] REZI: Primary data saved (47178 records). [2025-09-18T21:22:14.071884] [INFO ] [MAIN ] REZI: Full history saved. [2025-09-18T21:22:14.072010] [INFO ] [MAIN ] Update Progress: 1792/2372 symbols completed. REZI took 38.1s. Estimated remaining: 1h 24m 51s. Rate: 6.8 symbols/min [2025-09-18T21:22:14.129386] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-09-18T21:22:14.255557] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:22:14.267735] [DEBUG] [LOCAL ] RFL: Loaded 10456 existing records from primary storage. [2025-09-18T21:22:14.267872] [INFO ] [MAIN ] RFL: Loaded 10456 existing records. [2025-09-18T21:22:14.456747] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:22:14.456994] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-09-18T21:22:14.457049] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-09-18T21:22:14.457404] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-09-18T21:22:14.457475] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-09-18T21:22:14.836940] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:22:14.919511] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-11. [2025-09-18T21:22:14.964045] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-18T21:22:14.976046] [INFO ] [REMOTE ] REXR: Full fetch complete (74902 records). [2025-09-18T21:22:14.976242] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-09-18T21:22:15.391208] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-09-18T21:22:15.391291] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-09-18T21:22:15.392423] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-09-18T21:22:15.392490] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-09-18T21:22:15.394685] [DEBUG] [LOCAL ] REXR: Trimmed 74902 records to 52409 (keeping 200 days of data) [2025-09-18T21:22:15.510943] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-18T21:22:15.730818] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-09-18T21:22:15.780864] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-18T21:22:15.805558] [DEBUG] [LOCAL ] REXR: Primary data saved (52409 records). [2025-09-18T21:22:15.805727] [INFO ] [MAIN ] REXR: Full history saved. [2025-09-18T21:22:15.807311] [INFO ] [MAIN ] Update Progress: 1793/2372 symbols completed. REXR took 43.2s. Estimated remaining: 1h 24m 40s. Rate: 6.8 symbols/min [2025-09-18T21:22:15.978976] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:22:15.989069] [DEBUG] [LOCAL ] RFM: Loaded 4008 existing records from primary storage. [2025-09-18T21:22:15.989238] [INFO ] [MAIN ] RFM: Loaded 4008 existing records. [2025-09-18T21:22:16.172334] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:22:16.172829] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-09-18T21:22:16.172891] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-09-18T21:22:16.173145] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-09-18T21:22:16.173203] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-09-18T21:22:16.528686] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-09-18T21:22:16.533765] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:22:16.655015] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-18T21:22:17.319592] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-09-18T21:22:17.908355] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-18T21:22:18.002588] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-18T21:22:18.012271] [INFO ] [REMOTE ] RF: Full fetch complete (77459 records). [2025-09-18T21:22:18.012497] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-09-18T21:22:18.124605] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-09-18T21:22:18.411696] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-09-18T21:22:18.411788] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-09-18T21:22:18.412828] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-09-18T21:22:18.412954] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-09-18T21:22:18.414518] [DEBUG] [LOCAL ] RF: Trimmed 77459 records to 54020 (keeping 200 days of data) [2025-09-18T21:22:18.783040] [DEBUG] [LOCAL ] RF: Primary data saved (54020 records). [2025-09-18T21:22:18.783519] [INFO ] [MAIN ] RF: Full history saved. [2025-09-18T21:22:18.783806] [INFO ] [MAIN ] Update Progress: 1794/2372 symbols completed. RF took 29.4s. Estimated remaining: 1h 24m 30s. Rate: 6.8 symbols/min [2025-09-18T21:22:18.923386] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-09-18T21:22:18.972298] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:22:18.984470] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-18T21:22:18.995871] [DEBUG] [LOCAL ] RFMZ: Loaded 8509 existing records from primary storage. [2025-09-18T21:22:18.996010] [INFO ] [MAIN ] RFMZ: Loaded 8509 existing records. [2025-09-18T21:22:19.186902] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:22:19.187187] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-09-18T21:22:19.187236] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-09-18T21:22:19.187696] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-09-18T21:22:19.187757] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-09-18T21:22:19.561063] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:22:19.568524] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-18T21:22:19.719563] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-09-18T21:22:20.306701] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-18T21:22:20.519756] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-11. [2025-09-18T21:22:21.267411] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-18T21:22:21.319542] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-09-18T21:22:22.119577] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-09-18T21:22:22.233187] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-18T21:22:22.586178] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-18T21:22:22.919552] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-09-18T21:22:23.508937] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-18T21:22:23.719542] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-09-18T21:22:24.439818] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-18T21:22:24.519545] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-09-18T21:22:25.175486] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-18T21:22:25.319575] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-09-18T21:22:25.880252] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-18T21:22:26.119567] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-09-18T21:22:26.919545] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-11. [2025-09-18T21:22:27.131114] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-18T21:22:27.502443] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-18T21:22:27.719845] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-09-18T21:22:28.450234] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-18T21:22:28.519503] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-09-18T21:22:29.319570] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-09-18T21:22:29.405071] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-18T21:22:29.987417] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-18T21:22:30.119548] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-09-18T21:22:30.759971] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-18T21:22:30.919564] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-09-18T21:22:31.719570] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-09-18T21:22:31.828781] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-18T21:22:32.307323] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-18T21:22:32.519556] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-09-18T21:22:33.103687] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-18T21:22:33.319568] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-09-18T21:22:33.854727] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-18T21:22:34.119592] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-09-18T21:22:34.744225] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-18T21:22:34.919546] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-09-18T21:22:35.719546] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-09-18T21:22:35.782901] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-18T21:22:35.785926] [INFO ] [REMOTE ] RFL: Full fetch complete (12480 records). [2025-09-18T21:22:35.786007] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-09-18T21:22:36.157306] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-09-18T21:22:36.157626] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-09-18T21:22:36.158101] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-09-18T21:22:36.158159] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-09-18T21:22:36.158678] [DEBUG] [LOCAL ] RFL: Trimmed 12480 records to 10653 (keeping 200 days of data) [2025-09-18T21:22:36.226275] [DEBUG] [LOCAL ] RFL: Primary data saved (10653 records). [2025-09-18T21:22:36.226405] [INFO ] [MAIN ] RFL: Full history saved. [2025-09-18T21:22:36.226513] [INFO ] [MAIN ] Update Progress: 1795/2372 symbols completed. RFL took 22.2s. Estimated remaining: 1h 24m 24s. Rate: 6.8 symbols/min [2025-09-18T21:22:36.398455] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:22:36.434316] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-18T21:22:36.448894] [DEBUG] [LOCAL ] RGA: Loaded 30186 existing records from primary storage. [2025-09-18T21:22:36.449040] [INFO ] [MAIN ] RGA: Loaded 30186 existing records. [2025-09-18T21:22:36.524760] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-09-18T21:22:36.630257] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:22:36.630560] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-09-18T21:22:36.630609] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-09-18T21:22:36.631790] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-09-18T21:22:36.631877] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-09-18T21:22:37.001834] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:22:37.300757] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-18T21:22:37.319544] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-11. [2025-09-18T21:22:38.119558] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-09-18T21:22:38.593608] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T21:22:38.721763] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-18T21:22:38.919575] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-09-18T21:22:39.719572] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-09-18T21:22:40.147617] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T21:22:40.519556] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-09-18T21:22:40.689501] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-18T21:22:41.065234] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-18T21:22:41.068351] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12827 records). [2025-09-18T21:22:41.068507] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-09-18T21:22:41.324737] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-09-18T21:22:41.482864] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-09-18T21:22:41.482942] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-09-18T21:22:41.483235] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-09-18T21:22:41.483296] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-09-18T21:22:41.483894] [DEBUG] [LOCAL ] RFMZ: Trimmed 12827 records to 8561 (keeping 200 days of data) [2025-09-18T21:22:41.552805] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8561 records). [2025-09-18T21:22:41.552966] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-09-18T21:22:41.553094] [INFO ] [MAIN ] Update Progress: 1796/2372 symbols completed. RFMZ took 22.8s. Estimated remaining: 1h 24m 14s. Rate: 6.8 symbols/min [2025-09-18T21:22:41.727185] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:22:41.749032] [DEBUG] [LOCAL ] RGR: Loaded 20073 existing records from primary storage. [2025-09-18T21:22:41.749212] [INFO ] [MAIN ] RGR: Loaded 20073 existing records. [2025-09-18T21:22:41.934913] [WARN ] [MAIN ] RGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:22:41.935192] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-09-18T21:22:41.935244] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-09-18T21:22:41.935834] [DEBUG] [LOCAL ] RGR: Deleted primary data file. [2025-09-18T21:22:41.935894] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-09-18T21:22:42.125817] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-09-18T21:22:42.273113] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-18T21:22:42.342427] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:22:42.919584] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-09-18T21:22:43.405860] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-18T21:22:43.622232] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-18T21:22:43.719544] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-09-18T21:22:44.177218] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-18T21:22:44.519556] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-09-18T21:22:44.952006] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-18T21:22:45.319570] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-09-18T21:22:46.119566] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-11. [2025-09-18T21:22:46.139533] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-18T21:22:46.141497] [INFO ] [REMOTE ] RFI: Full fetch complete (15830 records). [2025-09-18T21:22:46.141571] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-09-18T21:22:46.518494] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-09-18T21:22:46.518574] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-09-18T21:22:46.518936] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-09-18T21:22:46.518998] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-09-18T21:22:46.519502] [DEBUG] [LOCAL ] RFI: Trimmed 15830 records to 10613 (keeping 200 days of data) [2025-09-18T21:22:46.596241] [DEBUG] [LOCAL ] RFI: Primary data saved (10613 records). [2025-09-18T21:22:46.596410] [INFO ] [MAIN ] RFI: Full history saved. [2025-09-18T21:22:46.596528] [INFO ] [MAIN ] Update Progress: 1797/2372 symbols completed. RFI took 42.5s. Estimated remaining: 1h 24m 4s. Rate: 6.8 symbols/min [2025-09-18T21:22:46.919557] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-09-18T21:22:47.116033] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-18T21:22:47.719589] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-09-18T21:22:48.376972] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-18T21:22:48.408398] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T21:22:48.519592] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-09-18T21:22:49.319626] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-09-18T21:22:50.082694] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-18T21:22:50.108128] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T21:22:50.119496] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-09-18T21:22:50.919543] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-09-18T21:22:51.661597] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T21:22:51.719493] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-09-18T21:22:51.857366] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-18T21:22:52.519600] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-09-18T21:22:52.758896] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-18T21:22:53.319539] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-09-18T21:22:53.562243] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-18T21:22:53.650462] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-18T21:22:54.119543] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-09-18T21:22:54.919517] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-09-18T21:22:54.931431] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-18T21:22:55.719552] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-09-18T21:22:56.062936] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-18T21:22:56.519580] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-09-18T21:22:56.558820] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-18T21:22:57.319564] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-09-18T21:22:57.473000] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-18T21:22:58.119709] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-09-18T21:22:58.425010] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-18T21:22:58.919604] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-09-18T21:22:59.137116] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-18T21:22:59.719704] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-09-18T21:23:00.519734] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-09-18T21:23:01.591246] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-18T21:23:01.596160] [INFO ] [REMOTE ] RGA: Full fetch complete (45623 records). [2025-09-18T21:23:01.596297] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-09-18T21:23:02.002828] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-09-18T21:23:02.002939] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-09-18T21:23:02.003909] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-09-18T21:23:02.003978] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-09-18T21:23:02.005293] [DEBUG] [LOCAL ] RGA: Trimmed 45623 records to 30484 (keeping 200 days of data) [2025-09-18T21:23:02.199819] [DEBUG] [LOCAL ] RGA: Primary data saved (30484 records). [2025-09-18T21:23:02.199957] [INFO ] [MAIN ] RGA: Full history saved. [2025-09-18T21:23:02.200047] [INFO ] [MAIN ] Update Progress: 1798/2372 symbols completed. RGA took 26.0s. Estimated remaining: 1h 23m 57s. Rate: 6.8 symbols/min [2025-09-18T21:23:03.784210] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (4.06 seconds). [2025-09-18T21:23:03.785919] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-09-18T21:23:04.263176] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-18T21:23:04.265190] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-09-18T21:23:04.745206] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-18T21:23:04.746807] [INFO ] [REMOTE ] RFM: Full fetch complete (6016 records). [2025-09-18T21:23:04.746906] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-09-18T21:23:05.155507] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-09-18T21:23:05.155665] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-09-18T21:23:05.155934] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-09-18T21:23:05.156112] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-09-18T21:23:05.156852] [DEBUG] [LOCAL ] RFM: Trimmed 6016 records to 4093 (keeping 200 days of data) [2025-09-18T21:23:05.192668] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (6.27 seconds). [2025-09-18T21:23:05.199763] [DEBUG] [LOCAL ] RFM: Primary data saved (4093 records). [2025-09-18T21:23:05.205621] [INFO ] [MAIN ] RFM: Full history saved. [2025-09-18T21:23:05.206004] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-09-18T21:23:05.206385] [INFO ] [MAIN ] Update Progress: 1799/2372 symbols completed. RFM took 49.4s. Estimated remaining: 1h 23m 47s. Rate: 6.8 symbols/min [2025-09-18T21:23:06.101273] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-18T21:23:06.106031] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-09-18T21:23:07.039335] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T21:23:07.045451] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-09-18T21:23:07.981497] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-18T21:23:07.986418] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-09-18T21:23:08.939310] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-18T21:23:08.942796] [INFO ] [REMOTE ] RGR: Full fetch complete (28267 records). [2025-09-18T21:23:08.942897] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-09-18T21:23:09.332610] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-09-18T21:23:09.332728] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-09-18T21:23:09.333357] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-09-18T21:23:09.333405] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-09-18T21:23:09.334208] [DEBUG] [LOCAL ] RGR: Trimmed 28267 records to 20255 (keeping 200 days of data) [2025-09-18T21:23:09.462938] [DEBUG] [LOCAL ] RGR: Primary data saved (20255 records). [2025-09-18T21:23:09.463080] [INFO ] [MAIN ] RGR: Full history saved. [2025-09-18T21:23:09.463182] [INFO ] [MAIN ] Update Progress: 1800/2372 symbols completed. RGR took 27.9s. Estimated remaining: 1h 23m 36s. Rate: 6.8 symbols/min [2025-09-18T21:23:10.091610] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:23:10.119025] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:23:10.253571] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:23:10.248866] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:23:10.261491] [DEBUG] [LOCAL ] RGT: Loaded 2902 existing records from primary storage. [2025-09-18T21:23:10.261915] [INFO ] [MAIN ] RGT: Loaded 2902 existing records. [2025-09-18T21:23:10.486489] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:23:10.487250] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-09-18T21:23:10.501786] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-09-18T21:23:10.502095] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-09-18T21:23:10.502160] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-09-18T21:23:10.653225] [DEBUG] [LOCAL ] RHI: Loaded 49264 existing records from primary storage. [2025-09-18T21:23:10.661847] [INFO ] [MAIN ] RHI: Loaded 49264 existing records. [2025-09-18T21:23:10.663219] [DEBUG] [LOCAL ] RHP: Loaded 41777 existing records from primary storage. [2025-09-18T21:23:10.664509] [DEBUG] [LOCAL ] RH: Loaded 47769 existing records from primary storage. [2025-09-18T21:23:10.665394] [INFO ] [MAIN ] RH: Loaded 47769 existing records. [2025-09-18T21:23:10.694554] [INFO ] [MAIN ] RHP: Loaded 41777 existing records. [2025-09-18T21:23:11.535746] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:23:11.570091] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-09-18T21:23:11.569923] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:23:11.575605] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-09-18T21:23:11.564440] [WARN ] [MAIN ] RHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:23:11.609793] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-09-18T21:23:11.615570] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-09-18T21:23:11.615496] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-09-18T21:23:11.615797] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-09-18T21:23:11.615379] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-09-18T21:23:11.654745] [DEBUG] [LOCAL ] RHI: Deleted primary data file. [2025-09-18T21:23:11.657795] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-09-18T21:23:11.658036] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-09-18T21:23:11.703972] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:23:11.685975] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-09-18T21:23:11.751716] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-11. [2025-09-18T21:23:11.792327] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-09-18T21:23:12.453627] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-18T21:23:12.493860] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-09-18T21:23:12.602922] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:23:12.638769] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-11. [2025-09-18T21:23:12.853728] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:23:12.883488] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-11. [2025-09-18T21:23:12.887724] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:23:12.889316] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-11. [2025-09-18T21:23:13.054558] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-18T21:23:13.056080] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-09-18T21:23:13.621345] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-18T21:23:13.622682] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-09-18T21:23:13.985046] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-18T21:23:13.986262] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-09-18T21:23:14.010154] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T21:23:14.021205] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-09-18T21:23:14.072026] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T21:23:14.080501] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-09-18T21:23:14.121081] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-18T21:23:14.130546] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-09-18T21:23:14.450817] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-18T21:23:14.919571] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-09-18T21:23:15.307450] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-18T21:23:15.345147] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-18T21:23:15.671948] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-18T21:23:15.702961] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-18T21:23:15.719483] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-09-18T21:23:16.519558] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-09-18T21:23:17.303962] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T21:23:17.319498] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-09-18T21:23:17.595980] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-18T21:23:18.119630] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-09-18T21:23:18.474607] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-18T21:23:18.919572] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-09-18T21:23:19.356496] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-18T21:23:19.719550] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-09-18T21:23:20.275613] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-18T21:23:20.519548] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-09-18T21:23:20.889139] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-18T21:23:21.319570] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-09-18T21:23:22.119575] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-09-18T21:23:22.569596] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (5.25 seconds). [2025-09-18T21:23:22.660559] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-18T21:23:22.919566] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-09-18T21:23:23.263288] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-18T21:23:23.314669] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-18T21:23:23.315691] [INFO ] [REMOTE ] RGT: Full fetch complete (4134 records). [2025-09-18T21:23:23.315776] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-09-18T21:23:23.693109] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-09-18T21:23:23.693187] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-09-18T21:23:23.693317] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-09-18T21:23:23.693356] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-09-18T21:23:23.693757] [DEBUG] [LOCAL ] RGT: Trimmed 4134 records to 2936 (keeping 200 days of data) [2025-09-18T21:23:23.711591] [DEBUG] [LOCAL ] RGT: Primary data saved (2936 records). [2025-09-18T21:23:23.711699] [INFO ] [MAIN ] RGT: Full history saved. [2025-09-18T21:23:23.711795] [INFO ] [MAIN ] Update Progress: 1801/2372 symbols completed. RGT took 14.2s. Estimated remaining: 1h 23m 29s. Rate: 6.8 symbols/min [2025-09-18T21:23:23.724775] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-09-18T21:23:23.883919] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:23:23.949203] [DEBUG] [LOCAL ] RIG: Loaded 53673 existing records from primary storage. [2025-09-18T21:23:23.949404] [INFO ] [MAIN ] RIG: Loaded 53673 existing records. [2025-09-18T21:23:24.131931] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:23:24.132182] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-09-18T21:23:24.132233] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-09-18T21:23:24.133737] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-09-18T21:23:24.133831] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-09-18T21:23:24.512885] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:23:24.519494] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-11. [2025-09-18T21:23:25.319546] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-09-18T21:23:25.597471] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-18T21:23:26.057035] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-18T21:23:26.119521] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-09-18T21:23:26.800693] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T21:23:26.919518] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-09-18T21:23:27.719509] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-09-18T21:23:27.768397] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-18T21:23:28.255152] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-18T21:23:28.519573] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-09-18T21:23:29.319514] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-09-18T21:23:29.870003] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-18T21:23:29.944103] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-18T21:23:30.119515] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-09-18T21:23:30.661283] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-18T21:23:30.919561] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-09-18T21:23:31.568602] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T21:23:31.719541] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-09-18T21:23:32.466455] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-18T21:23:32.519508] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-09-18T21:23:33.249401] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T21:23:33.319498] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-09-18T21:23:34.119567] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-09-18T21:23:34.234088] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-18T21:23:34.919524] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-09-18T21:23:35.345201] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-18T21:23:35.443741] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-18T21:23:35.719576] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-09-18T21:23:36.517903] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-18T21:23:36.527168] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-09-18T21:23:37.197807] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-18T21:23:37.319550] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-09-18T21:23:37.894309] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-18T21:23:38.119581] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-09-18T21:23:38.772369] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T21:23:38.919565] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-09-18T21:23:39.282454] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-18T21:23:39.719536] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-09-18T21:23:40.457593] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-18T21:23:40.464429] [INFO ] [REMOTE ] RH: Full fetch complete (65351 records). [2025-09-18T21:23:40.464561] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-09-18T21:23:40.531570] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-09-18T21:23:40.868011] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-09-18T21:23:40.868108] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-09-18T21:23:40.869165] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-09-18T21:23:40.869231] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-09-18T21:23:40.870742] [DEBUG] [LOCAL ] RH: Trimmed 65351 records to 48119 (keeping 200 days of data) [2025-09-18T21:23:41.164479] [DEBUG] [LOCAL ] RH: Primary data saved (48119 records). [2025-09-18T21:23:41.164682] [INFO ] [MAIN ] RH: Full history saved. [2025-09-18T21:23:41.164822] [INFO ] [MAIN ] Update Progress: 1802/2372 symbols completed. RH took 31.7s. Estimated remaining: 1h 23m 23s. Rate: 6.8 symbols/min [2025-09-18T21:23:41.322671] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-09-18T21:23:41.342965] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:23:41.404827] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-18T21:23:41.431064] [DEBUG] [LOCAL ] RIO: Loaded 53402 existing records from primary storage. [2025-09-18T21:23:41.431205] [INFO ] [MAIN ] RIO: Loaded 53402 existing records. [2025-09-18T21:23:41.610274] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:23:41.610539] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-09-18T21:23:41.610587] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-09-18T21:23:41.612301] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-09-18T21:23:41.612366] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-09-18T21:23:41.975454] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:23:42.119509] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-11. [2025-09-18T21:23:42.243095] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-18T21:23:42.810052] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T21:23:42.919508] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-09-18T21:23:43.719626] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-09-18T21:23:43.838090] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-18T21:23:44.227674] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-18T21:23:44.234498] [INFO ] [REMOTE ] RHI: Full fetch complete (69321 records). [2025-09-18T21:23:44.234613] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-09-18T21:23:44.528372] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-09-18T21:23:44.631169] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-09-18T21:23:44.631296] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-09-18T21:23:44.632437] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-09-18T21:23:44.632535] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-09-18T21:23:44.634147] [DEBUG] [LOCAL ] RHI: Trimmed 69321 records to 49598 (keeping 200 days of data) [2025-09-18T21:23:44.939365] [DEBUG] [LOCAL ] RHI: Primary data saved (49598 records). [2025-09-18T21:23:44.939507] [INFO ] [MAIN ] RHI: Full history saved. [2025-09-18T21:23:44.939598] [INFO ] [MAIN ] Update Progress: 1803/2372 symbols completed. RHI took 35.5s. Estimated remaining: 1h 23m 13s. Rate: 6.8 symbols/min [2025-09-18T21:23:45.107674] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:23:45.163683] [DEBUG] [LOCAL ] RITM: Loaded 52801 existing records from primary storage. [2025-09-18T21:23:45.163833] [INFO ] [MAIN ] RITM: Loaded 52801 existing records. [2025-09-18T21:23:45.329514] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-09-18T21:23:45.357624] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:23:45.358722] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-09-18T21:23:45.358791] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-09-18T21:23:45.360362] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-09-18T21:23:45.360422] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-09-18T21:23:45.748702] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:23:45.784635] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-18T21:23:46.109576] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T21:23:46.119553] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-11. [2025-09-18T21:23:46.919545] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-09-18T21:23:47.503851] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-18T21:23:47.574319] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-18T21:23:47.719599] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-09-18T21:23:48.160715] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-18T21:23:48.519572] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-09-18T21:23:49.321995] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-09-18T21:23:49.328142] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-18T21:23:49.782755] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-18T21:23:50.119553] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-09-18T21:23:50.919576] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-09-18T21:23:51.487393] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-18T21:23:51.528926] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-18T21:23:51.536559] [INFO ] [REMOTE ] RIG: Full fetch complete (77572 records). [2025-09-18T21:23:51.536770] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-09-18T21:23:51.731582] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-09-18T21:23:52.076104] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-09-18T21:23:52.076243] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-09-18T21:23:52.078370] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-09-18T21:23:52.078540] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-09-18T21:23:52.080818] [DEBUG] [LOCAL ] RIG: Trimmed 77572 records to 54062 (keeping 200 days of data) [2025-09-18T21:23:52.525049] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-09-18T21:23:52.555948] [DEBUG] [LOCAL ] RIG: Primary data saved (54062 records). [2025-09-18T21:23:52.556221] [INFO ] [MAIN ] RIG: Full history saved. [2025-09-18T21:23:52.556352] [INFO ] [MAIN ] Update Progress: 1804/2372 symbols completed. RIG took 28.8s. Estimated remaining: 1h 23m 4s. Rate: 6.8 symbols/min [2025-09-18T21:23:52.782693] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:23:52.796903] [DEBUG] [LOCAL ] RIV: Loaded 11640 existing records from primary storage. [2025-09-18T21:23:52.797058] [INFO ] [MAIN ] RIV: Loaded 11640 existing records. [2025-09-18T21:23:52.990041] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:23:52.990398] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-09-18T21:23:52.990459] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-09-18T21:23:52.990969] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-09-18T21:23:52.991032] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-09-18T21:23:53.401450] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:23:53.402135] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-11. [2025-09-18T21:23:53.406546] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-18T21:23:53.445930] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-18T21:23:54.119566] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-09-18T21:23:54.212481] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-18T21:23:54.243157] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-18T21:23:54.919570] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-09-18T21:23:55.249770] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-18T21:23:55.719606] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-09-18T21:23:56.519563] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-09-18T21:23:56.780484] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-18T21:23:56.846315] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-18T21:23:56.851911] [INFO ] [REMOTE ] RHP: Full fetch complete (57825 records). [2025-09-18T21:23:56.852032] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-09-18T21:23:57.242928] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-09-18T21:23:57.243019] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-09-18T21:23:57.243942] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-09-18T21:23:57.244008] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-09-18T21:23:57.245333] [DEBUG] [LOCAL ] RHP: Trimmed 57825 records to 42071 (keeping 200 days of data) [2025-09-18T21:23:57.338105] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-09-18T21:23:57.510030] [DEBUG] [LOCAL ] RHP: Primary data saved (42071 records). [2025-09-18T21:23:57.510166] [INFO ] [MAIN ] RHP: Full history saved. [2025-09-18T21:23:57.510248] [INFO ] [MAIN ] Update Progress: 1805/2372 symbols completed. RHP took 48.0s. Estimated remaining: 1h 22m 54s. Rate: 6.8 symbols/min [2025-09-18T21:23:57.680356] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:23:57.728820] [DEBUG] [LOCAL ] RJF: Loaded 47176 existing records from primary storage. [2025-09-18T21:23:57.729015] [INFO ] [MAIN ] RJF: Loaded 47176 existing records. [2025-09-18T21:23:57.906573] [WARN ] [MAIN ] RJF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:23:57.906833] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-09-18T21:23:57.906883] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-09-18T21:23:57.908260] [DEBUG] [LOCAL ] RJF: Deleted primary data file. [2025-09-18T21:23:57.908321] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-09-18T21:23:58.124038] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-09-18T21:23:58.210910] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-18T21:23:58.299212] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:23:58.359837] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-18T21:23:58.919572] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-11. [2025-09-18T21:23:59.719581] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-09-18T21:24:00.055416] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-18T21:24:00.159440] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-18T21:24:00.519568] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-09-18T21:24:00.550734] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-18T21:24:01.319703] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-09-18T21:24:02.119565] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-09-18T21:24:02.919609] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-09-18T21:24:04.057147] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (3.54 seconds). [2025-09-18T21:24:04.068682] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-09-18T21:24:04.343807] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (3.02 seconds). [2025-09-18T21:24:04.519627] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-09-18T21:24:04.779628] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-18T21:24:05.342405] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-09-18T21:24:05.367705] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (3.25 seconds). [2025-09-18T21:24:05.870416] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-18T21:24:05.942301] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-18T21:24:06.029964] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T21:24:06.119506] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-09-18T21:24:06.919600] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-09-18T21:24:07.719612] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-09-18T21:24:07.897456] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-18T21:24:07.941029] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-18T21:24:08.519542] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-09-18T21:24:09.319550] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-09-18T21:24:09.470213] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-18T21:24:09.760468] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-18T21:24:09.997823] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T21:24:10.119527] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-09-18T21:24:10.919552] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-09-18T21:24:11.507562] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-18T21:24:11.719509] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-09-18T21:24:11.850580] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-18T21:24:12.519550] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-09-18T21:24:13.192918] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-18T21:24:13.319561] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-09-18T21:24:14.119547] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-09-18T21:24:14.281480] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-18T21:24:14.462877] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-18T21:24:14.919550] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-09-18T21:24:15.719548] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-09-18T21:24:16.519590] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-09-18T21:24:16.726932] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-18T21:24:17.293108] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (3.17 seconds). [2025-09-18T21:24:17.319487] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-09-18T21:24:18.119568] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-09-18T21:24:18.210720] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-18T21:24:18.750117] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T21:24:18.919546] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-09-18T21:24:18.980231] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-18T21:24:19.002382] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-18T21:24:19.006182] [INFO ] [REMOTE ] RIV: Full fetch complete (17147 records). [2025-09-18T21:24:19.006296] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-09-18T21:24:19.375972] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-09-18T21:24:19.376093] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-09-18T21:24:19.376524] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-09-18T21:24:19.376585] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-09-18T21:24:19.377163] [DEBUG] [LOCAL ] RIV: Trimmed 17147 records to 11782 (keeping 200 days of data) [2025-09-18T21:24:19.452457] [DEBUG] [LOCAL ] RIV: Primary data saved (11782 records). [2025-09-18T21:24:19.452607] [INFO ] [MAIN ] RIV: Full history saved. [2025-09-18T21:24:19.452751] [INFO ] [MAIN ] Update Progress: 1806/2372 symbols completed. RIV took 26.9s. Estimated remaining: 1h 22m 49s. Rate: 6.8 symbols/min [2025-09-18T21:24:19.622203] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:24:19.677182] [DEBUG] [LOCAL ] RKT: Loaded 53720 existing records from primary storage. [2025-09-18T21:24:19.677331] [INFO ] [MAIN ] RKT: Loaded 53720 existing records. [2025-09-18T21:24:19.724683] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-09-18T21:24:19.860753] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:24:19.860978] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-09-18T21:24:19.861078] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-09-18T21:24:19.862145] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-09-18T21:24:19.862218] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-09-18T21:24:20.226762] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:24:20.519583] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-11. [2025-09-18T21:24:20.812560] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-18T21:24:21.319532] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-09-18T21:24:21.412775] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-18T21:24:22.024210] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-18T21:24:22.119541] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-09-18T21:24:22.842872] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-18T21:24:22.919512] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-09-18T21:24:23.527599] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-18T21:24:23.719542] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-09-18T21:24:24.519537] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-09-18T21:24:24.756814] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-18T21:24:24.764227] [INFO ] [REMOTE ] RITM: Full fetch complete (76431 records). [2025-09-18T21:24:24.764378] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-09-18T21:24:25.176967] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-09-18T21:24:25.177092] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-09-18T21:24:25.178264] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-09-18T21:24:25.178390] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-09-18T21:24:25.201435] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-18T21:24:25.208692] [DEBUG] [LOCAL ] RITM: Trimmed 76431 records to 53187 (keeping 200 days of data) [2025-09-18T21:24:25.210069] [INFO ] [REMOTE ] RIO: Full fetch complete (77203 records). [2025-09-18T21:24:25.210159] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-09-18T21:24:25.321499] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-09-18T21:24:25.743457] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-09-18T21:24:25.743861] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-09-18T21:24:25.745681] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-09-18T21:24:25.746515] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-09-18T21:24:25.753100] [DEBUG] [LOCAL ] RIO: Trimmed 77203 records to 53789 (keeping 200 days of data) [2025-09-18T21:24:26.205541] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-18T21:24:26.220452] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-09-18T21:24:26.242156] [DEBUG] [LOCAL ] RITM: Primary data saved (53187 records). [2025-09-18T21:24:26.243172] [INFO ] [MAIN ] RITM: Full history saved. [2025-09-18T21:24:26.246317] [INFO ] [MAIN ] Update Progress: 1807/2372 symbols completed. RITM took 41.3s. Estimated remaining: 1h 22m 40s. Rate: 6.8 symbols/min [2025-09-18T21:24:26.437604] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:24:26.556429] [DEBUG] [LOCAL ] RL: Loaded 42059 existing records from primary storage. [2025-09-18T21:24:26.557431] [INFO ] [MAIN ] RL: Loaded 42059 existing records. [2025-09-18T21:24:26.720572] [DEBUG] [LOCAL ] RIO: Primary data saved (53789 records). [2025-09-18T21:24:26.754783] [INFO ] [MAIN ] RIO: Full history saved. [2025-09-18T21:24:26.761539] [WARN ] [MAIN ] RL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:24:26.761879] [INFO ] [MAIN ] Update Progress: 1808/2372 symbols completed. RIO took 45.6s. Estimated remaining: 1h 22m 29s. Rate: 6.8 symbols/min [2025-09-18T21:24:26.796373] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-09-18T21:24:26.833452] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-09-18T21:24:26.858003] [DEBUG] [LOCAL ] RL: Deleted primary data file. [2025-09-18T21:24:26.863700] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-09-18T21:24:27.055264] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:24:27.369468] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-18T21:24:27.434482] [DEBUG] [LOCAL ] RLI: Loaded 33294 existing records from primary storage. [2025-09-18T21:24:27.441097] [INFO ] [MAIN ] RLI: Loaded 33294 existing records. [2025-09-18T21:24:27.440942] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:24:27.450840] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-11. [2025-09-18T21:24:27.643317] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:24:27.643666] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-09-18T21:24:27.643819] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-09-18T21:24:27.644773] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-09-18T21:24:27.644835] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-09-18T21:24:27.723833] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-09-18T21:24:28.050842] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:24:28.045536] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-18T21:24:28.519540] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-11. [2025-09-18T21:24:28.779103] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-18T21:24:28.892131] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-18T21:24:29.205083] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-18T21:24:29.319552] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-09-18T21:24:30.119607] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-09-18T21:24:30.492819] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-18T21:24:30.919545] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-09-18T21:24:31.719605] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-09-18T21:24:31.885542] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-18T21:24:32.012332] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-18T21:24:32.519557] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-09-18T21:24:32.965200] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-18T21:24:33.319537] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-09-18T21:24:33.760188] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-18T21:24:33.767030] [INFO ] [REMOTE ] RJF: Full fetch complete (68178 records). [2025-09-18T21:24:33.767222] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-09-18T21:24:34.124577] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-09-18T21:24:34.169610] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-09-18T21:24:34.169734] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-09-18T21:24:34.170771] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-09-18T21:24:34.170838] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-09-18T21:24:34.173955] [DEBUG] [LOCAL ] RJF: Trimmed 68178 records to 47500 (keeping 200 days of data) [2025-09-18T21:24:34.493901] [DEBUG] [LOCAL ] RJF: Primary data saved (47500 records). [2025-09-18T21:24:34.494059] [INFO ] [MAIN ] RJF: Full history saved. [2025-09-18T21:24:34.494381] [INFO ] [MAIN ] Update Progress: 1809/2372 symbols completed. RJF took 37.0s. Estimated remaining: 1h 22m 19s. Rate: 6.8 symbols/min [2025-09-18T21:24:34.679299] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:24:34.726261] [DEBUG] [LOCAL ] RLJ: Loaded 48328 existing records from primary storage. [2025-09-18T21:24:34.726438] [INFO ] [MAIN ] RLJ: Loaded 48328 existing records. [2025-09-18T21:24:34.910708] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:24:34.910954] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-09-18T21:24:34.911015] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-09-18T21:24:34.912011] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-09-18T21:24:34.912072] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-09-18T21:24:34.943491] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-09-18T21:24:35.277462] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:24:35.477429] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-18T21:24:35.510754] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-18T21:24:35.719581] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-09-18T21:24:36.406985] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-18T21:24:36.519627] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-09-18T21:24:37.319525] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-11. [2025-09-18T21:24:37.393722] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-18T21:24:37.758122] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-18T21:24:38.119544] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-09-18T21:24:38.654144] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-18T21:24:38.919550] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-09-18T21:24:39.198855] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-18T21:24:39.719561] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-09-18T21:24:40.231256] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T21:24:40.519546] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-09-18T21:24:41.273140] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-18T21:24:41.319507] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-09-18T21:24:41.566719] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-18T21:24:42.119549] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-09-18T21:24:42.774793] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T21:24:42.919515] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-09-18T21:24:43.719527] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-09-18T21:24:43.774073] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-18T21:24:43.806952] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-18T21:24:44.519618] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-09-18T21:24:45.319557] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-09-18T21:24:45.484430] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-18T21:24:46.119569] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-09-18T21:24:46.472935] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-18T21:24:46.703170] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T21:24:46.919542] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-09-18T21:24:47.271456] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-18T21:24:47.719615] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-09-18T21:24:48.124807] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-18T21:24:48.519548] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-09-18T21:24:48.821958] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-18T21:24:49.319602] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-09-18T21:24:50.119585] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-09-18T21:24:50.198135] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-18T21:24:50.919548] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-09-18T21:24:51.250044] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-18T21:24:51.391142] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-18T21:24:51.719553] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-09-18T21:24:52.519571] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-09-18T21:24:52.791357] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-18T21:24:53.319551] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-09-18T21:24:53.675945] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-18T21:24:53.683772] [INFO ] [REMOTE ] RKT: Full fetch complete (77167 records). [2025-09-18T21:24:53.683946] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-09-18T21:24:54.121083] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-09-18T21:24:54.121241] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-09-18T21:24:54.126924] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-09-18T21:24:54.137466] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-09-18T21:24:54.137758] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-09-18T21:24:54.141037] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-18T21:24:54.150910] [DEBUG] [LOCAL ] RKT: Trimmed 77167 records to 54110 (keeping 200 days of data) [2025-09-18T21:24:54.503971] [DEBUG] [LOCAL ] RKT: Primary data saved (54110 records). [2025-09-18T21:24:54.504445] [INFO ] [MAIN ] RKT: Full history saved. [2025-09-18T21:24:54.504589] [INFO ] [MAIN ] Update Progress: 1810/2372 symbols completed. RKT took 35.1s. Estimated remaining: 1h 22m 14s. Rate: 6.8 symbols/min [2025-09-18T21:24:54.695248] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:24:54.708944] [DEBUG] [LOCAL ] RLTY: Loaded 11236 existing records from primary storage. [2025-09-18T21:24:54.709061] [INFO ] [MAIN ] RLTY: Loaded 11236 existing records. [2025-09-18T21:24:54.883923] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T21:24:54.924390] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-09-18T21:24:54.938298] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:24:54.940089] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-09-18T21:24:54.940145] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-09-18T21:24:54.940815] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-09-18T21:24:54.940897] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-09-18T21:24:55.337111] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:24:55.388564] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-18T21:24:55.719573] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-09-18T21:24:56.137816] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-18T21:24:56.145513] [INFO ] [REMOTE ] RL: Full fetch complete (60165 records). [2025-09-18T21:24:56.145620] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-09-18T21:24:56.520524] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-09-18T21:24:56.536051] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-09-18T21:24:56.536108] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-09-18T21:24:56.537147] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-09-18T21:24:56.537302] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-09-18T21:24:56.538667] [DEBUG] [LOCAL ] RL: Trimmed 60165 records to 42280 (keeping 200 days of data) [2025-09-18T21:24:56.815980] [DEBUG] [LOCAL ] RL: Primary data saved (42280 records). [2025-09-18T21:24:56.816118] [INFO ] [MAIN ] RL: Full history saved. [2025-09-18T21:24:56.816905] [INFO ] [MAIN ] Update Progress: 1811/2372 symbols completed. RL took 30.6s. Estimated remaining: 1h 22m 3s. Rate: 6.8 symbols/min [2025-09-18T21:24:56.989379] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:24:57.039016] [DEBUG] [LOCAL ] RLX: Loaded 48154 existing records from primary storage. [2025-09-18T21:24:57.039173] [INFO ] [MAIN ] RLX: Loaded 48154 existing records. [2025-09-18T21:24:57.218084] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:24:57.218374] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-09-18T21:24:57.218423] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-09-18T21:24:57.219408] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-09-18T21:24:57.219469] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-09-18T21:24:57.322860] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-11. [2025-09-18T21:24:57.670848] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:24:57.674193] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-18T21:24:57.705088] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-18T21:24:58.088265] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-18T21:24:58.119494] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-09-18T21:24:58.919617] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-09-18T21:24:59.404590] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-18T21:24:59.409859] [INFO ] [REMOTE ] RLI: Full fetch complete (45668 records). [2025-09-18T21:24:59.409981] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-09-18T21:24:59.725612] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-18T21:24:59.724659] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-11. [2025-09-18T21:24:59.843995] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-09-18T21:24:59.844078] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-09-18T21:24:59.845012] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-09-18T21:24:59.845104] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-09-18T21:24:59.848019] [DEBUG] [LOCAL ] RLI: Trimmed 45668 records to 33515 (keeping 200 days of data) [2025-09-18T21:25:00.067978] [DEBUG] [LOCAL ] RLI: Primary data saved (33515 records). [2025-09-18T21:25:00.068129] [INFO ] [MAIN ] RLI: Full history saved. [2025-09-18T21:25:00.068220] [INFO ] [MAIN ] Update Progress: 1812/2372 symbols completed. RLI took 33.3s. Estimated remaining: 1h 21m 53s. Rate: 6.8 symbols/min [2025-09-18T21:25:00.244533] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:25:00.254341] [DEBUG] [LOCAL ] RM: Loaded 7740 existing records from primary storage. [2025-09-18T21:25:00.254460] [INFO ] [MAIN ] RM: Loaded 7740 existing records. [2025-09-18T21:25:00.432230] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:25:00.432492] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-09-18T21:25:00.432540] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-09-18T21:25:00.433029] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-09-18T21:25:00.433090] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-09-18T21:25:00.529788] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-09-18T21:25:00.792737] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:25:01.319566] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-09-18T21:25:01.431240] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-18T21:25:01.477814] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T21:25:02.119578] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-09-18T21:25:02.672968] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-18T21:25:02.919566] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-09-18T21:25:03.570132] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-18T21:25:03.719587] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-11. [2025-09-18T21:25:04.120049] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-18T21:25:04.181789] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-18T21:25:04.519546] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-09-18T21:25:05.319545] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-09-18T21:25:05.872417] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-18T21:25:05.879341] [INFO ] [REMOTE ] RLJ: Full fetch complete (69098 records). [2025-09-18T21:25:05.879511] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-09-18T21:25:06.124183] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-09-18T21:25:06.137059] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-18T21:25:06.297997] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-09-18T21:25:06.298084] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-09-18T21:25:06.299078] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-09-18T21:25:06.299146] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-09-18T21:25:06.301549] [DEBUG] [LOCAL ] RLJ: Trimmed 69098 records to 48681 (keeping 200 days of data) [2025-09-18T21:25:06.584492] [DEBUG] [LOCAL ] RLJ: Primary data saved (48681 records). [2025-09-18T21:25:06.584679] [INFO ] [MAIN ] RLJ: Full history saved. [2025-09-18T21:25:06.584794] [INFO ] [MAIN ] Update Progress: 1813/2372 symbols completed. RLJ took 32.1s. Estimated remaining: 1h 21m 43s. Rate: 6.8 symbols/min [2025-09-18T21:25:06.756827] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:25:06.777293] [DEBUG] [LOCAL ] RMAX: Loaded 21780 existing records from primary storage. [2025-09-18T21:25:06.777420] [INFO ] [MAIN ] RMAX: Loaded 21780 existing records. [2025-09-18T21:25:06.925887] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-09-18T21:25:06.925817] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-18T21:25:06.969257] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:25:06.969556] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-09-18T21:25:06.969609] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-09-18T21:25:06.970300] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-09-18T21:25:06.970360] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-09-18T21:25:07.332335] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:25:07.719545] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-09-18T21:25:08.443977] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-18T21:25:08.494441] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-18T21:25:08.519512] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-09-18T21:25:09.319545] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-09-18T21:25:10.126498] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-09-18T21:25:10.144994] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-18T21:25:10.192613] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-18T21:25:10.747911] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-18T21:25:10.919546] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-09-18T21:25:11.719553] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-09-18T21:25:11.754637] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-18T21:25:12.519553] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-11. [2025-09-18T21:25:13.319542] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-09-18T21:25:13.482451] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-18T21:25:13.516519] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-18T21:25:13.865328] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-18T21:25:14.119543] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-09-18T21:25:14.919565] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-09-18T21:25:14.958345] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T21:25:15.704488] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-18T21:25:15.719524] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-09-18T21:25:16.436601] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-18T21:25:16.519536] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-09-18T21:25:17.319514] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-09-18T21:25:17.355427] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T21:25:18.123436] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-09-18T21:25:18.126825] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-18T21:25:18.919591] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-09-18T21:25:19.545948] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T21:25:19.678376] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-18T21:25:19.719587] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-09-18T21:25:20.519563] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-09-18T21:25:20.528774] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-18T21:25:20.531381] [INFO ] [REMOTE ] RLTY: Full fetch complete (18195 records). [2025-09-18T21:25:20.531464] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-09-18T21:25:20.917111] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-09-18T21:25:20.917228] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-09-18T21:25:20.917717] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-09-18T21:25:20.917783] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-09-18T21:25:20.918488] [DEBUG] [LOCAL ] RLTY: Trimmed 18195 records to 11372 (keeping 200 days of data) [2025-09-18T21:25:20.995635] [DEBUG] [LOCAL ] RLTY: Primary data saved (11372 records). [2025-09-18T21:25:20.995822] [INFO ] [MAIN ] RLTY: Full history saved. [2025-09-18T21:25:20.995917] [INFO ] [MAIN ] Update Progress: 1814/2372 symbols completed. RLTY took 26.5s. Estimated remaining: 1h 21m 36s. Rate: 6.8 symbols/min [2025-09-18T21:25:21.174435] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:25:21.219040] [DEBUG] [LOCAL ] RMD: Loaded 42597 existing records from primary storage. [2025-09-18T21:25:21.219198] [INFO ] [MAIN ] RMD: Loaded 42597 existing records. [2025-09-18T21:25:21.324860] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-09-18T21:25:21.417588] [WARN ] [MAIN ] RMD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:25:21.417884] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-09-18T21:25:21.417940] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-09-18T21:25:21.419364] [DEBUG] [LOCAL ] RMD: Deleted primary data file. [2025-09-18T21:25:21.419432] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-09-18T21:25:21.799771] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:25:22.024908] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-18T21:25:22.045017] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-18T21:25:22.119533] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-09-18T21:25:22.919553] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-09-18T21:25:23.627493] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-18T21:25:23.675749] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-18T21:25:23.719570] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-09-18T21:25:24.519544] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-09-18T21:25:25.252807] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T21:25:25.289314] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-18T21:25:25.319497] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-11. [2025-09-18T21:25:26.119555] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-09-18T21:25:26.643513] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-18T21:25:26.919546] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-09-18T21:25:26.988384] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-18T21:25:27.494174] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-18T21:25:27.719578] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-09-18T21:25:28.519567] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-09-18T21:25:29.166829] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T21:25:29.263636] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-18T21:25:29.319491] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-09-18T21:25:30.119538] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-09-18T21:25:30.234137] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-18T21:25:30.919559] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-09-18T21:25:31.701927] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-18T21:25:31.719546] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-09-18T21:25:32.337191] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-18T21:25:32.346902] [INFO ] [REMOTE ] RLX: Full fetch complete (70194 records). [2025-09-18T21:25:32.347061] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-09-18T21:25:32.527569] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-09-18T21:25:32.771288] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-18T21:25:32.770555] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-09-18T21:25:32.771423] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-09-18T21:25:32.777116] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-09-18T21:25:32.777562] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-09-18T21:25:32.778971] [DEBUG] [LOCAL ] RLX: Trimmed 70194 records to 48504 (keeping 200 days of data) [2025-09-18T21:25:33.065181] [DEBUG] [LOCAL ] RLX: Primary data saved (48504 records). [2025-09-18T21:25:33.065873] [INFO ] [MAIN ] RLX: Full history saved. [2025-09-18T21:25:33.066486] [INFO ] [MAIN ] Update Progress: 1815/2372 symbols completed. RLX took 36.2s. Estimated remaining: 1h 21m 29s. Rate: 6.8 symbols/min [2025-09-18T21:25:33.251597] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:25:33.258760] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-18T21:25:33.266535] [DEBUG] [LOCAL ] RMI: Loaded 4573 existing records from primary storage. [2025-09-18T21:25:33.266625] [INFO ] [MAIN ] RMI: Loaded 4573 existing records. [2025-09-18T21:25:33.324673] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-09-18T21:25:33.457259] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:25:33.457502] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-09-18T21:25:33.457550] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-09-18T21:25:33.457835] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-09-18T21:25:33.457894] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-09-18T21:25:33.812626] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:25:34.119524] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-09-18T21:25:34.195340] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-18T21:25:34.919581] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-09-18T21:25:35.658988] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T21:25:35.660729] [INFO ] [REMOTE ] RM: Full fetch complete (11452 records). [2025-09-18T21:25:35.660807] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-09-18T21:25:35.725859] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-09-18T21:25:36.005885] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-18T21:25:36.084843] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-09-18T21:25:36.084910] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-09-18T21:25:36.085197] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-09-18T21:25:36.085237] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-09-18T21:25:36.085709] [DEBUG] [LOCAL ] RM: Trimmed 11452 records to 7801 (keeping 200 days of data) [2025-09-18T21:25:36.134228] [DEBUG] [LOCAL ] RM: Primary data saved (7801 records). [2025-09-18T21:25:36.134329] [INFO ] [MAIN ] RM: Full history saved. [2025-09-18T21:25:36.134408] [INFO ] [MAIN ] Update Progress: 1816/2372 symbols completed. RM took 36.1s. Estimated remaining: 1h 21m 18s. Rate: 6.8 symbols/min [2025-09-18T21:25:36.334230] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:25:36.347142] [DEBUG] [LOCAL ] RMM: Loaded 10213 existing records from primary storage. [2025-09-18T21:25:36.347277] [INFO ] [MAIN ] RMM: Loaded 10213 existing records. [2025-09-18T21:25:36.526928] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-11. [2025-09-18T21:25:36.526864] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:25:36.527403] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-09-18T21:25:36.528423] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-09-18T21:25:36.528880] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-09-18T21:25:36.528944] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-09-18T21:25:36.961257] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:25:36.973394] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T21:25:37.158155] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-18T21:25:37.319575] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-11. [2025-09-18T21:25:38.050863] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-18T21:25:38.119521] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-09-18T21:25:38.919612] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-09-18T21:25:39.001271] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T21:25:39.719532] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-09-18T21:25:39.982021] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-18T21:25:40.519552] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-09-18T21:25:41.090241] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-18T21:25:41.115555] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T21:25:41.319552] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-09-18T21:25:42.119566] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-09-18T21:25:42.919558] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-09-18T21:25:43.193887] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-18T21:25:43.197143] [INFO ] [REMOTE ] RMAX: Full fetch complete (29577 records). [2025-09-18T21:25:43.197219] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-09-18T21:25:43.571931] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-09-18T21:25:43.572059] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-09-18T21:25:43.572694] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-09-18T21:25:43.573436] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-09-18T21:25:43.574293] [DEBUG] [LOCAL ] RMAX: Trimmed 29577 records to 21953 (keeping 200 days of data) [2025-09-18T21:25:43.701834] [DEBUG] [LOCAL ] RMAX: Primary data saved (21953 records). [2025-09-18T21:25:43.702059] [INFO ] [MAIN ] RMAX: Full history saved. [2025-09-18T21:25:43.702190] [INFO ] [MAIN ] Update Progress: 1817/2372 symbols completed. RMAX took 37.1s. Estimated remaining: 1h 21m 9s. Rate: 6.8 symbols/min [2025-09-18T21:25:43.760362] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T21:25:43.760214] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-09-18T21:25:43.863420] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-18T21:25:43.909968] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:25:43.926111] [DEBUG] [LOCAL ] RMMZ: Loaded 4805 existing records from primary storage. [2025-09-18T21:25:43.926209] [INFO ] [MAIN ] RMMZ: Loaded 4805 existing records. [2025-09-18T21:25:44.116788] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:25:44.117044] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-09-18T21:25:44.117093] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-09-18T21:25:44.117452] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-09-18T21:25:44.117514] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-09-18T21:25:44.503973] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:25:44.519499] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-11. [2025-09-18T21:25:45.094064] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-18T21:25:45.319591] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-09-18T21:25:45.378856] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-18T21:25:46.119545] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-09-18T21:25:46.736195] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-18T21:25:46.902980] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T21:25:46.919504] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-09-18T21:25:47.719571] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-09-18T21:25:48.112068] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-18T21:25:48.519523] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-09-18T21:25:48.602762] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-18T21:25:49.090140] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-18T21:25:49.319604] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-09-18T21:25:49.964795] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-18T21:25:50.119579] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-09-18T21:25:50.763813] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-18T21:25:50.919546] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-09-18T21:25:51.673874] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-18T21:25:51.719536] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-09-18T21:25:52.416616] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-18T21:25:52.519551] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-09-18T21:25:53.070686] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-18T21:25:53.319594] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-09-18T21:25:54.119548] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-09-18T21:25:54.791406] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-18T21:25:54.862183] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-18T21:25:54.919518] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-09-18T21:25:55.367395] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-18T21:25:55.719539] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-09-18T21:25:56.519587] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-09-18T21:25:56.642283] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-18T21:25:57.319608] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-09-18T21:25:57.733951] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-18T21:25:58.119804] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-09-18T21:25:58.912786] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T21:25:58.926458] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-09-18T21:25:58.944313] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-18T21:25:59.653627] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-18T21:25:59.656400] [INFO ] [REMOTE ] RMM: Full fetch complete (14748 records). [2025-09-18T21:25:59.656523] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-09-18T21:25:59.724758] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-09-18T21:26:00.058047] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-09-18T21:26:00.058186] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-09-18T21:26:00.058754] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-09-18T21:26:00.058844] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-09-18T21:26:00.061329] [DEBUG] [LOCAL ] RMM: Trimmed 14748 records to 10271 (keeping 200 days of data) [2025-09-18T21:26:00.137231] [DEBUG] [LOCAL ] RMM: Primary data saved (10271 records). [2025-09-18T21:26:00.137467] [INFO ] [MAIN ] RMM: Full history saved. [2025-09-18T21:26:00.137631] [INFO ] [MAIN ] Update Progress: 1818/2372 symbols completed. RMM took 24.0s. Estimated remaining: 1h 21m 2s. Rate: 6.8 symbols/min [2025-09-18T21:26:00.262189] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-18T21:26:00.347054] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:26:00.370558] [DEBUG] [LOCAL ] RMT: Loaded 17815 existing records from primary storage. [2025-09-18T21:26:00.370790] [INFO ] [MAIN ] RMT: Loaded 17815 existing records. [2025-09-18T21:26:00.524754] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-09-18T21:26:00.606038] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:26:00.606482] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-09-18T21:26:00.606600] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-09-18T21:26:00.607361] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-09-18T21:26:00.607428] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-09-18T21:26:01.007034] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:26:01.122594] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-18T21:26:01.319555] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-09-18T21:26:01.917131] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-18T21:26:02.119577] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-09-18T21:26:02.884277] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-18T21:26:02.919502] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-09-18T21:26:03.450065] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-18T21:26:03.451632] [INFO ] [REMOTE ] RMI: Full fetch complete (6331 records). [2025-09-18T21:26:03.451727] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-09-18T21:26:03.724795] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-11. [2025-09-18T21:26:03.819103] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-09-18T21:26:03.819204] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-09-18T21:26:03.819423] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-09-18T21:26:03.819464] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-09-18T21:26:03.819889] [DEBUG] [LOCAL ] RMI: Trimmed 6331 records to 4657 (keeping 200 days of data) [2025-09-18T21:26:03.849051] [DEBUG] [LOCAL ] RMI: Primary data saved (4657 records). [2025-09-18T21:26:03.849141] [INFO ] [MAIN ] RMI: Full history saved. [2025-09-18T21:26:03.849238] [INFO ] [MAIN ] Update Progress: 1819/2372 symbols completed. RMI took 30.8s. Estimated remaining: 1h 20m 52s. Rate: 6.8 symbols/min [2025-09-18T21:26:04.016561] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:26:04.065015] [DEBUG] [LOCAL ] RNG: Loaded 48251 existing records from primary storage. [2025-09-18T21:26:04.065165] [INFO ] [MAIN ] RNG: Loaded 48251 existing records. [2025-09-18T21:26:04.285715] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:26:04.286066] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-09-18T21:26:04.286121] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-09-18T21:26:04.287867] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-09-18T21:26:04.287929] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-09-18T21:26:04.529911] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-09-18T21:26:04.646491] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:26:04.775477] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-18T21:26:04.901061] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-18T21:26:05.319556] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-09-18T21:26:06.119549] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-11. [2025-09-18T21:26:06.711308] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T21:26:06.919569] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-09-18T21:26:07.390974] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T21:26:07.719535] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-09-18T21:26:07.850919] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-18T21:26:08.519557] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-09-18T21:26:09.319533] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-09-18T21:26:09.365199] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-18T21:26:09.374340] [INFO ] [REMOTE ] RMD: Full fetch complete (60794 records). [2025-09-18T21:26:09.374499] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-09-18T21:26:09.636563] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-18T21:26:09.793082] [DEBUG] [VALIDATOR ] RMD: All expected trading days are present. [2025-09-18T21:26:09.793166] [DEBUG] [VALIDATOR ] RMD: Primary data validation passed. [2025-09-18T21:26:09.794119] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-09-18T21:26:09.794183] [DEBUG] [LOCAL ] RMD: Saving primary data. [2025-09-18T21:26:09.795506] [DEBUG] [LOCAL ] RMD: Trimmed 60794 records to 42846 (keeping 200 days of data) [2025-09-18T21:26:10.080416] [DEBUG] [LOCAL ] RMD: Primary data saved (42846 records). [2025-09-18T21:26:10.080552] [INFO ] [MAIN ] RMD: Full history saved. [2025-09-18T21:26:10.080638] [INFO ] [MAIN ] Update Progress: 1820/2372 symbols completed. RMD took 49.1s. Estimated remaining: 1h 20m 43s. Rate: 6.8 symbols/min [2025-09-18T21:26:10.128029] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-09-18T21:26:10.261968] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:26:10.283694] [DEBUG] [LOCAL ] RNGR: Loaded 20417 existing records from primary storage. [2025-09-18T21:26:10.283830] [INFO ] [MAIN ] RNGR: Loaded 20417 existing records. [2025-09-18T21:26:10.467257] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:26:10.467554] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-09-18T21:26:10.467606] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-09-18T21:26:10.468510] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-09-18T21:26:10.468572] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-09-18T21:26:10.742728] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-18T21:26:10.853258] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:26:10.909181] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-18T21:26:10.919578] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-09-18T21:26:11.478117] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-18T21:26:11.719557] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-09-18T21:26:12.338775] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-18T21:26:12.519541] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-11. [2025-09-18T21:26:13.319520] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-09-18T21:26:13.613460] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T21:26:14.070077] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-18T21:26:14.119592] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-09-18T21:26:14.919535] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-09-18T21:26:14.958927] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T21:26:15.592095] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-18T21:26:15.719566] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-09-18T21:26:16.519560] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-09-18T21:26:16.625584] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-18T21:26:17.319560] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-09-18T21:26:18.090501] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-18T21:26:18.119498] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-09-18T21:26:18.202976] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-18T21:26:18.919557] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-09-18T21:26:19.719503] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-09-18T21:26:19.760480] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-18T21:26:19.796579] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-18T21:26:20.519561] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-09-18T21:26:20.641112] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-18T21:26:20.940198] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-18T21:26:20.941383] [INFO ] [REMOTE ] RMMZ: Full fetch complete (7277 records). [2025-09-18T21:26:20.941471] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-09-18T21:26:21.307784] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-09-18T21:26:21.307905] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-09-18T21:26:21.308111] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-09-18T21:26:21.308168] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-09-18T21:26:21.308618] [DEBUG] [LOCAL ] RMMZ: Trimmed 7277 records to 4843 (keeping 200 days of data) [2025-09-18T21:26:21.330396] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-09-18T21:26:21.340459] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4843 records). [2025-09-18T21:26:21.340540] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-09-18T21:26:21.340673] [INFO ] [MAIN ] Update Progress: 1821/2372 symbols completed. RMMZ took 37.6s. Estimated remaining: 1h 20m 35s. Rate: 6.8 symbols/min [2025-09-18T21:26:21.511521] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:26:21.528795] [DEBUG] [LOCAL ] RNP: Loaded 15886 existing records from primary storage. [2025-09-18T21:26:21.528915] [INFO ] [MAIN ] RNP: Loaded 15886 existing records. [2025-09-18T21:26:21.707307] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:26:21.707574] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-09-18T21:26:21.707624] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-09-18T21:26:21.708261] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-09-18T21:26:21.708321] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-09-18T21:26:22.082156] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:26:22.119505] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-09-18T21:26:22.209278] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-18T21:26:22.919561] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-09-18T21:26:23.648230] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T21:26:23.719529] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-11. [2025-09-18T21:26:23.818002] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-18T21:26:24.519557] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-09-18T21:26:24.652614] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-18T21:26:25.260726] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-18T21:26:25.319542] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-09-18T21:26:26.119549] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-09-18T21:26:26.369814] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T21:26:26.919551] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-09-18T21:26:27.540028] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T21:26:27.692520] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-18T21:26:27.719498] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-09-18T21:26:28.497721] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-18T21:26:28.519510] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-09-18T21:26:29.319602] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-09-18T21:26:29.366096] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-18T21:26:29.368364] [INFO ] [REMOTE ] RMT: Full fetch complete (25493 records). [2025-09-18T21:26:29.368439] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-09-18T21:26:29.741929] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-09-18T21:26:29.742007] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-09-18T21:26:29.742521] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-09-18T21:26:29.742667] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-09-18T21:26:29.743689] [DEBUG] [LOCAL ] RMT: Trimmed 25493 records to 17886 (keeping 200 days of data) [2025-09-18T21:26:29.849459] [DEBUG] [LOCAL ] RMT: Primary data saved (17886 records). [2025-09-18T21:26:29.849599] [INFO ] [MAIN ] RMT: Full history saved. [2025-09-18T21:26:29.849714] [INFO ] [MAIN ] Update Progress: 1822/2372 symbols completed. RMT took 29.7s. Estimated remaining: 1h 20m 26s. Rate: 6.8 symbols/min [2025-09-18T21:26:30.026606] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:26:30.068567] [DEBUG] [LOCAL ] RNR: Loaded 34785 existing records from primary storage. [2025-09-18T21:26:30.068738] [INFO ] [MAIN ] RNR: Loaded 34785 existing records. [2025-09-18T21:26:30.124680] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-09-18T21:26:30.253515] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:26:30.253769] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-09-18T21:26:30.253824] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-09-18T21:26:30.254832] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-09-18T21:26:30.254895] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-09-18T21:26:30.611522] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:26:30.705760] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-18T21:26:30.919510] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-09-18T21:26:31.034752] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-18T21:26:31.719514] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-09-18T21:26:32.002158] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-18T21:26:32.519588] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-09-18T21:26:33.028823] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-18T21:26:33.319547] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-09-18T21:26:33.445666] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-18T21:26:34.119616] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-11. [2025-09-18T21:26:34.919576] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-09-18T21:26:35.085638] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-18T21:26:35.128439] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T21:26:35.495683] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-18T21:26:35.719565] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-09-18T21:26:36.519546] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-09-18T21:26:37.268514] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-18T21:26:37.286984] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-18T21:26:37.319502] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-09-18T21:26:38.126277] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-09-18T21:26:38.129147] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-18T21:26:38.919581] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-09-18T21:26:39.007451] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-18T21:26:39.719591] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-09-18T21:26:40.484676] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-18T21:26:40.502402] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-18T21:26:40.519497] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-09-18T21:26:41.319613] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-09-18T21:26:41.541097] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-18T21:26:42.119567] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-09-18T21:26:42.705236] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-18T21:26:42.827424] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-18T21:26:42.919499] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-09-18T21:26:43.719592] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-09-18T21:26:44.014530] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-18T21:26:44.519631] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-09-18T21:26:45.031064] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-18T21:26:45.319594] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-09-18T21:26:46.053685] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-18T21:26:46.119501] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-09-18T21:26:46.520620] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-18T21:26:46.919701] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-09-18T21:26:47.474403] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-18T21:26:47.483972] [INFO ] [REMOTE ] RNG: Full fetch complete (69329 records). [2025-09-18T21:26:47.484118] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-09-18T21:26:47.724629] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-09-18T21:26:47.897100] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-09-18T21:26:47.897183] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-09-18T21:26:47.898193] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-09-18T21:26:47.898319] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-09-18T21:26:47.899883] [DEBUG] [LOCAL ] RNG: Trimmed 69329 records to 48600 (keeping 200 days of data) [2025-09-18T21:26:48.217063] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-18T21:26:48.236105] [DEBUG] [LOCAL ] RNG: Primary data saved (48600 records). [2025-09-18T21:26:48.236212] [INFO ] [MAIN ] RNG: Full history saved. [2025-09-18T21:26:48.237070] [INFO ] [MAIN ] Update Progress: 1823/2372 symbols completed. RNG took 44.4s. Estimated remaining: 1h 20m 20s. Rate: 6.8 symbols/min [2025-09-18T21:26:48.391827] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-18T21:26:48.418777] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:26:48.419789] [INFO ] [REMOTE ] RNP: Full fetch complete (23498 records). [2025-09-18T21:26:48.419867] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-09-18T21:26:48.521738] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-09-18T21:26:48.756585] [DEBUG] [LOCAL ] RNST: Loaded 37354 existing records from primary storage. [2025-09-18T21:26:48.767914] [INFO ] [MAIN ] RNST: Loaded 37354 existing records. [2025-09-18T21:26:48.976220] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-09-18T21:26:48.981459] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-09-18T21:26:48.993703] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-09-18T21:26:48.998911] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-09-18T21:26:49.038389] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:26:49.038883] [DEBUG] [LOCAL ] RNP: Trimmed 23498 records to 15981 (keeping 200 days of data) [2025-09-18T21:26:49.038983] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-09-18T21:26:49.039077] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-09-18T21:26:49.040574] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-09-18T21:26:49.040674] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-09-18T21:26:49.327536] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-09-18T21:26:49.366770] [DEBUG] [LOCAL ] RNP: Primary data saved (15981 records). [2025-09-18T21:26:49.378122] [INFO ] [MAIN ] RNP: Full history saved. [2025-09-18T21:26:49.390932] [INFO ] [MAIN ] Update Progress: 1824/2372 symbols completed. RNP took 28.1s. Estimated remaining: 1h 20m 9s. Rate: 6.8 symbols/min [2025-09-18T21:26:49.667719] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:26:49.740978] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:26:49.766708] [DEBUG] [LOCAL ] ROG: Loaded 23482 existing records from primary storage. [2025-09-18T21:26:49.766852] [INFO ] [MAIN ] ROG: Loaded 23482 existing records. [2025-09-18T21:26:49.962171] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:26:49.962928] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-09-18T21:26:49.962996] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-09-18T21:26:49.971282] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-09-18T21:26:49.981488] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-09-18T21:26:50.070729] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-18T21:26:50.125236] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-11. [2025-09-18T21:26:50.578521] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:26:50.635507] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-18T21:26:50.919623] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-11. [2025-09-18T21:26:51.067948] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-18T21:26:51.572785] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-18T21:26:51.719596] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-09-18T21:26:52.519570] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-09-18T21:26:52.547743] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-18T21:26:53.319519] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-09-18T21:26:53.574962] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-18T21:26:54.045184] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-18T21:26:54.119537] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-09-18T21:26:54.919558] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-09-18T21:26:55.240382] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-18T21:26:55.719564] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-09-18T21:26:55.917317] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-18T21:26:56.519576] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-09-18T21:26:56.851978] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-18T21:26:57.319589] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-09-18T21:26:57.464535] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T21:26:58.119578] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-09-18T21:26:58.445811] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-18T21:26:58.919565] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-09-18T21:26:59.330040] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-18T21:26:59.719559] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-09-18T21:27:00.286914] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-18T21:27:00.519588] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-09-18T21:27:00.698915] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-18T21:27:01.147992] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-18T21:27:01.151017] [INFO ] [REMOTE ] RNGR: Full fetch complete (28413 records). [2025-09-18T21:27:01.151119] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-09-18T21:27:01.321389] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-09-18T21:27:01.607498] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-09-18T21:27:01.607923] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-09-18T21:27:01.608602] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-09-18T21:27:01.608692] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-09-18T21:27:01.609729] [DEBUG] [LOCAL ] RNGR: Trimmed 28413 records to 20620 (keeping 200 days of data) [2025-09-18T21:27:01.766331] [DEBUG] [LOCAL ] RNGR: Primary data saved (20620 records). [2025-09-18T21:27:01.766468] [INFO ] [MAIN ] RNGR: Full history saved. [2025-09-18T21:27:01.766668] [INFO ] [MAIN ] Update Progress: 1825/2372 symbols completed. RNGR took 51.7s. Estimated remaining: 1h 20m 1s. Rate: 6.8 symbols/min [2025-09-18T21:27:01.951845] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:27:02.003086] [DEBUG] [LOCAL ] ROK: Loaded 44212 existing records from primary storage. [2025-09-18T21:27:02.003245] [INFO ] [MAIN ] ROK: Loaded 44212 existing records. [2025-09-18T21:27:02.124764] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-09-18T21:27:02.201581] [WARN ] [MAIN ] ROK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:27:02.201917] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-09-18T21:27:02.201968] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-09-18T21:27:02.203268] [DEBUG] [LOCAL ] ROK: Deleted primary data file. [2025-09-18T21:27:02.203331] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-09-18T21:27:02.657620] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:27:02.919584] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-09-18T21:27:03.102458] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-18T21:27:03.107131] [INFO ] [REMOTE ] RNR: Full fetch complete (51436 records). [2025-09-18T21:27:03.107234] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-09-18T21:27:03.488871] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-09-18T21:27:03.488971] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-09-18T21:27:03.489862] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-09-18T21:27:03.489931] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-09-18T21:27:03.493215] [DEBUG] [LOCAL ] RNR: Trimmed 51436 records to 34997 (keeping 200 days of data) [2025-09-18T21:27:03.719785] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-11. [2025-09-18T21:27:03.741827] [DEBUG] [LOCAL ] RNR: Primary data saved (34997 records). [2025-09-18T21:27:03.742003] [INFO ] [MAIN ] RNR: Full history saved. [2025-09-18T21:27:03.742121] [INFO ] [MAIN ] Update Progress: 1826/2372 symbols completed. RNR took 33.9s. Estimated remaining: 1h 19m 50s. Rate: 6.8 symbols/min [2025-09-18T21:27:03.914818] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:27:03.967586] [DEBUG] [LOCAL ] ROL: Loaded 50296 existing records from primary storage. [2025-09-18T21:27:03.967785] [INFO ] [MAIN ] ROL: Loaded 50296 existing records. [2025-09-18T21:27:04.154942] [WARN ] [MAIN ] ROL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:27:04.155214] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-09-18T21:27:04.155265] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-09-18T21:27:04.156463] [DEBUG] [LOCAL ] ROL: Deleted primary data file. [2025-09-18T21:27:04.156526] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-09-18T21:27:04.539674] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:27:04.540012] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-11. [2025-09-18T21:27:04.635027] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-18T21:27:05.035622] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-18T21:27:05.290283] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-18T21:27:05.319565] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-09-18T21:27:05.968973] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T21:27:06.119560] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-09-18T21:27:06.171224] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-18T21:27:06.919552] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-09-18T21:27:07.580793] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-18T21:27:07.708041] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-18T21:27:07.719494] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-09-18T21:27:08.519532] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-09-18T21:27:08.685224] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-18T21:27:09.319567] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-09-18T21:27:10.024545] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T21:27:10.119537] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-09-18T21:27:10.774744] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-18T21:27:10.919537] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-09-18T21:27:11.719612] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-09-18T21:27:11.759053] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T21:27:12.115217] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-18T21:27:12.478979] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-18T21:27:12.481992] [INFO ] [REMOTE ] ROG: Full fetch complete (30721 records). [2025-09-18T21:27:12.482126] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-09-18T21:27:12.524847] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-09-18T21:27:12.872343] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-09-18T21:27:12.872461] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-09-18T21:27:12.873256] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-09-18T21:27:12.873335] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-09-18T21:27:12.875303] [DEBUG] [LOCAL ] ROG: Trimmed 30721 records to 23600 (keeping 200 days of data) [2025-09-18T21:27:13.026868] [DEBUG] [LOCAL ] ROG: Primary data saved (23600 records). [2025-09-18T21:27:13.027016] [INFO ] [MAIN ] ROG: Full history saved. [2025-09-18T21:27:13.027121] [INFO ] [MAIN ] Update Progress: 1827/2372 symbols completed. ROG took 23.6s. Estimated remaining: 1h 19m 42s. Rate: 6.8 symbols/min [2025-09-18T21:27:13.202329] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:27:13.244703] [DEBUG] [LOCAL ] RPM: Loaded 41074 existing records from primary storage. [2025-09-18T21:27:13.244858] [INFO ] [MAIN ] RPM: Loaded 41074 existing records. [2025-09-18T21:27:13.324744] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-09-18T21:27:13.433715] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:27:13.434048] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-09-18T21:27:13.434105] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-09-18T21:27:13.435411] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-09-18T21:27:13.435473] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-09-18T21:27:13.803356] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:27:14.119636] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-09-18T21:27:14.509402] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-18T21:27:14.919625] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-11. [2025-09-18T21:27:15.719717] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-09-18T21:27:15.920975] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-18T21:27:16.348627] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T21:27:16.505085] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-18T21:27:16.519516] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-09-18T21:27:17.063826] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-18T21:27:17.319550] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-09-18T21:27:17.804478] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-18T21:27:18.119584] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-09-18T21:27:18.919616] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-09-18T21:27:19.186396] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-18T21:27:19.222283] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-18T21:27:19.719562] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-09-18T21:27:20.143859] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-18T21:27:20.519628] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-09-18T21:27:21.270084] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-18T21:27:21.319500] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-09-18T21:27:21.985627] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-18T21:27:22.119504] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-09-18T21:27:22.537322] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-18T21:27:22.919585] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-09-18T21:27:23.289847] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-18T21:27:23.719598] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-09-18T21:27:24.424722] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-18T21:27:24.519567] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-09-18T21:27:25.052303] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T21:27:25.319576] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-09-18T21:27:26.119524] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-09-18T21:27:26.288559] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-18T21:27:26.706221] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-18T21:27:26.919545] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-09-18T21:27:27.297327] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-18T21:27:27.302284] [INFO ] [REMOTE ] RNST: Full fetch complete (52702 records). [2025-09-18T21:27:27.302382] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-09-18T21:27:27.693774] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-09-18T21:27:27.693876] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-09-18T21:27:27.694789] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-09-18T21:27:27.694852] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-09-18T21:27:27.696115] [DEBUG] [LOCAL ] RNST: Trimmed 52702 records to 37630 (keeping 200 days of data) [2025-09-18T21:27:27.751481] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-09-18T21:27:27.943695] [DEBUG] [LOCAL ] RNST: Primary data saved (37630 records). [2025-09-18T21:27:27.943861] [INFO ] [MAIN ] RNST: Full history saved. [2025-09-18T21:27:27.944445] [INFO ] [MAIN ] Update Progress: 1828/2372 symbols completed. RNST took 39.7s. Estimated remaining: 1h 19m 35s. Rate: 6.8 symbols/min [2025-09-18T21:27:28.120927] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:27:28.121091] [DEBUG] [LOCAL ] RPT: No existing data file found in primary storage. [2025-09-18T21:27:28.121132] [WARN ] [MAIN ] RPT: No existing data found, performing full refresh instead. [2025-09-18T21:27:28.121302] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-09-18T21:27:28.121347] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-09-18T21:27:28.121390] [DEBUG] [LOCAL ] RPT: No primary data file found to delete. [2025-09-18T21:27:28.121423] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-09-18T21:27:28.492068] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:27:28.519486] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-11. [2025-09-18T21:27:28.549777] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-18T21:27:28.752858] [DEBUG] [REMOTE ] RPT: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:27:28.753184] [WARN ] [REMOTE ] RPT: No data returned for month 2024-11 [2025-09-18T21:27:29.319549] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-09-18T21:27:29.558844] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-18T21:27:30.119538] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-09-18T21:27:30.143839] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-18T21:27:30.919526] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-09-18T21:27:30.960068] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-18T21:27:31.719535] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-09-18T21:27:32.519556] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-09-18T21:27:32.833810] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-18T21:27:32.872055] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T21:27:33.319548] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-09-18T21:27:33.741195] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-18T21:27:33.748536] [INFO ] [REMOTE ] ROL: Full fetch complete (72406 records). [2025-09-18T21:27:33.748760] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-09-18T21:27:34.125585] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-09-18T21:27:34.166868] [DEBUG] [VALIDATOR ] ROL: All expected trading days are present. [2025-09-18T21:27:34.167021] [DEBUG] [VALIDATOR ] ROL: Primary data validation passed. [2025-09-18T21:27:34.168119] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-09-18T21:27:34.168198] [DEBUG] [LOCAL ] ROL: Saving primary data. [2025-09-18T21:27:34.181497] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-18T21:27:34.188554] [DEBUG] [LOCAL ] ROL: Trimmed 72406 records to 50671 (keeping 200 days of data) [2025-09-18T21:27:34.498969] [DEBUG] [LOCAL ] ROL: Primary data saved (50671 records). [2025-09-18T21:27:34.499121] [INFO ] [MAIN ] ROL: Full history saved. [2025-09-18T21:27:34.499221] [INFO ] [MAIN ] Update Progress: 1829/2372 symbols completed. ROL took 30.8s. Estimated remaining: 1h 19m 25s. Rate: 6.8 symbols/min [2025-09-18T21:27:34.668495] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:27:34.668729] [DEBUG] [LOCAL ] RQI: No existing data file found in primary storage. [2025-09-18T21:27:34.668785] [WARN ] [MAIN ] RQI: No existing data found, performing full refresh instead. [2025-09-18T21:27:34.668985] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-09-18T21:27:34.669035] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-09-18T21:27:34.669078] [DEBUG] [LOCAL ] RQI: No primary data file found to delete. [2025-09-18T21:27:34.669112] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-09-18T21:27:34.924768] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-09-18T21:27:35.023934] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:27:35.719540] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-11. [2025-09-18T21:27:35.774685] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-18T21:27:35.820473] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-18T21:27:36.519576] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-09-18T21:27:36.694899] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-18T21:27:37.319564] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-09-18T21:27:37.943247] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-18T21:27:38.119603] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-09-18T21:27:38.369635] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T21:27:38.844639] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-18T21:27:38.919560] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-09-18T21:27:39.719548] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-09-18T21:27:40.519623] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-09-18T21:27:40.694804] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-18T21:27:41.151594] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T21:27:41.235362] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-18T21:27:41.319548] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-09-18T21:27:42.119566] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-09-18T21:27:42.590086] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-18T21:27:42.919599] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-09-18T21:27:43.411132] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-18T21:27:43.719570] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-09-18T21:27:44.291855] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-18T21:27:44.519551] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-09-18T21:27:44.661917] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-18T21:27:45.319545] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-09-18T21:27:45.667900] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-18T21:27:45.673153] [INFO ] [REMOTE ] RPM: Full fetch complete (58416 records). [2025-09-18T21:27:45.673263] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-09-18T21:27:46.057716] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-09-18T21:27:46.057817] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-09-18T21:27:46.058756] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-09-18T21:27:46.058826] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-09-18T21:27:46.060197] [DEBUG] [LOCAL ] RPM: Trimmed 58416 records to 41355 (keeping 200 days of data) [2025-09-18T21:27:46.124386] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-09-18T21:27:46.328057] [DEBUG] [LOCAL ] RPM: Primary data saved (41355 records). [2025-09-18T21:27:46.328195] [INFO ] [MAIN ] RPM: Full history saved. [2025-09-18T21:27:46.328277] [INFO ] [MAIN ] Update Progress: 1830/2372 symbols completed. RPM took 33.3s. Estimated remaining: 1h 19m 17s. Rate: 6.8 symbols/min [2025-09-18T21:27:46.503921] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:27:46.554400] [DEBUG] [LOCAL ] RRC: Loaded 52777 existing records from primary storage. [2025-09-18T21:27:46.554570] [INFO ] [MAIN ] RRC: Loaded 52777 existing records. [2025-09-18T21:27:46.738229] [WARN ] [MAIN ] RRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:27:46.738735] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-09-18T21:27:46.738817] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-09-18T21:27:46.740038] [DEBUG] [LOCAL ] RRC: Deleted primary data file. [2025-09-18T21:27:46.740101] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-09-18T21:27:46.928148] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-09-18T21:27:47.063614] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-18T21:27:47.183548] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:27:47.195346] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-18T21:27:47.719557] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-11. [2025-09-18T21:27:48.015859] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-18T21:27:48.519597] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-09-18T21:27:49.322584] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-09-18T21:27:49.328713] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-18T21:27:49.978797] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T21:27:50.121676] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-09-18T21:27:50.128312] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-18T21:27:50.919594] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-09-18T21:27:51.550726] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T21:27:51.719531] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-09-18T21:27:52.316362] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-18T21:27:52.519563] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-09-18T21:27:52.742757] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-18T21:27:53.319606] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-09-18T21:27:54.034303] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T21:27:54.119544] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-09-18T21:27:54.496414] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-18T21:27:54.919554] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-09-18T21:27:55.611024] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T21:27:55.719547] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-09-18T21:27:56.447146] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T21:27:56.519539] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-09-18T21:27:57.319597] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-09-18T21:27:57.645325] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-18T21:27:57.673853] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-18T21:27:58.119543] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-09-18T21:27:58.128194] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-18T21:27:58.131118] [INFO ] [REMOTE ] RPT: Full fetch complete (28425 records). [2025-09-18T21:27:58.131205] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-09-18T21:27:58.328980] [WARN ] [VALIDATOR ] RPT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-18T21:27:58.329414] [FATAL] [MAIN ] RPT: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:27:58.329486] [WARN ] [MAIN ] RPT: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:27:58.329558] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-09-18T21:27:58.329637] [DEBUG] [LOCAL ] RPT: No primary data file found to delete. [2025-09-18T21:27:58.329730] [INFO ] [LOCAL ] RPT: Starting deletion of derivative data. [2025-09-18T21:27:58.329818] [DEBUG] [LOCAL ] RPT: No derivative data file found to delete. [2025-09-18T21:27:58.329923] [INFO ] [MAIN ] Update Progress: 1831/2372 symbols completed. RPT took 30.4s. Estimated remaining: 1h 19m 10s. Rate: 6.8 symbols/min [2025-09-18T21:27:58.504167] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:27:58.551239] [DEBUG] [LOCAL ] RRX: Loaded 41158 existing records from primary storage. [2025-09-18T21:27:58.551384] [INFO ] [MAIN ] RRX: Loaded 41158 existing records. [2025-09-18T21:27:58.735930] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:27:58.736207] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-09-18T21:27:58.736256] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-09-18T21:27:58.737216] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-09-18T21:27:58.737279] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-09-18T21:27:58.928414] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-09-18T21:27:59.109335] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:27:59.351325] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-18T21:27:59.356563] [INFO ] [REMOTE ] RQI: Full fetch complete (43074 records). [2025-09-18T21:27:59.356697] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-09-18T21:27:59.725118] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-09-18T21:27:59.751167] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-09-18T21:27:59.751267] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-09-18T21:27:59.752166] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-09-18T21:27:59.752379] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-09-18T21:27:59.753546] [DEBUG] [LOCAL ] RQI: Trimmed 43074 records to 29386 (keeping 200 days of data) [2025-09-18T21:27:59.939908] [DEBUG] [LOCAL ] RQI: Primary data saved (29386 records). [2025-09-18T21:27:59.940113] [INFO ] [MAIN ] RQI: Full history saved. [2025-09-18T21:27:59.940232] [INFO ] [MAIN ] Update Progress: 1832/2372 symbols completed. RQI took 25.4s. Estimated remaining: 1h 18m 59s. Rate: 6.8 symbols/min [2025-09-18T21:28:00.118297] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:28:00.145529] [DEBUG] [LOCAL ] RS: Loaded 25896 existing records from primary storage. [2025-09-18T21:28:00.145707] [INFO ] [MAIN ] RS: Loaded 25896 existing records. [2025-09-18T21:28:00.324968] [WARN ] [MAIN ] RS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:28:00.325236] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-09-18T21:28:00.325286] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-09-18T21:28:00.326131] [DEBUG] [LOCAL ] RS: Deleted primary data file. [2025-09-18T21:28:00.326194] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-09-18T21:28:00.525535] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-11. [2025-09-18T21:28:00.704782] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:28:00.731446] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-18T21:28:01.319581] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-09-18T21:28:01.822180] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-18T21:28:01.863754] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-18T21:28:02.119600] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-09-18T21:28:02.483893] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-18T21:28:02.489534] [INFO ] [REMOTE ] ROK: Full fetch complete (63403 records). [2025-09-18T21:28:02.489674] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-09-18T21:28:02.905495] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-09-18T21:28:02.905585] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-09-18T21:28:02.906591] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-09-18T21:28:02.906681] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-09-18T21:28:02.907951] [DEBUG] [LOCAL ] ROK: Trimmed 63403 records to 44486 (keeping 200 days of data) [2025-09-18T21:28:02.967176] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-11. [2025-09-18T21:28:03.198970] [DEBUG] [LOCAL ] ROK: Primary data saved (44486 records). [2025-09-18T21:28:03.199116] [INFO ] [MAIN ] ROK: Full history saved. [2025-09-18T21:28:03.199205] [INFO ] [MAIN ] Update Progress: 1833/2372 symbols completed. ROK took 1m 1s. Estimated remaining: 1h 18m 48s. Rate: 6.8 symbols/min [2025-09-18T21:28:03.370817] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:28:03.378987] [DEBUG] [LOCAL ] RSF: Loaded 4162 existing records from primary storage. [2025-09-18T21:28:03.379093] [INFO ] [MAIN ] RSF: Loaded 4162 existing records. [2025-09-18T21:28:03.584203] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:28:03.584774] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-09-18T21:28:03.584931] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-09-18T21:28:03.585265] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-09-18T21:28:03.585345] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-09-18T21:28:03.724506] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-09-18T21:28:03.953913] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:28:03.987396] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-18T21:28:04.023304] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-18T21:28:04.519556] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-09-18T21:28:05.314934] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-18T21:28:05.322010] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-11. [2025-09-18T21:28:05.492845] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-18T21:28:05.649947] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-18T21:28:06.119542] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-09-18T21:28:06.659047] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-18T21:28:06.919622] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-09-18T21:28:07.719558] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-09-18T21:28:08.239194] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-18T21:28:08.519692] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-09-18T21:28:09.304304] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T21:28:09.319502] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-09-18T21:28:10.119618] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-09-18T21:28:10.314026] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-18T21:28:10.388121] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-18T21:28:10.919617] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-09-18T21:28:11.278198] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-18T21:28:11.278983] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-18T21:28:11.719573] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-09-18T21:28:12.138624] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-18T21:28:12.519581] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-09-18T21:28:12.981873] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-18T21:28:13.319589] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-09-18T21:28:14.119604] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-09-18T21:28:14.692126] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-18T21:28:14.916121] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-18T21:28:14.924510] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-09-18T21:28:15.719537] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-09-18T21:28:16.519535] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-09-18T21:28:16.561342] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-18T21:28:16.872474] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-18T21:28:17.319635] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-09-18T21:28:17.924016] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-18T21:28:17.926954] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-18T21:28:18.119571] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-09-18T21:28:18.919558] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-09-18T21:28:19.454559] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-18T21:28:19.620465] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-18T21:28:19.719555] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-09-18T21:28:20.519558] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-09-18T21:28:21.116969] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-18T21:28:21.319602] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-09-18T21:28:21.465742] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-18T21:28:21.762627] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-18T21:28:22.119589] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-09-18T21:28:22.919564] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-09-18T21:28:23.057839] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-18T21:28:23.414362] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-18T21:28:23.415491] [INFO ] [REMOTE ] RSF: Full fetch complete (5595 records). [2025-09-18T21:28:23.415561] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-09-18T21:28:23.727463] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-09-18T21:28:23.817460] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-09-18T21:28:23.817567] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-09-18T21:28:23.817804] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-09-18T21:28:23.817879] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-09-18T21:28:23.818308] [DEBUG] [LOCAL ] RSF: Trimmed 5595 records to 4178 (keeping 200 days of data) [2025-09-18T21:28:23.845700] [DEBUG] [LOCAL ] RSF: Primary data saved (4178 records). [2025-09-18T21:28:23.845858] [INFO ] [MAIN ] RSF: Full history saved. [2025-09-18T21:28:23.845953] [INFO ] [MAIN ] Update Progress: 1834/2372 symbols completed. RSF took 20.6s. Estimated remaining: 1h 18m 43s. Rate: 6.8 symbols/min [2025-09-18T21:28:24.019681] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:28:24.071297] [DEBUG] [LOCAL ] RSG: Loaded 47462 existing records from primary storage. [2025-09-18T21:28:24.071498] [INFO ] [MAIN ] RSG: Loaded 47462 existing records. [2025-09-18T21:28:24.250895] [WARN ] [MAIN ] RSG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:28:24.251195] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-09-18T21:28:24.251244] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-09-18T21:28:24.252402] [DEBUG] [LOCAL ] RSG: Deleted primary data file. [2025-09-18T21:28:24.252464] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-09-18T21:28:24.524704] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-09-18T21:28:24.617704] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:28:25.132287] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-18T21:28:25.319550] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-09-18T21:28:25.773356] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-18T21:28:26.119564] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-09-18T21:28:26.463055] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-18T21:28:26.919563] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-09-18T21:28:27.719616] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-09-18T21:28:27.817366] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-18T21:28:28.330199] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-18T21:28:28.519536] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-09-18T21:28:28.799835] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-18T21:28:29.319561] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-09-18T21:28:29.915012] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-18T21:28:29.922415] [INFO ] [REMOTE ] RRC: Full fetch complete (76031 records). [2025-09-18T21:28:29.922622] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-09-18T21:28:30.141905] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-09-18T21:28:30.260389] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-18T21:28:30.313213] [INFO ] [REMOTE ] RS: Full fetch complete (39357 records). [2025-09-18T21:28:30.330716] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-09-18T21:28:30.433451] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-09-18T21:28:30.449543] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-09-18T21:28:30.461801] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-09-18T21:28:30.461911] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-09-18T21:28:30.525056] [DEBUG] [LOCAL ] RRC: Trimmed 76031 records to 53166 (keeping 200 days of data) [2025-09-18T21:28:30.866566] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-09-18T21:28:30.867197] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-09-18T21:28:30.868124] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-09-18T21:28:30.868528] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-09-18T21:28:30.872060] [DEBUG] [LOCAL ] RS: Trimmed 39357 records to 26060 (keeping 200 days of data) [2025-09-18T21:28:30.927803] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-11. [2025-09-18T21:28:31.288744] [DEBUG] [LOCAL ] RRC: Primary data saved (53166 records). [2025-09-18T21:28:31.290066] [INFO ] [MAIN ] RRC: Full history saved. [2025-09-18T21:28:31.290476] [INFO ] [MAIN ] Update Progress: 1835/2372 symbols completed. RRC took 45.0s. Estimated remaining: 1h 18m 34s. Rate: 6.8 symbols/min [2025-09-18T21:28:31.391794] [DEBUG] [LOCAL ] RS: Primary data saved (26060 records). [2025-09-18T21:28:31.408084] [INFO ] [MAIN ] RS: Full history saved. [2025-09-18T21:28:31.408276] [INFO ] [MAIN ] Update Progress: 1836/2372 symbols completed. RS took 31.5s. Estimated remaining: 1h 18m 23s. Rate: 6.8 symbols/min [2025-09-18T21:28:31.599455] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:28:31.615529] [DEBUG] [LOCAL ] RSI: No existing data file found in primary storage. [2025-09-18T21:28:31.625930] [WARN ] [MAIN ] RSI: No existing data found, performing full refresh instead. [2025-09-18T21:28:31.653859] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-09-18T21:28:31.669802] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-09-18T21:28:31.673273] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-09-18T21:28:31.673360] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-09-18T21:28:31.673152] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:28:32.007219] [DEBUG] [LOCAL ] RSKD: Loaded 34243 existing records from primary storage. [2025-09-18T21:28:32.033694] [INFO ] [MAIN ] RSKD: Loaded 34243 existing records. [2025-09-18T21:28:32.093152] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:28:32.130057] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-11. [2025-09-18T21:28:32.312111] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:28:32.314959] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-18T21:28:32.315152] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-09-18T21:28:32.324056] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-09-18T21:28:32.325622] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-09-18T21:28:32.325739] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-09-18T21:28:32.522473] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-09-18T21:28:32.743986] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-18T21:28:32.742206] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:28:33.319562] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-11. [2025-09-18T21:28:33.692726] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-18T21:28:33.835519] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-18T21:28:33.841418] [INFO ] [REMOTE ] RRX: Full fetch complete (57809 records). [2025-09-18T21:28:33.841563] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-09-18T21:28:34.124932] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-09-18T21:28:34.228621] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-09-18T21:28:34.228747] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-09-18T21:28:34.229774] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-09-18T21:28:34.229837] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-09-18T21:28:34.231176] [DEBUG] [LOCAL ] RRX: Trimmed 57809 records to 41467 (keeping 200 days of data) [2025-09-18T21:28:34.535667] [DEBUG] [LOCAL ] RRX: Primary data saved (41467 records). [2025-09-18T21:28:34.535891] [INFO ] [MAIN ] RRX: Full history saved. [2025-09-18T21:28:34.537320] [INFO ] [MAIN ] Update Progress: 1837/2372 symbols completed. RRX took 36.2s. Estimated remaining: 1h 18m 12s. Rate: 6.8 symbols/min [2025-09-18T21:28:34.736540] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T21:28:34.919623] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-09-18T21:28:35.587707] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-18T21:28:35.719565] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-09-18T21:28:36.138798] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-18T21:28:36.519593] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-09-18T21:28:37.239630] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T21:28:37.319534] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-09-18T21:28:37.853714] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T21:28:38.119571] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-09-18T21:28:38.671305] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T21:28:38.919579] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-09-18T21:28:39.069749] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T21:28:39.719588] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-09-18T21:28:40.413930] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T21:28:40.519522] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-09-18T21:28:40.564102] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-18T21:28:41.319583] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-09-18T21:28:42.083532] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-18T21:28:42.119532] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-09-18T21:28:42.919580] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-09-18T21:28:43.032621] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-18T21:28:43.626168] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T21:28:43.719534] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-09-18T21:28:44.022052] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-18T21:28:44.519560] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-09-18T21:28:45.323183] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-09-18T21:28:45.328562] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-18T21:28:45.968589] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T21:28:46.119569] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-09-18T21:28:46.249426] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-18T21:28:46.919575] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-09-18T21:28:47.463276] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-18T21:28:47.719503] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-09-18T21:28:48.243051] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T21:28:48.519619] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-09-18T21:28:48.632597] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-18T21:28:49.319629] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-09-18T21:28:49.868133] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-18T21:28:50.119563] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-09-18T21:28:50.919593] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-09-18T21:28:51.039958] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-18T21:28:51.272718] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-18T21:28:51.719636] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-09-18T21:28:52.338794] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-18T21:28:52.519559] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-09-18T21:28:53.277018] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-18T21:28:53.319494] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-09-18T21:28:53.815439] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T21:28:54.119736] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-09-18T21:28:54.849300] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-18T21:28:54.919551] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-09-18T21:28:55.581512] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T21:28:55.588378] [INFO ] [REMOTE ] RSI: Full fetch complete (69396 records). [2025-09-18T21:28:55.588544] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-09-18T21:28:55.734078] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-09-18T21:28:55.991235] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-09-18T21:28:55.991341] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-09-18T21:28:55.992390] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-09-18T21:28:55.992457] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-09-18T21:28:55.994019] [DEBUG] [LOCAL ] RSI: Trimmed 69396 records to 47640 (keeping 200 days of data) [2025-09-18T21:28:56.245419] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T21:28:56.264866] [INFO ] [REMOTE ] RSG: Full fetch complete (67613 records). [2025-09-18T21:28:56.272779] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-09-18T21:28:56.496712] [DEBUG] [LOCAL ] RSI: Primary data saved (47640 records). [2025-09-18T21:28:56.516191] [INFO ] [MAIN ] RSI: Full history saved. [2025-09-18T21:28:56.518893] [INFO ] [MAIN ] Update Progress: 1838/2372 symbols completed. RSI took 25.2s. Estimated remaining: 1h 18m 7s. Rate: 6.8 symbols/min [2025-09-18T21:28:56.750584] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-09-18T21:28:56.750702] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-09-18T21:28:56.751697] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-09-18T21:28:56.751762] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-09-18T21:28:56.753478] [DEBUG] [LOCAL ] RSG: Trimmed 67613 records to 47819 (keeping 200 days of data) [2025-09-18T21:28:57.055955] [DEBUG] [LOCAL ] RSG: Primary data saved (47819 records). [2025-09-18T21:28:57.056094] [INFO ] [MAIN ] RSG: Full history saved. [2025-09-18T21:28:57.057459] [INFO ] [MAIN ] Update Progress: 1839/2372 symbols completed. RSG took 33.2s. Estimated remaining: 1h 17m 56s. Rate: 6.8 symbols/min [2025-09-18T21:28:57.208397] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-18T21:28:57.216967] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-09-18T21:28:58.430868] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-18T21:28:58.438824] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-09-18T21:28:59.489177] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-18T21:28:59.494410] [INFO ] [REMOTE ] RSKD: Full fetch complete (48389 records). [2025-09-18T21:28:59.494581] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-09-18T21:28:59.897236] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-09-18T21:28:59.897446] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-09-18T21:28:59.899567] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-09-18T21:28:59.899699] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-09-18T21:28:59.903490] [DEBUG] [LOCAL ] RSKD: Trimmed 48389 records to 34536 (keeping 200 days of data) [2025-09-18T21:29:00.126698] [DEBUG] [LOCAL ] RSKD: Primary data saved (34536 records). [2025-09-18T21:29:00.126933] [INFO ] [MAIN ] RSKD: Full history saved. [2025-09-18T21:29:00.127300] [INFO ] [MAIN ] Update Progress: 1840/2372 symbols completed. RSKD took 28.7s. Estimated remaining: 1h 17m 46s. Rate: 6.8 symbols/min [2025-09-18T21:29:00.755772] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:29:00.944072] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:29:00.905468] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:29:00.945364] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:29:01.032566] [DEBUG] [LOCAL ] RVT: Loaded 27420 existing records from primary storage. [2025-09-18T21:29:01.032788] [INFO ] [MAIN ] RVT: Loaded 27420 existing records. [2025-09-18T21:29:01.220225] [DEBUG] [LOCAL ] RVLV: Loaded 48014 existing records from primary storage. [2025-09-18T21:29:01.219463] [DEBUG] [LOCAL ] RTO: Loaded 40670 existing records from primary storage. [2025-09-18T21:29:01.261951] [INFO ] [MAIN ] RTO: Loaded 40670 existing records. [2025-09-18T21:29:01.251906] [INFO ] [MAIN ] RVLV: Loaded 48014 existing records. [2025-09-18T21:29:01.256603] [DEBUG] [LOCAL ] RTX: Loaded 53712 existing records from primary storage. [2025-09-18T21:29:01.365712] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:29:01.360423] [INFO ] [MAIN ] RTX: Loaded 53712 existing records. [2025-09-18T21:29:01.444547] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-09-18T21:29:01.548044] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-09-18T21:29:01.578687] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-09-18T21:29:01.599303] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-09-18T21:29:01.869736] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:29:01.879843] [WARN ] [MAIN ] RTX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:29:01.925895] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:29:01.925799] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-09-18T21:29:01.941742] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-09-18T21:29:01.952258] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-09-18T21:29:01.952321] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-09-18T21:29:01.957569] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-09-18T21:29:01.965229] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-09-18T21:29:01.969216] [DEBUG] [LOCAL ] RTX: Deleted primary data file. [2025-09-18T21:29:01.969428] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-09-18T21:29:01.985826] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-09-18T21:29:01.995479] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-09-18T21:29:02.021159] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-09-18T21:29:02.031678] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-09-18T21:29:03.141673] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:29:03.230691] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-11. [2025-09-18T21:29:03.319564] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:29:03.328769] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-11. [2025-09-18T21:29:03.390752] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:29:03.426715] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-11. [2025-09-18T21:29:03.468225] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:29:03.468514] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-11. [2025-09-18T21:29:04.646862] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T21:29:04.652966] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-09-18T21:29:04.848393] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-18T21:29:04.857118] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-09-18T21:29:04.947323] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-18T21:29:04.956715] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-09-18T21:29:05.355385] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-11 (2.03 seconds). [2025-09-18T21:29:05.365662] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-09-18T21:29:05.573954] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-18T21:29:05.581226] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-09-18T21:29:06.046530] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-18T21:29:06.054846] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-09-18T21:29:06.534919] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T21:29:06.541338] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-09-18T21:29:06.646315] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-18T21:29:06.919695] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-09-18T21:29:07.254579] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T21:29:07.341397] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-18T21:29:07.417335] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-18T21:29:07.719594] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-09-18T21:29:08.222876] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-18T21:29:08.519584] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-09-18T21:29:08.924287] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-18T21:29:09.319552] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-09-18T21:29:10.119602] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-09-18T21:29:10.594175] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-18T21:29:10.656300] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-18T21:29:10.919553] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-09-18T21:29:11.036181] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-18T21:29:11.719547] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-09-18T21:29:12.321578] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-18T21:29:12.519548] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-09-18T21:29:13.319577] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-09-18T21:29:13.383604] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-18T21:29:14.119609] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-09-18T21:29:14.254578] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-18T21:29:14.552928] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-18T21:29:14.919603] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-09-18T21:29:15.589460] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-18T21:29:15.719492] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-09-18T21:29:15.748864] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-18T21:29:16.519553] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-09-18T21:29:17.319556] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-09-18T21:29:17.504121] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-18T21:29:17.653285] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-18T21:29:18.119553] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-09-18T21:29:18.383977] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-18T21:29:18.919553] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-09-18T21:29:19.719581] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-09-18T21:29:20.200335] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-18T21:29:20.277974] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-18T21:29:20.505077] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T21:29:20.519517] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-09-18T21:29:21.319598] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-09-18T21:29:21.604281] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-18T21:29:21.608638] [INFO ] [REMOTE ] RVT: Full fetch complete (40240 records). [2025-09-18T21:29:21.608758] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-09-18T21:29:22.002816] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-09-18T21:29:22.003136] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-09-18T21:29:22.003960] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-09-18T21:29:22.004024] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-09-18T21:29:22.005025] [DEBUG] [LOCAL ] RVT: Trimmed 40240 records to 27715 (keeping 200 days of data) [2025-09-18T21:29:22.119703] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-09-18T21:29:22.183849] [DEBUG] [LOCAL ] RVT: Primary data saved (27715 records). [2025-09-18T21:29:22.183997] [INFO ] [MAIN ] RVT: Full history saved. [2025-09-18T21:29:22.184101] [INFO ] [MAIN ] Update Progress: 1841/2372 symbols completed. RVT took 22.1s. Estimated remaining: 1h 17m 41s. Rate: 6.8 symbols/min [2025-09-18T21:29:22.357359] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:29:22.404378] [DEBUG] [LOCAL ] RVTY: Loaded 47610 existing records from primary storage. [2025-09-18T21:29:22.404544] [INFO ] [MAIN ] RVTY: Loaded 47610 existing records. [2025-09-18T21:29:22.590136] [WARN ] [MAIN ] RVTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:29:22.590512] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-09-18T21:29:22.590567] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-09-18T21:29:22.592130] [DEBUG] [LOCAL ] RVTY: Deleted primary data file. [2025-09-18T21:29:22.592196] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-09-18T21:29:22.926824] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-09-18T21:29:22.958314] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:29:23.172391] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-18T21:29:23.719539] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-09-18T21:29:23.937685] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-18T21:29:24.322530] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-18T21:29:24.519526] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-09-18T21:29:24.962340] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-18T21:29:25.319547] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-09-18T21:29:25.639090] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-18T21:29:26.119571] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-09-18T21:29:26.644264] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-18T21:29:26.919540] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-09-18T21:29:27.397452] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-18T21:29:27.719698] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-09-18T21:29:28.519575] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-09-18T21:29:29.030789] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-18T21:29:29.069760] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-18T21:29:29.319585] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-09-18T21:29:30.005927] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T21:29:30.012594] [INFO ] [REMOTE ] RVLV: Full fetch complete (68806 records). [2025-09-18T21:29:30.012762] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-09-18T21:29:30.125632] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-11. [2025-09-18T21:29:30.454969] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-09-18T21:29:30.455085] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-09-18T21:29:30.456237] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-09-18T21:29:30.456306] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-09-18T21:29:30.458054] [DEBUG] [LOCAL ] RVLV: Trimmed 68806 records to 48377 (keeping 200 days of data) [2025-09-18T21:29:30.749291] [DEBUG] [LOCAL ] RVLV: Primary data saved (48377 records). [2025-09-18T21:29:30.749436] [INFO ] [MAIN ] RVLV: Full history saved. [2025-09-18T21:29:30.749563] [INFO ] [MAIN ] Update Progress: 1842/2372 symbols completed. RVLV took 30.6s. Estimated remaining: 1h 17m 32s. Rate: 6.8 symbols/min [2025-09-18T21:29:30.917693] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:29:30.919713] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-09-18T21:29:30.955967] [DEBUG] [LOCAL ] RWT: Loaded 40527 existing records from primary storage. [2025-09-18T21:29:30.956120] [INFO ] [MAIN ] RWT: Loaded 40527 existing records. [2025-09-18T21:29:31.137227] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:29:31.137587] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-09-18T21:29:31.137694] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-09-18T21:29:31.138753] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-09-18T21:29:31.138820] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-09-18T21:29:31.505046] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:29:31.672199] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-18T21:29:31.724599] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-09-18T21:29:31.741058] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-18T21:29:32.016946] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-18T21:29:32.022394] [INFO ] [REMOTE ] RTO: Full fetch complete (58387 records). [2025-09-18T21:29:32.022519] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-09-18T21:29:32.399689] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-09-18T21:29:32.399776] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-09-18T21:29:32.400683] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-09-18T21:29:32.400745] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-09-18T21:29:32.402143] [DEBUG] [LOCAL ] RTO: Trimmed 58387 records to 40963 (keeping 200 days of data) [2025-09-18T21:29:32.519532] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-09-18T21:29:32.647323] [DEBUG] [LOCAL ] RTO: Primary data saved (40963 records). [2025-09-18T21:29:32.647439] [INFO ] [MAIN ] RTO: Full history saved. [2025-09-18T21:29:32.647520] [INFO ] [MAIN ] Update Progress: 1843/2372 symbols completed. RTO took 32.5s. Estimated remaining: 1h 17m 21s. Rate: 6.8 symbols/min [2025-09-18T21:29:32.819770] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:29:32.819977] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-09-18T21:29:32.820032] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-09-18T21:29:32.820193] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-09-18T21:29:32.820237] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-18T21:29:32.820279] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-18T21:29:32.820311] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-09-18T21:29:33.170307] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:29:33.319497] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-11. [2025-09-18T21:29:33.756767] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-18T21:29:33.848014] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T21:29:34.121068] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-09-18T21:29:34.123807] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-18T21:29:34.469500] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-18T21:29:34.919554] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-09-18T21:29:35.456853] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-18T21:29:35.719527] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-09-18T21:29:36.519612] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-09-18T21:29:36.948491] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-18T21:29:37.319561] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-09-18T21:29:37.763391] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-18T21:29:37.778798] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-18T21:29:38.119557] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-11. [2025-09-18T21:29:38.919553] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-09-18T21:29:39.385074] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T21:29:39.719609] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-09-18T21:29:40.519547] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-09-18T21:29:40.892712] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-18T21:29:40.893805] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-18T21:29:40.902444] [INFO ] [REMOTE ] RTX: Full fetch complete (77619 records). [2025-09-18T21:29:40.902554] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-09-18T21:29:41.326846] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-09-18T21:29:41.329712] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-09-18T21:29:41.329906] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-09-18T21:29:41.332350] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-09-18T21:29:41.332719] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-09-18T21:29:41.366228] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-18T21:29:41.364057] [DEBUG] [LOCAL ] RTX: Trimmed 77619 records to 54101 (keeping 200 days of data) [2025-09-18T21:29:41.714631] [DEBUG] [LOCAL ] RTX: Primary data saved (54101 records). [2025-09-18T21:29:41.714805] [INFO ] [MAIN ] RTX: Full history saved. [2025-09-18T21:29:41.714910] [INFO ] [MAIN ] Update Progress: 1844/2372 symbols completed. RTX took 41.6s. Estimated remaining: 1h 17m 12s. Rate: 6.8 symbols/min [2025-09-18T21:29:41.884348] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:29:41.884524] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-09-18T21:29:41.884564] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-09-18T21:29:41.884755] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-09-18T21:29:41.884804] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-18T21:29:41.884846] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-18T21:29:41.884878] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-09-18T21:29:42.127287] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-09-18T21:29:42.244496] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:29:42.852255] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-18T21:29:42.888442] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-18T21:29:42.919586] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-09-18T21:29:43.719614] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-09-18T21:29:44.519548] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-09-18T21:29:44.545604] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-18T21:29:44.874544] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-18T21:29:45.236472] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-18T21:29:45.319540] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-09-18T21:29:46.119627] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-09-18T21:29:46.485283] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-18T21:29:46.919277] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-18T21:29:46.922867] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-09-18T21:29:47.476696] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-18T21:29:47.719595] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-18T21:29:48.038936] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-18T21:29:48.040006] [INFO ] [REMOTE ] RWTN: Full fetch complete (3073 records). [2025-09-18T21:29:48.040079] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-09-18T21:29:48.231575] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-18T21:29:48.231858] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:29:48.231915] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:29:48.232000] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-18T21:29:48.232066] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-18T21:29:48.232101] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-09-18T21:29:48.232221] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-09-18T21:29:48.232317] [INFO ] [MAIN ] Update Progress: 1845/2372 symbols completed. RWTN took 15.6s. Estimated remaining: 1h 17m 3s. Rate: 6.8 symbols/min [2025-09-18T21:29:48.401678] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:29:48.401880] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-09-18T21:29:48.401919] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-09-18T21:29:48.402063] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-09-18T21:29:48.402104] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-18T21:29:48.402145] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-18T21:29:48.402177] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-09-18T21:29:48.524671] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-11. [2025-09-18T21:29:48.769584] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:29:49.057330] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-18T21:29:49.319563] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-09-18T21:29:50.119560] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-11. [2025-09-18T21:29:50.337066] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:29:50.337421] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-11 [2025-09-18T21:29:50.788360] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-18T21:29:50.919567] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-09-18T21:29:51.719551] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-09-18T21:29:52.113952] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-18T21:29:52.140157] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-18T21:29:52.519560] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-09-18T21:29:53.133638] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-18T21:29:53.319586] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-09-18T21:29:53.534123] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:29:53.534473] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-09-18T21:29:54.119563] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-09-18T21:29:54.560337] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-18T21:29:54.919562] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-09-18T21:29:55.719603] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-09-18T21:29:56.519581] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-09-18T21:29:56.711871] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-18T21:29:56.808138] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-18T21:29:57.071845] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-18T21:29:57.319584] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-01. [2025-09-18T21:29:57.684226] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-18T21:29:58.119616] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-02. [2025-09-18T21:29:58.805291] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-18T21:29:58.919564] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-09-18T21:29:59.719590] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-09-18T21:30:00.140929] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-18T21:30:00.519558] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-09-18T21:30:00.597459] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-18T21:30:01.319622] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-09-18T21:30:01.811106] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-18T21:30:02.119613] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-03. [2025-09-18T21:30:02.276372] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-18T21:30:02.500280] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-18T21:30:02.919563] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-04. [2025-09-18T21:30:03.571913] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-18T21:30:03.719563] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-09-18T21:30:04.121160] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-18T21:30:04.519609] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-09-18T21:30:05.103529] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-18T21:30:05.319582] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-09-18T21:30:05.831317] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-18T21:30:06.119583] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-18T21:30:06.571351] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-18T21:30:06.572626] [INFO ] [REMOTE ] RWTO: Full fetch complete (4686 records). [2025-09-18T21:30:06.572723] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-09-18T21:30:06.764384] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-18T21:30:06.764659] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:30:06.764729] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:30:06.764801] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-18T21:30:06.764889] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-18T21:30:06.764944] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-09-18T21:30:06.764988] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-09-18T21:30:06.765057] [INFO ] [MAIN ] Update Progress: 1846/2372 symbols completed. RWTO took 25.1s. Estimated remaining: 1h 16m 57s. Rate: 6.8 symbols/min [2025-09-18T21:30:06.938102] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-05. [2025-09-18T21:30:06.942187] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:30:06.991221] [DEBUG] [LOCAL ] RXO: Loaded 47726 existing records from primary storage. [2025-09-18T21:30:06.991373] [INFO ] [MAIN ] RXO: Loaded 47726 existing records. [2025-09-18T21:30:07.173069] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:30:07.173323] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-09-18T21:30:07.173372] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-09-18T21:30:07.174751] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-09-18T21:30:07.174816] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-09-18T21:30:07.557214] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:30:07.661863] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-18T21:30:07.719606] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-09-18T21:30:08.519559] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-09-18T21:30:09.319566] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-06. [2025-09-18T21:30:09.400705] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-18T21:30:09.593893] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-18T21:30:09.770684] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-18T21:30:10.119594] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-07. [2025-09-18T21:30:10.581196] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-18T21:30:10.919560] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-09-18T21:30:11.719579] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-11. [2025-09-18T21:30:12.519552] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-08. [2025-09-18T21:30:12.547499] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-18T21:30:12.872874] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-18T21:30:12.902383] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-18T21:30:13.319561] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-09. [2025-09-18T21:30:13.714639] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-18T21:30:13.715940] [INFO ] [REMOTE ] RWTP: Full fetch complete (4279 records). [2025-09-18T21:30:13.716022] [DEBUG] [VALIDATOR ] RWTP: Validating primary data. [2025-09-18T21:30:13.900173] [WARN ] [VALIDATOR ] RWTP: Validation failed - insufficient historical data. Have 160 unique days, need 200 days [2025-09-18T21:30:13.900386] [FATAL] [MAIN ] RWTP: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:30:13.900460] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:30:13.900532] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-18T21:30:13.900601] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-18T21:30:13.900668] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-09-18T21:30:13.900749] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-09-18T21:30:13.900810] [INFO ] [MAIN ] Update Progress: 1847/2372 symbols completed. RWTP took 25.7s. Estimated remaining: 1h 16m 48s. Rate: 6.8 symbols/min [2025-09-18T21:30:14.070084] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:30:14.118340] [DEBUG] [LOCAL ] RY: Loaded 48054 existing records from primary storage. [2025-09-18T21:30:14.118485] [INFO ] [MAIN ] RY: Loaded 48054 existing records. [2025-09-18T21:30:14.129276] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-09-18T21:30:14.300227] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:30:14.300467] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-09-18T21:30:14.300515] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-09-18T21:30:14.301908] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-09-18T21:30:14.301970] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-09-18T21:30:14.661925] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:30:14.919493] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-11. [2025-09-18T21:30:15.719571] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-09-18T21:30:15.857421] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-18T21:30:16.177784] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-18T21:30:16.519634] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-09-18T21:30:17.319591] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-09-18T21:30:17.357524] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-18T21:30:17.785247] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-18T21:30:17.846539] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-18T21:30:18.119542] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-09-18T21:30:18.919565] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-09-18T21:30:19.719542] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-09-18T21:30:19.946001] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-18T21:30:20.386121] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-18T21:30:20.391921] [INFO ] [REMOTE ] RWT: Full fetch complete (58299 records). [2025-09-18T21:30:20.392066] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-09-18T21:30:20.534053] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-09-18T21:30:20.788082] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-09-18T21:30:20.788186] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-09-18T21:30:20.789320] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-09-18T21:30:20.789389] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-09-18T21:30:20.790837] [DEBUG] [LOCAL ] RWT: Trimmed 58299 records to 40816 (keeping 200 days of data) [2025-09-18T21:30:21.033956] [DEBUG] [LOCAL ] RWT: Primary data saved (40816 records). [2025-09-18T21:30:21.034142] [INFO ] [MAIN ] RWT: Full history saved. [2025-09-18T21:30:21.034325] [INFO ] [MAIN ] Update Progress: 1848/2372 symbols completed. RWT took 50.3s. Estimated remaining: 1h 16m 39s. Rate: 6.8 symbols/min [2025-09-18T21:30:21.232380] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:30:21.268121] [DEBUG] [LOCAL ] RYAM: Loaded 35209 existing records from primary storage. [2025-09-18T21:30:21.268285] [INFO ] [MAIN ] RYAM: Loaded 35209 existing records. [2025-09-18T21:30:21.331299] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-09-18T21:30:21.471742] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:30:21.472022] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-09-18T21:30:21.472073] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-09-18T21:30:21.473224] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-09-18T21:30:21.473289] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-09-18T21:30:21.883785] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:30:21.925977] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-18T21:30:21.933592] [INFO ] [REMOTE ] RVTY: Full fetch complete (66202 records). [2025-09-18T21:30:21.933753] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-09-18T21:30:22.125371] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-11. [2025-09-18T21:30:22.336573] [DEBUG] [VALIDATOR ] RVTY: All expected trading days are present. [2025-09-18T21:30:22.336698] [DEBUG] [VALIDATOR ] RVTY: Primary data validation passed. [2025-09-18T21:30:22.337935] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-09-18T21:30:22.338007] [DEBUG] [LOCAL ] RVTY: Saving primary data. [2025-09-18T21:30:22.339665] [DEBUG] [LOCAL ] RVTY: Trimmed 66202 records to 47953 (keeping 200 days of data) [2025-09-18T21:30:22.595782] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-18T21:30:22.711829] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T21:30:22.729628] [DEBUG] [LOCAL ] RVTY: Primary data saved (47953 records). [2025-09-18T21:30:22.729818] [INFO ] [MAIN ] RVTY: Full history saved. [2025-09-18T21:30:22.729920] [INFO ] [MAIN ] Update Progress: 1849/2372 symbols completed. RVTY took 1m 1s. Estimated remaining: 1h 16m 28s. Rate: 6.8 symbols/min [2025-09-18T21:30:22.925700] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-09-18T21:30:22.925552] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:30:22.974203] [DEBUG] [LOCAL ] RYAN: Loaded 43954 existing records from primary storage. [2025-09-18T21:30:22.974456] [INFO ] [MAIN ] RYAN: Loaded 43954 existing records. [2025-09-18T21:30:23.199732] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:30:23.200031] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-09-18T21:30:23.200083] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-09-18T21:30:23.201284] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-09-18T21:30:23.201349] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-09-18T21:30:23.571633] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:30:23.592210] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-18T21:30:23.719545] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-09-18T21:30:24.528614] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-11. [2025-09-18T21:30:24.535289] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T21:30:24.652130] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-18T21:30:25.319542] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-09-18T21:30:25.697174] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-18T21:30:26.119558] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-09-18T21:30:26.807310] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T21:30:26.919597] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-09-18T21:30:27.487575] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-18T21:30:27.719715] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-09-18T21:30:27.978364] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-18T21:30:28.519617] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-09-18T21:30:29.320102] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-09-18T21:30:29.322669] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-18T21:30:29.397199] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-18T21:30:30.119632] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-09-18T21:30:30.919581] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-09-18T21:30:31.123086] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-18T21:30:31.245893] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-18T21:30:31.719555] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-09-18T21:30:32.341452] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-18T21:30:32.519586] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-09-18T21:30:32.952154] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-18T21:30:33.319583] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-09-18T21:30:33.881299] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-18T21:30:34.119542] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-09-18T21:30:34.919617] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-09-18T21:30:35.095757] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-18T21:30:35.670232] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-18T21:30:35.719513] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-09-18T21:30:36.135747] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T21:30:36.519577] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-09-18T21:30:37.319546] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-09-18T21:30:37.572813] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-18T21:30:37.779070] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-18T21:30:38.119602] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-09-18T21:30:38.620568] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T21:30:38.919599] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-09-18T21:30:39.575864] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T21:30:39.719630] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-09-18T21:30:40.504631] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-18T21:30:40.519504] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-09-18T21:30:40.976057] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-18T21:30:40.982709] [INFO ] [REMOTE ] RXO: Full fetch complete (67615 records). [2025-09-18T21:30:40.982852] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-09-18T21:30:41.329814] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-09-18T21:30:41.387950] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-09-18T21:30:41.388047] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-09-18T21:30:41.389148] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-09-18T21:30:41.389226] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-09-18T21:30:41.390699] [DEBUG] [LOCAL ] RXO: Trimmed 67615 records to 48105 (keeping 200 days of data) [2025-09-18T21:30:41.668680] [DEBUG] [LOCAL ] RXO: Primary data saved (48105 records). [2025-09-18T21:30:41.668828] [INFO ] [MAIN ] RXO: Full history saved. [2025-09-18T21:30:41.668940] [INFO ] [MAIN ] Update Progress: 1850/2372 symbols completed. RXO took 34.9s. Estimated remaining: 1h 16m 22s. Rate: 6.8 symbols/min [2025-09-18T21:30:41.840265] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:30:41.861226] [DEBUG] [LOCAL ] RYI: Loaded 21523 existing records from primary storage. [2025-09-18T21:30:41.861351] [INFO ] [MAIN ] RYI: Loaded 21523 existing records. [2025-09-18T21:30:42.044038] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:30:42.044536] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-09-18T21:30:42.044607] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-09-18T21:30:42.045507] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-09-18T21:30:42.045581] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-09-18T21:30:42.120499] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-09-18T21:30:42.420446] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:30:42.444435] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-18T21:30:42.880515] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-18T21:30:42.919519] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-09-18T21:30:43.675088] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-18T21:30:43.719496] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-09-18T21:30:43.983823] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-18T21:30:44.519569] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-09-18T21:30:44.841037] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-18T21:30:45.319558] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-09-18T21:30:46.005124] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-18T21:30:46.119534] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-09-18T21:30:46.273018] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-18T21:30:46.919587] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-09-18T21:30:47.373235] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-18T21:30:47.719567] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-09-18T21:30:47.970997] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-18T21:30:48.519547] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-11. [2025-09-18T21:30:48.934356] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-18T21:30:49.319564] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-09-18T21:30:49.693710] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-18T21:30:50.119562] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-09-18T21:30:50.564308] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T21:30:50.919555] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-09-18T21:30:51.451794] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T21:30:51.458179] [INFO ] [REMOTE ] RY: Full fetch complete (68399 records). [2025-09-18T21:30:51.458303] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-09-18T21:30:51.726767] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-09-18T21:30:51.875011] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-09-18T21:30:51.875106] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-09-18T21:30:51.876090] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-09-18T21:30:51.876156] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-09-18T21:30:51.877593] [DEBUG] [LOCAL ] RY: Trimmed 68399 records to 48378 (keeping 200 days of data) [2025-09-18T21:30:52.182975] [DEBUG] [LOCAL ] RY: Primary data saved (48378 records). [2025-09-18T21:30:52.183371] [INFO ] [MAIN ] RY: Full history saved. [2025-09-18T21:30:52.185138] [INFO ] [MAIN ] Update Progress: 1851/2372 symbols completed. RY took 38.3s. Estimated remaining: 1h 16m 14s. Rate: 6.8 symbols/min [2025-09-18T21:30:52.375048] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T21:30:52.378524] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:30:52.385425] [INFO ] [REMOTE ] RYAM: Full fetch complete (48490 records). [2025-09-18T21:30:52.385583] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-09-18T21:30:52.521932] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-09-18T21:30:52.820384] [DEBUG] [LOCAL ] RYN: Loaded 45855 existing records from primary storage. [2025-09-18T21:30:52.819249] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-09-18T21:30:52.820513] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-09-18T21:30:52.821396] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-09-18T21:30:52.821474] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-09-18T21:30:52.821559] [INFO ] [MAIN ] RYN: Loaded 45855 existing records. [2025-09-18T21:30:52.924113] [DEBUG] [LOCAL ] RYAM: Trimmed 48490 records to 35504 (keeping 200 days of data) [2025-09-18T21:30:53.060345] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:30:53.094337] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-09-18T21:30:53.095473] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-09-18T21:30:53.098244] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-09-18T21:30:53.098675] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-09-18T21:30:53.265068] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-18T21:30:53.324459] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-09-18T21:30:53.550116] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:30:53.598071] [DEBUG] [LOCAL ] RYAM: Primary data saved (35504 records). [2025-09-18T21:30:53.598207] [INFO ] [MAIN ] RYAM: Full history saved. [2025-09-18T21:30:53.598307] [INFO ] [MAIN ] Update Progress: 1852/2372 symbols completed. RYAM took 32.6s. Estimated remaining: 1h 16m 3s. Rate: 6.8 symbols/min [2025-09-18T21:30:53.767279] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:30:53.775247] [DEBUG] [LOCAL ] RZB: Loaded 6326 existing records from primary storage. [2025-09-18T21:30:53.775388] [INFO ] [MAIN ] RZB: Loaded 6326 existing records. [2025-09-18T21:30:53.963457] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:30:53.963984] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-09-18T21:30:53.964132] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-09-18T21:30:53.964757] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-09-18T21:30:53.964826] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-09-18T21:30:54.129297] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-11. [2025-09-18T21:30:54.236485] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-18T21:30:54.436165] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:30:54.451816] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-18T21:30:54.919554] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-09-18T21:30:55.719619] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-09-18T21:30:55.799681] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-18T21:30:55.838909] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-18T21:30:56.519572] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-09-18T21:30:57.150796] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-18T21:30:57.157751] [INFO ] [REMOTE ] RYAN: Full fetch complete (63126 records). [2025-09-18T21:30:57.157868] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-09-18T21:30:57.324020] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-09-18T21:30:57.541969] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-18T21:30:57.584135] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-09-18T21:30:57.584627] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-09-18T21:30:57.585671] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-09-18T21:30:57.585738] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-09-18T21:30:57.589630] [DEBUG] [LOCAL ] RYAN: Trimmed 63126 records to 44329 (keeping 200 days of data) [2025-09-18T21:30:57.855109] [DEBUG] [LOCAL ] RYAN: Primary data saved (44329 records). [2025-09-18T21:30:57.855260] [INFO ] [MAIN ] RYAN: Full history saved. [2025-09-18T21:30:57.855347] [INFO ] [MAIN ] Update Progress: 1853/2372 symbols completed. RYAN took 35.1s. Estimated remaining: 1h 15m 53s. Rate: 6.8 symbols/min [2025-09-18T21:30:58.026054] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:30:58.035233] [DEBUG] [LOCAL ] RZC: Loaded 6887 existing records from primary storage. [2025-09-18T21:30:58.035368] [INFO ] [MAIN ] RZC: Loaded 6887 existing records. [2025-09-18T21:30:58.124732] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-09-18T21:30:58.218822] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:30:58.219057] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-09-18T21:30:58.219104] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-09-18T21:30:58.219457] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-09-18T21:30:58.219517] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-09-18T21:30:58.572837] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:30:58.657067] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T21:30:58.919527] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-11. [2025-09-18T21:30:59.300946] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-18T21:30:59.353765] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-18T21:30:59.719554] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-09-18T21:31:00.452368] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-18T21:31:00.519513] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-09-18T21:31:01.095618] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-18T21:31:01.319560] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-09-18T21:31:02.119573] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-11. [2025-09-18T21:31:02.696740] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-18T21:31:02.744481] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-18T21:31:02.919545] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-09-18T21:31:03.399338] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-18T21:31:03.719585] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-09-18T21:31:04.519545] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-09-18T21:31:05.261682] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-18T21:31:05.319557] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-09-18T21:31:05.319448] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-18T21:31:06.119527] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-09-18T21:31:06.418738] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-18T21:31:06.689112] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-18T21:31:06.919562] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-09-18T21:31:07.614868] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-18T21:31:07.719513] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-09-18T21:31:08.490260] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-18T21:31:08.519564] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-09-18T21:31:09.219155] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-18T21:31:09.319581] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-09-18T21:31:10.050821] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-18T21:31:10.119573] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-09-18T21:31:10.558693] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-18T21:31:10.919585] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-09-18T21:31:11.719542] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-09-18T21:31:11.769855] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-18T21:31:12.519548] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-09-18T21:31:12.598556] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-18T21:31:13.302530] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-18T21:31:13.319501] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-09-18T21:31:13.890994] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-18T21:31:14.119584] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-09-18T21:31:14.919544] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-09-18T21:31:15.597893] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-18T21:31:15.719555] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-09-18T21:31:15.951253] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-18T21:31:16.303966] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-18T21:31:16.519584] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-09-18T21:31:17.151620] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-18T21:31:17.319560] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-09-18T21:31:17.758974] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-18T21:31:18.119574] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-09-18T21:31:18.919549] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-09-18T21:31:19.399035] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-18T21:31:19.400843] [INFO ] [REMOTE ] RZB: Full fetch complete (8850 records). [2025-09-18T21:31:19.400953] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-09-18T21:31:19.724871] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-09-18T21:31:19.804372] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-09-18T21:31:19.804463] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-09-18T21:31:19.804772] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-09-18T21:31:19.804869] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-09-18T21:31:19.806626] [DEBUG] [LOCAL ] RZB: Trimmed 8850 records to 6390 (keeping 200 days of data) [2025-09-18T21:31:19.849953] [DEBUG] [LOCAL ] RZB: Primary data saved (6390 records). [2025-09-18T21:31:19.850113] [INFO ] [MAIN ] RZB: Full history saved. [2025-09-18T21:31:19.850416] [INFO ] [MAIN ] Update Progress: 1854/2372 symbols completed. RZB took 26.3s. Estimated remaining: 1h 15m 48s. Rate: 6.8 symbols/min [2025-09-18T21:31:20.024177] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:31:20.055674] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-18T21:31:20.122789] [DEBUG] [LOCAL ] S: Loaded 53544 existing records from primary storage. [2025-09-18T21:31:20.123044] [INFO ] [MAIN ] S: Loaded 53544 existing records. [2025-09-18T21:31:20.314049] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:31:20.314360] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-09-18T21:31:20.314425] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-09-18T21:31:20.315741] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-09-18T21:31:20.315837] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-09-18T21:31:20.524741] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-09-18T21:31:20.685547] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:31:20.966683] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-18T21:31:21.153967] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T21:31:21.319534] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-09-18T21:31:22.119543] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-09-18T21:31:22.527593] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-18T21:31:22.536877] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-18T21:31:22.539688] [INFO ] [REMOTE ] RZC: Full fetch complete (9938 records). [2025-09-18T21:31:22.539777] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-09-18T21:31:22.900998] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-09-18T21:31:22.901077] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-09-18T21:31:22.901309] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-09-18T21:31:22.901347] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-09-18T21:31:22.902070] [DEBUG] [LOCAL ] RZC: Trimmed 9938 records to 6915 (keeping 200 days of data) [2025-09-18T21:31:22.919672] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-09-18T21:31:22.945879] [DEBUG] [LOCAL ] RZC: Primary data saved (6915 records). [2025-09-18T21:31:22.945973] [INFO ] [MAIN ] RZC: Full history saved. [2025-09-18T21:31:22.946092] [INFO ] [MAIN ] Update Progress: 1855/2372 symbols completed. RZC took 25.1s. Estimated remaining: 1h 15m 37s. Rate: 6.8 symbols/min [2025-09-18T21:31:23.125202] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:31:23.185494] [DEBUG] [LOCAL ] SA: Loaded 42927 existing records from primary storage. [2025-09-18T21:31:23.185670] [INFO ] [MAIN ] SA: Loaded 42927 existing records. [2025-09-18T21:31:23.362608] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:31:23.362991] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-09-18T21:31:23.363077] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-09-18T21:31:23.364073] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-09-18T21:31:23.364157] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-09-18T21:31:23.722339] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-09-18T21:31:23.722227] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:31:24.519551] [INFO ] [REMOTE ] S: Fetching primary data for 2024-11. [2025-09-18T21:31:24.617987] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-18T21:31:24.655432] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-18T21:31:24.659315] [INFO ] [REMOTE ] RYI: Full fetch complete (32251 records). [2025-09-18T21:31:24.659452] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-09-18T21:31:25.054984] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-09-18T21:31:25.055083] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-09-18T21:31:25.055796] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-09-18T21:31:25.055862] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-09-18T21:31:25.058420] [DEBUG] [LOCAL ] RYI: Trimmed 32251 records to 21745 (keeping 200 days of data) [2025-09-18T21:31:25.211026] [DEBUG] [LOCAL ] RYI: Primary data saved (21745 records). [2025-09-18T21:31:25.211160] [INFO ] [MAIN ] RYI: Full history saved. [2025-09-18T21:31:25.211317] [INFO ] [MAIN ] Update Progress: 1856/2372 symbols completed. RYI took 43.5s. Estimated remaining: 1h 15m 27s. Rate: 6.8 symbols/min [2025-09-18T21:31:25.324690] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-11. [2025-09-18T21:31:25.383584] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:31:25.395758] [DEBUG] [LOCAL ] SABA: Loaded 9443 existing records from primary storage. [2025-09-18T21:31:25.395886] [INFO ] [MAIN ] SABA: Loaded 9443 existing records. [2025-09-18T21:31:25.579200] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:31:25.579710] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-09-18T21:31:25.579769] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-09-18T21:31:25.580382] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-09-18T21:31:25.580442] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-09-18T21:31:25.936243] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:31:26.119502] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-11. [2025-09-18T21:31:26.208878] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-18T21:31:26.636702] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-18T21:31:26.860058] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-18T21:31:26.919516] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-09-18T21:31:27.719596] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-09-18T21:31:28.519519] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-09-18T21:31:28.579301] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-18T21:31:29.073830] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-18T21:31:29.300051] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-18T21:31:29.319494] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-09-18T21:31:30.119550] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-09-18T21:31:30.919552] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-09-18T21:31:30.946129] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-18T21:31:30.996113] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-18T21:31:31.719562] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-09-18T21:31:32.385060] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-18T21:31:32.519588] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-09-18T21:31:33.163632] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-18T21:31:33.167123] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T21:31:33.319599] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-09-18T21:31:34.119591] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-09-18T21:31:34.597596] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-18T21:31:34.606851] [INFO ] [REMOTE ] RYN: Full fetch complete (64423 records). [2025-09-18T21:31:34.606982] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-09-18T21:31:34.924683] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-09-18T21:31:35.014401] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-09-18T21:31:35.014544] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-09-18T21:31:35.015679] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-09-18T21:31:35.015745] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-09-18T21:31:35.017120] [DEBUG] [LOCAL ] RYN: Trimmed 64423 records to 46202 (keeping 200 days of data) [2025-09-18T21:31:35.326323] [DEBUG] [LOCAL ] RYN: Primary data saved (46202 records). [2025-09-18T21:31:35.326460] [INFO ] [MAIN ] RYN: Full history saved. [2025-09-18T21:31:35.327306] [INFO ] [MAIN ] Update Progress: 1857/2372 symbols completed. RYN took 43.1s. Estimated remaining: 1h 15m 18s. Rate: 6.8 symbols/min [2025-09-18T21:31:35.513670] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:31:35.560230] [DEBUG] [LOCAL ] SAFE: Loaded 30477 existing records from primary storage. [2025-09-18T21:31:35.560397] [INFO ] [MAIN ] SAFE: Loaded 30477 existing records. [2025-09-18T21:31:35.720601] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-09-18T21:31:35.743132] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:31:35.743386] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-09-18T21:31:35.743434] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-09-18T21:31:35.744744] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-09-18T21:31:35.744806] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-09-18T21:31:35.895076] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-18T21:31:36.119910] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:31:36.164108] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-18T21:31:36.519619] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-09-18T21:31:37.051296] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T21:31:37.319556] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-09-18T21:31:38.119590] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-11. [2025-09-18T21:31:38.724408] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-18T21:31:38.803261] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T21:31:38.919588] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-09-18T21:31:39.208865] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T21:31:39.719566] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-09-18T21:31:40.427706] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-18T21:31:40.519530] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-09-18T21:31:40.951823] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-18T21:31:40.986227] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-18T21:31:41.319559] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-09-18T21:31:42.105225] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-18T21:31:42.119481] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-09-18T21:31:42.793134] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-18T21:31:42.919598] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-09-18T21:31:43.719595] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-09-18T21:31:44.519718] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-09-18T21:31:44.955384] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-18T21:31:45.036212] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-18T21:31:45.100107] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-18T21:31:45.319618] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-09-18T21:31:46.119543] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-09-18T21:31:46.919579] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-09-18T21:31:47.270333] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-18T21:31:47.344313] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-18T21:31:47.719529] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-09-18T21:31:48.077564] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-18T21:31:48.519567] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-09-18T21:31:49.044718] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-18T21:31:49.319601] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-09-18T21:31:50.119532] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-09-18T21:31:50.585862] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-18T21:31:50.674817] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T21:31:50.919569] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-09-18T21:31:51.199284] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-18T21:31:51.421341] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-18T21:31:51.423984] [INFO ] [REMOTE ] SABA: Full fetch complete (15497 records). [2025-09-18T21:31:51.424062] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-09-18T21:31:51.724684] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-09-18T21:31:51.823298] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-09-18T21:31:51.823383] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-09-18T21:31:51.823745] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-09-18T21:31:51.824001] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-09-18T21:31:51.824596] [DEBUG] [LOCAL ] SABA: Trimmed 15497 records to 9484 (keeping 200 days of data) [2025-09-18T21:31:51.887119] [DEBUG] [LOCAL ] SABA: Primary data saved (9484 records). [2025-09-18T21:31:51.887272] [INFO ] [MAIN ] SABA: Full history saved. [2025-09-18T21:31:51.887400] [INFO ] [MAIN ] Update Progress: 1858/2372 symbols completed. SABA took 26.7s. Estimated remaining: 1h 15m 12s. Rate: 6.8 symbols/min [2025-09-18T21:31:52.061549] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:31:52.084861] [DEBUG] [LOCAL ] SAH: Loaded 22302 existing records from primary storage. [2025-09-18T21:31:52.085006] [INFO ] [MAIN ] SAH: Loaded 22302 existing records. [2025-09-18T21:31:52.275702] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:31:52.275954] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-09-18T21:31:52.276055] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-09-18T21:31:52.276946] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-09-18T21:31:52.277011] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-09-18T21:31:52.524719] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-09-18T21:31:52.677039] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:31:53.319519] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-09-18T21:31:53.767195] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-18T21:31:53.971143] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T21:31:54.119527] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-11. [2025-09-18T21:31:54.191633] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-18T21:31:54.889333] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-18T21:31:54.919565] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-09-18T21:31:55.719576] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-09-18T21:31:56.519631] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-09-18T21:31:57.134617] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-18T21:31:57.176511] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-18T21:31:57.197577] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-18T21:31:57.204177] [INFO ] [REMOTE ] SA: Full fetch complete (61314 records). [2025-09-18T21:31:57.204327] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-09-18T21:31:57.324618] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-09-18T21:31:57.605995] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-09-18T21:31:57.606115] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-09-18T21:31:57.607265] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-09-18T21:31:57.607344] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-09-18T21:31:57.611310] [DEBUG] [LOCAL ] SA: Trimmed 61314 records to 43277 (keeping 200 days of data) [2025-09-18T21:31:57.877004] [DEBUG] [LOCAL ] SA: Primary data saved (43277 records). [2025-09-18T21:31:57.877149] [INFO ] [MAIN ] SA: Full history saved. [2025-09-18T21:31:57.877235] [INFO ] [MAIN ] Update Progress: 1859/2372 symbols completed. SA took 34.9s. Estimated remaining: 1h 15m 2s. Rate: 6.8 symbols/min [2025-09-18T21:31:58.050096] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:31:58.050278] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-09-18T21:31:58.050317] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-09-18T21:31:58.050464] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-09-18T21:31:58.050508] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-18T21:31:58.050551] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-18T21:31:58.050583] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-09-18T21:31:58.127757] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-09-18T21:31:58.414354] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:31:58.426500] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-18T21:31:58.919544] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-09-18T21:31:59.101480] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-18T21:31:59.719574] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-11. [2025-09-18T21:31:59.842315] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-18T21:32:00.340807] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-18T21:32:00.519528] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-09-18T21:32:00.852300] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-18T21:32:01.319549] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-09-18T21:32:02.119547] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-09-18T21:32:02.919567] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-09-18T21:32:03.335045] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-18T21:32:03.512623] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-18T21:32:03.719543] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-09-18T21:32:03.960919] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-18T21:32:04.519634] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-09-18T21:32:04.733984] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-18T21:32:05.319561] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-09-18T21:32:05.540850] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-18T21:32:05.649630] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-18T21:32:06.119558] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-09-18T21:32:06.432309] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-18T21:32:06.919554] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-09-18T21:32:07.719569] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-09-18T21:32:07.962142] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-18T21:32:08.519570] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-09-18T21:32:08.589035] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-18T21:32:09.319567] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-09-18T21:32:09.622087] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-18T21:32:10.119517] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-09-18T21:32:10.456217] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-18T21:32:10.506966] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-18T21:32:10.518105] [INFO ] [REMOTE ] S: Full fetch complete (77494 records). [2025-09-18T21:32:10.518265] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-09-18T21:32:10.911081] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-09-18T21:32:10.911174] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-09-18T21:32:10.912243] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-09-18T21:32:10.912310] [DEBUG] [LOCAL ] S: Saving primary data. [2025-09-18T21:32:10.913867] [DEBUG] [LOCAL ] S: Trimmed 77494 records to 53934 (keeping 200 days of data) [2025-09-18T21:32:10.919522] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-09-18T21:32:11.255363] [DEBUG] [LOCAL ] S: Primary data saved (53934 records). [2025-09-18T21:32:11.255580] [INFO ] [MAIN ] S: Full history saved. [2025-09-18T21:32:11.255782] [INFO ] [MAIN ] Update Progress: 1860/2372 symbols completed. S took 51.4s. Estimated remaining: 1h 14m 55s. Rate: 6.8 symbols/min [2025-09-18T21:32:11.444845] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:32:11.466750] [DEBUG] [LOCAL ] SAM: Loaded 21704 existing records from primary storage. [2025-09-18T21:32:11.466947] [INFO ] [MAIN ] SAM: Loaded 21704 existing records. [2025-09-18T21:32:11.659317] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:32:11.659553] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-09-18T21:32:11.659610] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-09-18T21:32:11.660200] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-09-18T21:32:11.660266] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-09-18T21:32:11.726854] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-09-18T21:32:12.046251] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:32:12.058490] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-18T21:32:12.519590] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-11. [2025-09-18T21:32:13.305191] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-18T21:32:13.319482] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-09-18T21:32:13.629549] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-18T21:32:14.119569] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-09-18T21:32:14.462855] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T21:32:14.919527] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-09-18T21:32:15.113896] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-18T21:32:15.719553] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-09-18T21:32:15.949860] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-18T21:32:15.954613] [INFO ] [REMOTE ] SAFE: Full fetch complete (44940 records). [2025-09-18T21:32:15.954783] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-09-18T21:32:16.103247] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-18T21:32:16.344439] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-09-18T21:32:16.344527] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-09-18T21:32:16.345472] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-09-18T21:32:16.345554] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-09-18T21:32:16.346574] [DEBUG] [LOCAL ] SAFE: Trimmed 44940 records to 30726 (keeping 200 days of data) [2025-09-18T21:32:16.519736] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-09-18T21:32:16.539368] [DEBUG] [LOCAL ] SAFE: Primary data saved (30726 records). [2025-09-18T21:32:16.539529] [INFO ] [MAIN ] SAFE: Full history saved. [2025-09-18T21:32:16.539626] [INFO ] [MAIN ] Update Progress: 1861/2372 symbols completed. SAFE took 41.2s. Estimated remaining: 1h 14m 45s. Rate: 6.8 symbols/min [2025-09-18T21:32:16.737421] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:32:16.801894] [DEBUG] [LOCAL ] SAN: Loaded 53041 existing records from primary storage. [2025-09-18T21:32:16.802083] [INFO ] [MAIN ] SAN: Loaded 53041 existing records. [2025-09-18T21:32:17.035504] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:32:17.035804] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-09-18T21:32:17.035856] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-09-18T21:32:17.037478] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-09-18T21:32:17.037542] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-09-18T21:32:17.324973] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-09-18T21:32:17.406745] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:32:17.482811] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-18T21:32:17.615274] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-18T21:32:18.119547] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-09-18T21:32:18.478197] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-18T21:32:18.919546] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-09-18T21:32:19.261706] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-18T21:32:19.719551] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-09-18T21:32:20.519542] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-11. [2025-09-18T21:32:20.721049] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-18T21:32:21.319555] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-09-18T21:32:22.119595] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-09-18T21:32:22.376706] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-18T21:32:22.406179] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-18T21:32:22.874398] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-18T21:32:22.919494] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-09-18T21:32:23.719564] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-18T21:32:23.995770] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-18T21:32:24.050421] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-18T21:32:24.051309] [INFO ] [REMOTE ] SAJ: Full fetch complete (969 records). [2025-09-18T21:32:24.051396] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-09-18T21:32:24.247080] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-09-18T21:32:24.247310] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:32:24.247383] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:32:24.247452] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-18T21:32:24.247518] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-18T21:32:24.247555] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-09-18T21:32:24.247609] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-09-18T21:32:24.247714] [INFO ] [MAIN ] Update Progress: 1862/2372 symbols completed. SAJ took 26.4s. Estimated remaining: 1h 14m 36s. Rate: 6.8 symbols/min [2025-09-18T21:32:24.419755] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:32:24.470225] [DEBUG] [LOCAL ] SAND: Loaded 51758 existing records from primary storage. [2025-09-18T21:32:24.470401] [INFO ] [MAIN ] SAND: Loaded 51758 existing records. [2025-09-18T21:32:24.524752] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-09-18T21:32:24.650969] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:32:24.651201] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-09-18T21:32:24.651247] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-09-18T21:32:24.652499] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-09-18T21:32:24.652560] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-09-18T21:32:25.052559] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:32:25.319625] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-09-18T21:32:25.406508] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-18T21:32:25.410549] [INFO ] [REMOTE ] SAH: Full fetch complete (30360 records). [2025-09-18T21:32:25.415054] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-09-18T21:32:26.046833] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-09-18T21:32:26.046969] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-09-18T21:32:26.048545] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-09-18T21:32:26.049475] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-09-18T21:32:26.050996] [DEBUG] [LOCAL ] SAH: Trimmed 30360 records to 22501 (keeping 200 days of data) [2025-09-18T21:32:26.131267] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-09-18T21:32:26.240404] [DEBUG] [LOCAL ] SAH: Primary data saved (22501 records). [2025-09-18T21:32:26.240614] [INFO ] [MAIN ] SAH: Full history saved. [2025-09-18T21:32:26.240811] [INFO ] [MAIN ] Update Progress: 1863/2372 symbols completed. SAH took 34.4s. Estimated remaining: 1h 14m 25s. Rate: 6.8 symbols/min [2025-09-18T21:32:26.456352] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-18T21:32:26.492094] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:32:26.548569] [DEBUG] [LOCAL ] SAP: Loaded 50093 existing records from primary storage. [2025-09-18T21:32:26.548783] [INFO ] [MAIN ] SAP: Loaded 50093 existing records. [2025-09-18T21:32:26.743485] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:32:26.743786] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-09-18T21:32:26.743839] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-09-18T21:32:26.745114] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-09-18T21:32:26.745175] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-09-18T21:32:26.920562] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-09-18T21:32:27.117114] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:32:27.730004] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-11. [2025-09-18T21:32:27.752681] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-18T21:32:28.029022] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-18T21:32:28.519559] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-09-18T21:32:29.319537] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-09-18T21:32:29.404590] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-18T21:32:29.461140] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-18T21:32:30.119576] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-09-18T21:32:30.930278] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-09-18T21:32:30.936041] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-18T21:32:31.254404] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T21:32:31.719545] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-11. [2025-09-18T21:32:32.519570] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-09-18T21:32:32.785823] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-18T21:32:33.282367] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-18T21:32:33.319547] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-09-18T21:32:34.043842] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-18T21:32:34.119594] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-09-18T21:32:34.620392] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-18T21:32:34.919507] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-09-18T21:32:34.957306] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-18T21:32:35.719569] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-09-18T21:32:36.519599] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-09-18T21:32:36.576432] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-18T21:32:37.319574] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-09-18T21:32:37.512832] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-18T21:32:37.537381] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-18T21:32:37.541241] [INFO ] [REMOTE ] SAM: Full fetch complete (30075 records). [2025-09-18T21:32:37.541330] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-09-18T21:32:37.927073] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-09-18T21:32:37.927178] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-09-18T21:32:37.927984] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-09-18T21:32:37.928052] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-09-18T21:32:37.929037] [DEBUG] [LOCAL ] SAM: Trimmed 30075 records to 21867 (keeping 200 days of data) [2025-09-18T21:32:38.065010] [DEBUG] [LOCAL ] SAM: Primary data saved (21867 records). [2025-09-18T21:32:38.065149] [INFO ] [MAIN ] SAM: Full history saved. [2025-09-18T21:32:38.065234] [INFO ] [MAIN ] Update Progress: 1864/2372 symbols completed. SAM took 26.8s. Estimated remaining: 1h 14m 17s. Rate: 6.8 symbols/min [2025-09-18T21:32:38.131026] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-09-18T21:32:38.254341] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:32:38.272763] [DEBUG] [LOCAL ] SAR: Loaded 16499 existing records from primary storage. [2025-09-18T21:32:38.272909] [INFO ] [MAIN ] SAR: Loaded 16499 existing records. [2025-09-18T21:32:38.456885] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:32:38.457165] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-09-18T21:32:38.457224] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-09-18T21:32:38.457780] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-09-18T21:32:38.457842] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-09-18T21:32:38.870200] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:32:38.919529] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-09-18T21:32:39.023876] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-18T21:32:39.719549] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-09-18T21:32:39.929960] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-18T21:32:40.383956] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-18T21:32:40.519560] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-09-18T21:32:41.319532] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-09-18T21:32:41.396393] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-18T21:32:42.119536] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-09-18T21:32:42.151788] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-18T21:32:42.919594] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-11. [2025-09-18T21:32:43.172355] [DEBUG] [REMOTE ] SAR: Error fetching primary data for 2024-11: 'API call returned an empty response.' [2025-09-18T21:32:43.172739] [WARN ] [REMOTE ] SAR: No data returned for month 2024-11 [2025-09-18T21:32:43.216679] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-18T21:32:43.729285] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-09-18T21:32:43.735678] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-18T21:32:44.519559] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-09-18T21:32:45.282441] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-18T21:32:45.319504] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-09-18T21:32:46.044792] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T21:32:46.119563] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-09-18T21:32:46.886566] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-18T21:32:46.919555] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-09-18T21:32:47.005131] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-18T21:32:47.719564] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-09-18T21:32:48.519571] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-09-18T21:32:48.844665] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-18T21:32:49.225881] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-18T21:32:49.319576] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-09-18T21:32:50.119584] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-09-18T21:32:50.345273] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-18T21:32:50.919577] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-09-18T21:32:51.141361] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-18T21:32:51.511581] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-18T21:32:51.519631] [INFO ] [REMOTE ] SAN: Full fetch complete (76122 records). [2025-09-18T21:32:51.519878] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-09-18T21:32:51.727133] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-09-18T21:32:51.943243] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-09-18T21:32:51.943339] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-09-18T21:32:51.944526] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-09-18T21:32:51.944614] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-09-18T21:32:51.946316] [DEBUG] [LOCAL ] SAN: Trimmed 76122 records to 53427 (keeping 200 days of data) [2025-09-18T21:32:52.273415] [DEBUG] [LOCAL ] SAN: Primary data saved (53427 records). [2025-09-18T21:32:52.273556] [INFO ] [MAIN ] SAN: Full history saved. [2025-09-18T21:32:52.274324] [INFO ] [MAIN ] Update Progress: 1865/2372 symbols completed. SAN took 35.7s. Estimated remaining: 1h 14m 10s. Rate: 6.8 symbols/min [2025-09-18T21:32:52.445846] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:32:52.492366] [DEBUG] [LOCAL ] SARO: Loaded 48817 existing records from primary storage. [2025-09-18T21:32:52.492508] [INFO ] [MAIN ] SARO: Loaded 48817 existing records. [2025-09-18T21:32:52.524718] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-09-18T21:32:52.683511] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:32:52.683951] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-09-18T21:32:52.684126] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-09-18T21:32:52.685681] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-09-18T21:32:52.685747] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-09-18T21:32:52.903350] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-18T21:32:53.098316] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:32:53.148467] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-18T21:32:53.319523] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-09-18T21:32:53.540939] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-18T21:32:54.119570] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-09-18T21:32:54.919555] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-09-18T21:32:55.069548] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-18T21:32:55.594070] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-18T21:32:55.625840] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-18T21:32:55.719530] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-09-18T21:32:56.519545] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-09-18T21:32:56.627907] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-18T21:32:57.319573] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-09-18T21:32:58.119536] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-11. [2025-09-18T21:32:58.168351] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-18T21:32:58.221720] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-18T21:32:58.229145] [INFO ] [REMOTE ] SAND: Full fetch complete (74063 records). [2025-09-18T21:32:58.229270] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-09-18T21:32:58.627927] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-09-18T21:32:58.628013] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-09-18T21:32:58.629044] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-09-18T21:32:58.629117] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-09-18T21:32:58.630556] [DEBUG] [LOCAL ] SAND: Trimmed 74063 records to 52120 (keeping 200 days of data) [2025-09-18T21:32:58.924940] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-09-18T21:32:58.951174] [DEBUG] [LOCAL ] SAND: Primary data saved (52120 records). [2025-09-18T21:32:58.951334] [INFO ] [MAIN ] SAND: Full history saved. [2025-09-18T21:32:58.951427] [INFO ] [MAIN ] Update Progress: 1866/2372 symbols completed. SAND took 34.7s. Estimated remaining: 1h 14m 1s. Rate: 6.8 symbols/min [2025-09-18T21:32:59.131285] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:32:59.131483] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-09-18T21:32:59.131538] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-09-18T21:32:59.131800] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-09-18T21:32:59.131861] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-18T21:32:59.131906] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-18T21:32:59.131978] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-09-18T21:32:59.515398] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:32:59.540434] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T21:32:59.719539] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-09-18T21:32:59.768995] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-18T21:33:00.519557] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-09-18T21:33:01.116771] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-18T21:33:01.319556] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-09-18T21:33:02.119601] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-11. [2025-09-18T21:33:02.919612] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-09-18T21:33:03.137245] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-18T21:33:03.719605] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-09-18T21:33:03.778983] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-18T21:33:03.982287] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-18T21:33:04.519552] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-09-18T21:33:04.951555] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-18T21:33:05.184539] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-18T21:33:05.319588] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-09-18T21:33:06.119578] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-09-18T21:33:06.149807] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-18T21:33:06.316421] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-18T21:33:06.558660] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-18T21:33:06.919589] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-09-18T21:33:07.264686] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-18T21:33:07.719532] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-09-18T21:33:08.519541] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-09-18T21:33:08.930702] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-18T21:33:08.959045] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-18T21:33:09.319568] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-09-18T21:33:10.119550] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-09-18T21:33:10.555019] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-18T21:33:10.919526] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-09-18T21:33:10.960505] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-18T21:33:10.967540] [INFO ] [REMOTE ] SAP: Full fetch complete (71426 records). [2025-09-18T21:33:10.967686] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-09-18T21:33:11.353295] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-09-18T21:33:11.353405] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-09-18T21:33:11.354474] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-09-18T21:33:11.354547] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-09-18T21:33:11.358849] [DEBUG] [LOCAL ] SAP: Trimmed 71426 records to 50481 (keeping 200 days of data) [2025-09-18T21:33:11.672553] [DEBUG] [LOCAL ] SAP: Primary data saved (50481 records). [2025-09-18T21:33:11.672829] [INFO ] [MAIN ] SAP: Full history saved. [2025-09-18T21:33:11.673000] [INFO ] [MAIN ] Update Progress: 1867/2372 symbols completed. SAP took 45.4s. Estimated remaining: 1h 13m 53s. Rate: 6.8 symbols/min [2025-09-18T21:33:11.729589] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-09-18T21:33:11.849441] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:33:11.849626] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-09-18T21:33:11.849705] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-09-18T21:33:11.849854] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-09-18T21:33:11.849898] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-18T21:33:11.849940] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-18T21:33:11.849974] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-09-18T21:33:12.094533] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-18T21:33:12.164587] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-18T21:33:12.232996] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:33:12.519582] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-09-18T21:33:12.989756] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-18T21:33:13.319542] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-09-18T21:33:14.119551] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-09-18T21:33:14.775115] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-18T21:33:14.919549] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-09-18T21:33:15.303765] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-18T21:33:15.719537] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-09-18T21:33:16.519539] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-11. [2025-09-18T21:33:16.592953] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-18T21:33:16.620025] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-18T21:33:16.623038] [INFO ] [REMOTE ] SAR: Full fetch complete (22579 records). [2025-09-18T21:33:16.623116] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-09-18T21:33:16.820928] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-11 (0.30 seconds). [2025-09-18T21:33:16.832058] [WARN ] [VALIDATOR ] SAR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-18T21:33:16.832456] [FATAL] [MAIN ] SAR: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:33:16.832531] [WARN ] [MAIN ] SAR: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:33:16.832607] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-09-18T21:33:16.832717] [DEBUG] [LOCAL ] SAR: No primary data file found to delete. [2025-09-18T21:33:16.832773] [INFO ] [LOCAL ] SAR: Starting deletion of derivative data. [2025-09-18T21:33:16.833237] [DEBUG] [LOCAL ] SAR: Deleted derivative data file. [2025-09-18T21:33:16.833394] [INFO ] [MAIN ] Update Progress: 1868/2372 symbols completed. SAR took 38.8s. Estimated remaining: 1h 13m 43s. Rate: 6.8 symbols/min [2025-09-18T21:33:17.011339] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:33:17.011549] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-09-18T21:33:17.011606] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-09-18T21:33:17.011777] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-09-18T21:33:17.011863] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-18T21:33:17.011929] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-18T21:33:17.011966] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-09-18T21:33:17.334983] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-09-18T21:33:17.376620] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:33:18.119549] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-18T21:33:18.448751] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-18T21:33:18.449548] [INFO ] [REMOTE ] SAT: Full fetch complete (1613 records). [2025-09-18T21:33:18.449622] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-09-18T21:33:18.450020] [FATAL] [VALIDATOR ] SAT: Data is stale - most recent date (2025-09-17) is before last completed trading day (2025-09-18). Symbol may be delisted or halted. [2025-09-18T21:33:18.450104] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:33:18.450147] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:33:18.450184] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-18T21:33:18.450243] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-18T21:33:18.450294] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-09-18T21:33:18.450362] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-09-18T21:33:18.450428] [INFO ] [MAIN ] Update Progress: 1869/2372 symbols completed. SAT took 19.5s. Estimated remaining: 1h 13m 32s. Rate: 6.8 symbols/min [2025-09-18T21:33:18.627384] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:33:18.663869] [DEBUG] [LOCAL ] SB: Loaded 33697 existing records from primary storage. [2025-09-18T21:33:18.664039] [INFO ] [MAIN ] SB: Loaded 33697 existing records. [2025-09-18T21:33:18.849893] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:33:18.850414] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-09-18T21:33:18.850555] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-09-18T21:33:18.852338] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-09-18T21:33:18.852446] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-09-18T21:33:18.924378] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-09-18T21:33:19.080572] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-18T21:33:19.271981] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:33:19.360257] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-18T21:33:19.719527] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-11. [2025-09-18T21:33:20.519552] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-11. [2025-09-18T21:33:20.818233] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-11 (0.30 seconds). [2025-09-18T21:33:21.111142] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T21:33:21.319550] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-09-18T21:33:21.650303] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-18T21:33:22.119556] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-09-18T21:33:22.444045] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-18T21:33:22.919549] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-18T21:33:23.261884] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-18T21:33:23.719591] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-09-18T21:33:24.519583] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-09-18T21:33:25.216433] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T21:33:25.319561] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-09-18T21:33:26.119543] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-09-18T21:33:26.175753] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-18T21:33:26.472130] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-18T21:33:26.534985] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-18T21:33:26.919559] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-09-18T21:33:27.719566] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-18T21:33:28.252346] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-18T21:33:28.316278] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-18T21:33:28.519555] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-09-18T21:33:29.319588] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-09-18T21:33:29.679269] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-18T21:33:29.936933] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T21:33:30.119543] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-18T21:33:30.495434] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-18T21:33:30.919563] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-18T21:33:31.306489] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-18T21:33:31.719546] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-09-18T21:33:32.043546] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-18T21:33:32.519600] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-09-18T21:33:32.864445] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-18T21:33:33.319548] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-09-18T21:33:33.753873] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-18T21:33:34.119598] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-09-18T21:33:34.919561] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-09-18T21:33:35.726461] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-18T21:33:35.732046] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-18T21:33:36.110825] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-18T21:33:36.383584] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T21:33:36.519611] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-09-18T21:33:36.823701] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-18T21:33:37.319582] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-18T21:33:37.650747] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-18T21:33:38.119570] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-09-18T21:33:38.475421] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-18T21:33:38.919574] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-09-18T21:33:39.719549] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-18T21:33:40.150477] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-18T21:33:40.200767] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-18T21:33:40.519606] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-09-18T21:33:40.861531] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-18T21:33:41.319552] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-09-18T21:33:42.119569] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-18T21:33:42.650735] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-18T21:33:42.652110] [INFO ] [REMOTE ] SAZ: Full fetch complete (1820 records). [2025-09-18T21:33:42.652340] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-09-18T21:33:42.856406] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-18T21:33:42.857110] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:33:42.857276] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:33:42.857369] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-18T21:33:42.857558] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-18T21:33:42.874249] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-09-18T21:33:42.876831] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-09-18T21:33:42.878408] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T21:33:42.877484] [INFO ] [MAIN ] Update Progress: 1870/2372 symbols completed. SAZ took 26.0s. Estimated remaining: 1h 13m 28s. Rate: 6.8 symbols/min [2025-09-18T21:33:42.924736] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-09-18T21:33:43.109259] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:33:43.109465] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-09-18T21:33:43.109520] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-09-18T21:33:43.109704] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-09-18T21:33:43.109757] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-18T21:33:43.109825] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-18T21:33:43.109904] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-09-18T21:33:43.465860] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:33:43.719548] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-18T21:33:44.342683] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T21:33:44.343761] [INFO ] [REMOTE ] SAY: Full fetch complete (1460 records). [2025-09-18T21:33:44.343944] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-09-18T21:33:44.521786] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-11. [2025-09-18T21:33:44.522715] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-18T21:33:44.558589] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-18T21:33:44.559267] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:33:44.559356] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:33:44.559418] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-18T21:33:44.559783] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-18T21:33:44.559829] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-09-18T21:33:44.559887] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-09-18T21:33:44.559961] [INFO ] [MAIN ] Update Progress: 1871/2372 symbols completed. SAY took 32.9s. Estimated remaining: 1h 13m 17s. Rate: 6.8 symbols/min [2025-09-18T21:33:44.729310] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:33:44.806535] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:33:44.807055] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-11 [2025-09-18T21:33:44.809180] [DEBUG] [LOCAL ] SBH: Loaded 49807 existing records from primary storage. [2025-09-18T21:33:44.809367] [INFO ] [MAIN ] SBH: Loaded 49807 existing records. [2025-09-18T21:33:44.995727] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:33:44.996107] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-09-18T21:33:44.996189] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-09-18T21:33:44.997234] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-09-18T21:33:44.997299] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-09-18T21:33:45.327771] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-09-18T21:33:45.360408] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:33:45.563600] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:33:45.563968] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-09-18T21:33:46.119546] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-09-18T21:33:46.919601] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-01. [2025-09-18T21:33:47.144380] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:33:47.144736] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-01 [2025-09-18T21:33:47.719565] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-09-18T21:33:47.862955] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-18T21:33:48.519548] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-02. [2025-09-18T21:33:48.744387] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:33:48.744744] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-02 [2025-09-18T21:33:49.121214] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-18T21:33:49.319565] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-11. [2025-09-18T21:33:50.119522] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-03. [2025-09-18T21:33:50.344464] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:33:50.344806] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-03 [2025-09-18T21:33:50.709617] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T21:33:50.919552] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-09-18T21:33:51.719538] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-09-18T21:33:52.519556] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-04. [2025-09-18T21:33:52.588997] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-18T21:33:52.903430] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:33:52.903792] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-04 [2025-09-18T21:33:52.977509] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-18T21:33:52.987091] [INFO ] [REMOTE ] SARO: Full fetch complete (68744 records). [2025-09-18T21:33:52.987258] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-09-18T21:33:53.324708] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-05. [2025-09-18T21:33:53.383664] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-09-18T21:33:53.383748] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-09-18T21:33:53.384946] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-09-18T21:33:53.385198] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-09-18T21:33:53.386754] [DEBUG] [LOCAL ] SARO: Trimmed 68744 records to 49159 (keeping 200 days of data) [2025-09-18T21:33:53.629172] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:33:53.630433] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-05 [2025-09-18T21:33:53.705979] [DEBUG] [LOCAL ] SARO: Primary data saved (49159 records). [2025-09-18T21:33:53.706122] [INFO ] [MAIN ] SARO: Full history saved. [2025-09-18T21:33:53.707266] [INFO ] [MAIN ] Update Progress: 1872/2372 symbols completed. SARO took 1m 1s. Estimated remaining: 1h 13m 8s. Rate: 6.8 symbols/min [2025-09-18T21:33:53.915633] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:33:53.928704] [DEBUG] [LOCAL ] SBI: Loaded 7713 existing records from primary storage. [2025-09-18T21:33:53.928835] [INFO ] [MAIN ] SBI: Loaded 7713 existing records. [2025-09-18T21:33:54.103119] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:33:54.103362] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-09-18T21:33:54.103410] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-09-18T21:33:54.103801] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-09-18T21:33:54.103861] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-09-18T21:33:54.124688] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-06. [2025-09-18T21:33:54.437158] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:33:54.462871] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-06 [2025-09-18T21:33:54.467216] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:33:54.919541] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-07. [2025-09-18T21:33:55.275365] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-18T21:33:55.719550] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-08. [2025-09-18T21:33:56.265800] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-18T21:33:56.519628] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-09. [2025-09-18T21:33:56.924902] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-18T21:33:56.926035] [INFO ] [REMOTE ] SBDS: Full fetch complete (974 records). [2025-09-18T21:33:56.926138] [DEBUG] [VALIDATOR ] SBDS: Validating primary data. [2025-09-18T21:33:57.116882] [WARN ] [VALIDATOR ] SBDS: Validation failed - insufficient historical data. Have 40 unique days, need 200 days [2025-09-18T21:33:57.117058] [FATAL] [MAIN ] SBDS: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:33:57.117127] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:33:57.117195] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-18T21:33:57.117259] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-18T21:33:57.117310] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-09-18T21:33:57.117378] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-09-18T21:33:57.117464] [INFO ] [MAIN ] Update Progress: 1873/2372 symbols completed. SBDS took 14.2s. Estimated remaining: 1h 12m 58s. Rate: 6.8 symbols/min [2025-09-18T21:33:57.285802] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:33:57.299097] [DEBUG] [LOCAL ] SBR: Loaded 7257 existing records from primary storage. [2025-09-18T21:33:57.299233] [INFO ] [MAIN ] SBR: Loaded 7257 existing records. [2025-09-18T21:33:57.324736] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-11. [2025-09-18T21:33:57.482113] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:33:57.482342] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-09-18T21:33:57.482392] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-09-18T21:33:57.482870] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-09-18T21:33:57.482942] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-09-18T21:33:57.845589] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:33:57.850913] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-18T21:33:58.119558] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-09-18T21:33:58.703231] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-18T21:33:58.919597] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-09-18T21:33:59.450472] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-18T21:33:59.719546] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-09-18T21:34:00.370574] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-18T21:34:00.519586] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-09-18T21:34:01.188278] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-18T21:34:01.319582] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-11. [2025-09-18T21:34:02.119548] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-09-18T21:34:02.229399] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-18T21:34:02.919557] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-09-18T21:34:03.416940] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T21:34:03.719540] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-09-18T21:34:04.254019] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-18T21:34:04.519574] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-09-18T21:34:04.615292] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-18T21:34:05.319571] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-09-18T21:34:05.961667] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-18T21:34:06.119580] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-09-18T21:34:06.196195] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-18T21:34:06.919595] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-09-18T21:34:07.187597] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-18T21:34:07.192511] [INFO ] [REMOTE ] SB: Full fetch complete (50876 records). [2025-09-18T21:34:07.192669] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-09-18T21:34:07.555835] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-18T21:34:07.593028] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-09-18T21:34:07.593140] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-09-18T21:34:07.594112] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-09-18T21:34:07.594180] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-09-18T21:34:07.597381] [DEBUG] [LOCAL ] SB: Trimmed 50876 records to 33925 (keeping 200 days of data) [2025-09-18T21:34:07.719715] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-09-18T21:34:07.818610] [DEBUG] [LOCAL ] SB: Primary data saved (33925 records). [2025-09-18T21:34:07.818808] [INFO ] [MAIN ] SB: Full history saved. [2025-09-18T21:34:07.818940] [INFO ] [MAIN ] Update Progress: 1874/2372 symbols completed. SB took 49.4s. Estimated remaining: 1h 12m 50s. Rate: 6.8 symbols/min [2025-09-18T21:34:07.991529] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:34:08.046405] [DEBUG] [LOCAL ] SBS: Loaded 49382 existing records from primary storage. [2025-09-18T21:34:08.046584] [INFO ] [MAIN ] SBS: Loaded 49382 existing records. [2025-09-18T21:34:08.226158] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:34:08.226448] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-09-18T21:34:08.226496] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-09-18T21:34:08.227932] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-09-18T21:34:08.227992] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-09-18T21:34:08.523578] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-09-18T21:34:08.620739] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:34:08.628844] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-18T21:34:09.163423] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-18T21:34:09.319552] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-11. [2025-09-18T21:34:10.119551] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-09-18T21:34:10.742416] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T21:34:10.919554] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-09-18T21:34:11.451374] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-18T21:34:11.704705] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-18T21:34:11.719539] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-09-18T21:34:12.519557] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-09-18T21:34:13.201307] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-18T21:34:13.319546] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-09-18T21:34:13.456696] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-18T21:34:13.973687] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-18T21:34:14.119519] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-09-18T21:34:14.709396] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-18T21:34:14.919547] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-09-18T21:34:15.665592] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-18T21:34:15.719570] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-09-18T21:34:16.519566] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-09-18T21:34:17.167793] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T21:34:17.319543] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-09-18T21:34:17.906937] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-18T21:34:18.083094] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-18T21:34:18.119510] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-09-18T21:34:18.919550] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-09-18T21:34:19.491938] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-18T21:34:19.510726] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-18T21:34:19.512045] [INFO ] [REMOTE ] SBI: Full fetch complete (10732 records). [2025-09-18T21:34:19.512118] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-09-18T21:34:19.724627] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-09-18T21:34:19.895892] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-09-18T21:34:19.895975] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-09-18T21:34:19.896224] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-09-18T21:34:19.896264] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-09-18T21:34:19.896756] [DEBUG] [LOCAL ] SBI: Trimmed 10732 records to 7844 (keeping 200 days of data) [2025-09-18T21:34:19.942833] [DEBUG] [LOCAL ] SBI: Primary data saved (7844 records). [2025-09-18T21:34:19.942970] [INFO ] [MAIN ] SBI: Full history saved. [2025-09-18T21:34:19.943072] [INFO ] [MAIN ] Update Progress: 1875/2372 symbols completed. SBI took 26.2s. Estimated remaining: 1h 12m 42s. Rate: 6.8 symbols/min [2025-09-18T21:34:20.124315] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:34:20.140799] [DEBUG] [LOCAL ] SBSI: Loaded 14636 existing records from primary storage. [2025-09-18T21:34:20.140930] [INFO ] [MAIN ] SBSI: Loaded 14636 existing records. [2025-09-18T21:34:20.336807] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:34:20.337109] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-09-18T21:34:20.337165] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-09-18T21:34:20.337860] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-09-18T21:34:20.337924] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-09-18T21:34:20.522211] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-09-18T21:34:20.708505] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:34:21.171091] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-18T21:34:21.319538] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-11. [2025-09-18T21:34:21.456600] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-18T21:34:22.119550] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-09-18T21:34:22.171728] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-18T21:34:22.771900] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-18T21:34:22.919515] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-09-18T21:34:23.719536] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-09-18T21:34:24.423945] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-18T21:34:24.519530] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-09-18T21:34:24.798319] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-18T21:34:25.265791] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-18T21:34:25.268022] [INFO ] [REMOTE ] SBR: Full fetch complete (10967 records). [2025-09-18T21:34:25.268106] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-09-18T21:34:25.327608] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-09-18T21:34:25.667616] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-09-18T21:34:25.667743] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-09-18T21:34:25.668015] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-09-18T21:34:25.668055] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-09-18T21:34:25.668566] [DEBUG] [LOCAL ] SBR: Trimmed 10967 records to 7318 (keeping 200 days of data) [2025-09-18T21:34:25.721071] [DEBUG] [LOCAL ] SBR: Primary data saved (7318 records). [2025-09-18T21:34:25.721223] [INFO ] [MAIN ] SBR: Full history saved. [2025-09-18T21:34:25.721315] [INFO ] [MAIN ] Update Progress: 1876/2372 symbols completed. SBR took 28.6s. Estimated remaining: 1h 12m 33s. Rate: 6.8 symbols/min [2025-09-18T21:34:25.897680] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:34:25.965025] [DEBUG] [LOCAL ] SBSW: Loaded 52923 existing records from primary storage. [2025-09-18T21:34:25.965210] [INFO ] [MAIN ] SBSW: Loaded 52923 existing records. [2025-09-18T21:34:26.122453] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-09-18T21:34:26.152412] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:34:26.152762] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-09-18T21:34:26.152833] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-09-18T21:34:26.154545] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-09-18T21:34:26.154611] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-09-18T21:34:26.353375] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-18T21:34:26.547724] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:34:26.919548] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-09-18T21:34:27.719539] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-11. [2025-09-18T21:34:27.907466] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-18T21:34:28.050607] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-18T21:34:28.519587] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-09-18T21:34:29.324750] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-09-18T21:34:29.362330] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-18T21:34:29.558219] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-18T21:34:30.119562] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-09-18T21:34:30.922518] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-09-18T21:34:30.927170] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-18T21:34:30.934833] [INFO ] [REMOTE ] SBH: Full fetch complete (72643 records). [2025-09-18T21:34:30.934937] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-09-18T21:34:31.331749] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-09-18T21:34:31.331847] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-09-18T21:34:31.332991] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-09-18T21:34:31.333057] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-09-18T21:34:31.336313] [DEBUG] [LOCAL ] SBH: Trimmed 72643 records to 50188 (keeping 200 days of data) [2025-09-18T21:34:31.679035] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-18T21:34:31.700378] [DEBUG] [LOCAL ] SBH: Primary data saved (50188 records). [2025-09-18T21:34:31.701429] [INFO ] [MAIN ] SBH: Full history saved. [2025-09-18T21:34:31.701318] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-18T21:34:31.704188] [INFO ] [MAIN ] Update Progress: 1877/2372 symbols completed. SBH took 47.1s. Estimated remaining: 1h 12m 23s. Rate: 6.8 symbols/min [2025-09-18T21:34:31.719492] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-09-18T21:34:32.519559] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-09-18T21:34:33.317104] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-18T21:34:33.320324] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-09-18T21:34:33.425117] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-18T21:34:34.119549] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-09-18T21:34:34.881360] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-18T21:34:34.919502] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-09-18T21:34:35.567170] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T21:34:35.719524] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-09-18T21:34:36.519551] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-09-18T21:34:36.775350] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-18T21:34:37.275468] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-18T21:34:37.319501] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-09-18T21:34:37.347625] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-18T21:34:38.119542] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-09-18T21:34:38.919543] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-09-18T21:34:39.066541] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-18T21:34:39.191837] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-18T21:34:39.719586] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-09-18T21:34:40.470889] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-18T21:34:40.519540] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-09-18T21:34:40.665753] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-18T21:34:41.319573] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-09-18T21:34:41.575180] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-18T21:34:42.119588] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-09-18T21:34:42.788820] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-18T21:34:42.815070] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-18T21:34:42.919617] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-09-18T21:34:43.719584] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-09-18T21:34:43.795491] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-18T21:34:43.798293] [INFO ] [REMOTE ] SBSI: Full fetch complete (20900 records). [2025-09-18T21:34:43.798374] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-09-18T21:34:44.170909] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-09-18T21:34:44.170991] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-09-18T21:34:44.171424] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-09-18T21:34:44.171462] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-09-18T21:34:44.172096] [DEBUG] [LOCAL ] SBSI: Trimmed 20900 records to 14759 (keeping 200 days of data) [2025-09-18T21:34:44.265090] [DEBUG] [LOCAL ] SBSI: Primary data saved (14759 records). [2025-09-18T21:34:44.265228] [INFO ] [MAIN ] SBSI: Full history saved. [2025-09-18T21:34:44.265340] [INFO ] [MAIN ] Update Progress: 1878/2372 symbols completed. SBSI took 24.3s. Estimated remaining: 1h 12m 15s. Rate: 6.8 symbols/min [2025-09-18T21:34:44.519529] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-09-18T21:34:45.710948] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-18T21:34:45.722319] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-09-18T21:34:45.841610] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T21:34:46.119556] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-09-18T21:34:47.609212] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T21:34:47.620431] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-09-18T21:34:47.658226] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-18T21:34:47.719506] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-09-18T21:34:49.290285] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-18T21:34:49.298447] [INFO ] [REMOTE ] SBS: Full fetch complete (70038 records). [2025-09-18T21:34:49.298565] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-09-18T21:34:49.697789] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-09-18T21:34:49.697974] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-09-18T21:34:49.699038] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-09-18T21:34:49.699124] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-09-18T21:34:49.729946] [DEBUG] [LOCAL ] SBS: Trimmed 70038 records to 49756 (keeping 200 days of data) [2025-09-18T21:34:49.731793] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-18T21:34:49.744224] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-09-18T21:34:50.041686] [DEBUG] [LOCAL ] SBS: Primary data saved (49756 records). [2025-09-18T21:34:50.041828] [INFO ] [MAIN ] SBS: Full history saved. [2025-09-18T21:34:50.041914] [INFO ] [MAIN ] Update Progress: 1879/2372 symbols completed. SBS took 42.2s. Estimated remaining: 1h 12m 6s. Rate: 6.8 symbols/min [2025-09-18T21:34:51.754241] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-18T21:34:51.766850] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-09-18T21:34:53.404500] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-18T21:34:53.412223] [INFO ] [REMOTE ] SBSW: Full fetch complete (76328 records). [2025-09-18T21:34:53.412370] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-09-18T21:34:53.825615] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-09-18T21:34:53.825772] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-09-18T21:34:53.826875] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-09-18T21:34:53.826999] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-09-18T21:34:53.828615] [DEBUG] [LOCAL ] SBSW: Trimmed 76328 records to 53305 (keeping 200 days of data) [2025-09-18T21:34:54.144373] [DEBUG] [LOCAL ] SBSW: Primary data saved (53305 records). [2025-09-18T21:34:54.144514] [INFO ] [MAIN ] SBSW: Full history saved. [2025-09-18T21:34:54.144598] [INFO ] [MAIN ] Update Progress: 1880/2372 symbols completed. SBSW took 28.4s. Estimated remaining: 1h 11m 56s. Rate: 6.8 symbols/min [2025-09-18T21:34:54.746354] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:34:54.839119] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:34:54.840364] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:34:54.866401] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:34:54.866685] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-09-18T21:34:54.866931] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-09-18T21:34:54.868364] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-09-18T21:34:54.868904] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-18T21:34:54.869009] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-18T21:34:54.869064] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-09-18T21:34:54.961360] [DEBUG] [LOCAL ] SCD: Loaded 12610 existing records from primary storage. [2025-09-18T21:34:54.979135] [INFO ] [MAIN ] SCD: Loaded 12610 existing records. [2025-09-18T21:34:55.264841] [DEBUG] [LOCAL ] SCCO: Loaded 49388 existing records from primary storage. [2025-09-18T21:34:55.341820] [INFO ] [MAIN ] SCCO: Loaded 49388 existing records. [2025-09-18T21:34:55.398601] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:34:55.458879] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-09-18T21:34:55.459624] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-09-18T21:34:55.459879] [INFO ] [MAIN ] SCHW: Loaded 53685 existing records. [2025-09-18T21:34:55.459964] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-09-18T21:34:55.535837] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-09-18T21:34:55.554749] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-09-18T21:34:55.814022] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:34:55.896110] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-11. [2025-09-18T21:34:55.912538] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:34:56.010732] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:34:56.010816] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-09-18T21:34:56.045509] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-09-18T21:34:56.069495] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-09-18T21:34:56.060819] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-09-18T21:34:56.069676] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-09-18T21:34:56.096968] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-09-18T21:34:56.191994] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-09-18T21:34:56.207101] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-09-18T21:34:56.397800] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-18T21:34:56.477298] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-09-18T21:34:56.536977] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:34:56.544981] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-11. [2025-09-18T21:34:56.945925] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:34:56.958259] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-18T21:34:56.958574] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-11. [2025-09-18T21:34:56.983055] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-09-18T21:34:57.017179] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:34:57.017716] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-11. [2025-09-18T21:34:57.311088] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-18T21:34:57.312086] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-18T21:34:57.317901] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-18T21:34:57.319853] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-09-18T21:34:57.656423] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-18T21:34:57.657331] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-18T21:34:57.883041] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-18T21:34:57.883890] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-18T21:34:57.940306] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-18T21:34:58.106186] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-18T21:34:58.119544] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-18T21:34:58.458201] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-18T21:34:58.925391] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-18T21:34:58.940850] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-11 (1.98 seconds). [2025-09-18T21:34:58.991129] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-18T21:34:59.646479] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T21:34:59.719544] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-09-18T21:35:00.519567] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-09-18T21:35:01.251711] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-18T21:35:01.319568] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-09-18T21:35:02.119586] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-09-18T21:35:02.425445] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-18T21:35:02.624040] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-18T21:35:02.781295] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-18T21:35:02.919543] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-09-18T21:35:03.719531] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-09-18T21:35:04.519531] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-09-18T21:35:04.589724] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-18T21:35:04.623310] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-18T21:35:05.319545] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-09-18T21:35:06.047068] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-18T21:35:06.119506] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-18T21:35:06.330718] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-18T21:35:06.658847] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-18T21:35:06.919550] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-09-18T21:35:07.657914] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-18T21:35:07.719498] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-09-18T21:35:08.471568] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-18T21:35:08.519576] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-09-18T21:35:09.319544] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-09-18T21:35:10.119605] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-09-18T21:35:10.181602] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-18T21:35:10.500398] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-18T21:35:10.919570] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-18T21:35:11.230319] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-18T21:35:11.719516] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-09-18T21:35:11.777128] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-18T21:35:12.519545] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-09-18T21:35:13.319543] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-18T21:35:13.490311] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-18T21:35:13.528565] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-18T21:35:13.585371] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-18T21:35:13.586132] [INFO ] [REMOTE ] SBXD: Full fetch complete (3070 records). [2025-09-18T21:35:13.586201] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-09-18T21:35:13.769707] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-09-18T21:35:13.769984] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:35:13.770073] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:35:13.770164] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-18T21:35:13.770252] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-18T21:35:13.770321] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-09-18T21:35:13.770395] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-09-18T21:35:13.770508] [INFO ] [MAIN ] Update Progress: 1881/2372 symbols completed. SBXD took 19.6s. Estimated remaining: 1h 11m 50s. Rate: 6.8 symbols/min [2025-09-18T21:35:14.009926] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:35:14.056335] [DEBUG] [LOCAL ] SCI: Loaded 46762 existing records from primary storage. [2025-09-18T21:35:14.056481] [INFO ] [MAIN ] SCI: Loaded 46762 existing records. [2025-09-18T21:35:14.124744] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-09-18T21:35:14.235971] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:35:14.236237] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-09-18T21:35:14.236291] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-09-18T21:35:14.237668] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-09-18T21:35:14.237729] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-09-18T21:35:14.607928] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:35:14.919537] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-09-18T21:35:15.659495] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-18T21:35:15.719493] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-09-18T21:35:15.808329] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-18T21:35:16.387975] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-18T21:35:16.390280] [INFO ] [REMOTE ] SCD: Full fetch complete (16034 records). [2025-09-18T21:35:16.390365] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-09-18T21:35:16.533882] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-09-18T21:35:16.762906] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-09-18T21:35:16.762986] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-09-18T21:35:16.763336] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-09-18T21:35:16.763376] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-09-18T21:35:16.763967] [DEBUG] [LOCAL ] SCD: Trimmed 16034 records to 12673 (keeping 200 days of data) [2025-09-18T21:35:16.846709] [DEBUG] [LOCAL ] SCD: Primary data saved (12673 records). [2025-09-18T21:35:16.846873] [INFO ] [MAIN ] SCD: Full history saved. [2025-09-18T21:35:16.846965] [INFO ] [MAIN ] Update Progress: 1882/2372 symbols completed. SCD took 22.7s. Estimated remaining: 1h 11m 39s. Rate: 6.8 symbols/min [2025-09-18T21:35:17.019768] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:35:17.035987] [DEBUG] [LOCAL ] SCL: Loaded 14788 existing records from primary storage. [2025-09-18T21:35:17.036117] [INFO ] [MAIN ] SCL: Loaded 14788 existing records. [2025-09-18T21:35:17.218245] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:35:17.218516] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-09-18T21:35:17.218567] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-09-18T21:35:17.219118] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-09-18T21:35:17.219181] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-09-18T21:35:17.328546] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-09-18T21:35:17.618235] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:35:18.119504] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-11. [2025-09-18T21:35:18.375510] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-18T21:35:18.919526] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-09-18T21:35:19.200984] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-18T21:35:19.241521] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T21:35:19.719533] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-09-18T21:35:20.519549] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-09-18T21:35:20.644387] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-18T21:35:21.106430] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-18T21:35:21.126782] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-18T21:35:21.319535] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-09-18T21:35:22.119600] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-09-18T21:35:22.919624] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-09-18T21:35:23.016271] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-18T21:35:23.719596] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-09-18T21:35:23.743281] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T21:35:23.943965] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-18T21:35:24.519607] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-09-18T21:35:25.246513] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-18T21:35:25.319542] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-09-18T21:35:26.119551] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-09-18T21:35:26.379034] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-18T21:35:26.723232] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-18T21:35:26.864965] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-18T21:35:26.871878] [INFO ] [REMOTE ] SCCO: Full fetch complete (70522 records). [2025-09-18T21:35:26.872031] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-09-18T21:35:26.926452] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-11. [2025-09-18T21:35:27.300208] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-09-18T21:35:27.300343] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-09-18T21:35:27.301508] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-09-18T21:35:27.301585] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-09-18T21:35:27.303812] [DEBUG] [LOCAL ] SCCO: Trimmed 70522 records to 49767 (keeping 200 days of data) [2025-09-18T21:35:27.614274] [DEBUG] [LOCAL ] SCCO: Primary data saved (49767 records). [2025-09-18T21:35:27.614452] [INFO ] [MAIN ] SCCO: Full history saved. [2025-09-18T21:35:27.614548] [INFO ] [MAIN ] Update Progress: 1883/2372 symbols completed. SCCO took 33.5s. Estimated remaining: 1h 11m 31s. Rate: 6.8 symbols/min [2025-09-18T21:35:27.720195] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-09-18T21:35:27.798285] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:35:27.820988] [DEBUG] [LOCAL ] SCM: Loaded 20182 existing records from primary storage. [2025-09-18T21:35:27.821185] [INFO ] [MAIN ] SCM: Loaded 20182 existing records. [2025-09-18T21:35:28.001587] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:35:28.001858] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-09-18T21:35:28.001919] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-09-18T21:35:28.002481] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-09-18T21:35:28.002540] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-09-18T21:35:28.367240] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:35:28.429899] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-18T21:35:28.519546] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-11. [2025-09-18T21:35:28.823011] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-18T21:35:29.319580] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-09-18T21:35:29.364933] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-18T21:35:30.119557] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-09-18T21:35:30.433569] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-18T21:35:30.899298] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-18T21:35:30.919554] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-09-18T21:35:31.719550] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-09-18T21:35:32.003565] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-18T21:35:32.519585] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-09-18T21:35:33.252491] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-18T21:35:33.319505] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-09-18T21:35:33.376870] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-18T21:35:34.119600] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-09-18T21:35:34.705137] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-18T21:35:34.919555] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-09-18T21:35:35.719609] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-09-18T21:35:35.903813] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-18T21:35:36.087156] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-18T21:35:36.484526] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-18T21:35:36.519509] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-09-18T21:35:37.319545] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-09-18T21:35:37.765559] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-18T21:35:38.119625] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-09-18T21:35:38.142627] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-18T21:35:38.720964] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-18T21:35:38.729498] [INFO ] [REMOTE ] SCHW: Full fetch complete (77560 records). [2025-09-18T21:35:38.729754] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-09-18T21:35:38.926893] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-09-18T21:35:39.139166] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-09-18T21:35:39.139264] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-09-18T21:35:39.140370] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-09-18T21:35:39.140442] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-09-18T21:35:39.141956] [DEBUG] [LOCAL ] SCHW: Trimmed 77560 records to 54075 (keeping 200 days of data) [2025-09-18T21:35:39.483316] [DEBUG] [LOCAL ] SCHW: Primary data saved (54075 records). [2025-09-18T21:35:39.483492] [INFO ] [MAIN ] SCHW: Full history saved. [2025-09-18T21:35:39.483593] [INFO ] [MAIN ] Update Progress: 1884/2372 symbols completed. SCHW took 45.3s. Estimated remaining: 1h 11m 23s. Rate: 6.8 symbols/min [2025-09-18T21:35:39.652680] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:35:39.693071] [DEBUG] [LOCAL ] SCS: Loaded 42799 existing records from primary storage. [2025-09-18T21:35:39.693264] [INFO ] [MAIN ] SCS: Loaded 42799 existing records. [2025-09-18T21:35:39.724718] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-09-18T21:35:39.876072] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:35:39.876407] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-09-18T21:35:39.876464] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-09-18T21:35:39.877550] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-09-18T21:35:39.877618] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-09-18T21:35:40.136392] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-18T21:35:40.257013] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:35:40.519555] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-09-18T21:35:41.264263] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-18T21:35:41.319513] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-09-18T21:35:41.558511] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-18T21:35:42.119552] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-09-18T21:35:42.919515] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-09-18T21:35:43.011875] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-18T21:35:43.050736] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-18T21:35:43.054830] [INFO ] [REMOTE ] SCL: Full fetch complete (20781 records). [2025-09-18T21:35:43.054935] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-09-18T21:35:43.419060] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-09-18T21:35:43.419153] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-09-18T21:35:43.419558] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-09-18T21:35:43.419597] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-09-18T21:35:43.420193] [DEBUG] [LOCAL ] SCL: Trimmed 20781 records to 14926 (keeping 200 days of data) [2025-09-18T21:35:43.509005] [DEBUG] [LOCAL ] SCL: Primary data saved (14926 records). [2025-09-18T21:35:43.509147] [INFO ] [MAIN ] SCL: Full history saved. [2025-09-18T21:35:43.509231] [INFO ] [MAIN ] Update Progress: 1885/2372 symbols completed. SCL took 26.7s. Estimated remaining: 1h 11m 13s. Rate: 6.8 symbols/min [2025-09-18T21:35:43.679070] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:35:43.709504] [DEBUG] [LOCAL ] SD: Loaded 29207 existing records from primary storage. [2025-09-18T21:35:43.709869] [INFO ] [MAIN ] SD: Loaded 29207 existing records. [2025-09-18T21:35:43.724595] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-09-18T21:35:43.914826] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:35:43.916078] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-18T21:35:43.920822] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-09-18T21:35:43.920905] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-09-18T21:35:43.921751] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-09-18T21:35:43.921831] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-09-18T21:35:44.282559] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:35:44.519587] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-11. [2025-09-18T21:35:45.319535] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-11. [2025-09-18T21:35:45.399865] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-18T21:35:45.864628] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-18T21:35:46.119557] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-09-18T21:35:46.352944] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-18T21:35:46.919564] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-09-18T21:35:47.244074] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-18T21:35:47.719553] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-09-18T21:35:48.495918] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-18T21:35:48.519514] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-09-18T21:35:49.319556] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-09-18T21:35:49.475551] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-18T21:35:49.538461] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-18T21:35:49.931040] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-18T21:35:50.119576] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-09-18T21:35:50.919535] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-09-18T21:35:51.075736] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-18T21:35:51.719562] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-09-18T21:35:52.276213] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-18T21:35:52.519580] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-09-18T21:35:52.842829] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-18T21:35:53.319606] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-09-18T21:35:53.436757] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-18T21:35:54.119552] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-09-18T21:35:54.919516] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-09-18T21:35:54.963131] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-18T21:35:55.013406] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-18T21:35:55.719546] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-09-18T21:35:56.112507] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-18T21:35:56.519535] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-09-18T21:35:56.677192] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-18T21:35:56.680684] [INFO ] [REMOTE ] SCM: Full fetch complete (28290 records). [2025-09-18T21:35:56.680794] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-09-18T21:35:57.062761] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-09-18T21:35:57.062880] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-09-18T21:35:57.063454] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-09-18T21:35:57.063503] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-09-18T21:35:57.065847] [DEBUG] [LOCAL ] SCM: Trimmed 28290 records to 20323 (keeping 200 days of data) [2025-09-18T21:35:57.191780] [DEBUG] [LOCAL ] SCM: Primary data saved (20323 records). [2025-09-18T21:35:57.191910] [INFO ] [MAIN ] SCM: Full history saved. [2025-09-18T21:35:57.192017] [INFO ] [MAIN ] Update Progress: 1886/2372 symbols completed. SCM took 29.6s. Estimated remaining: 1h 11m 6s. Rate: 6.8 symbols/min [2025-09-18T21:35:57.331300] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-09-18T21:35:57.364595] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:35:57.376530] [DEBUG] [LOCAL ] SDHC: Loaded 10603 existing records from primary storage. [2025-09-18T21:35:57.376670] [INFO ] [MAIN ] SDHC: Loaded 10603 existing records. [2025-09-18T21:35:57.559633] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:35:57.559908] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-09-18T21:35:57.559959] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-09-18T21:35:57.560373] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-09-18T21:35:57.560433] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-09-18T21:35:57.938194] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:35:57.942058] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-18T21:35:58.119539] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-11. [2025-09-18T21:35:58.905275] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T21:35:58.919938] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-09-18T21:35:58.920849] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-18T21:35:59.719600] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-09-18T21:36:00.516567] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-18T21:36:00.525188] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-09-18T21:36:00.563117] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T21:36:01.319566] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-09-18T21:36:02.055506] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-18T21:36:02.119563] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-09-18T21:36:02.919542] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-09-18T21:36:03.511296] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-18T21:36:03.719546] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-09-18T21:36:03.840452] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-18T21:36:04.397932] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-18T21:36:04.519555] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-09-18T21:36:04.990632] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-18T21:36:05.111743] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-18T21:36:05.319572] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-09-18T21:36:06.119550] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-09-18T21:36:06.785578] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-18T21:36:06.919570] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-09-18T21:36:07.585788] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T21:36:07.606387] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-18T21:36:07.719546] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-09-18T21:36:08.519550] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-09-18T21:36:09.180733] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T21:36:09.187110] [INFO ] [REMOTE ] SCI: Full fetch complete (66987 records). [2025-09-18T21:36:09.187275] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-09-18T21:36:09.330399] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-09-18T21:36:09.590087] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-09-18T21:36:09.590171] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-09-18T21:36:09.591157] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-09-18T21:36:09.591222] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-09-18T21:36:09.595208] [DEBUG] [LOCAL ] SCI: Trimmed 66987 records to 47062 (keeping 200 days of data) [2025-09-18T21:36:09.940741] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-18T21:36:09.938847] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-18T21:36:09.960319] [DEBUG] [LOCAL ] SCI: Primary data saved (47062 records). [2025-09-18T21:36:09.960709] [INFO ] [MAIN ] SCI: Full history saved. [2025-09-18T21:36:09.960865] [INFO ] [MAIN ] Update Progress: 1887/2372 symbols completed. SCI took 56.2s. Estimated remaining: 1h 10m 58s. Rate: 6.8 symbols/min [2025-09-18T21:36:10.129438] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-09-18T21:36:10.133315] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:36:10.149050] [DEBUG] [LOCAL ] SDHY: Loaded 10736 existing records from primary storage. [2025-09-18T21:36:10.149679] [INFO ] [MAIN ] SDHY: Loaded 10736 existing records. [2025-09-18T21:36:10.365022] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:36:10.365291] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-09-18T21:36:10.365339] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-09-18T21:36:10.365779] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-09-18T21:36:10.365841] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-09-18T21:36:10.726282] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:36:10.919494] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-11. [2025-09-18T21:36:11.000033] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-18T21:36:11.719598] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-09-18T21:36:11.762321] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-18T21:36:12.519542] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-09-18T21:36:12.647504] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-18T21:36:13.319604] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-09-18T21:36:14.119570] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-09-18T21:36:14.895567] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-18T21:36:14.919599] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-09-18T21:36:14.941157] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-18T21:36:15.719555] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-09-18T21:36:15.756104] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T21:36:16.191876] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-18T21:36:16.404934] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-18T21:36:16.519539] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-09-18T21:36:17.319574] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-09-18T21:36:18.048993] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-18T21:36:18.056387] [INFO ] [REMOTE ] SCS: Full fetch complete (59644 records). [2025-09-18T21:36:18.056576] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-09-18T21:36:18.126221] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-09-18T21:36:18.187271] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-18T21:36:18.225707] [INFO ] [REMOTE ] SDHC: Full fetch complete (16898 records). [2025-09-18T21:36:18.248427] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-09-18T21:36:18.798312] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-09-18T21:36:18.803613] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-09-18T21:36:18.810001] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-09-18T21:36:18.815210] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-09-18T21:36:18.868224] [DEBUG] [LOCAL ] SCS: Trimmed 59644 records to 43154 (keeping 200 days of data) [2025-09-18T21:36:18.881234] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-09-18T21:36:18.881637] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-09-18T21:36:18.881979] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-09-18T21:36:18.882070] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-09-18T21:36:18.883056] [DEBUG] [LOCAL ] SDHC: Trimmed 16898 records to 10681 (keeping 200 days of data) [2025-09-18T21:36:18.983534] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-09-18T21:36:19.072163] [DEBUG] [LOCAL ] SDHC: Primary data saved (10681 records). [2025-09-18T21:36:19.072859] [INFO ] [MAIN ] SDHC: Full history saved. [2025-09-18T21:36:19.073553] [INFO ] [MAIN ] Update Progress: 1888/2372 symbols completed. SDHC took 21.9s. Estimated remaining: 1h 10m 49s. Rate: 6.8 symbols/min [2025-09-18T21:36:19.253329] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:36:19.329057] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-18T21:36:19.361401] [INFO ] [REMOTE ] SD: Full fetch complete (41023 records). [2025-09-18T21:36:19.362341] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-09-18T21:36:19.617557] [DEBUG] [LOCAL ] SDRL: Loaded 42153 existing records from primary storage. [2025-09-18T21:36:19.659707] [INFO ] [MAIN ] SDRL: Loaded 42153 existing records. [2025-09-18T21:36:19.926899] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-09-18T21:36:19.937807] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-09-18T21:36:19.944474] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-09-18T21:36:19.971567] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-09-18T21:36:20.025714] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:36:20.034456] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-09-18T21:36:20.035095] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-09-18T21:36:20.037027] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T21:36:20.041870] [DEBUG] [LOCAL ] SD: Trimmed 41023 records to 29439 (keeping 200 days of data) [2025-09-18T21:36:20.042250] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-09-18T21:36:20.044950] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-09-18T21:36:20.045838] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-09-18T21:36:20.542526] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:36:20.544450] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-11. [2025-09-18T21:36:20.549162] [DEBUG] [LOCAL ] SCS: Primary data saved (43154 records). [2025-09-18T21:36:20.550244] [INFO ] [MAIN ] SCS: Full history saved. [2025-09-18T21:36:20.550422] [INFO ] [MAIN ] Update Progress: 1889/2372 symbols completed. SCS took 41.1s. Estimated remaining: 1h 10m 39s. Rate: 6.8 symbols/min [2025-09-18T21:36:20.743990] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:36:20.796373] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-18T21:36:20.854474] [DEBUG] [LOCAL ] SD: Primary data saved (29439 records). [2025-09-18T21:36:20.854707] [INFO ] [MAIN ] SD: Full history saved. [2025-09-18T21:36:20.854854] [INFO ] [MAIN ] Update Progress: 1890/2372 symbols completed. SD took 37.3s. Estimated remaining: 1h 10m 28s. Rate: 6.8 symbols/min [2025-09-18T21:36:20.978488] [DEBUG] [LOCAL ] SE: Loaded 53400 existing records from primary storage. [2025-09-18T21:36:20.984424] [INFO ] [MAIN ] SE: Loaded 53400 existing records. [2025-09-18T21:36:21.163616] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:36:21.264789] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:36:21.265069] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-09-18T21:36:21.265119] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-18T21:36:21.266424] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-09-18T21:36:21.266497] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-09-18T21:36:21.325734] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-09-18T21:36:21.550893] [DEBUG] [LOCAL ] SEE: Loaded 48471 existing records from primary storage. [2025-09-18T21:36:21.562350] [INFO ] [MAIN ] SEE: Loaded 48471 existing records. [2025-09-18T21:36:21.798441] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:36:21.856872] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:36:21.857440] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-09-18T21:36:21.857545] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-09-18T21:36:21.859202] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-09-18T21:36:21.859277] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-09-18T21:36:22.098300] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-18T21:36:22.123416] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-11. [2025-09-18T21:36:22.177887] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-18T21:36:22.269441] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:36:22.919542] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-09-18T21:36:23.657552] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-18T21:36:23.719516] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-09-18T21:36:24.243428] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-11 (2.12 seconds). [2025-09-18T21:36:24.519573] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-11. [2025-09-18T21:36:24.744398] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-18T21:36:25.319581] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-09-18T21:36:25.882454] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-18T21:36:25.897906] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-18T21:36:26.119553] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-09-18T21:36:26.919582] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-09-18T21:36:27.719590] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-09-18T21:36:27.803309] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-18T21:36:28.350520] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-18T21:36:28.519617] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-09-18T21:36:28.590361] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-18T21:36:29.188564] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-18T21:36:29.319592] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-09-18T21:36:30.119563] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-09-18T21:36:30.619191] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-18T21:36:30.919557] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-09-18T21:36:31.719513] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-09-18T21:36:31.780266] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-18T21:36:32.093623] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-18T21:36:32.519549] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-09-18T21:36:32.987442] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-18T21:36:33.056223] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-18T21:36:33.319589] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-09-18T21:36:33.925669] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-18T21:36:33.927874] [INFO ] [REMOTE ] SDHY: Full fetch complete (16298 records). [2025-09-18T21:36:33.927947] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-09-18T21:36:34.124734] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-09-18T21:36:34.297765] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-09-18T21:36:34.297856] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-09-18T21:36:34.298216] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-09-18T21:36:34.298256] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-09-18T21:36:34.298905] [DEBUG] [LOCAL ] SDHY: Trimmed 16298 records to 10805 (keeping 200 days of data) [2025-09-18T21:36:34.366857] [DEBUG] [LOCAL ] SDHY: Primary data saved (10805 records). [2025-09-18T21:36:34.367014] [INFO ] [MAIN ] SDHY: Full history saved. [2025-09-18T21:36:34.367136] [INFO ] [MAIN ] Update Progress: 1891/2372 symbols completed. SDHY took 24.4s. Estimated remaining: 1h 10m 20s. Rate: 6.8 symbols/min [2025-09-18T21:36:34.550210] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:36:34.567094] [DEBUG] [LOCAL ] SEG: Loaded 13948 existing records from primary storage. [2025-09-18T21:36:34.567240] [INFO ] [MAIN ] SEG: Loaded 13948 existing records. [2025-09-18T21:36:34.746898] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:36:34.747145] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-09-18T21:36:34.747193] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-09-18T21:36:34.747713] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-09-18T21:36:34.747773] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-09-18T21:36:34.926374] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-09-18T21:36:35.100057] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:36:35.719503] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-09-18T21:36:36.003523] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-18T21:36:36.523170] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-09-18T21:36:36.528473] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-18T21:36:37.033474] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-18T21:36:37.319624] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-09-18T21:36:38.119567] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-09-18T21:36:38.503265] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-18T21:36:38.919549] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-09-18T21:36:39.057793] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-18T21:36:39.217027] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-18T21:36:39.719546] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-09-18T21:36:40.519540] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-11. [2025-09-18T21:36:40.831201] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-18T21:36:41.052073] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T21:36:41.116258] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-18T21:36:41.319591] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-09-18T21:36:42.119627] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-09-18T21:36:42.919566] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-09-18T21:36:43.185562] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-18T21:36:43.431287] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-18T21:36:43.699748] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-18T21:36:43.719505] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-09-18T21:36:44.519551] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-09-18T21:36:45.319597] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-09-18T21:36:45.452816] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-18T21:36:45.848840] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-18T21:36:45.867722] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-18T21:36:46.119531] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-09-18T21:36:46.919571] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-09-18T21:36:47.076253] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-18T21:36:47.719596] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-09-18T21:36:48.519562] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-09-18T21:36:48.981627] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-18T21:36:49.193706] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-18T21:36:49.319578] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-09-18T21:36:50.043969] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-18T21:36:50.119500] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-09-18T21:36:50.638120] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-18T21:36:50.919518] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-09-18T21:36:51.529030] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-18T21:36:51.719568] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-09-18T21:36:52.495282] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-18T21:36:52.502209] [INFO ] [REMOTE ] SEE: Full fetch complete (69440 records). [2025-09-18T21:36:52.502358] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-09-18T21:36:52.524696] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-09-18T21:36:52.903265] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-09-18T21:36:52.903477] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-09-18T21:36:52.904634] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-09-18T21:36:52.904726] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-09-18T21:36:52.906310] [DEBUG] [LOCAL ] SEE: Trimmed 69440 records to 48830 (keeping 200 days of data) [2025-09-18T21:36:53.218552] [DEBUG] [LOCAL ] SEE: Primary data saved (48830 records). [2025-09-18T21:36:53.218766] [INFO ] [MAIN ] SEE: Full history saved. [2025-09-18T21:36:53.218880] [INFO ] [MAIN ] Update Progress: 1892/2372 symbols completed. SEE took 32.4s. Estimated remaining: 1h 10m 14s. Rate: 6.8 symbols/min [2025-09-18T21:36:53.326998] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-09-18T21:36:53.439106] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:36:53.467451] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T21:36:53.504556] [DEBUG] [LOCAL ] SEI: Loaded 49604 existing records from primary storage. [2025-09-18T21:36:53.504779] [INFO ] [MAIN ] SEI: Loaded 49604 existing records. [2025-09-18T21:36:53.743244] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:36:53.743702] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-09-18T21:36:53.743779] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-09-18T21:36:53.746527] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-09-18T21:36:53.746468] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-18T21:36:53.746844] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-09-18T21:36:54.125410] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-09-18T21:36:54.131001] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:36:54.688086] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T21:36:54.906349] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-18T21:36:54.919481] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-09-18T21:36:55.631281] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-18T21:36:55.719522] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-09-18T21:36:56.428739] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-18T21:36:56.519530] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-11. [2025-09-18T21:36:57.319569] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-09-18T21:36:57.795930] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-18T21:36:58.119593] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-09-18T21:36:58.897530] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-18T21:36:58.919507] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-09-18T21:36:59.022825] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-18T21:36:59.719560] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-09-18T21:37:00.187130] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-18T21:37:00.195391] [INFO ] [REMOTE ] SDRL: Full fetch complete (61767 records). [2025-09-18T21:37:00.195579] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-09-18T21:37:00.532463] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-09-18T21:37:00.589474] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-09-18T21:37:00.589558] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-09-18T21:37:00.590514] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-09-18T21:37:00.590591] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-09-18T21:37:00.591885] [DEBUG] [LOCAL ] SDRL: Trimmed 61767 records to 42440 (keeping 200 days of data) [2025-09-18T21:37:00.712183] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-18T21:37:00.858290] [DEBUG] [LOCAL ] SDRL: Primary data saved (42440 records). [2025-09-18T21:37:00.858426] [INFO ] [MAIN ] SDRL: Full history saved. [2025-09-18T21:37:00.859669] [INFO ] [MAIN ] Update Progress: 1893/2372 symbols completed. SDRL took 41.8s. Estimated remaining: 1h 10m 5s. Rate: 6.8 symbols/min [2025-09-18T21:37:01.027439] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:37:01.070741] [DEBUG] [LOCAL ] SEM: Loaded 43135 existing records from primary storage. [2025-09-18T21:37:01.070888] [INFO ] [MAIN ] SEM: Loaded 43135 existing records. [2025-09-18T21:37:01.247881] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:37:01.248144] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-09-18T21:37:01.248193] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-09-18T21:37:01.249618] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-09-18T21:37:01.249707] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-09-18T21:37:01.326701] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-09-18T21:37:01.612144] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:37:02.119548] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-09-18T21:37:02.274357] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-18T21:37:02.612463] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-18T21:37:02.614516] [INFO ] [REMOTE ] SEG: Full fetch complete (19775 records). [2025-09-18T21:37:02.614589] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-09-18T21:37:02.924620] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-11. [2025-09-18T21:37:02.982129] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-09-18T21:37:02.982209] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-09-18T21:37:02.982710] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-09-18T21:37:02.982775] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-09-18T21:37:02.983619] [DEBUG] [LOCAL ] SEG: Trimmed 19775 records to 14020 (keeping 200 days of data) [2025-09-18T21:37:03.068029] [DEBUG] [LOCAL ] SEG: Primary data saved (14020 records). [2025-09-18T21:37:03.068149] [INFO ] [MAIN ] SEG: Full history saved. [2025-09-18T21:37:03.068228] [INFO ] [MAIN ] Update Progress: 1894/2372 symbols completed. SEG took 28.7s. Estimated remaining: 1h 9m 54s. Rate: 6.8 symbols/min [2025-09-18T21:37:03.246896] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:37:03.280904] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-18T21:37:03.324414] [DEBUG] [LOCAL ] SEMR: Loaded 41753 existing records from primary storage. [2025-09-18T21:37:03.324554] [INFO ] [MAIN ] SEMR: Loaded 41753 existing records. [2025-09-18T21:37:03.502255] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:37:03.502487] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-09-18T21:37:03.502564] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-09-18T21:37:03.503425] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-09-18T21:37:03.503484] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-09-18T21:37:03.724807] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-09-18T21:37:03.858992] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:37:04.519535] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-09-18T21:37:04.645008] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-18T21:37:05.275354] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T21:37:05.319492] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-09-18T21:37:06.119569] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-11. [2025-09-18T21:37:06.360456] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-18T21:37:06.372240] [INFO ] [REMOTE ] SE: Full fetch complete (76960 records). [2025-09-18T21:37:06.372391] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-09-18T21:37:06.777536] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-09-18T21:37:06.777846] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-09-18T21:37:06.779196] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-09-18T21:37:06.779350] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-09-18T21:37:06.781517] [DEBUG] [LOCAL ] SE: Trimmed 76960 records to 53786 (keeping 200 days of data) [2025-09-18T21:37:06.895721] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-18T21:37:06.919694] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-09-18T21:37:07.084229] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-18T21:37:07.177554] [DEBUG] [LOCAL ] SE: Primary data saved (53786 records). [2025-09-18T21:37:07.177718] [INFO ] [MAIN ] SE: Full history saved. [2025-09-18T21:37:07.177868] [INFO ] [MAIN ] Update Progress: 1895/2372 symbols completed. SE took 46.6s. Estimated remaining: 1h 9m 44s. Rate: 6.8 symbols/min [2025-09-18T21:37:07.354288] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:37:07.403726] [DEBUG] [LOCAL ] SES: Loaded 51517 existing records from primary storage. [2025-09-18T21:37:07.403871] [INFO ] [MAIN ] SES: Loaded 51517 existing records. [2025-09-18T21:37:07.585940] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:37:07.586224] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-09-18T21:37:07.586274] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-09-18T21:37:07.587366] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-09-18T21:37:07.587426] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-09-18T21:37:07.728055] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-09-18T21:37:07.953754] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:37:08.519559] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-09-18T21:37:08.749302] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-18T21:37:09.019104] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-18T21:37:09.319544] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-09-18T21:37:09.706215] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-18T21:37:10.119542] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-11. [2025-09-18T21:37:10.919542] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-09-18T21:37:11.122638] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-18T21:37:11.632453] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-18T21:37:11.719494] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-09-18T21:37:12.219698] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-18T21:37:12.519584] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-09-18T21:37:13.319505] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-09-18T21:37:13.489791] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-18T21:37:13.670134] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-18T21:37:14.119560] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-09-18T21:37:14.919551] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-09-18T21:37:15.157835] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-18T21:37:15.261102] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-18T21:37:15.719548] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-09-18T21:37:16.519607] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-09-18T21:37:17.025202] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-18T21:37:17.183944] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-18T21:37:17.319550] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-09-18T21:37:17.864992] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-18T21:37:18.119537] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-09-18T21:37:18.919601] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-09-18T21:37:18.983479] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-18T21:37:19.719565] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-09-18T21:37:20.231613] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-18T21:37:20.401627] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-18T21:37:20.519524] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-09-18T21:37:21.292132] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-18T21:37:21.319535] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-09-18T21:37:21.733372] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-18T21:37:22.119609] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-09-18T21:37:22.919549] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-09-18T21:37:22.998172] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-18T21:37:23.448040] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T21:37:23.719559] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-09-18T21:37:24.378232] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T21:37:24.519617] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-09-18T21:37:25.103797] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T21:37:25.319554] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-09-18T21:37:25.774552] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-18T21:37:25.782394] [INFO ] [REMOTE ] SEI: Full fetch complete (69269 records). [2025-09-18T21:37:25.782563] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-09-18T21:37:26.134261] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-09-18T21:37:26.345448] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-09-18T21:37:26.345556] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-09-18T21:37:26.346753] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-09-18T21:37:26.346830] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-09-18T21:37:26.348507] [DEBUG] [LOCAL ] SEI: Trimmed 69269 records to 49991 (keeping 200 days of data) [2025-09-18T21:37:26.737890] [DEBUG] [LOCAL ] SEI: Primary data saved (49991 records). [2025-09-18T21:37:26.738064] [INFO ] [MAIN ] SEI: Full history saved. [2025-09-18T21:37:26.738178] [INFO ] [MAIN ] Update Progress: 1896/2372 symbols completed. SEI took 33.5s. Estimated remaining: 1h 9m 38s. Rate: 6.8 symbols/min [2025-09-18T21:37:26.921683] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-09-18T21:37:26.989861] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:37:27.035709] [DEBUG] [LOCAL ] SF: Loaded 41953 existing records from primary storage. [2025-09-18T21:37:27.050548] [INFO ] [MAIN ] SF: Loaded 41953 existing records. [2025-09-18T21:37:27.118241] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-18T21:37:27.274911] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:37:27.275171] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-09-18T21:37:27.275221] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-09-18T21:37:27.276536] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-09-18T21:37:27.276600] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-09-18T21:37:27.657314] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:37:27.693070] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T21:37:27.719533] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-11. [2025-09-18T21:37:28.519574] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-09-18T21:37:29.021188] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-18T21:37:29.203325] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-18T21:37:29.319534] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-09-18T21:37:29.872205] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-18T21:37:30.119570] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-09-18T21:37:30.472603] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-18T21:37:30.919568] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-09-18T21:37:31.186750] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-18T21:37:31.719561] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-09-18T21:37:32.248623] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-18T21:37:32.519549] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-09-18T21:37:33.066097] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-18T21:37:33.072358] [INFO ] [REMOTE ] SEM: Full fetch complete (61843 records). [2025-09-18T21:37:33.072481] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-09-18T21:37:33.329197] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-09-18T21:37:33.471579] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-09-18T21:37:33.471688] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-09-18T21:37:33.472779] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-09-18T21:37:33.472845] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-09-18T21:37:33.474237] [DEBUG] [LOCAL ] SEM: Trimmed 61843 records to 43446 (keeping 200 days of data) [2025-09-18T21:37:33.797350] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-18T21:37:33.797896] [DEBUG] [LOCAL ] SEM: Primary data saved (43446 records). [2025-09-18T21:37:33.798063] [INFO ] [MAIN ] SEM: Full history saved. [2025-09-18T21:37:33.807132] [INFO ] [MAIN ] Update Progress: 1897/2372 symbols completed. SEM took 32.9s. Estimated remaining: 1h 9m 29s. Rate: 6.8 symbols/min [2025-09-18T21:37:33.978310] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:37:33.985697] [DEBUG] [LOCAL ] SFB: Loaded 4084 existing records from primary storage. [2025-09-18T21:37:33.985837] [INFO ] [MAIN ] SFB: Loaded 4084 existing records. [2025-09-18T21:37:34.124671] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-09-18T21:37:34.179746] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:37:34.180021] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-09-18T21:37:34.180070] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-09-18T21:37:34.180334] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-09-18T21:37:34.180393] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-09-18T21:37:34.535435] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:37:34.919591] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-11. [2025-09-18T21:37:35.320893] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-11 (0.40 seconds). [2025-09-18T21:37:35.632940] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-18T21:37:35.678159] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-18T21:37:35.719501] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-09-18T21:37:36.519559] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-09-18T21:37:37.319519] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-09-18T21:37:37.356232] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T21:37:37.811804] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-18T21:37:38.119577] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-09-18T21:37:38.759852] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-18T21:37:38.919553] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-09-18T21:37:39.318513] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-18T21:37:39.321854] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-18T21:37:39.719547] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-09-18T21:37:40.519564] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-09-18T21:37:41.266895] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-18T21:37:41.319519] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-09-18T21:37:41.798683] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-18T21:37:42.119552] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-09-18T21:37:42.825042] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-18T21:37:42.919514] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-09-18T21:37:43.719578] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-09-18T21:37:43.839385] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-18T21:37:44.011503] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-18T21:37:44.018076] [INFO ] [REMOTE ] SEMR: Full fetch complete (58491 records). [2025-09-18T21:37:44.018196] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-09-18T21:37:44.130740] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-18T21:37:44.463198] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-09-18T21:37:44.463337] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-09-18T21:37:44.464298] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-09-18T21:37:44.464392] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-09-18T21:37:44.466125] [DEBUG] [LOCAL ] SEMR: Trimmed 58491 records to 42078 (keeping 200 days of data) [2025-09-18T21:37:44.520116] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-09-18T21:37:44.726807] [DEBUG] [LOCAL ] SEMR: Primary data saved (42078 records). [2025-09-18T21:37:44.726944] [INFO ] [MAIN ] SEMR: Full history saved. [2025-09-18T21:37:44.727043] [INFO ] [MAIN ] Update Progress: 1898/2372 symbols completed. SEMR took 41.7s. Estimated remaining: 1h 9m 21s. Rate: 6.8 symbols/min [2025-09-18T21:37:44.905517] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:37:44.927539] [DEBUG] [LOCAL ] SFBS: Loaded 21357 existing records from primary storage. [2025-09-18T21:37:44.927695] [INFO ] [MAIN ] SFBS: Loaded 21357 existing records. [2025-09-18T21:37:45.117318] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:37:45.117618] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-09-18T21:37:45.117714] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-09-18T21:37:45.118428] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-09-18T21:37:45.118502] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-09-18T21:37:45.324709] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-09-18T21:37:45.360461] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-18T21:37:45.500963] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:37:46.119619] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-09-18T21:37:46.665851] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-18T21:37:46.715423] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-18T21:37:46.919591] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-09-18T21:37:47.719555] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-11. [2025-09-18T21:37:48.519604] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-09-18T21:37:48.714308] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-18T21:37:48.996359] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-18T21:37:49.118627] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-18T21:37:49.319556] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-09-18T21:37:49.775830] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-18T21:37:50.119551] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-09-18T21:37:50.919545] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-09-18T21:37:51.335972] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-18T21:37:51.341400] [INFO ] [REMOTE ] SF: Full fetch complete (59223 records). [2025-09-18T21:37:51.341551] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-09-18T21:37:51.724001] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-09-18T21:37:51.740385] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-09-18T21:37:51.740498] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-09-18T21:37:51.741533] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-09-18T21:37:51.741612] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-09-18T21:37:51.743329] [DEBUG] [LOCAL ] SF: Trimmed 59223 records to 42264 (keeping 200 days of data) [2025-09-18T21:37:51.855928] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-18T21:37:52.030575] [DEBUG] [LOCAL ] SF: Primary data saved (42264 records). [2025-09-18T21:37:52.030741] [INFO ] [MAIN ] SF: Full history saved. [2025-09-18T21:37:52.030838] [INFO ] [MAIN ] Update Progress: 1899/2372 symbols completed. SF took 25.3s. Estimated remaining: 1h 9m 12s. Rate: 6.8 symbols/min [2025-09-18T21:37:52.205788] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:37:52.249377] [DEBUG] [LOCAL ] SFL: Loaded 45499 existing records from primary storage. [2025-09-18T21:37:52.249531] [INFO ] [MAIN ] SFL: Loaded 45499 existing records. [2025-09-18T21:37:52.434638] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:37:52.438785] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-18T21:37:52.440766] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-09-18T21:37:52.440831] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-09-18T21:37:52.442004] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-09-18T21:37:52.442069] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-09-18T21:37:52.524720] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-09-18T21:37:52.828904] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:37:53.319554] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-11. [2025-09-18T21:37:53.727958] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T21:37:54.119555] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-09-18T21:37:54.589000] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-18T21:37:54.718606] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-18T21:37:54.919528] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-09-18T21:37:55.719545] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-09-18T21:37:56.519550] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-09-18T21:37:56.767623] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-18T21:37:56.910918] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-18T21:37:56.911968] [INFO ] [REMOTE ] SFB: Full fetch complete (5720 records). [2025-09-18T21:37:56.912042] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-09-18T21:37:57.239420] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-18T21:37:57.324630] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-09-18T21:37:57.332185] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-09-18T21:37:57.333056] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-09-18T21:37:57.333262] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-09-18T21:37:57.333306] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-09-18T21:37:57.333747] [DEBUG] [LOCAL ] SFB: Trimmed 5720 records to 4099 (keeping 200 days of data) [2025-09-18T21:37:57.359590] [DEBUG] [LOCAL ] SFB: Primary data saved (4099 records). [2025-09-18T21:37:57.359720] [INFO ] [MAIN ] SFB: Full history saved. [2025-09-18T21:37:57.359818] [INFO ] [MAIN ] Update Progress: 1900/2372 symbols completed. SFB took 23.6s. Estimated remaining: 1h 9m 2s. Rate: 6.8 symbols/min [2025-09-18T21:37:57.538298] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:37:57.593238] [DEBUG] [LOCAL ] SG: Loaded 53460 existing records from primary storage. [2025-09-18T21:37:57.593432] [INFO ] [MAIN ] SG: Loaded 53460 existing records. [2025-09-18T21:37:57.781401] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:37:57.781726] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-09-18T21:37:57.781784] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-09-18T21:37:57.783220] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-09-18T21:37:57.783284] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-09-18T21:37:58.123194] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-09-18T21:37:58.161275] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:37:58.919563] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-11. [2025-09-18T21:37:59.268169] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-18T21:37:59.302121] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-18T21:37:59.719568] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-09-18T21:38:00.519526] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-09-18T21:38:00.590672] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-18T21:38:01.319604] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-09-18T21:38:01.648151] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-18T21:38:01.719975] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-18T21:38:01.726880] [INFO ] [REMOTE ] SES: Full fetch complete (74215 records). [2025-09-18T21:38:01.727004] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-09-18T21:38:02.125469] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-09-18T21:38:02.124703] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-09-18T21:38:02.125587] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-09-18T21:38:02.127636] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-09-18T21:38:02.127856] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-09-18T21:38:02.129404] [DEBUG] [LOCAL ] SES: Trimmed 74215 records to 51906 (keeping 200 days of data) [2025-09-18T21:38:02.447898] [DEBUG] [LOCAL ] SES: Primary data saved (51906 records). [2025-09-18T21:38:02.448065] [INFO ] [MAIN ] SES: Full history saved. [2025-09-18T21:38:02.448159] [INFO ] [MAIN ] Update Progress: 1901/2372 symbols completed. SES took 55.3s. Estimated remaining: 1h 8m 52s. Rate: 6.8 symbols/min [2025-09-18T21:38:02.627751] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:38:02.669710] [DEBUG] [LOCAL ] SGHC: Loaded 45384 existing records from primary storage. [2025-09-18T21:38:02.669908] [INFO ] [MAIN ] SGHC: Loaded 45384 existing records. [2025-09-18T21:38:02.852328] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:38:02.852572] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-09-18T21:38:02.852661] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-09-18T21:38:02.854064] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-09-18T21:38:02.854127] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-09-18T21:38:02.925256] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-09-18T21:38:03.227883] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:38:03.282715] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-18T21:38:03.719556] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-09-18T21:38:03.882723] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-18T21:38:03.953035] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-18T21:38:04.519542] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-09-18T21:38:05.303286] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T21:38:05.319495] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-09-18T21:38:05.352336] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-18T21:38:06.119546] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-09-18T21:38:06.918903] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-18T21:38:06.922013] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-11. [2025-09-18T21:38:07.724668] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-09-18T21:38:07.749431] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-18T21:38:08.408060] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-18T21:38:08.519555] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-09-18T21:38:08.929181] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-18T21:38:09.319605] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-09-18T21:38:09.655604] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-18T21:38:10.119532] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-09-18T21:38:10.138481] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-18T21:38:10.919535] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-09-18T21:38:11.719549] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-09-18T21:38:11.870705] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-18T21:38:11.922632] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-18T21:38:12.519544] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-09-18T21:38:12.955947] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-18T21:38:13.319615] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-09-18T21:38:14.119545] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-09-18T21:38:14.260175] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-18T21:38:14.919543] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-09-18T21:38:15.124535] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-18T21:38:15.621571] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-18T21:38:15.719524] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-09-18T21:38:16.434704] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T21:38:16.519501] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-09-18T21:38:16.820256] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-18T21:38:17.319609] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-09-18T21:38:18.119572] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-09-18T21:38:18.273441] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-18T21:38:18.763444] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-18T21:38:18.919771] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-09-18T21:38:19.653270] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T21:38:19.719555] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-09-18T21:38:19.805024] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-18T21:38:19.808505] [INFO ] [REMOTE ] SFBS: Full fetch complete (30150 records). [2025-09-18T21:38:19.808609] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-09-18T21:38:20.201518] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-09-18T21:38:20.201597] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-09-18T21:38:20.202222] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-09-18T21:38:20.202302] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-09-18T21:38:20.203056] [DEBUG] [LOCAL ] SFBS: Trimmed 30150 records to 21591 (keeping 200 days of data) [2025-09-18T21:38:20.334470] [DEBUG] [LOCAL ] SFBS: Primary data saved (21591 records). [2025-09-18T21:38:20.334606] [INFO ] [MAIN ] SFBS: Full history saved. [2025-09-18T21:38:20.334744] [INFO ] [MAIN ] Update Progress: 1902/2372 symbols completed. SFBS took 35.6s. Estimated remaining: 1h 8m 46s. Rate: 6.8 symbols/min [2025-09-18T21:38:20.507330] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:38:20.507521] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-09-18T21:38:20.507560] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-09-18T21:38:20.507738] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-09-18T21:38:20.507793] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-18T21:38:20.507838] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-18T21:38:20.507872] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-09-18T21:38:20.528741] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-09-18T21:38:20.870505] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:38:21.199231] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-18T21:38:21.319564] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-11. [2025-09-18T21:38:21.517094] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:38:21.517500] [WARN ] [REMOTE ] SGI: No data returned for month 2024-11 [2025-09-18T21:38:22.119536] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-09-18T21:38:22.316577] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:38:22.319666] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-09-18T21:38:22.321619] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-18T21:38:22.919574] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-09-18T21:38:23.719570] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-01. [2025-09-18T21:38:23.927846] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:38:23.928230] [WARN ] [REMOTE ] SGI: No data returned for month 2025-01 [2025-09-18T21:38:24.519515] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-02. [2025-09-18T21:38:25.066478] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-18T21:38:25.319529] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-09-18T21:38:25.522880] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-18T21:38:26.119582] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-09-18T21:38:26.919514] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-03. [2025-09-18T21:38:27.147024] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-18T21:38:27.666281] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-18T21:38:27.719502] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-09-18T21:38:28.519608] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-09-18T21:38:28.698280] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-18T21:38:28.970009] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-18T21:38:29.319556] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-09-18T21:38:29.863031] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-18T21:38:30.119575] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-09-18T21:38:30.834797] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-18T21:38:30.919510] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-09-18T21:38:31.416269] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T21:38:31.719546] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-09-18T21:38:32.348834] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-18T21:38:32.519545] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-09-18T21:38:32.856344] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-18T21:38:32.862513] [INFO ] [REMOTE ] SFL: Full fetch complete (65150 records). [2025-09-18T21:38:32.862614] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-09-18T21:38:33.259170] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-09-18T21:38:33.259269] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-09-18T21:38:33.260243] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-09-18T21:38:33.260307] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-09-18T21:38:33.261720] [DEBUG] [LOCAL ] SFL: Trimmed 65150 records to 45807 (keeping 200 days of data) [2025-09-18T21:38:33.327863] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-09-18T21:38:33.541414] [DEBUG] [LOCAL ] SFL: Primary data saved (45807 records). [2025-09-18T21:38:33.541547] [INFO ] [MAIN ] SFL: Full history saved. [2025-09-18T21:38:33.541671] [INFO ] [MAIN ] Update Progress: 1903/2372 symbols completed. SFL took 41.5s. Estimated remaining: 1h 8m 38s. Rate: 6.8 symbols/min [2025-09-18T21:38:33.720915] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:38:33.731224] [DEBUG] [LOCAL ] SGU: Loaded 6642 existing records from primary storage. [2025-09-18T21:38:33.731349] [INFO ] [MAIN ] SGU: Loaded 6642 existing records. [2025-09-18T21:38:33.914558] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:38:33.914977] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-09-18T21:38:33.915051] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-09-18T21:38:33.915495] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-09-18T21:38:33.915572] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-09-18T21:38:34.124793] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-04. [2025-09-18T21:38:34.295990] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:38:34.320697] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-18T21:38:34.328933] [INFO ] [REMOTE ] SGHC: Full fetch complete (62915 records). [2025-09-18T21:38:34.329051] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-09-18T21:38:34.714703] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-09-18T21:38:34.714793] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-09-18T21:38:34.715858] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-09-18T21:38:34.715944] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-09-18T21:38:34.717709] [DEBUG] [LOCAL ] SGHC: Trimmed 62915 records to 45772 (keeping 200 days of data) [2025-09-18T21:38:34.937590] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-11. [2025-09-18T21:38:35.014734] [DEBUG] [LOCAL ] SGHC: Primary data saved (45772 records). [2025-09-18T21:38:35.014928] [INFO ] [MAIN ] SGHC: Full history saved. [2025-09-18T21:38:35.015397] [INFO ] [MAIN ] Update Progress: 1904/2372 symbols completed. SGHC took 32.6s. Estimated remaining: 1h 8m 28s. Rate: 6.8 symbols/min [2025-09-18T21:38:35.144681] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-18T21:38:35.197985] [INFO ] [REMOTE ] SG: Full fetch complete (77099 records). [2025-09-18T21:38:35.220857] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-09-18T21:38:35.224740] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:38:35.579961] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-18T21:38:35.640626] [DEBUG] [LOCAL ] SHAK: Loaded 49214 existing records from primary storage. [2025-09-18T21:38:35.663963] [INFO ] [MAIN ] SHAK: Loaded 49214 existing records. [2025-09-18T21:38:35.779978] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-09-18T21:38:35.728329] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-09-18T21:38:35.811332] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-09-18T21:38:35.825054] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-09-18T21:38:35.825392] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-09-18T21:38:35.909492] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:38:35.910985] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-09-18T21:38:35.910399] [DEBUG] [LOCAL ] SG: Trimmed 77099 records to 53850 (keeping 200 days of data) [2025-09-18T21:38:35.911221] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-09-18T21:38:35.912959] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-09-18T21:38:35.913070] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-09-18T21:38:36.409628] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:38:36.450407] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-18T21:38:36.529675] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-11. [2025-09-18T21:38:36.572984] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T21:38:36.692730] [DEBUG] [LOCAL ] SG: Primary data saved (53850 records). [2025-09-18T21:38:36.692872] [INFO ] [MAIN ] SG: Full history saved. [2025-09-18T21:38:36.694413] [INFO ] [MAIN ] Update Progress: 1905/2372 symbols completed. SG took 39.3s. Estimated remaining: 1h 8m 17s. Rate: 6.8 symbols/min [2025-09-18T21:38:36.873045] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:38:36.900752] [DEBUG] [LOCAL ] SHCO: Loaded 26315 existing records from primary storage. [2025-09-18T21:38:36.900927] [INFO ] [MAIN ] SHCO: Loaded 26315 existing records. [2025-09-18T21:38:37.137034] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:38:37.137302] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-09-18T21:38:37.137410] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-09-18T21:38:37.138622] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-09-18T21:38:37.138705] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-09-18T21:38:37.328529] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-09-18T21:38:37.508900] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:38:38.053751] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-18T21:38:38.089459] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-18T21:38:38.119507] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-05. [2025-09-18T21:38:38.919578] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-11. [2025-09-18T21:38:39.719609] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-09-18T21:38:39.758530] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-18T21:38:40.069159] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-18T21:38:40.519593] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-06. [2025-09-18T21:38:41.046062] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T21:38:41.319527] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-09-18T21:38:41.800129] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-18T21:38:41.964219] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T21:38:42.119550] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-07. [2025-09-18T21:38:42.919550] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-09-18T21:38:43.719572] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-09-18T21:38:43.787156] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-18T21:38:43.812685] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-18T21:38:44.519540] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-08. [2025-09-18T21:38:45.171682] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-18T21:38:45.319504] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-09-18T21:38:46.119527] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-09-18T21:38:46.362849] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-18T21:38:46.586416] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-18T21:38:46.603312] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-18T21:38:46.919542] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-09-18T21:38:47.660414] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-18T21:38:47.719499] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-09-18T21:38:48.242676] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-18T21:38:48.519554] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-09-18T21:38:49.319541] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-09. [2025-09-18T21:38:50.055469] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-18T21:38:50.119501] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-09-18T21:38:50.698291] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-18T21:38:50.705495] [INFO ] [REMOTE ] SGI: Full fetch complete (56035 records). [2025-09-18T21:38:50.705613] [DEBUG] [VALIDATOR ] SGI: Validating primary data. [2025-09-18T21:38:50.898187] [WARN ] [VALIDATOR ] SGI: Validation failed - insufficient historical data. Have 148 unique days, need 200 days [2025-09-18T21:38:50.898809] [FATAL] [MAIN ] SGI: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:38:50.898882] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:38:50.898963] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-18T21:38:50.899032] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-18T21:38:50.899071] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-09-18T21:38:50.899129] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-09-18T21:38:50.899214] [INFO ] [MAIN ] Update Progress: 1906/2372 symbols completed. SGI took 30.6s. Estimated remaining: 1h 8m 10s. Rate: 6.8 symbols/min [2025-09-18T21:38:50.929687] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-09-18T21:38:51.070912] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:38:51.146077] [DEBUG] [LOCAL ] SHEL: Loaded 53672 existing records from primary storage. [2025-09-18T21:38:51.146461] [INFO ] [MAIN ] SHEL: Loaded 53672 existing records. [2025-09-18T21:38:51.327783] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:38:51.328134] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-09-18T21:38:51.328190] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-09-18T21:38:51.330229] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-09-18T21:38:51.330290] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-09-18T21:38:51.519118] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-18T21:38:51.716716] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:38:51.719496] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-11. [2025-09-18T21:38:51.794119] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-18T21:38:52.519606] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-09-18T21:38:53.072983] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-18T21:38:53.319550] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-09-18T21:38:53.646230] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-18T21:38:54.119615] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-09-18T21:38:54.135334] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-18T21:38:54.919544] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-09-18T21:38:55.686880] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T21:38:55.712749] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-18T21:38:55.719492] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-09-18T21:38:56.519551] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-09-18T21:38:56.787123] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-18T21:38:57.121012] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-18T21:38:57.122617] [INFO ] [REMOTE ] SGU: Full fetch complete (8894 records). [2025-09-18T21:38:57.122714] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-09-18T21:38:57.328855] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-09-18T21:38:57.505257] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-09-18T21:38:57.505347] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-09-18T21:38:57.505568] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-09-18T21:38:57.505607] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-09-18T21:38:57.506076] [DEBUG] [LOCAL ] SGU: Trimmed 8894 records to 6692 (keeping 200 days of data) [2025-09-18T21:38:57.551351] [DEBUG] [LOCAL ] SGU: Primary data saved (6692 records). [2025-09-18T21:38:57.551473] [INFO ] [MAIN ] SGU: Full history saved. [2025-09-18T21:38:57.551574] [INFO ] [MAIN ] Update Progress: 1907/2372 symbols completed. SGU took 24.0s. Estimated remaining: 1h 8m 0s. Rate: 6.8 symbols/min [2025-09-18T21:38:57.722824] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:38:57.752391] [DEBUG] [LOCAL ] SHG: Loaded 27665 existing records from primary storage. [2025-09-18T21:38:57.752534] [INFO ] [MAIN ] SHG: Loaded 27665 existing records. [2025-09-18T21:38:57.938714] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:38:57.940253] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-09-18T21:38:57.940315] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-09-18T21:38:57.941581] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-09-18T21:38:57.941708] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-09-18T21:38:58.122717] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-09-18T21:38:58.313289] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:38:58.919541] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-11. [2025-09-18T21:38:59.553258] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-18T21:38:59.585039] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T21:38:59.719566] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-09-18T21:38:59.895535] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-18T21:39:00.519556] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-09-18T21:39:01.122732] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T21:39:01.319548] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-09-18T21:39:02.119603] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-09-18T21:39:02.501396] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-18T21:39:02.919557] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-09-18T21:39:03.719551] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-09-18T21:39:04.774238] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (3.45 seconds). [2025-09-18T21:39:04.786163] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-09-18T21:39:04.827725] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-09-18T21:39:05.224966] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-18T21:39:05.319544] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-09-18T21:39:05.968241] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-18T21:39:06.002335] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (3.08 seconds). [2025-09-18T21:39:06.119552] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-09-18T21:39:06.447948] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-18T21:39:06.919558] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-09-18T21:39:07.719543] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-09-18T21:39:07.772836] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-18T21:39:08.519545] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-09-18T21:39:08.645232] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-18T21:39:08.741313] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-18T21:39:09.319557] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-09-18T21:39:09.797335] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-18T21:39:09.804720] [INFO ] [REMOTE ] SHAK: Full fetch complete (69788 records). [2025-09-18T21:39:09.804844] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-09-18T21:39:10.124613] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-09-18T21:39:10.205622] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-09-18T21:39:10.205734] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-09-18T21:39:10.206762] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-09-18T21:39:10.206827] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-09-18T21:39:10.211000] [DEBUG] [LOCAL ] SHAK: Trimmed 69788 records to 49593 (keeping 200 days of data) [2025-09-18T21:39:10.508468] [DEBUG] [LOCAL ] SHAK: Primary data saved (49593 records). [2025-09-18T21:39:10.508605] [INFO ] [MAIN ] SHAK: Full history saved. [2025-09-18T21:39:10.508727] [INFO ] [MAIN ] Update Progress: 1908/2372 symbols completed. SHAK took 35.5s. Estimated remaining: 1h 7m 53s. Rate: 6.8 symbols/min [2025-09-18T21:39:10.682021] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:39:10.707019] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-18T21:39:10.762029] [DEBUG] [LOCAL ] SHO: Loaded 49859 existing records from primary storage. [2025-09-18T21:39:10.762188] [INFO ] [MAIN ] SHO: Loaded 49859 existing records. [2025-09-18T21:39:10.935369] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-09-18T21:39:10.994401] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:39:10.994743] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-09-18T21:39:10.994815] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-09-18T21:39:10.995909] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-09-18T21:39:10.995971] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-09-18T21:39:11.576576] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:39:11.719562] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-11. [2025-09-18T21:39:12.211249] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-18T21:39:12.326188] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-18T21:39:12.519538] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-09-18T21:39:13.319542] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-09-18T21:39:14.119538] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-09-18T21:39:14.351624] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-11 (2.63 seconds). [2025-09-18T21:39:14.919553] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-09-18T21:39:15.246038] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-18T21:39:15.362026] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-09-18T21:39:15.467245] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-18T21:39:15.719560] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-09-18T21:39:16.173543] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-18T21:39:16.519571] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-09-18T21:39:17.319579] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-09-18T21:39:18.103138] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-18T21:39:18.126298] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-09-18T21:39:18.143209] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-18T21:39:18.618554] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-18T21:39:18.919546] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-09-18T21:39:19.719620] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-09-18T21:39:20.033961] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-18T21:39:20.268127] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-18T21:39:20.272826] [INFO ] [REMOTE ] SHCO: Full fetch complete (37070 records). [2025-09-18T21:39:20.272933] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-09-18T21:39:20.528147] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-09-18T21:39:20.677779] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-09-18T21:39:20.677932] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-09-18T21:39:20.678776] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-09-18T21:39:20.678872] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-09-18T21:39:20.695790] [DEBUG] [LOCAL ] SHCO: Trimmed 37070 records to 26461 (keeping 200 days of data) [2025-09-18T21:39:20.696520] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-18T21:39:20.865764] [DEBUG] [LOCAL ] SHCO: Primary data saved (26461 records). [2025-09-18T21:39:20.865914] [INFO ] [MAIN ] SHCO: Full history saved. [2025-09-18T21:39:20.866015] [INFO ] [MAIN ] Update Progress: 1909/2372 symbols completed. SHCO took 44.2s. Estimated remaining: 1h 7m 44s. Rate: 6.8 symbols/min [2025-09-18T21:39:21.041102] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:39:21.047731] [DEBUG] [LOCAL ] SHOC: Loaded 4202 existing records from primary storage. [2025-09-18T21:39:21.047878] [INFO ] [MAIN ] SHOC: Loaded 4202 existing records. [2025-09-18T21:39:21.245102] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:39:21.245385] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-09-18T21:39:21.245436] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-09-18T21:39:21.245752] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-09-18T21:39:21.245815] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-09-18T21:39:21.326271] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-09-18T21:39:21.629790] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:39:22.119507] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-09-18T21:39:22.148564] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-18T21:39:22.386225] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-18T21:39:22.919689] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-09-18T21:39:23.719561] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-09-18T21:39:24.426773] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T21:39:24.477800] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-18T21:39:24.519538] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-09-18T21:39:24.662874] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-18T21:39:25.319590] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-09-18T21:39:26.119586] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-11. [2025-09-18T21:39:26.169065] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-18T21:39:26.177048] [INFO ] [REMOTE ] SHEL: Full fetch complete (77603 records). [2025-09-18T21:39:26.177275] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-09-18T21:39:26.617160] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-09-18T21:39:26.617275] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-09-18T21:39:26.618637] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-09-18T21:39:26.618744] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-09-18T21:39:26.620529] [DEBUG] [LOCAL ] SHEL: Trimmed 77603 records to 54062 (keeping 200 days of data) [2025-09-18T21:39:26.925409] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-09-18T21:39:26.969972] [DEBUG] [LOCAL ] SHEL: Primary data saved (54062 records). [2025-09-18T21:39:26.970149] [INFO ] [MAIN ] SHEL: Full history saved. [2025-09-18T21:39:26.970247] [INFO ] [MAIN ] Update Progress: 1910/2372 symbols completed. SHEL took 36.1s. Estimated remaining: 1h 7m 35s. Rate: 6.8 symbols/min [2025-09-18T21:39:27.140997] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-18T21:39:27.162389] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:39:27.200351] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-18T21:39:27.257300] [DEBUG] [LOCAL ] SHW: Loaded 50526 existing records from primary storage. [2025-09-18T21:39:27.257484] [INFO ] [MAIN ] SHW: Loaded 50526 existing records. [2025-09-18T21:39:27.437265] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:39:27.437539] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-09-18T21:39:27.437590] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-09-18T21:39:27.438837] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-09-18T21:39:27.438898] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-09-18T21:39:27.723086] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-09-18T21:39:27.800525] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:39:27.819345] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-18T21:39:28.519609] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-11. [2025-09-18T21:39:29.319578] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-09-18T21:39:29.512950] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-18T21:39:29.898458] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-18T21:39:30.049673] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-18T21:39:30.053981] [INFO ] [REMOTE ] SHG: Full fetch complete (41558 records). [2025-09-18T21:39:30.054073] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-09-18T21:39:30.124782] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-09-18T21:39:30.435734] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-09-18T21:39:30.435825] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-09-18T21:39:30.436630] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-09-18T21:39:30.436709] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-09-18T21:39:30.437684] [DEBUG] [LOCAL ] SHG: Trimmed 41558 records to 27806 (keeping 200 days of data) [2025-09-18T21:39:30.616397] [DEBUG] [LOCAL ] SHG: Primary data saved (27806 records). [2025-09-18T21:39:30.616544] [INFO ] [MAIN ] SHG: Full history saved. [2025-09-18T21:39:30.616662] [INFO ] [MAIN ] Update Progress: 1911/2372 symbols completed. SHG took 33.1s. Estimated remaining: 1h 7m 25s. Rate: 6.8 symbols/min [2025-09-18T21:39:30.796854] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:39:30.797108] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-09-18T21:39:30.797155] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-09-18T21:39:30.797310] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-09-18T21:39:30.797354] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-18T21:39:30.797397] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-18T21:39:30.797433] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-09-18T21:39:30.924694] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-09-18T21:39:31.093241] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-18T21:39:31.173575] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:39:31.719577] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-09-18T21:39:32.406406] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-18T21:39:32.519536] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-09-18T21:39:32.669694] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-18T21:39:33.319542] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-09-18T21:39:34.129748] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-11. [2025-09-18T21:39:34.132639] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-18T21:39:34.429838] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:39:34.430172] [WARN ] [REMOTE ] SI: No data returned for month 2024-11 [2025-09-18T21:39:34.570572] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T21:39:34.919541] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-09-18T21:39:35.148336] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:39:35.148702] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-09-18T21:39:35.719567] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-09-18T21:39:36.519553] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-09-18T21:39:37.319549] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-09-18T21:39:37.541502] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-18T21:39:37.938544] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-18T21:39:38.043601] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T21:39:38.119594] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-09-18T21:39:38.919604] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-09-18T21:39:39.719542] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-09-18T21:39:39.826389] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-18T21:39:40.384948] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-18T21:39:40.519568] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-09-18T21:39:40.573723] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-18T21:39:40.580784] [INFO ] [REMOTE ] SHO: Full fetch complete (71039 records). [2025-09-18T21:39:40.580914] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-09-18T21:39:40.975845] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-09-18T21:39:40.975955] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-09-18T21:39:40.977019] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-09-18T21:39:40.977088] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-09-18T21:39:40.978571] [DEBUG] [LOCAL ] SHO: Trimmed 71039 records to 50219 (keeping 200 days of data) [2025-09-18T21:39:41.283038] [DEBUG] [LOCAL ] SHO: Primary data saved (50219 records). [2025-09-18T21:39:41.283180] [INFO ] [MAIN ] SHO: Full history saved. [2025-09-18T21:39:41.283266] [INFO ] [MAIN ] Update Progress: 1912/2372 symbols completed. SHO took 30.8s. Estimated remaining: 1h 7m 17s. Rate: 6.8 symbols/min [2025-09-18T21:39:41.327913] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-01. [2025-09-18T21:39:41.458606] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:39:41.502364] [DEBUG] [LOCAL ] SID: Loaded 42163 existing records from primary storage. [2025-09-18T21:39:41.502584] [INFO ] [MAIN ] SID: Loaded 42163 existing records. [2025-09-18T21:39:41.618255] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:39:41.634193] [WARN ] [REMOTE ] SI: No data returned for month 2025-01 [2025-09-18T21:39:41.688695] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:39:41.688984] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-09-18T21:39:41.689046] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-09-18T21:39:41.689892] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-09-18T21:39:41.689954] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-09-18T21:39:42.067935] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:39:42.124689] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-11. [2025-09-18T21:39:42.147563] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-18T21:39:42.919547] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-09-18T21:39:43.422720] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-18T21:39:43.690773] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-18T21:39:43.719497] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-09-18T21:39:44.519566] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-02. [2025-09-18T21:39:44.719949] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:39:44.720307] [WARN ] [REMOTE ] SI: No data returned for month 2025-02 [2025-09-18T21:39:45.117814] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-18T21:39:45.319552] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-03. [2025-09-18T21:39:45.589412] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:39:45.589750] [WARN ] [REMOTE ] SI: No data returned for month 2025-03 [2025-09-18T21:39:46.119545] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-09-18T21:39:46.919585] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-04. [2025-09-18T21:39:47.151617] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:39:47.151988] [WARN ] [REMOTE ] SI: No data returned for month 2025-04 [2025-09-18T21:39:47.719565] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-05. [2025-09-18T21:39:47.941478] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:39:47.941824] [WARN ] [REMOTE ] SI: No data returned for month 2025-05 [2025-09-18T21:39:48.007234] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-18T21:39:48.519566] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-06. [2025-09-18T21:39:48.744161] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:39:48.744522] [WARN ] [REMOTE ] SI: No data returned for month 2025-06 [2025-09-18T21:39:49.319539] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-09-18T21:39:50.119561] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-09-18T21:39:50.535817] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-18T21:39:50.919565] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-07. [2025-09-18T21:39:51.262309] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-18T21:39:51.291241] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-18T21:39:51.719558] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-09-18T21:39:52.519555] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-09-18T21:39:53.327457] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-08. [2025-09-18T21:39:53.332845] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T21:39:54.033687] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-18T21:39:54.119501] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-09-18T21:39:54.428992] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-18T21:39:54.919556] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-09-18T21:39:55.719585] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-09-18T21:39:55.832386] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-18T21:39:55.930099] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T21:39:56.195887] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-18T21:39:56.519547] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-09-18T21:39:57.085481] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-18T21:39:57.319601] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-09-18T21:39:58.119543] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-09. [2025-09-18T21:39:58.631489] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-18T21:39:58.919611] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-09-18T21:39:59.012165] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-18T21:39:59.015354] [INFO ] [REMOTE ] SI: Full fetch complete (5299 records). [2025-09-18T21:39:59.015484] [DEBUG] [VALIDATOR ] SI: Validating primary data. [2025-09-18T21:39:59.215388] [WARN ] [VALIDATOR ] SI: Validation failed - insufficient historical data. Have 35 unique days, need 200 days [2025-09-18T21:39:59.215635] [FATAL] [MAIN ] SI: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:39:59.215734] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:39:59.215809] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-18T21:39:59.215884] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-18T21:39:59.215924] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-09-18T21:39:59.215993] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-09-18T21:39:59.216106] [INFO ] [MAIN ] Update Progress: 1913/2372 symbols completed. SI took 28.6s. Estimated remaining: 1h 7m 10s. Rate: 6.8 symbols/min [2025-09-18T21:39:59.327754] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-18T21:39:59.400709] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:39:59.460578] [DEBUG] [LOCAL ] SIG: Loaded 46750 existing records from primary storage. [2025-09-18T21:39:59.460801] [INFO ] [MAIN ] SIG: Loaded 46750 existing records. [2025-09-18T21:39:59.645347] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:39:59.645618] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-09-18T21:39:59.645699] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-09-18T21:39:59.646695] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-09-18T21:39:59.646756] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-09-18T21:39:59.724693] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-09-18T21:40:00.017267] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:40:00.519559] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-09-18T21:40:01.319555] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-09-18T21:40:01.400757] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-18T21:40:01.777161] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-18T21:40:01.778335] [INFO ] [REMOTE ] SHOC: Full fetch complete (7570 records). [2025-09-18T21:40:01.778408] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-09-18T21:40:02.124749] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-11. [2025-09-18T21:40:02.165370] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-09-18T21:40:02.165483] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-09-18T21:40:02.165740] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-09-18T21:40:02.165925] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-09-18T21:40:02.166597] [DEBUG] [LOCAL ] SHOC: Trimmed 7570 records to 4243 (keeping 200 days of data) [2025-09-18T21:40:02.220673] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-18T21:40:02.235152] [DEBUG] [LOCAL ] SHOC: Primary data saved (4243 records). [2025-09-18T21:40:02.235256] [INFO ] [MAIN ] SHOC: Full history saved. [2025-09-18T21:40:02.235543] [INFO ] [MAIN ] Update Progress: 1914/2372 symbols completed. SHOC took 41.4s. Estimated remaining: 1h 6m 60s. Rate: 6.8 symbols/min [2025-09-18T21:40:02.411609] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:40:02.434607] [DEBUG] [LOCAL ] SII: Loaded 22961 existing records from primary storage. [2025-09-18T21:40:02.434777] [INFO ] [MAIN ] SII: Loaded 22961 existing records. [2025-09-18T21:40:02.626736] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:40:02.627060] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-09-18T21:40:02.627122] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-09-18T21:40:02.627772] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-09-18T21:40:02.627834] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-09-18T21:40:02.924671] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-09-18T21:40:03.093112] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:40:03.723920] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-09-18T21:40:03.732085] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-18T21:40:03.748792] [INFO ] [REMOTE ] SHW: Full fetch complete (72923 records). [2025-09-18T21:40:03.749040] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-09-18T21:40:04.034938] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-18T21:40:04.451804] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-09-18T21:40:04.451952] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-09-18T21:40:04.453917] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-09-18T21:40:04.454068] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-09-18T21:40:04.456894] [DEBUG] [LOCAL ] SHW: Trimmed 72923 records to 50914 (keeping 200 days of data) [2025-09-18T21:40:04.547251] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-11. [2025-09-18T21:40:04.862393] [DEBUG] [LOCAL ] SHW: Primary data saved (50914 records). [2025-09-18T21:40:04.862550] [INFO ] [MAIN ] SHW: Full history saved. [2025-09-18T21:40:04.862680] [INFO ] [MAIN ] Update Progress: 1915/2372 symbols completed. SHW took 37.9s. Estimated remaining: 1h 6m 50s. Rate: 6.8 symbols/min [2025-09-18T21:40:05.038392] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:40:05.070551] [DEBUG] [LOCAL ] SILA: Loaded 31283 existing records from primary storage. [2025-09-18T21:40:05.070732] [INFO ] [MAIN ] SILA: Loaded 31283 existing records. [2025-09-18T21:40:05.262125] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:40:05.262988] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-09-18T21:40:05.263222] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-09-18T21:40:05.264035] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-09-18T21:40:05.264223] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-09-18T21:40:05.344130] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-09-18T21:40:05.400581] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-18T21:40:05.671290] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:40:05.684264] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-18T21:40:06.119552] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-11. [2025-09-18T21:40:06.921574] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-09-18T21:40:06.924433] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-18T21:40:07.508578] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T21:40:07.719577] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-09-18T21:40:08.004016] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-18T21:40:08.519550] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-09-18T21:40:08.809602] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-18T21:40:09.319546] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-09-18T21:40:10.081554] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-18T21:40:10.119495] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-09-18T21:40:10.283067] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-18T21:40:10.919543] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-09-18T21:40:10.961806] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T21:40:11.719546] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-09-18T21:40:12.416175] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-18T21:40:12.519497] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-09-18T21:40:12.683432] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-18T21:40:13.319559] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-09-18T21:40:14.022535] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-18T21:40:14.119522] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-09-18T21:40:14.670775] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T21:40:14.919546] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-09-18T21:40:15.140275] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-18T21:40:15.719576] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-09-18T21:40:16.202120] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-18T21:40:16.207778] [INFO ] [REMOTE ] SID: Full fetch complete (60810 records). [2025-09-18T21:40:16.207895] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-09-18T21:40:16.524754] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-09-18T21:40:16.594283] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-09-18T21:40:16.594393] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-09-18T21:40:16.595371] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-09-18T21:40:16.595436] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-09-18T21:40:16.596694] [DEBUG] [LOCAL ] SID: Trimmed 60810 records to 42466 (keeping 200 days of data) [2025-09-18T21:40:16.836451] [DEBUG] [LOCAL ] SID: Primary data saved (42466 records). [2025-09-18T21:40:16.836611] [INFO ] [MAIN ] SID: Full history saved. [2025-09-18T21:40:16.836750] [INFO ] [MAIN ] Update Progress: 1916/2372 symbols completed. SID took 35.6s. Estimated remaining: 1h 6m 42s. Rate: 6.8 symbols/min [2025-09-18T21:40:17.007906] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:40:17.046494] [DEBUG] [LOCAL ] SITC: Loaded 41624 existing records from primary storage. [2025-09-18T21:40:17.046633] [INFO ] [MAIN ] SITC: Loaded 41624 existing records. [2025-09-18T21:40:17.227591] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:40:17.228179] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-09-18T21:40:17.228322] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-09-18T21:40:17.229632] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-09-18T21:40:17.229734] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-09-18T21:40:17.331601] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-09-18T21:40:17.614699] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-18T21:40:17.653095] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:40:17.914983] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-18T21:40:18.119545] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-11. [2025-09-18T21:40:18.314766] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-18T21:40:18.919543] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-09-18T21:40:19.445388] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-18T21:40:19.719594] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-09-18T21:40:20.425569] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-18T21:40:20.519502] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-09-18T21:40:21.319560] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-09-18T21:40:21.604322] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-18T21:40:21.852708] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T21:40:22.119580] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-09-18T21:40:22.192089] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-18T21:40:22.919548] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-09-18T21:40:23.284431] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-18T21:40:23.719583] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-09-18T21:40:24.119917] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T21:40:24.519617] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-09-18T21:40:24.900980] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-18T21:40:25.319762] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-09-18T21:40:25.646762] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-18T21:40:26.119565] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-09-18T21:40:26.500788] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-18T21:40:26.919541] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-09-18T21:40:27.258889] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-18T21:40:27.719562] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-09-18T21:40:28.023121] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-18T21:40:28.519567] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-09-18T21:40:29.215938] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T21:40:29.319512] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-09-18T21:40:29.780181] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-18T21:40:30.119564] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-09-18T21:40:30.324587] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-18T21:40:30.919567] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-09-18T21:40:31.212178] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-18T21:40:31.719545] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-09-18T21:40:32.222851] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T21:40:32.519574] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-09-18T21:40:33.011174] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-18T21:40:33.319545] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-09-18T21:40:33.524419] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-18T21:40:34.119561] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-09-18T21:40:34.141332] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-18T21:40:34.144779] [INFO ] [REMOTE ] SII: Full fetch complete (29362 records). [2025-09-18T21:40:34.144878] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-09-18T21:40:34.525120] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-09-18T21:40:34.525209] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-09-18T21:40:34.525841] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-09-18T21:40:34.525905] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-09-18T21:40:34.526694] [DEBUG] [LOCAL ] SII: Trimmed 29362 records to 23155 (keeping 200 days of data) [2025-09-18T21:40:34.670703] [DEBUG] [LOCAL ] SII: Primary data saved (23155 records). [2025-09-18T21:40:34.670842] [INFO ] [MAIN ] SII: Full history saved. [2025-09-18T21:40:34.670927] [INFO ] [MAIN ] Update Progress: 1917/2372 symbols completed. SII took 32.4s. Estimated remaining: 1h 6m 35s. Rate: 6.8 symbols/min [2025-09-18T21:40:34.919559] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-09-18T21:40:35.677050] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-18T21:40:35.719507] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-09-18T21:40:35.852477] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-18T21:40:35.856481] [INFO ] [REMOTE ] SILA: Full fetch complete (45335 records). [2025-09-18T21:40:35.856582] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-09-18T21:40:36.236976] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-09-18T21:40:36.237062] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-09-18T21:40:36.237887] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-09-18T21:40:36.237951] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-09-18T21:40:36.238983] [DEBUG] [LOCAL ] SILA: Trimmed 45335 records to 31543 (keeping 200 days of data) [2025-09-18T21:40:36.442797] [DEBUG] [LOCAL ] SILA: Primary data saved (31543 records). [2025-09-18T21:40:36.443024] [INFO ] [MAIN ] SILA: Full history saved. [2025-09-18T21:40:36.443219] [INFO ] [MAIN ] Update Progress: 1918/2372 symbols completed. SILA took 31.6s. Estimated remaining: 1h 6m 24s. Rate: 6.8 symbols/min [2025-09-18T21:40:36.519626] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-09-18T21:40:37.283160] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-18T21:40:37.290832] [INFO ] [REMOTE ] SIG: Full fetch complete (68325 records). [2025-09-18T21:40:37.290966] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-09-18T21:40:37.677429] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-09-18T21:40:37.677515] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-09-18T21:40:37.678527] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-09-18T21:40:37.679122] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-09-18T21:40:37.680576] [DEBUG] [LOCAL ] SIG: Trimmed 68325 records to 47088 (keeping 200 days of data) [2025-09-18T21:40:37.981791] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T21:40:37.993249] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-09-18T21:40:38.002736] [DEBUG] [LOCAL ] SIG: Primary data saved (47088 records). [2025-09-18T21:40:38.002822] [INFO ] [MAIN ] SIG: Full history saved. [2025-09-18T21:40:38.002902] [INFO ] [MAIN ] Update Progress: 1919/2372 symbols completed. SIG took 38.8s. Estimated remaining: 1h 6m 14s. Rate: 6.8 symbols/min [2025-09-18T21:40:39.561525] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-18T21:40:39.570594] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-09-18T21:40:40.731017] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-18T21:40:40.738975] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-09-18T21:40:42.537180] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-18T21:40:42.546511] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-09-18T21:40:44.005789] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-18T21:40:44.015807] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-09-18T21:40:45.530421] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-18T21:40:45.539404] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-09-18T21:40:46.815062] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-18T21:40:46.821574] [INFO ] [REMOTE ] SITC: Full fetch complete (60720 records). [2025-09-18T21:40:46.821722] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-09-18T21:40:47.224809] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-09-18T21:40:47.224895] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-09-18T21:40:47.225858] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-09-18T21:40:47.225924] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-09-18T21:40:47.227216] [DEBUG] [LOCAL ] SITC: Trimmed 60720 records to 41957 (keeping 200 days of data) [2025-09-18T21:40:47.478139] [DEBUG] [LOCAL ] SITC: Primary data saved (41957 records). [2025-09-18T21:40:47.478273] [INFO ] [MAIN ] SITC: Full history saved. [2025-09-18T21:40:47.478359] [INFO ] [MAIN ] Update Progress: 1920/2372 symbols completed. SITC took 30.6s. Estimated remaining: 1h 6m 5s. Rate: 6.8 symbols/min [2025-09-18T21:40:48.108093] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:40:48.174075] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:40:48.194085] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:40:48.231719] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:40:48.293292] [DEBUG] [LOCAL ] SKE: Loaded 35274 existing records from primary storage. [2025-09-18T21:40:48.292434] [DEBUG] [LOCAL ] SJT: Loaded 22207 existing records from primary storage. [2025-09-18T21:40:48.293493] [INFO ] [MAIN ] SKE: Loaded 35274 existing records. [2025-09-18T21:40:48.293575] [INFO ] [MAIN ] SJT: Loaded 22207 existing records. [2025-09-18T21:40:48.401090] [DEBUG] [LOCAL ] SITE: Loaded 35327 existing records from primary storage. [2025-09-18T21:40:48.486010] [INFO ] [MAIN ] SITE: Loaded 35327 existing records. [2025-09-18T21:40:48.757389] [DEBUG] [LOCAL ] SJM: Loaded 50122 existing records from primary storage. [2025-09-18T21:40:48.807206] [INFO ] [MAIN ] SJM: Loaded 50122 existing records. [2025-09-18T21:40:48.807027] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:40:48.970272] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-09-18T21:40:48.986073] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-09-18T21:40:49.020302] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-09-18T21:40:49.020233] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:40:49.020493] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-09-18T21:40:49.048454] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:40:49.086532] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-09-18T21:40:49.117259] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-09-18T21:40:49.117397] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-09-18T21:40:49.147710] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-09-18T21:40:49.164779] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-09-18T21:40:49.164699] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-09-18T21:40:49.185673] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-09-18T21:40:49.267955] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-09-18T21:40:49.494514] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:40:49.560009] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-09-18T21:40:49.565308] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-09-18T21:40:49.610699] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-09-18T21:40:49.658501] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-09-18T21:40:50.351452] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:40:50.413850] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-11. [2025-09-18T21:40:50.568945] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:40:50.627511] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:40:50.611328] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-11. [2025-09-18T21:40:50.633074] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-11. [2025-09-18T21:40:50.754446] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:40:50.754843] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-11. [2025-09-18T21:40:51.491732] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-18T21:40:51.496543] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-09-18T21:40:51.832206] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T21:40:51.839401] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-09-18T21:40:52.037625] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-18T21:40:52.044310] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-09-18T21:40:52.149827] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T21:40:52.159437] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-09-18T21:40:52.561919] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-18T21:40:52.567615] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-09-18T21:40:52.707717] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-18T21:40:52.714547] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-09-18T21:40:52.968802] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-18T21:40:52.977950] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-09-18T21:40:53.596548] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-18T21:40:53.607343] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-09-18T21:40:53.619237] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-18T21:40:53.623497] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-09-18T21:40:53.714972] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-18T21:40:53.721324] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-09-18T21:40:53.946537] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-18T21:40:53.953420] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-09-18T21:40:54.527589] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-18T21:40:54.532505] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-09-18T21:40:54.727813] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T21:40:54.919673] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-09-18T21:40:54.972462] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-18T21:40:55.302637] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T21:40:55.682225] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-18T21:40:55.719492] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-09-18T21:40:55.898938] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-18T21:40:56.519562] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-09-18T21:40:56.656121] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-18T21:40:57.319579] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-09-18T21:40:58.119550] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-09-18T21:40:58.278021] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-18T21:40:58.580842] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-18T21:40:58.919540] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-09-18T21:40:59.259807] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-18T21:40:59.719565] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-09-18T21:41:00.228391] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-18T21:41:00.519557] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-09-18T21:41:01.192889] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-18T21:41:01.319531] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-09-18T21:41:01.446307] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-18T21:41:02.119551] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-09-18T21:41:02.919552] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-09-18T21:41:03.023046] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-18T21:41:03.074883] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-18T21:41:03.719571] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-09-18T21:41:04.489686] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-18T21:41:04.519509] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-09-18T21:41:04.737114] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-18T21:41:05.319581] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-09-18T21:41:05.974701] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-18T21:41:06.119547] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-09-18T21:41:06.240047] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-18T21:41:06.919555] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-09-18T21:41:07.209327] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-18T21:41:07.719603] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-09-18T21:41:07.751397] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-18T21:41:07.754990] [INFO ] [REMOTE ] SJT: Full fetch complete (32184 records). [2025-09-18T21:41:07.755127] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-09-18T21:41:08.173059] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-09-18T21:41:08.173138] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-09-18T21:41:08.173809] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-09-18T21:41:08.173871] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-09-18T21:41:08.174727] [DEBUG] [LOCAL ] SJT: Trimmed 32184 records to 22312 (keeping 200 days of data) [2025-09-18T21:41:08.308997] [DEBUG] [LOCAL ] SJT: Primary data saved (22312 records). [2025-09-18T21:41:08.309131] [INFO ] [MAIN ] SJT: Full history saved. [2025-09-18T21:41:08.309233] [INFO ] [MAIN ] Update Progress: 1921/2372 symbols completed. SJT took 20.8s. Estimated remaining: 1h 5m 59s. Rate: 6.8 symbols/min [2025-09-18T21:41:08.479699] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:41:08.489439] [DEBUG] [LOCAL ] SKIL: Loaded 6376 existing records from primary storage. [2025-09-18T21:41:08.489554] [INFO ] [MAIN ] SKIL: Loaded 6376 existing records. [2025-09-18T21:41:08.526952] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-09-18T21:41:08.682728] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:41:08.683025] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-09-18T21:41:08.683097] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-09-18T21:41:08.683448] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-09-18T21:41:08.683507] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-09-18T21:41:09.033859] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:41:09.319545] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-09-18T21:41:09.590980] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-18T21:41:09.800844] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-18T21:41:10.119552] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-09-18T21:41:10.326858] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-18T21:41:10.919567] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-09-18T21:41:11.716269] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-18T21:41:11.726596] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-09-18T21:41:11.856401] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-18T21:41:12.519562] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-09-18T21:41:13.080509] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-18T21:41:13.116513] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T21:41:13.319517] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-11. [2025-09-18T21:41:13.875897] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-18T21:41:14.119500] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-09-18T21:41:14.919539] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-09-18T21:41:15.602458] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-18T21:41:15.615222] [INFO ] [REMOTE ] SJM: Full fetch complete (71832 records). [2025-09-18T21:41:15.615481] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-09-18T21:41:15.724809] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-09-18T21:41:16.142575] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-09-18T21:41:16.142712] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-09-18T21:41:16.143974] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-09-18T21:41:16.144058] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-09-18T21:41:16.145809] [DEBUG] [LOCAL ] SJM: Trimmed 71832 records to 50511 (keeping 200 days of data) [2025-09-18T21:41:16.393812] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-18T21:41:16.444439] [INFO ] [REMOTE ] SITE: Full fetch complete (49068 records). [2025-09-18T21:41:16.445369] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-09-18T21:41:16.523944] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-09-18T21:41:16.610217] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-18T21:41:16.968632] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-09-18T21:41:16.969253] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-09-18T21:41:16.970199] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-09-18T21:41:16.970280] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-09-18T21:41:16.974939] [DEBUG] [LOCAL ] SITE: Trimmed 49068 records to 35589 (keeping 200 days of data) [2025-09-18T21:41:16.984967] [DEBUG] [LOCAL ] SJM: Primary data saved (50511 records). [2025-09-18T21:41:16.985141] [INFO ] [MAIN ] SJM: Full history saved. [2025-09-18T21:41:16.985282] [INFO ] [MAIN ] Update Progress: 1922/2372 symbols completed. SJM took 29.5s. Estimated remaining: 1h 5m 51s. Rate: 6.8 symbols/min [2025-09-18T21:41:17.334980] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-09-18T21:41:17.355237] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:41:17.408333] [DEBUG] [LOCAL ] SKLZ: Loaded 12034 existing records from primary storage. [2025-09-18T21:41:17.408742] [INFO ] [MAIN ] SKLZ: Loaded 12034 existing records. [2025-09-18T21:41:17.615972] [DEBUG] [LOCAL ] SITE: Primary data saved (35589 records). [2025-09-18T21:41:17.612564] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:41:17.616385] [INFO ] [MAIN ] SITE: Full history saved. [2025-09-18T21:41:17.616892] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-09-18T21:41:17.617092] [INFO ] [MAIN ] Update Progress: 1923/2372 symbols completed. SITE took 30.1s. Estimated remaining: 1h 5m 40s. Rate: 6.8 symbols/min [2025-09-18T21:41:17.617243] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-09-18T21:41:17.639323] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-09-18T21:41:17.650947] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-09-18T21:41:17.922278] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:41:18.248896] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:41:18.258112] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-11. [2025-09-18T21:41:18.256351] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-18T21:41:18.259895] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-18T21:41:18.260918] [DEBUG] [LOCAL ] SKM: Loaded 35400 existing records from primary storage. [2025-09-18T21:41:18.271588] [INFO ] [MAIN ] SKM: Loaded 35400 existing records. [2025-09-18T21:41:18.460701] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:41:18.460947] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-09-18T21:41:18.460997] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-09-18T21:41:18.461816] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-09-18T21:41:18.461878] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-09-18T21:41:18.833863] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:41:18.919558] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-11. [2025-09-18T21:41:19.172087] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-18T21:41:19.719604] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-09-18T21:41:20.165407] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-18T21:41:20.519554] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-09-18T21:41:20.536509] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-18T21:41:21.074987] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-18T21:41:21.319578] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-09-18T21:41:22.119530] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-09-18T21:41:22.395849] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-18T21:41:22.919580] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-09-18T21:41:23.252884] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-18T21:41:23.466730] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-18T21:41:23.719549] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-09-18T21:41:24.519559] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-09-18T21:41:24.930306] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-18T21:41:24.937658] [INFO ] [REMOTE ] SKE: Full fetch complete (49868 records). [2025-09-18T21:41:24.937774] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-09-18T21:41:25.276290] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-18T21:41:25.332022] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-09-18T21:41:25.350173] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-09-18T21:41:25.351045] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-09-18T21:41:25.352045] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-09-18T21:41:25.352118] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-09-18T21:41:25.353529] [DEBUG] [LOCAL ] SKE: Trimmed 49868 records to 35645 (keeping 200 days of data) [2025-09-18T21:41:25.574964] [DEBUG] [LOCAL ] SKE: Primary data saved (35645 records). [2025-09-18T21:41:25.575117] [INFO ] [MAIN ] SKE: Full history saved. [2025-09-18T21:41:25.575223] [INFO ] [MAIN ] Update Progress: 1924/2372 symbols completed. SKE took 38.1s. Estimated remaining: 1h 5m 31s. Rate: 6.8 symbols/min [2025-09-18T21:41:25.743027] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:41:25.790029] [DEBUG] [LOCAL ] SKT: Loaded 42554 existing records from primary storage. [2025-09-18T21:41:25.790221] [INFO ] [MAIN ] SKT: Loaded 42554 existing records. [2025-09-18T21:41:25.965882] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:41:25.966192] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-09-18T21:41:25.966240] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-09-18T21:41:25.967762] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-09-18T21:41:25.967843] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-09-18T21:41:26.119529] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-09-18T21:41:26.275622] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T21:41:26.349787] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:41:26.919540] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-09-18T21:41:27.307952] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-18T21:41:27.584201] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-18T21:41:27.719550] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-09-18T21:41:28.186526] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-18T21:41:28.519576] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-09-18T21:41:29.319509] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-11. [2025-09-18T21:41:29.748138] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-18T21:41:30.119614] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-09-18T21:41:30.555264] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-18T21:41:30.899834] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-18T21:41:30.919492] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-09-18T21:41:31.490789] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-18T21:41:31.719513] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-09-18T21:41:32.519535] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-09-18T21:41:32.594151] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-18T21:41:33.319610] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-09-18T21:41:33.787185] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-18T21:41:34.119544] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-09-18T21:41:34.307985] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-18T21:41:34.689919] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-18T21:41:34.919561] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-09-18T21:41:35.719590] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-09-18T21:41:36.056193] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-18T21:41:36.385225] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-18T21:41:36.519532] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-09-18T21:41:37.319548] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-09-18T21:41:37.914286] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-18T21:41:38.066135] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-18T21:41:38.119512] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-09-18T21:41:38.919545] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-09-18T21:41:39.628148] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-18T21:41:39.719561] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-09-18T21:41:40.155796] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-18T21:41:40.397987] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-18T21:41:40.519545] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-09-18T21:41:41.319565] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-09-18T21:41:41.502288] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-18T21:41:42.119578] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-09-18T21:41:42.680529] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-18T21:41:42.700580] [INFO ] [REMOTE ] SKIL: Full fetch complete (9994 records). [2025-09-18T21:41:42.703007] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-09-18T21:41:42.750010] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T21:41:42.924720] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-09-18T21:41:43.101398] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-09-18T21:41:43.101474] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-09-18T21:41:43.101721] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-09-18T21:41:43.101782] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-09-18T21:41:43.102213] [DEBUG] [LOCAL ] SKIL: Trimmed 9994 records to 6445 (keeping 200 days of data) [2025-09-18T21:41:43.144602] [DEBUG] [LOCAL ] SKIL: Primary data saved (6445 records). [2025-09-18T21:41:43.144774] [INFO ] [MAIN ] SKIL: Full history saved. [2025-09-18T21:41:43.144904] [INFO ] [MAIN ] Update Progress: 1925/2372 symbols completed. SKIL took 34.8s. Estimated remaining: 1h 5m 24s. Rate: 6.8 symbols/min [2025-09-18T21:41:43.312670] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:41:43.356764] [DEBUG] [LOCAL ] SKY: Loaded 37604 existing records from primary storage. [2025-09-18T21:41:43.356927] [INFO ] [MAIN ] SKY: Loaded 37604 existing records. [2025-09-18T21:41:43.535706] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:41:43.535944] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-09-18T21:41:43.535992] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-09-18T21:41:43.536881] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-09-18T21:41:43.536942] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-09-18T21:41:43.731628] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-09-18T21:41:43.880977] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-18T21:41:43.923300] [INFO ] [REMOTE ] SKLZ: Full fetch complete (19147 records). [2025-09-18T21:41:43.924397] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-09-18T21:41:43.945318] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:41:44.314004] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-09-18T21:41:44.314135] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-09-18T21:41:44.314585] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-09-18T21:41:44.314666] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-09-18T21:41:44.315514] [DEBUG] [LOCAL ] SKLZ: Trimmed 19147 records to 12122 (keeping 200 days of data) [2025-09-18T21:41:44.388901] [DEBUG] [LOCAL ] SKLZ: Primary data saved (12122 records). [2025-09-18T21:41:44.389096] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-09-18T21:41:44.389241] [INFO ] [MAIN ] Update Progress: 1926/2372 symbols completed. SKLZ took 27.4s. Estimated remaining: 1h 5m 14s. Rate: 6.8 symbols/min [2025-09-18T21:41:44.532533] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-09-18T21:41:44.567912] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:41:44.587048] [DEBUG] [LOCAL ] SKYH: Loaded 16561 existing records from primary storage. [2025-09-18T21:41:44.587214] [INFO ] [MAIN ] SKYH: Loaded 16561 existing records. [2025-09-18T21:41:44.782113] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:41:44.782463] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-09-18T21:41:44.782612] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-09-18T21:41:44.783103] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-09-18T21:41:44.783164] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-09-18T21:41:45.161876] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:41:45.193292] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-18T21:41:45.319535] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-11. [2025-09-18T21:41:45.998852] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-18T21:41:46.119562] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-09-18T21:41:46.163142] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-18T21:41:46.919583] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-09-18T21:41:47.470957] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-18T21:41:47.719558] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-09-18T21:41:47.801131] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T21:41:48.519581] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-09-18T21:41:49.000816] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-18T21:41:49.006091] [INFO ] [REMOTE ] SKM: Full fetch complete (47984 records). [2025-09-18T21:41:49.006235] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-09-18T21:41:49.245381] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-18T21:41:49.319560] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-09-18T21:41:49.411575] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-09-18T21:41:49.411690] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-09-18T21:41:49.412541] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-09-18T21:41:49.412585] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-09-18T21:41:49.413766] [DEBUG] [LOCAL ] SKM: Trimmed 47984 records to 35636 (keeping 200 days of data) [2025-09-18T21:41:49.642124] [DEBUG] [LOCAL ] SKM: Primary data saved (35636 records). [2025-09-18T21:41:49.642278] [INFO ] [MAIN ] SKM: Full history saved. [2025-09-18T21:41:49.642368] [INFO ] [MAIN ] Update Progress: 1927/2372 symbols completed. SKM took 32.0s. Estimated remaining: 1h 5m 4s. Rate: 6.8 symbols/min [2025-09-18T21:41:49.817722] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:41:49.878142] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-09-18T21:41:49.878317] [INFO ] [MAIN ] SLB: Loaded 53697 existing records. [2025-09-18T21:41:50.071765] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:41:50.072012] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-09-18T21:41:50.072062] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-09-18T21:41:50.073232] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-09-18T21:41:50.073294] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-09-18T21:41:50.128253] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-11. [2025-09-18T21:41:50.213419] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-18T21:41:50.465726] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:41:50.919553] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-09-18T21:41:51.429038] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-18T21:41:51.719602] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-09-18T21:41:51.827534] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-18T21:41:52.519552] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-09-18T21:41:53.253599] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T21:41:53.315223] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-18T21:41:53.319696] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-09-18T21:41:54.119547] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-09-18T21:41:54.712333] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T21:41:54.919557] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-09-18T21:41:54.979700] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-18T21:41:55.719551] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-09-18T21:41:56.485833] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T21:41:56.524635] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-09-18T21:41:56.531295] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-18T21:41:57.319547] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-09-18T21:41:57.856991] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T21:41:58.119580] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-09-18T21:41:58.248424] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T21:41:58.919567] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-11. [2025-09-18T21:41:59.476433] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-18T21:41:59.719567] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-09-18T21:42:00.519576] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-09-18T21:42:00.792493] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-18T21:42:01.251571] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T21:42:01.319514] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-09-18T21:42:01.738101] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-18T21:42:02.104342] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-18T21:42:02.119537] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-09-18T21:42:02.919540] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-09-18T21:42:03.719577] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-09-18T21:42:03.985088] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-18T21:42:04.373582] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-18T21:42:04.376560] [INFO ] [REMOTE ] SKYH: Full fetch complete (22539 records). [2025-09-18T21:42:04.376733] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-09-18T21:42:04.479301] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-18T21:42:04.524029] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-09-18T21:42:04.801440] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-09-18T21:42:04.801528] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-09-18T21:42:04.802036] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-09-18T21:42:04.802099] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-09-18T21:42:04.802765] [DEBUG] [LOCAL ] SKYH: Trimmed 22539 records to 16725 (keeping 200 days of data) [2025-09-18T21:42:04.900934] [DEBUG] [LOCAL ] SKYH: Primary data saved (16725 records). [2025-09-18T21:42:04.901091] [INFO ] [MAIN ] SKYH: Full history saved. [2025-09-18T21:42:04.901178] [INFO ] [MAIN ] Update Progress: 1928/2372 symbols completed. SKYH took 20.5s. Estimated remaining: 1h 4m 57s. Rate: 6.8 symbols/min [2025-09-18T21:42:05.071858] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:42:05.110095] [DEBUG] [LOCAL ] SLF: Loaded 39345 existing records from primary storage. [2025-09-18T21:42:05.110265] [INFO ] [MAIN ] SLF: Loaded 39345 existing records. [2025-09-18T21:42:05.288023] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:42:05.288293] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-09-18T21:42:05.288342] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-09-18T21:42:05.289388] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-09-18T21:42:05.289449] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-09-18T21:42:05.324856] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-09-18T21:42:05.663182] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:42:06.127174] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-11. [2025-09-18T21:42:06.144029] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-18T21:42:06.620959] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-18T21:42:06.919601] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-09-18T21:42:07.326524] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-18T21:42:07.719782] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-09-18T21:42:07.938237] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-18T21:42:07.946793] [INFO ] [REMOTE ] SKT: Full fetch complete (59715 records). [2025-09-18T21:42:07.947115] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-09-18T21:42:08.523586] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-09-18T21:42:08.560374] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-09-18T21:42:08.560489] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-09-18T21:42:08.561571] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-09-18T21:42:08.561726] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-09-18T21:42:08.563189] [DEBUG] [LOCAL ] SKT: Trimmed 59715 records to 42905 (keeping 200 days of data) [2025-09-18T21:42:08.826993] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T21:42:08.877005] [DEBUG] [LOCAL ] SKT: Primary data saved (42905 records). [2025-09-18T21:42:08.877161] [INFO ] [MAIN ] SKT: Full history saved. [2025-09-18T21:42:08.877251] [INFO ] [MAIN ] Update Progress: 1929/2372 symbols completed. SKT took 43.3s. Estimated remaining: 1h 4m 47s. Rate: 6.8 symbols/min [2025-09-18T21:42:09.043698] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:42:09.085682] [DEBUG] [LOCAL ] SLG: Loaded 45646 existing records from primary storage. [2025-09-18T21:42:09.085835] [INFO ] [MAIN ] SLG: Loaded 45646 existing records. [2025-09-18T21:42:09.272672] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:42:09.272953] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-09-18T21:42:09.273005] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-09-18T21:42:09.274410] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-09-18T21:42:09.274475] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-09-18T21:42:09.324717] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-09-18T21:42:09.665348] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:42:10.119563] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-11. [2025-09-18T21:42:10.445711] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-18T21:42:10.901529] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T21:42:10.919505] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-09-18T21:42:11.349590] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-18T21:42:11.719549] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-09-18T21:42:12.012825] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-18T21:42:12.519543] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-09-18T21:42:13.143811] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-18T21:42:13.319533] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-09-18T21:42:14.119528] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-09-18T21:42:14.198177] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-18T21:42:14.622269] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-18T21:42:14.919546] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-09-18T21:42:15.526721] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T21:42:15.719504] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-09-18T21:42:16.473822] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T21:42:16.519521] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-09-18T21:42:17.319536] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-09-18T21:42:17.475727] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-18T21:42:17.872977] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T21:42:18.119571] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-09-18T21:42:18.548089] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T21:42:18.919587] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-09-18T21:42:19.719604] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-09-18T21:42:20.229589] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-18T21:42:20.318962] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-18T21:42:20.519545] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-09-18T21:42:20.921498] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-18T21:42:21.319596] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-09-18T21:42:21.698814] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-18T21:42:22.119551] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-09-18T21:42:22.438235] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-18T21:42:22.919559] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-09-18T21:42:23.459734] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-18T21:42:23.719545] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-09-18T21:42:24.396332] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T21:42:24.519570] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-09-18T21:42:25.319512] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-09-18T21:42:25.552027] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-18T21:42:25.914148] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-18T21:42:26.119563] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-09-18T21:42:26.565371] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-18T21:42:26.919611] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-09-18T21:42:27.490221] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-18T21:42:27.719542] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-09-18T21:42:28.519545] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-09-18T21:42:28.800447] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-18T21:42:29.027075] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-18T21:42:29.319608] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-09-18T21:42:29.686015] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-18T21:42:29.692184] [INFO ] [REMOTE ] SKY: Full fetch complete (54681 records). [2025-09-18T21:42:29.692300] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-09-18T21:42:30.131030] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-09-18T21:42:30.150507] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-09-18T21:42:30.150597] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-09-18T21:42:30.151564] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-09-18T21:42:30.151760] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-09-18T21:42:30.152951] [DEBUG] [LOCAL ] SKY: Trimmed 54681 records to 37932 (keeping 200 days of data) [2025-09-18T21:42:30.377997] [DEBUG] [LOCAL ] SKY: Primary data saved (37932 records). [2025-09-18T21:42:30.378155] [INFO ] [MAIN ] SKY: Full history saved. [2025-09-18T21:42:30.378262] [INFO ] [MAIN ] Update Progress: 1930/2372 symbols completed. SKY took 47.2s. Estimated remaining: 1h 4m 41s. Rate: 6.8 symbols/min [2025-09-18T21:42:30.551864] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:42:30.589917] [DEBUG] [LOCAL ] SLGN: Loaded 40273 existing records from primary storage. [2025-09-18T21:42:30.590089] [INFO ] [MAIN ] SLGN: Loaded 40273 existing records. [2025-09-18T21:42:30.775179] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:42:30.775589] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-09-18T21:42:30.775756] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-09-18T21:42:30.776713] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-09-18T21:42:30.776826] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-09-18T21:42:30.905850] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T21:42:30.926110] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-09-18T21:42:31.192268] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:42:31.719551] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-09-18T21:42:32.024215] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-18T21:42:32.433937] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-18T21:42:32.519563] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-09-18T21:42:32.668541] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-18T21:42:32.675579] [INFO ] [REMOTE ] SLF: Full fetch complete (56545 records). [2025-09-18T21:42:32.675715] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-09-18T21:42:33.058962] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-09-18T21:42:33.059047] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-09-18T21:42:33.059943] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-09-18T21:42:33.060006] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-09-18T21:42:33.061318] [DEBUG] [LOCAL ] SLF: Trimmed 56545 records to 39573 (keeping 200 days of data) [2025-09-18T21:42:33.298051] [DEBUG] [LOCAL ] SLF: Primary data saved (39573 records). [2025-09-18T21:42:33.298187] [INFO ] [MAIN ] SLF: Full history saved. [2025-09-18T21:42:33.298283] [INFO ] [MAIN ] Update Progress: 1931/2372 symbols completed. SLF took 28.4s. Estimated remaining: 1h 4m 31s. Rate: 6.8 symbols/min [2025-09-18T21:42:33.329807] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-11. [2025-09-18T21:42:33.473828] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:42:33.473973] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-09-18T21:42:33.474010] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-09-18T21:42:33.474164] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-09-18T21:42:33.474205] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-18T21:42:33.474246] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-18T21:42:33.474278] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-09-18T21:42:33.844196] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:42:33.894248] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-18T21:42:34.119600] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-11. [2025-09-18T21:42:34.437749] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-11 (0.32 seconds). [2025-09-18T21:42:34.438993] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-18T21:42:34.919568] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-09-18T21:42:35.719626] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-09-18T21:42:36.168278] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-18T21:42:36.174949] [INFO ] [REMOTE ] SLG: Full fetch complete (65310 records). [2025-09-18T21:42:36.175060] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-09-18T21:42:36.526095] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-09-18T21:42:36.573450] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-09-18T21:42:36.573524] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-09-18T21:42:36.577985] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-09-18T21:42:36.578158] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-09-18T21:42:36.579911] [DEBUG] [LOCAL ] SLG: Trimmed 65310 records to 46009 (keeping 200 days of data) [2025-09-18T21:42:36.860658] [DEBUG] [LOCAL ] SLG: Primary data saved (46009 records). [2025-09-18T21:42:36.860805] [INFO ] [MAIN ] SLG: Full history saved. [2025-09-18T21:42:36.860908] [INFO ] [MAIN ] Update Progress: 1932/2372 symbols completed. SLG took 28.0s. Estimated remaining: 1h 4m 21s. Rate: 6.8 symbols/min [2025-09-18T21:42:37.032525] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:42:37.073376] [DEBUG] [LOCAL ] SLQT: Loaded 44321 existing records from primary storage. [2025-09-18T21:42:37.073521] [INFO ] [MAIN ] SLQT: Loaded 44321 existing records. [2025-09-18T21:42:37.249048] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:42:37.249302] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-09-18T21:42:37.249350] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-09-18T21:42:37.250290] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-09-18T21:42:37.250349] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-09-18T21:42:37.324723] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-09-18T21:42:37.609183] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:42:37.986767] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-18T21:42:38.022951] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-18T21:42:38.060570] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-18T21:42:38.119549] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-09-18T21:42:38.919578] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-09-18T21:42:39.255061] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-18T21:42:39.719633] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-09-18T21:42:40.091604] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-18T21:42:40.519586] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-11. [2025-09-18T21:42:40.860239] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-18T21:42:41.319603] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-09-18T21:42:41.605497] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-18T21:42:41.627811] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-18T21:42:42.119561] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-09-18T21:42:42.631082] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-18T21:42:42.638500] [INFO ] [REMOTE ] SLB: Full fetch complete (77603 records). [2025-09-18T21:42:42.638712] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-09-18T21:42:42.924802] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-09-18T21:42:43.041587] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-09-18T21:42:43.041724] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-09-18T21:42:43.042826] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-09-18T21:42:43.042904] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-09-18T21:42:43.044814] [DEBUG] [LOCAL ] SLB: Trimmed 77603 records to 54087 (keeping 200 days of data) [2025-09-18T21:42:43.381136] [DEBUG] [LOCAL ] SLB: Primary data saved (54087 records). [2025-09-18T21:42:43.381281] [INFO ] [MAIN ] SLB: Full history saved. [2025-09-18T21:42:43.382457] [INFO ] [MAIN ] Update Progress: 1933/2372 symbols completed. SLB took 53.7s. Estimated remaining: 1h 4m 12s. Rate: 6.8 symbols/min [2025-09-18T21:42:43.555273] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:42:43.583675] [DEBUG] [LOCAL ] SLVM: Loaded 28006 existing records from primary storage. [2025-09-18T21:42:43.583837] [INFO ] [MAIN ] SLVM: Loaded 28006 existing records. [2025-09-18T21:42:43.726168] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-09-18T21:42:43.769685] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:42:43.769916] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-09-18T21:42:43.769980] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-09-18T21:42:43.770776] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-09-18T21:42:43.770841] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-09-18T21:42:44.130192] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:42:44.130793] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-18T21:42:44.489448] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-18T21:42:44.519490] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-09-18T21:42:45.319600] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-11. [2025-09-18T21:42:46.072743] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-18T21:42:46.119495] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-09-18T21:42:46.299351] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-18T21:42:46.462873] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-18T21:42:46.919606] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-09-18T21:42:47.719605] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-09-18T21:42:48.520664] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-09-18T21:42:48.531748] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-18T21:42:48.710964] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-18T21:42:49.319556] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-09-18T21:42:50.125062] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-09-18T21:42:50.142532] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-18T21:42:50.405431] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-18T21:42:50.919567] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-09-18T21:42:51.221155] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-18T21:42:51.719556] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-09-18T21:42:52.519599] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-09-18T21:42:52.588069] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T21:42:52.654180] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-18T21:42:52.804526] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-18T21:42:53.319598] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-09-18T21:42:53.658518] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-18T21:42:54.119557] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-09-18T21:42:54.919551] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-09-18T21:42:55.238846] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-18T21:42:55.438883] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T21:42:55.719569] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-09-18T21:42:56.519540] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-09-18T21:42:56.917542] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-18T21:42:57.319546] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-09-18T21:42:58.119556] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-09-18T21:42:58.206355] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-18T21:42:58.354063] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-18T21:42:58.374709] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-18T21:42:58.919569] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-18T21:42:59.170717] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-18T21:42:59.171422] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1054 records). [2025-09-18T21:42:59.171491] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-09-18T21:42:59.365369] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-18T21:42:59.365557] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:42:59.365627] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:42:59.365720] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-18T21:42:59.365786] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-18T21:42:59.365824] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-09-18T21:42:59.365892] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-09-18T21:42:59.365978] [INFO ] [MAIN ] Update Progress: 1934/2372 symbols completed. SLNZ took 26.1s. Estimated remaining: 1h 4m 5s. Rate: 6.8 symbols/min [2025-09-18T21:42:59.564121] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:42:59.617767] [DEBUG] [LOCAL ] SM: Loaded 52333 existing records from primary storage. [2025-09-18T21:42:59.617918] [INFO ] [MAIN ] SM: Loaded 52333 existing records. [2025-09-18T21:42:59.721311] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-09-18T21:42:59.803928] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:42:59.804210] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-09-18T21:42:59.804260] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-09-18T21:42:59.806244] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-09-18T21:42:59.806447] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-09-18T21:43:00.206971] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:43:00.519617] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-09-18T21:43:01.319707] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-11. [2025-09-18T21:43:01.363725] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T21:43:01.470639] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-18T21:43:02.119568] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-09-18T21:43:02.924609] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-09-18T21:43:02.941721] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-18T21:43:03.388206] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-18T21:43:03.719613] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-09-18T21:43:03.955832] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-18T21:43:04.519594] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-09-18T21:43:04.935006] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-18T21:43:05.319517] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-09-18T21:43:06.119585] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-09-18T21:43:06.272787] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-18T21:43:06.328130] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-18T21:43:06.919552] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-09-18T21:43:07.466593] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-18T21:43:07.719564] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-09-18T21:43:08.519550] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-09-18T21:43:08.865839] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-18T21:43:08.906589] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-18T21:43:09.319552] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-09-18T21:43:09.746919] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-18T21:43:10.119562] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-09-18T21:43:10.919564] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-09-18T21:43:10.953887] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-18T21:43:11.187795] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-18T21:43:11.719558] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-09-18T21:43:12.463343] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-18T21:43:12.519552] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-09-18T21:43:13.183364] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T21:43:13.189810] [INFO ] [REMOTE ] SLGN: Full fetch complete (57588 records). [2025-09-18T21:43:13.189968] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-09-18T21:43:13.329575] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-09-18T21:43:13.574539] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-09-18T21:43:13.574632] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-09-18T21:43:13.575592] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-09-18T21:43:13.575678] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-09-18T21:43:13.576959] [DEBUG] [LOCAL ] SLGN: Trimmed 57588 records to 40594 (keeping 200 days of data) [2025-09-18T21:43:13.833169] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-18T21:43:13.841059] [INFO ] [REMOTE ] SLQT: Full fetch complete (63491 records). [2025-09-18T21:43:13.843507] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-09-18T21:43:14.131290] [DEBUG] [LOCAL ] SLGN: Primary data saved (40594 records). [2025-09-18T21:43:14.126017] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-09-18T21:43:14.153821] [INFO ] [MAIN ] SLGN: Full history saved. [2025-09-18T21:43:14.161676] [INFO ] [MAIN ] Update Progress: 1935/2372 symbols completed. SLGN took 43.8s. Estimated remaining: 1h 3m 57s. Rate: 6.8 symbols/min [2025-09-18T21:43:14.330629] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-09-18T21:43:14.342286] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-09-18T21:43:14.348533] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-09-18T21:43:14.348618] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-09-18T21:43:14.393158] [DEBUG] [LOCAL ] SLQT: Trimmed 63491 records to 44598 (keeping 200 days of data) [2025-09-18T21:43:14.489738] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:43:14.498979] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-09-18T21:43:14.524682] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-09-18T21:43:14.528505] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-09-18T21:43:14.528884] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-18T21:43:14.533296] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-18T21:43:14.534484] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-09-18T21:43:15.015508] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:43:15.017557] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-11. [2025-09-18T21:43:15.080374] [DEBUG] [LOCAL ] SLQT: Primary data saved (44598 records). [2025-09-18T21:43:15.080523] [INFO ] [MAIN ] SLQT: Full history saved. [2025-09-18T21:43:15.080625] [INFO ] [MAIN ] Update Progress: 1936/2372 symbols completed. SLQT took 38.2s. Estimated remaining: 1h 3m 47s. Rate: 6.8 symbols/min [2025-09-18T21:43:15.288291] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:43:15.262825] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:43:15.290711] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-18T21:43:15.289038] [WARN ] [REMOTE ] SMA: No data returned for month 2024-11 [2025-09-18T21:43:15.310503] [DEBUG] [LOCAL ] SMBK: Loaded 8268 existing records from primary storage. [2025-09-18T21:43:15.310608] [INFO ] [MAIN ] SMBK: Loaded 8268 existing records. [2025-09-18T21:43:15.486261] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:43:15.486515] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-09-18T21:43:15.486562] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-09-18T21:43:15.486904] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-09-18T21:43:15.486964] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-09-18T21:43:15.726973] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-09-18T21:43:15.872521] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-18T21:43:15.892771] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:43:16.519603] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-09-18T21:43:16.748938] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:43:16.749330] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-09-18T21:43:17.319563] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-11. [2025-09-18T21:43:17.647148] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-18T21:43:17.783631] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-18T21:43:18.119586] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-09-18T21:43:18.919555] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-09-18T21:43:19.719525] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-01. [2025-09-18T21:43:19.837493] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-18T21:43:19.873428] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-18T21:43:20.026022] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:43:20.026343] [WARN ] [REMOTE ] SMA: No data returned for month 2025-01 [2025-09-18T21:43:20.519693] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-09-18T21:43:21.319522] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-02. [2025-09-18T21:43:21.472876] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-18T21:43:21.477124] [INFO ] [REMOTE ] SLVM: Full fetch complete (39272 records). [2025-09-18T21:43:21.477207] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-09-18T21:43:21.548704] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:43:21.578538] [WARN ] [REMOTE ] SMA: No data returned for month 2025-02 [2025-09-18T21:43:21.873544] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-09-18T21:43:21.873620] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-09-18T21:43:21.874537] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-09-18T21:43:21.874603] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-09-18T21:43:21.875500] [DEBUG] [LOCAL ] SLVM: Trimmed 39272 records to 28220 (keeping 200 days of data) [2025-09-18T21:43:22.058758] [DEBUG] [LOCAL ] SLVM: Primary data saved (28220 records). [2025-09-18T21:43:22.058993] [INFO ] [MAIN ] SLVM: Full history saved. [2025-09-18T21:43:22.059227] [INFO ] [MAIN ] Update Progress: 1937/2372 symbols completed. SLVM took 38.7s. Estimated remaining: 1h 3m 37s. Rate: 6.8 symbols/min [2025-09-18T21:43:22.124768] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-09-18T21:43:22.237584] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:43:22.251058] [DEBUG] [LOCAL ] SMC: Loaded 11482 existing records from primary storage. [2025-09-18T21:43:22.251172] [INFO ] [MAIN ] SMC: Loaded 11482 existing records. [2025-09-18T21:43:22.427298] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:43:22.427543] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-09-18T21:43:22.427592] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-09-18T21:43:22.427990] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-09-18T21:43:22.428066] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-09-18T21:43:22.798227] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:43:22.919508] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-09-18T21:43:22.929500] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-18T21:43:23.719566] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-09-18T21:43:24.519684] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-03. [2025-09-18T21:43:24.707085] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-18T21:43:24.713784] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-18T21:43:24.754411] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:43:24.754812] [WARN ] [REMOTE ] SMA: No data returned for month 2025-03 [2025-09-18T21:43:25.319547] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-09-18T21:43:26.119550] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-11. [2025-09-18T21:43:26.728517] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-18T21:43:26.866531] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-18T21:43:26.919544] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-04. [2025-09-18T21:43:27.719601] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-09-18T21:43:28.227543] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-18T21:43:28.390488] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-18T21:43:28.519544] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-09-18T21:43:29.254007] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-18T21:43:29.319524] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-09-18T21:43:30.046722] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-18T21:43:30.119523] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-09-18T21:43:30.708319] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-18T21:43:30.919560] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-09-18T21:43:31.643737] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-18T21:43:31.719509] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-09-18T21:43:32.416203] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-18T21:43:32.519519] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-09-18T21:43:33.297518] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-18T21:43:33.319488] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-09-18T21:43:33.979296] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-18T21:43:34.119510] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-09-18T21:43:34.713706] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-18T21:43:34.919555] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-09-18T21:43:35.719557] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-09-18T21:43:36.454581] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-18T21:43:36.519501] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-09-18T21:43:36.696283] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-18T21:43:37.319552] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-09-18T21:43:37.955238] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-18T21:43:37.971703] [INFO ] [REMOTE ] SM: Full fetch complete (74931 records). [2025-09-18T21:43:37.972741] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-18T21:43:37.972430] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-09-18T21:43:38.125598] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-09-18T21:43:38.388926] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-09-18T21:43:38.389010] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-09-18T21:43:38.390068] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-09-18T21:43:38.390133] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-09-18T21:43:38.392434] [DEBUG] [LOCAL ] SM: Trimmed 74931 records to 52708 (keeping 200 days of data) [2025-09-18T21:43:38.735477] [DEBUG] [LOCAL ] SM: Primary data saved (52708 records). [2025-09-18T21:43:38.735626] [INFO ] [MAIN ] SM: Full history saved. [2025-09-18T21:43:38.735793] [INFO ] [MAIN ] Update Progress: 1938/2372 symbols completed. SM took 39.4s. Estimated remaining: 1h 3m 30s. Rate: 6.8 symbols/min [2025-09-18T21:43:38.933212] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-09-18T21:43:38.966628] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:43:38.976602] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-18T21:43:39.024822] [DEBUG] [LOCAL ] SMFG: Loaded 48191 existing records from primary storage. [2025-09-18T21:43:39.024974] [INFO ] [MAIN ] SMFG: Loaded 48191 existing records. [2025-09-18T21:43:39.202976] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:43:39.203244] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-09-18T21:43:39.203293] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-09-18T21:43:39.204720] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-09-18T21:43:39.204785] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-09-18T21:43:39.561906] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:43:39.600353] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-18T21:43:39.602219] [INFO ] [REMOTE ] SMBK: Full fetch complete (11754 records). [2025-09-18T21:43:39.602292] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-09-18T21:43:39.724617] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-05. [2025-09-18T21:43:39.976259] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-09-18T21:43:39.976421] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-09-18T21:43:39.976774] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-09-18T21:43:39.976837] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-09-18T21:43:39.977329] [DEBUG] [LOCAL ] SMBK: Trimmed 11754 records to 8341 (keeping 200 days of data) [2025-09-18T21:43:40.035613] [DEBUG] [LOCAL ] SMBK: Primary data saved (8341 records). [2025-09-18T21:43:40.035776] [INFO ] [MAIN ] SMBK: Full history saved. [2025-09-18T21:43:40.035914] [INFO ] [MAIN ] Update Progress: 1939/2372 symbols completed. SMBK took 25.0s. Estimated remaining: 1h 3m 20s. Rate: 6.8 symbols/min [2025-09-18T21:43:40.209470] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:43:40.266611] [DEBUG] [LOCAL ] SMG: Loaded 44277 existing records from primary storage. [2025-09-18T21:43:40.266818] [INFO ] [MAIN ] SMG: Loaded 44277 existing records. [2025-09-18T21:43:40.449450] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:43:40.449791] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-09-18T21:43:40.449846] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-09-18T21:43:40.451242] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-09-18T21:43:40.451330] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-09-18T21:43:40.524777] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-11. [2025-09-18T21:43:40.828677] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:43:41.102483] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-18T21:43:41.319542] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-06. [2025-09-18T21:43:41.899948] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-18T21:43:42.119574] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-09-18T21:43:42.671618] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-18T21:43:42.850538] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-18T21:43:42.919525] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-09-18T21:43:43.719553] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-09-18T21:43:44.519565] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-07. [2025-09-18T21:43:44.570682] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-18T21:43:44.621452] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-18T21:43:45.319552] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-11. [2025-09-18T21:43:45.638401] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-18T21:43:46.119557] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-09-18T21:43:46.737157] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T21:43:46.919597] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-08. [2025-09-18T21:43:47.359404] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-18T21:43:47.719568] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-09-18T21:43:48.381932] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-18T21:43:48.519563] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-09-18T21:43:49.093159] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-18T21:43:49.319556] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-09-18T21:43:49.990824] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-18T21:43:50.107088] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-18T21:43:50.119490] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-09-18T21:43:50.919532] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-09-18T21:43:51.719569] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-09. [2025-09-18T21:43:51.759013] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-18T21:43:52.196995] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-18T21:43:52.519567] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-09-18T21:43:52.649688] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-18T21:43:52.655194] [INFO ] [REMOTE ] SMA: Full fetch complete (28677 records). [2025-09-18T21:43:52.655377] [DEBUG] [VALIDATOR ] SMA: Validating primary data. [2025-09-18T21:43:52.955354] [WARN ] [VALIDATOR ] SMA: Validation failed - insufficient historical data. Have 117 unique days, need 200 days [2025-09-18T21:43:52.956186] [FATAL] [MAIN ] SMA: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:43:52.956277] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:43:52.956443] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-18T21:43:52.956563] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-18T21:43:52.956633] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-09-18T21:43:52.956751] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-09-18T21:43:52.956854] [INFO ] [MAIN ] Update Progress: 1940/2372 symbols completed. SMA took 38.8s. Estimated remaining: 1h 3m 12s. Rate: 6.8 symbols/min [2025-09-18T21:43:53.236316] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:43:53.264046] [DEBUG] [LOCAL ] SMHI: Loaded 14627 existing records from primary storage. [2025-09-18T21:43:53.264272] [INFO ] [MAIN ] SMHI: Loaded 14627 existing records. [2025-09-18T21:43:53.325142] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-09-18T21:43:53.555996] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:43:53.556312] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-09-18T21:43:53.556375] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-09-18T21:43:53.557025] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-09-18T21:43:53.557102] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-09-18T21:43:54.024790] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:43:54.124678] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-09-18T21:43:54.145126] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-18T21:43:54.529229] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-18T21:43:54.619346] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-18T21:43:54.621675] [INFO ] [REMOTE ] SMC: Full fetch complete (16825 records). [2025-09-18T21:43:54.621789] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-09-18T21:43:54.924768] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-11. [2025-09-18T21:43:55.041234] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-09-18T21:43:55.041363] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-09-18T21:43:55.041928] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-09-18T21:43:55.041993] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-09-18T21:43:55.042893] [DEBUG] [LOCAL ] SMC: Trimmed 16825 records to 11545 (keeping 200 days of data) [2025-09-18T21:43:55.118668] [DEBUG] [LOCAL ] SMC: Primary data saved (11545 records). [2025-09-18T21:43:55.118901] [INFO ] [MAIN ] SMC: Full history saved. [2025-09-18T21:43:55.119056] [INFO ] [MAIN ] Update Progress: 1941/2372 symbols completed. SMC took 33.1s. Estimated remaining: 1h 3m 2s. Rate: 6.8 symbols/min [2025-09-18T21:43:55.299400] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:43:55.323781] [DEBUG] [LOCAL ] SMP: Loaded 19979 existing records from primary storage. [2025-09-18T21:43:55.323978] [INFO ] [MAIN ] SMP: Loaded 19979 existing records. [2025-09-18T21:43:55.514360] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:43:55.514748] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-09-18T21:43:55.514808] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-09-18T21:43:55.515482] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-09-18T21:43:55.515545] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-09-18T21:43:55.727690] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-09-18T21:43:55.936215] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:43:56.024038] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-18T21:43:56.519564] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-11. [2025-09-18T21:43:57.263685] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-18T21:43:57.298985] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T21:43:57.319506] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-09-18T21:43:58.119527] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-09-18T21:43:58.246399] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-18T21:43:58.919584] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-09-18T21:43:59.113836] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-18T21:43:59.719546] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-09-18T21:43:59.756906] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T21:44:00.519541] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-09-18T21:44:00.579367] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-18T21:44:01.319547] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-09-18T21:44:02.119589] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-09-18T21:44:02.286217] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-18T21:44:02.669387] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-18T21:44:02.919579] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-09-18T21:44:03.441920] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T21:44:03.719563] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-09-18T21:44:04.022715] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-18T21:44:04.519600] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-09-18T21:44:05.279045] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-18T21:44:05.329247] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-09-18T21:44:05.330383] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-18T21:44:06.119596] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-09-18T21:44:06.829483] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-18T21:44:06.919531] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-09-18T21:44:06.989242] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-18T21:44:07.719542] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-09-18T21:44:08.323222] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-18T21:44:08.333229] [INFO ] [REMOTE ] SMFG: Full fetch complete (68730 records). [2025-09-18T21:44:08.333471] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-09-18T21:44:08.524511] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-09-18T21:44:08.741246] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-09-18T21:44:08.741348] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-09-18T21:44:08.742383] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-09-18T21:44:08.742462] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-09-18T21:44:08.744102] [DEBUG] [LOCAL ] SMFG: Trimmed 68730 records to 48525 (keeping 200 days of data) [2025-09-18T21:44:09.032185] [DEBUG] [LOCAL ] SMFG: Primary data saved (48525 records). [2025-09-18T21:44:09.032322] [INFO ] [MAIN ] SMFG: Full history saved. [2025-09-18T21:44:09.032404] [INFO ] [MAIN ] Update Progress: 1942/2372 symbols completed. SMFG took 30.3s. Estimated remaining: 1h 2m 54s. Rate: 6.8 symbols/min [2025-09-18T21:44:09.203626] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:44:09.257126] [DEBUG] [LOCAL ] SMR: Loaded 53797 existing records from primary storage. [2025-09-18T21:44:09.257285] [INFO ] [MAIN ] SMR: Loaded 53797 existing records. [2025-09-18T21:44:09.325048] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-09-18T21:44:09.449240] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:44:09.449680] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-09-18T21:44:09.449787] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-18T21:44:09.451039] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-09-18T21:44:09.451103] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-09-18T21:44:09.767283] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T21:44:09.873392] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:44:09.878329] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-18T21:44:10.091745] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-18T21:44:10.119503] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-09-18T21:44:10.919561] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-09-18T21:44:11.719588] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-09-18T21:44:11.789970] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-18T21:44:11.885942] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-18T21:44:12.519515] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-09-18T21:44:12.546481] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-18T21:44:13.319549] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-09-18T21:44:13.443811] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-18T21:44:14.119584] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-09-18T21:44:14.750931] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T21:44:14.919549] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-11. [2025-09-18T21:44:15.223209] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-18T21:44:15.719561] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-09-18T21:44:16.519555] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-09-18T21:44:17.040308] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T21:44:17.078198] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-18T21:44:17.319554] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-09-18T21:44:17.439181] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-11 (2.52 seconds). [2025-09-18T21:44:18.119557] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-09-18T21:44:18.339681] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-18T21:44:18.919558] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-09-18T21:44:19.719570] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-09-18T21:44:19.756092] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T21:44:19.806898] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-18T21:44:20.519532] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-09-18T21:44:20.575976] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-18T21:44:20.578852] [INFO ] [REMOTE ] SMP: Full fetch complete (25959 records). [2025-09-18T21:44:20.578931] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-09-18T21:44:20.977959] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-09-18T21:44:20.978059] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-09-18T21:44:20.978713] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-09-18T21:44:20.978777] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-09-18T21:44:20.980549] [DEBUG] [LOCAL ] SMP: Trimmed 25959 records to 20119 (keeping 200 days of data) [2025-09-18T21:44:21.117950] [DEBUG] [LOCAL ] SMP: Primary data saved (20119 records). [2025-09-18T21:44:21.118080] [INFO ] [MAIN ] SMP: Full history saved. [2025-09-18T21:44:21.118192] [INFO ] [MAIN ] Update Progress: 1943/2372 symbols completed. SMP took 26.0s. Estimated remaining: 1h 2m 46s. Rate: 6.8 symbols/min [2025-09-18T21:44:21.303831] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:44:21.305807] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T21:44:21.319518] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-09-18T21:44:21.363341] [DEBUG] [LOCAL ] SMRT: Loaded 44441 existing records from primary storage. [2025-09-18T21:44:21.363489] [INFO ] [MAIN ] SMRT: Loaded 44441 existing records. [2025-09-18T21:44:21.601387] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:44:21.601697] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-09-18T21:44:21.601771] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-09-18T21:44:21.602765] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-09-18T21:44:21.602828] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-09-18T21:44:21.974302] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:44:21.979502] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-18T21:44:21.981401] [INFO ] [REMOTE ] SMHI: Full fetch complete (24812 records). [2025-09-18T21:44:21.981474] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-09-18T21:44:22.128092] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-09-18T21:44:22.370586] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-09-18T21:44:22.370694] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-09-18T21:44:22.371304] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-09-18T21:44:22.371347] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-09-18T21:44:22.372012] [DEBUG] [LOCAL ] SMHI: Trimmed 24812 records to 14702 (keeping 200 days of data) [2025-09-18T21:44:22.462813] [DEBUG] [LOCAL ] SMHI: Primary data saved (14702 records). [2025-09-18T21:44:22.462967] [INFO ] [MAIN ] SMHI: Full history saved. [2025-09-18T21:44:22.463059] [INFO ] [MAIN ] Update Progress: 1944/2372 symbols completed. SMHI took 29.5s. Estimated remaining: 1h 2m 36s. Rate: 6.8 symbols/min [2025-09-18T21:44:22.646982] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:44:22.688945] [DEBUG] [LOCAL ] SMWB: Loaded 33407 existing records from primary storage. [2025-09-18T21:44:22.689121] [INFO ] [MAIN ] SMWB: Loaded 33407 existing records. [2025-09-18T21:44:22.883106] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:44:22.883557] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-09-18T21:44:22.883631] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-09-18T21:44:22.884739] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-09-18T21:44:22.884814] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-09-18T21:44:22.926680] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-09-18T21:44:23.292521] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:44:23.719571] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-11. [2025-09-18T21:44:24.204035] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-18T21:44:24.209943] [INFO ] [REMOTE ] SMG: Full fetch complete (62642 records). [2025-09-18T21:44:24.210111] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-09-18T21:44:24.526849] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-11. [2025-09-18T21:44:24.634240] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-09-18T21:44:24.634350] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-09-18T21:44:24.635540] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-09-18T21:44:24.635688] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-09-18T21:44:24.637212] [DEBUG] [LOCAL ] SMG: Trimmed 62642 records to 44583 (keeping 200 days of data) [2025-09-18T21:44:24.774335] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-09-18T21:44:24.976614] [DEBUG] [LOCAL ] SMG: Primary data saved (44583 records). [2025-09-18T21:44:24.976782] [INFO ] [MAIN ] SMG: Full history saved. [2025-09-18T21:44:24.976890] [INFO ] [MAIN ] Update Progress: 1945/2372 symbols completed. SMG took 44.9s. Estimated remaining: 1h 2m 26s. Rate: 6.8 symbols/min [2025-09-18T21:44:25.161991] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:44:25.184285] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-18T21:44:25.239791] [DEBUG] [LOCAL ] SN: Loaded 49857 existing records from primary storage. [2025-09-18T21:44:25.239980] [INFO ] [MAIN ] SN: Loaded 49857 existing records. [2025-09-18T21:44:25.324780] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-09-18T21:44:25.422119] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:44:25.422401] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-09-18T21:44:25.422458] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-09-18T21:44:25.423695] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-09-18T21:44:25.423756] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-09-18T21:44:25.782319] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:44:25.871426] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-18T21:44:26.119603] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-11. [2025-09-18T21:44:26.919549] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-09-18T21:44:27.721498] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-09-18T21:44:27.724264] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-18T21:44:28.036864] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-18T21:44:28.115609] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.79 seconds). [2025-09-18T21:44:28.519541] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-09-18T21:44:28.936814] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-18T21:44:29.319578] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-09-18T21:44:29.896918] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-18T21:44:30.119589] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-09-18T21:44:30.505973] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-18T21:44:30.919583] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-09-18T21:44:31.707984] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-18T21:44:31.723973] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-09-18T21:44:32.277916] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-18T21:44:32.519589] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-09-18T21:44:33.319548] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-09-18T21:44:34.078771] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-18T21:44:34.132246] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-09-18T21:44:34.155285] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-18T21:44:34.547704] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-18T21:44:34.919618] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-09-18T21:44:35.430780] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-18T21:44:35.719557] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-09-18T21:44:36.519619] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-09-18T21:44:37.103493] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-18T21:44:37.190190] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-18T21:44:37.319509] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-09-18T21:44:38.119592] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-09-18T21:44:38.320367] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-18T21:44:38.919586] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-09-18T21:44:39.546558] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T21:44:39.719510] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-09-18T21:44:39.765003] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-18T21:44:40.292431] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-18T21:44:40.519559] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-09-18T21:44:41.087035] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T21:44:41.319554] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-09-18T21:44:42.119606] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-09-18T21:44:42.780507] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T21:44:42.902806] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-18T21:44:42.919544] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-09-18T21:44:43.573095] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-18T21:44:43.719551] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-09-18T21:44:44.404083] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-18T21:44:44.519542] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-09-18T21:44:45.319576] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-09-18T21:44:45.780976] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-18T21:44:46.119555] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-09-18T21:44:46.345176] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-18T21:44:46.786773] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-18T21:44:46.919508] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-09-18T21:44:47.037891] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-18T21:44:47.719564] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-09-18T21:44:48.273896] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-18T21:44:48.519561] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-09-18T21:44:49.319618] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-09-18T21:44:49.877268] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-18T21:44:49.883265] [INFO ] [REMOTE ] SMRT: Full fetch complete (62252 records). [2025-09-18T21:44:49.883412] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-09-18T21:44:50.127945] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-09-18T21:44:50.292592] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-09-18T21:44:50.292761] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-09-18T21:44:50.293877] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-09-18T21:44:50.293986] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-09-18T21:44:50.295387] [DEBUG] [LOCAL ] SMRT: Trimmed 62252 records to 44785 (keeping 200 days of data) [2025-09-18T21:44:50.549412] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-09-18T21:44:50.619884] [DEBUG] [LOCAL ] SMRT: Primary data saved (44785 records). [2025-09-18T21:44:50.620047] [INFO ] [MAIN ] SMRT: Full history saved. [2025-09-18T21:44:50.621084] [INFO ] [MAIN ] Update Progress: 1946/2372 symbols completed. SMRT took 29.5s. Estimated remaining: 1h 2m 21s. Rate: 6.8 symbols/min [2025-09-18T21:44:50.795469] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:44:50.824140] [DEBUG] [LOCAL ] SNA: Loaded 26421 existing records from primary storage. [2025-09-18T21:44:50.824433] [INFO ] [MAIN ] SNA: Loaded 26421 existing records. [2025-09-18T21:44:50.923244] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-09-18T21:44:51.020678] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-18T21:44:51.054215] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:44:51.054895] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-09-18T21:44:51.054947] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-09-18T21:44:51.055691] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-09-18T21:44:51.055752] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-09-18T21:44:51.413798] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:44:51.665049] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-18T21:44:51.719498] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-09-18T21:44:52.519589] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-09-18T21:44:52.619846] [DEBUG] [REMOTE ] SN: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-18T21:44:52.620234] [WARN ] [REMOTE ] SN: No data returned for month 2025-05 [2025-09-18T21:44:53.077141] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-18T21:44:53.082147] [INFO ] [REMOTE ] SMWB: Full fetch complete (50482 records). [2025-09-18T21:44:53.082248] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-09-18T21:44:53.327767] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-11. [2025-09-18T21:44:53.471615] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-09-18T21:44:53.471759] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-09-18T21:44:53.472817] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-09-18T21:44:53.472964] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-09-18T21:44:53.474382] [DEBUG] [LOCAL ] SMWB: Trimmed 50482 records to 33579 (keeping 200 days of data) [2025-09-18T21:44:53.695732] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-09-18T21:44:53.716927] [DEBUG] [LOCAL ] SMWB: Primary data saved (33579 records). [2025-09-18T21:44:53.717432] [INFO ] [MAIN ] SMWB: Full history saved. [2025-09-18T21:44:53.717554] [INFO ] [MAIN ] Update Progress: 1947/2372 symbols completed. SMWB took 31.3s. Estimated remaining: 1h 2m 11s. Rate: 6.8 symbols/min [2025-09-18T21:44:53.888536] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:44:53.939156] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-09-18T21:44:53.939306] [INFO ] [MAIN ] SNAP: Loaded 53796 existing records. [2025-09-18T21:44:54.116919] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:44:54.117239] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-09-18T21:44:54.117296] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-09-18T21:44:54.118456] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-09-18T21:44:54.118516] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-09-18T21:44:54.129630] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-09-18T21:44:54.485377] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:44:54.702683] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-18T21:44:54.919553] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-11. [2025-09-18T21:44:55.719556] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-09-18T21:44:55.782996] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-18T21:44:56.519545] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-09-18T21:44:56.787216] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-18T21:44:57.229594] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-11 (2.31 seconds). [2025-09-18T21:44:57.319541] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-09-18T21:44:57.994764] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T21:44:58.119506] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-09-18T21:44:58.919556] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-09-18T21:44:59.280887] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-18T21:44:59.463633] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-18T21:44:59.719552] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-09-18T21:45:00.519602] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-09-18T21:45:01.117212] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-18T21:45:01.319563] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-09-18T21:45:01.399872] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-18T21:45:01.411575] [INFO ] [REMOTE ] SMR: Full fetch complete (77974 records). [2025-09-18T21:45:01.411852] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-09-18T21:45:01.832224] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-09-18T21:45:01.832340] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-09-18T21:45:01.833476] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-09-18T21:45:01.833554] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-09-18T21:45:01.835285] [DEBUG] [LOCAL ] SMR: Trimmed 77974 records to 54187 (keeping 200 days of data) [2025-09-18T21:45:02.131788] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-09-18T21:45:02.159433] [DEBUG] [LOCAL ] SMR: Primary data saved (54187 records). [2025-09-18T21:45:02.159561] [INFO ] [MAIN ] SMR: Full history saved. [2025-09-18T21:45:02.159671] [INFO ] [MAIN ] Update Progress: 1948/2372 symbols completed. SMR took 53.1s. Estimated remaining: 1h 2m 2s. Rate: 6.8 symbols/min [2025-09-18T21:45:02.350367] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:45:02.357161] [DEBUG] [LOCAL ] SNDA: Loaded 4753 existing records from primary storage. [2025-09-18T21:45:02.357254] [INFO ] [MAIN ] SNDA: Loaded 4753 existing records. [2025-09-18T21:45:02.556789] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:45:02.557059] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-09-18T21:45:02.557129] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-09-18T21:45:02.557462] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-09-18T21:45:02.557524] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-09-18T21:45:02.943286] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:45:02.943827] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-11. [2025-09-18T21:45:02.963965] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-18T21:45:02.971412] [INFO ] [REMOTE ] SN: Full fetch complete (62908 records). [2025-09-18T21:45:02.971674] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-09-18T21:45:03.189435] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-09-18T21:45:03.211628] [WARN ] [VALIDATOR ] SN: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-18T21:45:03.222706] [FATAL] [MAIN ] SN: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:45:03.224047] [WARN ] [MAIN ] SN: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:45:03.224739] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-09-18T21:45:03.225212] [DEBUG] [LOCAL ] SN: No primary data file found to delete. [2025-09-18T21:45:03.225370] [INFO ] [LOCAL ] SN: Starting deletion of derivative data. [2025-09-18T21:45:03.226233] [DEBUG] [LOCAL ] SN: Deleted derivative data file. [2025-09-18T21:45:03.226388] [INFO ] [MAIN ] Update Progress: 1949/2372 symbols completed. SN took 38.2s. Estimated remaining: 1h 1m 51s. Rate: 6.8 symbols/min [2025-09-18T21:45:03.407109] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-18T21:45:03.432345] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:45:03.472267] [DEBUG] [LOCAL ] SNDR: Loaded 40444 existing records from primary storage. [2025-09-18T21:45:03.472489] [INFO ] [MAIN ] SNDR: Loaded 40444 existing records. [2025-09-18T21:45:03.653611] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:45:03.653958] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-09-18T21:45:03.654015] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-09-18T21:45:03.654937] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-09-18T21:45:03.654999] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-09-18T21:45:03.724726] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-09-18T21:45:03.975356] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-18T21:45:04.037001] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:45:04.519543] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-11. [2025-09-18T21:45:05.319579] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-09-18T21:45:05.895630] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-18T21:45:06.046379] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-18T21:45:06.119623] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-09-18T21:45:06.502970] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-18T21:45:06.919545] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-09-18T21:45:07.719545] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-09-18T21:45:08.154729] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-18T21:45:08.519513] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-09-18T21:45:08.667799] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-18T21:45:08.834134] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T21:45:09.319550] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-09-18T21:45:10.119551] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-09-18T21:45:10.478589] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-18T21:45:10.744746] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-18T21:45:10.897188] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-18T21:45:10.919515] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-09-18T21:45:11.712000] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-18T21:45:11.719487] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-09-18T21:45:12.289988] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-18T21:45:12.519554] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-09-18T21:45:13.067035] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-18T21:45:13.319558] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-09-18T21:45:14.119507] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-09-18T21:45:14.523595] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-18T21:45:14.919570] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-09-18T21:45:15.323796] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T21:45:15.581470] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-18T21:45:15.719585] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-09-18T21:45:16.519584] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-09-18T21:45:17.056273] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-18T21:45:17.319553] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-09-18T21:45:17.692447] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-18T21:45:18.119549] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-09-18T21:45:18.593063] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-18T21:45:18.919569] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-09-18T21:45:18.953912] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-18T21:45:18.958437] [INFO ] [REMOTE ] SNA: Full fetch complete (39148 records). [2025-09-18T21:45:18.958580] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-09-18T21:45:19.354244] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-09-18T21:45:19.354342] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-09-18T21:45:19.355295] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-09-18T21:45:19.355382] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-09-18T21:45:19.356492] [DEBUG] [LOCAL ] SNA: Trimmed 39148 records to 26615 (keeping 200 days of data) [2025-09-18T21:45:19.537884] [DEBUG] [LOCAL ] SNA: Primary data saved (26615 records). [2025-09-18T21:45:19.538083] [INFO ] [MAIN ] SNA: Full history saved. [2025-09-18T21:45:19.538328] [INFO ] [MAIN ] Update Progress: 1950/2372 symbols completed. SNA took 28.9s. Estimated remaining: 1h 1m 44s. Rate: 6.8 symbols/min [2025-09-18T21:45:19.722880] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:45:19.722989] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-09-18T21:45:19.723669] [DEBUG] [LOCAL ] SNN: No existing data file found in primary storage. [2025-09-18T21:45:19.724673] [WARN ] [MAIN ] SNN: No existing data found, performing full refresh instead. [2025-09-18T21:45:19.724833] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-09-18T21:45:19.724876] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-09-18T21:45:19.724920] [DEBUG] [LOCAL ] SNN: No primary data file found to delete. [2025-09-18T21:45:19.724955] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-09-18T21:45:20.081233] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:45:20.305117] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-18T21:45:20.519604] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-11. [2025-09-18T21:45:21.255610] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-18T21:45:21.319498] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-09-18T21:45:21.858228] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-18T21:45:22.119608] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-09-18T21:45:22.919562] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-09-18T21:45:23.294695] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-18T21:45:23.596960] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-18T21:45:23.719571] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-09-18T21:45:24.195271] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-18T21:45:24.519545] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-09-18T21:45:25.319557] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-09-18T21:45:25.836884] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T21:45:25.879928] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-18T21:45:26.119569] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-09-18T21:45:26.915152] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-18T21:45:26.919484] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-09-18T21:45:26.949917] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-18T21:45:27.475790] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-18T21:45:27.719565] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-09-18T21:45:28.519550] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-09-18T21:45:29.243763] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T21:45:29.319558] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-09-18T21:45:30.119570] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-09-18T21:45:30.598386] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-18T21:45:30.754985] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-18T21:45:30.762445] [INFO ] [REMOTE ] SNAP: Full fetch complete (77895 records). [2025-09-18T21:45:30.762589] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-09-18T21:45:30.920089] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-09-18T21:45:31.213342] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-09-18T21:45:31.214738] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-09-18T21:45:31.217861] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-09-18T21:45:31.215790] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-18T21:45:31.218070] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-09-18T21:45:31.228557] [DEBUG] [LOCAL ] SNAP: Trimmed 77895 records to 54186 (keeping 200 days of data) [2025-09-18T21:45:31.476557] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-18T21:45:31.479456] [INFO ] [REMOTE ] SNDA: Full fetch complete (8599 records). [2025-09-18T21:45:31.480405] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-09-18T21:45:31.725568] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-09-18T21:45:31.978321] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-09-18T21:45:31.979029] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-09-18T21:45:31.980266] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-09-18T21:45:31.980597] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-09-18T21:45:31.982201] [DEBUG] [LOCAL ] SNDA: Trimmed 8599 records to 4786 (keeping 200 days of data) [2025-09-18T21:45:32.023739] [DEBUG] [LOCAL ] SNDA: Primary data saved (4786 records). [2025-09-18T21:45:32.024946] [INFO ] [MAIN ] SNDA: Full history saved. [2025-09-18T21:45:32.025454] [INFO ] [MAIN ] Update Progress: 1951/2372 symbols completed. SNDA took 29.9s. Estimated remaining: 1h 1m 36s. Rate: 6.8 symbols/min [2025-09-18T21:45:32.136620] [DEBUG] [LOCAL ] SNAP: Primary data saved (54186 records). [2025-09-18T21:45:32.142585] [INFO ] [MAIN ] SNAP: Full history saved. [2025-09-18T21:45:32.163392] [INFO ] [MAIN ] Update Progress: 1952/2372 symbols completed. SNAP took 38.4s. Estimated remaining: 1h 1m 25s. Rate: 6.8 symbols/min [2025-09-18T21:45:32.291390] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:45:32.387938] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:45:32.453052] [DEBUG] [LOCAL ] SNV: Loaded 48944 existing records from primary storage. [2025-09-18T21:45:32.453221] [INFO ] [MAIN ] SNV: Loaded 48944 existing records. [2025-09-18T21:45:32.519924] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-09-18T21:45:32.588605] [DEBUG] [LOCAL ] SNOW: Loaded 53569 existing records from primary storage. [2025-09-18T21:45:32.599133] [INFO ] [MAIN ] SNOW: Loaded 53569 existing records. [2025-09-18T21:45:32.768220] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:45:32.789855] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-09-18T21:45:32.808758] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-09-18T21:45:32.836384] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-09-18T21:45:32.850352] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-09-18T21:45:32.850233] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:45:32.870793] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-09-18T21:45:32.877552] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-18T21:45:32.927709] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-09-18T21:45:32.937272] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-09-18T21:45:33.689636] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:45:33.657600] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:45:33.690311] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-11. [2025-09-18T21:45:33.693268] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-18T21:45:34.049469] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-18T21:45:34.119572] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-09-18T21:45:34.919559] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-11. [2025-09-18T21:45:35.136519] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-18T21:45:35.552690] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T21:45:35.719587] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-09-18T21:45:36.519568] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-09-18T21:45:37.055165] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T21:45:37.144578] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-11 (2.23 seconds). [2025-09-18T21:45:37.319542] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-09-18T21:45:38.109104] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T21:45:38.119550] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-09-18T21:45:38.831117] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-18T21:45:38.919548] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-09-18T21:45:39.680887] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-18T21:45:39.719542] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-09-18T21:45:40.233537] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-18T21:45:40.519576] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-09-18T21:45:41.319563] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-09-18T21:45:42.124629] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-09-18T21:45:42.141542] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-18T21:45:42.185215] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-18T21:45:42.745583] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T21:45:42.919617] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-09-18T21:45:43.267198] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-18T21:45:43.272954] [INFO ] [REMOTE ] SNDR: Full fetch complete (58728 records). [2025-09-18T21:45:43.273090] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-09-18T21:45:43.660587] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-09-18T21:45:43.660715] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-09-18T21:45:43.661677] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-09-18T21:45:43.661743] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-09-18T21:45:43.665358] [DEBUG] [LOCAL ] SNDR: Trimmed 58728 records to 40781 (keeping 200 days of data) [2025-09-18T21:45:43.734876] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-09-18T21:45:43.934267] [DEBUG] [LOCAL ] SNDR: Primary data saved (40781 records). [2025-09-18T21:45:43.934434] [INFO ] [MAIN ] SNDR: Full history saved. [2025-09-18T21:45:43.934620] [INFO ] [MAIN ] Update Progress: 1953/2372 symbols completed. SNDR took 40.7s. Estimated remaining: 1h 1m 17s. Rate: 6.8 symbols/min [2025-09-18T21:45:44.164089] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:45:44.209604] [DEBUG] [LOCAL ] SNX: Loaded 39572 existing records from primary storage. [2025-09-18T21:45:44.209776] [INFO ] [MAIN ] SNX: Loaded 39572 existing records. [2025-09-18T21:45:44.398408] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:45:44.398843] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-09-18T21:45:44.398955] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-09-18T21:45:44.399986] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-09-18T21:45:44.400048] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-09-18T21:45:44.522035] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-09-18T21:45:44.718564] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-18T21:45:44.807440] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:45:45.319565] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-09-18T21:45:46.119585] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-11. [2025-09-18T21:45:46.163531] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-09-18T21:45:46.206090] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-18T21:45:46.751074] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T21:45:46.919548] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-09-18T21:45:47.344063] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-18T21:45:47.719571] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-09-18T21:45:48.140551] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-18T21:45:48.519575] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-09-18T21:45:49.092969] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-18T21:45:49.319567] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-09-18T21:45:50.108639] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T21:45:50.119709] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-09-18T21:45:50.708301] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T21:45:50.919604] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-09-18T21:45:51.727159] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-09-18T21:45:51.733050] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-18T21:45:52.348269] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-18T21:45:52.357407] [INFO ] [REMOTE ] SNN: Full fetch complete (62799 records). [2025-09-18T21:45:52.357529] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-09-18T21:45:52.523238] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-09-18T21:45:52.774497] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-09-18T21:45:52.774599] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-09-18T21:45:52.775627] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-09-18T21:45:52.775713] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-09-18T21:45:52.777097] [DEBUG] [LOCAL ] SNN: Trimmed 62799 records to 44690 (keeping 200 days of data) [2025-09-18T21:45:53.071453] [DEBUG] [LOCAL ] SNN: Primary data saved (44690 records). [2025-09-18T21:45:53.071592] [INFO ] [MAIN ] SNN: Full history saved. [2025-09-18T21:45:53.071700] [INFO ] [MAIN ] Update Progress: 1954/2372 symbols completed. SNN took 33.5s. Estimated remaining: 1h 1m 9s. Rate: 6.8 symbols/min [2025-09-18T21:45:53.248029] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:45:53.312437] [DEBUG] [LOCAL ] SO: Loaded 53603 existing records from primary storage. [2025-09-18T21:45:53.312623] [INFO ] [MAIN ] SO: Loaded 53603 existing records. [2025-09-18T21:45:53.348846] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-09-18T21:45:53.513261] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:45:53.513707] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-09-18T21:45:53.513766] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-18T21:45:53.515486] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-09-18T21:45:53.515551] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-09-18T21:45:53.911946] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:45:54.068904] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-18T21:45:54.101526] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-18T21:45:54.119480] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-09-18T21:45:54.813612] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-18T21:45:54.919587] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-09-18T21:45:55.234896] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-18T21:45:55.719572] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-09-18T21:45:56.519617] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-11. [2025-09-18T21:45:57.054979] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-18T21:45:57.065236] [INFO ] [REMOTE ] SNV: Full fetch complete (70913 records). [2025-09-18T21:45:57.065514] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-09-18T21:45:57.327683] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-09-18T21:45:57.383178] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-18T21:45:57.549157] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-09-18T21:45:57.549237] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-09-18T21:45:57.550246] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-09-18T21:45:57.550311] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-09-18T21:45:57.551775] [DEBUG] [LOCAL ] SNV: Trimmed 70913 records to 49306 (keeping 200 days of data) [2025-09-18T21:45:57.860541] [DEBUG] [LOCAL ] SNV: Primary data saved (49306 records). [2025-09-18T21:45:57.860730] [INFO ] [MAIN ] SNV: Full history saved. [2025-09-18T21:45:57.860836] [INFO ] [MAIN ] Update Progress: 1955/2372 symbols completed. SNV took 25.7s. Estimated remaining: 1h 0m 59s. Rate: 6.8 symbols/min [2025-09-18T21:45:58.040411] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:45:58.080443] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-18T21:45:58.120955] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-09-18T21:45:58.149834] [DEBUG] [LOCAL ] SOBO: Loaded 40075 existing records from primary storage. [2025-09-18T21:45:58.150048] [INFO ] [MAIN ] SOBO: Loaded 40075 existing records. [2025-09-18T21:45:58.407820] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:45:58.408118] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-09-18T21:45:58.408193] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-09-18T21:45:58.409221] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-09-18T21:45:58.409301] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-09-18T21:45:58.921855] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-09-18T21:45:59.014818] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:45:59.039958] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-18T21:45:59.729214] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-11. [2025-09-18T21:45:59.735232] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-18T21:46:00.519559] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-09-18T21:46:00.993604] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-18T21:46:01.065714] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-18T21:46:01.319629] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-09-18T21:46:02.061729] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-18T21:46:02.119554] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-09-18T21:46:02.919558] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-09-18T21:46:03.012120] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-18T21:46:03.719545] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-09-18T21:46:04.360119] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-18T21:46:04.466496] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-18T21:46:04.519532] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-09-18T21:46:05.075111] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-18T21:46:05.319593] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-09-18T21:46:06.119555] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-09-18T21:46:06.886638] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-18T21:46:06.925065] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-09-18T21:46:06.931392] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-18T21:46:07.492740] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-18T21:46:07.719552] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-09-18T21:46:08.045518] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-18T21:46:08.519545] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-09-18T21:46:09.250375] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T21:46:09.319537] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-09-18T21:46:09.999438] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-18T21:46:10.119555] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-09-18T21:46:10.919568] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-09-18T21:46:11.628586] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-18T21:46:11.719506] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-09-18T21:46:11.952683] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-18T21:46:12.185778] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-18T21:46:12.519568] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-09-18T21:46:13.319554] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-09-18T21:46:13.990755] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-18T21:46:14.076245] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T21:46:14.119494] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-09-18T21:46:14.668530] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-18T21:46:14.919553] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-09-18T21:46:15.719569] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-09-18T21:46:16.002545] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-18T21:46:16.330599] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-18T21:46:16.519557] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-09-18T21:46:16.865030] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-18T21:46:17.319563] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-09-18T21:46:18.119602] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-09-18T21:46:18.752774] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-18T21:46:18.839359] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-18T21:46:18.846874] [INFO ] [REMOTE ] SNOW: Full fetch complete (77615 records). [2025-09-18T21:46:18.847021] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-09-18T21:46:18.924876] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-09-18T21:46:19.282165] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-09-18T21:46:19.282255] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-09-18T21:46:19.283341] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-09-18T21:46:19.283425] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-09-18T21:46:19.285013] [DEBUG] [LOCAL ] SNOW: Trimmed 77615 records to 53959 (keeping 200 days of data) [2025-09-18T21:46:19.610608] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T21:46:19.690438] [DEBUG] [LOCAL ] SNOW: Primary data saved (53959 records). [2025-09-18T21:46:19.690719] [INFO ] [MAIN ] SNOW: Full history saved. [2025-09-18T21:46:19.690870] [INFO ] [MAIN ] Update Progress: 1956/2372 symbols completed. SNOW took 47.7s. Estimated remaining: 1h 0m 53s. Rate: 6.8 symbols/min [2025-09-18T21:46:19.724737] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-09-18T21:46:19.866627] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:46:19.912610] [DEBUG] [LOCAL ] SOC: Loaded 50212 existing records from primary storage. [2025-09-18T21:46:19.912850] [INFO ] [MAIN ] SOC: Loaded 50212 existing records. [2025-09-18T21:46:20.087147] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:46:20.087352] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-09-18T21:46:20.087400] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-09-18T21:46:20.088506] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-09-18T21:46:20.088568] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-09-18T21:46:20.446268] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:46:20.520773] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-11. [2025-09-18T21:46:20.526742] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-18T21:46:20.837450] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-18T21:46:20.842941] [INFO ] [REMOTE ] SNX: Full fetch complete (56145 records). [2025-09-18T21:46:20.843038] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-09-18T21:46:21.228700] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-09-18T21:46:21.228786] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-09-18T21:46:21.229596] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-09-18T21:46:21.229639] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-09-18T21:46:21.230785] [DEBUG] [LOCAL ] SNX: Trimmed 56145 records to 39913 (keeping 200 days of data) [2025-09-18T21:46:21.322989] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-09-18T21:46:21.485826] [DEBUG] [LOCAL ] SNX: Primary data saved (39913 records). [2025-09-18T21:46:21.485967] [INFO ] [MAIN ] SNX: Full history saved. [2025-09-18T21:46:21.486054] [INFO ] [MAIN ] Update Progress: 1957/2372 symbols completed. SNX took 37.6s. Estimated remaining: 1h 0m 43s. Rate: 6.8 symbols/min [2025-09-18T21:46:22.104125] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-18T21:46:22.119498] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-09-18T21:46:22.640324] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-18T21:46:22.919560] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-09-18T21:46:23.393691] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-18T21:46:23.719594] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-09-18T21:46:23.969164] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-18T21:46:24.519598] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-09-18T21:46:25.173205] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T21:46:25.319576] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-09-18T21:46:25.756063] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-18T21:46:25.764837] [INFO ] [REMOTE ] SO: Full fetch complete (77426 records). [2025-09-18T21:46:25.765047] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-09-18T21:46:26.125942] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-09-18T21:46:26.188796] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-09-18T21:46:26.189007] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-09-18T21:46:26.190417] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-09-18T21:46:26.190604] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-09-18T21:46:26.192579] [DEBUG] [LOCAL ] SO: Trimmed 77426 records to 53993 (keeping 200 days of data) [2025-09-18T21:46:26.319276] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-18T21:46:26.588490] [DEBUG] [LOCAL ] SO: Primary data saved (53993 records). [2025-09-18T21:46:26.588745] [INFO ] [MAIN ] SO: Full history saved. [2025-09-18T21:46:26.590678] [INFO ] [MAIN ] Update Progress: 1958/2372 symbols completed. SO took 33.5s. Estimated remaining: 1h 0m 33s. Rate: 6.8 symbols/min [2025-09-18T21:46:26.919585] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-09-18T21:46:27.469172] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-18T21:46:27.719607] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-09-18T21:46:28.341977] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T21:46:28.519612] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-09-18T21:46:28.796530] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-18T21:46:28.802159] [INFO ] [REMOTE ] SOBO: Full fetch complete (58640 records). [2025-09-18T21:46:28.802270] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-09-18T21:46:29.192468] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-09-18T21:46:29.192577] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-09-18T21:46:29.193498] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-09-18T21:46:29.193561] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-09-18T21:46:29.194859] [DEBUG] [LOCAL ] SOBO: Trimmed 58640 records to 40351 (keeping 200 days of data) [2025-09-18T21:46:29.439491] [DEBUG] [LOCAL ] SOBO: Primary data saved (40351 records). [2025-09-18T21:46:29.439621] [INFO ] [MAIN ] SOBO: Full history saved. [2025-09-18T21:46:29.439744] [INFO ] [MAIN ] Update Progress: 1959/2372 symbols completed. SOBO took 31.6s. Estimated remaining: 1h 0m 23s. Rate: 6.8 symbols/min [2025-09-18T21:46:29.936728] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-18T21:46:29.946896] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-09-18T21:46:31.651256] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-18T21:46:31.662531] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-09-18T21:46:33.299975] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-18T21:46:33.310925] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-09-18T21:46:34.902463] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T21:46:34.913348] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-09-18T21:46:36.668804] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-18T21:46:36.679985] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-09-18T21:46:38.420428] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-18T21:46:38.430891] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-09-18T21:46:40.185415] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-18T21:46:40.192823] [INFO ] [REMOTE ] SOC: Full fetch complete (71022 records). [2025-09-18T21:46:40.192943] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-09-18T21:46:40.587454] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-09-18T21:46:40.587573] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-09-18T21:46:40.588746] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-09-18T21:46:40.588813] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-09-18T21:46:40.590364] [DEBUG] [LOCAL ] SOC: Trimmed 71022 records to 50598 (keeping 200 days of data) [2025-09-18T21:46:40.889182] [DEBUG] [LOCAL ] SOC: Primary data saved (50598 records). [2025-09-18T21:46:40.889329] [INFO ] [MAIN ] SOC: Full history saved. [2025-09-18T21:46:40.889420] [INFO ] [MAIN ] Update Progress: 1960/2372 symbols completed. SOC took 21.2s. Estimated remaining: 1h 0m 15s. Rate: 6.8 symbols/min [2025-09-18T21:46:41.545953] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:46:41.584516] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:46:41.601323] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-09-18T21:46:41.623047] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:46:41.649602] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:46:41.649709] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-09-18T21:46:41.651613] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-09-18T21:46:41.651700] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-18T21:46:41.651760] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-18T21:46:41.651796] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-09-18T21:46:41.755585] [DEBUG] [LOCAL ] SOJE: Loaded 9482 existing records from primary storage. [2025-09-18T21:46:41.780324] [INFO ] [MAIN ] SOJE: Loaded 9482 existing records. [2025-09-18T21:46:41.793129] [DEBUG] [LOCAL ] SOJC: Loaded 5162 existing records from primary storage. [2025-09-18T21:46:41.814827] [INFO ] [MAIN ] SOJC: Loaded 5162 existing records. [2025-09-18T21:46:41.917385] [DEBUG] [LOCAL ] SOJD: Loaded 13004 existing records from primary storage. [2025-09-18T21:46:41.997666] [INFO ] [MAIN ] SOJD: Loaded 13004 existing records. [2025-09-18T21:46:42.471278] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:46:42.560920] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:46:42.557389] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-09-18T21:46:42.603542] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:46:42.614178] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-09-18T21:46:42.640379] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-09-18T21:46:42.614029] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-09-18T21:46:42.650337] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-09-18T21:46:42.657953] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-09-18T21:46:42.679996] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:46:42.657898] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-09-18T21:46:42.680298] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-09-18T21:46:42.680779] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-11. [2025-09-18T21:46:42.682007] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-09-18T21:46:42.682100] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-09-18T21:46:42.704806] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-09-18T21:46:42.704973] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-09-18T21:46:42.958303] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:46:43.016166] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-11 [2025-09-18T21:46:43.063027] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-09-18T21:46:43.414232] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:46:43.478130] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-09-18T21:46:43.519026] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-01. [2025-09-18T21:46:43.746790] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:46:43.775883] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:46:43.802334] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-11. [2025-09-18T21:46:43.802584] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-11. [2025-09-18T21:46:43.869464] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:46:43.870030] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-11. [2025-09-18T21:46:44.315481] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-18T21:46:44.317935] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-09-18T21:46:44.384934] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-18T21:46:44.389392] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-02. [2025-09-18T21:46:44.639785] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-18T21:46:44.642156] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-09-18T21:46:44.723573] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-18T21:46:44.727026] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-09-18T21:46:44.947803] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-18T21:46:44.950543] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-09-18T21:46:44.983294] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-18T21:46:44.986005] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-03. [2025-09-18T21:46:45.366172] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-18T21:46:45.368094] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-09-18T21:46:45.453721] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-18T21:46:45.457571] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-09-18T21:46:45.465394] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-18T21:46:45.468394] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-04. [2025-09-18T21:46:45.530109] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-18T21:46:45.714898] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-18T21:46:45.946838] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-18T21:46:46.119511] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-09-18T21:46:46.131067] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-18T21:46:46.836348] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-18T21:46:46.919558] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-09-18T21:46:47.601243] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-18T21:46:47.719556] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-09-18T21:46:48.519580] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-09-18T21:46:48.557264] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-18T21:46:49.015673] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-18T21:46:49.319605] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-09-18T21:46:50.119601] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-09-18T21:46:50.379848] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-18T21:46:50.682203] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-18T21:46:50.919559] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-09-18T21:46:51.643385] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-18T21:46:51.719578] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-09-18T21:46:52.220330] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-18T21:46:52.519622] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-09-18T21:46:53.075233] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-18T21:46:53.319503] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-09-18T21:46:54.019526] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-18T21:46:54.119560] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-09-18T21:46:54.903968] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-18T21:46:54.919518] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-09-18T21:46:55.469286] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-18T21:46:55.719539] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-09-18T21:46:56.207620] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-18T21:46:56.208965] [INFO ] [REMOTE ] SOJC: Full fetch complete (8207 records). [2025-09-18T21:46:56.209036] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-09-18T21:46:56.525608] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-09-18T21:46:56.571090] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-09-18T21:46:56.571288] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-09-18T21:46:56.571580] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-09-18T21:46:56.571625] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-09-18T21:46:56.572094] [DEBUG] [LOCAL ] SOJC: Trimmed 8207 records to 5199 (keeping 200 days of data) [2025-09-18T21:46:56.604813] [DEBUG] [LOCAL ] SOJC: Primary data saved (5199 records). [2025-09-18T21:46:56.604893] [INFO ] [MAIN ] SOJC: Full history saved. [2025-09-18T21:46:56.604982] [INFO ] [MAIN ] Update Progress: 1961/2372 symbols completed. SOJC took 15.7s. Estimated remaining: 1h 0m 8s. Rate: 6.8 symbols/min [2025-09-18T21:46:56.771871] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:46:56.787049] [DEBUG] [LOCAL ] SOL: Loaded 13739 existing records from primary storage. [2025-09-18T21:46:56.787156] [INFO ] [MAIN ] SOL: Loaded 13739 existing records. [2025-09-18T21:46:56.968845] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:46:56.969198] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-09-18T21:46:56.969277] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-09-18T21:46:56.970004] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-09-18T21:46:56.970087] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-09-18T21:46:57.322470] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:46:57.319513] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-05. [2025-09-18T21:46:57.402131] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-18T21:46:57.741122] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-18T21:46:58.119554] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-06. [2025-09-18T21:46:58.919618] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-09-18T21:46:58.951029] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-18T21:46:59.493922] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-18T21:46:59.719541] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-09-18T21:47:00.519594] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-09-18T21:47:00.583487] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-18T21:47:01.270756] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-18T21:47:01.319511] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-09-18T21:47:01.973291] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-18T21:47:02.119548] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-07. [2025-09-18T21:47:02.786556] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-18T21:47:02.919552] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-09-18T21:47:03.719614] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-08. [2025-09-18T21:47:03.768403] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-18T21:47:03.770607] [INFO ] [REMOTE ] SOJD: Full fetch complete (20306 records). [2025-09-18T21:47:03.770710] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-09-18T21:47:04.185761] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-09-18T21:47:04.185887] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-09-18T21:47:04.186389] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-09-18T21:47:04.186436] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-09-18T21:47:04.187196] [DEBUG] [LOCAL ] SOJD: Trimmed 20306 records to 13089 (keeping 200 days of data) [2025-09-18T21:47:04.258460] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-18T21:47:04.282326] [DEBUG] [LOCAL ] SOJD: Primary data saved (13089 records). [2025-09-18T21:47:04.282458] [INFO ] [MAIN ] SOJD: Full history saved. [2025-09-18T21:47:04.282544] [INFO ] [MAIN ] Update Progress: 1962/2372 symbols completed. SOJD took 23.4s. Estimated remaining: 59m 59s. Rate: 6.8 symbols/min [2025-09-18T21:47:04.463611] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:47:04.514323] [DEBUG] [LOCAL ] SOLV: Loaded 44321 existing records from primary storage. [2025-09-18T21:47:04.514531] [INFO ] [MAIN ] SOLV: Loaded 44321 existing records. [2025-09-18T21:47:04.525706] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-11. [2025-09-18T21:47:04.713857] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:47:04.714139] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-09-18T21:47:04.714205] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-09-18T21:47:04.715495] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-09-18T21:47:04.715561] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-09-18T21:47:05.087049] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:47:05.319546] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-09-18T21:47:05.536249] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T21:47:06.104715] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-18T21:47:06.119555] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-09. [2025-09-18T21:47:06.643286] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-18T21:47:06.645018] [INFO ] [REMOTE ] SOJF: Full fetch complete (12983 records). [2025-09-18T21:47:06.645091] [DEBUG] [VALIDATOR ] SOJF: Validating primary data. [2025-09-18T21:47:06.828823] [WARN ] [VALIDATOR ] SOJF: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-18T21:47:06.829129] [FATAL] [MAIN ] SOJF: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:47:06.829199] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:47:06.829248] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-18T21:47:06.829305] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-18T21:47:06.829340] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-09-18T21:47:06.829393] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-09-18T21:47:06.829489] [INFO ] [MAIN ] Update Progress: 1963/2372 symbols completed. SOJF took 25.9s. Estimated remaining: 59m 49s. Rate: 6.8 symbols/min [2025-09-18T21:47:06.927971] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-11. [2025-09-18T21:47:07.017981] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:47:07.061856] [DEBUG] [LOCAL ] SON: Loaded 42889 existing records from primary storage. [2025-09-18T21:47:07.062010] [INFO ] [MAIN ] SON: Loaded 42889 existing records. [2025-09-18T21:47:07.255978] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:47:07.256263] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-09-18T21:47:07.256316] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-09-18T21:47:07.257368] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-09-18T21:47:07.257430] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-09-18T21:47:07.673617] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:47:07.719506] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-11. [2025-09-18T21:47:08.519517] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-09-18T21:47:08.569605] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-18T21:47:09.060813] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-18T21:47:09.110773] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-18T21:47:09.319559] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-09-18T21:47:10.119598] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-09-18T21:47:10.897609] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-18T21:47:10.919496] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-09-18T21:47:11.719582] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-09-18T21:47:11.764992] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-18T21:47:12.418003] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-18T21:47:12.462505] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-18T21:47:12.519492] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-09-18T21:47:13.201969] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-18T21:47:13.319586] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-09-18T21:47:14.119551] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-09-18T21:47:14.695552] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T21:47:14.912304] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-18T21:47:14.919488] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-09-18T21:47:15.719517] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-09-18T21:47:16.027150] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-18T21:47:16.236131] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-18T21:47:16.237711] [INFO ] [REMOTE ] SOJE: Full fetch complete (14689 records). [2025-09-18T21:47:16.237782] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-09-18T21:47:16.525359] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-09-18T21:47:16.613660] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-09-18T21:47:16.613751] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-09-18T21:47:16.614117] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-09-18T21:47:16.614158] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-09-18T21:47:16.614766] [DEBUG] [LOCAL ] SOJE: Trimmed 14689 records to 9537 (keeping 200 days of data) [2025-09-18T21:47:16.674172] [DEBUG] [LOCAL ] SOJE: Primary data saved (9537 records). [2025-09-18T21:47:16.674318] [INFO ] [MAIN ] SOJE: Full history saved. [2025-09-18T21:47:16.674411] [INFO ] [MAIN ] Update Progress: 1964/2372 symbols completed. SOJE took 35.8s. Estimated remaining: 59m 40s. Rate: 6.8 symbols/min [2025-09-18T21:47:16.844734] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:47:16.900692] [DEBUG] [LOCAL ] SONY: Loaded 53366 existing records from primary storage. [2025-09-18T21:47:16.900900] [INFO ] [MAIN ] SONY: Loaded 53366 existing records. [2025-09-18T21:47:17.081835] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:47:17.082077] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-09-18T21:47:17.082125] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-09-18T21:47:17.083388] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-09-18T21:47:17.083450] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-09-18T21:47:17.328581] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-09-18T21:47:17.451613] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:47:18.119526] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-09-18T21:47:18.145544] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-18T21:47:18.272742] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-18T21:47:18.919621] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-09-18T21:47:19.319763] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-18T21:47:19.719591] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-09-18T21:47:20.343604] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-18T21:47:20.519582] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-09-18T21:47:20.814588] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-18T21:47:21.319567] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-11. [2025-09-18T21:47:22.116398] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-18T21:47:22.125335] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-09-18T21:47:22.903712] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-18T21:47:22.919497] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-09-18T21:47:23.088729] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-18T21:47:23.715089] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-18T21:47:23.719494] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-09-18T21:47:24.519553] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-09-18T21:47:24.759279] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-18T21:47:25.319547] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-09-18T21:47:25.958459] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-18T21:47:26.119549] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-09-18T21:47:26.589121] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-18T21:47:26.919556] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-09-18T21:47:27.719598] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-09-18T21:47:28.089592] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-18T21:47:28.322362] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-18T21:47:28.357269] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-18T21:47:28.519559] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-09-18T21:47:29.319544] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-09-18T21:47:30.119560] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-09-18T21:47:30.429313] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-18T21:47:30.722516] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-18T21:47:30.894795] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T21:47:30.919501] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-09-18T21:47:31.719585] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-09-18T21:47:32.134205] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-18T21:47:32.519568] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-09-18T21:47:32.985438] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-18T21:47:33.319578] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-09-18T21:47:34.119555] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-09-18T21:47:34.486842] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-18T21:47:34.675042] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T21:47:34.752375] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-18T21:47:34.754516] [INFO ] [REMOTE ] SOL: Full fetch complete (22003 records). [2025-09-18T21:47:34.754612] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-09-18T21:47:34.926901] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-09-18T21:47:35.126716] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-09-18T21:47:35.126834] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-09-18T21:47:35.127446] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-09-18T21:47:35.127525] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-09-18T21:47:35.128148] [DEBUG] [LOCAL ] SOL: Trimmed 22003 records to 13829 (keeping 200 days of data) [2025-09-18T21:47:35.205915] [DEBUG] [LOCAL ] SOL: Primary data saved (13829 records). [2025-09-18T21:47:35.206059] [INFO ] [MAIN ] SOL: Full history saved. [2025-09-18T21:47:35.206186] [INFO ] [MAIN ] Update Progress: 1965/2372 symbols completed. SOL took 38.6s. Estimated remaining: 59m 33s. Rate: 6.8 symbols/min [2025-09-18T21:47:35.374147] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:47:35.379234] [DEBUG] [LOCAL ] SOR: Loaded 2984 existing records from primary storage. [2025-09-18T21:47:35.379321] [INFO ] [MAIN ] SOR: Loaded 2984 existing records. [2025-09-18T21:47:35.555769] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:47:35.556001] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-09-18T21:47:35.556050] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-09-18T21:47:35.556319] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-09-18T21:47:35.556377] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-09-18T21:47:35.730430] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-09-18T21:47:35.925127] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:47:36.519509] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-09-18T21:47:36.566499] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-18T21:47:36.792810] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-18T21:47:37.319611] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-09-18T21:47:37.969735] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T21:47:38.119548] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-09-18T21:47:38.919571] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-11. [2025-09-18T21:47:39.384776] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-18T21:47:39.386680] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-18T21:47:39.458018] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-18T21:47:39.719609] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-09-18T21:47:40.519550] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-09-18T21:47:41.263864] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-18T21:47:41.273200] [INFO ] [REMOTE ] SOLV: Full fetch complete (63176 records). [2025-09-18T21:47:41.273333] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-09-18T21:47:41.330369] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-09-18T21:47:41.672109] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-09-18T21:47:41.672196] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-09-18T21:47:41.673167] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-09-18T21:47:41.673234] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-09-18T21:47:41.674624] [DEBUG] [LOCAL ] SOLV: Trimmed 63176 records to 44615 (keeping 200 days of data) [2025-09-18T21:47:41.949638] [DEBUG] [LOCAL ] SOLV: Primary data saved (44615 records). [2025-09-18T21:47:41.949805] [INFO ] [MAIN ] SOLV: Full history saved. [2025-09-18T21:47:41.951013] [INFO ] [MAIN ] Update Progress: 1966/2372 symbols completed. SOLV took 37.7s. Estimated remaining: 59m 24s. Rate: 6.8 symbols/min [2025-09-18T21:47:42.120944] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-09-18T21:47:42.122564] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:47:42.138712] [DEBUG] [LOCAL ] SOS: Loaded 7406 existing records from primary storage. [2025-09-18T21:47:42.138891] [INFO ] [MAIN ] SOS: Loaded 7406 existing records. [2025-09-18T21:47:42.322059] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:47:42.322425] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-09-18T21:47:42.322503] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-09-18T21:47:42.322943] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-09-18T21:47:42.323016] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-09-18T21:47:42.667791] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-18T21:47:42.651023] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-18T21:47:42.773791] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-18T21:47:42.796043] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:47:42.810726] [INFO ] [REMOTE ] SON: Full fetch complete (61577 records). [2025-09-18T21:47:42.810978] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-09-18T21:47:42.924681] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-09-18T21:47:43.221051] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-09-18T21:47:43.221149] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-09-18T21:47:43.222287] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-09-18T21:47:43.222383] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-09-18T21:47:43.223957] [DEBUG] [LOCAL ] SON: Trimmed 61577 records to 43197 (keeping 200 days of data) [2025-09-18T21:47:43.345918] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-18T21:47:43.540847] [DEBUG] [LOCAL ] SON: Primary data saved (43197 records). [2025-09-18T21:47:43.541068] [INFO ] [MAIN ] SON: Full history saved. [2025-09-18T21:47:43.541349] [INFO ] [MAIN ] Update Progress: 1967/2372 symbols completed. SON took 36.7s. Estimated remaining: 59m 14s. Rate: 6.8 symbols/min [2025-09-18T21:47:43.729713] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-09-18T21:47:43.734396] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:47:43.773333] [DEBUG] [LOCAL ] SPB: Loaded 34205 existing records from primary storage. [2025-09-18T21:47:43.773488] [INFO ] [MAIN ] SPB: Loaded 34205 existing records. [2025-09-18T21:47:43.958450] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:47:43.958742] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-09-18T21:47:43.958798] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-09-18T21:47:43.960209] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-09-18T21:47:43.960270] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-09-18T21:47:44.242801] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-18T21:47:44.340081] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:47:44.519603] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-11. [2025-09-18T21:47:45.319624] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-09-18T21:47:45.758849] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-18T21:47:45.799565] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-18T21:47:46.119568] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-09-18T21:47:46.919546] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-09-18T21:47:47.719569] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-09-18T21:47:48.025227] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T21:47:48.110769] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-18T21:47:48.114600] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-18T21:47:48.519600] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-09-18T21:47:49.319591] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-09-18T21:47:49.601044] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-18T21:47:50.119552] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-09-18T21:47:50.607356] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-18T21:47:50.919522] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-11. [2025-09-18T21:47:51.160489] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-18T21:47:51.719607] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-09-18T21:47:52.190916] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T21:47:52.519563] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-09-18T21:47:53.319528] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-09-18T21:47:53.512878] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-18T21:47:53.634959] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-18T21:47:53.657984] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-18T21:47:54.119550] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-09-18T21:47:54.591231] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-18T21:47:54.919557] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-09-18T21:47:55.479012] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-18T21:47:55.719549] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-09-18T21:47:56.171193] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-18T21:47:56.519566] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-09-18T21:47:57.319552] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-09-18T21:47:57.753927] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-18T21:47:57.755100] [INFO ] [REMOTE ] SOR: Full fetch complete (4397 records). [2025-09-18T21:47:57.755184] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-09-18T21:47:58.118225] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-09-18T21:47:58.118420] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-09-18T21:47:58.118795] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-09-18T21:47:58.118880] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-09-18T21:47:58.119566] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-09-18T21:47:58.122326] [DEBUG] [LOCAL ] SOR: Trimmed 4397 records to 3003 (keeping 200 days of data) [2025-09-18T21:47:58.163774] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-18T21:47:58.162529] [DEBUG] [LOCAL ] SOR: Primary data saved (3003 records). [2025-09-18T21:47:58.170615] [INFO ] [MAIN ] SOR: Full history saved. [2025-09-18T21:47:58.171031] [INFO ] [MAIN ] Update Progress: 1968/2372 symbols completed. SOR took 23.0s. Estimated remaining: 59m 6s. Rate: 6.8 symbols/min [2025-09-18T21:47:58.203793] [INFO ] [REMOTE ] SONY: Full fetch complete (77105 records). [2025-09-18T21:47:58.228025] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-09-18T21:47:58.477870] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:47:58.778134] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-09-18T21:47:58.778253] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-09-18T21:47:58.779473] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-09-18T21:47:58.779606] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-09-18T21:47:58.794139] [DEBUG] [LOCAL ] SONY: Trimmed 77105 records to 53752 (keeping 200 days of data) [2025-09-18T21:47:58.795288] [DEBUG] [LOCAL ] SPCE: Loaded 49826 existing records from primary storage. [2025-09-18T21:47:58.795422] [INFO ] [MAIN ] SPCE: Loaded 49826 existing records. [2025-09-18T21:47:58.941124] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-09-18T21:47:59.083744] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:47:59.097431] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-09-18T21:47:59.101374] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-09-18T21:47:59.105136] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-09-18T21:47:59.105803] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-09-18T21:47:59.607362] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:47:59.622958] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-18T21:47:59.697690] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-18T21:47:59.719613] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-09-18T21:47:59.722992] [DEBUG] [LOCAL ] SONY: Primary data saved (53752 records). [2025-09-18T21:47:59.723338] [INFO ] [MAIN ] SONY: Full history saved. [2025-09-18T21:47:59.723487] [INFO ] [MAIN ] Update Progress: 1969/2372 symbols completed. SONY took 43.0s. Estimated remaining: 58m 56s. Rate: 6.8 symbols/min [2025-09-18T21:47:59.895270] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:47:59.904295] [DEBUG] [LOCAL ] SPE: Loaded 6419 existing records from primary storage. [2025-09-18T21:47:59.904420] [INFO ] [MAIN ] SPE: Loaded 6419 existing records. [2025-09-18T21:48:00.087366] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:48:00.087710] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-09-18T21:48:00.087771] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-09-18T21:48:00.088114] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-09-18T21:48:00.088200] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-09-18T21:48:00.363982] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-18T21:48:00.466950] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:48:00.519495] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-11. [2025-09-18T21:48:01.279282] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-18T21:48:01.319598] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-11. [2025-09-18T21:48:02.119546] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-09-18T21:48:02.919607] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-09-18T21:48:03.237705] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-18T21:48:03.266057] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-18T21:48:03.669138] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-18T21:48:03.719519] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-09-18T21:48:04.337731] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-18T21:48:04.519590] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-09-18T21:48:05.319573] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-09-18T21:48:06.107826] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-18T21:48:06.119489] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-09-18T21:48:06.488049] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-18T21:48:06.919539] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-09-18T21:48:06.936218] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-18T21:48:07.719598] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-09-18T21:48:08.176448] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-18T21:48:08.519530] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-09-18T21:48:08.764270] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-18T21:48:09.196589] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-18T21:48:09.319543] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-09-18T21:48:10.119559] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-09-18T21:48:10.900388] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T21:48:10.919497] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-09-18T21:48:11.702794] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-18T21:48:11.719495] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-09-18T21:48:11.961482] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-18T21:48:12.171190] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-18T21:48:12.519682] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-09-18T21:48:12.939120] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-18T21:48:13.319583] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-09-18T21:48:13.996103] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-18T21:48:14.119603] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-09-18T21:48:14.841741] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T21:48:14.919555] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-09-18T21:48:15.693883] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-18T21:48:15.719532] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-09-18T21:48:16.386402] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-18T21:48:16.519576] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-09-18T21:48:17.109420] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-18T21:48:17.111212] [INFO ] [REMOTE ] SPE: Full fetch complete (10140 records). [2025-09-18T21:48:17.111291] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-09-18T21:48:17.327141] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-09-18T21:48:17.504258] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-09-18T21:48:17.504347] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-09-18T21:48:17.504665] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-09-18T21:48:17.504729] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-09-18T21:48:17.505187] [DEBUG] [LOCAL ] SPE: Trimmed 10140 records to 6451 (keeping 200 days of data) [2025-09-18T21:48:17.544277] [DEBUG] [LOCAL ] SPE: Primary data saved (6451 records). [2025-09-18T21:48:17.544395] [INFO ] [MAIN ] SPE: Full history saved. [2025-09-18T21:48:17.544562] [INFO ] [MAIN ] Update Progress: 1970/2372 symbols completed. SPE took 17.8s. Estimated remaining: 58m 49s. Rate: 6.8 symbols/min [2025-09-18T21:48:17.719028] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:48:17.779017] [DEBUG] [LOCAL ] SPG: Loaded 50466 existing records from primary storage. [2025-09-18T21:48:17.779170] [INFO ] [MAIN ] SPG: Loaded 50466 existing records. [2025-09-18T21:48:17.957060] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:48:17.957330] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-09-18T21:48:17.957378] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-09-18T21:48:17.958485] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-09-18T21:48:17.958546] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-09-18T21:48:18.131067] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-09-18T21:48:18.316686] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:48:18.610828] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-18T21:48:18.919546] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-09-18T21:48:19.469061] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T21:48:19.719585] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-11. [2025-09-18T21:48:19.739218] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-18T21:48:20.519595] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-09-18T21:48:21.319571] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-09-18T21:48:21.558026] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-18T21:48:22.119610] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-09-18T21:48:22.150563] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-18T21:48:22.309125] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-18T21:48:22.919593] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-09-18T21:48:23.730637] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-09-18T21:48:23.733926] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-18T21:48:24.519547] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-09-18T21:48:24.605100] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-18T21:48:24.891335] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-18T21:48:25.319544] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-09-18T21:48:25.926805] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-18T21:48:26.119555] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-09-18T21:48:26.919725] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-09-18T21:48:27.558378] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-18T21:48:27.655133] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-18T21:48:27.719518] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-09-18T21:48:27.810454] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-18T21:48:27.817441] [INFO ] [REMOTE ] SPB: Full fetch complete (47330 records). [2025-09-18T21:48:27.817546] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-09-18T21:48:28.199390] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-09-18T21:48:28.199488] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-09-18T21:48:28.200308] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-09-18T21:48:28.200377] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-09-18T21:48:28.201378] [DEBUG] [LOCAL ] SPB: Trimmed 47330 records to 34447 (keeping 200 days of data) [2025-09-18T21:48:28.414122] [DEBUG] [LOCAL ] SPB: Primary data saved (34447 records). [2025-09-18T21:48:28.414279] [INFO ] [MAIN ] SPB: Full history saved. [2025-09-18T21:48:28.414449] [INFO ] [MAIN ] Update Progress: 1971/2372 symbols completed. SPB took 44.9s. Estimated remaining: 58m 41s. Rate: 6.8 symbols/min [2025-09-18T21:48:28.524612] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-09-18T21:48:28.590787] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:48:28.634732] [DEBUG] [LOCAL ] SPGI: Loaded 45808 existing records from primary storage. [2025-09-18T21:48:28.634869] [INFO ] [MAIN ] SPGI: Loaded 45808 existing records. [2025-09-18T21:48:28.861518] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:48:28.861805] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-09-18T21:48:28.861858] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-09-18T21:48:28.862969] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-09-18T21:48:28.863029] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-09-18T21:48:29.216513] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:48:29.319494] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-11. [2025-09-18T21:48:29.350616] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-18T21:48:30.119573] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-09-18T21:48:30.298182] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-18T21:48:30.844031] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-18T21:48:30.846821] [INFO ] [REMOTE ] SOS: Full fetch complete (11375 records). [2025-09-18T21:48:30.846894] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-09-18T21:48:30.924726] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-09-18T21:48:31.238046] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-09-18T21:48:31.238173] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-09-18T21:48:31.238531] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-09-18T21:48:31.238686] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-09-18T21:48:31.239578] [DEBUG] [LOCAL ] SOS: Trimmed 11375 records to 7525 (keeping 200 days of data) [2025-09-18T21:48:31.302753] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-11 (1.98 seconds). [2025-09-18T21:48:31.325112] [DEBUG] [LOCAL ] SOS: Primary data saved (7525 records). [2025-09-18T21:48:31.325286] [INFO ] [MAIN ] SOS: Full history saved. [2025-09-18T21:48:31.325400] [INFO ] [MAIN ] Update Progress: 1972/2372 symbols completed. SOS took 49.4s. Estimated remaining: 58m 31s. Rate: 6.8 symbols/min [2025-09-18T21:48:31.508084] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:48:31.532240] [DEBUG] [LOCAL ] SPH: Loaded 18549 existing records from primary storage. [2025-09-18T21:48:31.532393] [INFO ] [MAIN ] SPH: Loaded 18549 existing records. [2025-09-18T21:48:31.716183] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:48:31.716500] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-09-18T21:48:31.716556] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-09-18T21:48:31.717071] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-09-18T21:48:31.717133] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-09-18T21:48:31.728556] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-09-18T21:48:32.082033] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:48:32.519530] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-11. [2025-09-18T21:48:32.847046] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-18T21:48:33.295761] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-18T21:48:33.312573] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-18T21:48:33.319492] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-09-18T21:48:34.119565] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-09-18T21:48:34.919519] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-09-18T21:48:35.015030] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-18T21:48:35.719602] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-09-18T21:48:36.106194] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-18T21:48:36.440231] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-18T21:48:36.519500] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-09-18T21:48:36.767543] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T21:48:37.319542] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-09-18T21:48:38.123803] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-09-18T21:48:38.139002] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-18T21:48:38.164719] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-18T21:48:38.919549] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-09-18T21:48:39.719558] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-09-18T21:48:39.899591] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-18T21:48:40.519547] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-09-18T21:48:40.709438] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-18T21:48:41.318213] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-18T21:48:41.328329] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-09-18T21:48:42.119554] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-09-18T21:48:42.200780] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-18T21:48:42.209056] [INFO ] [REMOTE ] SPCE: Full fetch complete (72232 records). [2025-09-18T21:48:42.209186] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-09-18T21:48:42.608666] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-09-18T21:48:42.608773] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-09-18T21:48:42.609839] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-09-18T21:48:42.609920] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-09-18T21:48:42.611481] [DEBUG] [LOCAL ] SPCE: Trimmed 72232 records to 50170 (keeping 200 days of data) [2025-09-18T21:48:42.922489] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-09-18T21:48:42.944047] [DEBUG] [LOCAL ] SPCE: Primary data saved (50170 records). [2025-09-18T21:48:42.944200] [INFO ] [MAIN ] SPCE: Full history saved. [2025-09-18T21:48:42.944295] [INFO ] [MAIN ] Update Progress: 1973/2372 symbols completed. SPCE took 44.8s. Estimated remaining: 58m 23s. Rate: 6.8 symbols/min [2025-09-18T21:48:43.128415] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:48:43.146681] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-18T21:48:43.182254] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-18T21:48:43.223445] [DEBUG] [LOCAL ] SPHR: Loaded 40151 existing records from primary storage. [2025-09-18T21:48:43.223592] [INFO ] [MAIN ] SPHR: Loaded 40151 existing records. [2025-09-18T21:48:43.406143] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:48:43.406438] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-09-18T21:48:43.406489] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-09-18T21:48:43.407350] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-09-18T21:48:43.407412] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-09-18T21:48:43.734104] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-09-18T21:48:43.777605] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:48:44.519526] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-11. [2025-09-18T21:48:44.602353] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-18T21:48:45.319583] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-09-18T21:48:45.720046] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-18T21:48:45.787520] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-18T21:48:46.119703] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-09-18T21:48:46.193880] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-18T21:48:46.919605] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-09-18T21:48:47.557638] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-18T21:48:47.650169] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-18T21:48:47.719601] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-09-18T21:48:48.519574] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-09-18T21:48:48.547792] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-18T21:48:49.319572] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-09-18T21:48:49.737429] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-18T21:48:49.744523] [INFO ] [REMOTE ] SPG: Full fetch complete (71903 records). [2025-09-18T21:48:49.744721] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-09-18T21:48:50.122856] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-09-18T21:48:50.157347] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-09-18T21:48:50.157536] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-09-18T21:48:50.158823] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-09-18T21:48:50.159031] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-09-18T21:48:50.161247] [DEBUG] [LOCAL ] SPG: Trimmed 71903 records to 50828 (keeping 200 days of data) [2025-09-18T21:48:50.298261] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-18T21:48:50.528551] [DEBUG] [LOCAL ] SPG: Primary data saved (50828 records). [2025-09-18T21:48:50.528756] [INFO ] [MAIN ] SPG: Full history saved. [2025-09-18T21:48:50.528861] [INFO ] [MAIN ] Update Progress: 1974/2372 symbols completed. SPG took 33.0s. Estimated remaining: 58m 14s. Rate: 6.8 symbols/min [2025-09-18T21:48:50.701438] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:48:50.739733] [DEBUG] [LOCAL ] SPIR: Loaded 37538 existing records from primary storage. [2025-09-18T21:48:50.739878] [INFO ] [MAIN ] SPIR: Loaded 37538 existing records. [2025-09-18T21:48:50.922375] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-09-18T21:48:50.926408] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:48:50.928173] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-09-18T21:48:50.928261] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-09-18T21:48:50.929171] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-09-18T21:48:50.929237] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-09-18T21:48:51.291108] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:48:51.304383] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-18T21:48:51.719563] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-09-18T21:48:52.498471] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-18T21:48:52.519501] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-09-18T21:48:52.731279] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-18T21:48:53.319600] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-09-18T21:48:53.477919] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-18T21:48:54.119547] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-11. [2025-09-18T21:48:54.770556] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T21:48:54.919514] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-09-18T21:48:55.117224] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-18T21:48:55.719575] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-09-18T21:48:55.763390] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-18T21:48:55.766149] [INFO ] [REMOTE ] SPH: Full fetch complete (28658 records). [2025-09-18T21:48:55.766279] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-09-18T21:48:56.141963] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-09-18T21:48:56.142043] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-09-18T21:48:56.142666] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-09-18T21:48:56.142728] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-09-18T21:48:56.143398] [DEBUG] [LOCAL ] SPH: Trimmed 28658 records to 18652 (keeping 200 days of data) [2025-09-18T21:48:56.263324] [DEBUG] [LOCAL ] SPH: Primary data saved (18652 records). [2025-09-18T21:48:56.263473] [INFO ] [MAIN ] SPH: Full history saved. [2025-09-18T21:48:56.263560] [INFO ] [MAIN ] Update Progress: 1975/2372 symbols completed. SPH took 24.9s. Estimated remaining: 58m 4s. Rate: 6.8 symbols/min [2025-09-18T21:48:56.437961] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:48:56.447109] [DEBUG] [LOCAL ] SPMC: Loaded 5744 existing records from primary storage. [2025-09-18T21:48:56.447257] [INFO ] [MAIN ] SPMC: Loaded 5744 existing records. [2025-09-18T21:48:56.524712] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-09-18T21:48:56.708525] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:48:56.708900] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-09-18T21:48:56.709011] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-09-18T21:48:56.709331] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-09-18T21:48:56.709394] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-09-18T21:48:57.227702] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:48:57.263257] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-18T21:48:57.319630] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-09-18T21:48:57.992328] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T21:48:58.119584] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-09-18T21:48:58.437751] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-18T21:48:58.781523] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-18T21:48:58.788122] [INFO ] [REMOTE ] SPGI: Full fetch complete (66245 records). [2025-09-18T21:48:58.788257] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-09-18T21:48:58.924630] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-11. [2025-09-18T21:48:59.201932] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-09-18T21:48:59.202018] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-09-18T21:48:59.202995] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-09-18T21:48:59.203067] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-09-18T21:48:59.205467] [DEBUG] [LOCAL ] SPGI: Trimmed 66245 records to 46192 (keeping 200 days of data) [2025-09-18T21:48:59.499918] [DEBUG] [LOCAL ] SPGI: Primary data saved (46192 records). [2025-09-18T21:48:59.500063] [INFO ] [MAIN ] SPGI: Full history saved. [2025-09-18T21:48:59.500153] [INFO ] [MAIN ] Update Progress: 1976/2372 symbols completed. SPGI took 31.1s. Estimated remaining: 57m 54s. Rate: 6.8 symbols/min [2025-09-18T21:48:59.685515] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:48:59.682224] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-18T21:48:59.685792] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-09-18T21:48:59.687913] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-09-18T21:48:59.688117] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-09-18T21:48:59.688171] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-18T21:48:59.688216] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-18T21:48:59.688249] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-09-18T21:48:59.724606] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-09-18T21:49:00.064308] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:49:00.519541] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-09-18T21:49:01.326895] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-09-18T21:49:01.332867] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T21:49:01.706863] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-18T21:49:01.773346] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-18T21:49:02.119548] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-09-18T21:49:02.919602] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-11. [2025-09-18T21:49:03.157087] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:49:03.157449] [WARN ] [REMOTE ] SPME: No data returned for month 2024-11 [2025-09-18T21:49:03.719543] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-09-18T21:49:03.841205] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-18T21:49:03.963499] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:49:03.963889] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-09-18T21:49:04.519539] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-01. [2025-09-18T21:49:04.714575] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:49:04.714969] [WARN ] [REMOTE ] SPME: No data returned for month 2025-01 [2025-09-18T21:49:05.319558] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-09-18T21:49:06.119555] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-02. [2025-09-18T21:49:06.346247] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:49:06.346587] [WARN ] [REMOTE ] SPME: No data returned for month 2025-02 [2025-09-18T21:49:06.808360] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-18T21:49:06.919557] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-03. [2025-09-18T21:49:07.168212] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:49:07.168536] [WARN ] [REMOTE ] SPME: No data returned for month 2025-03 [2025-09-18T21:49:07.719544] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-09-18T21:49:08.519585] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-09-18T21:49:09.028420] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-18T21:49:09.054724] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-18T21:49:09.319563] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-09-18T21:49:10.119617] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-04. [2025-09-18T21:49:10.485343] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:49:10.485704] [WARN ] [REMOTE ] SPME: No data returned for month 2025-04 [2025-09-18T21:49:10.512805] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-18T21:49:10.919575] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-05. [2025-09-18T21:49:11.130212] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:49:11.130623] [WARN ] [REMOTE ] SPME: No data returned for month 2025-05 [2025-09-18T21:49:11.719547] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-09-18T21:49:12.519546] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-09-18T21:49:13.211376] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T21:49:13.319534] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-09-18T21:49:13.780017] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-18T21:49:13.866999] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-18T21:49:14.119547] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-09-18T21:49:14.919532] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-09-18T21:49:15.474286] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-18T21:49:15.573794] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-18T21:49:15.719596] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-09-18T21:49:16.519609] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-09-18T21:49:16.970055] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-18T21:49:17.319607] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-09-18T21:49:17.683247] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-18T21:49:17.786118] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-18T21:49:18.119578] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-09-18T21:49:18.919542] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-06. [2025-09-18T21:49:19.146315] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:49:19.146682] [WARN ] [REMOTE ] SPME: No data returned for month 2025-06 [2025-09-18T21:49:19.439723] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-18T21:49:19.719612] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-09-18T21:49:20.358087] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-18T21:49:20.519601] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-09-18T21:49:21.319573] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-09-18T21:49:21.800783] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-18T21:49:21.844780] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-18T21:49:22.119592] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-09-18T21:49:22.782180] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-18T21:49:22.919553] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-09-18T21:49:23.719587] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-09-18T21:49:24.372458] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T21:49:24.519560] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-09-18T21:49:25.076021] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-18T21:49:25.082902] [INFO ] [REMOTE ] SPHR: Full fetch complete (57145 records). [2025-09-18T21:49:25.083065] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-09-18T21:49:25.324631] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-09-18T21:49:25.478052] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-09-18T21:49:25.478176] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-09-18T21:49:25.479130] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-09-18T21:49:25.479194] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-09-18T21:49:25.480491] [DEBUG] [LOCAL ] SPHR: Trimmed 57145 records to 40490 (keeping 200 days of data) [2025-09-18T21:49:25.721131] [DEBUG] [LOCAL ] SPHR: Primary data saved (40490 records). [2025-09-18T21:49:25.721260] [INFO ] [MAIN ] SPHR: Full history saved. [2025-09-18T21:49:25.721383] [INFO ] [MAIN ] Update Progress: 1977/2372 symbols completed. SPHR took 42.8s. Estimated remaining: 57m 49s. Rate: 6.8 symbols/min [2025-09-18T21:49:25.892757] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:49:25.927531] [DEBUG] [LOCAL ] SPNT: Loaded 34724 existing records from primary storage. [2025-09-18T21:49:25.927700] [INFO ] [MAIN ] SPNT: Loaded 34724 existing records. [2025-09-18T21:49:26.107556] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:49:26.107941] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-09-18T21:49:26.108018] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-09-18T21:49:26.108999] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-09-18T21:49:26.109062] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-09-18T21:49:26.122624] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-07. [2025-09-18T21:49:26.216236] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-18T21:49:26.249386] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-18T21:49:26.508909] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:49:26.599771] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-18T21:49:26.919584] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-08. [2025-09-18T21:49:27.348011] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-18T21:49:27.719554] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-09. [2025-09-18T21:49:28.032945] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-18T21:49:28.033747] [INFO ] [REMOTE ] SPME: Full fetch complete (635 records). [2025-09-18T21:49:28.033821] [DEBUG] [VALIDATOR ] SPME: Validating primary data. [2025-09-18T21:49:28.214847] [WARN ] [VALIDATOR ] SPME: Validation failed - insufficient historical data. Have 44 unique days, need 200 days [2025-09-18T21:49:28.215053] [FATAL] [MAIN ] SPME: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:49:28.215139] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:49:28.215217] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-18T21:49:28.215299] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-18T21:49:28.215338] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-09-18T21:49:28.215397] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-09-18T21:49:28.215493] [INFO ] [MAIN ] Update Progress: 1978/2372 symbols completed. SPME took 28.7s. Estimated remaining: 57m 39s. Rate: 6.8 symbols/min [2025-09-18T21:49:28.397460] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:49:28.450838] [DEBUG] [LOCAL ] SPOT: Loaded 51070 existing records from primary storage. [2025-09-18T21:49:28.451022] [INFO ] [MAIN ] SPOT: Loaded 51070 existing records. [2025-09-18T21:49:28.524790] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-09-18T21:49:28.671933] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:49:28.672166] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-09-18T21:49:28.672217] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-09-18T21:49:28.673430] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-09-18T21:49:28.673490] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-09-18T21:49:29.034219] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:49:29.102908] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-18T21:49:29.104254] [INFO ] [REMOTE ] SPMC: Full fetch complete (8133 records). [2025-09-18T21:49:29.104327] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-09-18T21:49:29.324755] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-09-18T21:49:29.475970] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-09-18T21:49:29.476058] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-09-18T21:49:29.476469] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-09-18T21:49:29.476536] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-09-18T21:49:29.477090] [DEBUG] [LOCAL ] SPMC: Trimmed 8133 records to 5759 (keeping 200 days of data) [2025-09-18T21:49:29.514370] [DEBUG] [LOCAL ] SPMC: Primary data saved (5759 records). [2025-09-18T21:49:29.514700] [INFO ] [MAIN ] SPMC: Full history saved. [2025-09-18T21:49:29.514894] [INFO ] [MAIN ] Update Progress: 1979/2372 symbols completed. SPMC took 33.3s. Estimated remaining: 57m 29s. Rate: 6.8 symbols/min [2025-09-18T21:49:29.684702] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:49:29.734229] [DEBUG] [LOCAL ] SPR: Loaded 41443 existing records from primary storage. [2025-09-18T21:49:29.734435] [INFO ] [MAIN ] SPR: Loaded 41443 existing records. [2025-09-18T21:49:29.912784] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:49:29.913146] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-09-18T21:49:29.913203] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-09-18T21:49:29.914287] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-09-18T21:49:29.914347] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-09-18T21:49:30.124770] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-11. [2025-09-18T21:49:30.270576] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:49:30.538043] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-18T21:49:30.542773] [INFO ] [REMOTE ] SPIR: Full fetch complete (52021 records). [2025-09-18T21:49:30.542875] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-09-18T21:49:30.925192] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-11. [2025-09-18T21:49:30.943447] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-09-18T21:49:30.943516] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-09-18T21:49:30.944408] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-09-18T21:49:30.944492] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-09-18T21:49:30.946900] [DEBUG] [LOCAL ] SPIR: Trimmed 52021 records to 37819 (keeping 200 days of data) [2025-09-18T21:49:31.168046] [DEBUG] [LOCAL ] SPIR: Primary data saved (37819 records). [2025-09-18T21:49:31.168202] [INFO ] [MAIN ] SPIR: Full history saved. [2025-09-18T21:49:31.168291] [INFO ] [MAIN ] Update Progress: 1980/2372 symbols completed. SPIR took 40.6s. Estimated remaining: 57m 18s. Rate: 6.8 symbols/min [2025-09-18T21:49:31.347620] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:49:31.369757] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-18T21:49:31.380613] [DEBUG] [LOCAL ] SPRU: Loaded 8337 existing records from primary storage. [2025-09-18T21:49:31.380737] [INFO ] [MAIN ] SPRU: Loaded 8337 existing records. [2025-09-18T21:49:31.562751] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:49:31.563088] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-09-18T21:49:31.563146] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-09-18T21:49:31.563463] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-09-18T21:49:31.563523] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-09-18T21:49:31.729891] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-09-18T21:49:31.942501] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:49:32.519616] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-11. [2025-09-18T21:49:33.061752] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T21:49:33.166899] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-11 (2.24 seconds). [2025-09-18T21:49:33.319540] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-11. [2025-09-18T21:49:33.890778] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-18T21:49:33.931996] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-18T21:49:34.119563] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-09-18T21:49:34.919547] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-09-18T21:49:34.955563] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T21:49:35.719555] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-09-18T21:49:36.519570] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-09-18T21:49:36.921314] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-18T21:49:36.990033] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-18T21:49:37.319581] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-09-18T21:49:37.373421] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-18T21:49:38.119586] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-09-18T21:49:38.599992] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-18T21:49:38.919544] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-09-18T21:49:39.168434] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-18T21:49:39.719556] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-09-18T21:49:40.246972] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-18T21:49:40.519549] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-09-18T21:49:41.111934] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-18T21:49:41.319544] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-09-18T21:49:41.718793] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-18T21:49:42.119596] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-09-18T21:49:42.317718] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-18T21:49:42.707844] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-18T21:49:42.919615] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-09-18T21:49:43.653892] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-18T21:49:43.719546] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-09-18T21:49:44.519552] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-09-18T21:49:44.896210] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-18T21:49:45.319582] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-09-18T21:49:46.023542] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-18T21:49:46.119585] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-09-18T21:49:46.919540] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-09-18T21:49:47.523973] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-18T21:49:47.563785] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-18T21:49:47.719568] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-09-18T21:49:48.012584] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-18T21:49:48.519624] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-09-18T21:49:49.085299] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-18T21:49:49.127081] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-18T21:49:49.319562] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-09-18T21:49:50.119693] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-09-18T21:49:50.790315] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-18T21:49:50.919578] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-09-18T21:49:51.719554] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-09-18T21:49:52.358898] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-18T21:49:52.413540] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-18T21:49:52.464383] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-18T21:49:52.519553] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-09-18T21:49:53.319570] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-09-18T21:49:54.119544] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-09-18T21:49:54.919594] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-09-18T21:49:55.027707] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-18T21:49:55.545159] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (3.03 seconds). [2025-09-18T21:49:55.599892] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T21:49:55.719509] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-09-18T21:49:56.519554] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-09-18T21:49:56.679026] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-18T21:49:57.231312] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-18T21:49:57.319502] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-09-18T21:49:57.654798] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-18T21:49:58.119546] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-09-18T21:49:58.363113] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-18T21:49:58.585027] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-18T21:49:58.587170] [INFO ] [REMOTE ] SPRU: Full fetch complete (11523 records). [2025-09-18T21:49:58.587258] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-09-18T21:49:58.927092] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-09-18T21:49:58.966612] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-09-18T21:49:58.966786] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-09-18T21:49:58.967100] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-09-18T21:49:58.967161] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-09-18T21:49:58.967758] [DEBUG] [LOCAL ] SPRU: Trimmed 11523 records to 8414 (keeping 200 days of data) [2025-09-18T21:49:59.016562] [DEBUG] [LOCAL ] SPRU: Primary data saved (8414 records). [2025-09-18T21:49:59.016773] [INFO ] [MAIN ] SPRU: Full history saved. [2025-09-18T21:49:59.016893] [INFO ] [MAIN ] Update Progress: 1981/2372 symbols completed. SPRU took 27.8s. Estimated remaining: 57m 13s. Rate: 6.8 symbols/min [2025-09-18T21:49:59.191502] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:49:59.217785] [DEBUG] [LOCAL ] SPXC: Loaded 23398 existing records from primary storage. [2025-09-18T21:49:59.217932] [INFO ] [MAIN ] SPXC: Loaded 23398 existing records. [2025-09-18T21:49:59.403225] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:49:59.403503] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-09-18T21:49:59.403556] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-09-18T21:49:59.404257] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-09-18T21:49:59.404320] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-09-18T21:49:59.728979] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-09-18T21:49:59.771769] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:50:00.172677] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-18T21:50:00.519550] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-11. [2025-09-18T21:50:01.319565] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-09-18T21:50:01.670038] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-18T21:50:01.772291] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-18T21:50:02.119557] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-09-18T21:50:02.337054] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-18T21:50:02.343453] [INFO ] [REMOTE ] SPNT: Full fetch complete (48640 records). [2025-09-18T21:50:02.343694] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-09-18T21:50:02.742518] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-09-18T21:50:02.742605] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-09-18T21:50:02.743661] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-09-18T21:50:02.743726] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-09-18T21:50:02.745170] [DEBUG] [LOCAL ] SPNT: Trimmed 48640 records to 35016 (keeping 200 days of data) [2025-09-18T21:50:02.921277] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-09-18T21:50:02.972518] [DEBUG] [LOCAL ] SPNT: Primary data saved (35016 records). [2025-09-18T21:50:02.972846] [INFO ] [MAIN ] SPNT: Full history saved. [2025-09-18T21:50:02.973109] [INFO ] [MAIN ] Update Progress: 1982/2372 symbols completed. SPNT took 37.3s. Estimated remaining: 57m 4s. Rate: 6.8 symbols/min [2025-09-18T21:50:03.158008] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:50:03.175962] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-18T21:50:03.188269] [DEBUG] [LOCAL ] SPXX: Loaded 8979 existing records from primary storage. [2025-09-18T21:50:03.188381] [INFO ] [MAIN ] SPXX: Loaded 8979 existing records. [2025-09-18T21:50:03.386081] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:50:03.386412] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-09-18T21:50:03.386524] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-09-18T21:50:03.387005] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-09-18T21:50:03.387131] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-09-18T21:50:03.724607] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-09-18T21:50:03.785887] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:50:04.519539] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-11. [2025-09-18T21:50:04.846886] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-18T21:50:05.094683] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-18T21:50:05.186541] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-18T21:50:05.319544] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-09-18T21:50:06.119572] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-09-18T21:50:06.919577] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-09-18T21:50:07.221815] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-18T21:50:07.285176] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-18T21:50:07.719598] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-09-18T21:50:08.225141] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-18T21:50:08.519572] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-09-18T21:50:09.319576] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-09-18T21:50:09.340918] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-18T21:50:09.347705] [INFO ] [REMOTE ] SPR: Full fetch complete (59983 records). [2025-09-18T21:50:09.347833] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-09-18T21:50:09.740317] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-09-18T21:50:09.740409] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-09-18T21:50:09.741482] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-09-18T21:50:09.741550] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-09-18T21:50:09.744882] [DEBUG] [LOCAL ] SPR: Trimmed 59983 records to 41763 (keeping 200 days of data) [2025-09-18T21:50:10.013730] [DEBUG] [LOCAL ] SPR: Primary data saved (41763 records). [2025-09-18T21:50:10.013928] [INFO ] [MAIN ] SPR: Full history saved. [2025-09-18T21:50:10.015676] [INFO ] [MAIN ] Update Progress: 1983/2372 symbols completed. SPR took 40.5s. Estimated remaining: 56m 55s. Rate: 6.8 symbols/min [2025-09-18T21:50:10.122724] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-09-18T21:50:10.198768] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:50:10.256334] [DEBUG] [LOCAL ] SQM: Loaded 48675 existing records from primary storage. [2025-09-18T21:50:10.256512] [INFO ] [MAIN ] SQM: Loaded 48675 existing records. [2025-09-18T21:50:10.448164] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:50:10.448591] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-09-18T21:50:10.448750] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-09-18T21:50:10.454924] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-09-18T21:50:10.462868] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-18T21:50:10.462408] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-09-18T21:50:10.726870] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-18T21:50:10.844758] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:50:10.919496] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-11. [2025-09-18T21:50:11.719550] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-09-18T21:50:11.951481] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-18T21:50:11.962093] [INFO ] [REMOTE ] SPOT: Full fetch complete (74100 records). [2025-09-18T21:50:11.962240] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-09-18T21:50:12.306932] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-18T21:50:12.412292] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-09-18T21:50:12.412496] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-09-18T21:50:12.413933] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-09-18T21:50:12.414020] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-09-18T21:50:12.443785] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-18T21:50:12.443922] [DEBUG] [LOCAL ] SPOT: Trimmed 74100 records to 51433 (keeping 200 days of data) [2025-09-18T21:50:12.523973] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-09-18T21:50:12.795095] [DEBUG] [LOCAL ] SPOT: Primary data saved (51433 records). [2025-09-18T21:50:12.795239] [INFO ] [MAIN ] SPOT: Full history saved. [2025-09-18T21:50:12.795326] [INFO ] [MAIN ] Update Progress: 1984/2372 symbols completed. SPOT took 44.6s. Estimated remaining: 56m 45s. Rate: 6.8 symbols/min [2025-09-18T21:50:12.975512] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:50:12.999684] [DEBUG] [LOCAL ] SQNS: Loaded 25148 existing records from primary storage. [2025-09-18T21:50:12.999818] [INFO ] [MAIN ] SQNS: Loaded 25148 existing records. [2025-09-18T21:50:13.195898] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:50:13.196220] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-09-18T21:50:13.196276] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-09-18T21:50:13.196938] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-09-18T21:50:13.196998] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-09-18T21:50:13.335230] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-09-18T21:50:13.553926] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:50:13.939972] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T21:50:14.119548] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-09-18T21:50:14.811786] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-18T21:50:14.849097] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-18T21:50:14.919494] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-09-18T21:50:15.719555] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-11. [2025-09-18T21:50:16.309849] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-18T21:50:16.519550] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-09-18T21:50:16.772701] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-18T21:50:17.319566] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-09-18T21:50:17.855378] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-18T21:50:17.878293] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-18T21:50:18.119547] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-09-18T21:50:18.919594] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-09-18T21:50:19.356333] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-18T21:50:19.669086] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-18T21:50:19.719513] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-09-18T21:50:20.389066] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-18T21:50:20.519544] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-09-18T21:50:21.310413] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-18T21:50:21.319490] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-09-18T21:50:22.038527] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-18T21:50:22.119514] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-09-18T21:50:22.919565] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-09-18T21:50:23.027029] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-18T21:50:23.719545] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-09-18T21:50:24.520691] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-09-18T21:50:24.525468] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T21:50:24.655695] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-18T21:50:25.319542] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-09-18T21:50:25.396072] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-18T21:50:26.051701] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-18T21:50:26.119524] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-09-18T21:50:26.919536] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-09-18T21:50:26.949105] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-18T21:50:26.951153] [INFO ] [REMOTE ] SPXX: Full fetch complete (12295 records). [2025-09-18T21:50:26.951225] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-09-18T21:50:27.325074] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-09-18T21:50:27.325410] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-09-18T21:50:27.325738] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-09-18T21:50:27.325813] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-09-18T21:50:27.326295] [DEBUG] [LOCAL ] SPXX: Trimmed 12295 records to 9084 (keeping 200 days of data) [2025-09-18T21:50:27.387546] [DEBUG] [LOCAL ] SPXX: Primary data saved (9084 records). [2025-09-18T21:50:27.387715] [INFO ] [MAIN ] SPXX: Full history saved. [2025-09-18T21:50:27.387870] [INFO ] [MAIN ] Update Progress: 1985/2372 symbols completed. SPXX took 24.4s. Estimated remaining: 56m 37s. Rate: 6.8 symbols/min [2025-09-18T21:50:27.562845] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:50:27.615094] [DEBUG] [LOCAL ] SR: Loaded 32653 existing records from primary storage. [2025-09-18T21:50:27.615258] [INFO ] [MAIN ] SR: Loaded 32653 existing records. [2025-09-18T21:50:27.728418] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-09-18T21:50:27.827791] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:50:27.828131] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-09-18T21:50:27.828183] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-09-18T21:50:27.829175] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-09-18T21:50:27.829249] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-09-18T21:50:28.213829] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:50:28.519549] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-09-18T21:50:28.552154] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-18T21:50:28.905483] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-18T21:50:29.049661] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-18T21:50:29.319552] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-09-18T21:50:30.119551] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-11. [2025-09-18T21:50:30.919528] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-09-18T21:50:31.001848] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-18T21:50:31.074878] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-18T21:50:31.719618] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-09-18T21:50:32.048103] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-18T21:50:32.519577] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-09-18T21:50:33.105533] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-18T21:50:33.271454] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-18T21:50:33.319598] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-09-18T21:50:33.899378] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-18T21:50:34.119542] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-09-18T21:50:34.919563] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-09-18T21:50:35.719546] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-09-18T21:50:35.965558] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-18T21:50:36.020163] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-18T21:50:36.324473] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-18T21:50:36.519555] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-09-18T21:50:37.319565] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-09-18T21:50:38.119566] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-09-18T21:50:38.322458] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-18T21:50:38.359730] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-18T21:50:38.365115] [INFO ] [REMOTE ] SPXC: Full fetch complete (33866 records). [2025-09-18T21:50:38.365220] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-09-18T21:50:38.744879] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-09-18T21:50:38.744967] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-09-18T21:50:38.745761] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-09-18T21:50:38.745827] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-09-18T21:50:38.746733] [DEBUG] [LOCAL ] SPXC: Trimmed 33866 records to 23627 (keeping 200 days of data) [2025-09-18T21:50:38.862063] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-18T21:50:38.920889] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-09-18T21:50:38.928801] [DEBUG] [LOCAL ] SPXC: Primary data saved (23627 records). [2025-09-18T21:50:38.928892] [INFO ] [MAIN ] SPXC: Full history saved. [2025-09-18T21:50:38.929020] [INFO ] [MAIN ] Update Progress: 1986/2372 symbols completed. SPXC took 39.9s. Estimated remaining: 56m 29s. Rate: 6.8 symbols/min [2025-09-18T21:50:39.106483] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:50:39.166199] [DEBUG] [LOCAL ] SRE: Loaded 53422 existing records from primary storage. [2025-09-18T21:50:39.166369] [INFO ] [MAIN ] SRE: Loaded 53422 existing records. [2025-09-18T21:50:39.388927] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:50:39.389199] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-09-18T21:50:39.389247] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-09-18T21:50:39.390437] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-09-18T21:50:39.390499] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-09-18T21:50:39.746854] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-09-18T21:50:39.752825] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:50:40.519553] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-11. [2025-09-18T21:50:41.129466] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T21:50:41.241493] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-18T21:50:41.319575] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-09-18T21:50:42.124733] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-09-18T21:50:42.141723] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-18T21:50:42.724828] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T21:50:42.919631] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-09-18T21:50:43.719612] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-09-18T21:50:43.894473] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-18T21:50:44.457880] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-18T21:50:44.519576] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-09-18T21:50:44.746920] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-18T21:50:45.319546] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-09-18T21:50:45.989966] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-18T21:50:46.119542] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-09-18T21:50:46.747857] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-18T21:50:46.754049] [INFO ] [REMOTE ] SQNS: Full fetch complete (31554 records). [2025-09-18T21:50:46.754162] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-09-18T21:50:46.930857] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-09-18T21:50:47.136022] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-09-18T21:50:47.136100] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-09-18T21:50:47.136762] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-09-18T21:50:47.136847] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-09-18T21:50:47.137612] [DEBUG] [LOCAL ] SQNS: Trimmed 31554 records to 25398 (keeping 200 days of data) [2025-09-18T21:50:47.289174] [DEBUG] [LOCAL ] SQNS: Primary data saved (25398 records). [2025-09-18T21:50:47.289340] [INFO ] [MAIN ] SQNS: Full history saved. [2025-09-18T21:50:47.289449] [INFO ] [MAIN ] Update Progress: 1987/2372 symbols completed. SQNS took 34.5s. Estimated remaining: 56m 20s. Rate: 6.8 symbols/min [2025-09-18T21:50:47.467946] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:50:47.479861] [DEBUG] [LOCAL ] SREA: Loaded 10455 existing records from primary storage. [2025-09-18T21:50:47.480001] [INFO ] [MAIN ] SREA: Loaded 10455 existing records. [2025-09-18T21:50:47.666441] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:50:47.666940] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-09-18T21:50:47.667010] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-09-18T21:50:47.667519] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-09-18T21:50:47.667578] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-09-18T21:50:47.724727] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-09-18T21:50:48.078822] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:50:48.081765] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-18T21:50:48.135841] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-18T21:50:48.519571] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-11. [2025-09-18T21:50:49.042011] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-18T21:50:49.319551] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-09-18T21:50:49.367593] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-18T21:50:49.374625] [INFO ] [REMOTE ] SQM: Full fetch complete (68822 records). [2025-09-18T21:50:49.374819] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-09-18T21:50:49.776478] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-09-18T21:50:49.776568] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-09-18T21:50:49.777580] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-09-18T21:50:49.777664] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-09-18T21:50:49.779287] [DEBUG] [LOCAL ] SQM: Trimmed 68822 records to 49038 (keeping 200 days of data) [2025-09-18T21:50:50.073147] [DEBUG] [LOCAL ] SQM: Primary data saved (49038 records). [2025-09-18T21:50:50.073285] [INFO ] [MAIN ] SQM: Full history saved. [2025-09-18T21:50:50.074233] [INFO ] [MAIN ] Update Progress: 1988/2372 symbols completed. SQM took 40.1s. Estimated remaining: 56m 10s. Rate: 6.8 symbols/min [2025-09-18T21:50:50.130680] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-09-18T21:50:50.259300] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:50:50.274116] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-18T21:50:50.311206] [DEBUG] [LOCAL ] SRFM: Loaded 34848 existing records from primary storage. [2025-09-18T21:50:50.311362] [INFO ] [MAIN ] SRFM: Loaded 34848 existing records. [2025-09-18T21:50:50.494212] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:50:50.494503] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-09-18T21:50:50.494561] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-09-18T21:50:50.495329] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-09-18T21:50:50.495434] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-09-18T21:50:50.850729] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:50:50.919522] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-11. [2025-09-18T21:50:51.630424] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-18T21:50:51.719517] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-09-18T21:50:51.988054] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-18T21:50:52.519560] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-09-18T21:50:53.010009] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-18T21:50:53.319557] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-09-18T21:50:53.835289] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-18T21:50:54.119569] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-09-18T21:50:54.919539] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-09-18T21:50:54.959540] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T21:50:55.006928] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-18T21:50:55.719562] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-09-18T21:50:56.147841] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-18T21:50:56.519539] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-09-18T21:50:57.264903] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-18T21:50:57.319547] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-09-18T21:50:58.001541] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-18T21:50:58.119553] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-09-18T21:50:58.757217] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-18T21:50:58.813575] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T21:50:58.919510] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-09-18T21:50:59.719554] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-09-18T21:50:59.901951] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-18T21:50:59.906567] [INFO ] [REMOTE ] SR: Full fetch complete (45534 records). [2025-09-18T21:50:59.906692] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-09-18T21:51:00.282994] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-09-18T21:51:00.283078] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-09-18T21:51:00.283909] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-09-18T21:51:00.283972] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-09-18T21:51:00.285066] [DEBUG] [LOCAL ] SR: Trimmed 45534 records to 32904 (keeping 200 days of data) [2025-09-18T21:51:00.496450] [DEBUG] [LOCAL ] SR: Primary data saved (32904 records). [2025-09-18T21:51:00.496619] [INFO ] [MAIN ] SR: Full history saved. [2025-09-18T21:51:00.496748] [INFO ] [MAIN ] Update Progress: 1989/2372 symbols completed. SR took 33.1s. Estimated remaining: 56m 2s. Rate: 6.8 symbols/min [2025-09-18T21:51:00.528446] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-09-18T21:51:00.673056] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:51:00.691260] [DEBUG] [LOCAL ] SRG: Loaded 16123 existing records from primary storage. [2025-09-18T21:51:00.691419] [INFO ] [MAIN ] SRG: Loaded 16123 existing records. [2025-09-18T21:51:00.874612] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:51:00.874914] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-09-18T21:51:00.874963] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-09-18T21:51:00.875396] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-09-18T21:51:00.875457] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-09-18T21:51:01.255662] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:51:01.274447] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T21:51:01.319532] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-11. [2025-09-18T21:51:02.119559] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-09-18T21:51:02.790280] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-18T21:51:02.816282] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-18T21:51:02.919526] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-09-18T21:51:03.719557] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-09-18T21:51:04.519570] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-09-18T21:51:05.309794] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (3.19 seconds). [2025-09-18T21:51:05.319503] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-09-18T21:51:05.372207] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-18T21:51:05.447457] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-18T21:51:05.708304] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-09-18T21:51:06.119551] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-09-18T21:51:06.360493] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-18T21:51:06.852942] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-18T21:51:06.919533] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-09-18T21:51:07.719566] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-09-18T21:51:07.878960] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-18T21:51:08.402762] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-18T21:51:08.519514] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-09-18T21:51:09.315353] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-18T21:51:09.319503] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-09-18T21:51:10.119526] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-09-18T21:51:10.901286] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-18T21:51:10.924638] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-09-18T21:51:10.939011] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-18T21:51:11.719526] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-09-18T21:51:11.985140] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-18T21:51:12.519533] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-09-18T21:51:12.608540] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-18T21:51:13.319558] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-09-18T21:51:14.119556] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-09-18T21:51:14.163201] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T21:51:14.667850] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-18T21:51:14.675485] [INFO ] [REMOTE ] SRE: Full fetch complete (77106 records). [2025-09-18T21:51:14.675722] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-09-18T21:51:14.925789] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-09-18T21:51:15.091982] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-09-18T21:51:15.092069] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-09-18T21:51:15.093196] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-09-18T21:51:15.093298] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-09-18T21:51:15.095850] [DEBUG] [LOCAL ] SRE: Trimmed 77106 records to 53812 (keeping 200 days of data) [2025-09-18T21:51:15.432779] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-18T21:51:15.450958] [DEBUG] [LOCAL ] SRE: Primary data saved (53812 records). [2025-09-18T21:51:15.451079] [INFO ] [MAIN ] SRE: Full history saved. [2025-09-18T21:51:15.451161] [INFO ] [MAIN ] Update Progress: 1990/2372 symbols completed. SRE took 36.5s. Estimated remaining: 55m 54s. Rate: 6.8 symbols/min [2025-09-18T21:51:15.627484] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:51:15.638219] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-18T21:51:15.667210] [DEBUG] [LOCAL ] SRI: Loaded 28111 existing records from primary storage. [2025-09-18T21:51:15.667369] [INFO ] [MAIN ] SRI: Loaded 28111 existing records. [2025-09-18T21:51:15.720691] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-09-18T21:51:15.860637] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:51:15.860918] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-09-18T21:51:15.860976] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-09-18T21:51:15.861625] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-09-18T21:51:15.861717] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-09-18T21:51:16.222494] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:51:16.439543] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T21:51:16.519555] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-09-18T21:51:17.319581] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-11. [2025-09-18T21:51:17.338140] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-18T21:51:18.119592] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-09-18T21:51:18.609765] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-18T21:51:18.622939] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-18T21:51:18.919560] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-09-18T21:51:19.581432] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-18T21:51:19.719598] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-09-18T21:51:20.519585] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-09-18T21:51:21.059073] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T21:51:21.319557] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-09-18T21:51:21.355777] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-18T21:51:21.928345] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-18T21:51:21.930044] [INFO ] [REMOTE ] SREA: Full fetch complete (16006 records). [2025-09-18T21:51:21.930118] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-09-18T21:51:22.126201] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-09-18T21:51:22.322423] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-09-18T21:51:22.322511] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-09-18T21:51:22.322930] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-09-18T21:51:22.322993] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-09-18T21:51:22.323729] [DEBUG] [LOCAL ] SREA: Trimmed 16006 records to 10496 (keeping 200 days of data) [2025-09-18T21:51:22.391429] [DEBUG] [LOCAL ] SREA: Primary data saved (10496 records). [2025-09-18T21:51:22.391634] [INFO ] [MAIN ] SREA: Full history saved. [2025-09-18T21:51:22.391807] [INFO ] [MAIN ] Update Progress: 1991/2372 symbols completed. SREA took 35.1s. Estimated remaining: 55m 45s. Rate: 6.8 symbols/min [2025-09-18T21:51:22.581325] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:51:22.581530] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-09-18T21:51:22.581570] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-09-18T21:51:22.581741] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-09-18T21:51:22.581795] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-18T21:51:22.581839] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-18T21:51:22.581872] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-09-18T21:51:22.924624] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-09-18T21:51:22.963791] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:51:23.719567] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-09-18T21:51:23.808217] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-18T21:51:23.811117] [INFO ] [REMOTE ] SRG: Full fetch complete (25694 records). [2025-09-18T21:51:23.811204] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-09-18T21:51:24.210834] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-09-18T21:51:24.211029] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-09-18T21:51:24.211721] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-09-18T21:51:24.211857] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-09-18T21:51:24.213277] [DEBUG] [LOCAL ] SRG: Trimmed 25694 records to 16295 (keeping 200 days of data) [2025-09-18T21:51:24.316911] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-18T21:51:24.352224] [DEBUG] [LOCAL ] SRG: Primary data saved (16295 records). [2025-09-18T21:51:24.352414] [INFO ] [MAIN ] SRG: Full history saved. [2025-09-18T21:51:24.352535] [INFO ] [MAIN ] Update Progress: 1992/2372 symbols completed. SRG took 23.9s. Estimated remaining: 55m 35s. Rate: 6.8 symbols/min [2025-09-18T21:51:24.528306] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-11. [2025-09-18T21:51:24.534134] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:51:24.545715] [DEBUG] [LOCAL ] SRV: Loaded 7809 existing records from primary storage. [2025-09-18T21:51:24.545840] [INFO ] [MAIN ] SRV: Loaded 7809 existing records. [2025-09-18T21:51:24.746798] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:51:24.747293] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-09-18T21:51:24.747420] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-09-18T21:51:24.747867] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-09-18T21:51:24.748058] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-09-18T21:51:24.875435] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-18T21:51:25.033685] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-18T21:51:25.149363] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:51:25.319510] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-11. [2025-09-18T21:51:26.090330] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-18T21:51:26.119501] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-09-18T21:51:26.919560] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-09-18T21:51:27.719612] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-09-18T21:51:28.056848] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T21:51:28.292287] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-18T21:51:28.296868] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-18T21:51:28.519557] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-09-18T21:51:29.319548] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-09-18T21:51:29.798785] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-18T21:51:30.119556] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-09-18T21:51:30.508431] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-18T21:51:30.919705] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-09-18T21:51:31.403187] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-18T21:51:31.555303] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-18T21:51:31.719683] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-09-18T21:51:32.519560] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-09-18T21:51:33.319590] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-18T21:51:33.590854] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-18T21:51:33.632846] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-18T21:51:33.650778] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-18T21:51:33.657465] [INFO ] [REMOTE ] SRFM: Full fetch complete (48331 records). [2025-09-18T21:51:33.657597] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-09-18T21:51:34.032413] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-09-18T21:51:34.032493] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-09-18T21:51:34.033297] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-09-18T21:51:34.033360] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-09-18T21:51:34.034387] [DEBUG] [LOCAL ] SRFM: Trimmed 48331 records to 35211 (keeping 200 days of data) [2025-09-18T21:51:34.120686] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-09-18T21:51:34.243244] [DEBUG] [LOCAL ] SRFM: Primary data saved (35211 records). [2025-09-18T21:51:34.243397] [INFO ] [MAIN ] SRFM: Full history saved. [2025-09-18T21:51:34.243490] [INFO ] [MAIN ] Update Progress: 1993/2372 symbols completed. SRFM took 44.2s. Estimated remaining: 55m 26s. Rate: 6.8 symbols/min [2025-09-18T21:51:34.420004] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:51:34.463218] [DEBUG] [LOCAL ] SSB: Loaded 42962 existing records from primary storage. [2025-09-18T21:51:34.463381] [INFO ] [MAIN ] SSB: Loaded 42962 existing records. [2025-09-18T21:51:34.701636] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:51:34.701952] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-09-18T21:51:34.702004] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-09-18T21:51:34.703196] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-09-18T21:51:34.703274] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-09-18T21:51:34.928453] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-09-18T21:51:35.201223] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:51:35.310731] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-18T21:51:35.643672] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-18T21:51:35.719615] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-09-18T21:51:36.445452] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-18T21:51:36.519577] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-09-18T21:51:37.319539] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-18T21:51:37.758396] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-18T21:51:37.776289] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-18T21:51:38.119561] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-18T21:51:38.547339] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-18T21:51:38.919543] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-09-18T21:51:39.719556] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-18T21:51:40.349071] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-18T21:51:40.373265] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T21:51:40.519555] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-18T21:51:40.870218] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-18T21:51:41.319554] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-11. [2025-09-18T21:51:42.119623] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-09-18T21:51:42.746848] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T21:51:42.762085] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-18T21:51:42.919545] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-09-18T21:51:43.719562] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-09-18T21:51:43.815400] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-18T21:51:44.519547] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-09-18T21:51:45.050979] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-18T21:51:45.091083] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-18T21:51:45.319552] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-09-18T21:51:46.119561] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-18T21:51:46.160446] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-18T21:51:46.473764] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-18T21:51:46.919541] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-18T21:51:47.273504] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-18T21:51:47.719543] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-18T21:51:48.002797] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-18T21:51:48.003592] [INFO ] [REMOTE ] SRL: Full fetch complete (1922 records). [2025-09-18T21:51:48.003692] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-09-18T21:51:48.193191] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-18T21:51:48.193393] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:51:48.193468] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:51:48.193582] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-18T21:51:48.193696] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-18T21:51:48.193753] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-09-18T21:51:48.193813] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-09-18T21:51:48.193894] [INFO ] [MAIN ] Update Progress: 1994/2372 symbols completed. SRL took 25.8s. Estimated remaining: 55m 18s. Rate: 6.8 symbols/min [2025-09-18T21:51:48.360889] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:51:48.387049] [DEBUG] [LOCAL ] SSD: Loaded 22468 existing records from primary storage. [2025-09-18T21:51:48.387233] [INFO ] [MAIN ] SSD: Loaded 22468 existing records. [2025-09-18T21:51:48.529266] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-09-18T21:51:48.572405] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:51:48.572693] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-09-18T21:51:48.572752] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-09-18T21:51:48.573606] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-09-18T21:51:48.573706] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-09-18T21:51:48.935597] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:51:49.319494] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-11. [2025-09-18T21:51:49.482966] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-18T21:51:50.119495] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-09-18T21:51:50.150942] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-18T21:51:50.919524] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-09-18T21:51:51.072242] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-18T21:51:51.075590] [INFO ] [REMOTE ] SRI: Full fetch complete (41806 records). [2025-09-18T21:51:51.075695] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-09-18T21:51:51.454854] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-09-18T21:51:51.454938] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-09-18T21:51:51.455665] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-09-18T21:51:51.455727] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-09-18T21:51:51.456750] [DEBUG] [LOCAL ] SRI: Trimmed 41806 records to 28249 (keeping 200 days of data) [2025-09-18T21:51:51.609475] [DEBUG] [LOCAL ] SRI: Primary data saved (28249 records). [2025-09-18T21:51:51.609610] [INFO ] [MAIN ] SRI: Full history saved. [2025-09-18T21:51:51.609734] [INFO ] [MAIN ] Update Progress: 1995/2372 symbols completed. SRI took 36.2s. Estimated remaining: 55m 9s. Rate: 6.8 symbols/min [2025-09-18T21:51:51.724722] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-09-18T21:51:51.780141] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:51:51.820611] [DEBUG] [LOCAL ] SSL: Loaded 41116 existing records from primary storage. [2025-09-18T21:51:51.820792] [INFO ] [MAIN ] SSL: Loaded 41116 existing records. [2025-09-18T21:51:51.997835] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:51:51.998114] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-09-18T21:51:51.998162] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-09-18T21:51:51.999085] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-09-18T21:51:51.999158] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-09-18T21:51:52.358200] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:51:52.364542] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-18T21:51:52.426068] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T21:51:52.519495] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-11. [2025-09-18T21:51:53.319550] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-09-18T21:51:54.012022] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-18T21:51:54.119564] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-09-18T21:51:54.418126] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-18T21:51:54.919565] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-09-18T21:51:55.719560] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-09-18T21:51:55.790150] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-18T21:51:56.205092] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-18T21:51:56.466861] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-18T21:51:56.519512] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-09-18T21:51:57.319614] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-09-18T21:51:57.672750] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T21:51:57.770672] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-18T21:51:58.119550] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-09-18T21:51:58.919535] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-09-18T21:51:59.530452] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-18T21:51:59.549998] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-18T21:51:59.551968] [INFO ] [REMOTE ] SRV: Full fetch complete (11609 records). [2025-09-18T21:51:59.552086] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-09-18T21:51:59.722111] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-09-18T21:51:59.939589] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-09-18T21:51:59.939725] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-09-18T21:51:59.940043] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-09-18T21:51:59.940113] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-09-18T21:51:59.940583] [DEBUG] [LOCAL ] SRV: Trimmed 11609 records to 7846 (keeping 200 days of data) [2025-09-18T21:51:59.988456] [DEBUG] [LOCAL ] SRV: Primary data saved (7846 records). [2025-09-18T21:51:59.988588] [INFO ] [MAIN ] SRV: Full history saved. [2025-09-18T21:51:59.988722] [INFO ] [MAIN ] Update Progress: 1996/2372 symbols completed. SRV took 35.6s. Estimated remaining: 54m 60s. Rate: 6.8 symbols/min [2025-09-18T21:52:00.157800] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:52:00.171270] [DEBUG] [LOCAL ] SST: Loaded 12440 existing records from primary storage. [2025-09-18T21:52:00.171389] [INFO ] [MAIN ] SST: Loaded 12440 existing records. [2025-09-18T21:52:00.348922] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:52:00.349171] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-09-18T21:52:00.349226] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-09-18T21:52:00.349637] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-09-18T21:52:00.349749] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-09-18T21:52:00.524715] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-09-18T21:52:00.709544] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:52:01.324726] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-11. [2025-09-18T21:52:01.340821] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-18T21:52:02.051771] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-18T21:52:02.119534] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-09-18T21:52:02.192236] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T21:52:02.919578] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-09-18T21:52:03.493075] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T21:52:03.719585] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-09-18T21:52:04.023385] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-18T21:52:04.519575] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-09-18T21:52:05.319577] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-09-18T21:52:05.375137] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-18T21:52:05.760970] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T21:52:05.964634] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-18T21:52:06.119546] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-09-18T21:52:06.919595] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-09-18T21:52:07.719568] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-09-18T21:52:07.865713] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-18T21:52:07.888340] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-18T21:52:08.519582] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-09-18T21:52:09.154070] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T21:52:09.319513] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-09-18T21:52:09.364233] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-18T21:52:10.119554] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-09-18T21:52:10.919607] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-09-18T21:52:10.957547] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-18T21:52:11.558876] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-18T21:52:11.719566] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-09-18T21:52:12.194524] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-18T21:52:12.519598] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-09-18T21:52:12.973611] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-18T21:52:12.979759] [INFO ] [REMOTE ] SSB: Full fetch complete (60978 records). [2025-09-18T21:52:12.979869] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-09-18T21:52:13.277467] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-18T21:52:13.324637] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-09-18T21:52:13.405945] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-09-18T21:52:13.406038] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-09-18T21:52:13.407104] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-09-18T21:52:13.407215] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-09-18T21:52:13.408673] [DEBUG] [LOCAL ] SSB: Trimmed 60978 records to 43282 (keeping 200 days of data) [2025-09-18T21:52:13.702506] [DEBUG] [LOCAL ] SSB: Primary data saved (43282 records). [2025-09-18T21:52:13.702662] [INFO ] [MAIN ] SSB: Full history saved. [2025-09-18T21:52:13.703997] [INFO ] [MAIN ] Update Progress: 1997/2372 symbols completed. SSB took 39.5s. Estimated remaining: 54m 52s. Rate: 6.8 symbols/min [2025-09-18T21:52:14.119569] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-09-18T21:52:14.741751] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-18T21:52:14.919532] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-09-18T21:52:14.999322] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-18T21:52:15.719596] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-09-18T21:52:16.369746] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T21:52:16.519536] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-09-18T21:52:16.873939] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-18T21:52:17.319696] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-09-18T21:52:17.971553] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T21:52:18.119548] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-09-18T21:52:18.204723] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-18T21:52:18.919610] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-09-18T21:52:19.582331] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T21:52:19.588958] [INFO ] [REMOTE ] SSL: Full fetch complete (60245 records). [2025-09-18T21:52:19.589125] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-09-18T21:52:19.725866] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-09-18T21:52:20.039078] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-09-18T21:52:20.035957] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-18T21:52:20.039210] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-09-18T21:52:20.045243] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-09-18T21:52:20.045471] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-09-18T21:52:20.046791] [DEBUG] [LOCAL ] SSL: Trimmed 60245 records to 41419 (keeping 200 days of data) [2025-09-18T21:52:20.285803] [DEBUG] [LOCAL ] SSL: Primary data saved (41419 records). [2025-09-18T21:52:20.285937] [INFO ] [MAIN ] SSL: Full history saved. [2025-09-18T21:52:20.286054] [INFO ] [MAIN ] Update Progress: 1998/2372 symbols completed. SSL took 28.7s. Estimated remaining: 54m 43s. Rate: 6.8 symbols/min [2025-09-18T21:52:20.519590] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-09-18T21:52:20.725487] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-18T21:52:21.319616] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-09-18T21:52:21.644999] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T21:52:22.119507] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-09-18T21:52:22.185044] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-18T21:52:22.919521] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-09-18T21:52:23.014500] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-18T21:52:23.552252] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-18T21:52:23.719525] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-09-18T21:52:24.519510] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-09-18T21:52:24.560847] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-18T21:52:24.564347] [INFO ] [REMOTE ] SSD: Full fetch complete (32121 records). [2025-09-18T21:52:24.564433] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-09-18T21:52:24.938916] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-09-18T21:52:24.938999] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-09-18T21:52:24.940101] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-09-18T21:52:24.940164] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-09-18T21:52:24.940975] [DEBUG] [LOCAL ] SSD: Trimmed 32121 records to 22625 (keeping 200 days of data) [2025-09-18T21:52:25.103452] [DEBUG] [LOCAL ] SSD: Primary data saved (22625 records). [2025-09-18T21:52:25.103689] [INFO ] [MAIN ] SSD: Full history saved. [2025-09-18T21:52:25.103948] [INFO ] [MAIN ] Update Progress: 1999/2372 symbols completed. SSD took 36.9s. Estimated remaining: 54m 33s. Rate: 6.8 symbols/min [2025-09-18T21:52:25.229403] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-18T21:52:25.319562] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-09-18T21:52:25.958830] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-18T21:52:25.960460] [INFO ] [REMOTE ] SST: Full fetch complete (19130 records). [2025-09-18T21:52:25.960532] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-09-18T21:52:26.331384] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-09-18T21:52:26.331461] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-09-18T21:52:26.331982] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-09-18T21:52:26.332044] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-09-18T21:52:26.332579] [DEBUG] [LOCAL ] SST: Trimmed 19130 records to 12511 (keeping 200 days of data) [2025-09-18T21:52:26.411584] [DEBUG] [LOCAL ] SST: Primary data saved (12511 records). [2025-09-18T21:52:26.411740] [INFO ] [MAIN ] SST: Full history saved. [2025-09-18T21:52:26.411870] [INFO ] [MAIN ] Update Progress: 2000/2372 symbols completed. SST took 26.4s. Estimated remaining: 54m 23s. Rate: 6.8 symbols/min [2025-09-18T21:52:27.038003] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:52:27.053990] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:52:27.090209] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:52:27.110917] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:52:27.137994] [DEBUG] [LOCAL ] STC: Loaded 17858 existing records from primary storage. [2025-09-18T21:52:27.144165] [INFO ] [MAIN ] STC: Loaded 17858 existing records. [2025-09-18T21:52:27.247187] [DEBUG] [LOCAL ] SSTK: Loaded 27109 existing records from primary storage. [2025-09-18T21:52:27.264784] [INFO ] [MAIN ] SSTK: Loaded 27109 existing records. [2025-09-18T21:52:27.549068] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:52:27.568683] [DEBUG] [LOCAL ] STAG: Loaded 50025 existing records from primary storage. [2025-09-18T21:52:27.574094] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-09-18T21:52:27.574228] [INFO ] [MAIN ] STAG: Loaded 50025 existing records. [2025-09-18T21:52:27.548916] [DEBUG] [LOCAL ] ST: Loaded 49888 existing records from primary storage. [2025-09-18T21:52:27.616887] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:52:27.617005] [INFO ] [MAIN ] ST: Loaded 49888 existing records. [2025-09-18T21:52:27.616768] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-09-18T21:52:27.706265] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-09-18T21:52:27.715115] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-09-18T21:52:27.764348] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-09-18T21:52:27.822304] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-09-18T21:52:27.841189] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-09-18T21:52:27.883814] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-09-18T21:52:28.141347] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:52:28.259024] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-09-18T21:52:28.266764] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-09-18T21:52:28.253736] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:52:28.313903] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-09-18T21:52:28.349438] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-09-18T21:52:28.392028] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-09-18T21:52:28.440977] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-09-18T21:52:28.502898] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-09-18T21:52:28.537992] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-09-18T21:52:28.835700] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:52:28.916965] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-11. [2025-09-18T21:52:29.156700] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:52:29.197762] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-11. [2025-09-18T21:52:29.404962] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:52:29.411150] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-11. [2025-09-18T21:52:29.490009] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:52:29.490474] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-11. [2025-09-18T21:52:29.828855] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-18T21:52:29.832065] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-09-18T21:52:30.462868] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T21:52:30.469633] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-09-18T21:52:30.741182] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-18T21:52:30.778219] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-18T21:52:30.899751] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-18T21:52:30.919496] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-09-18T21:52:31.609015] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-18T21:52:31.719571] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-09-18T21:52:32.272297] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-18T21:52:32.404563] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-18T21:52:32.519558] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-09-18T21:52:33.319571] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-09-18T21:52:34.119549] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-09-18T21:52:34.348395] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-18T21:52:34.811837] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T21:52:34.920610] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-09-18T21:52:34.923956] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-18T21:52:35.719563] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-09-18T21:52:36.471954] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T21:52:36.519544] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-09-18T21:52:37.097329] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T21:52:37.319562] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-09-18T21:52:37.421306] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-18T21:52:38.119550] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-09-18T21:52:38.722405] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T21:52:38.919520] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-09-18T21:52:39.257616] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-18T21:52:39.719623] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-09-18T21:52:40.432522] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T21:52:40.519507] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-09-18T21:52:40.858043] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-18T21:52:41.319556] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-09-18T21:52:42.119603] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-09-18T21:52:42.225589] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-18T21:52:42.306141] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-18T21:52:42.919534] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-09-18T21:52:43.325146] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-18T21:52:43.639922] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T21:52:43.719565] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-09-18T21:52:44.519564] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-09-18T21:52:44.810716] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-18T21:52:45.319544] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-09-18T21:52:46.110995] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-18T21:52:46.127438] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-09-18T21:52:46.919535] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-09-18T21:52:46.967730] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-18T21:52:47.024006] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-18T21:52:47.543346] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-18T21:52:47.719558] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-09-18T21:52:48.519606] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-09-18T21:52:49.231242] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-18T21:52:49.319524] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-09-18T21:52:50.119614] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-09-18T21:52:50.286612] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-18T21:52:50.340979] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-18T21:52:50.919547] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-09-18T21:52:51.719620] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-09-18T21:52:51.719547] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-18T21:52:51.875365] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-18T21:52:52.519559] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-09-18T21:52:53.302234] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T21:52:53.319562] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-09-18T21:52:54.119567] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-09-18T21:52:54.345246] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-18T21:52:54.808893] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T21:52:54.919560] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-09-18T21:52:55.001002] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-18T21:52:55.719557] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-09-18T21:52:56.519550] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-09-18T21:52:56.574589] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-18T21:52:56.985015] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-18T21:52:57.108426] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-18T21:52:57.111472] [INFO ] [REMOTE ] STC: Full fetch complete (26086 records). [2025-09-18T21:52:57.111562] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-09-18T21:52:57.326241] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-09-18T21:52:57.523248] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-09-18T21:52:57.523337] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-09-18T21:52:57.523971] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-09-18T21:52:57.524035] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-09-18T21:52:57.524974] [DEBUG] [LOCAL ] STC: Trimmed 26086 records to 18054 (keeping 200 days of data) [2025-09-18T21:52:57.645990] [DEBUG] [LOCAL ] STC: Primary data saved (18054 records). [2025-09-18T21:52:57.646132] [INFO ] [MAIN ] STC: Full history saved. [2025-09-18T21:52:57.646222] [INFO ] [MAIN ] Update Progress: 2001/2372 symbols completed. STC took 31.2s. Estimated remaining: 54m 18s. Rate: 6.8 symbols/min [2025-09-18T21:52:57.824410] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:52:57.868837] [DEBUG] [LOCAL ] STE: Loaded 35477 existing records from primary storage. [2025-09-18T21:52:57.868980] [INFO ] [MAIN ] STE: Loaded 35477 existing records. [2025-09-18T21:52:58.060740] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:52:58.061013] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-09-18T21:52:58.061064] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-09-18T21:52:58.062088] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-09-18T21:52:58.062149] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-09-18T21:52:58.127802] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-09-18T21:52:58.450136] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:52:58.919545] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-09-18T21:52:58.982057] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-18T21:52:58.999471] [INFO ] [REMOTE ] STAG: Full fetch complete (71652 records). [2025-09-18T21:52:59.000574] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-18T21:52:59.004336] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-09-18T21:52:59.051777] [INFO ] [REMOTE ] SSTK: Full fetch complete (42431 records). [2025-09-18T21:52:59.091344] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-09-18T21:52:59.732776] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-11. [2025-09-18T21:52:59.823489] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-09-18T21:52:59.841499] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-09-18T21:52:59.841743] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-09-18T21:52:59.842981] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-09-18T21:52:59.843066] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-09-18T21:52:59.841683] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-09-18T21:52:59.843795] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-09-18T21:52:59.844163] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-09-18T21:52:59.845635] [DEBUG] [LOCAL ] SSTK: Trimmed 42431 records to 27288 (keeping 200 days of data) [2025-09-18T21:52:59.846221] [DEBUG] [LOCAL ] STAG: Trimmed 71652 records to 50407 (keeping 200 days of data) [2025-09-18T21:53:00.199845] [DEBUG] [LOCAL ] SSTK: Primary data saved (27288 records). [2025-09-18T21:53:00.200289] [INFO ] [MAIN ] SSTK: Full history saved. [2025-09-18T21:53:00.227378] [INFO ] [MAIN ] Update Progress: 2002/2372 symbols completed. SSTK took 33.8s. Estimated remaining: 54m 8s. Rate: 6.8 symbols/min [2025-09-18T21:53:00.423316] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:53:00.450982] [DEBUG] [LOCAL ] STEL: Loaded 23806 existing records from primary storage. [2025-09-18T21:53:00.454617] [INFO ] [MAIN ] STEL: Loaded 23806 existing records. [2025-09-18T21:53:00.700133] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:53:00.703202] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-09-18T21:53:00.704925] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-09-18T21:53:00.709520] [DEBUG] [LOCAL ] STAG: Primary data saved (50407 records). [2025-09-18T21:53:00.709623] [INFO ] [MAIN ] STAG: Full history saved. [2025-09-18T21:53:00.709833] [INFO ] [MAIN ] Update Progress: 2003/2372 symbols completed. STAG took 34.3s. Estimated remaining: 53m 58s. Rate: 6.8 symbols/min [2025-09-18T21:53:00.715539] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-09-18T21:53:00.722754] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-09-18T21:53:01.075350] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:53:01.126815] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-18T21:53:01.223806] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-09-18T21:53:01.339485] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:53:01.340107] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-11. [2025-09-18T21:53:01.353555] [DEBUG] [LOCAL ] STEM: Loaded 40364 existing records from primary storage. [2025-09-18T21:53:01.353799] [INFO ] [MAIN ] STEM: Loaded 40364 existing records. [2025-09-18T21:53:01.525052] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-18T21:53:01.592251] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:53:01.592518] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-09-18T21:53:01.592572] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-09-18T21:53:01.593463] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-09-18T21:53:01.593752] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-09-18T21:53:01.949789] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:53:02.119554] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-11. [2025-09-18T21:53:02.527549] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-18T21:53:02.919567] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-09-18T21:53:03.338543] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-18T21:53:03.590515] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-18T21:53:03.719523] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-09-18T21:53:03.964254] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-18T21:53:04.519600] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-09-18T21:53:05.319719] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-09-18T21:53:05.912032] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-18T21:53:05.966083] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T21:53:05.972953] [INFO ] [REMOTE ] ST: Full fetch complete (71732 records). [2025-09-18T21:53:05.973093] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-09-18T21:53:06.128023] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-09-18T21:53:06.381173] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-09-18T21:53:06.381273] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-09-18T21:53:06.382361] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-09-18T21:53:06.382430] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-09-18T21:53:06.384979] [DEBUG] [LOCAL ] ST: Trimmed 71732 records to 50255 (keeping 200 days of data) [2025-09-18T21:53:06.631559] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T21:53:06.739058] [DEBUG] [LOCAL ] ST: Primary data saved (50255 records). [2025-09-18T21:53:06.739223] [INFO ] [MAIN ] ST: Full history saved. [2025-09-18T21:53:06.739329] [INFO ] [MAIN ] Update Progress: 2004/2372 symbols completed. ST took 40.3s. Estimated remaining: 53m 49s. Rate: 6.8 symbols/min [2025-09-18T21:53:06.924737] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-09-18T21:53:06.931490] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:53:06.951942] [DEBUG] [LOCAL ] STEW: Loaded 16468 existing records from primary storage. [2025-09-18T21:53:06.952130] [INFO ] [MAIN ] STEW: Loaded 16468 existing records. [2025-09-18T21:53:07.147042] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:53:07.147339] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-09-18T21:53:07.147398] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-09-18T21:53:07.148095] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-09-18T21:53:07.148155] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-09-18T21:53:07.512945] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:53:07.719606] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-11. [2025-09-18T21:53:08.288288] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-18T21:53:08.354060] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T21:53:08.519545] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-09-18T21:53:08.645026] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-18T21:53:09.319570] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-09-18T21:53:10.119586] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-09-18T21:53:10.214331] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-18T21:53:10.251002] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-18T21:53:10.919566] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-09-18T21:53:11.306122] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-18T21:53:11.581364] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-18T21:53:11.719537] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-09-18T21:53:12.519515] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-09-18T21:53:12.804537] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-18T21:53:13.319544] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-09-18T21:53:13.873168] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-18T21:53:14.119563] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-09-18T21:53:14.156405] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T21:53:14.919549] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-09-18T21:53:15.719571] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-09-18T21:53:16.217866] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-18T21:53:16.356862] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-18T21:53:16.394017] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-18T21:53:16.519502] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-09-18T21:53:17.319551] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-09-18T21:53:18.119567] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-09-18T21:53:18.409549] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-18T21:53:18.655149] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-18T21:53:18.919543] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-09-18T21:53:19.105396] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-18T21:53:19.719634] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-09-18T21:53:20.217962] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-18T21:53:20.430822] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-18T21:53:20.519578] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-09-18T21:53:21.319629] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-09-18T21:53:21.678170] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-18T21:53:22.119601] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-09-18T21:53:22.190915] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-18T21:53:22.919565] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-09-18T21:53:23.553287] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T21:53:23.719576] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-09-18T21:53:23.936883] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-18T21:53:24.519600] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-09-18T21:53:24.850304] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-18T21:53:25.319575] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-09-18T21:53:25.417422] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-18T21:53:26.119561] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-09-18T21:53:26.919510] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-09-18T21:53:27.010359] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-18T21:53:27.094792] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-18T21:53:27.719583] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-09-18T21:53:28.163121] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-18T21:53:28.519592] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-09-18T21:53:29.139639] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-18T21:53:29.191275] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-18T21:53:29.194839] [INFO ] [REMOTE ] STEL: Full fetch complete (32029 records). [2025-09-18T21:53:29.194923] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-09-18T21:53:29.332939] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-09-18T21:53:29.566075] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-09-18T21:53:29.566164] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-09-18T21:53:29.566860] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-09-18T21:53:29.566923] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-09-18T21:53:29.567722] [DEBUG] [LOCAL ] STEL: Trimmed 32029 records to 24014 (keeping 200 days of data) [2025-09-18T21:53:29.715124] [DEBUG] [LOCAL ] STEL: Primary data saved (24014 records). [2025-09-18T21:53:29.715262] [INFO ] [MAIN ] STEL: Full history saved. [2025-09-18T21:53:29.715361] [INFO ] [MAIN ] Update Progress: 2005/2372 symbols completed. STEL took 29.5s. Estimated remaining: 53m 43s. Rate: 6.8 symbols/min [2025-09-18T21:53:29.889289] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:53:29.889534] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-09-18T21:53:29.889589] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-09-18T21:53:29.889767] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-09-18T21:53:29.889814] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-18T21:53:29.889857] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-18T21:53:29.889890] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-09-18T21:53:30.129023] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-09-18T21:53:30.248192] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:53:30.863045] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-18T21:53:30.892374] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-18T21:53:30.919501] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-09-18T21:53:31.719524] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-09-18T21:53:31.931363] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-18T21:53:32.519554] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-09-18T21:53:32.874245] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-18T21:53:33.319549] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-09-18T21:53:33.719742] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-18T21:53:33.872914] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-18T21:53:34.119563] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-09-18T21:53:34.919546] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-09-18T21:53:35.318581] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-18T21:53:35.322705] [INFO ] [REMOTE ] STEM: Full fetch complete (62986 records). [2025-09-18T21:53:35.322826] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-09-18T21:53:35.458861] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-18T21:53:35.493267] [INFO ] [REMOTE ] STEW: Full fetch complete (22114 records). [2025-09-18T21:53:35.520184] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-09-18T21:53:35.734161] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-09-18T21:53:36.048623] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-09-18T21:53:36.059229] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-09-18T21:53:36.070589] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-09-18T21:53:36.088812] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-09-18T21:53:36.130393] [DEBUG] [LOCAL ] STEM: Trimmed 62986 records to 40575 (keeping 200 days of data) [2025-09-18T21:53:36.137024] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-09-18T21:53:36.137129] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-09-18T21:53:36.137371] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-09-18T21:53:36.137630] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-09-18T21:53:36.138434] [DEBUG] [LOCAL ] STEW: Trimmed 22114 records to 16546 (keeping 200 days of data) [2025-09-18T21:53:36.328588] [DEBUG] [LOCAL ] STEW: Primary data saved (16546 records). [2025-09-18T21:53:36.329322] [INFO ] [MAIN ] STEW: Full history saved. [2025-09-18T21:53:36.329772] [INFO ] [MAIN ] Update Progress: 2006/2372 symbols completed. STEW took 29.6s. Estimated remaining: 53m 34s. Rate: 6.8 symbols/min [2025-09-18T21:53:36.516468] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:53:36.519770] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-11. [2025-09-18T21:53:36.577240] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-18T21:53:36.583065] [DEBUG] [LOCAL ] STK: Loaded 9386 existing records from primary storage. [2025-09-18T21:53:36.589463] [INFO ] [MAIN ] STK: Loaded 9386 existing records. [2025-09-18T21:53:36.621747] [INFO ] [REMOTE ] STE: Full fetch complete (50707 records). [2025-09-18T21:53:36.633862] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-09-18T21:53:36.966987] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:53:37.036267] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-09-18T21:53:37.050944] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-09-18T21:53:37.063292] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-09-18T21:53:37.063465] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-18T21:53:37.077749] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-09-18T21:53:37.325009] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-09-18T21:53:37.503693] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-09-18T21:53:37.520572] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-09-18T21:53:37.529296] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-09-18T21:53:37.534875] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-09-18T21:53:37.595709] [DEBUG] [LOCAL ] STE: Trimmed 50707 records to 35784 (keeping 200 days of data) [2025-09-18T21:53:37.800892] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-18T21:53:37.790382] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:53:37.813453] [DEBUG] [LOCAL ] STEM: Primary data saved (40575 records). [2025-09-18T21:53:37.814103] [INFO ] [MAIN ] STEM: Full history saved. [2025-09-18T21:53:37.814575] [INFO ] [MAIN ] Update Progress: 2007/2372 symbols completed. STEM took 37.1s. Estimated remaining: 53m 23s. Rate: 6.8 symbols/min [2025-09-18T21:53:38.007176] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:53:38.128574] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-11. [2025-09-18T21:53:38.160546] [DEBUG] [LOCAL ] STLA: Loaded 53547 existing records from primary storage. [2025-09-18T21:53:38.161280] [INFO ] [MAIN ] STLA: Loaded 53547 existing records. [2025-09-18T21:53:38.361119] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:53:38.365430] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-09-18T21:53:38.366126] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-09-18T21:53:38.368895] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-09-18T21:53:38.369527] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-09-18T21:53:38.445222] [DEBUG] [LOCAL ] STE: Primary data saved (35784 records). [2025-09-18T21:53:38.456585] [INFO ] [MAIN ] STE: Full history saved. [2025-09-18T21:53:38.456819] [INFO ] [MAIN ] Update Progress: 2008/2372 symbols completed. STE took 40.8s. Estimated remaining: 53m 13s. Rate: 6.8 symbols/min [2025-09-18T21:53:38.811428] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:53:38.923006] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-09-18T21:53:38.976010] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-18T21:53:39.015149] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:53:39.077147] [DEBUG] [LOCAL ] STM: Loaded 53589 existing records from primary storage. [2025-09-18T21:53:39.077520] [INFO ] [MAIN ] STM: Loaded 53589 existing records. [2025-09-18T21:53:39.387398] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-18T21:53:39.383154] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:53:39.389532] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-09-18T21:53:39.389610] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-09-18T21:53:39.391043] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-09-18T21:53:39.391109] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-09-18T21:53:39.724835] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-11. [2025-09-18T21:53:39.956897] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:53:40.519548] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-09-18T21:53:41.187707] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-18T21:53:41.319544] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-09-18T21:53:41.933051] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-11 (2.21 seconds). [2025-09-18T21:53:41.970590] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-18T21:53:42.119540] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-09-18T21:53:42.919585] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-11. [2025-09-18T21:53:43.719553] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-09-18T21:53:44.047289] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-18T21:53:44.135263] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-18T21:53:44.519505] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-09-18T21:53:44.569794] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T21:53:45.319595] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-09-18T21:53:46.119592] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-09-18T21:53:46.465821] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-18T21:53:46.481216] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-18T21:53:46.919555] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-09-18T21:53:46.951751] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-18T21:53:47.719558] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-09-18T21:53:48.519546] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-09-18T21:53:49.053931] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-18T21:53:49.181605] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-18T21:53:49.319548] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-09-18T21:53:49.518618] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-18T21:53:49.659516] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-18T21:53:50.119605] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-09-18T21:53:50.919553] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-09-18T21:53:51.269795] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-18T21:53:51.719513] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-09-18T21:53:51.939712] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-18T21:53:52.275057] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-18T21:53:52.519556] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-09-18T21:53:53.319596] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-09-18T21:53:53.364275] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-18T21:53:53.707585] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-18T21:53:54.119565] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-09-18T21:53:54.919554] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-09-18T21:53:55.719574] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-09-18T21:53:56.224915] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-18T21:53:56.402301] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-18T21:53:56.519561] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-09-18T21:53:57.161877] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-18T21:53:57.319535] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-09-18T21:53:57.776001] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-18T21:53:58.119509] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-09-18T21:53:58.315521] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-18T21:53:58.516492] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-18T21:53:58.919536] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-09-18T21:53:59.719544] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-09-18T21:54:00.519538] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-09-18T21:54:01.026278] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-18T21:54:01.169165] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-18T21:54:01.319544] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-18T21:54:01.649033] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-18T21:54:01.756530] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-18T21:54:01.757814] [INFO ] [REMOTE ] STG: Full fetch complete (2466 records). [2025-09-18T21:54:01.757907] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-09-18T21:54:01.946733] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-18T21:54:01.946954] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:54:01.947028] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:54:01.947102] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-18T21:54:01.947185] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-18T21:54:01.947245] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-09-18T21:54:01.947291] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-09-18T21:54:01.947353] [INFO ] [MAIN ] Update Progress: 2009/2372 symbols completed. STG took 32.2s. Estimated remaining: 53m 7s. Rate: 6.8 symbols/min [2025-09-18T21:54:02.122706] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-09-18T21:54:02.148088] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:54:02.175751] [DEBUG] [LOCAL ] STN: Loaded 23143 existing records from primary storage. [2025-09-18T21:54:02.175917] [INFO ] [MAIN ] STN: Loaded 23143 existing records. [2025-09-18T21:54:02.364243] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:54:02.364544] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-09-18T21:54:02.364605] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-09-18T21:54:02.365347] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-09-18T21:54:02.365412] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-09-18T21:54:02.767687] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:54:02.919554] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-11. [2025-09-18T21:54:03.719585] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-09-18T21:54:04.519555] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-09-18T21:54:04.802360] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-18T21:54:05.319621] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-09-18T21:54:05.411285] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (3.29 seconds). [2025-09-18T21:54:05.430492] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-18T21:54:06.119549] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-09-18T21:54:06.227173] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-18T21:54:06.532480] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-18T21:54:06.919607] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-09-18T21:54:07.479460] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-18T21:54:07.719563] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-09-18T21:54:07.885382] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-18T21:54:08.519569] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-09-18T21:54:08.744487] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-18T21:54:09.319556] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-09-18T21:54:10.119578] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-09-18T21:54:10.318259] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-18T21:54:10.842589] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-18T21:54:10.858367] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T21:54:10.860974] [INFO ] [REMOTE ] STK: Full fetch complete (13863 records). [2025-09-18T21:54:10.861400] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-09-18T21:54:10.924710] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-09-18T21:54:11.235302] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-09-18T21:54:11.235383] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-09-18T21:54:11.235756] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-09-18T21:54:11.235818] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-09-18T21:54:11.236370] [DEBUG] [LOCAL ] STK: Trimmed 13863 records to 9502 (keeping 200 days of data) [2025-09-18T21:54:11.294556] [DEBUG] [LOCAL ] STK: Primary data saved (9502 records). [2025-09-18T21:54:11.294711] [INFO ] [MAIN ] STK: Full history saved. [2025-09-18T21:54:11.294837] [INFO ] [MAIN ] Update Progress: 2010/2372 symbols completed. STK took 35.0s. Estimated remaining: 52m 58s. Rate: 6.8 symbols/min [2025-09-18T21:54:11.471627] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:54:11.521040] [DEBUG] [LOCAL ] STNG: Loaded 44189 existing records from primary storage. [2025-09-18T21:54:11.521222] [INFO ] [MAIN ] STNG: Loaded 44189 existing records. [2025-09-18T21:54:11.708563] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:54:11.708845] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-09-18T21:54:11.708913] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-09-18T21:54:11.709929] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-09-18T21:54:11.709989] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-09-18T21:54:11.724731] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-09-18T21:54:12.076471] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:54:12.519637] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-09-18T21:54:12.812376] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-18T21:54:13.319545] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-09-18T21:54:13.348178] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-18T21:54:13.670566] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-18T21:54:14.119558] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-09-18T21:54:14.919577] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-09-18T21:54:15.340007] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-18T21:54:15.558910] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-18T21:54:15.569710] [INFO ] [REMOTE ] STLA: Full fetch complete (77407 records). [2025-09-18T21:54:15.569921] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-09-18T21:54:15.724757] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-11. [2025-09-18T21:54:15.984976] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-09-18T21:54:15.985071] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-09-18T21:54:15.986240] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-09-18T21:54:15.986308] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-09-18T21:54:15.987958] [DEBUG] [LOCAL ] STLA: Trimmed 77407 records to 53936 (keeping 200 days of data) [2025-09-18T21:54:16.313383] [DEBUG] [LOCAL ] STLA: Primary data saved (53936 records). [2025-09-18T21:54:16.313564] [INFO ] [MAIN ] STLA: Full history saved. [2025-09-18T21:54:16.313698] [INFO ] [MAIN ] Update Progress: 2011/2372 symbols completed. STLA took 38.5s. Estimated remaining: 52m 49s. Rate: 6.8 symbols/min [2025-09-18T21:54:16.492547] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:54:16.505203] [DEBUG] [LOCAL ] STRV: Loaded 11738 existing records from primary storage. [2025-09-18T21:54:16.505312] [INFO ] [MAIN ] STRV: Loaded 11738 existing records. [2025-09-18T21:54:16.537573] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-09-18T21:54:16.694878] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:54:16.695149] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-09-18T21:54:16.695201] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-09-18T21:54:16.695692] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-09-18T21:54:16.695755] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-09-18T21:54:17.077182] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:54:17.319585] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-11. [2025-09-18T21:54:17.627662] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-09-18T21:54:17.969875] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-18T21:54:18.024107] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-18T21:54:18.123888] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-09-18T21:54:18.130748] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-11 (2.41 seconds). [2025-09-18T21:54:18.919557] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-09-18T21:54:19.719601] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-09-18T21:54:20.011921] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-18T21:54:20.029826] [INFO ] [REMOTE ] STM: Full fetch complete (77361 records). [2025-09-18T21:54:20.030904] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T21:54:20.030514] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-09-18T21:54:20.440948] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-09-18T21:54:20.441138] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-09-18T21:54:20.442231] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-09-18T21:54:20.442296] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-09-18T21:54:20.443763] [DEBUG] [LOCAL ] STM: Trimmed 77361 records to 53979 (keeping 200 days of data) [2025-09-18T21:54:20.536987] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-09-18T21:54:20.787081] [DEBUG] [LOCAL ] STM: Primary data saved (53979 records). [2025-09-18T21:54:20.787227] [INFO ] [MAIN ] STM: Full history saved. [2025-09-18T21:54:20.787316] [INFO ] [MAIN ] Update Progress: 2012/2372 symbols completed. STM took 42.3s. Estimated remaining: 52m 39s. Rate: 6.8 symbols/min [2025-09-18T21:54:20.960343] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:54:21.011349] [DEBUG] [LOCAL ] STT: Loaded 51245 existing records from primary storage. [2025-09-18T21:54:21.011560] [INFO ] [MAIN ] STT: Loaded 51245 existing records. [2025-09-18T21:54:21.200349] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:54:21.201116] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-09-18T21:54:21.201369] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-09-18T21:54:21.207688] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-09-18T21:54:21.213273] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-18T21:54:21.212942] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-09-18T21:54:21.320554] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-09-18T21:54:21.505812] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-18T21:54:21.623199] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:54:22.119558] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-09-18T21:54:22.237560] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-18T21:54:22.679209] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-18T21:54:22.919553] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-09-18T21:54:23.665535] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-18T21:54:23.719509] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-09-18T21:54:24.519553] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-09-18T21:54:24.553183] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-18T21:54:25.319574] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-09-18T21:54:25.431590] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-18T21:54:26.119542] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-09-18T21:54:26.928369] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-09-18T21:54:26.935374] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-18T21:54:26.956506] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-18T21:54:27.719578] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-09-18T21:54:27.860865] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-18T21:54:28.301951] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-18T21:54:28.519572] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-09-18T21:54:29.319554] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-09-18T21:54:29.781510] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-18T21:54:30.119556] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-11. [2025-09-18T21:54:30.401273] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-18T21:54:30.405014] [INFO ] [REMOTE ] STN: Full fetch complete (32161 records). [2025-09-18T21:54:30.405178] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-09-18T21:54:30.783388] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-09-18T21:54:30.783533] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-09-18T21:54:30.784770] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-09-18T21:54:30.784848] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-09-18T21:54:30.786093] [DEBUG] [LOCAL ] STN: Trimmed 32161 records to 23348 (keeping 200 days of data) [2025-09-18T21:54:30.923600] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-09-18T21:54:30.938625] [DEBUG] [LOCAL ] STN: Primary data saved (23348 records). [2025-09-18T21:54:30.938769] [INFO ] [MAIN ] STN: Full history saved. [2025-09-18T21:54:30.938897] [INFO ] [MAIN ] Update Progress: 2013/2372 symbols completed. STN took 29.0s. Estimated remaining: 52m 31s. Rate: 6.8 symbols/min [2025-09-18T21:54:31.112676] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:54:31.112859] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-09-18T21:54:31.112897] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-09-18T21:54:31.113084] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-09-18T21:54:31.113137] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-18T21:54:31.113180] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-18T21:54:31.113212] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-09-18T21:54:31.495474] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:54:31.719543] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-11. [2025-09-18T21:54:32.514991] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:54:32.515359] [WARN ] [REMOTE ] STUB: No data returned for month 2024-11 [2025-09-18T21:54:32.519519] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-09-18T21:54:33.093618] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-11 (2.97 seconds). [2025-09-18T21:54:33.120023] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-18T21:54:33.250364] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-18T21:54:33.319610] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-09-18T21:54:34.119556] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-09-18T21:54:34.919579] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-09-18T21:54:35.067278] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-18T21:54:35.441013] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-18T21:54:35.471826] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-18T21:54:35.719576] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-09-18T21:54:35.936446] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:54:35.936856] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-09-18T21:54:36.519623] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-01. [2025-09-18T21:54:36.729254] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:54:36.730489] [WARN ] [REMOTE ] STUB: No data returned for month 2025-01 [2025-09-18T21:54:37.319573] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-02. [2025-09-18T21:54:37.558812] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:54:37.559148] [WARN ] [REMOTE ] STUB: No data returned for month 2025-02 [2025-09-18T21:54:38.119567] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-09-18T21:54:38.919552] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-09-18T21:54:39.461992] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-18T21:54:39.674122] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-18T21:54:39.676021] [INFO ] [REMOTE ] STRV: Full fetch complete (18652 records). [2025-09-18T21:54:39.676094] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-09-18T21:54:39.729998] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-09-18T21:54:40.054603] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-09-18T21:54:40.054717] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-09-18T21:54:40.055147] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-09-18T21:54:40.055189] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-09-18T21:54:40.055855] [DEBUG] [LOCAL ] STRV: Trimmed 18652 records to 11795 (keeping 200 days of data) [2025-09-18T21:54:40.130595] [DEBUG] [LOCAL ] STRV: Primary data saved (11795 records). [2025-09-18T21:54:40.130770] [INFO ] [MAIN ] STRV: Full history saved. [2025-09-18T21:54:40.130866] [INFO ] [MAIN ] Update Progress: 2014/2372 symbols completed. STRV took 23.8s. Estimated remaining: 52m 22s. Rate: 6.8 symbols/min [2025-09-18T21:54:40.310162] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:54:40.340946] [DEBUG] [LOCAL ] STVN: Loaded 26565 existing records from primary storage. [2025-09-18T21:54:40.341112] [INFO ] [MAIN ] STVN: Loaded 26565 existing records. [2025-09-18T21:54:40.527779] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-09-18T21:54:40.528030] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:54:40.528401] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-09-18T21:54:40.528494] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-09-18T21:54:40.530540] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-09-18T21:54:40.530728] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-09-18T21:54:40.896102] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:54:41.319526] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-11. [2025-09-18T21:54:41.398683] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-18T21:54:42.119527] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-09-18T21:54:42.195428] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-18T21:54:42.487537] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-18T21:54:42.919556] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-09-18T21:54:43.604963] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-18T21:54:43.719553] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-03. [2025-09-18T21:54:43.810297] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-18T21:54:43.957839] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:54:43.958222] [WARN ] [REMOTE ] STUB: No data returned for month 2025-03 [2025-09-18T21:54:44.519561] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-09-18T21:54:45.319582] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-09-18T21:54:45.762402] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-18T21:54:46.119556] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-09-18T21:54:46.740783] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-18T21:54:46.868027] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-18T21:54:46.919526] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-09-18T21:54:47.719530] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-09-18T21:54:47.909515] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-18T21:54:48.519547] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-04. [2025-09-18T21:54:48.766460] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:54:48.766871] [WARN ] [REMOTE ] STUB: No data returned for month 2025-04 [2025-09-18T21:54:49.241636] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T21:54:49.248635] [INFO ] [REMOTE ] STNG: Full fetch complete (64331 records). [2025-09-18T21:54:49.248823] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-09-18T21:54:49.324637] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-05. [2025-09-18T21:54:49.633843] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:54:49.654905] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-09-18T21:54:49.651511] [WARN ] [REMOTE ] STUB: No data returned for month 2025-05 [2025-09-18T21:54:49.655377] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-09-18T21:54:49.656875] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-09-18T21:54:49.656964] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-09-18T21:54:49.664010] [DEBUG] [LOCAL ] STNG: Trimmed 64331 records to 44534 (keeping 200 days of data) [2025-09-18T21:54:49.954941] [DEBUG] [LOCAL ] STNG: Primary data saved (44534 records). [2025-09-18T21:54:49.955106] [INFO ] [MAIN ] STNG: Full history saved. [2025-09-18T21:54:49.955309] [INFO ] [MAIN ] Update Progress: 2015/2372 symbols completed. STNG took 38.7s. Estimated remaining: 52m 14s. Rate: 6.8 symbols/min [2025-09-18T21:54:50.133804] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-06. [2025-09-18T21:54:50.137565] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:54:50.194820] [DEBUG] [LOCAL ] STWD: Loaded 51899 existing records from primary storage. [2025-09-18T21:54:50.194973] [INFO ] [MAIN ] STWD: Loaded 51899 existing records. [2025-09-18T21:54:50.449048] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:54:50.454337] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:54:50.454728] [WARN ] [REMOTE ] STUB: No data returned for month 2025-06 [2025-09-18T21:54:50.455236] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-09-18T21:54:50.455294] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-09-18T21:54:50.456702] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-09-18T21:54:50.456763] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-09-18T21:54:50.822724] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:54:50.919507] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-11. [2025-09-18T21:54:51.719555] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-09-18T21:54:52.418879] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-18T21:54:52.519550] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-07. [2025-09-18T21:54:52.752386] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:54:52.752728] [WARN ] [REMOTE ] STUB: No data returned for month 2025-07 [2025-09-18T21:54:53.319549] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-08. [2025-09-18T21:54:53.531615] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T21:54:53.534802] [WARN ] [REMOTE ] STUB: No data returned for month 2025-08 [2025-09-18T21:54:53.536866] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-18T21:54:54.119557] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-09-18T21:54:54.919541] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-09-18T21:54:55.689320] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T21:54:55.719491] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-09-18T21:54:55.847998] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-18T21:54:56.519549] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-09-18T21:54:57.319552] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-09-18T21:54:57.512585] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-18T21:54:58.078810] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-18T21:54:58.110485] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-18T21:54:58.119485] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-09-18T21:54:58.919574] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-09-18T21:54:59.255817] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-18T21:54:59.719559] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-09-18T21:55:00.526472] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-09. [2025-09-18T21:55:00.531945] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-18T21:55:01.032123] [INFO ] [REMOTE ] STUB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-18T21:55:01.034217] [INFO ] [REMOTE ] STUB: Full fetch complete (615 records). [2025-09-18T21:55:01.034350] [DEBUG] [VALIDATOR ] STUB: Validating primary data. [2025-09-18T21:55:01.238256] [WARN ] [VALIDATOR ] STUB: Validation failed - insufficient historical data. Have 2 unique days, need 200 days [2025-09-18T21:55:01.238503] [FATAL] [MAIN ] STUB: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:55:01.238575] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:55:01.238726] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-18T21:55:01.238811] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-18T21:55:01.238852] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-09-18T21:55:01.238911] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-09-18T21:55:01.239015] [INFO ] [MAIN ] Update Progress: 2016/2372 symbols completed. STUB took 30.3s. Estimated remaining: 52m 5s. Rate: 6.8 symbols/min [2025-09-18T21:55:01.324621] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-09-18T21:55:01.425541] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:55:01.431375] [DEBUG] [LOCAL ] STXD: Loaded 1353 existing records from primary storage. [2025-09-18T21:55:01.431480] [INFO ] [MAIN ] STXD: Loaded 1353 existing records. [2025-09-18T21:55:01.637322] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:55:01.638147] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-09-18T21:55:01.638305] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-09-18T21:55:01.648906] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-09-18T21:55:01.669675] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-09-18T21:55:01.753913] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-18T21:55:02.056450] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:55:02.119536] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-09-18T21:55:02.919569] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-09-18T21:55:03.003902] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-18T21:55:03.400020] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-18T21:55:03.719587] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-09-18T21:55:04.452573] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-18T21:55:04.519532] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-09-18T21:55:04.627495] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-18T21:55:05.319551] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-11. [2025-09-18T21:55:05.782588] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-18T21:55:06.119548] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-09-18T21:55:06.238967] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-18T21:55:06.390715] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-09-18T21:55:06.919549] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-09-18T21:55:07.719566] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-09-18T21:55:08.124816] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-18T21:55:08.129804] [INFO ] [REMOTE ] STVN: Full fetch complete (39338 records). [2025-09-18T21:55:08.129926] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-09-18T21:55:08.526593] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-09-18T21:55:08.545084] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-09-18T21:55:08.545202] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-09-18T21:55:08.546051] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-09-18T21:55:08.546238] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-09-18T21:55:08.547346] [DEBUG] [LOCAL ] STVN: Trimmed 39338 records to 26785 (keeping 200 days of data) [2025-09-18T21:55:08.727440] [DEBUG] [LOCAL ] STVN: Primary data saved (26785 records). [2025-09-18T21:55:08.727595] [INFO ] [MAIN ] STVN: Full history saved. [2025-09-18T21:55:08.727746] [INFO ] [MAIN ] Update Progress: 2017/2372 symbols completed. STVN took 28.6s. Estimated remaining: 51m 56s. Rate: 6.8 symbols/min [2025-09-18T21:55:08.896620] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:55:08.901371] [DEBUG] [LOCAL ] STXE: Loaded 2251 existing records from primary storage. [2025-09-18T21:55:08.901463] [INFO ] [MAIN ] STXE: Loaded 2251 existing records. [2025-09-18T21:55:09.076715] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:55:09.077005] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-09-18T21:55:09.077053] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-09-18T21:55:09.077271] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-09-18T21:55:09.077336] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-09-18T21:55:09.326776] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-09-18T21:55:09.443322] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:55:09.483308] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-18T21:55:09.769298] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-18T21:55:10.119549] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-09-18T21:55:10.302617] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-18T21:55:10.919575] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-11. [2025-09-18T21:55:11.280626] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-11 (0.36 seconds). [2025-09-18T21:55:11.558101] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-18T21:55:11.719614] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-09-18T21:55:12.183890] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-18T21:55:12.519593] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-09-18T21:55:13.319579] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-09-18T21:55:13.748866] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-18T21:55:14.064215] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-18T21:55:14.119557] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-09-18T21:55:14.507459] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-18T21:55:14.919553] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-09-18T21:55:15.405054] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-18T21:55:15.719557] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-09-18T21:55:16.187662] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-18T21:55:16.519563] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-09-18T21:55:16.972613] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-18T21:55:17.319563] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-09-18T21:55:18.023618] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-18T21:55:18.034120] [INFO ] [REMOTE ] STT: Full fetch complete (74535 records). [2025-09-18T21:55:18.034268] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-09-18T21:55:18.124725] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-09-18T21:55:18.431723] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-09-18T21:55:18.431830] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-09-18T21:55:18.432896] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-09-18T21:55:18.432961] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-09-18T21:55:18.435139] [DEBUG] [LOCAL ] STT: Trimmed 74535 records to 51602 (keeping 200 days of data) [2025-09-18T21:55:18.765310] [DEBUG] [LOCAL ] STT: Primary data saved (51602 records). [2025-09-18T21:55:18.765463] [INFO ] [MAIN ] STT: Full history saved. [2025-09-18T21:55:18.765568] [INFO ] [MAIN ] Update Progress: 2018/2372 symbols completed. STT took 58.0s. Estimated remaining: 51m 48s. Rate: 6.8 symbols/min [2025-09-18T21:55:18.932065] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-09-18T21:55:18.934947] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:55:18.940517] [DEBUG] [LOCAL ] STXG: Loaded 2661 existing records from primary storage. [2025-09-18T21:55:18.940605] [INFO ] [MAIN ] STXG: Loaded 2661 existing records. [2025-09-18T21:55:19.129813] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:55:19.130103] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-09-18T21:55:19.130155] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-09-18T21:55:19.130482] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-09-18T21:55:19.130543] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-09-18T21:55:19.308571] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-18T21:55:19.514177] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:55:19.618254] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-18T21:55:19.719556] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-09-18T21:55:20.519599] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-09-18T21:55:21.056269] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-18T21:55:21.260935] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-18T21:55:21.319499] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-09-18T21:55:22.119588] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-09-18T21:55:22.449987] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-18T21:55:22.919565] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-09-18T21:55:23.198186] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-18T21:55:23.212503] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-18T21:55:23.719585] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-11. [2025-09-18T21:55:24.077118] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-11 (0.36 seconds). [2025-09-18T21:55:24.519602] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-09-18T21:55:25.319596] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-09-18T21:55:25.792736] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-18T21:55:26.015157] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-18T21:55:26.028350] [INFO ] [REMOTE ] STWD: Full fetch complete (74744 records). [2025-09-18T21:55:26.028614] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-09-18T21:55:26.124854] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-09-18T21:55:26.563564] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-09-18T21:55:26.563750] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-09-18T21:55:26.565429] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-09-18T21:55:26.565521] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-09-18T21:55:26.567727] [DEBUG] [LOCAL ] STWD: Trimmed 74744 records to 52277 (keeping 200 days of data) [2025-09-18T21:55:26.706529] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-18T21:55:26.919631] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-09-18T21:55:26.946342] [DEBUG] [LOCAL ] STWD: Primary data saved (52277 records). [2025-09-18T21:55:26.946514] [INFO ] [MAIN ] STWD: Full history saved. [2025-09-18T21:55:26.946639] [INFO ] [MAIN ] Update Progress: 2019/2372 symbols completed. STWD took 37.0s. Estimated remaining: 51m 39s. Rate: 6.8 symbols/min [2025-09-18T21:55:27.125935] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:55:27.129333] [DEBUG] [LOCAL ] STXK: Loaded 1526 existing records from primary storage. [2025-09-18T21:55:27.129411] [INFO ] [MAIN ] STXK: Loaded 1526 existing records. [2025-09-18T21:55:27.294206] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-18T21:55:27.302042] [INFO ] [REMOTE ] STXD: Full fetch complete (2084 records). [2025-09-18T21:55:27.302137] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-09-18T21:55:27.330258] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:55:27.394941] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-09-18T21:55:27.408877] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-09-18T21:55:27.435064] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-09-18T21:55:27.438507] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-09-18T21:55:27.729518] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-09-18T21:55:28.060938] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-09-18T21:55:28.061362] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-09-18T21:55:28.061511] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-09-18T21:55:28.061592] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-09-18T21:55:28.072778] [DEBUG] [LOCAL ] STXD: Trimmed 2084 records to 1374 (keeping 200 days of data) [2025-09-18T21:55:28.150372] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:55:28.153413] [DEBUG] [LOCAL ] STXD: Primary data saved (1374 records). [2025-09-18T21:55:28.153551] [INFO ] [MAIN ] STXD: Full history saved. [2025-09-18T21:55:28.153664] [INFO ] [MAIN ] Update Progress: 2020/2372 symbols completed. STXD took 26.9s. Estimated remaining: 51m 29s. Rate: 6.8 symbols/min [2025-09-18T21:55:28.261876] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-18T21:55:28.331496] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:55:28.331630] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-09-18T21:55:28.331700] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-09-18T21:55:28.331853] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-09-18T21:55:28.331902] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-18T21:55:28.331978] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-18T21:55:28.332051] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-09-18T21:55:28.524723] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-09-18T21:55:28.694553] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:55:29.111921] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-18T21:55:29.319582] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-09-18T21:55:29.684763] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-18T21:55:30.119562] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-11. [2025-09-18T21:55:30.528691] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-11 (0.41 seconds). [2025-09-18T21:55:30.919552] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-09-18T21:55:31.514758] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-18T21:55:31.719547] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-09-18T21:55:32.285201] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-18T21:55:32.519568] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-09-18T21:55:32.977752] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-18T21:55:33.319601] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-11. [2025-09-18T21:55:33.851996] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-18T21:55:34.119551] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-09-18T21:55:34.476765] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-18T21:55:34.919555] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-09-18T21:55:35.380712] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-18T21:55:35.719555] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-09-18T21:55:36.303478] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-18T21:55:36.519583] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-09-18T21:55:36.888601] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-18T21:55:37.319577] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-09-18T21:55:37.702757] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-18T21:55:38.119550] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-09-18T21:55:38.465775] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-18T21:55:38.919556] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-09-18T21:55:39.247564] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-18T21:55:39.719554] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-09-18T21:55:40.160147] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-18T21:55:40.519543] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-09-18T21:55:41.018484] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-18T21:55:41.319578] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-09-18T21:55:41.788813] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-18T21:55:42.119545] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-09-18T21:55:42.496131] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-18T21:55:42.919570] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-09-18T21:55:43.274977] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-18T21:55:43.719586] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-09-18T21:55:44.101521] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-18T21:55:44.102561] [INFO ] [REMOTE ] STXE: Full fetch complete (3709 records). [2025-09-18T21:55:44.102635] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-09-18T21:55:44.523460] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-09-18T21:55:44.523883] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-09-18T21:55:44.524054] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-09-18T21:55:44.525224] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-09-18T21:55:44.525285] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-09-18T21:55:44.525722] [DEBUG] [LOCAL ] STXE: Trimmed 3709 records to 2267 (keeping 200 days of data) [2025-09-18T21:55:44.541048] [DEBUG] [LOCAL ] STXE: Primary data saved (2267 records). [2025-09-18T21:55:44.541130] [INFO ] [MAIN ] STXE: Full history saved. [2025-09-18T21:55:44.541208] [INFO ] [MAIN ] Update Progress: 2021/2372 symbols completed. STXE took 35.8s. Estimated remaining: 51m 21s. Rate: 6.8 symbols/min [2025-09-18T21:55:44.720861] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:55:44.726029] [DEBUG] [LOCAL ] STXT: Loaded 2617 existing records from primary storage. [2025-09-18T21:55:44.726110] [INFO ] [MAIN ] STXT: Loaded 2617 existing records. [2025-09-18T21:55:44.908037] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:55:44.908336] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-09-18T21:55:44.908391] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-09-18T21:55:44.908625] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-09-18T21:55:44.908709] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-09-18T21:55:45.019173] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-18T21:55:45.270569] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:55:45.319498] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-11. [2025-09-18T21:55:45.878756] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-18T21:55:46.119537] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-09-18T21:55:46.465403] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-18T21:55:46.919581] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-09-18T21:55:47.486596] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-18T21:55:47.719551] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-09-18T21:55:48.082302] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-18T21:55:48.519558] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-09-18T21:55:49.013931] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-18T21:55:49.319550] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-09-18T21:55:49.796971] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-18T21:55:50.119565] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-09-18T21:55:50.657335] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-18T21:55:50.919549] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-09-18T21:55:51.273602] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-18T21:55:51.719564] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-09-18T21:55:52.146488] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-18T21:55:52.519538] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-09-18T21:55:53.008261] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-18T21:55:53.319552] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-09-18T21:55:53.656003] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-18T21:55:54.119561] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-09-18T21:55:54.480466] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-18T21:55:54.919541] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-09-18T21:55:55.431305] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-18T21:55:55.719552] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-09-18T21:55:56.100583] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-18T21:55:56.519550] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-09-18T21:55:57.019349] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-18T21:55:57.319554] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-09-18T21:55:57.701536] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-18T21:55:58.119601] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-18T21:55:58.429917] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-18T21:55:58.430698] [INFO ] [REMOTE ] STXM: Full fetch complete (1467 records). [2025-09-18T21:55:58.430771] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-09-18T21:55:58.610590] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-18T21:55:58.610793] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-09-18T21:55:58.610862] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-09-18T21:55:58.610933] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-18T21:55:58.610998] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-18T21:55:58.611035] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-09-18T21:55:58.611091] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-09-18T21:55:58.611172] [INFO ] [MAIN ] Update Progress: 2022/2372 symbols completed. STXM took 30.5s. Estimated remaining: 51m 13s. Rate: 6.8 symbols/min [2025-09-18T21:55:58.783340] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:55:58.788165] [DEBUG] [LOCAL ] STXV: Loaded 1694 existing records from primary storage. [2025-09-18T21:55:58.788304] [INFO ] [MAIN ] STXV: Loaded 1694 existing records. [2025-09-18T21:55:58.928317] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-09-18T21:55:58.970813] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:55:58.971088] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-09-18T21:55:58.971138] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-09-18T21:55:58.971358] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-09-18T21:55:58.971420] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-09-18T21:55:59.345298] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:55:59.419142] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-18T21:55:59.719577] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-09-18T21:56:00.061891] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-18T21:56:00.062857] [INFO ] [REMOTE ] STXG: Full fetch complete (4216 records). [2025-09-18T21:56:00.062929] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-09-18T21:56:00.433583] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-09-18T21:56:00.433685] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-09-18T21:56:00.433833] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-09-18T21:56:00.433872] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-09-18T21:56:00.434226] [DEBUG] [LOCAL ] STXG: Trimmed 4216 records to 2693 (keeping 200 days of data) [2025-09-18T21:56:00.450858] [DEBUG] [LOCAL ] STXG: Primary data saved (2693 records). [2025-09-18T21:56:00.450924] [INFO ] [MAIN ] STXG: Full history saved. [2025-09-18T21:56:00.450998] [INFO ] [MAIN ] Update Progress: 2023/2372 symbols completed. STXG took 41.7s. Estimated remaining: 51m 3s. Rate: 6.8 symbols/min [2025-09-18T21:56:00.524792] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-09-18T21:56:00.630525] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:56:00.695042] [DEBUG] [LOCAL ] STZ: Loaded 52272 existing records from primary storage. [2025-09-18T21:56:00.695198] [INFO ] [MAIN ] STZ: Loaded 52272 existing records. [2025-09-18T21:56:00.878267] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:56:00.878506] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-09-18T21:56:00.878555] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-09-18T21:56:00.879874] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-09-18T21:56:00.879935] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-09-18T21:56:00.957892] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-18T21:56:01.247557] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:56:01.319493] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-11. [2025-09-18T21:56:02.119587] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-09-18T21:56:02.536337] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-18T21:56:02.810347] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-18T21:56:02.919533] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-09-18T21:56:03.719554] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-09-18T21:56:04.359792] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-18T21:56:04.513141] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-18T21:56:04.523139] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-09-18T21:56:04.987052] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-18T21:56:05.319539] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-09-18T21:56:06.119550] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-09-18T21:56:06.511799] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-18T21:56:06.512807] [INFO ] [REMOTE ] STXT: Full fetch complete (4069 records). [2025-09-18T21:56:06.512879] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-09-18T21:56:06.893840] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-09-18T21:56:06.893924] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-09-18T21:56:06.894054] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-09-18T21:56:06.894092] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-09-18T21:56:06.894477] [DEBUG] [LOCAL ] STXT: Trimmed 4069 records to 2644 (keeping 200 days of data) [2025-09-18T21:56:06.911390] [DEBUG] [LOCAL ] STXT: Primary data saved (2644 records). [2025-09-18T21:56:06.911458] [INFO ] [MAIN ] STXT: Full history saved. [2025-09-18T21:56:06.911542] [INFO ] [MAIN ] Update Progress: 2024/2372 symbols completed. STXT took 22.4s. Estimated remaining: 50m 54s. Rate: 6.8 symbols/min [2025-09-18T21:56:06.924709] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-09-18T21:56:07.085890] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:56:07.137864] [DEBUG] [LOCAL ] SU: Loaded 53469 existing records from primary storage. [2025-09-18T21:56:07.138007] [INFO ] [MAIN ] SU: Loaded 53469 existing records. [2025-09-18T21:56:07.320174] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:56:07.320605] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-09-18T21:56:07.320784] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-09-18T21:56:07.322184] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-09-18T21:56:07.322246] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-09-18T21:56:07.417134] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-18T21:56:07.543376] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-18T21:56:07.735262] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-09-18T21:56:07.776902] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:56:08.125873] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-18T21:56:08.126728] [INFO ] [REMOTE ] STXK: Full fetch complete (2434 records). [2025-09-18T21:56:08.126802] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-09-18T21:56:08.501174] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-09-18T21:56:08.501256] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-09-18T21:56:08.501362] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-09-18T21:56:08.501403] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-09-18T21:56:08.501799] [DEBUG] [LOCAL ] STXK: Trimmed 2434 records to 1540 (keeping 200 days of data) [2025-09-18T21:56:08.511518] [DEBUG] [LOCAL ] STXK: Primary data saved (1540 records). [2025-09-18T21:56:08.511585] [INFO ] [MAIN ] STXK: Full history saved. [2025-09-18T21:56:08.511682] [INFO ] [MAIN ] Update Progress: 2025/2372 symbols completed. STXK took 41.6s. Estimated remaining: 50m 44s. Rate: 6.8 symbols/min [2025-09-18T21:56:08.524754] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-11. [2025-09-18T21:56:08.691898] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:56:08.739238] [DEBUG] [LOCAL ] SUI: Loaded 42310 existing records from primary storage. [2025-09-18T21:56:08.739388] [INFO ] [MAIN ] SUI: Loaded 42310 existing records. [2025-09-18T21:56:08.933984] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:56:08.934275] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-09-18T21:56:08.934335] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-09-18T21:56:08.935618] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-09-18T21:56:08.935727] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-09-18T21:56:09.048006] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-18T21:56:09.310762] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:56:09.319501] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-11. [2025-09-18T21:56:10.119553] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-09-18T21:56:10.617794] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-18T21:56:10.682785] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-18T21:56:10.919590] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-09-18T21:56:11.305263] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-18T21:56:11.719554] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-09-18T21:56:12.519595] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-11. [2025-09-18T21:56:13.063443] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T21:56:13.319545] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-09-18T21:56:14.119560] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-09-18T21:56:14.369200] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-18T21:56:14.424756] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-18T21:56:14.654119] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-18T21:56:14.919550] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-09-18T21:56:15.719626] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-09-18T21:56:16.519733] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-09-18T21:56:16.725920] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-18T21:56:17.047859] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T21:56:17.319560] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-09-18T21:56:18.119533] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-09-18T21:56:18.331102] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-18T21:56:18.458288] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-18T21:56:18.618294] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-18T21:56:18.919596] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-09-18T21:56:19.719587] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-09-18T21:56:20.447524] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-18T21:56:20.519515] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-09-18T21:56:21.319564] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-09-18T21:56:21.522791] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-18T21:56:21.799087] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-18T21:56:22.119595] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-09-18T21:56:22.574280] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-18T21:56:22.639925] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-18T21:56:22.919563] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-09-18T21:56:23.719554] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-09-18T21:56:24.519560] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-09-18T21:56:25.012627] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-18T21:56:25.210156] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T21:56:25.319558] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-09-18T21:56:25.718099] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-18T21:56:26.119551] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-09-18T21:56:26.919547] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-09-18T21:56:27.039673] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-18T21:56:27.719623] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-09-18T21:56:28.059784] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-18T21:56:28.519610] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-09-18T21:56:28.612623] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-18T21:56:29.319693] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-09-18T21:56:29.730526] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-18T21:56:29.870240] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-18T21:56:30.119554] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-09-18T21:56:30.928974] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-09-18T21:56:30.934897] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-18T21:56:31.282503] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-18T21:56:31.719548] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-09-18T21:56:32.075522] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-18T21:56:32.142364] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-18T21:56:32.519545] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-09-18T21:56:33.319552] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-09-18T21:56:33.841702] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-18T21:56:33.847779] [INFO ] [REMOTE ] SUI: Full fetch complete (61071 records). [2025-09-18T21:56:33.847900] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-09-18T21:56:34.124798] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-09-18T21:56:34.247714] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-09-18T21:56:34.247847] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-09-18T21:56:34.248837] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-09-18T21:56:34.248905] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-09-18T21:56:34.251057] [DEBUG] [LOCAL ] SUI: Trimmed 61071 records to 42541 (keeping 200 days of data) [2025-09-18T21:56:34.525777] [DEBUG] [LOCAL ] SUI: Primary data saved (42541 records). [2025-09-18T21:56:34.525913] [INFO ] [MAIN ] SUI: Full history saved. [2025-09-18T21:56:34.526013] [INFO ] [MAIN ] Update Progress: 2026/2372 symbols completed. SUI took 26.0s. Estimated remaining: 50m 38s. Rate: 6.8 symbols/min [2025-09-18T21:56:34.694558] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:56:34.731202] [DEBUG] [LOCAL ] SUN: Loaded 37221 existing records from primary storage. [2025-09-18T21:56:34.731358] [INFO ] [MAIN ] SUN: Loaded 37221 existing records. [2025-09-18T21:56:34.911614] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:56:34.911899] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-09-18T21:56:34.911965] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-09-18T21:56:34.913067] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-09-18T21:56:34.913126] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-09-18T21:56:34.944436] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-09-18T21:56:35.269712] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:56:35.406680] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-18T21:56:35.543833] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-18T21:56:35.719579] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-11. [2025-09-18T21:56:35.973793] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-18T21:56:36.519561] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-09-18T21:56:37.183589] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-18T21:56:37.319616] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-09-18T21:56:38.119566] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-09-18T21:56:38.325532] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-18T21:56:38.461140] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-18T21:56:38.462065] [INFO ] [REMOTE ] STXV: Full fetch complete (2640 records). [2025-09-18T21:56:38.462136] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-09-18T21:56:38.836490] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-09-18T21:56:38.836609] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-09-18T21:56:38.836805] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-09-18T21:56:38.836959] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-09-18T21:56:38.837579] [DEBUG] [LOCAL ] STXV: Trimmed 2640 records to 1704 (keeping 200 days of data) [2025-09-18T21:56:38.852476] [DEBUG] [LOCAL ] STXV: Primary data saved (1704 records). [2025-09-18T21:56:38.852679] [INFO ] [MAIN ] STXV: Full history saved. [2025-09-18T21:56:38.852818] [INFO ] [MAIN ] Update Progress: 2027/2372 symbols completed. STXV took 40.2s. Estimated remaining: 50m 29s. Rate: 6.8 symbols/min [2025-09-18T21:56:38.924635] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-09-18T21:56:39.118801] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-18T21:56:39.117035] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:56:39.202423] [DEBUG] [LOCAL ] SUPV: Loaded 46929 existing records from primary storage. [2025-09-18T21:56:39.202564] [INFO ] [MAIN ] SUPV: Loaded 46929 existing records. [2025-09-18T21:56:39.391782] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:56:39.392209] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-09-18T21:56:39.392268] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-09-18T21:56:39.393632] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-09-18T21:56:39.393740] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-09-18T21:56:39.724693] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-09-18T21:56:39.754327] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:56:40.444746] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-18T21:56:40.519524] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-09-18T21:56:41.319568] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-11. [2025-09-18T21:56:41.539955] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-18T21:56:41.755578] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-18T21:56:42.119559] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-09-18T21:56:42.626021] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-18T21:56:42.919544] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-09-18T21:56:43.222562] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-18T21:56:43.230272] [INFO ] [REMOTE ] STZ: Full fetch complete (75514 records). [2025-09-18T21:56:43.230422] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-09-18T21:56:43.646489] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-09-18T21:56:43.646778] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-09-18T21:56:43.647975] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-09-18T21:56:43.648085] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-09-18T21:56:43.650105] [DEBUG] [LOCAL ] STZ: Trimmed 75514 records to 52658 (keeping 200 days of data) [2025-09-18T21:56:43.734614] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-09-18T21:56:43.778242] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-18T21:56:44.040154] [DEBUG] [LOCAL ] STZ: Primary data saved (52658 records). [2025-09-18T21:56:44.040310] [INFO ] [MAIN ] STZ: Full history saved. [2025-09-18T21:56:44.042503] [INFO ] [MAIN ] Update Progress: 2028/2372 symbols completed. STZ took 43.6s. Estimated remaining: 50m 19s. Rate: 6.8 symbols/min [2025-09-18T21:56:44.232981] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:56:44.283625] [DEBUG] [LOCAL ] SUZ: Loaded 45992 existing records from primary storage. [2025-09-18T21:56:44.283802] [INFO ] [MAIN ] SUZ: Loaded 45992 existing records. [2025-09-18T21:56:44.487042] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:56:44.487349] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-09-18T21:56:44.487420] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-09-18T21:56:44.488512] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-09-18T21:56:44.488576] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-09-18T21:56:44.524612] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-09-18T21:56:44.860519] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:56:45.319518] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-11. [2025-09-18T21:56:45.366839] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-18T21:56:46.125152] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-09-18T21:56:46.138596] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-18T21:56:46.482978] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-18T21:56:46.919543] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-09-18T21:56:47.555684] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T21:56:47.719542] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-09-18T21:56:48.080788] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-18T21:56:48.519557] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-09-18T21:56:49.005207] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-18T21:56:49.319553] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-09-18T21:56:50.118635] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-18T21:56:50.127257] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-09-18T21:56:50.722904] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-18T21:56:50.732385] [INFO ] [REMOTE ] SU: Full fetch complete (77251 records). [2025-09-18T21:56:50.732594] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-09-18T21:56:50.930814] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-09-18T21:56:51.146326] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-09-18T21:56:51.146428] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-09-18T21:56:51.147668] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-09-18T21:56:51.147764] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-09-18T21:56:51.149518] [DEBUG] [LOCAL ] SU: Trimmed 77251 records to 53850 (keeping 200 days of data) [2025-09-18T21:56:51.483343] [DEBUG] [LOCAL ] SU: Primary data saved (53850 records). [2025-09-18T21:56:51.483488] [INFO ] [MAIN ] SU: Full history saved. [2025-09-18T21:56:51.483595] [INFO ] [MAIN ] Update Progress: 2029/2372 symbols completed. SU took 44.6s. Estimated remaining: 50m 10s. Rate: 6.8 symbols/min [2025-09-18T21:56:51.630544] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-18T21:56:51.706356] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:56:51.727058] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-09-18T21:56:51.744104] [DEBUG] [LOCAL ] SVV: Loaded 39382 existing records from primary storage. [2025-09-18T21:56:51.744261] [INFO ] [MAIN ] SVV: Loaded 39382 existing records. [2025-09-18T21:56:51.927118] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:56:51.927402] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-09-18T21:56:51.927454] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-09-18T21:56:51.928288] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-09-18T21:56:51.928351] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-09-18T21:56:52.293742] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:56:52.322328] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-18T21:56:52.519520] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-09-18T21:56:53.180163] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T21:56:53.319544] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-09-18T21:56:54.119567] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-09-18T21:56:54.280557] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-18T21:56:54.360288] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-18T21:56:54.919497] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-09-18T21:56:55.470403] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-18T21:56:55.719573] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-09-18T21:56:56.209867] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-18T21:56:56.519559] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-11. [2025-09-18T21:56:57.076038] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-18T21:56:57.319622] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-09-18T21:56:57.575418] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-18T21:56:58.119593] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-09-18T21:56:58.693355] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T21:56:58.919598] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-09-18T21:56:59.451403] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T21:56:59.719551] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-09-18T21:56:59.972894] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T21:57:00.519544] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-09-18T21:57:01.059296] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T21:57:01.319568] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-09-18T21:57:02.119568] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-09-18T21:57:02.619817] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-18T21:57:02.919565] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-09-18T21:57:03.504998] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-18T21:57:03.719599] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-09-18T21:57:04.519719] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-09-18T21:57:05.041285] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-18T21:57:05.112373] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (2.99 seconds). [2025-09-18T21:57:05.319579] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-09-18T21:57:05.538670] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-18T21:57:05.681678] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-18T21:57:06.119548] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-09-18T21:57:06.596693] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-18T21:57:06.919567] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-09-18T21:57:07.493326] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-18T21:57:07.499784] [INFO ] [REMOTE ] SUZ: Full fetch complete (67029 records). [2025-09-18T21:57:07.499922] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-09-18T21:57:07.724798] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-09-18T21:57:07.919544] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-09-18T21:57:07.919635] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-09-18T21:57:07.920714] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-09-18T21:57:07.920827] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-09-18T21:57:07.925925] [DEBUG] [LOCAL ] SUZ: Trimmed 67029 records to 46263 (keeping 200 days of data) [2025-09-18T21:57:08.057767] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T21:57:08.230982] [DEBUG] [LOCAL ] SUZ: Primary data saved (46263 records). [2025-09-18T21:57:08.231132] [INFO ] [MAIN ] SUZ: Full history saved. [2025-09-18T21:57:08.231293] [INFO ] [MAIN ] Update Progress: 2030/2372 symbols completed. SUZ took 24.2s. Estimated remaining: 50m 3s. Rate: 6.8 symbols/min [2025-09-18T21:57:08.419427] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:57:08.480989] [DEBUG] [LOCAL ] SW: Loaded 53165 existing records from primary storage. [2025-09-18T21:57:08.481180] [INFO ] [MAIN ] SW: Loaded 53165 existing records. [2025-09-18T21:57:08.525236] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-09-18T21:57:08.671532] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:57:08.671893] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-09-18T21:57:08.671948] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-09-18T21:57:08.673171] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-09-18T21:57:08.673245] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-09-18T21:57:09.053803] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:57:09.319555] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-09-18T21:57:09.532001] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-18T21:57:09.914855] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-18T21:57:09.925003] [INFO ] [REMOTE ] SUPV: Full fetch complete (67935 records). [2025-09-18T21:57:09.925143] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-09-18T21:57:10.132606] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-09-18T21:57:10.340329] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-09-18T21:57:10.340435] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-09-18T21:57:10.341498] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-09-18T21:57:10.341582] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-09-18T21:57:10.345947] [DEBUG] [LOCAL ] SUPV: Trimmed 67935 records to 47311 (keeping 200 days of data) [2025-09-18T21:57:10.610752] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-18T21:57:10.696527] [DEBUG] [LOCAL ] SUPV: Primary data saved (47311 records). [2025-09-18T21:57:10.696729] [INFO ] [MAIN ] SUPV: Full history saved. [2025-09-18T21:57:10.698354] [INFO ] [MAIN ] Update Progress: 2031/2372 symbols completed. SUPV took 31.8s. Estimated remaining: 49m 53s. Rate: 6.8 symbols/min [2025-09-18T21:57:10.892214] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:57:10.919598] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-09-18T21:57:10.963566] [DEBUG] [LOCAL ] SWK: Loaded 52532 existing records from primary storage. [2025-09-18T21:57:10.963781] [INFO ] [MAIN ] SWK: Loaded 52532 existing records. [2025-09-18T21:57:11.152893] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:57:11.153164] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-09-18T21:57:11.153226] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-09-18T21:57:11.154349] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-09-18T21:57:11.154410] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-09-18T21:57:11.532328] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:57:11.586421] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T21:57:11.719528] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-09-18T21:57:12.512891] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-18T21:57:12.521783] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-11. [2025-09-18T21:57:12.834740] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T21:57:12.840026] [INFO ] [REMOTE ] SUN: Full fetch complete (54177 records). [2025-09-18T21:57:12.840125] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-09-18T21:57:13.247490] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-09-18T21:57:13.247576] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-09-18T21:57:13.248601] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-09-18T21:57:13.248692] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-09-18T21:57:13.250697] [DEBUG] [LOCAL ] SUN: Trimmed 54177 records to 37520 (keeping 200 days of data) [2025-09-18T21:57:13.324432] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-11. [2025-09-18T21:57:13.511047] [DEBUG] [LOCAL ] SUN: Primary data saved (37520 records). [2025-09-18T21:57:13.511264] [INFO ] [MAIN ] SUN: Full history saved. [2025-09-18T21:57:13.511478] [INFO ] [MAIN ] Update Progress: 2032/2372 symbols completed. SUN took 39.0s. Estimated remaining: 49m 43s. Rate: 6.8 symbols/min [2025-09-18T21:57:13.741711] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:57:13.782615] [DEBUG] [LOCAL ] SWX: Loaded 31355 existing records from primary storage. [2025-09-18T21:57:13.782818] [INFO ] [MAIN ] SWX: Loaded 31355 existing records. [2025-09-18T21:57:13.963781] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:57:13.964057] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-09-18T21:57:13.964107] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-09-18T21:57:13.964965] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-09-18T21:57:13.965030] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-09-18T21:57:14.124702] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-09-18T21:57:14.350276] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:57:14.919533] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-11. [2025-09-18T21:57:14.983146] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-11 (2.46 seconds). [2025-09-18T21:57:15.719583] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-09-18T21:57:15.774943] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-18T21:57:15.842639] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-11 (2.52 seconds). [2025-09-18T21:57:16.292679] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-18T21:57:16.519557] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-09-18T21:57:17.320749] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-09-18T21:57:17.323960] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-18T21:57:17.567786] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-18T21:57:18.119544] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-09-18T21:57:18.208849] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-18T21:57:18.919555] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-09-18T21:57:19.719578] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-09-18T21:57:19.973449] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-18T21:57:20.019542] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-18T21:57:20.519552] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-09-18T21:57:21.182964] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-18T21:57:21.319576] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-09-18T21:57:21.459322] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-18T21:57:22.119549] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-09-18T21:57:22.917116] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-18T21:57:22.926794] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-09-18T21:57:23.144376] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-18T21:57:23.719585] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-09-18T21:57:24.063920] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-18T21:57:24.519598] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-09-18T21:57:25.152710] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-18T21:57:25.319603] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-09-18T21:57:25.672724] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-18T21:57:26.119551] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-09-18T21:57:26.919567] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-09-18T21:57:27.719588] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-09-18T21:57:27.962203] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-09-18T21:57:28.218810] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-18T21:57:28.225564] [INFO ] [REMOTE ] SVV: Full fetch complete (55435 records). [2025-09-18T21:57:28.225721] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-09-18T21:57:28.525933] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-09-18T21:57:28.642138] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-09-18T21:57:28.642236] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-09-18T21:57:28.643260] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-09-18T21:57:28.643329] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-09-18T21:57:28.645017] [DEBUG] [LOCAL ] SVV: Trimmed 55435 records to 39709 (keeping 200 days of data) [2025-09-18T21:57:28.804805] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-18T21:57:28.926039] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-18T21:57:28.969549] [DEBUG] [LOCAL ] SVV: Primary data saved (39709 records). [2025-09-18T21:57:28.969743] [INFO ] [MAIN ] SVV: Full history saved. [2025-09-18T21:57:28.969860] [INFO ] [MAIN ] Update Progress: 2033/2372 symbols completed. SVV took 37.5s. Estimated remaining: 49m 36s. Rate: 6.8 symbols/min [2025-09-18T21:57:29.141874] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:57:29.150187] [DEBUG] [LOCAL ] SWZ: Loaded 6184 existing records from primary storage. [2025-09-18T21:57:29.150302] [INFO ] [MAIN ] SWZ: Loaded 6184 existing records. [2025-09-18T21:57:29.324740] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-09-18T21:57:29.371352] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:57:29.371736] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-09-18T21:57:29.371797] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-09-18T21:57:29.372348] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-09-18T21:57:29.372411] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-09-18T21:57:29.793818] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:57:30.119617] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-11. [2025-09-18T21:57:30.584386] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-18T21:57:30.639420] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-18T21:57:30.715268] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-18T21:57:30.919569] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-09-18T21:57:31.719592] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-09-18T21:57:32.519517] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-09-18T21:57:32.662238] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-18T21:57:33.097172] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-18T21:57:33.296246] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T21:57:33.319521] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-09-18T21:57:34.119575] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-09-18T21:57:34.924744] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-09-18T21:57:34.939432] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-18T21:57:35.719546] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-09-18T21:57:36.136385] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-18T21:57:36.155243] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-18T21:57:36.202307] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-18T21:57:36.519560] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-09-18T21:57:36.979220] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-18T21:57:37.319580] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-09-18T21:57:37.956074] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-18T21:57:38.119522] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-09-18T21:57:38.895423] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-18T21:57:38.919559] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-09-18T21:57:39.719551] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-09-18T21:57:40.327787] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-18T21:57:40.519534] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-09-18T21:57:40.661184] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-18T21:57:41.319544] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-09-18T21:57:42.087042] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-18T21:57:42.119528] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-09-18T21:57:42.181253] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-18T21:57:42.617386] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-18T21:57:42.919559] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-09-18T21:57:43.602620] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-18T21:57:43.719515] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-09-18T21:57:44.519554] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-09-18T21:57:45.066954] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-18T21:57:45.140311] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-18T21:57:45.319557] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-09-18T21:57:46.002571] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-18T21:57:46.010530] [INFO ] [REMOTE ] SWK: Full fetch complete (75226 records). [2025-09-18T21:57:46.010705] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-09-18T21:57:46.124707] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-09-18T21:57:46.420007] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-09-18T21:57:46.420123] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-09-18T21:57:46.421505] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-09-18T21:57:46.421591] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-09-18T21:57:46.423859] [DEBUG] [LOCAL ] SWK: Trimmed 75226 records to 52912 (keeping 200 days of data) [2025-09-18T21:57:46.769715] [DEBUG] [LOCAL ] SWK: Primary data saved (52912 records). [2025-09-18T21:57:46.769887] [INFO ] [MAIN ] SWK: Full history saved. [2025-09-18T21:57:46.770706] [INFO ] [MAIN ] Update Progress: 2034/2372 symbols completed. SWK took 36.1s. Estimated remaining: 49m 28s. Rate: 6.8 symbols/min [2025-09-18T21:57:46.921134] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-09-18T21:57:46.940871] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:57:46.982692] [DEBUG] [LOCAL ] SXC: Loaded 41823 existing records from primary storage. [2025-09-18T21:57:46.982849] [INFO ] [MAIN ] SXC: Loaded 41823 existing records. [2025-09-18T21:57:47.162078] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:57:47.162484] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-09-18T21:57:47.162547] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-09-18T21:57:47.163671] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-09-18T21:57:47.163734] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-09-18T21:57:47.304387] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-18T21:57:47.549981] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:57:47.719521] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-11. [2025-09-18T21:57:48.425524] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T21:57:48.519513] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-09-18T21:57:49.319550] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-09-18T21:57:49.379215] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-18T21:57:49.870862] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-18T21:57:49.872055] [INFO ] [REMOTE ] SWZ: Full fetch complete (8075 records). [2025-09-18T21:57:49.872130] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-09-18T21:57:50.122680] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-09-18T21:57:50.245561] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-09-18T21:57:50.245798] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-09-18T21:57:50.246049] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-09-18T21:57:50.246119] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-09-18T21:57:50.246927] [DEBUG] [LOCAL ] SWZ: Trimmed 8075 records to 6201 (keeping 200 days of data) [2025-09-18T21:57:50.314253] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-18T21:57:50.328055] [DEBUG] [LOCAL ] SWZ: Primary data saved (6201 records). [2025-09-18T21:57:50.328285] [INFO ] [MAIN ] SWZ: Full history saved. [2025-09-18T21:57:50.328381] [INFO ] [MAIN ] Update Progress: 2035/2372 symbols completed. SWZ took 21.4s. Estimated remaining: 49m 19s. Rate: 6.8 symbols/min [2025-09-18T21:57:50.501298] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:57:50.514708] [DEBUG] [LOCAL ] SXI: Loaded 11414 existing records from primary storage. [2025-09-18T21:57:50.514816] [INFO ] [MAIN ] SXI: Loaded 11414 existing records. [2025-09-18T21:57:50.696942] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:57:50.697231] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-09-18T21:57:50.697282] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-09-18T21:57:50.697733] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-09-18T21:57:50.697793] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-09-18T21:57:50.924831] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-09-18T21:57:51.075861] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:57:51.421153] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-18T21:57:51.425899] [INFO ] [REMOTE ] SWX: Full fetch complete (43653 records). [2025-09-18T21:57:51.425999] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-09-18T21:57:51.724713] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-09-18T21:57:51.798262] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-09-18T21:57:51.798332] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-09-18T21:57:51.799092] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-09-18T21:57:51.799159] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-09-18T21:57:51.800413] [DEBUG] [LOCAL ] SWX: Trimmed 43653 records to 31595 (keeping 200 days of data) [2025-09-18T21:57:52.003086] [DEBUG] [LOCAL ] SWX: Primary data saved (31595 records). [2025-09-18T21:57:52.003247] [INFO ] [MAIN ] SWX: Full history saved. [2025-09-18T21:57:52.003351] [INFO ] [MAIN ] Update Progress: 2036/2372 symbols completed. SWX took 38.5s. Estimated remaining: 49m 9s. Rate: 6.8 symbols/min [2025-09-18T21:57:52.172249] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:57:52.202068] [DEBUG] [LOCAL ] SXT: Loaded 28864 existing records from primary storage. [2025-09-18T21:57:52.202201] [INFO ] [MAIN ] SXT: Loaded 28864 existing records. [2025-09-18T21:57:52.377693] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:57:52.377951] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-09-18T21:57:52.377998] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-09-18T21:57:52.378673] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-09-18T21:57:52.378732] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-09-18T21:57:52.527731] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-11. [2025-09-18T21:57:52.744196] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:57:52.798747] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-18T21:57:53.090750] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-18T21:57:53.104708] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-18T21:57:53.319501] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-09-18T21:57:54.119538] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-09-18T21:57:54.673071] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-18T21:57:54.795503] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-18T21:57:54.919568] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-11. [2025-09-18T21:57:55.719560] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-09-18T21:57:55.769466] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-18T21:57:56.367978] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-18T21:57:56.519556] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-09-18T21:57:57.219335] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-18T21:57:57.319550] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-09-18T21:57:58.066912] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-18T21:57:58.119520] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-09-18T21:57:58.919535] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-09-18T21:57:58.929621] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-18T21:57:59.354173] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-18T21:57:59.362681] [INFO ] [REMOTE ] SW: Full fetch complete (76548 records). [2025-09-18T21:57:59.362817] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-09-18T21:57:59.724625] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-09-18T21:57:59.783086] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-09-18T21:57:59.783172] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-09-18T21:57:59.784259] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-09-18T21:57:59.784330] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-09-18T21:57:59.785970] [DEBUG] [LOCAL ] SW: Trimmed 76548 records to 53554 (keeping 200 days of data) [2025-09-18T21:58:00.137294] [DEBUG] [LOCAL ] SW: Primary data saved (53554 records). [2025-09-18T21:58:00.137444] [INFO ] [MAIN ] SW: Full history saved. [2025-09-18T21:58:00.137559] [INFO ] [MAIN ] Update Progress: 2037/2372 symbols completed. SW took 51.9s. Estimated remaining: 48m 60s. Rate: 6.8 symbols/min [2025-09-18T21:58:00.519598] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-09-18T21:58:01.324849] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-09-18T21:58:01.341782] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-18T21:58:01.367415] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-18T21:58:02.119556] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-09-18T21:58:02.210076] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-18T21:58:02.919588] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-09-18T21:58:03.020980] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-18T21:58:03.719547] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-09-18T21:58:04.251453] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-18T21:58:04.471187] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-18T21:58:04.519540] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-09-18T21:58:05.319524] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-09-18T21:58:05.684900] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-18T21:58:05.945304] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-18T21:58:06.119570] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-09-18T21:58:06.919566] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-09-18T21:58:07.686465] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-18T21:58:07.702798] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-18T21:58:07.719515] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-09-18T21:58:08.519633] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-09-18T21:58:08.671134] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-18T21:58:09.319601] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-09-18T21:58:10.015398] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-18T21:58:10.119570] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-09-18T21:58:10.161052] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-18T21:58:10.163711] [INFO ] [REMOTE ] SXI: Full fetch complete (14393 records). [2025-09-18T21:58:10.163797] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-09-18T21:58:10.540754] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-09-18T21:58:10.540870] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-09-18T21:58:10.541233] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-09-18T21:58:10.541276] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-09-18T21:58:10.541995] [DEBUG] [LOCAL ] SXI: Trimmed 14393 records to 11512 (keeping 200 days of data) [2025-09-18T21:58:10.620818] [DEBUG] [LOCAL ] SXI: Primary data saved (11512 records). [2025-09-18T21:58:10.620960] [INFO ] [MAIN ] SXI: Full history saved. [2025-09-18T21:58:10.621048] [INFO ] [MAIN ] Update Progress: 2038/2372 symbols completed. SXI took 20.3s. Estimated remaining: 48m 51s. Rate: 6.8 symbols/min [2025-09-18T21:58:10.919565] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-09-18T21:58:11.646999] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T21:58:11.719554] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-09-18T21:58:12.060629] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-18T21:58:12.519602] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-09-18T21:58:13.186875] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-18T21:58:13.319600] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-09-18T21:58:13.426434] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-18T21:58:14.119565] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-09-18T21:58:14.884995] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-18T21:58:14.919565] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-09-18T21:58:15.342888] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-18T21:58:15.719615] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-09-18T21:58:16.085746] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-18T21:58:16.519565] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-09-18T21:58:16.997494] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-18T21:58:17.319603] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-09-18T21:58:17.525172] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T21:58:17.531139] [INFO ] [REMOTE ] SXC: Full fetch complete (61156 records). [2025-09-18T21:58:17.531253] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-09-18T21:58:17.915262] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-09-18T21:58:17.915343] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-09-18T21:58:17.916306] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-09-18T21:58:17.916369] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-09-18T21:58:17.917915] [DEBUG] [LOCAL ] SXC: Trimmed 61156 records to 42124 (keeping 200 days of data) [2025-09-18T21:58:18.172688] [DEBUG] [LOCAL ] SXC: Primary data saved (42124 records). [2025-09-18T21:58:18.172823] [INFO ] [MAIN ] SXC: Full history saved. [2025-09-18T21:58:18.173422] [INFO ] [MAIN ] Update Progress: 2039/2372 symbols completed. SXC took 31.4s. Estimated remaining: 48m 42s. Rate: 6.8 symbols/min [2025-09-18T21:58:18.427282] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-18T21:58:18.431874] [INFO ] [REMOTE ] SXT: Full fetch complete (37346 records). [2025-09-18T21:58:18.431965] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-09-18T21:58:18.809776] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-09-18T21:58:18.809865] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-09-18T21:58:18.810612] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-09-18T21:58:18.810720] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-09-18T21:58:18.811767] [DEBUG] [LOCAL ] SXT: Trimmed 37346 records to 29141 (keeping 200 days of data) [2025-09-18T21:58:18.994396] [DEBUG] [LOCAL ] SXT: Primary data saved (29141 records). [2025-09-18T21:58:18.994588] [INFO ] [MAIN ] SXT: Full history saved. [2025-09-18T21:58:18.994722] [INFO ] [MAIN ] Update Progress: 2040/2372 symbols completed. SXT took 27.0s. Estimated remaining: 48m 32s. Rate: 6.8 symbols/min [2025-09-18T21:58:19.589208] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:58:19.685740] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:58:19.683207] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:58:19.715950] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:58:19.786497] [DEBUG] [LOCAL ] SYK: Loaded 47145 existing records from primary storage. [2025-09-18T21:58:19.786765] [INFO ] [MAIN ] SYK: Loaded 47145 existing records. [2025-09-18T21:58:19.935819] [DEBUG] [LOCAL ] SYF: Loaded 53466 existing records from primary storage. [2025-09-18T21:58:19.947306] [INFO ] [MAIN ] SYF: Loaded 53466 existing records. [2025-09-18T21:58:20.029268] [DEBUG] [LOCAL ] SYY: Loaded 53252 existing records from primary storage. [2025-09-18T21:58:20.103233] [INFO ] [MAIN ] SYY: Loaded 53252 existing records. [2025-09-18T21:58:20.220446] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-09-18T21:58:20.221066] [INFO ] [MAIN ] T: Loaded 53798 existing records. [2025-09-18T21:58:20.201814] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:58:20.323223] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-09-18T21:58:20.328564] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-09-18T21:58:20.420077] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-09-18T21:58:20.466939] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-09-18T21:58:20.480484] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:58:20.528982] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-09-18T21:58:20.589291] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-09-18T21:58:20.705446] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-09-18T21:58:20.713269] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-09-18T21:58:20.774982] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:58:20.768205] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:58:20.929412] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-09-18T21:58:20.962249] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-09-18T21:58:20.967669] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-09-18T21:58:20.972855] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-09-18T21:58:21.004358] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-09-18T21:58:21.009598] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-09-18T21:58:21.020398] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-09-18T21:58:21.030818] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-09-18T21:58:21.361985] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:58:21.444408] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-11. [2025-09-18T21:58:21.986629] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:58:22.025855] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-11. [2025-09-18T21:58:22.175949] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:58:22.185824] [INFO ] [REMOTE ] T: Fetching primary data for 2024-11. [2025-09-18T21:58:22.211062] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:58:22.212331] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-11. [2025-09-18T21:58:23.452349] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-11 (2.01 seconds). [2025-09-18T21:58:23.464252] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-09-18T21:58:23.544993] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-18T21:58:23.555608] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-09-18T21:58:23.615106] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-18T21:58:23.626066] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-09-18T21:58:24.314802] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-11 (2.13 seconds). [2025-09-18T21:58:24.330942] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-09-18T21:58:25.005926] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-18T21:58:25.018457] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-09-18T21:58:25.049291] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-18T21:58:25.120588] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T21:58:25.319564] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-09-18T21:58:26.119559] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-09-18T21:58:26.599084] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T21:58:26.816174] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-18T21:58:26.869102] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T21:58:26.919596] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-09-18T21:58:27.560618] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-18T21:58:27.719574] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-09-18T21:58:28.296991] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T21:58:28.519588] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-09-18T21:58:29.127030] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T21:58:29.319601] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-09-18T21:58:29.975670] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-18T21:58:30.119596] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-09-18T21:58:30.752596] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-18T21:58:30.919571] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-09-18T21:58:31.719561] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-09-18T21:58:32.519601] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-09-18T21:58:32.656360] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-09-18T21:58:32.759002] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-18T21:58:33.241990] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T21:58:33.319560] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-09-18T21:58:34.104633] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T21:58:34.119500] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-09-18T21:58:34.876269] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-18T21:58:34.919508] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-09-18T21:58:35.712331] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-18T21:58:35.722778] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-09-18T21:58:36.519583] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-09-18T21:58:36.735133] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-18T21:58:37.302107] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T21:58:37.319550] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-09-18T21:58:38.119557] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-09-18T21:58:38.238330] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-18T21:58:38.767286] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-18T21:58:38.919550] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-09-18T21:58:39.719564] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-09-18T21:58:40.241843] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-18T21:58:40.335494] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-18T21:58:40.519566] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-09-18T21:58:41.246776] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-18T21:58:41.319516] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-09-18T21:58:42.119569] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-09-18T21:58:42.680918] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-18T21:58:42.909877] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-18T21:58:42.920868] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-09-18T21:58:43.719558] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-09-18T21:58:43.857033] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-18T21:58:44.458461] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-18T21:58:44.519566] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-09-18T21:58:45.004429] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-18T21:58:45.011508] [INFO ] [REMOTE ] SYK: Full fetch complete (68567 records). [2025-09-18T21:58:45.011700] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-09-18T21:58:45.325852] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-09-18T21:58:45.415238] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-09-18T21:58:45.415463] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-09-18T21:58:45.416581] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-09-18T21:58:45.416718] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-09-18T21:58:45.418586] [DEBUG] [LOCAL ] SYK: Trimmed 68567 records to 47505 (keeping 200 days of data) [2025-09-18T21:58:45.544574] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-18T21:58:45.763427] [DEBUG] [LOCAL ] SYK: Primary data saved (47505 records). [2025-09-18T21:58:45.763580] [INFO ] [MAIN ] SYK: Full history saved. [2025-09-18T21:58:45.763741] [INFO ] [MAIN ] Update Progress: 2041/2372 symbols completed. SYK took 26.8s. Estimated remaining: 48m 27s. Rate: 6.8 symbols/min [2025-09-18T21:58:45.936899] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:58:45.976896] [DEBUG] [LOCAL ] TAC: Loaded 43008 existing records from primary storage. [2025-09-18T21:58:45.977044] [INFO ] [MAIN ] TAC: Loaded 43008 existing records. [2025-09-18T21:58:46.125330] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-09-18T21:58:46.156571] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:58:46.156793] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-09-18T21:58:46.156857] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-09-18T21:58:46.157878] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-09-18T21:58:46.157940] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-09-18T21:58:46.535688] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:58:46.625874] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-18T21:58:46.633493] [INFO ] [REMOTE ] SYF: Full fetch complete (77172 records). [2025-09-18T21:58:46.633694] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-09-18T21:58:46.927821] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-11. [2025-09-18T21:58:47.039156] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-09-18T21:58:47.039253] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-09-18T21:58:47.040438] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-09-18T21:58:47.040508] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-09-18T21:58:47.042187] [DEBUG] [LOCAL ] SYF: Trimmed 77172 records to 53850 (keeping 200 days of data) [2025-09-18T21:58:47.402519] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-18T21:58:47.431225] [DEBUG] [LOCAL ] SYF: Primary data saved (53850 records). [2025-09-18T21:58:47.431384] [INFO ] [MAIN ] SYF: Full history saved. [2025-09-18T21:58:47.431487] [INFO ] [MAIN ] Update Progress: 2042/2372 symbols completed. SYF took 28.4s. Estimated remaining: 48m 17s. Rate: 6.8 symbols/min [2025-09-18T21:58:47.603312] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:58:47.651424] [DEBUG] [LOCAL ] TAK: Loaded 49995 existing records from primary storage. [2025-09-18T21:58:47.651581] [INFO ] [MAIN ] TAK: Loaded 49995 existing records. [2025-09-18T21:58:47.728527] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-09-18T21:58:47.855675] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:58:47.855912] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-09-18T21:58:47.855964] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-09-18T21:58:47.858131] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-09-18T21:58:47.858195] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-09-18T21:58:48.217426] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:58:48.242113] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-18T21:58:48.519543] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-11. [2025-09-18T21:58:49.319526] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-09-18T21:58:49.367157] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T21:58:50.122695] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-09-18T21:58:50.128140] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-18T21:58:50.919539] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-09-18T21:58:51.450167] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-18T21:58:51.458350] [INFO ] [REMOTE ] SYY: Full fetch complete (76816 records). [2025-09-18T21:58:51.458558] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-09-18T21:58:51.728801] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-09-18T21:58:51.777250] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-18T21:58:51.905485] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-09-18T21:58:51.905595] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-09-18T21:58:51.906739] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-09-18T21:58:51.906931] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-09-18T21:58:51.919317] [DEBUG] [LOCAL ] SYY: Trimmed 76816 records to 53641 (keeping 200 days of data) [2025-09-18T21:58:51.941592] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-09-18T21:58:52.286404] [DEBUG] [LOCAL ] SYY: Primary data saved (53641 records). [2025-09-18T21:58:52.286567] [INFO ] [MAIN ] SYY: Full history saved. [2025-09-18T21:58:52.286680] [INFO ] [MAIN ] Update Progress: 2043/2372 symbols completed. SYY took 33.3s. Estimated remaining: 48m 7s. Rate: 6.8 symbols/min [2025-09-18T21:58:52.474703] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:58:52.526723] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-09-18T21:58:52.529803] [DEBUG] [LOCAL ] TAL: Loaded 52163 existing records from primary storage. [2025-09-18T21:58:52.529961] [INFO ] [MAIN ] TAL: Loaded 52163 existing records. [2025-09-18T21:58:52.715491] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:58:52.715913] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-09-18T21:58:52.715986] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-09-18T21:58:52.717085] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-09-18T21:58:52.717167] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-09-18T21:58:53.083018] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:58:53.319558] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-11. [2025-09-18T21:58:53.415711] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-18T21:58:53.916246] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-18T21:58:54.119554] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-09-18T21:58:54.919569] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-09-18T21:58:54.956268] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-18T21:58:55.341074] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T21:58:55.719545] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-09-18T21:58:56.407988] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T21:58:56.519516] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-09-18T21:58:57.059107] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T21:58:57.319590] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-09-18T21:58:58.119605] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-09-18T21:58:58.157448] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-18T21:58:58.611207] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-18T21:58:58.919604] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-09-18T21:58:59.556545] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-18T21:58:59.719586] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-09-18T21:59:00.519602] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-09-18T21:59:01.202531] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-18T21:59:01.323353] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-09-18T21:59:01.331038] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T21:59:01.839566] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-18T21:59:02.119556] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-09-18T21:59:02.919628] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-09-18T21:59:03.345567] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-18T21:59:03.706971] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-18T21:59:03.719491] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-09-18T21:59:04.481308] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-18T21:59:04.519501] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-09-18T21:59:05.115190] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-18T21:59:05.319578] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-09-18T21:59:06.009418] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-18T21:59:06.119540] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-09-18T21:59:06.919554] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-09-18T21:59:07.719553] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-09-18T21:59:07.927082] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-18T21:59:07.998126] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-18T21:59:08.405104] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-18T21:59:08.519564] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-09-18T21:59:08.971840] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T21:59:09.319598] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-09-18T21:59:10.005664] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T21:59:10.119506] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-09-18T21:59:10.919578] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-09-18T21:59:11.122990] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-18T21:59:11.569076] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-18T21:59:11.719565] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-09-18T21:59:12.519550] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-09-18T21:59:13.321242] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-09-18T21:59:13.324382] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-18T21:59:13.361094] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T21:59:14.072186] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-18T21:59:14.119512] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-09-18T21:59:14.682527] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T21:59:14.919548] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-09-18T21:59:15.148424] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-18T21:59:15.154457] [INFO ] [REMOTE ] TAC: Full fetch complete (64198 records). [2025-09-18T21:59:15.154678] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-09-18T21:59:15.735198] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-09-18T21:59:15.731129] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-09-18T21:59:15.735390] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-09-18T21:59:15.737080] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-09-18T21:59:15.738458] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-09-18T21:59:15.740598] [DEBUG] [LOCAL ] TAC: Trimmed 64198 records to 43355 (keeping 200 days of data) [2025-09-18T21:59:16.099420] [DEBUG] [LOCAL ] TAC: Primary data saved (43355 records). [2025-09-18T21:59:16.099599] [INFO ] [MAIN ] TAC: Full history saved. [2025-09-18T21:59:16.099791] [INFO ] [MAIN ] Update Progress: 2044/2372 symbols completed. TAC took 30.3s. Estimated remaining: 48m 1s. Rate: 6.8 symbols/min [2025-09-18T21:59:16.309518] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:59:16.335605] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-18T21:59:16.343919] [INFO ] [REMOTE ] T: Full fetch complete (77910 records). [2025-09-18T21:59:16.344119] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-09-18T21:59:16.522200] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-09-18T21:59:16.664925] [DEBUG] [LOCAL ] TALO: Loaded 50840 existing records from primary storage. [2025-09-18T21:59:16.697905] [INFO ] [MAIN ] TALO: Loaded 50840 existing records. [2025-09-18T21:59:17.002610] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-09-18T21:59:17.009197] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:59:17.009627] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-09-18T21:59:17.010816] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-09-18T21:59:17.011100] [DEBUG] [LOCAL ] T: Saving primary data. [2025-09-18T21:59:17.011398] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-09-18T21:59:17.011584] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-09-18T21:59:17.024415] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-09-18T21:59:17.039431] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-09-18T21:59:17.024627] [DEBUG] [LOCAL ] T: Trimmed 77910 records to 54188 (keeping 200 days of data) [2025-09-18T21:59:17.170233] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-18T21:59:17.329099] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-09-18T21:59:17.532855] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:59:17.761469] [DEBUG] [LOCAL ] T: Primary data saved (54188 records). [2025-09-18T21:59:17.761620] [INFO ] [MAIN ] T: Full history saved. [2025-09-18T21:59:17.761750] [INFO ] [MAIN ] Update Progress: 2045/2372 symbols completed. T took 58.8s. Estimated remaining: 47m 51s. Rate: 6.8 symbols/min [2025-09-18T21:59:17.964580] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:59:18.019962] [DEBUG] [LOCAL ] TAP: Loaded 52847 existing records from primary storage. [2025-09-18T21:59:18.020111] [INFO ] [MAIN ] TAP: Loaded 52847 existing records. [2025-09-18T21:59:18.120001] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-11. [2025-09-18T21:59:18.198928] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:59:18.199150] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-09-18T21:59:18.199198] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-09-18T21:59:18.200332] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-09-18T21:59:18.200392] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-09-18T21:59:18.564398] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:59:18.594463] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-18T21:59:18.731349] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-18T21:59:18.741414] [INFO ] [REMOTE ] TAK: Full fetch complete (71341 records). [2025-09-18T21:59:18.741539] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-09-18T21:59:18.938341] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-09-18T21:59:19.148977] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-09-18T21:59:19.149065] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-09-18T21:59:19.150124] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-09-18T21:59:19.150211] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-09-18T21:59:19.154781] [DEBUG] [LOCAL ] TAK: Trimmed 71341 records to 50341 (keeping 200 days of data) [2025-09-18T21:59:19.470346] [DEBUG] [LOCAL ] TAK: Primary data saved (50341 records). [2025-09-18T21:59:19.470490] [INFO ] [MAIN ] TAK: Full history saved. [2025-09-18T21:59:19.470619] [INFO ] [MAIN ] Update Progress: 2046/2372 symbols completed. TAK took 32.0s. Estimated remaining: 47m 41s. Rate: 6.8 symbols/min [2025-09-18T21:59:19.648403] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:59:19.701137] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-18T21:59:19.702230] [DEBUG] [LOCAL ] TBB: Loaded 11751 existing records from primary storage. [2025-09-18T21:59:19.716384] [INFO ] [MAIN ] TBB: Loaded 11751 existing records. [2025-09-18T21:59:19.730242] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-11. [2025-09-18T21:59:19.901225] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:59:19.901478] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-09-18T21:59:19.901527] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-09-18T21:59:19.901943] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-09-18T21:59:19.902012] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-09-18T21:59:20.252051] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:59:20.526221] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-11. [2025-09-18T21:59:20.532308] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T21:59:21.140165] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-18T21:59:21.202550] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-18T21:59:21.319510] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-09-18T21:59:22.119565] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-09-18T21:59:22.227152] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-18T21:59:22.919560] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-09-18T21:59:23.572441] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T21:59:23.582996] [INFO ] [REMOTE ] TAL: Full fetch complete (75549 records). [2025-09-18T21:59:23.583209] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-09-18T21:59:23.729059] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-09-18T21:59:23.994950] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-09-18T21:59:23.995053] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-09-18T21:59:23.996417] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-09-18T21:59:23.996516] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-09-18T21:59:23.998717] [DEBUG] [LOCAL ] TAL: Trimmed 75549 records to 52549 (keeping 200 days of data) [2025-09-18T21:59:24.329434] [DEBUG] [LOCAL ] TAL: Primary data saved (52549 records). [2025-09-18T21:59:24.329739] [INFO ] [MAIN ] TAL: Full history saved. [2025-09-18T21:59:24.330976] [INFO ] [MAIN ] Update Progress: 2047/2372 symbols completed. TAL took 32.0s. Estimated remaining: 47m 32s. Rate: 6.8 symbols/min [2025-09-18T21:59:24.519362] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:59:24.532588] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-09-18T21:59:24.557783] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-18T21:59:24.612827] [DEBUG] [LOCAL ] TBBB: Loaded 36050 existing records from primary storage. [2025-09-18T21:59:24.612975] [INFO ] [MAIN ] TBBB: Loaded 36050 existing records. [2025-09-18T21:59:24.797878] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:59:24.798544] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-09-18T21:59:24.798613] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-09-18T21:59:24.799590] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-09-18T21:59:24.799715] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-09-18T21:59:25.180603] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:59:25.229242] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T21:59:25.319528] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-09-18T21:59:25.481985] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T21:59:26.119574] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-11. [2025-09-18T21:59:26.838089] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T21:59:26.919496] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-09-18T21:59:26.944634] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-18T21:59:27.719569] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-09-18T21:59:28.294200] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-18T21:59:28.519570] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-09-18T21:59:29.170448] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-18T21:59:29.319594] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-09-18T21:59:29.904832] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T21:59:30.119557] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-09-18T21:59:30.748578] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-18T21:59:30.919583] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-09-18T21:59:31.002945] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-18T21:59:31.368027] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-18T21:59:31.719613] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-09-18T21:59:32.456237] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-18T21:59:32.519561] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-09-18T21:59:33.319575] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-09-18T21:59:33.378765] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-18T21:59:34.119556] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-09-18T21:59:34.627189] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-18T21:59:34.744274] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-18T21:59:34.919601] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-09-18T21:59:35.719570] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-09-18T21:59:36.170847] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-18T21:59:36.224910] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-18T21:59:36.519559] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-09-18T21:59:37.319575] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-09-18T21:59:37.805128] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-18T21:59:38.119546] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-09-18T21:59:38.919576] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-09-18T21:59:39.103246] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-18T21:59:39.180874] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-18T21:59:39.597584] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-18T21:59:39.719523] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-09-18T21:59:40.422248] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-18T21:59:40.519518] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-09-18T21:59:41.319543] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-09-18T21:59:42.119514] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-09-18T21:59:42.204426] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-18T21:59:42.207086] [INFO ] [REMOTE ] TBB: Full fetch complete (18349 records). [2025-09-18T21:59:42.207192] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-09-18T21:59:42.624520] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-09-18T21:59:42.624806] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-09-18T21:59:42.625783] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-09-18T21:59:42.625895] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-09-18T21:59:42.626922] [DEBUG] [LOCAL ] TBB: Trimmed 18349 records to 11813 (keeping 200 days of data) [2025-09-18T21:59:42.687284] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-18T21:59:42.737867] [DEBUG] [LOCAL ] TBB: Primary data saved (11813 records). [2025-09-18T21:59:42.738814] [INFO ] [MAIN ] TBB: Full history saved. [2025-09-18T21:59:42.739522] [INFO ] [MAIN ] Update Progress: 2048/2372 symbols completed. TBB took 23.3s. Estimated remaining: 47m 24s. Rate: 6.8 symbols/min [2025-09-18T21:59:42.926145] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-09-18T21:59:42.926072] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:59:42.949414] [DEBUG] [LOCAL ] TBI: Loaded 22751 existing records from primary storage. [2025-09-18T21:59:42.949553] [INFO ] [MAIN ] TBI: Loaded 22751 existing records. [2025-09-18T21:59:43.131872] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:59:43.132169] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-09-18T21:59:43.132217] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-09-18T21:59:43.133064] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-09-18T21:59:43.133124] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-09-18T21:59:43.490805] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:59:43.678112] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-18T21:59:43.719500] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-09-18T21:59:44.297662] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-18T21:59:44.519566] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-09-18T21:59:45.319544] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-11. [2025-09-18T21:59:45.436948] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-18T21:59:46.119557] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-09-18T21:59:46.174587] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-18T21:59:46.219428] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-18T21:59:46.919560] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-09-18T21:59:47.719555] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-09-18T21:59:47.844536] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-18T21:59:48.204707] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-18T21:59:48.519590] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-09-18T21:59:48.596181] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T21:59:49.319543] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-09-18T21:59:50.103398] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-18T21:59:50.119499] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-09-18T21:59:50.297052] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-18T21:59:50.919548] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-09-18T21:59:51.521146] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-18T21:59:51.528257] [INFO ] [REMOTE ] TALO: Full fetch complete (72944 records). [2025-09-18T21:59:51.528396] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-09-18T21:59:51.725265] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-09-18T21:59:51.936386] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-09-18T21:59:51.936471] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-09-18T21:59:51.937514] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-09-18T21:59:51.937603] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-09-18T21:59:51.939047] [DEBUG] [LOCAL ] TALO: Trimmed 72944 records to 51209 (keeping 200 days of data) [2025-09-18T21:59:52.082700] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-18T21:59:52.283615] [DEBUG] [LOCAL ] TALO: Primary data saved (51209 records). [2025-09-18T21:59:52.283796] [INFO ] [MAIN ] TALO: Full history saved. [2025-09-18T21:59:52.283901] [INFO ] [MAIN ] Update Progress: 2049/2372 symbols completed. TALO took 36.2s. Estimated remaining: 47m 16s. Rate: 6.8 symbols/min [2025-09-18T21:59:52.453962] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:59:52.454198] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-09-18T21:59:52.454250] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-09-18T21:59:52.454403] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-09-18T21:59:52.454445] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-18T21:59:52.454487] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-18T21:59:52.454519] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-09-18T21:59:52.527999] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-09-18T21:59:52.812067] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:59:53.319532] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-09-18T21:59:53.422158] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-18T21:59:53.639151] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-18T21:59:54.119587] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-09-18T21:59:54.315389] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-18T21:59:54.919591] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-09-18T21:59:55.107055] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-18T21:59:55.112083] [INFO ] [REMOTE ] TBBB: Full fetch complete (51356 records). [2025-09-18T21:59:55.112250] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-09-18T21:59:55.500292] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-09-18T21:59:55.500402] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-09-18T21:59:55.501326] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-09-18T21:59:55.501401] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-09-18T21:59:55.502548] [DEBUG] [LOCAL ] TBBB: Trimmed 51356 records to 36224 (keeping 200 days of data) [2025-09-18T21:59:55.715081] [DEBUG] [LOCAL ] TBBB: Primary data saved (36224 records). [2025-09-18T21:59:55.715223] [INFO ] [MAIN ] TBBB: Full history saved. [2025-09-18T21:59:55.716005] [INFO ] [MAIN ] Update Progress: 2050/2372 symbols completed. TBBB took 31.4s. Estimated remaining: 47m 6s. Rate: 6.8 symbols/min [2025-09-18T21:59:55.727602] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-09-18T21:59:55.890813] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T21:59:55.895897] [DEBUG] [LOCAL ] TBN: Loaded 3011 existing records from primary storage. [2025-09-18T21:59:55.895989] [INFO ] [MAIN ] TBN: Loaded 3011 existing records. [2025-09-18T21:59:56.074781] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T21:59:56.075038] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-09-18T21:59:56.075087] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-09-18T21:59:56.075456] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-09-18T21:59:56.075535] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-09-18T21:59:56.448235] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T21:59:56.519510] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-11. [2025-09-18T21:59:56.739435] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-18T21:59:56.800432] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-18T21:59:56.809451] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-11 (0.29 seconds). [2025-09-18T21:59:57.319563] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-09-18T21:59:57.710770] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-18T21:59:58.119609] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-11. [2025-09-18T21:59:58.458574] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-11 (0.34 seconds). [2025-09-18T21:59:58.919610] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-09-18T21:59:59.334929] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-18T21:59:59.719630] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-09-18T22:00:00.519562] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-09-18T22:00:00.868797] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-18T22:00:01.319557] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-09-18T22:00:02.119618] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-09-18T22:00:02.919727] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-09-18T22:00:03.762307] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (3.24 seconds). [2025-09-18T22:00:03.775697] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-09-18T22:00:04.340196] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-18T22:00:04.448611] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (3.13 seconds). [2025-09-18T22:00:04.519563] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-09-18T22:00:05.260626] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-18T22:00:05.319582] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-09-18T22:00:05.552886] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-18T22:00:05.860951] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-18T22:00:06.119555] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-09-18T22:00:06.581675] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-18T22:00:06.595936] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-18T22:00:06.919544] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-09-18T22:00:07.277460] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-18T22:00:07.719610] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-09-18T22:00:08.519559] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-09-18T22:00:08.709801] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-18T22:00:08.903468] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-18T22:00:09.319619] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-09-18T22:00:09.760098] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-18T22:00:10.119574] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-09-18T22:00:10.587698] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-18T22:00:10.596563] [INFO ] [REMOTE ] TAP: Full fetch complete (75974 records). [2025-09-18T22:00:10.596722] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-09-18T22:00:10.923970] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-09-18T22:00:11.021044] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-09-18T22:00:11.021130] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-09-18T22:00:11.022204] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-09-18T22:00:11.022272] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-09-18T22:00:11.023830] [DEBUG] [LOCAL ] TAP: Trimmed 75974 records to 53235 (keeping 200 days of data) [2025-09-18T22:00:11.364202] [DEBUG] [LOCAL ] TAP: Primary data saved (53235 records). [2025-09-18T22:00:11.364377] [INFO ] [MAIN ] TAP: Full history saved. [2025-09-18T22:00:11.364478] [INFO ] [MAIN ] Update Progress: 2051/2372 symbols completed. TAP took 53.6s. Estimated remaining: 46m 58s. Rate: 6.8 symbols/min [2025-09-18T22:00:11.465758] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-18T22:00:11.555526] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:00:11.555752] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-09-18T22:00:11.555811] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-09-18T22:00:11.556003] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-09-18T22:00:11.556059] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-18T22:00:11.556106] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-18T22:00:11.556144] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-09-18T22:00:11.730618] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-09-18T22:00:11.946740] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:00:12.288850] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-18T22:00:12.519569] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-11. [2025-09-18T22:00:12.887688] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:00:12.888043] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-11 [2025-09-18T22:00:13.319544] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-09-18T22:00:14.119597] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-09-18T22:00:14.919601] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-09-18T22:00:14.940383] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-18T22:00:14.958628] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:00:14.959092] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-09-18T22:00:15.719589] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-09-18T22:00:16.034354] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-18T22:00:16.049034] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-18T22:00:16.519541] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-01. [2025-09-18T22:00:16.714918] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:00:16.715255] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-01 [2025-09-18T22:00:17.319562] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-09-18T22:00:17.991048] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-18T22:00:17.994123] [INFO ] [REMOTE ] TBI: Full fetch complete (31608 records). [2025-09-18T22:00:17.994229] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-09-18T22:00:18.124704] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-09-18T22:00:18.398770] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-09-18T22:00:18.398896] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-09-18T22:00:18.399750] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-09-18T22:00:18.399817] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-09-18T22:00:18.400703] [DEBUG] [LOCAL ] TBI: Trimmed 31608 records to 22917 (keeping 200 days of data) [2025-09-18T22:00:18.534125] [DEBUG] [LOCAL ] TBI: Primary data saved (22917 records). [2025-09-18T22:00:18.534326] [INFO ] [MAIN ] TBI: Full history saved. [2025-09-18T22:00:18.534424] [INFO ] [MAIN ] Update Progress: 2052/2372 symbols completed. TBI took 35.8s. Estimated remaining: 46m 49s. Rate: 6.8 symbols/min [2025-09-18T22:00:18.718068] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-18T22:00:18.719358] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:00:18.777944] [DEBUG] [LOCAL ] TD: Loaded 52297 existing records from primary storage. [2025-09-18T22:00:18.778125] [INFO ] [MAIN ] TD: Loaded 52297 existing records. [2025-09-18T22:00:18.926438] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-09-18T22:00:18.959303] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:00:18.959568] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-09-18T22:00:18.959618] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-09-18T22:00:18.961225] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-09-18T22:00:18.961288] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-09-18T22:00:19.314360] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:00:19.430626] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-18T22:00:19.719552] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-09-18T22:00:20.295169] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-18T22:00:20.296616] [INFO ] [REMOTE ] TBN: Full fetch complete (4728 records). [2025-09-18T22:00:20.296740] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-09-18T22:00:20.524724] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-11. [2025-09-18T22:00:20.661206] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-09-18T22:00:20.661282] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-09-18T22:00:20.661425] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-09-18T22:00:20.661463] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-09-18T22:00:20.661862] [DEBUG] [LOCAL ] TBN: Trimmed 4728 records to 3059 (keeping 200 days of data) [2025-09-18T22:00:20.679683] [DEBUG] [LOCAL ] TBN: Primary data saved (3059 records). [2025-09-18T22:00:20.679754] [INFO ] [MAIN ] TBN: Full history saved. [2025-09-18T22:00:20.679838] [INFO ] [MAIN ] Update Progress: 2053/2372 symbols completed. TBN took 25.0s. Estimated remaining: 46m 40s. Rate: 6.8 symbols/min [2025-09-18T22:00:20.848847] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:00:20.898895] [DEBUG] [LOCAL ] TDC: Loaded 47027 existing records from primary storage. [2025-09-18T22:00:20.899062] [INFO ] [MAIN ] TDC: Loaded 47027 existing records. [2025-09-18T22:00:21.079267] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:00:21.079535] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-09-18T22:00:21.079591] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-09-18T22:00:21.080616] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-09-18T22:00:21.080717] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-09-18T22:00:21.324731] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-02. [2025-09-18T22:00:21.436683] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:00:21.601745] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:00:21.602056] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-02 [2025-09-18T22:00:22.119577] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-11. [2025-09-18T22:00:22.302058] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-18T22:00:22.919587] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-09-18T22:00:23.423956] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-18T22:00:23.719585] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-03. [2025-09-18T22:00:23.946404] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:00:23.946909] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-03 [2025-09-18T22:00:24.519570] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-09-18T22:00:24.732420] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-18T22:00:25.319562] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-09-18T22:00:25.608962] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-18T22:00:26.119557] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-09-18T22:00:26.167268] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-18T22:00:26.919612] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-09-18T22:00:27.265298] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-18T22:00:27.719582] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-09-18T22:00:28.035272] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-18T22:00:28.049247] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-18T22:00:28.519568] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-18T22:00:28.889914] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-18T22:00:28.890705] [INFO ] [REMOTE ] TBLU: Full fetch complete (1181 records). [2025-09-18T22:00:28.890779] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-09-18T22:00:29.125999] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-18T22:00:29.126202] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-09-18T22:00:29.126272] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-09-18T22:00:29.126348] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-18T22:00:29.126441] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-18T22:00:29.126503] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-09-18T22:00:29.126552] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-09-18T22:00:29.126618] [INFO ] [MAIN ] Update Progress: 2054/2372 symbols completed. TBLU took 36.8s. Estimated remaining: 46m 31s. Rate: 6.8 symbols/min [2025-09-18T22:00:29.300366] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:00:29.310191] [DEBUG] [LOCAL ] TDF: Loaded 6464 existing records from primary storage. [2025-09-18T22:00:29.310360] [INFO ] [MAIN ] TDF: Loaded 6464 existing records. [2025-09-18T22:00:29.324710] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-09-18T22:00:29.499963] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:00:29.500209] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-09-18T22:00:29.500259] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-09-18T22:00:29.500592] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-09-18T22:00:29.500691] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-09-18T22:00:29.878468] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:00:30.119557] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-04. [2025-09-18T22:00:30.359939] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:00:30.360282] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-04 [2025-09-18T22:00:30.846570] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T22:00:30.919595] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-09-18T22:00:31.719573] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-05. [2025-09-18T22:00:31.957714] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:00:31.958063] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-05 [2025-09-18T22:00:32.314544] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-18T22:00:32.519605] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-06. [2025-09-18T22:00:32.767725] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:00:32.768117] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-06 [2025-09-18T22:00:33.319556] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-11. [2025-09-18T22:00:34.119550] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-09-18T22:00:34.136150] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-18T22:00:34.919567] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-09-18T22:00:35.674219] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-18T22:00:35.719500] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-09-18T22:00:36.396730] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T22:00:36.519561] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-09-18T22:00:37.319555] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-09-18T22:00:37.328788] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-18T22:00:37.585714] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-18T22:00:38.119546] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-09-18T22:00:38.800308] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-18T22:00:38.816899] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-18T22:00:38.919566] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-09-18T22:00:39.719552] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-07. [2025-09-18T22:00:39.952356] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:00:39.953289] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-07 [2025-09-18T22:00:40.519545] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-08. [2025-09-18T22:00:40.782969] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-18T22:00:40.978692] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-18T22:00:41.319545] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-09-18T22:00:42.119617] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-09-18T22:00:42.768889] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-18T22:00:42.920629] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-18T22:00:42.920742] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-09. [2025-09-18T22:00:43.343044] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-18T22:00:43.344173] [INFO ] [REMOTE ] TCAI: Full fetch complete (828 records). [2025-09-18T22:00:43.344249] [DEBUG] [VALIDATOR ] TCAI: Validating primary data. [2025-09-18T22:00:43.537855] [WARN ] [VALIDATOR ] TCAI: Validation failed - insufficient historical data. Have 32 unique days, need 200 days [2025-09-18T22:00:43.538137] [FATAL] [MAIN ] TCAI: Fetched primary data is invalid. Refusing to save it. [2025-09-18T22:00:43.538222] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to validation failure. [2025-09-18T22:00:43.538311] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-18T22:00:43.538392] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-18T22:00:43.538452] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-09-18T22:00:43.538560] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-09-18T22:00:43.538696] [INFO ] [MAIN ] Update Progress: 2055/2372 symbols completed. TCAI took 32.2s. Estimated remaining: 46m 23s. Rate: 6.8 symbols/min [2025-09-18T22:00:43.725769] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-09-18T22:00:43.730175] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:00:43.756073] [DEBUG] [LOCAL ] TDG: Loaded 22189 existing records from primary storage. [2025-09-18T22:00:43.756412] [INFO ] [MAIN ] TDG: Loaded 22189 existing records. [2025-09-18T22:00:43.937011] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:00:43.937277] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-09-18T22:00:43.937328] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-09-18T22:00:43.938107] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-09-18T22:00:43.938173] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-09-18T22:00:44.315439] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:00:44.519555] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-09-18T22:00:45.314984] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T22:00:45.325848] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-09-18T22:00:45.335442] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-18T22:00:46.119559] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-09-18T22:00:46.705355] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-18T22:00:46.919551] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-09-18T22:00:47.719560] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-11. [2025-09-18T22:00:48.027212] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-18T22:00:48.068384] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-18T22:00:48.519552] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-09-18T22:00:48.861620] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-18T22:00:49.319563] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-09-18T22:00:50.020397] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-18T22:00:50.119519] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-09-18T22:00:50.175887] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-18T22:00:50.919573] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-09-18T22:00:51.719592] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-09-18T22:00:51.837150] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-18T22:00:51.844962] [INFO ] [REMOTE ] TD: Full fetch complete (75655 records). [2025-09-18T22:00:51.845157] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-09-18T22:00:52.261243] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-09-18T22:00:52.261404] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-09-18T22:00:52.262605] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-09-18T22:00:52.262702] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-09-18T22:00:52.264603] [DEBUG] [LOCAL ] TD: Trimmed 75655 records to 52676 (keeping 200 days of data) [2025-09-18T22:00:52.292188] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-18T22:00:52.519745] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-09-18T22:00:52.632861] [DEBUG] [LOCAL ] TD: Primary data saved (52676 records). [2025-09-18T22:00:52.633106] [INFO ] [MAIN ] TD: Full history saved. [2025-09-18T22:00:52.633312] [INFO ] [MAIN ] Update Progress: 2056/2372 symbols completed. TD took 34.1s. Estimated remaining: 46m 14s. Rate: 6.8 symbols/min [2025-09-18T22:00:52.833630] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:00:52.834524] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-18T22:00:52.892585] [DEBUG] [LOCAL ] TDOC: Loaded 53357 existing records from primary storage. [2025-09-18T22:00:52.892815] [INFO ] [MAIN ] TDOC: Loaded 53357 existing records. [2025-09-18T22:00:53.073955] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:00:53.074198] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-09-18T22:00:53.074260] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-09-18T22:00:53.075834] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-09-18T22:00:53.075896] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-09-18T22:00:53.326937] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-09-18T22:00:53.441868] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:00:53.442796] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-18T22:00:54.119557] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-11. [2025-09-18T22:00:54.493839] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-18T22:00:54.919545] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-09-18T22:00:55.542955] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-18T22:00:55.719579] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-09-18T22:00:55.955024] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-18T22:00:56.145498] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-18T22:00:56.519562] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-09-18T22:00:57.319588] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-09-18T22:00:57.614419] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-18T22:00:58.119541] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-09-18T22:00:58.553461] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-18T22:00:58.730443] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-18T22:00:58.919556] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-09-18T22:00:59.639535] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-18T22:00:59.719595] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-09-18T22:01:00.519544] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-09-18T22:01:01.056172] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-18T22:01:01.062590] [INFO ] [REMOTE ] TDC: Full fetch complete (66507 records). [2025-09-18T22:01:01.062722] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-09-18T22:01:01.324810] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-09-18T22:01:01.475909] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-09-18T22:01:01.476024] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-09-18T22:01:01.477141] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-09-18T22:01:01.477219] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-09-18T22:01:01.478743] [DEBUG] [LOCAL ] TDC: Trimmed 66507 records to 47386 (keeping 200 days of data) [2025-09-18T22:01:01.781054] [DEBUG] [LOCAL ] TDC: Primary data saved (47386 records). [2025-09-18T22:01:01.781203] [INFO ] [MAIN ] TDC: Full history saved. [2025-09-18T22:01:01.783051] [INFO ] [MAIN ] Update Progress: 2057/2372 symbols completed. TDC took 41.1s. Estimated remaining: 46m 5s. Rate: 6.8 symbols/min [2025-09-18T22:01:01.965201] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:01:02.008680] [DEBUG] [LOCAL ] TDS: Loaded 42900 existing records from primary storage. [2025-09-18T22:01:02.008836] [INFO ] [MAIN ] TDS: Loaded 42900 existing records. [2025-09-18T22:01:02.124730] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-09-18T22:01:02.189349] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:01:02.189728] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-09-18T22:01:02.189787] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-09-18T22:01:02.190751] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-09-18T22:01:02.190814] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-09-18T22:01:02.588278] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:01:02.664976] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-18T22:01:02.681804] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-18T22:01:02.688956] [INFO ] [REMOTE ] TDF: Full fetch complete (10733 records). [2025-09-18T22:01:02.697974] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-09-18T22:01:02.699179] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-18T22:01:02.924876] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-09-18T22:01:03.101521] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-09-18T22:01:03.101635] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-09-18T22:01:03.102248] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-09-18T22:01:03.102318] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-09-18T22:01:03.102955] [DEBUG] [LOCAL ] TDF: Trimmed 10733 records to 6549 (keeping 200 days of data) [2025-09-18T22:01:03.145782] [DEBUG] [LOCAL ] TDF: Primary data saved (6549 records). [2025-09-18T22:01:03.145987] [INFO ] [MAIN ] TDF: Full history saved. [2025-09-18T22:01:03.146146] [INFO ] [MAIN ] Update Progress: 2058/2372 symbols completed. TDF took 34.0s. Estimated remaining: 45m 55s. Rate: 6.8 symbols/min [2025-09-18T22:01:03.328958] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:01:03.384263] [DEBUG] [LOCAL ] TDW: Loaded 45734 existing records from primary storage. [2025-09-18T22:01:03.384479] [INFO ] [MAIN ] TDW: Loaded 45734 existing records. [2025-09-18T22:01:03.576762] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:01:03.577258] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-09-18T22:01:03.577344] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-09-18T22:01:03.578469] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-09-18T22:01:03.578554] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-09-18T22:01:03.733205] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-11. [2025-09-18T22:01:03.973150] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:01:04.259280] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T22:01:04.519553] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-09-18T22:01:05.236330] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-18T22:01:05.321580] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-18T22:01:05.320441] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-09-18T22:01:06.119602] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-09-18T22:01:06.664270] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T22:01:06.902479] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-18T22:01:06.919527] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-09-18T22:01:07.719607] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-09-18T22:01:08.065924] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-18T22:01:08.519591] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-09-18T22:01:08.985620] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-18T22:01:08.989735] [INFO ] [REMOTE ] TDG: Full fetch complete (32478 records). [2025-09-18T22:01:08.989849] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-09-18T22:01:09.326292] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-11. [2025-09-18T22:01:09.366181] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-09-18T22:01:09.366283] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-09-18T22:01:09.367056] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-09-18T22:01:09.367149] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-09-18T22:01:09.368830] [DEBUG] [LOCAL ] TDG: Trimmed 32478 records to 22331 (keeping 200 days of data) [2025-09-18T22:01:09.490430] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-18T22:01:09.550110] [DEBUG] [LOCAL ] TDG: Primary data saved (22331 records). [2025-09-18T22:01:09.550248] [INFO ] [MAIN ] TDG: Full history saved. [2025-09-18T22:01:09.550342] [INFO ] [MAIN ] Update Progress: 2059/2372 symbols completed. TDG took 26.0s. Estimated remaining: 45m 46s. Rate: 6.8 symbols/min [2025-09-18T22:01:09.718672] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:01:09.742100] [DEBUG] [LOCAL ] TDY: Loaded 23000 existing records from primary storage. [2025-09-18T22:01:09.742281] [INFO ] [MAIN ] TDY: Loaded 23000 existing records. [2025-09-18T22:01:09.924885] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:01:09.925176] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-09-18T22:01:09.925231] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-09-18T22:01:09.925873] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-09-18T22:01:09.925935] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-09-18T22:01:10.124832] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-09-18T22:01:10.283773] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:01:10.914433] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-18T22:01:10.923941] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-09-18T22:01:11.363759] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-18T22:01:11.719552] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-09-18T22:01:12.519637] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-09-18T22:01:12.726278] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-18T22:01:13.319590] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-11. [2025-09-18T22:01:13.624299] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-18T22:01:13.744181] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-18T22:01:14.119564] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-09-18T22:01:14.501854] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-18T22:01:14.919550] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-09-18T22:01:15.647839] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-18T22:01:15.719494] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-09-18T22:01:16.519552] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-09-18T22:01:16.902661] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-18T22:01:17.066172] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-18T22:01:17.319603] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-09-18T22:01:17.335791] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-18T22:01:18.119607] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-09-18T22:01:18.919585] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-09-18T22:01:19.583724] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-18T22:01:19.683121] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-18T22:01:19.719613] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-09-18T22:01:19.816778] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-18T22:01:20.519619] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-09-18T22:01:20.910132] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-18T22:01:21.319552] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-09-18T22:01:22.119516] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-09-18T22:01:22.671555] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-18T22:01:22.713870] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-18T22:01:22.919522] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-09-18T22:01:23.106154] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-18T22:01:23.719575] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-09-18T22:01:24.315130] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T22:01:24.519559] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-09-18T22:01:25.319571] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-09-18T22:01:25.779083] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-18T22:01:25.868129] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-18T22:01:26.119604] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-09-18T22:01:26.221864] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-18T22:01:26.919558] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-09-18T22:01:27.719550] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-09-18T22:01:28.039467] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-18T22:01:28.133509] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-18T22:01:28.519546] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-09-18T22:01:29.319531] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-09-18T22:01:29.464844] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-18T22:01:29.503423] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-18T22:01:30.119571] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-09-18T22:01:30.435330] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T22:01:30.443544] [INFO ] [REMOTE ] TDS: Full fetch complete (61342 records). [2025-09-18T22:01:30.443704] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-09-18T22:01:30.854331] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-09-18T22:01:30.854425] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-09-18T22:01:30.855400] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-09-18T22:01:30.855465] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-09-18T22:01:30.856824] [DEBUG] [LOCAL ] TDS: Trimmed 61342 records to 43200 (keeping 200 days of data) [2025-09-18T22:01:30.925944] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-09-18T22:01:31.146090] [DEBUG] [LOCAL ] TDS: Primary data saved (43200 records). [2025-09-18T22:01:31.146322] [INFO ] [MAIN ] TDS: Full history saved. [2025-09-18T22:01:31.147389] [INFO ] [MAIN ] Update Progress: 2060/2372 symbols completed. TDS took 29.4s. Estimated remaining: 45m 40s. Rate: 6.8 symbols/min [2025-09-18T22:01:31.322569] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:01:31.322755] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-09-18T22:01:31.322804] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-09-18T22:01:31.322948] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-09-18T22:01:31.322993] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-18T22:01:31.323038] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-18T22:01:31.323091] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-09-18T22:01:31.711894] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:01:31.719500] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-11. [2025-09-18T22:01:31.969921] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:01:31.970241] [WARN ] [REMOTE ] TE: No data returned for month 2024-11 [2025-09-18T22:01:32.418949] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-18T22:01:32.519543] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-09-18T22:01:32.643328] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-18T22:01:33.319560] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-09-18T22:01:34.119518] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-09-18T22:01:34.221705] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-18T22:01:34.369871] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:01:34.370340] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-09-18T22:01:34.733270] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-18T22:01:34.919549] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-09-18T22:01:35.719561] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-09-18T22:01:36.520758] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-18T22:01:36.519795] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-09-18T22:01:36.835948] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-18T22:01:37.319558] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-01. [2025-09-18T22:01:37.529731] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:01:37.530177] [WARN ] [REMOTE ] TE: No data returned for month 2025-01 [2025-09-18T22:01:38.063516] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-18T22:01:38.073550] [INFO ] [REMOTE ] TDOC: Full fetch complete (77195 records). [2025-09-18T22:01:38.073745] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-09-18T22:01:38.128831] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-09-18T22:01:38.506360] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-09-18T22:01:38.506456] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-09-18T22:01:38.507537] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-09-18T22:01:38.507604] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-09-18T22:01:38.512429] [DEBUG] [LOCAL ] TDOC: Trimmed 77195 records to 53744 (keeping 200 days of data) [2025-09-18T22:01:38.845722] [DEBUG] [LOCAL ] TDOC: Primary data saved (53744 records). [2025-09-18T22:01:38.845881] [INFO ] [MAIN ] TDOC: Full history saved. [2025-09-18T22:01:38.846026] [INFO ] [MAIN ] Update Progress: 2061/2372 symbols completed. TDOC took 46.2s. Estimated remaining: 45m 31s. Rate: 6.8 symbols/min [2025-09-18T22:01:38.924708] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-09-18T22:01:39.030783] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:01:39.040346] [DEBUG] [LOCAL ] TEAF: Loaded 7154 existing records from primary storage. [2025-09-18T22:01:39.040481] [INFO ] [MAIN ] TEAF: Loaded 7154 existing records. [2025-09-18T22:01:39.222318] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:01:39.222621] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-09-18T22:01:39.222719] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-09-18T22:01:39.223068] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-09-18T22:01:39.223130] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-09-18T22:01:39.623545] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:01:39.653532] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-18T22:01:39.719564] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-09-18T22:01:40.008668] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-18T22:01:40.519569] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-09-18T22:01:41.046769] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-18T22:01:41.050150] [INFO ] [REMOTE ] TDY: Full fetch complete (32289 records). [2025-09-18T22:01:41.050326] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-09-18T22:01:41.199133] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T22:01:41.324687] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-09-18T22:01:41.473985] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-09-18T22:01:41.474065] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-09-18T22:01:41.474755] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-09-18T22:01:41.474819] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-09-18T22:01:41.475726] [DEBUG] [LOCAL ] TDY: Trimmed 32289 records to 23132 (keeping 200 days of data) [2025-09-18T22:01:41.633532] [DEBUG] [LOCAL ] TDY: Primary data saved (23132 records). [2025-09-18T22:01:41.633691] [INFO ] [MAIN ] TDY: Full history saved. [2025-09-18T22:01:41.633820] [INFO ] [MAIN ] Update Progress: 2062/2372 symbols completed. TDY took 32.1s. Estimated remaining: 45m 21s. Rate: 6.8 symbols/min [2025-09-18T22:01:41.810926] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:01:41.874310] [DEBUG] [LOCAL ] TECK: Loaded 53441 existing records from primary storage. [2025-09-18T22:01:41.874497] [INFO ] [MAIN ] TECK: Loaded 53441 existing records. [2025-09-18T22:01:42.062968] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:01:42.063289] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-09-18T22:01:42.063341] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-09-18T22:01:42.065265] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-09-18T22:01:42.065342] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-09-18T22:01:42.130201] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-02. [2025-09-18T22:01:42.385524] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:01:42.401388] [WARN ] [REMOTE ] TE: No data returned for month 2025-02 [2025-09-18T22:01:42.477915] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:01:42.919517] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-11. [2025-09-18T22:01:43.011661] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-18T22:01:43.429845] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-18T22:01:43.719561] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-09-18T22:01:44.519615] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-09-18T22:01:45.198576] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-18T22:01:45.209216] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-18T22:01:45.209415] [INFO ] [REMOTE ] TDW: Full fetch complete (67160 records). [2025-09-18T22:01:45.211670] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-09-18T22:01:45.324695] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-09-18T22:01:45.650046] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-09-18T22:01:45.650139] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-09-18T22:01:45.651127] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-09-18T22:01:45.651191] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-09-18T22:01:45.652564] [DEBUG] [LOCAL ] TDW: Trimmed 67160 records to 46057 (keeping 200 days of data) [2025-09-18T22:01:45.931239] [DEBUG] [LOCAL ] TDW: Primary data saved (46057 records). [2025-09-18T22:01:45.931374] [INFO ] [MAIN ] TDW: Full history saved. [2025-09-18T22:01:45.931484] [INFO ] [MAIN ] Update Progress: 2063/2372 symbols completed. TDW took 42.8s. Estimated remaining: 45m 11s. Rate: 6.8 symbols/min [2025-09-18T22:01:46.052189] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-18T22:01:46.121337] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:01:46.121471] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-03. [2025-09-18T22:01:46.165179] [DEBUG] [LOCAL ] TEF: Loaded 37568 existing records from primary storage. [2025-09-18T22:01:46.165370] [INFO ] [MAIN ] TEF: Loaded 37568 existing records. [2025-09-18T22:01:46.362698] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:01:46.363152] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-09-18T22:01:46.363214] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-09-18T22:01:46.364885] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-09-18T22:01:46.364954] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-09-18T22:01:46.752365] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:01:46.919544] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-11. [2025-09-18T22:01:47.611811] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-18T22:01:47.719545] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-11. [2025-09-18T22:01:48.519537] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-09-18T22:01:48.695333] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-18T22:01:48.877159] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-18T22:01:48.984858] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T22:01:49.319555] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-09-18T22:01:50.119587] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-09-18T22:01:50.921760] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-04. [2025-09-18T22:01:50.924546] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-18T22:01:51.597896] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-18T22:01:51.719589] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-09-18T22:01:52.330254] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-18T22:01:52.519547] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-05. [2025-09-18T22:01:52.833730] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-18T22:01:53.319555] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-09-18T22:01:54.040954] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-18T22:01:54.119579] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-06. [2025-09-18T22:01:54.806322] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T22:01:54.919550] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-09-18T22:01:55.546342] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T22:01:55.719561] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-09-18T22:01:56.519573] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-09-18T22:01:56.586212] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-18T22:01:57.116698] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-18T22:01:57.192954] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-18T22:01:57.319521] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-09-18T22:01:58.119537] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-07. [2025-09-18T22:01:58.919570] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-09-18T22:01:58.999709] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-18T22:01:59.383389] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-18T22:01:59.719545] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-09-18T22:02:00.250514] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-18T22:02:00.519553] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-09-18T22:02:01.247886] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T22:02:01.319563] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-09-18T22:02:02.119585] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-08. [2025-09-18T22:02:02.151978] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-18T22:02:02.919565] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-09-18T22:02:03.049086] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-18T22:02:03.459376] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-18T22:02:03.719555] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-09-18T22:02:03.870563] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-18T22:02:04.519583] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-09. [2025-09-18T22:02:04.904302] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-18T22:02:05.319585] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-09-18T22:02:05.878345] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-18T22:02:05.884813] [INFO ] [REMOTE ] TE: Full fetch complete (45258 records). [2025-09-18T22:02:05.884921] [DEBUG] [VALIDATOR ] TE: Validating primary data. [2025-09-18T22:02:06.077120] [WARN ] [VALIDATOR ] TE: Validation failed - insufficient historical data. Have 139 unique days, need 200 days [2025-09-18T22:02:06.077848] [FATAL] [MAIN ] TE: Fetched primary data is invalid. Refusing to save it. [2025-09-18T22:02:06.077948] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to validation failure. [2025-09-18T22:02:06.078027] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-18T22:02:06.078105] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-18T22:02:06.078223] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-09-18T22:02:06.078305] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-09-18T22:02:06.078409] [INFO ] [MAIN ] Update Progress: 2064/2372 symbols completed. TE took 34.9s. Estimated remaining: 45m 4s. Rate: 6.8 symbols/min [2025-09-18T22:02:06.124797] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-09-18T22:02:06.252615] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:02:06.281914] [DEBUG] [LOCAL ] TEI: Loaded 20379 existing records from primary storage. [2025-09-18T22:02:06.282047] [INFO ] [MAIN ] TEI: Loaded 20379 existing records. [2025-09-18T22:02:06.467996] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:02:06.468304] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-09-18T22:02:06.468373] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-09-18T22:02:06.469085] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-09-18T22:02:06.469152] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-09-18T22:02:06.589509] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-18T22:02:06.862633] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:02:06.919505] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-11. [2025-09-18T22:02:07.719555] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-09-18T22:02:07.875261] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-18T22:02:07.898603] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-18T22:02:08.519559] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-09-18T22:02:09.095017] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-18T22:02:09.114337] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-18T22:02:09.319599] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-09-18T22:02:10.119601] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-09-18T22:02:10.325257] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-18T22:02:10.702587] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-18T22:02:10.919598] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-09-18T22:02:11.719575] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-09-18T22:02:11.728284] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-18T22:02:12.519603] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-09-18T22:02:12.638847] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-18T22:02:13.158845] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-18T22:02:13.319605] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-09-18T22:02:14.119596] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-09-18T22:02:14.919553] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-09-18T22:02:15.102943] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-18T22:02:15.307249] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-18T22:02:15.314954] [INFO ] [REMOTE ] TEF: Full fetch complete (54372 records). [2025-09-18T22:02:15.317632] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-18T22:02:15.317797] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-09-18T22:02:15.319544] [INFO ] [REMOTE ] TEAF: Full fetch complete (9760 records). [2025-09-18T22:02:15.319735] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-09-18T22:02:15.742094] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-09-18T22:02:16.158694] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-09-18T22:02:16.158855] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-09-18T22:02:16.159011] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-09-18T22:02:16.159221] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-09-18T22:02:16.159286] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-09-18T22:02:16.159366] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-09-18T22:02:16.160444] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-09-18T22:02:16.160534] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-09-18T22:02:16.161811] [DEBUG] [LOCAL ] TEAF: Trimmed 9760 records to 7310 (keeping 200 days of data) [2025-09-18T22:02:16.162844] [DEBUG] [LOCAL ] TEF: Trimmed 54372 records to 37836 (keeping 200 days of data) [2025-09-18T22:02:16.297058] [DEBUG] [LOCAL ] TEAF: Primary data saved (7310 records). [2025-09-18T22:02:16.302438] [INFO ] [MAIN ] TEAF: Full history saved. [2025-09-18T22:02:16.302887] [INFO ] [MAIN ] Update Progress: 2065/2372 symbols completed. TEAF took 37.5s. Estimated remaining: 44m 56s. Rate: 6.8 symbols/min [2025-09-18T22:02:16.539232] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-09-18T22:02:16.542441] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:02:16.620856] [DEBUG] [LOCAL ] TEF: Primary data saved (37836 records). [2025-09-18T22:02:16.621049] [INFO ] [MAIN ] TEF: Full history saved. [2025-09-18T22:02:16.621150] [INFO ] [MAIN ] Update Progress: 2066/2372 symbols completed. TEF took 30.7s. Estimated remaining: 44m 46s. Rate: 6.8 symbols/min [2025-09-18T22:02:16.837950] [DEBUG] [LOCAL ] TEL: Loaded 51190 existing records from primary storage. [2025-09-18T22:02:16.841777] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:02:16.842011] [INFO ] [MAIN ] TEL: Loaded 51190 existing records. [2025-09-18T22:02:17.039998] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:02:17.040381] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-09-18T22:02:17.040442] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-09-18T22:02:17.041687] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-09-18T22:02:17.041754] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-09-18T22:02:17.156764] [DEBUG] [LOCAL ] TEN: Loaded 31256 existing records from primary storage. [2025-09-18T22:02:17.157875] [INFO ] [MAIN ] TEN: Loaded 31256 existing records. [2025-09-18T22:02:17.512959] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:02:17.549299] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-09-18T22:02:17.552853] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-09-18T22:02:17.563889] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-09-18T22:02:17.569282] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-09-18T22:02:17.694534] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:02:17.720781] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-11. [2025-09-18T22:02:17.855033] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-18T22:02:18.067302] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-18T22:02:18.091057] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:02:18.119490] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-11. [2025-09-18T22:02:18.919591] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-09-18T22:02:19.300808] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-18T22:02:19.521948] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-18T22:02:19.719601] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-09-18T22:02:20.419175] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-18T22:02:20.519533] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-09-18T22:02:21.328097] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-09-18T22:02:21.346517] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-18T22:02:21.947712] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-18T22:02:21.956396] [INFO ] [REMOTE ] TECK: Full fetch complete (77139 records). [2025-09-18T22:02:21.956521] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-09-18T22:02:22.143343] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-09-18T22:02:22.368347] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-09-18T22:02:22.368435] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-09-18T22:02:22.369598] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-09-18T22:02:22.369698] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-09-18T22:02:22.371333] [DEBUG] [LOCAL ] TECK: Trimmed 77139 records to 53829 (keeping 200 days of data) [2025-09-18T22:02:22.703194] [DEBUG] [LOCAL ] TECK: Primary data saved (53829 records). [2025-09-18T22:02:22.703343] [INFO ] [MAIN ] TECK: Full history saved. [2025-09-18T22:02:22.703445] [INFO ] [MAIN ] Update Progress: 2067/2372 symbols completed. TECK took 41.1s. Estimated remaining: 44m 37s. Rate: 6.8 symbols/min [2025-09-18T22:02:22.880199] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:02:22.903772] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-18T22:02:22.919517] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-09-18T22:02:22.930296] [DEBUG] [LOCAL ] TEO: Loaded 21530 existing records from primary storage. [2025-09-18T22:02:22.930433] [INFO ] [MAIN ] TEO: Loaded 21530 existing records. [2025-09-18T22:02:23.122592] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:02:23.134602] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-18T22:02:23.138634] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-09-18T22:02:23.139402] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-09-18T22:02:23.140026] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-09-18T22:02:23.140087] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-09-18T22:02:23.525570] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:02:23.719556] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-11. [2025-09-18T22:02:24.397324] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-18T22:02:24.519547] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-09-18T22:02:24.832461] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-18T22:02:25.319566] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-09-18T22:02:25.425564] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-18T22:02:26.119543] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-09-18T22:02:26.202785] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-18T22:02:26.919589] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-09-18T22:02:27.658342] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-18T22:02:27.702068] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T22:02:27.719516] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-09-18T22:02:28.519601] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-09-18T22:02:28.940079] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-18T22:02:29.319534] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-09-18T22:02:29.384521] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-18T22:02:30.119586] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-09-18T22:02:30.635570] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-18T22:02:30.919537] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-09-18T22:02:31.017301] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-18T22:02:31.719557] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-09-18T22:02:32.140330] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T22:02:32.524738] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-09-18T22:02:32.534875] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-18T22:02:33.319544] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-09-18T22:02:33.896512] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-18T22:02:34.119549] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-09-18T22:02:34.192318] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-18T22:02:34.919550] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-09-18T22:02:35.333100] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-18T22:02:35.719612] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-09-18T22:02:35.762435] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-18T22:02:36.519580] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-09-18T22:02:36.667040] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-18T22:02:36.671156] [INFO ] [REMOTE ] TEI: Full fetch complete (29743 records). [2025-09-18T22:02:36.671349] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-09-18T22:02:37.094571] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-09-18T22:02:37.094794] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-09-18T22:02:37.096100] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-09-18T22:02:37.096183] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-09-18T22:02:37.097692] [DEBUG] [LOCAL ] TEI: Trimmed 29743 records to 20582 (keeping 200 days of data) [2025-09-18T22:02:37.245558] [DEBUG] [LOCAL ] TEI: Primary data saved (20582 records). [2025-09-18T22:02:37.245813] [INFO ] [MAIN ] TEI: Full history saved. [2025-09-18T22:02:37.245967] [INFO ] [MAIN ] Update Progress: 2068/2372 symbols completed. TEI took 31.2s. Estimated remaining: 44m 29s. Rate: 6.8 symbols/min [2025-09-18T22:02:37.324858] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-09-18T22:02:37.433800] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:02:37.508329] [DEBUG] [LOCAL ] TEVA: Loaded 53632 existing records from primary storage. [2025-09-18T22:02:37.508747] [INFO ] [MAIN ] TEVA: Loaded 53632 existing records. [2025-09-18T22:02:37.744309] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-18T22:02:37.742906] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:02:37.750512] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-09-18T22:02:37.750608] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-09-18T22:02:37.752208] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-09-18T22:02:37.752294] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-09-18T22:02:38.133980] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-09-18T22:02:38.141144] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:02:38.372241] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-18T22:02:38.919583] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-09-18T22:02:39.012868] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-18T22:02:39.719542] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-09-18T22:02:40.516839] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-18T22:02:40.525514] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-09-18T22:02:40.931146] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-18T22:02:41.319560] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-09-18T22:02:41.703222] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-18T22:02:42.119606] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-11. [2025-09-18T22:02:42.363160] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-18T22:02:42.919564] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-09-18T22:02:43.719545] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-09-18T22:02:44.013733] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-18T22:02:44.043343] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-18T22:02:44.419361] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-18T22:02:44.519491] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-09-18T22:02:45.319551] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-09-18T22:02:45.685620] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-18T22:02:45.690149] [INFO ] [REMOTE ] TEO: Full fetch complete (32599 records). [2025-09-18T22:02:45.690259] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-09-18T22:02:46.102532] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-09-18T22:02:46.102634] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-09-18T22:02:46.103316] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-09-18T22:02:46.103362] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-09-18T22:02:46.104257] [DEBUG] [LOCAL ] TEO: Trimmed 32599 records to 21772 (keeping 200 days of data) [2025-09-18T22:02:46.150689] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-09-18T22:02:46.236366] [DEBUG] [LOCAL ] TEO: Primary data saved (21772 records). [2025-09-18T22:02:46.236526] [INFO ] [MAIN ] TEO: Full history saved. [2025-09-18T22:02:46.236634] [INFO ] [MAIN ] Update Progress: 2069/2372 symbols completed. TEO took 23.5s. Estimated remaining: 44m 20s. Rate: 6.8 symbols/min [2025-09-18T22:02:46.409046] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:02:46.450305] [DEBUG] [LOCAL ] TEX: Loaded 45024 existing records from primary storage. [2025-09-18T22:02:46.450472] [INFO ] [MAIN ] TEX: Loaded 45024 existing records. [2025-09-18T22:02:46.628254] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:02:46.628498] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-09-18T22:02:46.628546] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-09-18T22:02:46.629498] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-09-18T22:02:46.629559] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-09-18T22:02:46.925976] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-09-18T22:02:46.998956] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:02:47.058632] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-18T22:02:47.474005] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-18T22:02:47.479108] [INFO ] [REMOTE ] TEN: Full fetch complete (44957 records). [2025-09-18T22:02:47.479200] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-09-18T22:02:47.724781] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-11. [2025-09-18T22:02:47.888608] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-09-18T22:02:47.888724] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-09-18T22:02:47.889547] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-09-18T22:02:47.889590] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-09-18T22:02:47.890592] [DEBUG] [LOCAL ] TEN: Trimmed 44957 records to 31428 (keeping 200 days of data) [2025-09-18T22:02:48.080610] [DEBUG] [LOCAL ] TEN: Primary data saved (31428 records). [2025-09-18T22:02:48.080777] [INFO ] [MAIN ] TEN: Full history saved. [2025-09-18T22:02:48.080870] [INFO ] [MAIN ] Update Progress: 2070/2372 symbols completed. TEN took 31.5s. Estimated remaining: 44m 10s. Rate: 6.8 symbols/min [2025-09-18T22:02:48.249891] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:02:48.301494] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-09-18T22:02:48.301671] [INFO ] [MAIN ] TFC: Loaded 53667 existing records. [2025-09-18T22:02:48.478057] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:02:48.478309] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-09-18T22:02:48.478356] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-09-18T22:02:48.479506] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-09-18T22:02:48.479567] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-09-18T22:02:48.533744] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-09-18T22:02:48.850273] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:02:48.904406] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-18T22:02:49.017080] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-18T22:02:49.319557] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-11. [2025-09-18T22:02:50.119516] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-09-18T22:02:50.507669] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-18T22:02:50.747453] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T22:02:50.919573] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-09-18T22:02:51.492052] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-18T22:02:51.719576] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-09-18T22:02:52.519590] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-09-18T22:02:53.036592] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-18T22:02:53.208490] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T22:02:53.319524] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-09-18T22:02:54.030625] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-18T22:02:54.119611] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-09-18T22:02:54.919559] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-09-18T22:02:55.719553] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-09-18T22:02:55.754047] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-18T22:02:55.837891] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-18T22:02:56.021525] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-18T22:02:56.519586] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-09-18T22:02:57.319567] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-09-18T22:02:57.362474] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-18T22:02:57.945196] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T22:02:58.119574] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-09-18T22:02:58.919535] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-09-18T22:02:59.335496] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-18T22:02:59.719545] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-09-18T22:02:59.767130] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-18T22:03:00.309310] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-18T22:03:00.519603] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-09-18T22:03:01.319567] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-09-18T22:03:02.071671] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-18T22:03:02.119569] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-09-18T22:03:02.858008] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-18T22:03:02.919586] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-09-18T22:03:03.719557] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-09-18T22:03:05.159578] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (3.84 seconds). [2025-09-18T22:03:05.171218] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-09-18T22:03:05.191792] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-18T22:03:05.198664] [INFO ] [REMOTE ] TEL: Full fetch complete (73109 records). [2025-09-18T22:03:05.198787] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-09-18T22:03:05.667845] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-09-18T22:03:05.668020] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-09-18T22:03:05.669258] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-09-18T22:03:05.669462] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-09-18T22:03:05.671580] [DEBUG] [LOCAL ] TEL: Trimmed 73109 records to 51567 (keeping 200 days of data) [2025-09-18T22:03:05.706796] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (3.59 seconds). [2025-09-18T22:03:05.823527] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-09-18T22:03:06.094162] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-18T22:03:06.119723] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-09-18T22:03:06.252794] [DEBUG] [LOCAL ] TEL: Primary data saved (51567 records). [2025-09-18T22:03:06.253022] [INFO ] [MAIN ] TEL: Full history saved. [2025-09-18T22:03:06.255675] [INFO ] [MAIN ] Update Progress: 2071/2372 symbols completed. TEL took 49.9s. Estimated remaining: 44m 3s. Rate: 6.8 symbols/min [2025-09-18T22:03:06.515103] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:03:06.569139] [DEBUG] [LOCAL ] TFII: Loaded 34883 existing records from primary storage. [2025-09-18T22:03:06.569343] [INFO ] [MAIN ] TFII: Loaded 34883 existing records. [2025-09-18T22:03:06.839452] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:03:06.840111] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-09-18T22:03:06.840258] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-09-18T22:03:06.841416] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-09-18T22:03:06.841501] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-09-18T22:03:07.314245] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-18T22:03:07.356343] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:03:07.356914] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-11. [2025-09-18T22:03:07.719557] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-09-18T22:03:07.904855] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-18T22:03:08.040455] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-18T22:03:08.475792] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T22:03:08.519500] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-09-18T22:03:09.229303] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-18T22:03:09.319604] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-09-18T22:03:09.396094] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T22:03:10.119545] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-09-18T22:03:10.920771] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-09-18T22:03:10.920622] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-18T22:03:11.166485] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-18T22:03:11.719561] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-09-18T22:03:12.519596] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-09-18T22:03:12.589469] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-18T22:03:13.319540] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-09-18T22:03:14.119618] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-09-18T22:03:14.376732] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-18T22:03:14.603252] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-09-18T22:03:14.919554] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-09-18T22:03:15.719514] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-09-18T22:03:15.828959] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-18T22:03:16.519552] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-09-18T22:03:16.560635] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T22:03:16.800359] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-18T22:03:17.081037] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-18T22:03:17.319594] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-09-18T22:03:17.691687] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-18T22:03:17.764184] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-18T22:03:17.771587] [INFO ] [REMOTE ] TFC: Full fetch complete (77522 records). [2025-09-18T22:03:17.771744] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-09-18T22:03:18.124701] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-09-18T22:03:18.172587] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-09-18T22:03:18.172704] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-09-18T22:03:18.173834] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-09-18T22:03:18.173913] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-09-18T22:03:18.175726] [DEBUG] [LOCAL ] TFC: Trimmed 77522 records to 54057 (keeping 200 days of data) [2025-09-18T22:03:18.503991] [DEBUG] [LOCAL ] TFC: Primary data saved (54057 records). [2025-09-18T22:03:18.504129] [INFO ] [MAIN ] TFC: Full history saved. [2025-09-18T22:03:18.504237] [INFO ] [MAIN ] Update Progress: 2072/2372 symbols completed. TFC took 30.4s. Estimated remaining: 43m 54s. Rate: 6.8 symbols/min [2025-09-18T22:03:18.678554] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:03:18.700932] [DEBUG] [LOCAL ] TFIN: Loaded 23553 existing records from primary storage. [2025-09-18T22:03:18.701105] [INFO ] [MAIN ] TFIN: Loaded 23553 existing records. [2025-09-18T22:03:18.881342] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:03:18.881620] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-09-18T22:03:18.881713] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-09-18T22:03:18.882309] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-09-18T22:03:18.882368] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-09-18T22:03:18.925892] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-09-18T22:03:19.242210] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:03:19.719613] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-11. [2025-09-18T22:03:19.965160] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-18T22:03:19.973744] [INFO ] [REMOTE ] TEVA: Full fetch complete (77521 records). [2025-09-18T22:03:19.973871] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-09-18T22:03:20.393729] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-09-18T22:03:20.393907] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-09-18T22:03:20.395097] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-09-18T22:03:20.395225] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-09-18T22:03:20.397039] [DEBUG] [LOCAL ] TEVA: Trimmed 77521 records to 54022 (keeping 200 days of data) [2025-09-18T22:03:20.518856] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-18T22:03:20.528953] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-09-18T22:03:20.757814] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-18T22:03:20.786755] [DEBUG] [LOCAL ] TEVA: Primary data saved (54022 records). [2025-09-18T22:03:20.786923] [INFO ] [MAIN ] TEVA: Full history saved. [2025-09-18T22:03:20.788394] [INFO ] [MAIN ] Update Progress: 2073/2372 symbols completed. TEVA took 43.5s. Estimated remaining: 43m 45s. Rate: 6.8 symbols/min [2025-09-18T22:03:20.956890] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:03:20.995765] [DEBUG] [LOCAL ] TFPM: Loaded 36949 existing records from primary storage. [2025-09-18T22:03:20.995988] [INFO ] [MAIN ] TFPM: Loaded 36949 existing records. [2025-09-18T22:03:21.179404] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:03:21.179694] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-09-18T22:03:21.179753] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-09-18T22:03:21.181034] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-09-18T22:03:21.181096] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-09-18T22:03:21.324735] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-09-18T22:03:21.547297] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:03:21.921826] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T22:03:22.119619] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-11. [2025-09-18T22:03:22.919561] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-09-18T22:03:23.100751] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-18T22:03:23.291189] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-18T22:03:23.719570] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-09-18T22:03:24.093262] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-18T22:03:24.313902] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-18T22:03:24.519560] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-09-18T22:03:25.319539] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-09-18T22:03:25.511235] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-18T22:03:26.119625] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-09-18T22:03:26.530421] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-18T22:03:26.537169] [INFO ] [REMOTE ] TEX: Full fetch complete (64651 records). [2025-09-18T22:03:26.537311] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-09-18T22:03:26.930191] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-09-18T22:03:26.934574] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-09-18T22:03:26.934731] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-09-18T22:03:26.935788] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-09-18T22:03:26.935982] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-09-18T22:03:26.937305] [DEBUG] [LOCAL ] TEX: Trimmed 64651 records to 45339 (keeping 200 days of data) [2025-09-18T22:03:27.184615] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-18T22:03:27.244926] [DEBUG] [LOCAL ] TEX: Primary data saved (45339 records). [2025-09-18T22:03:27.245087] [INFO ] [MAIN ] TEX: Full history saved. [2025-09-18T22:03:27.245208] [INFO ] [MAIN ] Update Progress: 2074/2372 symbols completed. TEX took 41.0s. Estimated remaining: 43m 36s. Rate: 6.8 symbols/min [2025-09-18T22:03:27.418200] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:03:27.462219] [DEBUG] [LOCAL ] TFX: Loaded 37745 existing records from primary storage. [2025-09-18T22:03:27.462434] [INFO ] [MAIN ] TFX: Loaded 37745 existing records. [2025-09-18T22:03:27.648047] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:03:27.648340] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-09-18T22:03:27.648393] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-09-18T22:03:27.649384] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-09-18T22:03:27.649447] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-09-18T22:03:27.724868] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-09-18T22:03:28.022878] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:03:28.419544] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T22:03:28.519554] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-11. [2025-09-18T22:03:29.319556] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-09-18T22:03:29.581473] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-18T22:03:30.080023] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-18T22:03:30.100742] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-18T22:03:30.119493] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-09-18T22:03:30.919531] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-09-18T22:03:31.612816] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T22:03:31.719495] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-09-18T22:03:31.843398] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-18T22:03:32.519543] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-09-18T22:03:33.094503] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T22:03:33.319587] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-09-18T22:03:33.775477] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-18T22:03:34.119536] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-09-18T22:03:34.410672] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-18T22:03:34.919516] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-09-18T22:03:34.943209] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-18T22:03:35.719518] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-09-18T22:03:36.095489] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-18T22:03:36.099945] [INFO ] [REMOTE ] TFII: Full fetch complete (47467 records). [2025-09-18T22:03:36.100081] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-09-18T22:03:36.478823] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-09-18T22:03:36.478966] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-09-18T22:03:36.479842] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-09-18T22:03:36.479910] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-09-18T22:03:36.481121] [DEBUG] [LOCAL ] TFII: Trimmed 47467 records to 35116 (keeping 200 days of data) [2025-09-18T22:03:36.537045] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-09-18T22:03:36.705464] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-18T22:03:36.725090] [DEBUG] [LOCAL ] TFII: Primary data saved (35116 records). [2025-09-18T22:03:36.725203] [INFO ] [MAIN ] TFII: Full history saved. [2025-09-18T22:03:36.725327] [INFO ] [MAIN ] Update Progress: 2075/2372 symbols completed. TFII took 30.5s. Estimated remaining: 43m 27s. Rate: 6.8 symbols/min [2025-09-18T22:03:36.895763] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:03:36.907332] [DEBUG] [LOCAL ] TG: Loaded 10344 existing records from primary storage. [2025-09-18T22:03:36.907450] [INFO ] [MAIN ] TG: Loaded 10344 existing records. [2025-09-18T22:03:37.102019] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:03:37.102289] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-09-18T22:03:37.102339] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-09-18T22:03:37.102705] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-09-18T22:03:37.102767] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-09-18T22:03:37.331849] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-09-18T22:03:37.470683] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:03:38.059505] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-18T22:03:38.119505] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-09-18T22:03:38.338600] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-18T22:03:38.919540] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-09-18T22:03:39.639540] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-18T22:03:39.719557] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-11. [2025-09-18T22:03:40.009962] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-18T22:03:40.519527] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-09-18T22:03:40.532206] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-18T22:03:41.319523] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-09-18T22:03:41.403875] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-18T22:03:41.407439] [INFO ] [REMOTE ] TFIN: Full fetch complete (30646 records). [2025-09-18T22:03:41.407575] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-09-18T22:03:41.797398] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-09-18T22:03:41.797488] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-09-18T22:03:41.798376] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-09-18T22:03:41.798463] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-09-18T22:03:41.799566] [DEBUG] [LOCAL ] TFIN: Trimmed 30646 records to 23775 (keeping 200 days of data) [2025-09-18T22:03:41.974410] [DEBUG] [LOCAL ] TFIN: Primary data saved (23775 records). [2025-09-18T22:03:41.974553] [INFO ] [MAIN ] TFIN: Full history saved. [2025-09-18T22:03:41.974744] [INFO ] [MAIN ] Update Progress: 2076/2372 symbols completed. TFIN took 23.5s. Estimated remaining: 43m 18s. Rate: 6.8 symbols/min [2025-09-18T22:03:42.144717] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-09-18T22:03:42.148037] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:03:42.148163] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-09-18T22:03:42.149039] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-09-18T22:03:42.149184] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-09-18T22:03:42.149228] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-18T22:03:42.149270] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-18T22:03:42.149302] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-09-18T22:03:42.455604] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-18T22:03:42.538392] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:03:42.919582] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-11. [2025-09-18T22:03:43.127150] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:03:43.127494] [WARN ] [REMOTE ] TGE: No data returned for month 2024-11 [2025-09-18T22:03:43.617904] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-18T22:03:43.719518] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-09-18T22:03:44.519540] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-09-18T22:03:45.056837] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-18T22:03:45.319543] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-09-18T22:03:45.329752] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-18T22:03:45.555769] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:03:45.556151] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-09-18T22:03:46.119546] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-09-18T22:03:46.919560] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-09-18T22:03:47.246437] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-18T22:03:47.719561] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-09-18T22:03:48.147258] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-18T22:03:48.519597] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-09-18T22:03:48.971421] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T22:03:49.054716] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-18T22:03:49.319569] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-09-18T22:03:50.119545] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-01. [2025-09-18T22:03:50.178700] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-18T22:03:50.333832] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:03:50.334199] [WARN ] [REMOTE ] TGE: No data returned for month 2025-01 [2025-09-18T22:03:50.919550] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-09-18T22:03:51.719502] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-02. [2025-09-18T22:03:51.956855] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:03:51.957257] [WARN ] [REMOTE ] TGE: No data returned for month 2025-02 [2025-09-18T22:03:52.196412] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-18T22:03:52.519551] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-09-18T22:03:53.319578] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-09-18T22:03:54.026384] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-18T22:03:54.090159] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-18T22:03:54.119501] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-03. [2025-09-18T22:03:54.356314] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:03:54.356629] [WARN ] [REMOTE ] TGE: No data returned for month 2025-03 [2025-09-18T22:03:54.919545] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-09-18T22:03:55.549401] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-18T22:03:55.719558] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-09-18T22:03:56.315689] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-18T22:03:56.519540] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-09-18T22:03:57.319560] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-09-18T22:03:57.336897] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-18T22:03:58.119558] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-09-18T22:03:58.458797] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-18T22:03:58.464385] [INFO ] [REMOTE ] TFX: Full fetch complete (53885 records). [2025-09-18T22:03:58.464525] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-09-18T22:03:58.841558] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-18T22:03:58.885343] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-09-18T22:03:58.885623] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-09-18T22:03:58.887516] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-09-18T22:03:58.887819] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-09-18T22:03:58.894412] [DEBUG] [LOCAL ] TFX: Trimmed 53885 records to 38015 (keeping 200 days of data) [2025-09-18T22:03:58.967270] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-09-18T22:03:59.164553] [DEBUG] [LOCAL ] TFX: Primary data saved (38015 records). [2025-09-18T22:03:59.164791] [INFO ] [MAIN ] TFX: Full history saved. [2025-09-18T22:03:59.164919] [INFO ] [MAIN ] Update Progress: 2077/2372 symbols completed. TFX took 31.9s. Estimated remaining: 43m 10s. Rate: 6.8 symbols/min [2025-09-18T22:03:59.701974] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-18T22:03:59.704292] [INFO ] [REMOTE ] TG: Full fetch complete (15254 records). [2025-09-18T22:03:59.704368] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-09-18T22:03:59.726638] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-04. [2025-09-18T22:04:00.006675] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:04:00.007378] [WARN ] [REMOTE ] TGE: No data returned for month 2025-04 [2025-09-18T22:04:00.088885] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-09-18T22:04:00.088967] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-09-18T22:04:00.089335] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-09-18T22:04:00.089375] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-09-18T22:04:00.089899] [DEBUG] [LOCAL ] TG: Trimmed 15254 records to 10478 (keeping 200 days of data) [2025-09-18T22:04:00.162404] [DEBUG] [LOCAL ] TG: Primary data saved (10478 records). [2025-09-18T22:04:00.162740] [INFO ] [MAIN ] TG: Full history saved. [2025-09-18T22:04:00.162850] [INFO ] [MAIN ] Update Progress: 2078/2372 symbols completed. TG took 23.4s. Estimated remaining: 43m 0s. Rate: 6.8 symbols/min [2025-09-18T22:04:00.519544] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-09-18T22:04:01.319584] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-05. [2025-09-18T22:04:01.819710] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:04:01.820242] [WARN ] [REMOTE ] TGE: No data returned for month 2025-05 [2025-09-18T22:04:01.840366] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T22:04:02.119556] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-06. [2025-09-18T22:04:02.919602] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-09-18T22:04:03.566024] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-18T22:04:03.719562] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-07. [2025-09-18T22:04:04.202716] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-18T22:04:04.327185] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-18T22:04:04.519586] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-09-18T22:04:05.319615] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-08. [2025-09-18T22:04:05.759332] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-18T22:04:06.119607] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-09-18T22:04:06.179548] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-18T22:04:06.919616] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-09. [2025-09-18T22:04:07.369988] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-18T22:04:07.682227] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-18T22:04:07.685045] [INFO ] [REMOTE ] TGE: Full fetch complete (8179 records). [2025-09-18T22:04:07.685313] [DEBUG] [VALIDATOR ] TGE: Validating primary data. [2025-09-18T22:04:07.729971] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-09-18T22:04:07.890978] [WARN ] [VALIDATOR ] TGE: Validation failed - insufficient historical data. Have 73 unique days, need 200 days [2025-09-18T22:04:07.891443] [FATAL] [MAIN ] TGE: Fetched primary data is invalid. Refusing to save it. [2025-09-18T22:04:07.891544] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to validation failure. [2025-09-18T22:04:07.891672] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-18T22:04:07.891811] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-18T22:04:07.891905] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-09-18T22:04:07.892023] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-09-18T22:04:07.892199] [INFO ] [MAIN ] Update Progress: 2079/2372 symbols completed. TGE took 25.9s. Estimated remaining: 42m 51s. Rate: 6.8 symbols/min [2025-09-18T22:04:09.375008] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-18T22:04:09.384474] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-09-18T22:04:10.723676] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-18T22:04:10.733337] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-09-18T22:04:12.019790] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-18T22:04:12.025558] [INFO ] [REMOTE ] TFPM: Full fetch complete (49910 records). [2025-09-18T22:04:12.025714] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-09-18T22:04:12.412141] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-09-18T22:04:12.412230] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-09-18T22:04:12.413082] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-09-18T22:04:12.413146] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-09-18T22:04:12.414276] [DEBUG] [LOCAL ] TFPM: Trimmed 49910 records to 37239 (keeping 200 days of data) [2025-09-18T22:04:12.663106] [DEBUG] [LOCAL ] TFPM: Primary data saved (37239 records). [2025-09-18T22:04:12.663293] [INFO ] [MAIN ] TFPM: Full history saved. [2025-09-18T22:04:12.664032] [INFO ] [MAIN ] Update Progress: 2080/2372 symbols completed. TFPM took 51.9s. Estimated remaining: 42m 42s. Rate: 6.8 symbols/min [2025-09-18T22:04:13.333965] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:04:13.291348] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:04:13.367016] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:04:13.392449] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:04:13.435999] [DEBUG] [LOCAL ] TGLS: Loaded 28588 existing records from primary storage. [2025-09-18T22:04:13.436381] [INFO ] [MAIN ] TGLS: Loaded 28588 existing records. [2025-09-18T22:04:13.667258] [DEBUG] [LOCAL ] TGS: Loaded 32159 existing records from primary storage. [2025-09-18T22:04:13.699509] [INFO ] [MAIN ] TGS: Loaded 32159 existing records. [2025-09-18T22:04:13.704111] [DEBUG] [LOCAL ] TGNA: Loaded 48676 existing records from primary storage. [2025-09-18T22:04:13.708204] [INFO ] [MAIN ] TGNA: Loaded 48676 existing records. [2025-09-18T22:04:13.707913] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:04:13.874050] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-09-18T22:04:13.841538] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-09-18T22:04:13.889754] [INFO ] [MAIN ] TGT: Loaded 53778 existing records. [2025-09-18T22:04:13.895008] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-09-18T22:04:13.947929] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-09-18T22:04:13.966792] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-09-18T22:04:14.250683] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:04:14.328801] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:04:14.328906] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-09-18T22:04:14.349233] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-09-18T22:04:14.338451] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-09-18T22:04:14.349326] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-09-18T22:04:14.417931] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-09-18T22:04:14.418071] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-09-18T22:04:14.425778] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-09-18T22:04:14.460337] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-09-18T22:04:14.483103] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:04:14.601680] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-09-18T22:04:14.634822] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-09-18T22:04:14.699417] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-09-18T22:04:14.713916] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-09-18T22:04:15.310868] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:04:15.387528] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-11. [2025-09-18T22:04:15.688984] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:04:15.805047] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-11. [2025-09-18T22:04:15.788936] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:04:15.818039] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-11. [2025-09-18T22:04:15.852196] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:04:15.852837] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-11. [2025-09-18T22:04:16.897084] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-18T22:04:16.903638] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-09-18T22:04:16.945627] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-18T22:04:16.952109] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-09-18T22:04:17.083861] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-18T22:04:17.093835] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-09-18T22:04:17.763726] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-18T22:04:17.775194] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-09-18T22:04:17.827850] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T22:04:17.830745] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-18T22:04:17.843414] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-09-18T22:04:17.843155] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-09-18T22:04:18.837675] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-18T22:04:18.848400] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-09-18T22:04:18.968032] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-18T22:04:18.975274] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-09-18T22:04:19.036538] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-18T22:04:19.725558] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-09-18T22:04:19.768737] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-18T22:04:19.932584] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-18T22:04:20.498687] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-18T22:04:20.519522] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-09-18T22:04:20.814549] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-18T22:04:21.319570] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-09-18T22:04:21.982329] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-18T22:04:22.119546] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-09-18T22:04:22.644218] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T22:04:22.919573] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-09-18T22:04:23.623585] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-18T22:04:23.719577] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-09-18T22:04:24.379925] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T22:04:24.519546] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-09-18T22:04:24.892495] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-18T22:04:25.319565] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-09-18T22:04:25.495622] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-18T22:04:26.119547] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-09-18T22:04:26.720250] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T22:04:26.919545] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-09-18T22:04:27.139251] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-18T22:04:27.719554] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-09-18T22:04:28.456177] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-18T22:04:28.519514] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-09-18T22:04:29.165350] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T22:04:29.319598] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-09-18T22:04:30.119586] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-09-18T22:04:30.434359] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-18T22:04:30.591223] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-18T22:04:30.919562] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-09-18T22:04:31.056040] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-18T22:04:31.719584] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-09-18T22:04:32.519510] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-09-18T22:04:32.701684] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-18T22:04:33.082857] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-18T22:04:33.319594] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-09-18T22:04:33.648856] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T22:04:34.119562] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-09-18T22:04:34.919560] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-09-18T22:04:35.524710] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-18T22:04:35.725834] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-09-18T22:04:35.757888] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-18T22:04:36.039682] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-18T22:04:36.519573] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-09-18T22:04:37.161099] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-18T22:04:37.319556] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-09-18T22:04:38.058377] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-18T22:04:38.064150] [INFO ] [REMOTE ] TGS: Full fetch complete (46959 records). [2025-09-18T22:04:38.064253] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-09-18T22:04:38.128524] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-09-18T22:04:38.462898] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-09-18T22:04:38.462986] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-09-18T22:04:38.463818] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-09-18T22:04:38.463894] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-09-18T22:04:38.464953] [DEBUG] [LOCAL ] TGS: Trimmed 46959 records to 32525 (keeping 200 days of data) [2025-09-18T22:04:38.652504] [DEBUG] [LOCAL ] TGS: Primary data saved (32525 records). [2025-09-18T22:04:38.652705] [INFO ] [MAIN ] TGS: Full history saved. [2025-09-18T22:04:38.652819] [INFO ] [MAIN ] Update Progress: 2081/2372 symbols completed. TGS took 26.0s. Estimated remaining: 42m 36s. Rate: 6.8 symbols/min [2025-09-18T22:04:38.823900] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:04:38.870993] [DEBUG] [LOCAL ] THC: Loaded 48343 existing records from primary storage. [2025-09-18T22:04:38.871137] [INFO ] [MAIN ] THC: Loaded 48343 existing records. [2025-09-18T22:04:38.927054] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-09-18T22:04:39.058522] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:04:39.059178] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-09-18T22:04:39.059294] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-09-18T22:04:39.060455] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-09-18T22:04:39.060523] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-09-18T22:04:39.177293] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-18T22:04:39.471761] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:04:39.719504] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-11. [2025-09-18T22:04:40.042442] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-18T22:04:40.461071] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-18T22:04:40.519554] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-09-18T22:04:41.233335] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-18T22:04:41.319559] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-09-18T22:04:42.119529] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-09-18T22:04:42.445077] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-18T22:04:42.449168] [INFO ] [REMOTE ] TGLS: Full fetch complete (40141 records). [2025-09-18T22:04:42.449256] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-09-18T22:04:42.827601] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-09-18T22:04:42.827737] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-09-18T22:04:42.828535] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-09-18T22:04:42.828674] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-09-18T22:04:42.829745] [DEBUG] [LOCAL ] TGLS: Trimmed 40141 records to 28792 (keeping 200 days of data) [2025-09-18T22:04:42.922569] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-09-18T22:04:43.028814] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-18T22:04:43.054009] [DEBUG] [LOCAL ] TGLS: Primary data saved (28792 records). [2025-09-18T22:04:43.054152] [INFO ] [MAIN ] TGLS: Full history saved. [2025-09-18T22:04:43.054293] [INFO ] [MAIN ] Update Progress: 2082/2372 symbols completed. TGLS took 30.4s. Estimated remaining: 42m 26s. Rate: 6.8 symbols/min [2025-09-18T22:04:43.224519] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:04:43.247137] [DEBUG] [LOCAL ] THG: Loaded 22174 existing records from primary storage. [2025-09-18T22:04:43.247282] [INFO ] [MAIN ] THG: Loaded 22174 existing records. [2025-09-18T22:04:43.424411] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:04:43.425686] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-09-18T22:04:43.425912] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-09-18T22:04:43.426609] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-09-18T22:04:43.426725] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-09-18T22:04:43.724691] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-09-18T22:04:43.820338] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:04:43.822267] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-18T22:04:44.117203] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-18T22:04:44.124114] [INFO ] [REMOTE ] TGNA: Full fetch complete (69671 records). [2025-09-18T22:04:44.124237] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-09-18T22:04:44.524763] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-09-18T22:04:44.525702] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-09-18T22:04:44.526678] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-09-18T22:04:44.527810] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-09-18T22:04:44.527980] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-09-18T22:04:44.529709] [DEBUG] [LOCAL ] TGNA: Trimmed 69671 records to 49066 (keeping 200 days of data) [2025-09-18T22:04:44.879314] [DEBUG] [LOCAL ] TGNA: Primary data saved (49066 records). [2025-09-18T22:04:44.879477] [INFO ] [MAIN ] TGNA: Full history saved. [2025-09-18T22:04:44.879584] [INFO ] [MAIN ] Update Progress: 2083/2372 symbols completed. TGNA took 32.2s. Estimated remaining: 42m 16s. Rate: 6.8 symbols/min [2025-09-18T22:04:45.054338] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:04:45.058589] [DEBUG] [LOCAL ] THIR: Loaded 2143 existing records from primary storage. [2025-09-18T22:04:45.058694] [INFO ] [MAIN ] THIR: Loaded 2143 existing records. [2025-09-18T22:04:45.235023] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:04:45.235267] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-09-18T22:04:45.235314] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-09-18T22:04:45.235524] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-09-18T22:04:45.235582] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-09-18T22:04:45.324838] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-11. [2025-09-18T22:04:45.594314] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:04:45.865464] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-18T22:04:45.950933] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T22:04:46.119509] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-11. [2025-09-18T22:04:46.384177] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-11 (0.26 seconds). [2025-09-18T22:04:46.397380] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-18T22:04:46.919548] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-09-18T22:04:47.218957] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-09-18T22:04:47.719565] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-09-18T22:04:48.519571] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-09-18T22:04:48.866967] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-18T22:04:49.138660] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T22:04:49.319566] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-09-18T22:04:50.119575] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-09-18T22:04:50.477998] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-18T22:04:50.919540] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-09-18T22:04:51.089857] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-18T22:04:51.719589] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-09-18T22:04:52.519598] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-09-18T22:04:52.626144] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-18T22:04:52.947467] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-18T22:04:53.319591] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-09-18T22:04:54.119618] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-09-18T22:04:54.477251] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-18T22:04:54.502424] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-18T22:04:54.526003] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-18T22:04:54.919551] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-09-18T22:04:55.719568] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-09-18T22:04:56.197036] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-18T22:04:56.519551] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-09-18T22:04:57.214148] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T22:04:57.319566] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-09-18T22:04:57.489468] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-18T22:04:57.656119] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-18T22:04:58.119569] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-09-18T22:04:58.919558] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-09-18T22:04:59.719560] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-09-18T22:05:00.162539] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-18T22:05:00.519568] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-09-18T22:05:00.573960] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-18T22:05:00.626574] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-18T22:05:01.319574] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-09-18T22:05:01.585236] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-18T22:05:01.614541] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-18T22:05:02.119563] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-09-18T22:05:02.659043] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-18T22:05:02.919547] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-09-18T22:05:03.395998] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-18T22:05:03.719548] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-09-18T22:05:04.149510] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-18T22:05:04.150511] [INFO ] [REMOTE ] THIR: Full fetch complete (2588 records). [2025-09-18T22:05:04.150581] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-09-18T22:05:04.508920] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-09-18T22:05:04.509000] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-09-18T22:05:04.509100] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-09-18T22:05:04.509139] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-09-18T22:05:04.509495] [DEBUG] [LOCAL ] THIR: Trimmed 2588 records to 2166 (keeping 200 days of data) [2025-09-18T22:05:04.522484] [DEBUG] [LOCAL ] THIR: Primary data saved (2166 records). [2025-09-18T22:05:04.522675] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-09-18T22:05:04.522589] [INFO ] [MAIN ] THIR: Full history saved. [2025-09-18T22:05:04.523123] [INFO ] [MAIN ] Update Progress: 2084/2372 symbols completed. THIR took 19.6s. Estimated remaining: 42m 9s. Rate: 6.8 symbols/min [2025-09-18T22:05:04.693469] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:05:04.697033] [DEBUG] [LOCAL ] THLV: Loaded 1683 existing records from primary storage. [2025-09-18T22:05:04.697115] [INFO ] [MAIN ] THLV: Loaded 1683 existing records. [2025-09-18T22:05:04.872271] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:05:04.872500] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-09-18T22:05:04.872547] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-09-18T22:05:04.872852] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-09-18T22:05:04.872912] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-09-18T22:05:05.233800] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:05:05.285673] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-18T22:05:05.293070] [INFO ] [REMOTE ] TGT: Full fetch complete (77834 records). [2025-09-18T22:05:05.293219] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-09-18T22:05:05.324740] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-11. [2025-09-18T22:05:05.686073] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-09-18T22:05:05.686160] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-09-18T22:05:05.687243] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-09-18T22:05:05.687311] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-09-18T22:05:05.688805] [DEBUG] [LOCAL ] TGT: Trimmed 77834 records to 54168 (keeping 200 days of data) [2025-09-18T22:05:05.817188] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-18T22:05:06.047997] [DEBUG] [LOCAL ] TGT: Primary data saved (54168 records). [2025-09-18T22:05:06.048160] [INFO ] [MAIN ] TGT: Full history saved. [2025-09-18T22:05:06.048255] [INFO ] [MAIN ] Update Progress: 2085/2372 symbols completed. TGT took 53.4s. Estimated remaining: 41m 59s. Rate: 6.8 symbols/min [2025-09-18T22:05:06.124699] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-09-18T22:05:06.218736] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:05:06.260969] [DEBUG] [LOCAL ] THO: Loaded 42467 existing records from primary storage. [2025-09-18T22:05:06.261143] [INFO ] [MAIN ] THO: Loaded 42467 existing records. [2025-09-18T22:05:06.443935] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:05:06.444294] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-09-18T22:05:06.444356] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-09-18T22:05:06.445521] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-09-18T22:05:06.445585] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-09-18T22:05:06.796808] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:05:06.919518] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-11. [2025-09-18T22:05:07.719554] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-09-18T22:05:08.035186] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T22:05:08.048457] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-18T22:05:08.085980] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-18T22:05:08.519561] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-09-18T22:05:09.319520] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-09-18T22:05:09.469708] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-18T22:05:09.635341] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-18T22:05:10.119535] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-09-18T22:05:10.919525] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-09-18T22:05:11.033186] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-18T22:05:11.719608] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-09-18T22:05:12.524761] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-09-18T22:05:12.542625] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-18T22:05:13.167918] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T22:05:13.319560] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-09-18T22:05:13.469919] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-18T22:05:14.119551] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-09-18T22:05:14.919586] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-09-18T22:05:14.942082] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-18T22:05:14.950477] [INFO ] [REMOTE ] THC: Full fetch complete (69499 records). [2025-09-18T22:05:14.950718] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-09-18T22:05:15.284904] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-18T22:05:15.394001] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-09-18T22:05:15.397970] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-09-18T22:05:15.399336] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-09-18T22:05:15.399685] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-09-18T22:05:15.399538] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-18T22:05:15.406194] [DEBUG] [LOCAL ] THC: Trimmed 69499 records to 48664 (keeping 200 days of data) [2025-09-18T22:05:15.721487] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-09-18T22:05:15.725471] [DEBUG] [LOCAL ] THC: Primary data saved (48664 records). [2025-09-18T22:05:15.726385] [INFO ] [MAIN ] THC: Full history saved. [2025-09-18T22:05:15.726493] [INFO ] [MAIN ] Update Progress: 2086/2372 symbols completed. THC took 37.1s. Estimated remaining: 41m 51s. Rate: 6.8 symbols/min [2025-09-18T22:05:15.912173] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:05:15.938773] [DEBUG] [LOCAL ] THQ: Loaded 24329 existing records from primary storage. [2025-09-18T22:05:15.938920] [INFO ] [MAIN ] THQ: Loaded 24329 existing records. [2025-09-18T22:05:16.133170] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:05:16.133438] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-09-18T22:05:16.133501] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-09-18T22:05:16.134167] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-09-18T22:05:16.134226] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-09-18T22:05:16.499942] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:05:16.519511] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-11. [2025-09-18T22:05:17.191170] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-18T22:05:17.323684] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-09-18T22:05:17.329224] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-18T22:05:17.787754] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-18T22:05:18.119556] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-09-18T22:05:18.890813] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-18T22:05:18.895228] [INFO ] [REMOTE ] THG: Full fetch complete (31133 records). [2025-09-18T22:05:18.895319] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-09-18T22:05:18.924717] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-09-18T22:05:19.272474] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-09-18T22:05:19.272571] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-09-18T22:05:19.273267] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-09-18T22:05:19.273344] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-09-18T22:05:19.274943] [DEBUG] [LOCAL ] THG: Trimmed 31133 records to 22325 (keeping 200 days of data) [2025-09-18T22:05:19.377014] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-18T22:05:19.428497] [DEBUG] [LOCAL ] THG: Primary data saved (22325 records). [2025-09-18T22:05:19.428796] [INFO ] [MAIN ] THG: Full history saved. [2025-09-18T22:05:19.428927] [INFO ] [MAIN ] Update Progress: 2087/2372 symbols completed. THG took 36.4s. Estimated remaining: 41m 41s. Rate: 6.8 symbols/min [2025-09-18T22:05:19.599565] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:05:19.620819] [DEBUG] [LOCAL ] THR: Loaded 20031 existing records from primary storage. [2025-09-18T22:05:19.620961] [INFO ] [MAIN ] THR: Loaded 20031 existing records. [2025-09-18T22:05:19.723904] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-09-18T22:05:19.806396] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:05:19.806722] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-09-18T22:05:19.806784] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-09-18T22:05:19.807345] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-09-18T22:05:19.807406] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-09-18T22:05:20.164859] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:05:20.519561] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-09-18T22:05:21.181121] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-18T22:05:21.210121] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T22:05:21.319536] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-09-18T22:05:22.119544] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-11. [2025-09-18T22:05:22.919515] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-09-18T22:05:23.003338] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-18T22:05:23.028907] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-18T22:05:23.719548] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-09-18T22:05:23.800753] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T22:05:24.519511] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-09-18T22:05:24.617031] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-18T22:05:24.867392] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-18T22:05:25.319590] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-09-18T22:05:26.119564] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-09-18T22:05:26.457914] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-18T22:05:26.593313] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-18T22:05:26.919557] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-09-18T22:05:27.719552] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-09-18T22:05:27.933541] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-18T22:05:28.475072] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-18T22:05:28.519509] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-09-18T22:05:29.319533] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-09-18T22:05:29.545053] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-18T22:05:30.111042] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-18T22:05:30.119487] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-09-18T22:05:30.919565] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-09-18T22:05:31.264349] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-18T22:05:31.719570] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-09-18T22:05:31.753808] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-18T22:05:32.154144] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-18T22:05:32.519619] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-09-18T22:05:33.319541] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-09-18T22:05:34.046828] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-18T22:05:34.119499] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-09-18T22:05:34.137334] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-18T22:05:34.919547] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-09-18T22:05:35.719617] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-09-18T22:05:35.806070] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-18T22:05:35.861876] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-18T22:05:36.054313] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-18T22:05:36.055235] [INFO ] [REMOTE ] THLV: Full fetch complete (2709 records). [2025-09-18T22:05:36.055315] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-09-18T22:05:36.421824] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-09-18T22:05:36.421925] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-09-18T22:05:36.422055] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-09-18T22:05:36.422135] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-09-18T22:05:36.422505] [DEBUG] [LOCAL ] THLV: Trimmed 2709 records to 1687 (keeping 200 days of data) [2025-09-18T22:05:36.433068] [DEBUG] [LOCAL ] THLV: Primary data saved (1687 records). [2025-09-18T22:05:36.433145] [INFO ] [MAIN ] THLV: Full history saved. [2025-09-18T22:05:36.433261] [INFO ] [MAIN ] Update Progress: 2088/2372 symbols completed. THLV took 31.9s. Estimated remaining: 41m 34s. Rate: 6.8 symbols/min [2025-09-18T22:05:36.524635] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-09-18T22:05:36.607542] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:05:36.644244] [DEBUG] [LOCAL ] THS: Loaded 37954 existing records from primary storage. [2025-09-18T22:05:36.644381] [INFO ] [MAIN ] THS: Loaded 37954 existing records. [2025-09-18T22:05:36.824539] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:05:36.824858] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-09-18T22:05:36.824906] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-09-18T22:05:36.825893] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-09-18T22:05:36.825953] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-09-18T22:05:37.188206] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:05:37.319550] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-09-18T22:05:37.923177] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-18T22:05:38.119545] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-09-18T22:05:38.423281] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-18T22:05:38.919536] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-09-18T22:05:39.551405] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T22:05:39.719527] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-09-18T22:05:40.039115] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-18T22:05:40.519543] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-11. [2025-09-18T22:05:41.204821] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T22:05:41.319530] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-09-18T22:05:41.841050] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-18T22:05:42.119567] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-09-18T22:05:42.458964] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-18T22:05:42.919568] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-09-18T22:05:43.199304] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-18T22:05:43.719603] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-09-18T22:05:43.987586] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-18T22:05:43.993717] [INFO ] [REMOTE ] THO: Full fetch complete (59912 records). [2025-09-18T22:05:43.993832] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-09-18T22:05:44.421354] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-09-18T22:05:44.421457] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-09-18T22:05:44.422591] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-09-18T22:05:44.422696] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-09-18T22:05:44.425363] [DEBUG] [LOCAL ] THO: Trimmed 59912 records to 42800 (keeping 200 days of data) [2025-09-18T22:05:44.519745] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-09-18T22:05:44.697729] [DEBUG] [LOCAL ] THO: Primary data saved (42800 records). [2025-09-18T22:05:44.697877] [INFO ] [MAIN ] THO: Full history saved. [2025-09-18T22:05:44.699635] [INFO ] [MAIN ] Update Progress: 2089/2372 symbols completed. THO took 38.7s. Estimated remaining: 41m 25s. Rate: 6.8 symbols/min [2025-09-18T22:05:44.871876] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:05:44.897526] [DEBUG] [LOCAL ] THW: Loaded 19172 existing records from primary storage. [2025-09-18T22:05:44.897704] [INFO ] [MAIN ] THW: Loaded 19172 existing records. [2025-09-18T22:05:45.031192] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-18T22:05:45.112226] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:05:45.112471] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-09-18T22:05:45.112539] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-09-18T22:05:45.113116] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-09-18T22:05:45.113176] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-09-18T22:05:45.329565] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-09-18T22:05:45.489696] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:05:45.527514] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-18T22:05:46.119586] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-09-18T22:05:46.548996] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-18T22:05:46.552901] [INFO ] [REMOTE ] THQ: Full fetch complete (34585 records). [2025-09-18T22:05:46.553018] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-09-18T22:05:46.924339] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-11. [2025-09-18T22:05:46.958686] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-09-18T22:05:46.958785] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-09-18T22:05:46.959925] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-09-18T22:05:46.960015] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-09-18T22:05:46.966682] [DEBUG] [LOCAL ] THQ: Trimmed 34585 records to 24478 (keeping 200 days of data) [2025-09-18T22:05:47.085586] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-18T22:05:47.157582] [DEBUG] [LOCAL ] THQ: Primary data saved (24478 records). [2025-09-18T22:05:47.157749] [INFO ] [MAIN ] THQ: Full history saved. [2025-09-18T22:05:47.157894] [INFO ] [MAIN ] Update Progress: 2090/2372 symbols completed. THQ took 31.4s. Estimated remaining: 41m 15s. Rate: 6.8 symbols/min [2025-09-18T22:05:47.338811] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:05:47.338997] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-09-18T22:05:47.339035] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-09-18T22:05:47.339179] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-09-18T22:05:47.339222] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-18T22:05:47.339265] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-18T22:05:47.339311] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-09-18T22:05:47.707932] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:05:47.719509] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-11. [2025-09-18T22:05:47.923018] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:05:47.923387] [WARN ] [REMOTE ] TIC: No data returned for month 2024-11 [2025-09-18T22:05:47.951489] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-18T22:05:48.519580] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-09-18T22:05:48.723815] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:05:48.724154] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-09-18T22:05:49.319574] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-09-18T22:05:50.119534] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-09-18T22:05:50.715205] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T22:05:50.909543] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-18T22:05:50.919492] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-09-18T22:05:51.719519] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-09-18T22:05:52.041068] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-18T22:05:52.519559] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-09-18T22:05:52.901276] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-18T22:05:53.319609] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-09-18T22:05:53.361555] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-18T22:05:53.364959] [INFO ] [REMOTE ] THR: Full fetch complete (28826 records). [2025-09-18T22:05:53.365040] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-09-18T22:05:53.738147] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-09-18T22:05:53.738235] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-09-18T22:05:53.738956] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-09-18T22:05:53.739023] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-09-18T22:05:53.739998] [DEBUG] [LOCAL ] THR: Trimmed 28826 records to 20234 (keeping 200 days of data) [2025-09-18T22:05:53.881861] [DEBUG] [LOCAL ] THR: Primary data saved (20234 records). [2025-09-18T22:05:53.881997] [INFO ] [MAIN ] THR: Full history saved. [2025-09-18T22:05:53.882117] [INFO ] [MAIN ] Update Progress: 2091/2372 symbols completed. THR took 34.5s. Estimated remaining: 41m 6s. Rate: 6.8 symbols/min [2025-09-18T22:05:54.069103] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:05:54.114546] [DEBUG] [LOCAL ] TIMB: Loaded 37186 existing records from primary storage. [2025-09-18T22:05:54.114745] [INFO ] [MAIN ] TIMB: Loaded 37186 existing records. [2025-09-18T22:05:54.126276] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-01. [2025-09-18T22:05:54.309551] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:05:54.309824] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-09-18T22:05:54.309878] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-09-18T22:05:54.310997] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-09-18T22:05:54.311058] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-09-18T22:05:54.447450] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:05:54.474413] [WARN ] [REMOTE ] TIC: No data returned for month 2025-01 [2025-09-18T22:05:54.713831] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:05:54.774177] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T22:05:54.919558] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-02. [2025-09-18T22:05:55.273419] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-18T22:05:55.719564] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-09-18T22:05:56.519565] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-03. [2025-09-18T22:05:56.994408] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-18T22:05:57.319551] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-09-18T22:05:57.435451] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-18T22:05:58.119556] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-04. [2025-09-18T22:05:58.491103] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-18T22:05:58.890242] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-18T22:05:58.919499] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-05. [2025-09-18T22:05:59.719575] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-09-18T22:06:00.283845] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-18T22:06:00.519559] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-06. [2025-09-18T22:06:00.876143] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-18T22:06:01.319559] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-11. [2025-09-18T22:06:02.121793] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-09-18T22:06:02.124847] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-18T22:06:02.919579] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-07. [2025-09-18T22:06:03.356221] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-11 (2.04 seconds). [2025-09-18T22:06:03.719559] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-09-18T22:06:04.519615] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-09-18T22:06:04.848809] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-09-18T22:06:05.319629] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-09-18T22:06:05.508276] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-18T22:06:05.613725] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-09-18T22:06:06.083536] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-18T22:06:06.119517] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-09-18T22:06:06.341698] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-18T22:06:06.347760] [INFO ] [REMOTE ] THS: Full fetch complete (53296 records). [2025-09-18T22:06:06.347896] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-09-18T22:06:06.762077] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-09-18T22:06:06.762189] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-09-18T22:06:06.763303] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-09-18T22:06:06.763393] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-09-18T22:06:06.764775] [DEBUG] [LOCAL ] THS: Trimmed 53296 records to 38245 (keeping 200 days of data) [2025-09-18T22:06:06.947639] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-08. [2025-09-18T22:06:07.021040] [DEBUG] [LOCAL ] THS: Primary data saved (38245 records). [2025-09-18T22:06:07.021212] [INFO ] [MAIN ] THS: Full history saved. [2025-09-18T22:06:07.021338] [INFO ] [MAIN ] Update Progress: 2092/2372 symbols completed. THS took 30.6s. Estimated remaining: 40m 58s. Rate: 6.8 symbols/min [2025-09-18T22:06:07.206490] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:06:07.212637] [DEBUG] [LOCAL ] TISI: Loaded 3865 existing records from primary storage. [2025-09-18T22:06:07.212756] [INFO ] [MAIN ] TISI: Loaded 3865 existing records. [2025-09-18T22:06:07.409407] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:06:07.409842] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-09-18T22:06:07.410027] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-09-18T22:06:07.410629] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-09-18T22:06:07.410742] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-09-18T22:06:07.509739] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-18T22:06:07.725460] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-09-18T22:06:07.806525] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:06:08.519589] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-11. [2025-09-18T22:06:08.627951] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-18T22:06:09.016075] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-18T22:06:09.083098] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-18T22:06:09.319629] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-09-18T22:06:10.119559] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-09-18T22:06:10.905252] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-18T22:06:10.927084] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-09-18T22:06:10.932745] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-18T22:06:11.719512] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-09. [2025-09-18T22:06:12.111409] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-18T22:06:12.519575] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-09-18T22:06:12.973754] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-18T22:06:12.980191] [INFO ] [REMOTE ] TIC: Full fetch complete (36764 records). [2025-09-18T22:06:12.980296] [DEBUG] [VALIDATOR ] TIC: Validating primary data. [2025-09-18T22:06:13.187000] [WARN ] [VALIDATOR ] TIC: Validation failed - insufficient historical data. Have 146 unique days, need 200 days [2025-09-18T22:06:13.187731] [FATAL] [MAIN ] TIC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T22:06:13.187808] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T22:06:13.187883] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-18T22:06:13.187974] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-18T22:06:13.188046] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-09-18T22:06:13.188131] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-09-18T22:06:13.188269] [INFO ] [MAIN ] Update Progress: 2093/2372 symbols completed. TIC took 26.0s. Estimated remaining: 40m 49s. Rate: 6.8 symbols/min [2025-09-18T22:06:13.324750] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-09-18T22:06:13.377162] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:06:13.410359] [DEBUG] [LOCAL ] TIXT: Loaded 31119 existing records from primary storage. [2025-09-18T22:06:13.410543] [INFO ] [MAIN ] TIXT: Loaded 31119 existing records. [2025-09-18T22:06:13.607632] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:06:13.607915] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-09-18T22:06:13.608069] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-09-18T22:06:13.609034] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-09-18T22:06:13.609100] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-09-18T22:06:14.024973] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:06:14.048483] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T22:06:14.119500] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-09-18T22:06:14.341784] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-18T22:06:14.919564] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-11. [2025-09-18T22:06:15.719576] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-09-18T22:06:15.803840] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-18T22:06:16.508386] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-18T22:06:16.519494] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-09-18T22:06:16.723697] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-18T22:06:17.319590] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-09-18T22:06:18.119543] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-09-18T22:06:18.919558] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-09-18T22:06:18.962931] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-18T22:06:19.048673] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-18T22:06:19.073149] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-18T22:06:19.339754] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-18T22:06:19.719576] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-09-18T22:06:20.373491] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-18T22:06:20.519578] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-09-18T22:06:21.319553] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-09-18T22:06:21.625595] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-18T22:06:22.119596] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-09-18T22:06:22.422569] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-18T22:06:22.556978] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-18T22:06:22.919556] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-09-18T22:06:23.719547] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-09-18T22:06:23.950444] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-18T22:06:24.519555] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-09-18T22:06:25.028370] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-18T22:06:25.319548] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-09-18T22:06:25.842722] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T22:06:26.119545] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-09-18T22:06:26.598446] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-18T22:06:26.919564] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-09-18T22:06:27.000957] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-18T22:06:27.719570] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-09-18T22:06:27.843042] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-18T22:06:28.519605] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-09-18T22:06:28.553491] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-18T22:06:29.097289] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-18T22:06:29.319543] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-09-18T22:06:30.119551] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-09-18T22:06:30.930165] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-09-18T22:06:30.932994] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-18T22:06:31.719538] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-09-18T22:06:31.791225] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-18T22:06:32.232193] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-18T22:06:32.519534] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-09-18T22:06:32.819308] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-18T22:06:33.117411] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-18T22:06:33.120341] [INFO ] [REMOTE ] THW: Full fetch complete (29427 records). [2025-09-18T22:06:33.120432] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-09-18T22:06:33.327774] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-09-18T22:06:33.494606] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-09-18T22:06:33.494753] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-09-18T22:06:33.495377] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-09-18T22:06:33.495420] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-09-18T22:06:33.496599] [DEBUG] [LOCAL ] THW: Trimmed 29427 records to 19276 (keeping 200 days of data) [2025-09-18T22:06:33.632304] [DEBUG] [LOCAL ] THW: Primary data saved (19276 records). [2025-09-18T22:06:33.632478] [INFO ] [MAIN ] THW: Full history saved. [2025-09-18T22:06:33.632607] [INFO ] [MAIN ] Update Progress: 2094/2372 symbols completed. THW took 48.9s. Estimated remaining: 40m 41s. Rate: 6.8 symbols/min [2025-09-18T22:06:33.805365] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:06:33.835040] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-18T22:06:33.879785] [DEBUG] [LOCAL ] TJX: Loaded 53676 existing records from primary storage. [2025-09-18T22:06:33.879941] [INFO ] [MAIN ] TJX: Loaded 53676 existing records. [2025-09-18T22:06:34.060276] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:06:34.060580] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-09-18T22:06:34.060637] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-09-18T22:06:34.062312] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-09-18T22:06:34.062374] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-09-18T22:06:34.125598] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-09-18T22:06:34.430705] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:06:34.919527] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-09-18T22:06:35.342634] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-18T22:06:35.555830] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-18T22:06:35.719534] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-09-18T22:06:36.519550] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-09-18T22:06:36.881666] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-18T22:06:36.882529] [INFO ] [REMOTE ] TISI: Full fetch complete (5069 records). [2025-09-18T22:06:36.882599] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-09-18T22:06:37.263361] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-09-18T22:06:37.263704] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-09-18T22:06:37.263971] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-09-18T22:06:37.264064] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-09-18T22:06:37.264983] [DEBUG] [LOCAL ] TISI: Trimmed 5069 records to 3886 (keeping 200 days of data) [2025-09-18T22:06:37.312099] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-18T22:06:37.324687] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-09-18T22:06:37.333223] [DEBUG] [LOCAL ] TISI: Primary data saved (3886 records). [2025-09-18T22:06:37.333419] [INFO ] [MAIN ] TISI: Full history saved. [2025-09-18T22:06:37.333574] [INFO ] [MAIN ] Update Progress: 2095/2372 symbols completed. TISI took 30.3s. Estimated remaining: 40m 32s. Rate: 6.8 symbols/min [2025-09-18T22:06:37.523873] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:06:37.566402] [DEBUG] [LOCAL ] TK: Loaded 39998 existing records from primary storage. [2025-09-18T22:06:37.566544] [INFO ] [MAIN ] TK: Loaded 39998 existing records. [2025-09-18T22:06:37.744463] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:06:37.744769] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-09-18T22:06:37.744852] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-09-18T22:06:37.746234] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-09-18T22:06:37.746295] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-09-18T22:06:38.110411] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:06:38.119499] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-11. [2025-09-18T22:06:38.411157] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-18T22:06:38.416294] [INFO ] [REMOTE ] TIMB: Full fetch complete (55323 records). [2025-09-18T22:06:38.416397] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-09-18T22:06:38.794523] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-09-18T22:06:38.794632] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-09-18T22:06:38.795605] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-09-18T22:06:38.795706] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-09-18T22:06:38.799051] [DEBUG] [LOCAL ] TIMB: Trimmed 55323 records to 37389 (keeping 200 days of data) [2025-09-18T22:06:38.919835] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-11. [2025-09-18T22:06:39.041384] [DEBUG] [LOCAL ] TIMB: Primary data saved (37389 records). [2025-09-18T22:06:39.041541] [INFO ] [MAIN ] TIMB: Full history saved. [2025-09-18T22:06:39.041668] [INFO ] [MAIN ] Update Progress: 2096/2372 symbols completed. TIMB took 45.2s. Estimated remaining: 40m 22s. Rate: 6.8 symbols/min [2025-09-18T22:06:39.217347] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:06:39.256825] [DEBUG] [LOCAL ] TKC: Loaded 37765 existing records from primary storage. [2025-09-18T22:06:39.256981] [INFO ] [MAIN ] TKC: Loaded 37765 existing records. [2025-09-18T22:06:39.442202] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:06:39.442509] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-09-18T22:06:39.442568] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-09-18T22:06:39.443356] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-09-18T22:06:39.443419] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-09-18T22:06:39.733197] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-09-18T22:06:39.854267] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:06:39.856301] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-18T22:06:40.519540] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-09-18T22:06:40.724697] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-18T22:06:41.170422] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-18T22:06:41.319517] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-09-18T22:06:41.721489] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-18T22:06:42.119575] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-09-18T22:06:42.479936] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-18T22:06:42.486670] [INFO ] [REMOTE ] TIXT: Full fetch complete (45244 records). [2025-09-18T22:06:42.486839] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-09-18T22:06:42.902816] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-09-18T22:06:42.902921] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-09-18T22:06:42.903892] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-09-18T22:06:42.903963] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-09-18T22:06:42.905226] [DEBUG] [LOCAL ] TIXT: Trimmed 45244 records to 31399 (keeping 200 days of data) [2025-09-18T22:06:42.949451] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-09-18T22:06:43.097315] [DEBUG] [LOCAL ] TIXT: Primary data saved (31399 records). [2025-09-18T22:06:43.097476] [INFO ] [MAIN ] TIXT: Full history saved. [2025-09-18T22:06:43.097598] [INFO ] [MAIN ] Update Progress: 2097/2372 symbols completed. TIXT took 29.9s. Estimated remaining: 40m 13s. Rate: 6.8 symbols/min [2025-09-18T22:06:43.271924] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:06:43.328283] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-18T22:06:43.352868] [DEBUG] [LOCAL ] TKO: Loaded 44407 existing records from primary storage. [2025-09-18T22:06:43.353048] [INFO ] [MAIN ] TKO: Loaded 44407 existing records. [2025-09-18T22:06:43.534660] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:06:43.534931] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-09-18T22:06:43.534979] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-09-18T22:06:43.536173] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-09-18T22:06:43.536232] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-09-18T22:06:43.724911] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-09-18T22:06:43.931221] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:06:44.519602] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-11. [2025-09-18T22:06:45.013241] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-18T22:06:45.069740] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-18T22:06:45.319582] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-09-18T22:06:45.578690] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-18T22:06:46.119570] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-09-18T22:06:46.827854] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T22:06:46.919513] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-09-18T22:06:47.719540] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-11. [2025-09-18T22:06:47.803890] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-18T22:06:48.302881] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-18T22:06:48.519558] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-09-18T22:06:49.054125] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-18T22:06:49.319613] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-09-18T22:06:49.792841] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-18T22:06:50.119601] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-09-18T22:06:50.919553] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-09-18T22:06:51.045841] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-18T22:06:51.107523] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-18T22:06:51.719597] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-09-18T22:06:52.320029] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-18T22:06:52.519564] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-09-18T22:06:53.319563] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-09-18T22:06:53.641559] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-18T22:06:53.678564] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-18T22:06:54.119566] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-09-18T22:06:54.402720] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-18T22:06:54.919584] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-09-18T22:06:55.719558] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-09-18T22:06:56.008334] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-18T22:06:56.173367] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T22:06:56.519566] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-09-18T22:06:57.302902] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T22:06:57.319563] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-09-18T22:06:57.497107] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-18T22:06:58.119613] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-09-18T22:06:58.919513] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-09-18T22:06:58.957473] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-18T22:06:59.284816] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-18T22:06:59.719561] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-09-18T22:07:00.519581] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-09-18T22:07:01.102562] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-18T22:07:01.241234] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-18T22:07:01.319515] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-09-18T22:07:01.553333] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-18T22:07:01.559519] [INFO ] [REMOTE ] TK: Full fetch complete (57316 records). [2025-09-18T22:07:01.559757] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-09-18T22:07:01.960688] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-09-18T22:07:01.960793] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-09-18T22:07:01.961724] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-09-18T22:07:01.961786] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-09-18T22:07:01.963056] [DEBUG] [LOCAL ] TK: Trimmed 57316 records to 40271 (keeping 200 days of data) [2025-09-18T22:07:02.124934] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-09-18T22:07:02.197247] [DEBUG] [LOCAL ] TK: Primary data saved (40271 records). [2025-09-18T22:07:02.197380] [INFO ] [MAIN ] TK: Full history saved. [2025-09-18T22:07:02.197462] [INFO ] [MAIN ] Update Progress: 2098/2372 symbols completed. TK took 24.9s. Estimated remaining: 40m 6s. Rate: 6.8 symbols/min [2025-09-18T22:07:02.380312] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:07:02.418917] [DEBUG] [LOCAL ] TKR: Loaded 40203 existing records from primary storage. [2025-09-18T22:07:02.419097] [INFO ] [MAIN ] TKR: Loaded 40203 existing records. [2025-09-18T22:07:02.607266] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:07:02.607599] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-09-18T22:07:02.607721] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-09-18T22:07:02.608912] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-09-18T22:07:02.608981] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-09-18T22:07:02.717627] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-18T22:07:02.924895] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-09-18T22:07:03.006301] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:07:03.719533] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-11. [2025-09-18T22:07:03.954316] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-18T22:07:04.139369] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-18T22:07:04.519557] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-09-18T22:07:04.830691] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-18T22:07:05.319571] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-09-18T22:07:05.690162] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T22:07:06.119558] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-09-18T22:07:06.919602] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-09-18T22:07:07.270048] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-18T22:07:07.340028] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-18T22:07:07.719559] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-09-18T22:07:08.429101] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T22:07:08.519549] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-09-18T22:07:08.832053] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T22:07:09.319557] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-09-18T22:07:09.937452] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T22:07:10.119556] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-09-18T22:07:10.447384] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-18T22:07:10.919572] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-09-18T22:07:11.559588] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-18T22:07:11.719612] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-09-18T22:07:12.251375] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T22:07:12.257448] [INFO ] [REMOTE ] TKC: Full fetch complete (50831 records). [2025-09-18T22:07:12.257558] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-09-18T22:07:12.524860] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-09-18T22:07:12.653492] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-09-18T22:07:12.653577] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-09-18T22:07:12.654464] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-09-18T22:07:12.654535] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-09-18T22:07:12.655975] [DEBUG] [LOCAL ] TKC: Trimmed 50831 records to 38120 (keeping 200 days of data) [2025-09-18T22:07:12.873982] [DEBUG] [LOCAL ] TKC: Primary data saved (38120 records). [2025-09-18T22:07:12.874174] [INFO ] [MAIN ] TKC: Full history saved. [2025-09-18T22:07:12.874280] [INFO ] [MAIN ] Update Progress: 2099/2372 symbols completed. TKC took 33.8s. Estimated remaining: 39m 57s. Rate: 6.8 symbols/min [2025-09-18T22:07:13.058631] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:07:13.084552] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-18T22:07:13.127850] [DEBUG] [LOCAL ] TLK: Loaded 39982 existing records from primary storage. [2025-09-18T22:07:13.127998] [INFO ] [MAIN ] TLK: Loaded 39982 existing records. [2025-09-18T22:07:13.312209] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:07:13.312460] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-09-18T22:07:13.312510] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-09-18T22:07:13.313569] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-09-18T22:07:13.313633] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-09-18T22:07:13.324740] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-09-18T22:07:13.682519] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:07:14.119516] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-11. [2025-09-18T22:07:14.634816] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-18T22:07:14.675222] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-18T22:07:14.919593] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-09-18T22:07:15.375977] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-18T22:07:15.719609] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-09-18T22:07:16.519583] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-09-18T22:07:16.967710] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-18T22:07:17.004277] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-18T22:07:17.038874] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-18T22:07:17.319561] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-09-18T22:07:17.841556] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-18T22:07:17.847934] [INFO ] [REMOTE ] TKO: Full fetch complete (64454 records). [2025-09-18T22:07:17.848072] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-09-18T22:07:18.124713] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-09-18T22:07:18.251412] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-09-18T22:07:18.251495] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-09-18T22:07:18.252511] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-09-18T22:07:18.252578] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-09-18T22:07:18.255730] [DEBUG] [LOCAL ] TKO: Trimmed 64454 records to 44746 (keeping 200 days of data) [2025-09-18T22:07:18.531374] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-18T22:07:18.540932] [INFO ] [REMOTE ] TJX: Full fetch complete (77542 records). [2025-09-18T22:07:18.541855] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-09-18T22:07:18.921118] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-09-18T22:07:18.952291] [DEBUG] [LOCAL ] TKO: Primary data saved (44746 records). [2025-09-18T22:07:18.986225] [INFO ] [MAIN ] TKO: Full history saved. [2025-09-18T22:07:19.005535] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-09-18T22:07:19.005957] [INFO ] [MAIN ] Update Progress: 2100/2372 symbols completed. TKO took 35.9s. Estimated remaining: 39m 48s. Rate: 6.8 symbols/min [2025-09-18T22:07:19.006035] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-09-18T22:07:19.007470] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-09-18T22:07:19.007555] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-09-18T22:07:19.113578] [DEBUG] [LOCAL ] TJX: Trimmed 77542 records to 54066 (keeping 200 days of data) [2025-09-18T22:07:19.283519] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:07:19.305985] [DEBUG] [LOCAL ] TLYS: Loaded 17016 existing records from primary storage. [2025-09-18T22:07:19.307216] [INFO ] [MAIN ] TLYS: Loaded 17016 existing records. [2025-09-18T22:07:19.535429] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:07:19.537200] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-09-18T22:07:19.538108] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-09-18T22:07:19.539866] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-09-18T22:07:19.540242] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-09-18T22:07:19.736786] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-09-18T22:07:19.942523] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:07:20.165086] [DEBUG] [LOCAL ] TJX: Primary data saved (54066 records). [2025-09-18T22:07:20.165235] [INFO ] [MAIN ] TJX: Full history saved. [2025-09-18T22:07:20.165873] [INFO ] [MAIN ] Update Progress: 2101/2372 symbols completed. TJX took 46.5s. Estimated remaining: 39m 38s. Rate: 6.8 symbols/min [2025-09-18T22:07:20.338602] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:07:20.338800] [DEBUG] [LOCAL ] TM: No existing data file found in primary storage. [2025-09-18T22:07:20.338846] [WARN ] [MAIN ] TM: No existing data found, performing full refresh instead. [2025-09-18T22:07:20.338988] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-09-18T22:07:20.339043] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-09-18T22:07:20.339111] [DEBUG] [LOCAL ] TM: No primary data file found to delete. [2025-09-18T22:07:20.339146] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-09-18T22:07:20.526202] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-11. [2025-09-18T22:07:20.709981] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:07:20.735787] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-18T22:07:20.818030] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-18T22:07:21.061636] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-18T22:07:21.319564] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-11. [2025-09-18T22:07:22.119566] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-09-18T22:07:22.777769] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-18T22:07:22.794238] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-18T22:07:22.919526] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-09-18T22:07:23.719540] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-09-18T22:07:24.445988] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T22:07:24.519556] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-09-18T22:07:25.196622] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-18T22:07:25.319553] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-09-18T22:07:26.065491] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-18T22:07:26.119518] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-09-18T22:07:26.650406] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-18T22:07:26.919560] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-09-18T22:07:27.545054] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-18T22:07:27.719561] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-09-18T22:07:27.762627] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-18T22:07:28.309334] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-18T22:07:28.519594] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-09-18T22:07:29.319563] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-09-18T22:07:29.732111] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-18T22:07:30.119560] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-09-18T22:07:30.824497] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-18T22:07:30.919536] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-09-18T22:07:31.358290] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-18T22:07:31.719550] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-09-18T22:07:32.347798] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-18T22:07:32.519545] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-09-18T22:07:32.809677] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-18T22:07:33.319546] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-09-18T22:07:33.687114] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-18T22:07:34.119539] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-09-18T22:07:34.368827] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-18T22:07:34.378106] [INFO ] [REMOTE ] TKR: Full fetch complete (57193 records). [2025-09-18T22:07:34.378308] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-09-18T22:07:34.787374] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-09-18T22:07:34.787483] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-09-18T22:07:34.788583] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-09-18T22:07:34.788677] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-09-18T22:07:34.789893] [DEBUG] [LOCAL ] TKR: Trimmed 57193 records to 40482 (keeping 200 days of data) [2025-09-18T22:07:34.969302] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-09-18T22:07:35.017966] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-18T22:07:35.058974] [DEBUG] [LOCAL ] TKR: Primary data saved (40482 records). [2025-09-18T22:07:35.059097] [INFO ] [MAIN ] TKR: Full history saved. [2025-09-18T22:07:35.059177] [INFO ] [MAIN ] Update Progress: 2102/2372 symbols completed. TKR took 32.9s. Estimated remaining: 39m 30s. Rate: 6.8 symbols/min [2025-09-18T22:07:35.229627] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:07:35.281690] [DEBUG] [LOCAL ] TME: Loaded 53200 existing records from primary storage. [2025-09-18T22:07:35.281901] [INFO ] [MAIN ] TME: Loaded 53200 existing records. [2025-09-18T22:07:35.459767] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:07:35.460071] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-09-18T22:07:35.460122] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-09-18T22:07:35.461524] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-09-18T22:07:35.461590] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-09-18T22:07:35.728143] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-09-18T22:07:35.818668] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:07:36.321989] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T22:07:36.336565] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-18T22:07:36.519540] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-11. [2025-09-18T22:07:37.319540] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-09-18T22:07:38.119560] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-09-18T22:07:38.213557] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-18T22:07:38.456741] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-18T22:07:38.919561] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-09-18T22:07:39.577627] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-18T22:07:39.719569] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-09-18T22:07:40.519578] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-09-18T22:07:40.566306] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-18T22:07:40.662606] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-18T22:07:41.319601] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-09-18T22:07:42.120807] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-09-18T22:07:42.120707] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-18T22:07:42.174795] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-18T22:07:42.919591] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-09-18T22:07:43.719549] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-09-18T22:07:43.887193] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-18T22:07:44.439984] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-18T22:07:44.519487] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-09-18T22:07:44.558135] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-18T22:07:45.319568] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-09-18T22:07:45.340195] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-18T22:07:45.342979] [INFO ] [REMOTE ] TLYS: Full fetch complete (21972 records). [2025-09-18T22:07:45.343060] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-09-18T22:07:45.720936] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-09-18T22:07:45.721033] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-09-18T22:07:45.721541] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-09-18T22:07:45.721619] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-09-18T22:07:45.722330] [DEBUG] [LOCAL ] TLYS: Trimmed 21972 records to 17081 (keeping 200 days of data) [2025-09-18T22:07:45.816375] [DEBUG] [LOCAL ] TLYS: Primary data saved (17081 records). [2025-09-18T22:07:45.816517] [INFO ] [MAIN ] TLYS: Full history saved. [2025-09-18T22:07:45.816660] [INFO ] [MAIN ] Update Progress: 2103/2372 symbols completed. TLYS took 26.8s. Estimated remaining: 39m 22s. Rate: 6.8 symbols/min [2025-09-18T22:07:45.985726] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:07:46.028113] [DEBUG] [LOCAL ] TMHC: Loaded 45617 existing records from primary storage. [2025-09-18T22:07:46.028259] [INFO ] [MAIN ] TMHC: Loaded 45617 existing records. [2025-09-18T22:07:46.125993] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-09-18T22:07:46.209298] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:07:46.210205] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-09-18T22:07:46.210264] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-09-18T22:07:46.211348] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-09-18T22:07:46.211411] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-09-18T22:07:46.568972] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:07:46.746251] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-18T22:07:46.919544] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-09-18T22:07:47.578455] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T22:07:47.719595] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-09-18T22:07:48.416167] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T22:07:48.519598] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-09-18T22:07:49.319589] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-09-18T22:07:49.437122] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-18T22:07:49.960046] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T22:07:50.119540] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-09-18T22:07:50.755782] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-18T22:07:50.919581] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-11. [2025-09-18T22:07:51.697112] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-18T22:07:51.719507] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-09-18T22:07:51.998824] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-18T22:07:52.519559] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-09-18T22:07:53.081535] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-18T22:07:53.319606] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-09-18T22:07:53.944746] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-18T22:07:54.119571] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-09-18T22:07:54.872827] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-18T22:07:54.919512] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-09-18T22:07:55.727451] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-09-18T22:07:55.751600] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-18T22:07:56.246942] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-18T22:07:56.519534] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-09-18T22:07:56.832763] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-18T22:07:56.837196] [INFO ] [REMOTE ] TM: Full fetch complete (53372 records). [2025-09-18T22:07:56.837290] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-09-18T22:07:57.231556] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-09-18T22:07:57.231671] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-09-18T22:07:57.232957] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-09-18T22:07:57.233050] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-09-18T22:07:57.238203] [DEBUG] [LOCAL ] TM: Trimmed 53372 records to 37307 (keeping 200 days of data) [2025-09-18T22:07:57.333691] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-09-18T22:07:57.477351] [DEBUG] [LOCAL ] TM: Primary data saved (37307 records). [2025-09-18T22:07:57.477508] [INFO ] [MAIN ] TM: Full history saved. [2025-09-18T22:07:57.477622] [INFO ] [MAIN ] Update Progress: 2104/2372 symbols completed. TM took 37.3s. Estimated remaining: 39m 13s. Rate: 6.8 symbols/min [2025-09-18T22:07:57.647866] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:07:57.705522] [DEBUG] [LOCAL ] TMO: Loaded 52380 existing records from primary storage. [2025-09-18T22:07:57.705705] [INFO ] [MAIN ] TMO: Loaded 52380 existing records. [2025-09-18T22:07:57.898331] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:07:57.899132] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-09-18T22:07:57.899252] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-09-18T22:07:57.900631] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-09-18T22:07:57.900732] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-09-18T22:07:58.030814] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-18T22:07:58.132694] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-09-18T22:07:58.310665] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:07:58.919527] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-09-18T22:07:59.411943] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-18T22:07:59.516848] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-18T22:07:59.719582] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-09-18T22:07:59.843635] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-18T22:07:59.849534] [INFO ] [REMOTE ] TLK: Full fetch complete (57480 records). [2025-09-18T22:07:59.849707] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-09-18T22:08:00.255867] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-09-18T22:08:00.255993] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-09-18T22:08:00.257258] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-09-18T22:08:00.257360] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-09-18T22:08:00.262056] [DEBUG] [LOCAL ] TLK: Trimmed 57480 records to 40251 (keeping 200 days of data) [2025-09-18T22:08:00.523931] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-11. [2025-09-18T22:08:00.525915] [DEBUG] [LOCAL ] TLK: Primary data saved (40251 records). [2025-09-18T22:08:00.526002] [INFO ] [MAIN ] TLK: Full history saved. [2025-09-18T22:08:00.526153] [INFO ] [MAIN ] Update Progress: 2105/2372 symbols completed. TLK took 47.7s. Estimated remaining: 39m 4s. Rate: 6.8 symbols/min [2025-09-18T22:08:00.699853] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:08:00.717240] [DEBUG] [LOCAL ] TNC: Loaded 15489 existing records from primary storage. [2025-09-18T22:08:00.717358] [INFO ] [MAIN ] TNC: Loaded 15489 existing records. [2025-09-18T22:08:00.896485] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:08:00.896813] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-09-18T22:08:00.896873] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-09-18T22:08:00.897324] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-09-18T22:08:00.897383] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-09-18T22:08:01.288065] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:08:01.319538] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-09-18T22:08:01.323441] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-18T22:08:02.119509] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-09-18T22:08:02.150958] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-18T22:08:02.919559] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-11. [2025-09-18T22:08:03.169056] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-18T22:08:03.447883] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T22:08:03.528522] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-18T22:08:03.719588] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-09-18T22:08:04.519631] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-09-18T22:08:04.827490] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T22:08:05.319555] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-09-18T22:08:06.119568] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-09-18T22:08:06.164967] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-18T22:08:06.389386] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-18T22:08:06.919543] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-09-18T22:08:07.719577] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-09-18T22:08:07.817228] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-18T22:08:07.951739] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-18T22:08:08.519629] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-09-18T22:08:09.319639] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-09-18T22:08:09.409578] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-18T22:08:09.503671] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-18T22:08:10.119617] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-09-18T22:08:10.706404] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-18T22:08:10.919587] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-09-18T22:08:11.568629] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T22:08:11.719635] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-09-18T22:08:12.092604] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-18T22:08:12.519607] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-09-18T22:08:13.247465] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T22:08:13.294114] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-18T22:08:13.319499] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-09-18T22:08:14.119566] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-09-18T22:08:14.734807] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-18T22:08:14.754932] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-18T22:08:14.919546] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-09-18T22:08:15.719558] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-09-18T22:08:16.413912] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T22:08:16.420736] [INFO ] [REMOTE ] TMHC: Full fetch complete (65601 records). [2025-09-18T22:08:16.420948] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-09-18T22:08:16.490921] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-18T22:08:16.522490] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-09-18T22:08:16.860304] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-09-18T22:08:16.860453] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-09-18T22:08:16.861733] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-09-18T22:08:16.861812] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-09-18T22:08:16.865297] [DEBUG] [LOCAL ] TMHC: Trimmed 65601 records to 45970 (keeping 200 days of data) [2025-09-18T22:08:17.154108] [DEBUG] [LOCAL ] TMHC: Primary data saved (45970 records). [2025-09-18T22:08:17.154257] [INFO ] [MAIN ] TMHC: Full history saved. [2025-09-18T22:08:17.154393] [INFO ] [MAIN ] Update Progress: 2106/2372 symbols completed. TMHC took 31.3s. Estimated remaining: 38m 56s. Rate: 6.8 symbols/min [2025-09-18T22:08:17.324035] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:08:17.324105] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-09-18T22:08:17.355331] [DEBUG] [LOCAL ] TNET: Loaded 29173 existing records from primary storage. [2025-09-18T22:08:17.355468] [INFO ] [MAIN ] TNET: Loaded 29173 existing records. [2025-09-18T22:08:17.532610] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:08:17.532906] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-09-18T22:08:17.532969] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-09-18T22:08:17.533846] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-09-18T22:08:17.533917] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-09-18T22:08:17.891001] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:08:18.119560] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-09-18T22:08:18.327866] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-18T22:08:18.911044] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T22:08:18.921459] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-11. [2025-09-18T22:08:19.002856] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-18T22:08:19.719554] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-09-18T22:08:20.058181] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-18T22:08:20.388690] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-18T22:08:20.391063] [INFO ] [REMOTE ] TNC: Full fetch complete (23312 records). [2025-09-18T22:08:20.391142] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-09-18T22:08:20.528103] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-09-18T22:08:20.755464] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-09-18T22:08:20.755546] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-09-18T22:08:20.756045] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-09-18T22:08:20.756107] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-09-18T22:08:20.756747] [DEBUG] [LOCAL ] TNC: Trimmed 23312 records to 15629 (keeping 200 days of data) [2025-09-18T22:08:20.862733] [DEBUG] [LOCAL ] TNC: Primary data saved (15629 records). [2025-09-18T22:08:20.863280] [INFO ] [MAIN ] TNC: Full history saved. [2025-09-18T22:08:20.863517] [INFO ] [MAIN ] Update Progress: 2107/2372 symbols completed. TNC took 20.3s. Estimated remaining: 38m 46s. Rate: 6.8 symbols/min [2025-09-18T22:08:21.039008] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:08:21.039233] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-09-18T22:08:21.039291] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-09-18T22:08:21.039533] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-09-18T22:08:21.039590] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-18T22:08:21.039636] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-18T22:08:21.039713] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-09-18T22:08:21.321930] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-09-18T22:08:21.403218] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:08:21.651839] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-18T22:08:22.119539] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-11. [2025-09-18T22:08:22.340401] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:08:22.340762] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-11 [2025-09-18T22:08:22.919554] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-09-18T22:08:23.106332] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-18T22:08:23.114791] [INFO ] [REMOTE ] TME: Full fetch complete (76754 records). [2025-09-18T22:08:23.114947] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-09-18T22:08:23.534302] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-09-18T22:08:23.534400] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-09-18T22:08:23.535480] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-09-18T22:08:23.535547] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-09-18T22:08:23.537071] [DEBUG] [LOCAL ] TME: Trimmed 76754 records to 53590 (keeping 200 days of data) [2025-09-18T22:08:23.721806] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-09-18T22:08:23.876861] [DEBUG] [LOCAL ] TME: Primary data saved (53590 records). [2025-09-18T22:08:23.877015] [INFO ] [MAIN ] TME: Full history saved. [2025-09-18T22:08:23.877138] [INFO ] [MAIN ] Update Progress: 2108/2372 symbols completed. TME took 48.8s. Estimated remaining: 38m 37s. Rate: 6.8 symbols/min [2025-09-18T22:08:23.999583] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:08:24.024747] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-09-18T22:08:24.050493] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:08:24.086180] [DEBUG] [LOCAL ] TNK: Loaded 35499 existing records from primary storage. [2025-09-18T22:08:24.086329] [INFO ] [MAIN ] TNK: Loaded 35499 existing records. [2025-09-18T22:08:24.261591] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:08:24.261874] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-09-18T22:08:24.261923] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-09-18T22:08:24.262864] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-09-18T22:08:24.262925] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-09-18T22:08:24.524734] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-09-18T22:08:24.622088] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:08:24.838960] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-18T22:08:25.319556] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-09-18T22:08:25.576567] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-18T22:08:26.119540] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-09-18T22:08:26.919559] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-01. [2025-09-18T22:08:27.139097] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:08:27.156332] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-01 [2025-09-18T22:08:27.173715] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-18T22:08:27.241017] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-18T22:08:27.719575] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-09-18T22:08:28.519557] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-11. [2025-09-18T22:08:28.844322] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-18T22:08:29.319555] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-09-18T22:08:29.619680] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-18T22:08:30.119534] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-09-18T22:08:30.919556] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-09-18T22:08:31.312632] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-18T22:08:31.343988] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-18T22:08:31.719543] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-09-18T22:08:32.002678] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-18T22:08:32.519538] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-02. [2025-09-18T22:08:32.724045] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:08:32.724448] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-02 [2025-09-18T22:08:33.319553] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-03. [2025-09-18T22:08:33.552756] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:08:33.553100] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-03 [2025-09-18T22:08:33.605704] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-18T22:08:34.119547] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-04. [2025-09-18T22:08:34.348261] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:08:34.348637] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-04 [2025-09-18T22:08:34.919550] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-05. [2025-09-18T22:08:35.138768] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:08:35.139147] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-05 [2025-09-18T22:08:35.719548] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-09-18T22:08:36.519560] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-09-18T22:08:36.983973] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-18T22:08:37.319563] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-09-18T22:08:38.103794] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-18T22:08:38.182911] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-09-18T22:08:38.205458] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-18T22:08:38.919572] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-09-18T22:08:39.475055] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-18T22:08:39.719572] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-09-18T22:08:40.440041] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T22:08:40.524614] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-09-18T22:08:40.535304] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-18T22:08:40.994285] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-18T22:08:41.001404] [INFO ] [REMOTE ] TMO: Full fetch complete (75340 records). [2025-09-18T22:08:41.001570] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-09-18T22:08:41.324622] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-09-18T22:08:41.401378] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-09-18T22:08:41.401473] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-09-18T22:08:41.402621] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-09-18T22:08:41.402722] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-09-18T22:08:41.404440] [DEBUG] [LOCAL ] TMO: Trimmed 75340 records to 52722 (keeping 200 days of data) [2025-09-18T22:08:41.762234] [DEBUG] [LOCAL ] TMO: Primary data saved (52722 records). [2025-09-18T22:08:41.762438] [INFO ] [MAIN ] TMO: Full history saved. [2025-09-18T22:08:41.763218] [INFO ] [MAIN ] Update Progress: 2109/2372 symbols completed. TMO took 44.3s. Estimated remaining: 38m 29s. Rate: 6.8 symbols/min [2025-09-18T22:08:41.939241] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:08:41.989783] [DEBUG] [LOCAL ] TNL: Loaded 42043 existing records from primary storage. [2025-09-18T22:08:41.989951] [INFO ] [MAIN ] TNL: Loaded 42043 existing records. [2025-09-18T22:08:42.129087] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-06. [2025-09-18T22:08:42.170377] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:08:42.170589] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-09-18T22:08:42.170637] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-09-18T22:08:42.171683] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-09-18T22:08:42.171744] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-09-18T22:08:42.530137] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:08:42.601988] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-18T22:08:42.912947] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-18T22:08:42.920781] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-07. [2025-09-18T22:08:43.630092] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-18T22:08:43.719526] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-09-18T22:08:44.519513] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-11. [2025-09-18T22:08:44.666679] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-18T22:08:44.670586] [INFO ] [REMOTE ] TNET: Full fetch complete (41582 records). [2025-09-18T22:08:44.670709] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-09-18T22:08:45.048429] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-09-18T22:08:45.048512] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-09-18T22:08:45.049423] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-09-18T22:08:45.049514] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-09-18T22:08:45.050494] [DEBUG] [LOCAL ] TNET: Trimmed 41582 records to 29368 (keeping 200 days of data) [2025-09-18T22:08:45.233957] [DEBUG] [LOCAL ] TNET: Primary data saved (29368 records). [2025-09-18T22:08:45.234127] [INFO ] [MAIN ] TNET: Full history saved. [2025-09-18T22:08:45.234221] [INFO ] [MAIN ] Update Progress: 2110/2372 symbols completed. TNET took 28.1s. Estimated remaining: 38m 20s. Rate: 6.8 symbols/min [2025-09-18T22:08:45.324743] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-08. [2025-09-18T22:08:45.405471] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:08:45.457080] [DEBUG] [LOCAL ] TOL: Loaded 51126 existing records from primary storage. [2025-09-18T22:08:45.457250] [INFO ] [MAIN ] TOL: Loaded 51126 existing records. [2025-09-18T22:08:45.638769] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:08:45.639144] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-09-18T22:08:45.639282] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-09-18T22:08:45.640508] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-09-18T22:08:45.640573] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-09-18T22:08:45.822724] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-18T22:08:45.942748] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-18T22:08:46.045813] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:08:46.119510] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-09. [2025-09-18T22:08:46.651889] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-18T22:08:46.653454] [INFO ] [REMOTE ] TNGY: Full fetch complete (3075 records). [2025-09-18T22:08:46.653525] [DEBUG] [VALIDATOR ] TNGY: Validating primary data. [2025-09-18T22:08:46.834106] [WARN ] [VALIDATOR ] TNGY: Validation failed - insufficient historical data. Have 66 unique days, need 200 days [2025-09-18T22:08:46.834320] [FATAL] [MAIN ] TNGY: Fetched primary data is invalid. Refusing to save it. [2025-09-18T22:08:46.834369] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to validation failure. [2025-09-18T22:08:46.834415] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-18T22:08:46.834471] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-18T22:08:46.834512] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-09-18T22:08:46.834568] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-09-18T22:08:46.834686] [INFO ] [MAIN ] Update Progress: 2111/2372 symbols completed. TNGY took 26.0s. Estimated remaining: 38m 10s. Rate: 6.8 symbols/min [2025-09-18T22:08:46.924758] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-11. [2025-09-18T22:08:47.013552] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:08:47.075669] [DEBUG] [LOCAL ] TOST: Loaded 53681 existing records from primary storage. [2025-09-18T22:08:47.075820] [INFO ] [MAIN ] TOST: Loaded 53681 existing records. [2025-09-18T22:08:47.255513] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:08:47.255818] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-09-18T22:08:47.255872] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-09-18T22:08:47.257162] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-09-18T22:08:47.257225] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-09-18T22:08:47.609069] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:08:47.719515] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-11. [2025-09-18T22:08:48.519566] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-09-18T22:08:48.699336] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-18T22:08:49.319625] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-09-18T22:08:49.406221] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-18T22:08:49.770039] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-18T22:08:50.119539] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-09-18T22:08:50.919612] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-09-18T22:08:51.043704] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-18T22:08:51.130346] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-18T22:08:51.719560] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-09-18T22:08:52.519535] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-09-18T22:08:52.591524] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-18T22:08:53.189521] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-18T22:08:53.319553] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-09-18T22:08:54.119616] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-09-18T22:08:54.254452] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-18T22:08:54.528818] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-18T22:08:54.919599] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-09-18T22:08:55.719563] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-09-18T22:08:56.103572] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-18T22:08:56.327986] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T22:08:56.519595] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-09-18T22:08:56.659687] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T22:08:57.319572] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-09-18T22:08:57.889241] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-18T22:08:58.119535] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-09-18T22:08:58.919530] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-09-18T22:08:59.069017] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-18T22:08:59.545862] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-18T22:08:59.719540] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-09-18T22:09:00.108105] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-18T22:09:00.519555] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-09-18T22:09:01.208180] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-18T22:09:01.319573] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-09-18T22:09:02.119634] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-09-18T22:09:02.641788] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-18T22:09:02.919589] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-09-18T22:09:03.719562] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-09-18T22:09:03.835999] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-09-18T22:09:04.519559] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-09-18T22:09:05.397940] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (3.28 seconds). [2025-09-18T22:09:05.407136] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-09-18T22:09:05.484059] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-09-18T22:09:05.979718] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T22:09:06.065141] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-18T22:09:06.119526] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-09-18T22:09:06.695407] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-18T22:09:06.919551] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-09-18T22:09:07.337799] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-18T22:09:07.719556] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-09-18T22:09:08.519600] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-09-18T22:09:08.860843] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-18T22:09:08.964138] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-18T22:09:09.319588] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-09-18T22:09:09.778228] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-18T22:09:10.119536] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-09-18T22:09:10.919531] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-09-18T22:09:10.978551] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-18T22:09:11.229754] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-18T22:09:11.719549] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-09-18T22:09:12.323442] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-18T22:09:12.519543] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-09-18T22:09:12.909300] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-18T22:09:12.915076] [INFO ] [REMOTE ] TNL: Full fetch complete (58625 records). [2025-09-18T22:09:12.915233] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-09-18T22:09:13.320143] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-09-18T22:09:13.319866] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-09-18T22:09:13.321115] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-09-18T22:09:13.322227] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-09-18T22:09:13.322401] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-09-18T22:09:13.323836] [DEBUG] [LOCAL ] TNL: Trimmed 58625 records to 42273 (keeping 200 days of data) [2025-09-18T22:09:13.593392] [DEBUG] [LOCAL ] TNL: Primary data saved (42273 records). [2025-09-18T22:09:13.593574] [INFO ] [MAIN ] TNL: Full history saved. [2025-09-18T22:09:13.594395] [INFO ] [MAIN ] Update Progress: 2112/2372 symbols completed. TNL took 31.8s. Estimated remaining: 38m 4s. Rate: 6.8 symbols/min [2025-09-18T22:09:13.778810] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:09:13.804627] [DEBUG] [LOCAL ] TPB: Loaded 24996 existing records from primary storage. [2025-09-18T22:09:13.804803] [INFO ] [MAIN ] TPB: Loaded 24996 existing records. [2025-09-18T22:09:13.983584] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:09:13.983873] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-09-18T22:09:13.983920] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-09-18T22:09:13.984604] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-09-18T22:09:13.984737] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-09-18T22:09:14.129196] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-09-18T22:09:14.356264] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:09:14.688542] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-18T22:09:14.919519] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-09-18T22:09:15.149068] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-18T22:09:15.191075] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-18T22:09:15.196547] [INFO ] [REMOTE ] TNK: Full fetch complete (51907 records). [2025-09-18T22:09:15.196679] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-09-18T22:09:15.587320] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-09-18T22:09:15.587410] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-09-18T22:09:15.588314] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-09-18T22:09:15.588382] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-09-18T22:09:15.589635] [DEBUG] [LOCAL ] TNK: Trimmed 51907 records to 35731 (keeping 200 days of data) [2025-09-18T22:09:15.758986] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-11. [2025-09-18T22:09:15.817985] [DEBUG] [LOCAL ] TNK: Primary data saved (35731 records). [2025-09-18T22:09:15.818125] [INFO ] [MAIN ] TNK: Full history saved. [2025-09-18T22:09:15.818259] [INFO ] [MAIN ] Update Progress: 2113/2372 symbols completed. TNK took 51.9s. Estimated remaining: 37m 54s. Rate: 6.8 symbols/min [2025-09-18T22:09:15.989758] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:09:16.028199] [DEBUG] [LOCAL ] TPC: Loaded 38922 existing records from primary storage. [2025-09-18T22:09:16.028347] [INFO ] [MAIN ] TPC: Loaded 38922 existing records. [2025-09-18T22:09:16.209661] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:09:16.209928] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-09-18T22:09:16.209978] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-09-18T22:09:16.210850] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-09-18T22:09:16.210911] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-09-18T22:09:16.524895] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-09-18T22:09:16.594164] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:09:17.319577] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-11. [2025-09-18T22:09:17.890833] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-09-18T22:09:17.917863] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-11 (2.16 seconds). [2025-09-18T22:09:18.119552] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-09-18T22:09:18.461441] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-18T22:09:18.919577] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-09-18T22:09:18.977733] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-18T22:09:18.998702] [INFO ] [REMOTE ] TOL: Full fetch complete (73700 records). [2025-09-18T22:09:18.999972] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T22:09:19.000091] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-09-18T22:09:19.401945] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-09-18T22:09:19.402035] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-09-18T22:09:19.403111] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-09-18T22:09:19.403179] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-09-18T22:09:19.404787] [DEBUG] [LOCAL ] TOL: Trimmed 73700 records to 51509 (keeping 200 days of data) [2025-09-18T22:09:19.719752] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-09-18T22:09:19.736466] [DEBUG] [LOCAL ] TOL: Primary data saved (51509 records). [2025-09-18T22:09:19.736676] [INFO ] [MAIN ] TOL: Full history saved. [2025-09-18T22:09:19.736803] [INFO ] [MAIN ] Update Progress: 2114/2372 symbols completed. TOL took 34.5s. Estimated remaining: 37m 45s. Rate: 6.8 symbols/min [2025-09-18T22:09:19.912780] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:09:19.958886] [DEBUG] [LOCAL ] TPH: Loaded 45324 existing records from primary storage. [2025-09-18T22:09:19.959065] [INFO ] [MAIN ] TPH: Loaded 45324 existing records. [2025-09-18T22:09:20.144955] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:09:20.145480] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-09-18T22:09:20.145632] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-09-18T22:09:20.152683] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-09-18T22:09:20.163442] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-09-18T22:09:20.169935] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-18T22:09:20.533259] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-09-18T22:09:20.540052] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:09:20.584020] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-18T22:09:21.319593] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-11. [2025-09-18T22:09:22.119546] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-09-18T22:09:22.700685] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-18T22:09:22.740580] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T22:09:22.895328] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-18T22:09:22.919523] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-09-18T22:09:23.719543] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-09-18T22:09:23.953704] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-18T22:09:24.519538] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-09-18T22:09:25.026202] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T22:09:25.319510] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-09-18T22:09:25.702508] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-18T22:09:26.119529] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-09-18T22:09:26.515822] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T22:09:26.891783] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-18T22:09:26.919487] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-09-18T22:09:27.719503] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-09-18T22:09:27.929612] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-18T22:09:28.519549] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-09-18T22:09:29.129507] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-18T22:09:29.319538] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-09-18T22:09:29.956487] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-18T22:09:30.119528] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-09-18T22:09:30.919597] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-09-18T22:09:31.719570] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-09-18T22:09:31.848119] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-18T22:09:31.857092] [INFO ] [REMOTE ] TOST: Full fetch complete (77554 records). [2025-09-18T22:09:31.857231] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-09-18T22:09:32.058813] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-18T22:09:32.310080] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-09-18T22:09:32.310206] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-09-18T22:09:32.311338] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-09-18T22:09:32.311505] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-09-18T22:09:32.313587] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-18T22:09:32.323579] [DEBUG] [LOCAL ] TOST: Trimmed 77554 records to 54071 (keeping 200 days of data) [2025-09-18T22:09:32.524862] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-09-18T22:09:32.649877] [DEBUG] [LOCAL ] TOST: Primary data saved (54071 records). [2025-09-18T22:09:32.650222] [INFO ] [MAIN ] TOST: Full history saved. [2025-09-18T22:09:32.650374] [INFO ] [MAIN ] Update Progress: 2115/2372 symbols completed. TOST took 45.8s. Estimated remaining: 37m 36s. Rate: 6.8 symbols/min [2025-09-18T22:09:32.825560] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:09:32.845121] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-18T22:09:32.863689] [DEBUG] [LOCAL ] TPL: Loaded 12466 existing records from primary storage. [2025-09-18T22:09:32.863825] [INFO ] [MAIN ] TPL: Loaded 12466 existing records. [2025-09-18T22:09:33.038797] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:09:33.039035] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-09-18T22:09:33.039097] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-09-18T22:09:33.039594] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-09-18T22:09:33.039694] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-09-18T22:09:33.324793] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-09-18T22:09:33.444047] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:09:33.981713] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T22:09:34.119525] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-09-18T22:09:34.719822] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-18T22:09:34.919536] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-09-18T22:09:35.719601] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-11. [2025-09-18T22:09:35.880330] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-18T22:09:36.233224] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-18T22:09:36.519588] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-09-18T22:09:36.542495] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-18T22:09:37.319584] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-09-18T22:09:37.570993] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-18T22:09:37.575173] [INFO ] [REMOTE ] TPB: Full fetch complete (34514 records). [2025-09-18T22:09:37.575256] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-09-18T22:09:37.960978] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-09-18T22:09:37.961094] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-09-18T22:09:37.961833] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-09-18T22:09:37.961895] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-09-18T22:09:37.962715] [DEBUG] [LOCAL ] TPB: Trimmed 34514 records to 25169 (keeping 200 days of data) [2025-09-18T22:09:38.113937] [DEBUG] [LOCAL ] TPB: Primary data saved (25169 records). [2025-09-18T22:09:38.114074] [INFO ] [MAIN ] TPB: Full history saved. [2025-09-18T22:09:38.114159] [INFO ] [MAIN ] Update Progress: 2116/2372 symbols completed. TPB took 24.5s. Estimated remaining: 37m 27s. Rate: 6.8 symbols/min [2025-09-18T22:09:38.125929] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-09-18T22:09:38.290307] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:09:38.344799] [DEBUG] [LOCAL ] TPR: Loaded 53485 existing records from primary storage. [2025-09-18T22:09:38.344953] [INFO ] [MAIN ] TPR: Loaded 53485 existing records. [2025-09-18T22:09:38.561082] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:09:38.561599] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-09-18T22:09:38.561842] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-09-18T22:09:38.563385] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-09-18T22:09:38.563454] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-09-18T22:09:38.789792] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-18T22:09:38.923375] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-09-18T22:09:39.004146] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:09:39.024015] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-18T22:09:39.719615] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-09-18T22:09:40.519540] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-11. [2025-09-18T22:09:40.568637] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-18T22:09:40.993767] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-18T22:09:41.319522] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-09-18T22:09:42.119539] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-09-18T22:09:42.160825] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-18T22:09:42.661413] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T22:09:42.919539] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-09-18T22:09:43.719589] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-09-18T22:09:43.778767] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-18T22:09:44.005890] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-18T22:09:44.519544] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-09-18T22:09:45.319533] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-09-18T22:09:45.399919] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-18T22:09:45.783820] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-18T22:09:46.119598] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-09-18T22:09:46.547135] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-18T22:09:46.919586] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-09-18T22:09:47.654680] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-18T22:09:47.719528] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-09-18T22:09:47.893712] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-18T22:09:48.519549] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-09-18T22:09:49.319509] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-09-18T22:09:49.336934] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-18T22:09:49.368661] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-18T22:09:50.119610] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-09-18T22:09:50.769749] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T22:09:50.775691] [INFO ] [REMOTE ] TPH: Full fetch complete (64648 records). [2025-09-18T22:09:50.775807] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-09-18T22:09:50.924805] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-09-18T22:09:51.180246] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-09-18T22:09:51.180337] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-09-18T22:09:51.181338] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-09-18T22:09:51.181484] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-09-18T22:09:51.183138] [DEBUG] [LOCAL ] TPH: Trimmed 64648 records to 45657 (keeping 200 days of data) [2025-09-18T22:09:51.408248] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-18T22:09:51.415903] [INFO ] [REMOTE ] TPC: Full fetch complete (54502 records). [2025-09-18T22:09:51.416573] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-09-18T22:09:51.721016] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-09-18T22:09:51.871179] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-09-18T22:09:51.872015] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-09-18T22:09:51.873263] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-09-18T22:09:51.874112] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-09-18T22:09:51.886750] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-18T22:09:51.892332] [DEBUG] [LOCAL ] TPC: Trimmed 54502 records to 39263 (keeping 200 days of data) [2025-09-18T22:09:52.012110] [DEBUG] [LOCAL ] TPH: Primary data saved (45657 records). [2025-09-18T22:09:52.012680] [INFO ] [MAIN ] TPH: Full history saved. [2025-09-18T22:09:52.013685] [INFO ] [MAIN ] Update Progress: 2117/2372 symbols completed. TPH took 32.3s. Estimated remaining: 37m 19s. Rate: 6.8 symbols/min [2025-09-18T22:09:52.174723] [DEBUG] [LOCAL ] TPC: Primary data saved (39263 records). [2025-09-18T22:09:52.174945] [INFO ] [MAIN ] TPC: Full history saved. [2025-09-18T22:09:52.175105] [INFO ] [MAIN ] Update Progress: 2118/2372 symbols completed. TPC took 36.4s. Estimated remaining: 37m 9s. Rate: 6.8 symbols/min [2025-09-18T22:09:52.519605] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-09-18T22:09:53.390325] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-18T22:09:53.401541] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-09-18T22:09:53.593940] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-18T22:09:54.119583] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-09-18T22:09:55.049577] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-18T22:09:55.054626] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-09-18T22:09:55.118053] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-18T22:09:55.719604] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-09-18T22:09:56.147263] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-18T22:09:56.519589] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-09-18T22:09:57.547910] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-18T22:09:57.560158] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-09-18T22:09:57.571817] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-18T22:09:58.119562] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-09-18T22:09:58.447056] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-18T22:09:58.919600] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-09-18T22:09:59.217821] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-18T22:09:59.219860] [INFO ] [REMOTE ] TPL: Full fetch complete (18534 records). [2025-09-18T22:09:59.219945] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-09-18T22:09:59.606360] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-09-18T22:09:59.606471] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-09-18T22:09:59.607050] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-09-18T22:09:59.607180] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-09-18T22:09:59.608076] [DEBUG] [LOCAL ] TPL: Trimmed 18534 records to 12528 (keeping 200 days of data) [2025-09-18T22:09:59.697950] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-18T22:09:59.719637] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-09-18T22:09:59.735145] [DEBUG] [LOCAL ] TPL: Primary data saved (12528 records). [2025-09-18T22:09:59.735251] [INFO ] [MAIN ] TPL: Full history saved. [2025-09-18T22:09:59.735340] [INFO ] [MAIN ] Update Progress: 2119/2372 symbols completed. TPL took 27.1s. Estimated remaining: 37m 0s. Rate: 6.8 symbols/min [2025-09-18T22:10:01.974449] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-18T22:10:01.987111] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-09-18T22:10:04.020549] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-18T22:10:04.032261] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-09-18T22:10:04.790961] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-18T22:10:04.798316] [INFO ] [REMOTE ] TPR: Full fetch complete (77298 records). [2025-09-18T22:10:04.798444] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-09-18T22:10:05.224876] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-09-18T22:10:05.225062] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-09-18T22:10:05.227101] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-09-18T22:10:05.227197] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-09-18T22:10:05.229492] [DEBUG] [LOCAL ] TPR: Trimmed 77298 records to 53875 (keeping 200 days of data) [2025-09-18T22:10:05.593610] [DEBUG] [LOCAL ] TPR: Primary data saved (53875 records). [2025-09-18T22:10:05.593784] [INFO ] [MAIN ] TPR: Full history saved. [2025-09-18T22:10:05.594780] [INFO ] [MAIN ] Update Progress: 2120/2372 symbols completed. TPR took 27.5s. Estimated remaining: 36m 51s. Rate: 6.8 symbols/min [2025-09-18T22:10:06.251760] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:10:06.253664] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:10:06.279171] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:10:06.334986] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:10:06.343906] [DEBUG] [LOCAL ] TPZ: Loaded 5302 existing records from primary storage. [2025-09-18T22:10:06.344214] [INFO ] [MAIN ] TPZ: Loaded 5302 existing records. [2025-09-18T22:10:06.443307] [DEBUG] [LOCAL ] TPYP: Loaded 7993 existing records from primary storage. [2025-09-18T22:10:06.484566] [INFO ] [MAIN ] TPYP: Loaded 7993 existing records. [2025-09-18T22:10:06.491309] [DEBUG] [LOCAL ] TPVG: Loaded 27116 existing records from primary storage. [2025-09-18T22:10:06.506910] [DEBUG] [LOCAL ] TR: Loaded 18171 existing records from primary storage. [2025-09-18T22:10:06.532577] [INFO ] [MAIN ] TR: Loaded 18171 existing records. [2025-09-18T22:10:06.532734] [INFO ] [MAIN ] TPVG: Loaded 27116 existing records. [2025-09-18T22:10:06.850866] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:10:06.967169] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-09-18T22:10:06.972482] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-09-18T22:10:07.015453] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-09-18T22:10:07.021731] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-09-18T22:10:07.078593] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:10:07.152394] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-09-18T22:10:07.223213] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-09-18T22:10:07.238867] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:10:07.244479] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-09-18T22:10:07.238698] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:10:07.244691] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-09-18T22:10:07.256191] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-09-18T22:10:07.280009] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-09-18T22:10:07.274693] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-09-18T22:10:07.305902] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-09-18T22:10:07.315024] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-09-18T22:10:07.340005] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-09-18T22:10:07.334627] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-09-18T22:10:07.355691] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-09-18T22:10:08.463624] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:10:08.519951] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-11. [2025-09-18T22:10:08.582541] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:10:08.625347] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-11. [2025-09-18T22:10:08.743399] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:10:08.765076] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-11. [2025-09-18T22:10:08.764584] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:10:08.766585] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-11. [2025-09-18T22:10:09.193176] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-18T22:10:09.195402] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-09-18T22:10:09.199723] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-18T22:10:09.201040] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-09-18T22:10:09.769383] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-18T22:10:09.773215] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-09-18T22:10:09.867712] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-18T22:10:09.873634] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-09-18T22:10:09.912739] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-18T22:10:09.915321] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-09-18T22:10:09.946136] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-18T22:10:09.948661] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-09-18T22:10:10.411220] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-18T22:10:10.414579] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-09-18T22:10:10.733624] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T22:10:10.817337] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-18T22:10:10.919562] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-09-18T22:10:11.103875] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T22:10:11.129341] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-18T22:10:11.532544] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-18T22:10:11.719566] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-09-18T22:10:12.505231] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-18T22:10:12.519494] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-09-18T22:10:13.284515] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-18T22:10:13.319498] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-09-18T22:10:14.119547] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-09-18T22:10:14.307443] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-18T22:10:14.708545] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-18T22:10:14.919575] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-09-18T22:10:15.719602] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-09-18T22:10:15.992006] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-18T22:10:16.274519] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-18T22:10:16.519548] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-09-18T22:10:17.287798] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-18T22:10:17.319563] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-09-18T22:10:18.119554] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-09-18T22:10:18.265998] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-18T22:10:18.629795] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-18T22:10:18.919566] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-09-18T22:10:19.719565] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-09-18T22:10:19.762917] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-18T22:10:20.519546] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-09-18T22:10:20.922724] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-18T22:10:21.260842] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-18T22:10:21.319513] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-09-18T22:10:22.044815] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-18T22:10:22.119519] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-09-18T22:10:22.919556] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-09-18T22:10:23.530759] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-18T22:10:23.565086] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T22:10:23.719568] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-09-18T22:10:24.212734] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-18T22:10:24.519599] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-09-18T22:10:25.319617] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-09-18T22:10:25.667897] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-18T22:10:26.119542] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-09-18T22:10:26.213044] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-18T22:10:26.919545] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-09-18T22:10:27.234370] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-18T22:10:27.322621] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-18T22:10:27.719540] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-09-18T22:10:28.519788] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-09-18T22:10:28.934798] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-18T22:10:28.993085] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-18T22:10:29.319553] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-09-18T22:10:30.119504] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-09-18T22:10:30.187925] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-18T22:10:30.849628] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-18T22:10:30.919515] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-09-18T22:10:31.541116] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T22:10:31.542809] [INFO ] [REMOTE ] TPYP: Full fetch complete (12509 records). [2025-09-18T22:10:31.542922] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-09-18T22:10:31.725678] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-09-18T22:10:31.937097] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-09-18T22:10:31.937175] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-09-18T22:10:31.937480] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-09-18T22:10:31.937571] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-09-18T22:10:31.938074] [DEBUG] [LOCAL ] TPYP: Trimmed 12509 records to 8065 (keeping 200 days of data) [2025-09-18T22:10:31.994733] [DEBUG] [LOCAL ] TPYP: Primary data saved (8065 records). [2025-09-18T22:10:31.994841] [INFO ] [MAIN ] TPYP: Full history saved. [2025-09-18T22:10:31.995049] [INFO ] [MAIN ] Update Progress: 2121/2372 symbols completed. TPYP took 26.4s. Estimated remaining: 36m 45s. Rate: 6.8 symbols/min [2025-09-18T22:10:32.165826] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:10:32.177513] [DEBUG] [LOCAL ] TRAK: Loaded 9421 existing records from primary storage. [2025-09-18T22:10:32.177614] [INFO ] [MAIN ] TRAK: Loaded 9421 existing records. [2025-09-18T22:10:32.362437] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:10:32.362706] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-09-18T22:10:32.362787] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-09-18T22:10:32.363247] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-09-18T22:10:32.363316] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-09-18T22:10:32.520986] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-09-18T22:10:32.725863] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:10:32.979328] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T22:10:32.988202] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-18T22:10:33.319550] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-09-18T22:10:33.818743] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-18T22:10:33.820481] [INFO ] [REMOTE ] TPZ: Full fetch complete (9300 records). [2025-09-18T22:10:33.820603] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-09-18T22:10:34.124633] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-09-18T22:10:34.185698] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-09-18T22:10:34.185778] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-09-18T22:10:34.186036] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-09-18T22:10:34.186077] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-09-18T22:10:34.186500] [DEBUG] [LOCAL ] TPZ: Trimmed 9300 records to 5323 (keeping 200 days of data) [2025-09-18T22:10:34.223897] [DEBUG] [LOCAL ] TPZ: Primary data saved (5323 records). [2025-09-18T22:10:34.223998] [INFO ] [MAIN ] TPZ: Full history saved. [2025-09-18T22:10:34.224137] [INFO ] [MAIN ] Update Progress: 2122/2372 symbols completed. TPZ took 28.6s. Estimated remaining: 36m 35s. Rate: 6.8 symbols/min [2025-09-18T22:10:34.409094] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:10:34.429874] [DEBUG] [LOCAL ] TRC: Loaded 15990 existing records from primary storage. [2025-09-18T22:10:34.430020] [INFO ] [MAIN ] TRC: Loaded 15990 existing records. [2025-09-18T22:10:34.613448] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:10:34.614005] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-09-18T22:10:34.614064] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-09-18T22:10:34.614854] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-09-18T22:10:34.614936] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-09-18T22:10:34.933902] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-11. [2025-09-18T22:10:34.976436] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:10:35.138424] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-18T22:10:35.719593] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-11. [2025-09-18T22:10:35.783252] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-18T22:10:36.470694] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-18T22:10:36.519528] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-09-18T22:10:37.319565] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-09-18T22:10:37.556587] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-18T22:10:38.119577] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-09-18T22:10:38.461298] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-18T22:10:38.668867] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-18T22:10:38.919622] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-09-18T22:10:39.719555] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-09-18T22:10:40.115637] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-18T22:10:40.120244] [INFO ] [REMOTE ] TPVG: Full fetch complete (40144 records). [2025-09-18T22:10:40.120331] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-09-18T22:10:40.521289] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-09-18T22:10:40.521175] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-18T22:10:40.541424] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-09-18T22:10:40.541503] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-09-18T22:10:40.542410] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-09-18T22:10:40.542478] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-09-18T22:10:40.545146] [DEBUG] [LOCAL ] TPVG: Trimmed 40144 records to 27300 (keeping 200 days of data) [2025-09-18T22:10:40.743708] [DEBUG] [LOCAL ] TPVG: Primary data saved (27300 records). [2025-09-18T22:10:40.743848] [INFO ] [MAIN ] TPVG: Full history saved. [2025-09-18T22:10:40.743973] [INFO ] [MAIN ] Update Progress: 2123/2372 symbols completed. TPVG took 35.1s. Estimated remaining: 36m 26s. Rate: 6.8 symbols/min [2025-09-18T22:10:40.924848] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:10:40.973104] [DEBUG] [LOCAL ] TREX: Loaded 49969 existing records from primary storage. [2025-09-18T22:10:40.973253] [INFO ] [MAIN ] TREX: Loaded 49969 existing records. [2025-09-18T22:10:41.168316] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:10:41.168594] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-09-18T22:10:41.168662] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-09-18T22:10:41.170263] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-09-18T22:10:41.170324] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-09-18T22:10:41.324328] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-09-18T22:10:41.536782] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:10:41.546495] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-18T22:10:41.550246] [INFO ] [REMOTE ] TR: Full fetch complete (24604 records). [2025-09-18T22:10:41.550340] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-09-18T22:10:41.943443] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-09-18T22:10:41.943785] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-09-18T22:10:41.944517] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-09-18T22:10:41.944582] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-09-18T22:10:41.945873] [DEBUG] [LOCAL ] TR: Trimmed 24604 records to 18344 (keeping 200 days of data) [2025-09-18T22:10:42.079197] [DEBUG] [LOCAL ] TR: Primary data saved (18344 records). [2025-09-18T22:10:42.079348] [INFO ] [MAIN ] TR: Full history saved. [2025-09-18T22:10:42.079454] [INFO ] [MAIN ] Update Progress: 2124/2372 symbols completed. TR took 36.5s. Estimated remaining: 36m 16s. Rate: 6.8 symbols/min [2025-09-18T22:10:42.124793] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-11. [2025-09-18T22:10:42.266271] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:10:42.338809] [DEBUG] [LOCAL ] TRGP: Loaded 50883 existing records from primary storage. [2025-09-18T22:10:42.338965] [INFO ] [MAIN ] TRGP: Loaded 50883 existing records. [2025-09-18T22:10:42.570510] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:10:42.581289] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-09-18T22:10:42.581371] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-09-18T22:10:42.582705] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-18T22:10:42.587132] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-09-18T22:10:42.587566] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-09-18T22:10:42.922017] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-09-18T22:10:42.950839] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:10:43.524511] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-18T22:10:43.713421] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-18T22:10:43.719484] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-09-18T22:10:44.519534] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-09-18T22:10:44.763521] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-18T22:10:45.010868] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-18T22:10:45.319568] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-09-18T22:10:46.119548] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-09-18T22:10:46.804617] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T22:10:46.919561] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-09-18T22:10:47.080312] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-18T22:10:47.719751] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-09-18T22:10:48.431045] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T22:10:48.498498] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-18T22:10:48.519503] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-09-18T22:10:49.319593] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-09-18T22:10:49.339455] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-18T22:10:50.119560] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-09-18T22:10:50.821962] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-18T22:10:50.896913] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-18T22:10:50.919506] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-09-18T22:10:51.540280] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-18T22:10:51.719570] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-09-18T22:10:52.512458] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-18T22:10:52.519490] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-09-18T22:10:53.261684] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-18T22:10:53.319521] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-09-18T22:10:54.116224] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-18T22:10:54.119499] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-09-18T22:10:54.919549] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-09-18T22:10:55.719688] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-09-18T22:10:56.000859] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-18T22:10:56.018240] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-18T22:10:56.022286] [INFO ] [REMOTE ] TRC: Full fetch complete (21957 records). [2025-09-18T22:10:56.022394] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-09-18T22:10:56.368633] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-18T22:10:56.418137] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-09-18T22:10:56.418225] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-09-18T22:10:56.418809] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-09-18T22:10:56.418892] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-09-18T22:10:56.419630] [DEBUG] [LOCAL ] TRC: Trimmed 21957 records to 16154 (keeping 200 days of data) [2025-09-18T22:10:56.522695] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-09-18T22:10:56.530091] [DEBUG] [LOCAL ] TRC: Primary data saved (16154 records). [2025-09-18T22:10:56.530249] [INFO ] [MAIN ] TRC: Full history saved. [2025-09-18T22:10:56.530344] [INFO ] [MAIN ] Update Progress: 2125/2372 symbols completed. TRC took 22.3s. Estimated remaining: 36m 8s. Rate: 6.8 symbols/min [2025-09-18T22:10:56.705396] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:10:56.750050] [DEBUG] [LOCAL ] TRN: Loaded 37514 existing records from primary storage. [2025-09-18T22:10:56.750199] [INFO ] [MAIN ] TRN: Loaded 37514 existing records. [2025-09-18T22:10:56.933783] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:10:56.934081] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-09-18T22:10:56.934131] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-09-18T22:10:56.935136] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-09-18T22:10:56.935198] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-09-18T22:10:57.322465] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-09-18T22:10:57.326508] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:10:57.348350] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-18T22:10:58.119579] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-11. [2025-09-18T22:10:58.919557] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-11. [2025-09-18T22:10:59.163310] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-18T22:10:59.717074] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-18T22:10:59.726319] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-09-18T22:10:59.876331] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-18T22:11:00.519615] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-09-18T22:11:01.115970] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-18T22:11:01.134393] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-18T22:11:01.319556] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-09-18T22:11:02.119542] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-09-18T22:11:02.919596] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-09-18T22:11:03.145966] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-18T22:11:03.434237] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-18T22:11:03.719556] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-09-18T22:11:03.903249] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-18T22:11:04.519559] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-09-18T22:11:05.319553] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-09-18T22:11:05.380050] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-18T22:11:05.988207] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-18T22:11:06.119552] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-09-18T22:11:06.705079] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-18T22:11:06.919556] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-09-18T22:11:07.510041] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-18T22:11:07.719595] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-09-18T22:11:07.929715] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T22:11:08.519560] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-09-18T22:11:09.143514] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T22:11:09.145595] [INFO ] [REMOTE ] TRAK: Full fetch complete (13402 records). [2025-09-18T22:11:09.145706] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-09-18T22:11:09.321898] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-09-18T22:11:09.530844] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-09-18T22:11:09.531004] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-09-18T22:11:09.531346] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-09-18T22:11:09.531418] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-09-18T22:11:09.532142] [DEBUG] [LOCAL ] TRAK: Trimmed 13402 records to 9519 (keeping 200 days of data) [2025-09-18T22:11:09.611019] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-18T22:11:09.632718] [DEBUG] [LOCAL ] TRAK: Primary data saved (9519 records). [2025-09-18T22:11:09.632825] [INFO ] [MAIN ] TRAK: Full history saved. [2025-09-18T22:11:09.632900] [INFO ] [MAIN ] Update Progress: 2126/2372 symbols completed. TRAK took 37.6s. Estimated remaining: 35m 60s. Rate: 6.8 symbols/min [2025-09-18T22:11:09.802614] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:11:09.858002] [DEBUG] [LOCAL ] TRNO: Loaded 44243 existing records from primary storage. [2025-09-18T22:11:09.858141] [INFO ] [MAIN ] TRNO: Loaded 44243 existing records. [2025-09-18T22:11:10.040898] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:11:10.041238] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-09-18T22:11:10.041295] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-09-18T22:11:10.042353] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-09-18T22:11:10.042413] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-09-18T22:11:10.124761] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-09-18T22:11:10.403412] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:11:10.928831] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-11. [2025-09-18T22:11:10.935774] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-18T22:11:11.658850] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-18T22:11:11.719501] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-09-18T22:11:12.027339] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-18T22:11:12.519586] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-09-18T22:11:13.319607] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-09-18T22:11:13.522296] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-18T22:11:13.781919] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-18T22:11:13.789423] [INFO ] [REMOTE ] TREX: Full fetch complete (70634 records). [2025-09-18T22:11:13.789561] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-09-18T22:11:14.124809] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-09-18T22:11:14.194969] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-09-18T22:11:14.195071] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-09-18T22:11:14.196177] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-09-18T22:11:14.196243] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-09-18T22:11:14.197879] [DEBUG] [LOCAL ] TREX: Trimmed 70634 records to 50357 (keeping 200 days of data) [2025-09-18T22:11:14.499915] [DEBUG] [LOCAL ] TREX: Primary data saved (50357 records). [2025-09-18T22:11:14.500125] [INFO ] [MAIN ] TREX: Full history saved. [2025-09-18T22:11:14.500235] [INFO ] [MAIN ] Update Progress: 2127/2372 symbols completed. TREX took 33.8s. Estimated remaining: 35m 51s. Rate: 6.8 symbols/min [2025-09-18T22:11:14.651944] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-18T22:11:14.705758] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:11:14.755331] [DEBUG] [LOCAL ] TROX: Loaded 51751 existing records from primary storage. [2025-09-18T22:11:14.755510] [INFO ] [MAIN ] TROX: Loaded 51751 existing records. [2025-09-18T22:11:14.930028] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-09-18T22:11:14.935453] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:11:14.936723] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-09-18T22:11:14.936787] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-09-18T22:11:14.937972] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-09-18T22:11:14.938036] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-09-18T22:11:15.290094] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:11:15.719552] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-09-18T22:11:15.790755] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-18T22:11:16.460584] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-18T22:11:16.519507] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-09-18T22:11:17.255512] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T22:11:17.319601] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-09-18T22:11:18.090630] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-18T22:11:18.119505] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-09-18T22:11:18.417741] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-18T22:11:18.919551] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-11. [2025-09-18T22:11:19.719560] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-09-18T22:11:19.919151] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-18T22:11:20.137894] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-18T22:11:20.519602] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-09-18T22:11:20.738355] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-18T22:11:21.319544] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-09-18T22:11:22.119525] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-09-18T22:11:22.145673] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-18T22:11:22.743462] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-18T22:11:22.919540] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-09-18T22:11:23.440449] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-18T22:11:23.719542] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-09-18T22:11:24.197992] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-18T22:11:24.466349] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-18T22:11:24.473519] [INFO ] [REMOTE ] TRGP: Full fetch complete (73377 records). [2025-09-18T22:11:24.473711] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-09-18T22:11:24.524883] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-09-18T22:11:24.892045] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-09-18T22:11:24.892147] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-09-18T22:11:24.893320] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-09-18T22:11:24.893394] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-09-18T22:11:24.895070] [DEBUG] [LOCAL ] TRGP: Trimmed 73377 records to 51262 (keeping 200 days of data) [2025-09-18T22:11:25.231898] [DEBUG] [LOCAL ] TRGP: Primary data saved (51262 records). [2025-09-18T22:11:25.232089] [INFO ] [MAIN ] TRGP: Full history saved. [2025-09-18T22:11:25.232742] [INFO ] [MAIN ] Update Progress: 2128/2372 symbols completed. TRGP took 43.2s. Estimated remaining: 35m 42s. Rate: 6.8 symbols/min [2025-09-18T22:11:25.324626] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-09-18T22:11:25.407092] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:11:25.459229] [DEBUG] [LOCAL ] TRP: Loaded 52167 existing records from primary storage. [2025-09-18T22:11:25.459394] [INFO ] [MAIN ] TRP: Loaded 52167 existing records. [2025-09-18T22:11:25.635208] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:11:25.635481] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-09-18T22:11:25.635529] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-09-18T22:11:25.636668] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-09-18T22:11:25.636731] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-09-18T22:11:25.999580] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:11:26.023915] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-18T22:11:26.119540] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-11. [2025-09-18T22:11:26.580378] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-18T22:11:26.919554] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-09-18T22:11:27.719582] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-09-18T22:11:27.938703] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-18T22:11:27.961684] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-18T22:11:27.966673] [INFO ] [REMOTE ] TRN: Full fetch complete (52723 records). [2025-09-18T22:11:27.966774] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-09-18T22:11:28.368487] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-09-18T22:11:28.368583] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-09-18T22:11:28.369495] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-09-18T22:11:28.369562] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-09-18T22:11:28.370885] [DEBUG] [LOCAL ] TRN: Trimmed 52723 records to 37803 (keeping 200 days of data) [2025-09-18T22:11:28.540357] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-09-18T22:11:28.603953] [DEBUG] [LOCAL ] TRN: Primary data saved (37803 records). [2025-09-18T22:11:28.604073] [INFO ] [MAIN ] TRN: Full history saved. [2025-09-18T22:11:28.604156] [INFO ] [MAIN ] Update Progress: 2129/2372 symbols completed. TRN took 32.1s. Estimated remaining: 35m 33s. Rate: 6.8 symbols/min [2025-09-18T22:11:28.777087] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:11:28.811872] [DEBUG] [LOCAL ] TRTX: Loaded 37363 existing records from primary storage. [2025-09-18T22:11:28.812013] [INFO ] [MAIN ] TRTX: Loaded 37363 existing records. [2025-09-18T22:11:28.997283] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:11:28.997554] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-09-18T22:11:28.997609] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-09-18T22:11:28.998456] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-09-18T22:11:28.998517] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-09-18T22:11:29.321951] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-09-18T22:11:29.398181] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:11:29.463482] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-18T22:11:29.792676] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T22:11:30.119563] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-11. [2025-09-18T22:11:30.825606] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T22:11:30.919538] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-09-18T22:11:31.526441] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-18T22:11:31.719550] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-09-18T22:11:32.524760] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-09-18T22:11:32.540741] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-18T22:11:32.747514] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-18T22:11:33.319553] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-09-18T22:11:34.119567] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-09-18T22:11:34.190133] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-18T22:11:34.380606] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-18T22:11:34.919567] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-09-18T22:11:35.711552] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-18T22:11:35.722505] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-09-18T22:11:36.519545] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-09-18T22:11:36.649075] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-18T22:11:37.156813] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T22:11:37.319550] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-09-18T22:11:37.418121] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-18T22:11:38.119597] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-09-18T22:11:38.925542] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-09-18T22:11:38.931212] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T22:11:39.347848] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T22:11:39.719580] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-09-18T22:11:40.519522] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-09-18T22:11:40.612334] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-18T22:11:41.295550] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T22:11:41.319496] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-09-18T22:11:41.975596] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T22:11:42.119537] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-09-18T22:11:42.658708] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T22:11:42.919552] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-09-18T22:11:43.459839] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-18T22:11:43.719575] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-09-18T22:11:44.519515] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-09-18T22:11:44.590472] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-18T22:11:45.319523] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-09-18T22:11:45.422169] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-18T22:11:46.124606] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-09-18T22:11:46.144172] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-18T22:11:46.526071] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T22:11:46.919579] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-09-18T22:11:47.402002] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-18T22:11:47.719552] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-09-18T22:11:48.519531] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-09-18T22:11:48.552057] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-18T22:11:48.674963] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-18T22:11:49.319587] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-09-18T22:11:50.119587] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-09-18T22:11:50.373623] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-18T22:11:50.532061] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-18T22:11:50.919568] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-09-18T22:11:51.572244] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T22:11:51.719591] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-09-18T22:11:52.428228] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-18T22:11:52.519560] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-09-18T22:11:52.738276] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-18T22:11:52.744365] [INFO ] [REMOTE ] TRNO: Full fetch complete (63963 records). [2025-09-18T22:11:52.744501] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-09-18T22:11:53.152002] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-09-18T22:11:53.152094] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-09-18T22:11:53.153126] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-09-18T22:11:53.153191] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-09-18T22:11:53.154713] [DEBUG] [LOCAL ] TRNO: Trimmed 63963 records to 44567 (keeping 200 days of data) [2025-09-18T22:11:53.334061] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-09-18T22:11:53.433833] [DEBUG] [LOCAL ] TRNO: Primary data saved (44567 records). [2025-09-18T22:11:53.434043] [INFO ] [MAIN ] TRNO: Full history saved. [2025-09-18T22:11:53.434167] [INFO ] [MAIN ] Update Progress: 2130/2372 symbols completed. TRNO took 43.8s. Estimated remaining: 35m 26s. Rate: 6.8 symbols/min [2025-09-18T22:11:53.610984] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:11:53.662971] [DEBUG] [LOCAL ] TRU: Loaded 51175 existing records from primary storage. [2025-09-18T22:11:53.663136] [INFO ] [MAIN ] TRU: Loaded 51175 existing records. [2025-09-18T22:11:53.862482] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:11:53.862818] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-09-18T22:11:53.862891] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-09-18T22:11:53.864089] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-09-18T22:11:53.864151] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-09-18T22:11:54.129767] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-09-18T22:11:54.247273] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:11:54.277814] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-18T22:11:54.848490] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T22:11:54.855915] [INFO ] [REMOTE ] TROX: Full fetch complete (72155 records). [2025-09-18T22:11:54.856037] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-09-18T22:11:54.924728] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-09-18T22:11:55.278857] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-09-18T22:11:55.279095] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-09-18T22:11:55.280377] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-09-18T22:11:55.280460] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-09-18T22:11:55.282329] [DEBUG] [LOCAL ] TROX: Trimmed 72155 records to 52140 (keeping 200 days of data) [2025-09-18T22:11:55.607279] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-18T22:11:55.636628] [DEBUG] [LOCAL ] TROX: Primary data saved (52140 records). [2025-09-18T22:11:55.636817] [INFO ] [MAIN ] TROX: Full history saved. [2025-09-18T22:11:55.636930] [INFO ] [MAIN ] Update Progress: 2131/2372 symbols completed. TROX took 41.1s. Estimated remaining: 35m 16s. Rate: 6.8 symbols/min [2025-09-18T22:11:55.728915] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-11. [2025-09-18T22:11:55.814818] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:11:55.869476] [DEBUG] [LOCAL ] TRV: Loaded 48413 existing records from primary storage. [2025-09-18T22:11:55.869630] [INFO ] [MAIN ] TRV: Loaded 48413 existing records. [2025-09-18T22:11:56.050399] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:11:56.050813] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-09-18T22:11:56.050875] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-09-18T22:11:56.052541] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-09-18T22:11:56.052602] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-09-18T22:11:56.415079] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:11:56.435596] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T22:11:56.443201] [INFO ] [REMOTE ] TRP: Full fetch complete (75435 records). [2025-09-18T22:11:56.443360] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-09-18T22:11:56.524631] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-11. [2025-09-18T22:11:56.840755] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-09-18T22:11:56.840860] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-09-18T22:11:56.842122] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-09-18T22:11:56.842191] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-09-18T22:11:56.843831] [DEBUG] [LOCAL ] TRP: Trimmed 75435 records to 52542 (keeping 200 days of data) [2025-09-18T22:11:57.172359] [DEBUG] [LOCAL ] TRP: Primary data saved (52542 records). [2025-09-18T22:11:57.172512] [INFO ] [MAIN ] TRP: Full history saved. [2025-09-18T22:11:57.174135] [INFO ] [MAIN ] Update Progress: 2132/2372 symbols completed. TRP took 31.9s. Estimated remaining: 35m 7s. Rate: 6.8 symbols/min [2025-09-18T22:11:57.329245] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-09-18T22:11:57.351978] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:11:57.352231] [DEBUG] [LOCAL ] TS: No existing data file found in primary storage. [2025-09-18T22:11:57.352278] [WARN ] [MAIN ] TS: No existing data found, performing full refresh instead. [2025-09-18T22:11:57.352471] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-09-18T22:11:57.352525] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-09-18T22:11:57.352570] [DEBUG] [LOCAL ] TS: No primary data file found to delete. [2025-09-18T22:11:57.352603] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-09-18T22:11:57.716790] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:11:57.745001] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-18T22:11:58.119525] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-09-18T22:11:58.167020] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-18T22:11:58.511300] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-18T22:11:58.516718] [INFO ] [REMOTE ] TRTX: Full fetch complete (52700 records). [2025-09-18T22:11:58.516827] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-09-18T22:11:58.907629] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-09-18T22:11:58.907750] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-09-18T22:11:58.908619] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-09-18T22:11:58.908697] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-09-18T22:11:58.909802] [DEBUG] [LOCAL ] TRTX: Trimmed 52700 records to 37676 (keeping 200 days of data) [2025-09-18T22:11:58.957668] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-11. [2025-09-18T22:11:59.136028] [DEBUG] [LOCAL ] TRTX: Primary data saved (37676 records). [2025-09-18T22:11:59.136197] [INFO ] [MAIN ] TRTX: Full history saved. [2025-09-18T22:11:59.136301] [INFO ] [MAIN ] Update Progress: 2133/2372 symbols completed. TRTX took 30.5s. Estimated remaining: 34m 57s. Rate: 6.8 symbols/min [2025-09-18T22:11:59.309319] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:11:59.342301] [DEBUG] [LOCAL ] TSE: Loaded 28997 existing records from primary storage. [2025-09-18T22:11:59.342468] [INFO ] [MAIN ] TSE: Loaded 28997 existing records. [2025-09-18T22:11:59.579270] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:11:59.580080] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-09-18T22:11:59.580164] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-09-18T22:11:59.581332] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-09-18T22:11:59.581412] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-09-18T22:11:59.724787] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-09-18T22:11:59.885131] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-18T22:12:00.240438] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:12:00.519593] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-11. [2025-09-18T22:12:00.775821] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-18T22:12:01.319598] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-09-18T22:12:01.538809] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-18T22:12:01.662108] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-18T22:12:02.119594] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-09-18T22:12:02.919600] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-09-18T22:12:03.719615] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-09-18T22:12:05.058624] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (2.94 seconds). [2025-09-18T22:12:05.069746] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-09-18T22:12:05.603861] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (4.28 seconds). [2025-09-18T22:12:05.614306] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-09-18T22:12:05.669886] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-09-18T22:12:05.740973] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-18T22:12:06.119600] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-09-18T22:12:06.403915] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T22:12:06.919523] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-09-18T22:12:06.995939] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T22:12:07.420768] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-18T22:12:07.719722] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-09-18T22:12:08.519559] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-09-18T22:12:08.786965] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-18T22:12:09.319526] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-09-18T22:12:09.419064] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-18T22:12:10.119586] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-09-18T22:12:10.348231] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-18T22:12:10.399205] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-18T22:12:10.919564] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-09-18T22:12:11.580966] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T22:12:11.719539] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-09-18T22:12:12.519546] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-09-18T22:12:12.710835] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-18T22:12:13.259331] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-18T22:12:13.319613] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-09-18T22:12:13.940471] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T22:12:14.119507] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-09-18T22:12:14.919624] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-09-18T22:12:15.719578] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-09-18T22:12:15.829452] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-18T22:12:16.519600] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-09-18T22:12:16.708304] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-18T22:12:16.821722] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-18T22:12:17.319584] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-09-18T22:12:17.894323] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-18T22:12:17.982177] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T22:12:18.119555] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-09-18T22:12:18.919556] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-09-18T22:12:19.044085] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-18T22:12:19.609001] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-18T22:12:19.719547] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-09-18T22:12:20.002236] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-18T22:12:20.519544] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-09-18T22:12:21.319527] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-09-18T22:12:21.322621] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-18T22:12:21.520630] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-18T22:12:22.119551] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-09-18T22:12:22.873357] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-18T22:12:22.919497] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-09-18T22:12:23.194931] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-18T22:12:23.202098] [INFO ] [REMOTE ] TRV: Full fetch complete (70003 records). [2025-09-18T22:12:23.202317] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-09-18T22:12:23.611053] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-09-18T22:12:23.611163] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-09-18T22:12:23.612366] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-09-18T22:12:23.612460] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-09-18T22:12:23.614065] [DEBUG] [LOCAL ] TRV: Trimmed 70003 records to 48772 (keeping 200 days of data) [2025-09-18T22:12:23.721499] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-09-18T22:12:23.772477] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-18T22:12:23.997956] [DEBUG] [LOCAL ] TRV: Primary data saved (48772 records). [2025-09-18T22:12:23.998126] [INFO ] [MAIN ] TRV: Full history saved. [2025-09-18T22:12:23.998249] [INFO ] [MAIN ] Update Progress: 2134/2372 symbols completed. TRV took 28.4s. Estimated remaining: 34m 50s. Rate: 6.8 symbols/min [2025-09-18T22:12:24.189736] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:12:24.200239] [DEBUG] [LOCAL ] TSI: Loaded 8689 existing records from primary storage. [2025-09-18T22:12:24.200358] [INFO ] [MAIN ] TSI: Loaded 8689 existing records. [2025-09-18T22:12:24.404044] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:12:24.404320] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-09-18T22:12:24.404372] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-09-18T22:12:24.404807] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-09-18T22:12:24.404871] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-09-18T22:12:24.524310] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-09-18T22:12:24.806427] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:12:25.083426] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-18T22:12:25.319544] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-09-18T22:12:26.112073] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-18T22:12:26.122958] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-09-18T22:12:26.892139] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-18T22:12:26.919497] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-09-18T22:12:27.061982] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-18T22:12:27.719540] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-09-18T22:12:28.519544] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-11. [2025-09-18T22:12:29.319551] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-09-18T22:12:29.413252] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-18T22:12:29.561170] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-18T22:12:29.585093] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-18T22:12:30.119535] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-09-18T22:12:30.587324] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-18T22:12:30.594762] [INFO ] [REMOTE ] TRU: Full fetch complete (72791 records). [2025-09-18T22:12:30.594907] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-09-18T22:12:30.898446] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-18T22:12:30.921633] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-09-18T22:12:31.014471] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-09-18T22:12:31.014553] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-09-18T22:12:31.016227] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-09-18T22:12:31.016322] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-09-18T22:12:31.020816] [DEBUG] [LOCAL ] TRU: Trimmed 72791 records to 51565 (keeping 200 days of data) [2025-09-18T22:12:31.374565] [DEBUG] [LOCAL ] TRU: Primary data saved (51565 records). [2025-09-18T22:12:31.374798] [INFO ] [MAIN ] TRU: Full history saved. [2025-09-18T22:12:31.374933] [INFO ] [MAIN ] Update Progress: 2135/2372 symbols completed. TRU took 37.9s. Estimated remaining: 34m 41s. Rate: 6.8 symbols/min [2025-09-18T22:12:31.567840] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:12:31.606871] [DEBUG] [LOCAL ] TSLX: Loaded 35446 existing records from primary storage. [2025-09-18T22:12:31.607028] [INFO ] [MAIN ] TSLX: Loaded 35446 existing records. [2025-09-18T22:12:31.724806] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-09-18T22:12:31.851153] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:12:31.851397] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-09-18T22:12:31.851445] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-09-18T22:12:31.852379] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-09-18T22:12:31.852438] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-09-18T22:12:32.215970] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:12:32.235772] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-18T22:12:32.519541] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-09-18T22:12:33.136849] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-18T22:12:33.151139] [INFO ] [REMOTE ] TS: Full fetch complete (74277 records). [2025-09-18T22:12:33.151305] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-09-18T22:12:33.333217] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-11. [2025-09-18T22:12:33.567261] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-09-18T22:12:33.567355] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-09-18T22:12:33.568586] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-09-18T22:12:33.568821] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-09-18T22:12:33.570445] [DEBUG] [LOCAL ] TS: Trimmed 74277 records to 52076 (keeping 200 days of data) [2025-09-18T22:12:33.689350] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-18T22:12:33.694339] [INFO ] [REMOTE ] TSE: Full fetch complete (41971 records). [2025-09-18T22:12:33.694860] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-09-18T22:12:34.127359] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-09-18T22:12:34.127890] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-09-18T22:12:34.124560] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-09-18T22:12:34.131110] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-09-18T22:12:34.135246] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-09-18T22:12:34.141433] [DEBUG] [LOCAL ] TSE: Trimmed 41971 records to 29154 (keeping 200 days of data) [2025-09-18T22:12:34.543901] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-18T22:12:34.543156] [DEBUG] [LOCAL ] TSE: Primary data saved (29154 records). [2025-09-18T22:12:34.551914] [INFO ] [MAIN ] TSE: Full history saved. [2025-09-18T22:12:34.552127] [INFO ] [MAIN ] Update Progress: 2136/2372 symbols completed. TSE took 35.4s. Estimated remaining: 34m 32s. Rate: 6.8 symbols/min [2025-09-18T22:12:34.673135] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-18T22:12:34.752901] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:12:34.756567] [DEBUG] [LOCAL ] TS: Primary data saved (52076 records). [2025-09-18T22:12:34.756768] [INFO ] [MAIN ] TS: Full history saved. [2025-09-18T22:12:34.756877] [INFO ] [MAIN ] Update Progress: 2137/2372 symbols completed. TS took 37.6s. Estimated remaining: 34m 22s. Rate: 6.8 symbols/min [2025-09-18T22:12:34.930958] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-09-18T22:12:34.935888] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:12:34.979326] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-09-18T22:12:34.979487] [INFO ] [MAIN ] TSM: Loaded 53819 existing records. [2025-09-18T22:12:35.197727] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:12:35.198907] [DEBUG] [LOCAL ] TSN: Loaded 52836 existing records from primary storage. [2025-09-18T22:12:35.199072] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-09-18T22:12:35.199313] [INFO ] [MAIN ] TSN: Loaded 52836 existing records. [2025-09-18T22:12:35.199238] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-09-18T22:12:35.256721] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-09-18T22:12:35.266381] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-09-18T22:12:35.571133] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:12:35.599686] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-09-18T22:12:35.639428] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-09-18T22:12:35.680311] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-09-18T22:12:35.690845] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-09-18T22:12:35.724716] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-09-18T22:12:35.899338] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:12:36.160766] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:12:36.322809] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T22:12:36.519555] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-11. [2025-09-18T22:12:36.670685] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-18T22:12:37.319599] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-11. [2025-09-18T22:12:38.119614] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-09-18T22:12:38.897485] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-18T22:12:38.912824] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-18T22:12:38.919491] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-09-18T22:12:39.001975] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-11 (2.48 seconds). [2025-09-18T22:12:39.669448] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-18T22:12:39.719504] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-09-18T22:12:40.200248] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-18T22:12:40.519579] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-09-18T22:12:41.319549] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-09-18T22:12:41.711994] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-18T22:12:42.119600] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-09-18T22:12:42.768811] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-18T22:12:42.801354] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-18T22:12:42.919543] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-09-18T22:12:43.719592] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-09-18T22:12:44.528568] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-09-18T22:12:44.535248] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-18T22:12:45.319602] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-09-18T22:12:45.602757] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-18T22:12:46.119550] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-09-18T22:12:46.591773] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-18T22:12:46.626543] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (2.91 seconds). [2025-09-18T22:12:46.808684] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T22:12:46.919598] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-09-18T22:12:47.719559] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-09-18T22:12:48.519554] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-09-18T22:12:48.615095] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-18T22:12:48.877170] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-18T22:12:49.319578] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-09-18T22:12:50.119550] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-09-18T22:12:50.857561] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T22:12:50.859331] [INFO ] [REMOTE ] TSI: Full fetch complete (13277 records). [2025-09-18T22:12:50.859411] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-09-18T22:12:50.924346] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-09-18T22:12:51.248062] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-09-18T22:12:51.248485] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-09-18T22:12:51.249202] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-09-18T22:12:51.249367] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-09-18T22:12:51.250318] [DEBUG] [LOCAL ] TSI: Trimmed 13277 records to 8718 (keeping 200 days of data) [2025-09-18T22:12:51.310308] [DEBUG] [LOCAL ] TSI: Primary data saved (8718 records). [2025-09-18T22:12:51.310718] [INFO ] [MAIN ] TSI: Full history saved. [2025-09-18T22:12:51.310895] [INFO ] [MAIN ] Update Progress: 2138/2372 symbols completed. TSI took 27.3s. Estimated remaining: 34m 14s. Rate: 6.8 symbols/min [2025-09-18T22:12:51.459893] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-18T22:12:51.556666] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:12:51.593252] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (3.07 seconds). [2025-09-18T22:12:51.612718] [DEBUG] [LOCAL ] TSQ: Loaded 12062 existing records from primary storage. [2025-09-18T22:12:51.612865] [INFO ] [MAIN ] TSQ: Loaded 12062 existing records. [2025-09-18T22:12:51.724860] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-09-18T22:12:51.826772] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:12:51.827082] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-09-18T22:12:51.827135] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-09-18T22:12:51.827943] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-09-18T22:12:51.828020] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-09-18T22:12:52.220143] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:12:52.437254] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-18T22:12:52.519630] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-11. [2025-09-18T22:12:52.966871] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-18T22:12:53.319702] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-09-18T22:12:53.554373] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-18T22:12:54.119561] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-09-18T22:12:54.919599] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-09-18T22:12:54.933538] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-18T22:12:55.721056] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-09-18T22:12:55.727717] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-18T22:12:56.526551] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-09-18T22:12:56.528940] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-18T22:12:56.558764] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T22:12:57.319552] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-09-18T22:12:58.112192] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T22:12:58.122704] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-09-18T22:12:58.380524] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-18T22:12:58.919579] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-09-18T22:12:59.017567] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-18T22:12:59.719555] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-09-18T22:13:00.519546] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-09-18T22:13:01.154830] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-18T22:13:01.319576] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-09-18T22:13:01.354705] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-18T22:13:01.370496] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-18T22:13:01.890559] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-18T22:13:02.119585] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-09-18T22:13:02.584461] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-18T22:13:02.591862] [INFO ] [REMOTE ] TSN: Full fetch complete (76046 records). [2025-09-18T22:13:02.591989] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-09-18T22:13:02.924631] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-09-18T22:13:02.998741] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-09-18T22:13:02.998828] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-09-18T22:13:02.999908] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-09-18T22:13:02.999971] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-09-18T22:13:03.001637] [DEBUG] [LOCAL ] TSN: Trimmed 76046 records to 53226 (keeping 200 days of data) [2025-09-18T22:13:03.338216] [DEBUG] [LOCAL ] TSN: Primary data saved (53226 records). [2025-09-18T22:13:03.338378] [INFO ] [MAIN ] TSN: Full history saved. [2025-09-18T22:13:03.338489] [INFO ] [MAIN ] Update Progress: 2139/2372 symbols completed. TSN took 28.6s. Estimated remaining: 34m 6s. Rate: 6.8 symbols/min [2025-09-18T22:13:03.509868] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:13:03.558599] [DEBUG] [LOCAL ] TT: Loaded 48052 existing records from primary storage. [2025-09-18T22:13:03.558813] [INFO ] [MAIN ] TT: Loaded 48052 existing records. [2025-09-18T22:13:03.728508] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-09-18T22:13:03.767775] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-18T22:13:03.767317] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:13:03.770563] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-09-18T22:13:03.771366] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-09-18T22:13:03.772979] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-09-18T22:13:03.773040] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-09-18T22:13:04.127016] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:13:04.519607] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-09-18T22:13:05.319527] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-09-18T22:13:05.546191] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-18T22:13:06.119598] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-09-18T22:13:06.429870] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-18T22:13:06.484582] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T22:13:06.743434] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-18T22:13:06.919562] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-09-18T22:13:07.719555] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-09-18T22:13:08.465953] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-18T22:13:08.519509] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-09-18T22:13:09.090357] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-18T22:13:09.319507] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-11. [2025-09-18T22:13:09.444068] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-18T22:13:10.119562] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-09-18T22:13:10.859562] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-18T22:13:10.919501] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-09-18T22:13:11.155856] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-18T22:13:11.719545] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-09-18T22:13:12.346564] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-18T22:13:12.519577] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-09-18T22:13:12.640036] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-18T22:13:12.645716] [INFO ] [REMOTE ] TSLX: Full fetch complete (48873 records). [2025-09-18T22:13:12.645862] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-09-18T22:13:13.027038] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-09-18T22:13:13.027141] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-09-18T22:13:13.028017] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-09-18T22:13:13.028080] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-09-18T22:13:13.029110] [DEBUG] [LOCAL ] TSLX: Trimmed 48873 records to 35680 (keeping 200 days of data) [2025-09-18T22:13:13.259546] [DEBUG] [LOCAL ] TSLX: Primary data saved (35680 records). [2025-09-18T22:13:13.259716] [INFO ] [MAIN ] TSLX: Full history saved. [2025-09-18T22:13:13.259814] [INFO ] [MAIN ] Update Progress: 2140/2372 symbols completed. TSLX took 41.9s. Estimated remaining: 33m 57s. Rate: 6.8 symbols/min [2025-09-18T22:13:13.324612] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-09-18T22:13:13.430413] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:13:13.430563] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-09-18T22:13:13.430600] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-09-18T22:13:13.430763] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-09-18T22:13:13.430808] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-18T22:13:13.430853] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-18T22:13:13.430890] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-09-18T22:13:13.787795] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:13:14.035454] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-18T22:13:14.037627] [INFO ] [REMOTE ] TSQ: Full fetch complete (16657 records). [2025-09-18T22:13:14.037756] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-09-18T22:13:14.124716] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-09-18T22:13:14.423124] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-09-18T22:13:14.423203] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-09-18T22:13:14.423671] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-09-18T22:13:14.423749] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-09-18T22:13:14.424313] [DEBUG] [LOCAL ] TSQ: Trimmed 16657 records to 12099 (keeping 200 days of data) [2025-09-18T22:13:14.495809] [DEBUG] [LOCAL ] TSQ: Primary data saved (12099 records). [2025-09-18T22:13:14.495951] [INFO ] [MAIN ] TSQ: Full history saved. [2025-09-18T22:13:14.496072] [INFO ] [MAIN ] Update Progress: 2141/2372 symbols completed. TSQ took 23.2s. Estimated remaining: 33m 47s. Rate: 6.8 symbols/min [2025-09-18T22:13:14.663941] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:13:14.715000] [DEBUG] [LOCAL ] TTC: Loaded 43035 existing records from primary storage. [2025-09-18T22:13:14.715149] [INFO ] [MAIN ] TTC: Loaded 43035 existing records. [2025-09-18T22:13:14.896851] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:13:14.897105] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-09-18T22:13:14.897158] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-09-18T22:13:14.898133] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-09-18T22:13:14.898194] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-09-18T22:13:14.929395] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-11. [2025-09-18T22:13:15.253287] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:13:15.258632] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:13:15.259427] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-11 [2025-09-18T22:13:15.298703] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-18T22:13:15.719532] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-09-18T22:13:15.900258] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-18T22:13:15.944996] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:13:15.945312] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-09-18T22:13:16.519548] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-09-18T22:13:17.319570] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-09-18T22:13:18.119543] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-01. [2025-09-18T22:13:18.345022] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:13:18.345362] [WARN ] [REMOTE ] TTAM: No data returned for month 2025-01 [2025-09-18T22:13:18.919587] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-02. [2025-09-18T22:13:19.114287] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-18T22:13:19.210476] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-09-18T22:13:19.719693] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-09-18T22:13:19.720488] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-18T22:13:20.519592] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-03. [2025-09-18T22:13:21.319559] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-11. [2025-09-18T22:13:21.755468] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T22:13:22.119549] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-09-18T22:13:22.273005] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-09-18T22:13:22.888676] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-18T22:13:22.919507] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-09-18T22:13:23.719523] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-04. [2025-09-18T22:13:23.820197] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-18T22:13:24.076361] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-18T22:13:24.519511] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-09-18T22:13:24.569493] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-18T22:13:25.319548] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-09-18T22:13:26.034585] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T22:13:26.119546] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-05. [2025-09-18T22:13:26.919552] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-09-18T22:13:27.029187] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-18T22:13:27.719561] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-09-18T22:13:28.077510] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-09-18T22:13:28.191499] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-18T22:13:28.519537] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-09-18T22:13:29.319564] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-09-18T22:13:29.425835] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-18T22:13:30.119635] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-09-18T22:13:30.323966] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-18T22:13:30.919728] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-06. [2025-09-18T22:13:31.719596] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-09-18T22:13:31.764471] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-18T22:13:31.831371] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-18T22:13:31.902616] [INFO ] [REMOTE ] TSM: Full fetch complete (77974 records). [2025-09-18T22:13:31.904235] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-18T22:13:31.904383] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-09-18T22:13:32.352132] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-09-18T22:13:32.352264] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-09-18T22:13:32.355168] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-09-18T22:13:32.355442] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-09-18T22:13:32.357899] [DEBUG] [LOCAL ] TSM: Trimmed 77974 records to 54209 (keeping 200 days of data) [2025-09-18T22:13:32.551871] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-07. [2025-09-18T22:13:32.721503] [DEBUG] [LOCAL ] TSM: Primary data saved (54209 records). [2025-09-18T22:13:32.721719] [INFO ] [MAIN ] TSM: Full history saved. [2025-09-18T22:13:32.721837] [INFO ] [MAIN ] Update Progress: 2142/2372 symbols completed. TSM took 58.2s. Estimated remaining: 33m 40s. Rate: 6.8 symbols/min [2025-09-18T22:13:32.896580] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:13:32.948293] [DEBUG] [LOCAL ] TTE: Loaded 51669 existing records from primary storage. [2025-09-18T22:13:32.948532] [INFO ] [MAIN ] TTE: Loaded 51669 existing records. [2025-09-18T22:13:33.144147] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:13:33.144783] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-09-18T22:13:33.144883] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-09-18T22:13:33.146198] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-09-18T22:13:33.146275] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-09-18T22:13:33.322943] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-09-18T22:13:33.513117] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-18T22:13:33.595539] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:13:34.093735] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-18T22:13:34.119502] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-11. [2025-09-18T22:13:34.737140] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-18T22:13:34.919540] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-09-18T22:13:35.727296] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-08. [2025-09-18T22:13:35.745946] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-18T22:13:36.521449] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-09-18T22:13:36.524196] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-18T22:13:36.804326] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-18T22:13:37.319566] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-09. [2025-09-18T22:13:38.119529] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-09-18T22:13:38.276637] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-18T22:13:38.280935] [INFO ] [REMOTE ] TTAM: Full fetch complete (32198 records). [2025-09-18T22:13:38.281119] [DEBUG] [VALIDATOR ] TTAM: Validating primary data. [2025-09-18T22:13:38.498086] [WARN ] [VALIDATOR ] TTAM: Validation failed - insufficient historical data. Have 154 unique days, need 200 days [2025-09-18T22:13:38.498745] [FATAL] [MAIN ] TTAM: Fetched primary data is invalid. Refusing to save it. [2025-09-18T22:13:38.498903] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to validation failure. [2025-09-18T22:13:38.499027] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-18T22:13:38.499138] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-18T22:13:38.499301] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-09-18T22:13:38.499429] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-09-18T22:13:38.499539] [INFO ] [MAIN ] Update Progress: 2143/2372 symbols completed. TTAM took 25.2s. Estimated remaining: 33m 31s. Rate: 6.8 symbols/min [2025-09-18T22:13:38.675358] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-18T22:13:38.756410] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:13:38.803762] [DEBUG] [LOCAL ] TTI: Loaded 45239 existing records from primary storage. [2025-09-18T22:13:38.803935] [INFO ] [MAIN ] TTI: Loaded 45239 existing records. [2025-09-18T22:13:38.924730] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-09-18T22:13:38.990299] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:13:38.990727] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-09-18T22:13:38.990847] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-09-18T22:13:38.991844] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-09-18T22:13:38.991905] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-09-18T22:13:39.353056] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:13:39.474753] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-18T22:13:39.719551] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-09-18T22:13:40.519513] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-09-18T22:13:40.596898] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-18T22:13:41.186709] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-18T22:13:41.319613] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-09-18T22:13:42.119590] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-11. [2025-09-18T22:13:42.847496] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-18T22:13:42.919523] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-09-18T22:13:43.719624] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-09-18T22:13:44.241159] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-11 (2.12 seconds). [2025-09-18T22:13:44.348425] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (3.03 seconds). [2025-09-18T22:13:44.519551] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-09-18T22:13:44.728202] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-18T22:13:44.802720] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-18T22:13:44.809377] [INFO ] [REMOTE ] TT: Full fetch complete (69652 records). [2025-09-18T22:13:44.809498] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-09-18T22:13:45.211397] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-09-18T22:13:45.219524] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-09-18T22:13:45.233991] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-09-18T22:13:45.234321] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-09-18T22:13:45.236502] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-18T22:13:45.246070] [DEBUG] [LOCAL ] TT: Trimmed 69652 records to 48402 (keeping 200 days of data) [2025-09-18T22:13:45.335989] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-09-18T22:13:45.565404] [DEBUG] [LOCAL ] TT: Primary data saved (48402 records). [2025-09-18T22:13:45.565564] [INFO ] [MAIN ] TT: Full history saved. [2025-09-18T22:13:45.566722] [INFO ] [MAIN ] Update Progress: 2144/2372 symbols completed. TT took 42.2s. Estimated remaining: 33m 22s. Rate: 6.8 symbols/min [2025-09-18T22:13:45.757858] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:13:45.818203] [DEBUG] [LOCAL ] TU: Loaded 49968 existing records from primary storage. [2025-09-18T22:13:45.818392] [INFO ] [MAIN ] TU: Loaded 49968 existing records. [2025-09-18T22:13:46.077369] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:13:46.077710] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-09-18T22:13:46.077771] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-09-18T22:13:46.079051] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-09-18T22:13:46.079131] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-09-18T22:13:46.125377] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-09-18T22:13:46.650155] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:13:46.919592] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-09-18T22:13:46.956968] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-18T22:13:47.479059] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-18T22:13:47.485273] [INFO ] [REMOTE ] TTC: Full fetch complete (62103 records). [2025-09-18T22:13:47.485453] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-09-18T22:13:47.724631] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-09-18T22:13:47.885291] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-09-18T22:13:47.885381] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-09-18T22:13:47.886365] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-09-18T22:13:47.886430] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-09-18T22:13:47.887704] [DEBUG] [LOCAL ] TTC: Trimmed 62103 records to 43308 (keeping 200 days of data) [2025-09-18T22:13:48.156114] [DEBUG] [LOCAL ] TTC: Primary data saved (43308 records). [2025-09-18T22:13:48.156248] [INFO ] [MAIN ] TTC: Full history saved. [2025-09-18T22:13:48.156329] [INFO ] [MAIN ] Update Progress: 2145/2372 symbols completed. TTC took 33.7s. Estimated remaining: 33m 12s. Rate: 6.8 symbols/min [2025-09-18T22:13:48.330049] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:13:48.373101] [DEBUG] [LOCAL ] TUYA: Loaded 46687 existing records from primary storage. [2025-09-18T22:13:48.373245] [INFO ] [MAIN ] TUYA: Loaded 46687 existing records. [2025-09-18T22:13:48.524725] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-11. [2025-09-18T22:13:48.554628] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:13:48.554896] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-09-18T22:13:48.554947] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-09-18T22:13:48.555859] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-09-18T22:13:48.555922] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-09-18T22:13:48.923330] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:13:48.955825] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-18T22:13:49.034249] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-18T22:13:49.319619] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-09-18T22:13:49.872015] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-18T22:13:50.119591] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-09-18T22:13:50.539842] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T22:13:50.919629] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-09-18T22:13:51.719592] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-11. [2025-09-18T22:13:51.858604] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-18T22:13:52.434433] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-18T22:13:52.519543] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-09-18T22:13:52.894032] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-18T22:13:53.319559] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-09-18T22:13:54.119537] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-09-18T22:13:54.374270] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-18T22:13:54.919620] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-09-18T22:13:55.423123] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-18T22:13:55.719572] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-09-18T22:13:56.039055] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-18T22:13:56.519553] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-09-18T22:13:56.974027] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T22:13:57.169568] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-18T22:13:57.319507] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-09-18T22:13:57.950447] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T22:13:58.119578] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-09-18T22:13:58.891218] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T22:13:58.919529] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-09-18T22:13:59.719588] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-09-18T22:13:59.825669] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-18T22:14:00.444461] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T22:14:00.519562] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-09-18T22:14:01.319623] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-09-18T22:14:01.491302] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-18T22:14:02.025474] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-18T22:14:02.119502] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-09-18T22:14:02.709773] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-18T22:14:02.919597] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-09-18T22:14:03.719544] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-09-18T22:14:03.850326] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-18T22:14:04.249212] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-18T22:14:04.519550] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-09-18T22:14:05.319521] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-09-18T22:14:05.370604] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-18T22:14:05.828102] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-18T22:14:06.119548] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-09-18T22:14:06.919554] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-09-18T22:14:07.066940] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-18T22:14:07.270760] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-18T22:14:07.276798] [INFO ] [REMOTE ] TTI: Full fetch complete (64580 records). [2025-09-18T22:14:07.276923] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-09-18T22:14:07.682865] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-09-18T22:14:07.682990] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-09-18T22:14:07.684008] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-09-18T22:14:07.684073] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-09-18T22:14:07.685497] [DEBUG] [LOCAL ] TTI: Trimmed 64580 records to 45604 (keeping 200 days of data) [2025-09-18T22:14:07.735250] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-09-18T22:14:07.962413] [DEBUG] [LOCAL ] TTI: Primary data saved (45604 records). [2025-09-18T22:14:07.962567] [INFO ] [MAIN ] TTI: Full history saved. [2025-09-18T22:14:07.962733] [INFO ] [MAIN ] Update Progress: 2146/2372 symbols completed. TTI took 29.5s. Estimated remaining: 33m 5s. Rate: 6.8 symbols/min [2025-09-18T22:14:08.143823] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:14:08.187199] [DEBUG] [LOCAL ] TV: Loaded 43149 existing records from primary storage. [2025-09-18T22:14:08.187340] [INFO ] [MAIN ] TV: Loaded 43149 existing records. [2025-09-18T22:14:08.370443] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:14:08.370802] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-09-18T22:14:08.370957] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-09-18T22:14:08.371915] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-09-18T22:14:08.371981] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-09-18T22:14:08.533379] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-09-18T22:14:08.694251] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-18T22:14:08.821659] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:14:09.319518] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-09-18T22:14:09.382989] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-18T22:14:10.103459] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-18T22:14:10.119507] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-09-18T22:14:10.919545] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-09-18T22:14:11.083761] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-18T22:14:11.567384] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T22:14:11.719523] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-09-18T22:14:12.320678] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T22:14:12.519544] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-11. [2025-09-18T22:14:12.955505] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-18T22:14:12.962939] [INFO ] [REMOTE ] TU: Full fetch complete (72828 records). [2025-09-18T22:14:12.963140] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-09-18T22:14:13.328275] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-09-18T22:14:13.378960] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-09-18T22:14:13.379052] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-09-18T22:14:13.380137] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-09-18T22:14:13.380213] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-09-18T22:14:13.382041] [DEBUG] [LOCAL ] TU: Trimmed 72828 records to 50329 (keeping 200 days of data) [2025-09-18T22:14:13.700434] [DEBUG] [LOCAL ] TU: Primary data saved (50329 records). [2025-09-18T22:14:13.700591] [INFO ] [MAIN ] TU: Full history saved. [2025-09-18T22:14:13.701320] [INFO ] [MAIN ] Update Progress: 2147/2372 symbols completed. TU took 28.1s. Estimated remaining: 32m 55s. Rate: 6.8 symbols/min [2025-09-18T22:14:13.885046] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:14:13.910546] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-18T22:14:13.922032] [DEBUG] [LOCAL ] TVC: Loaded 3552 existing records from primary storage. [2025-09-18T22:14:13.922180] [INFO ] [MAIN ] TVC: Loaded 3552 existing records. [2025-09-18T22:14:14.107538] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:14:14.108091] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-09-18T22:14:14.108151] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-09-18T22:14:14.108415] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-09-18T22:14:14.108474] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-09-18T22:14:14.129847] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-09-18T22:14:14.478015] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:14:14.744960] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-18T22:14:14.757931] [INFO ] [REMOTE ] TTE: Full fetch complete (74938 records). [2025-09-18T22:14:14.758186] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-09-18T22:14:14.924721] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-09-18T22:14:15.168379] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-09-18T22:14:15.168487] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-09-18T22:14:15.169573] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-09-18T22:14:15.169639] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-09-18T22:14:15.171126] [DEBUG] [LOCAL ] TTE: Trimmed 74938 records to 52053 (keeping 200 days of data) [2025-09-18T22:14:15.487316] [DEBUG] [LOCAL ] TTE: Primary data saved (52053 records). [2025-09-18T22:14:15.487452] [INFO ] [MAIN ] TTE: Full history saved. [2025-09-18T22:14:15.487552] [INFO ] [MAIN ] Update Progress: 2148/2372 symbols completed. TTE took 42.8s. Estimated remaining: 32m 46s. Rate: 6.8 symbols/min [2025-09-18T22:14:15.657745] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:14:15.662450] [DEBUG] [LOCAL ] TVE: Loaded 2855 existing records from primary storage. [2025-09-18T22:14:15.662532] [INFO ] [MAIN ] TVE: Loaded 2855 existing records. [2025-09-18T22:14:15.726460] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-11. [2025-09-18T22:14:15.879174] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:14:15.873442] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-18T22:14:15.879559] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-09-18T22:14:15.889956] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-09-18T22:14:15.891038] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-09-18T22:14:15.891110] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-09-18T22:14:16.292219] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:14:16.318408] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T22:14:16.415952] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-18T22:14:16.519541] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-11. [2025-09-18T22:14:16.996140] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-18T22:14:17.319559] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-09-18T22:14:18.119561] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-09-18T22:14:18.853610] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-18T22:14:18.919531] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-09-18T22:14:19.055567] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-18T22:14:19.719565] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-09-18T22:14:20.320962] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-18T22:14:20.462355] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-18T22:14:20.519561] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-09-18T22:14:20.993404] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-18T22:14:21.319591] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-09-18T22:14:22.119579] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-09-18T22:14:22.541270] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T22:14:22.715537] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-18T22:14:22.919549] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-09-18T22:14:23.719557] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-09-18T22:14:24.489032] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-18T22:14:24.522107] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-09-18T22:14:24.530690] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T22:14:25.319554] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-09-18T22:14:25.905966] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-18T22:14:26.119542] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-09-18T22:14:26.177897] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-18T22:14:26.919539] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-09-18T22:14:27.523810] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-18T22:14:27.618630] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-18T22:14:27.719582] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-09-18T22:14:28.519596] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-09-18T22:14:29.319594] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-09-18T22:14:29.381286] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-18T22:14:29.818927] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-18T22:14:29.888606] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-18T22:14:30.119607] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-09-18T22:14:30.919551] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-09-18T22:14:31.376694] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-18T22:14:31.635113] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-18T22:14:31.719554] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-09-18T22:14:32.519557] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-09-18T22:14:33.017701] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-18T22:14:33.294179] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-18T22:14:33.319583] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-09-18T22:14:34.119597] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-09-18T22:14:34.560767] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-18T22:14:34.666469] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-18T22:14:34.672866] [INFO ] [REMOTE ] TUYA: Full fetch complete (65780 records). [2025-09-18T22:14:34.673025] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-09-18T22:14:34.926698] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-09-18T22:14:35.074950] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-09-18T22:14:35.075047] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-09-18T22:14:35.076060] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-09-18T22:14:35.076143] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-09-18T22:14:35.077622] [DEBUG] [LOCAL ] TUYA: Trimmed 65780 records to 47037 (keeping 200 days of data) [2025-09-18T22:14:35.355106] [DEBUG] [LOCAL ] TUYA: Primary data saved (47037 records). [2025-09-18T22:14:35.355288] [INFO ] [MAIN ] TUYA: Full history saved. [2025-09-18T22:14:35.355429] [INFO ] [MAIN ] Update Progress: 2149/2372 symbols completed. TUYA took 47.2s. Estimated remaining: 32m 38s. Rate: 6.8 symbols/min [2025-09-18T22:14:35.522196] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-18T22:14:35.541153] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:14:35.577520] [DEBUG] [LOCAL ] TWI: Loaded 34927 existing records from primary storage. [2025-09-18T22:14:35.577672] [INFO ] [MAIN ] TWI: Loaded 34927 existing records. [2025-09-18T22:14:35.726477] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-09-18T22:14:35.760039] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:14:35.761316] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-09-18T22:14:35.761386] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-09-18T22:14:35.762366] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-09-18T22:14:35.762431] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-09-18T22:14:36.129933] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:14:36.275600] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-18T22:14:36.519545] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-11. [2025-09-18T22:14:37.319587] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-09-18T22:14:37.705469] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-18T22:14:37.757374] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-18T22:14:38.119550] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-09-18T22:14:38.919597] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-09-18T22:14:39.707577] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T22:14:39.724725] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-09-18T22:14:39.750633] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-18T22:14:40.250091] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-18T22:14:40.251456] [INFO ] [REMOTE ] TVC: Full fetch complete (5782 records). [2025-09-18T22:14:40.251541] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-09-18T22:14:40.524750] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-09-18T22:14:40.647143] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-09-18T22:14:40.647242] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-09-18T22:14:40.647429] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-09-18T22:14:40.647470] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-09-18T22:14:40.647914] [DEBUG] [LOCAL ] TVC: Trimmed 5782 records to 3569 (keeping 200 days of data) [2025-09-18T22:14:40.670219] [DEBUG] [LOCAL ] TVC: Primary data saved (3569 records). [2025-09-18T22:14:40.670313] [INFO ] [MAIN ] TVC: Full history saved. [2025-09-18T22:14:40.670437] [INFO ] [MAIN ] Update Progress: 2150/2372 symbols completed. TVC took 27.0s. Estimated remaining: 32m 29s. Rate: 6.8 symbols/min [2025-09-18T22:14:40.838345] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:14:40.913336] [DEBUG] [LOCAL ] TWLO: Loaded 52722 existing records from primary storage. [2025-09-18T22:14:40.913486] [INFO ] [MAIN ] TWLO: Loaded 52722 existing records. [2025-09-18T22:14:41.092791] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:14:41.093031] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-09-18T22:14:41.093079] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-09-18T22:14:41.094205] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-09-18T22:14:41.094265] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-09-18T22:14:41.325803] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-09-18T22:14:41.451624] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:14:41.906703] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-18T22:14:41.951837] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-18T22:14:42.119550] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-11. [2025-09-18T22:14:42.919539] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-09-18T22:14:43.719602] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-09-18T22:14:44.063553] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-11 (1.94 seconds). [2025-09-18T22:14:44.140127] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-18T22:14:44.142504] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-18T22:14:44.519506] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-09-18T22:14:45.319548] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-09-18T22:14:45.955893] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-18T22:14:46.119533] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-09-18T22:14:46.919782] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-09-18T22:14:47.055683] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-18T22:14:47.226350] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-18T22:14:47.240819] [INFO ] [REMOTE ] TV: Full fetch complete (62646 records). [2025-09-18T22:14:47.241056] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-09-18T22:14:47.358753] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-18T22:14:47.664520] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-09-18T22:14:47.664604] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-09-18T22:14:47.665736] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-09-18T22:14:47.665839] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-09-18T22:14:47.669481] [DEBUG] [LOCAL ] TV: Trimmed 62646 records to 43423 (keeping 200 days of data) [2025-09-18T22:14:47.729401] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-09-18T22:14:47.941770] [DEBUG] [LOCAL ] TV: Primary data saved (43423 records). [2025-09-18T22:14:47.941944] [INFO ] [MAIN ] TV: Full history saved. [2025-09-18T22:14:47.942259] [INFO ] [MAIN ] Update Progress: 2151/2372 symbols completed. TV took 40.0s. Estimated remaining: 32m 20s. Rate: 6.8 symbols/min [2025-09-18T22:14:48.111638] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:14:48.117685] [DEBUG] [LOCAL ] TWN: Loaded 3347 existing records from primary storage. [2025-09-18T22:14:48.117844] [INFO ] [MAIN ] TWN: Loaded 3347 existing records. [2025-09-18T22:14:48.292094] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:14:48.292330] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-09-18T22:14:48.292388] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-09-18T22:14:48.292715] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-09-18T22:14:48.292789] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-09-18T22:14:48.529719] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-09-18T22:14:48.646792] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:14:49.319581] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-09-18T22:14:49.587540] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-18T22:14:50.119551] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-09-18T22:14:50.129355] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-18T22:14:50.130620] [INFO ] [REMOTE ] TVE: Full fetch complete (4472 records). [2025-09-18T22:14:50.130730] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-09-18T22:14:50.414629] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-18T22:14:50.525727] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-09-18T22:14:50.525815] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-09-18T22:14:50.525957] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-09-18T22:14:50.525998] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-09-18T22:14:50.526436] [DEBUG] [LOCAL ] TVE: Trimmed 4472 records to 2867 (keeping 200 days of data) [2025-09-18T22:14:50.544690] [DEBUG] [LOCAL ] TVE: Primary data saved (2867 records). [2025-09-18T22:14:50.544770] [INFO ] [MAIN ] TVE: Full history saved. [2025-09-18T22:14:50.544900] [INFO ] [MAIN ] Update Progress: 2152/2372 symbols completed. TVE took 35.1s. Estimated remaining: 32m 11s. Rate: 6.8 symbols/min [2025-09-18T22:14:50.712270] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:14:50.780129] [DEBUG] [LOCAL ] TWO: Loaded 48207 existing records from primary storage. [2025-09-18T22:14:50.780303] [INFO ] [MAIN ] TWO: Loaded 48207 existing records. [2025-09-18T22:14:50.924843] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-11. [2025-09-18T22:14:50.965197] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:14:50.965517] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-09-18T22:14:50.965567] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-09-18T22:14:50.966821] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-09-18T22:14:50.966883] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-09-18T22:14:51.341902] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:14:51.662466] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-18T22:14:51.719508] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-11. [2025-09-18T22:14:51.994622] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-18T22:14:52.519927] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-09-18T22:14:53.151618] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T22:14:53.319539] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-09-18T22:14:54.124748] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-09-18T22:14:54.136673] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-18T22:14:54.644161] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-18T22:14:54.919542] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-09-18T22:14:55.559859] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-18T22:14:55.719516] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-09-18T22:14:55.800568] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-18T22:14:56.133378] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-18T22:14:56.519594] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-09-18T22:14:57.319549] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-09-18T22:14:58.119531] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-09-18T22:14:58.326377] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-18T22:14:58.919604] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-09-18T22:14:59.061104] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-18T22:14:59.128983] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-18T22:14:59.406282] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-18T22:14:59.719547] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-09-18T22:15:00.519542] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-09-18T22:15:01.274990] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-18T22:15:01.319520] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-09-18T22:15:02.119558] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-09-18T22:15:02.839984] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-18T22:15:02.919565] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-09-18T22:15:03.401969] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-18T22:15:03.719555] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-09-18T22:15:04.519562] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-09-18T22:15:04.535475] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-18T22:15:05.121627] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (3.00 seconds). [2025-09-18T22:15:05.319555] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-09-18T22:15:06.119606] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-09-18T22:15:06.345823] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (3.43 seconds). [2025-09-18T22:15:06.389773] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-18T22:15:06.531222] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-18T22:15:06.654011] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-18T22:15:06.919587] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-09-18T22:15:07.719579] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-09-18T22:15:08.519537] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-09-18T22:15:08.790379] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-18T22:15:09.020795] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-18T22:15:09.319504] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-09-18T22:15:09.483384] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-18T22:15:10.119576] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-09-18T22:15:10.775870] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-18T22:15:10.904136] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-18T22:15:10.910100] [INFO ] [REMOTE ] TWI: Full fetch complete (53343 records). [2025-09-18T22:15:10.910288] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-09-18T22:15:10.924716] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-09-18T22:15:11.357389] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-09-18T22:15:11.357505] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-09-18T22:15:11.358581] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-09-18T22:15:11.358669] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-09-18T22:15:11.359988] [DEBUG] [LOCAL ] TWI: Trimmed 53343 records to 35162 (keeping 200 days of data) [2025-09-18T22:15:11.593292] [DEBUG] [LOCAL ] TWI: Primary data saved (35162 records). [2025-09-18T22:15:11.593448] [INFO ] [MAIN ] TWI: Full history saved. [2025-09-18T22:15:11.593564] [INFO ] [MAIN ] Update Progress: 2153/2372 symbols completed. TWI took 36.2s. Estimated remaining: 32m 3s. Rate: 6.8 symbols/min [2025-09-18T22:15:11.724705] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-09-18T22:15:11.778777] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:15:11.778949] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-09-18T22:15:11.779004] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-09-18T22:15:11.779321] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-09-18T22:15:11.779386] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-18T22:15:11.779440] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-18T22:15:11.779474] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-09-18T22:15:12.149274] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:15:12.515081] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T22:15:12.525040] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-11. [2025-09-18T22:15:12.778269] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:15:12.778791] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-11 [2025-09-18T22:15:13.319556] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-09-18T22:15:13.657039] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:15:13.657394] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-09-18T22:15:13.721443] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-18T22:15:14.119553] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-01. [2025-09-18T22:15:14.357212] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:15:14.357554] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-01 [2025-09-18T22:15:14.919545] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-09-18T22:15:15.719554] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-09-18T22:15:16.075265] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-18T22:15:16.519553] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-09-18T22:15:16.958008] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-18T22:15:17.319538] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-09-18T22:15:17.776986] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-18T22:15:18.119547] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-09-18T22:15:18.574218] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-18T22:15:18.920419] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-09-18T22:15:18.923445] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-18T22:15:18.933189] [INFO ] [REMOTE ] TWLO: Full fetch complete (76284 records). [2025-09-18T22:15:18.933425] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-09-18T22:15:19.380207] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-09-18T22:15:19.380359] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-09-18T22:15:19.382165] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-09-18T22:15:19.382253] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-09-18T22:15:19.384558] [DEBUG] [LOCAL ] TWLO: Trimmed 76284 records to 53108 (keeping 200 days of data) [2025-09-18T22:15:19.469222] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-18T22:15:19.498332] [INFO ] [REMOTE ] TWN: Full fetch complete (5340 records). [2025-09-18T22:15:19.499146] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-09-18T22:15:19.725089] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-02. [2025-09-18T22:15:19.922109] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-09-18T22:15:19.923427] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-09-18T22:15:19.924372] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-09-18T22:15:19.924849] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-09-18T22:15:19.927912] [DEBUG] [LOCAL ] TWN: Trimmed 5340 records to 3362 (keeping 200 days of data) [2025-09-18T22:15:19.960056] [DEBUG] [LOCAL ] TWN: Primary data saved (3362 records). [2025-09-18T22:15:19.961616] [INFO ] [MAIN ] TWN: Full history saved. [2025-09-18T22:15:19.965366] [INFO ] [MAIN ] Update Progress: 2154/2372 symbols completed. TWN took 32.0s. Estimated remaining: 31m 54s. Rate: 6.8 symbols/min [2025-09-18T22:15:19.962438] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:15:20.020506] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-02 [2025-09-18T22:15:20.250687] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:15:20.353591] [DEBUG] [LOCAL ] TX: Loaded 23871 existing records from primary storage. [2025-09-18T22:15:20.355083] [INFO ] [MAIN ] TX: Loaded 23871 existing records. [2025-09-18T22:15:20.523917] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-09-18T22:15:20.527700] [DEBUG] [LOCAL ] TWLO: Primary data saved (53108 records). [2025-09-18T22:15:20.529544] [INFO ] [MAIN ] TWLO: Full history saved. [2025-09-18T22:15:20.536366] [INFO ] [MAIN ] Update Progress: 2155/2372 symbols completed. TWLO took 39.9s. Estimated remaining: 31m 45s. Rate: 6.8 symbols/min [2025-09-18T22:15:20.576634] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:15:20.650921] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-09-18T22:15:20.662573] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-09-18T22:15:20.690680] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-09-18T22:15:20.695924] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-09-18T22:15:20.872327] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:15:21.153395] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:15:21.167980] [DEBUG] [LOCAL ] TXNM: Loaded 44151 existing records from primary storage. [2025-09-18T22:15:21.168136] [INFO ] [MAIN ] TXNM: Loaded 44151 existing records. [2025-09-18T22:15:21.328795] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-11. [2025-09-18T22:15:21.353214] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:15:21.353502] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-09-18T22:15:21.353561] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-09-18T22:15:21.354904] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-09-18T22:15:21.354967] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-09-18T22:15:21.749753] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:15:22.119556] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-11. [2025-09-18T22:15:22.348326] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-18T22:15:22.410350] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-18T22:15:22.919557] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-09-18T22:15:23.363794] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-18T22:15:23.719551] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-09-18T22:15:24.519535] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-09-18T22:15:24.624307] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-18T22:15:24.647920] [INFO ] [REMOTE ] TWO: Full fetch complete (68511 records). [2025-09-18T22:15:24.649527] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-18T22:15:24.648844] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-09-18T22:15:25.054533] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-09-18T22:15:25.054629] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-09-18T22:15:25.055768] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-09-18T22:15:25.055837] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-09-18T22:15:25.057356] [DEBUG] [LOCAL ] TWO: Trimmed 68511 records to 48571 (keeping 200 days of data) [2025-09-18T22:15:25.337202] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-03. [2025-09-18T22:15:25.368544] [DEBUG] [LOCAL ] TWO: Primary data saved (48571 records). [2025-09-18T22:15:25.368724] [INFO ] [MAIN ] TWO: Full history saved. [2025-09-18T22:15:25.368862] [INFO ] [MAIN ] Update Progress: 2156/2372 symbols completed. TWO took 34.8s. Estimated remaining: 31m 36s. Rate: 6.8 symbols/min [2025-09-18T22:15:25.538566] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:15:25.558378] [DEBUG] [LOCAL ] TXO: Loaded 18662 existing records from primary storage. [2025-09-18T22:15:25.558513] [INFO ] [MAIN ] TXO: Loaded 18662 existing records. [2025-09-18T22:15:25.622549] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:15:25.650095] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-03 [2025-09-18T22:15:25.746448] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:15:25.746755] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-09-18T22:15:25.746812] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-09-18T22:15:25.747355] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-09-18T22:15:25.747416] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-09-18T22:15:26.126673] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-04. [2025-09-18T22:15:26.220993] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:15:26.258874] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-18T22:15:26.435907] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:15:26.436280] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-04 [2025-09-18T22:15:26.919600] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-05. [2025-09-18T22:15:27.651563] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-18T22:15:27.719596] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-09-18T22:15:28.519605] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-11. [2025-09-18T22:15:28.866068] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T22:15:29.319573] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-06. [2025-09-18T22:15:29.469427] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-18T22:15:29.989242] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-18T22:15:30.119556] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-07. [2025-09-18T22:15:30.711726] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-18T22:15:30.919563] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-09-18T22:15:31.719559] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-09-18T22:15:32.062564] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T22:15:32.301725] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-18T22:15:32.519558] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-09-18T22:15:33.319562] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-08. [2025-09-18T22:15:33.879540] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-18T22:15:34.063033] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-18T22:15:34.119554] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-09-18T22:15:34.919581] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-09-18T22:15:35.263167] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-18T22:15:35.584918] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-18T22:15:35.719551] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-09. [2025-09-18T22:15:36.216327] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-18T22:15:36.217998] [INFO ] [REMOTE ] TWOD: Full fetch complete (4212 records). [2025-09-18T22:15:36.218073] [DEBUG] [VALIDATOR ] TWOD: Validating primary data. [2025-09-18T22:15:36.410031] [WARN ] [VALIDATOR ] TWOD: Validation failed - insufficient historical data. Have 86 unique days, need 200 days [2025-09-18T22:15:36.410276] [FATAL] [MAIN ] TWOD: Fetched primary data is invalid. Refusing to save it. [2025-09-18T22:15:36.410348] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to validation failure. [2025-09-18T22:15:36.410468] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-18T22:15:36.410550] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-18T22:15:36.410590] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-09-18T22:15:36.410676] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-09-18T22:15:36.410767] [INFO ] [MAIN ] Update Progress: 2157/2372 symbols completed. TWOD took 24.8s. Estimated remaining: 31m 27s. Rate: 6.8 symbols/min [2025-09-18T22:15:36.519588] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-09-18T22:15:37.319554] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-09-18T22:15:38.085495] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-18T22:15:38.119519] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-09-18T22:15:38.192313] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-18T22:15:38.919577] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-09-18T22:15:39.594840] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T22:15:39.716015] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-18T22:15:39.720548] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-09-18T22:15:40.519560] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-09-18T22:15:40.641222] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-18T22:15:41.319627] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-09-18T22:15:41.356803] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-18T22:15:41.839711] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-18T22:15:42.119562] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-09-18T22:15:42.919563] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-09-18T22:15:43.536762] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T22:15:43.719556] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-09-18T22:15:43.779553] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-18T22:15:44.519558] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-09-18T22:15:44.985297] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-18T22:15:45.319569] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-09-18T22:15:46.013838] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T22:15:46.119531] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-09-18T22:15:46.193136] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-18T22:15:46.919554] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-09-18T22:15:47.351171] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-18T22:15:47.719567] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-09-18T22:15:47.749695] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-18T22:15:48.519621] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-09-18T22:15:49.124415] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-18T22:15:49.207853] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-18T22:15:49.319513] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-09-18T22:15:50.119557] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-09-18T22:15:50.153575] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-18T22:15:50.156607] [INFO ] [REMOTE ] TXO: Full fetch complete (25696 records). [2025-09-18T22:15:50.156754] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-09-18T22:15:50.529497] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-09-18T22:15:50.529614] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-09-18T22:15:50.530176] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-09-18T22:15:50.530232] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-09-18T22:15:50.531114] [DEBUG] [LOCAL ] TXO: Trimmed 25696 records to 18834 (keeping 200 days of data) [2025-09-18T22:15:50.650828] [DEBUG] [LOCAL ] TXO: Primary data saved (18834 records). [2025-09-18T22:15:50.650989] [INFO ] [MAIN ] TXO: Full history saved. [2025-09-18T22:15:50.651078] [INFO ] [MAIN ] Update Progress: 2158/2372 symbols completed. TXO took 25.3s. Estimated remaining: 31m 19s. Rate: 6.8 symbols/min [2025-09-18T22:15:50.919613] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-09-18T22:15:51.405213] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-18T22:15:51.719564] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-09-18T22:15:52.318827] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-18T22:15:52.519557] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-09-18T22:15:52.910886] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-18T22:15:53.319612] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-09-18T22:15:53.672203] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-18T22:15:53.677900] [INFO ] [REMOTE ] TXNM: Full fetch complete (62713 records). [2025-09-18T22:15:53.678025] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-09-18T22:15:54.053233] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-18T22:15:54.093876] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-09-18T22:15:54.094188] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-09-18T22:15:54.095423] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-09-18T22:15:54.094094] [INFO ] [REMOTE ] TX: Full fetch complete (35683 records). [2025-09-18T22:15:54.095633] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-09-18T22:15:54.096010] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-09-18T22:15:54.172192] [DEBUG] [LOCAL ] TXNM: Trimmed 62713 records to 44448 (keeping 200 days of data) [2025-09-18T22:15:54.619612] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-09-18T22:15:54.620001] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-09-18T22:15:54.621099] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-09-18T22:15:54.621183] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-09-18T22:15:54.624749] [DEBUG] [LOCAL ] TX: Trimmed 35683 records to 23999 (keeping 200 days of data) [2025-09-18T22:15:54.775463] [DEBUG] [LOCAL ] TX: Primary data saved (23999 records). [2025-09-18T22:15:54.776195] [INFO ] [MAIN ] TX: Full history saved. [2025-09-18T22:15:54.776346] [INFO ] [MAIN ] Update Progress: 2159/2372 symbols completed. TX took 34.8s. Estimated remaining: 31m 10s. Rate: 6.8 symbols/min [2025-09-18T22:15:54.935919] [DEBUG] [LOCAL ] TXNM: Primary data saved (44448 records). [2025-09-18T22:15:54.936062] [INFO ] [MAIN ] TXNM: Full history saved. [2025-09-18T22:15:54.936163] [INFO ] [MAIN ] Update Progress: 2160/2372 symbols completed. TXNM took 34.4s. Estimated remaining: 31m 0s. Rate: 6.8 symbols/min [2025-09-18T22:15:55.527413] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:15:55.558593] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:15:55.686481] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:15:55.707902] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:15:55.735683] [DEBUG] [LOCAL ] TY: Loaded 7682 existing records from primary storage. [2025-09-18T22:15:55.735978] [INFO ] [MAIN ] TY: Loaded 7682 existing records. [2025-09-18T22:15:55.735277] [DEBUG] [LOCAL ] TYL: Loaded 22466 existing records from primary storage. [2025-09-18T22:15:55.759585] [INFO ] [MAIN ] TYL: Loaded 22466 existing records. [2025-09-18T22:15:55.775406] [DEBUG] [LOCAL ] TYG: Loaded 14507 existing records from primary storage. [2025-09-18T22:15:55.852337] [INFO ] [MAIN ] TYG: Loaded 14507 existing records. [2025-09-18T22:15:56.280425] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:15:56.344715] [DEBUG] [LOCAL ] TXT: Loaded 49819 existing records from primary storage. [2025-09-18T22:15:56.371304] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-09-18T22:15:56.362218] [INFO ] [MAIN ] TXT: Loaded 49819 existing records. [2025-09-18T22:15:56.368730] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:15:56.376992] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:15:56.376797] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-09-18T22:15:56.404960] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-09-18T22:15:56.399514] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-09-18T22:15:56.415436] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-09-18T22:15:56.415536] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-09-18T22:15:56.420909] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-09-18T22:15:56.426210] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-09-18T22:15:56.432485] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-09-18T22:15:56.459706] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-09-18T22:15:56.525605] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-09-18T22:15:56.593096] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-09-18T22:15:57.141032] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:15:57.210898] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-09-18T22:15:57.236571] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-09-18T22:15:57.294377] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-09-18T22:15:57.387483] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-09-18T22:15:57.695886] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:15:57.752907] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:15:57.810282] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-11. [2025-09-18T22:15:57.809991] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:15:57.810599] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-11. [2025-09-18T22:15:57.812584] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-11. [2025-09-18T22:15:58.077787] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:15:58.078123] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-11. [2025-09-18T22:15:58.410375] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-18T22:15:58.412633] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-09-18T22:15:58.626841] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-18T22:15:58.629376] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-09-18T22:15:58.792498] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-18T22:15:58.919590] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-09-18T22:15:58.981530] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-18T22:15:59.259797] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-18T22:15:59.441201] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-18T22:15:59.719524] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-09-18T22:15:59.799617] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T22:16:00.519551] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-09-18T22:16:00.721012] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-18T22:16:01.319550] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-09-18T22:16:01.468454] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T22:16:02.119576] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-09-18T22:16:02.847233] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-18T22:16:02.919563] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-09-18T22:16:03.040966] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-18T22:16:03.518486] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-18T22:16:03.719557] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-09-18T22:16:04.397063] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-18T22:16:04.519613] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-09-18T22:16:05.319536] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-09-18T22:16:05.404308] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-18T22:16:05.967577] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-18T22:16:06.119548] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-09-18T22:16:06.919537] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-09-18T22:16:07.232739] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-18T22:16:07.719555] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-09-18T22:16:08.507885] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-18T22:16:08.519729] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-09-18T22:16:08.536433] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-18T22:16:09.319570] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-09-18T22:16:10.081344] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-18T22:16:10.119553] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-09-18T22:16:10.167454] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-18T22:16:10.919591] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-09-18T22:16:11.703764] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-18T22:16:11.724955] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-09-18T22:16:11.747518] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-18T22:16:12.444364] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T22:16:12.519563] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-09-18T22:16:13.319548] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-09-18T22:16:13.515831] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-18T22:16:14.119543] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-09-18T22:16:14.919544] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-09-18T22:16:15.069122] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-18T22:16:15.130487] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-18T22:16:15.691098] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-18T22:16:15.719499] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-09-18T22:16:16.387108] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-18T22:16:16.519542] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-09-18T22:16:17.291047] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-18T22:16:17.319533] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-09-18T22:16:18.119553] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-09-18T22:16:18.877362] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T22:16:18.919497] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-09-18T22:16:19.174132] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-18T22:16:19.719549] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-09-18T22:16:20.523148] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-09-18T22:16:20.525964] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-18T22:16:20.559630] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-18T22:16:21.319542] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-09-18T22:16:21.742102] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-18T22:16:22.119561] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-09-18T22:16:22.750553] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-18T22:16:22.752894] [INFO ] [REMOTE ] TYG: Full fetch complete (22422 records). [2025-09-18T22:16:22.752972] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-09-18T22:16:22.920607] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-09-18T22:16:23.145150] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-09-18T22:16:23.145265] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-09-18T22:16:23.145882] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-09-18T22:16:23.146017] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-09-18T22:16:23.147051] [DEBUG] [LOCAL ] TYG: Trimmed 22422 records to 14583 (keeping 200 days of data) [2025-09-18T22:16:23.251106] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-18T22:16:23.278627] [DEBUG] [LOCAL ] TYG: Primary data saved (14583 records). [2025-09-18T22:16:23.278809] [INFO ] [MAIN ] TYG: Full history saved. [2025-09-18T22:16:23.279372] [INFO ] [MAIN ] Update Progress: 2161/2372 symbols completed. TYG took 28.3s. Estimated remaining: 30m 53s. Rate: 6.8 symbols/min [2025-09-18T22:16:23.452666] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:16:23.509929] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-09-18T22:16:23.510108] [INFO ] [MAIN ] U: Loaded 53799 existing records. [2025-09-18T22:16:23.691048] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:16:23.691325] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-09-18T22:16:23.691374] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-09-18T22:16:23.692736] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-09-18T22:16:23.692797] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-09-18T22:16:23.728811] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-09-18T22:16:24.061518] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:16:24.204197] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-18T22:16:24.380106] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-18T22:16:24.519550] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-09-18T22:16:24.962699] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-18T22:16:24.969945] [INFO ] [REMOTE ] TXT: Full fetch complete (71988 records). [2025-09-18T22:16:24.970133] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-09-18T22:16:25.325465] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-09-18T22:16:25.402862] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-09-18T22:16:25.402959] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-09-18T22:16:25.404230] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-09-18T22:16:25.404301] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-09-18T22:16:25.406018] [DEBUG] [LOCAL ] TXT: Trimmed 71988 records to 50166 (keeping 200 days of data) [2025-09-18T22:16:25.727040] [DEBUG] [LOCAL ] TXT: Primary data saved (50166 records). [2025-09-18T22:16:25.727198] [INFO ] [MAIN ] TXT: Full history saved. [2025-09-18T22:16:25.727308] [INFO ] [MAIN ] Update Progress: 2162/2372 symbols completed. TXT took 30.8s. Estimated remaining: 30m 44s. Rate: 6.8 symbols/min [2025-09-18T22:16:25.897677] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:16:25.943337] [DEBUG] [LOCAL ] UA: Loaded 50372 existing records from primary storage. [2025-09-18T22:16:25.943491] [INFO ] [MAIN ] UA: Loaded 50372 existing records. [2025-09-18T22:16:26.122075] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-09-18T22:16:26.126165] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:16:26.127953] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-09-18T22:16:26.128035] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-09-18T22:16:26.129173] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-09-18T22:16:26.129236] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-09-18T22:16:26.489747] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:16:26.505434] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-18T22:16:26.622032] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-18T22:16:26.919565] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-11. [2025-09-18T22:16:27.719612] [INFO ] [REMOTE ] U: Fetching primary data for 2024-11. [2025-09-18T22:16:28.482330] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-18T22:16:28.519492] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-09-18T22:16:29.319587] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-09-18T22:16:30.057726] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-11 (2.34 seconds). [2025-09-18T22:16:30.121092] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-09-18T22:16:30.136756] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-18T22:16:30.137999] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-18T22:16:30.791132] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-18T22:16:30.792704] [INFO ] [REMOTE ] TY: Full fetch complete (11771 records). [2025-09-18T22:16:30.792775] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-09-18T22:16:30.924715] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-09-18T22:16:31.186455] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-09-18T22:16:31.186573] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-09-18T22:16:31.186879] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-09-18T22:16:31.186940] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-09-18T22:16:31.187395] [DEBUG] [LOCAL ] TY: Trimmed 11771 records to 7746 (keeping 200 days of data) [2025-09-18T22:16:31.239618] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-18T22:16:31.244490] [INFO ] [REMOTE ] TYL: Full fetch complete (31308 records). [2025-09-18T22:16:31.245158] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-09-18T22:16:31.449786] [DEBUG] [LOCAL ] TY: Primary data saved (7746 records). [2025-09-18T22:16:31.465703] [INFO ] [MAIN ] TY: Full history saved. [2025-09-18T22:16:31.467558] [INFO ] [MAIN ] Update Progress: 2163/2372 symbols completed. TY took 36.5s. Estimated remaining: 30m 35s. Rate: 6.8 symbols/min [2025-09-18T22:16:31.724281] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-09-18T22:16:31.877611] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:16:31.880164] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-09-18T22:16:31.880250] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-09-18T22:16:31.880929] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-09-18T22:16:31.881008] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-09-18T22:16:31.882493] [DEBUG] [LOCAL ] TYL: Trimmed 31308 records to 22643 (keeping 200 days of data) [2025-09-18T22:16:32.037972] [DEBUG] [LOCAL ] TYL: Primary data saved (22643 records). [2025-09-18T22:16:32.038121] [INFO ] [MAIN ] TYL: Full history saved. [2025-09-18T22:16:32.038214] [INFO ] [MAIN ] Update Progress: 2164/2372 symbols completed. TYL took 37.1s. Estimated remaining: 30m 25s. Rate: 6.8 symbols/min [2025-09-18T22:16:32.187843] [DEBUG] [LOCAL ] UAA: Loaded 53510 existing records from primary storage. [2025-09-18T22:16:32.206973] [INFO ] [MAIN ] UAA: Loaded 53510 existing records. [2025-09-18T22:16:32.304005] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:16:32.401169] [DEBUG] [LOCAL ] UAN: Loaded 5544 existing records from primary storage. [2025-09-18T22:16:32.416869] [INFO ] [MAIN ] UAN: Loaded 5544 existing records. [2025-09-18T22:16:32.466155] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:16:32.504244] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-09-18T22:16:32.504349] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-09-18T22:16:32.525464] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-09-18T22:16:32.526885] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-09-18T22:16:32.537856] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-09-18T22:16:32.723124] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:16:32.729401] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-09-18T22:16:32.739760] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-09-18T22:16:32.750330] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-09-18T22:16:32.764441] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-09-18T22:16:33.292449] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:16:33.334874] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-11. [2025-09-18T22:16:33.377632] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:16:33.529949] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-18T22:16:34.119584] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-11. [2025-09-18T22:16:34.724178] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-18T22:16:34.760407] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-18T22:16:34.919751] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-09-18T22:16:34.951717] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-18T22:16:35.719277] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-18T22:16:35.721448] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-09-18T22:16:36.519550] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-09-18T22:16:37.319560] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-09-18T22:16:37.426488] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-18T22:16:38.119578] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-09-18T22:16:38.224929] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-18T22:16:38.268833] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T22:16:38.919567] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-09-18T22:16:39.719687] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-09-18T22:16:39.842772] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-18T22:16:40.170064] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-18T22:16:40.348625] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-18T22:16:40.519547] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-09-18T22:16:41.319546] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-09-18T22:16:42.026009] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-18T22:16:42.056134] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-18T22:16:42.119507] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-09-18T22:16:42.919593] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-09-18T22:16:43.719604] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-09-18T22:16:43.869069] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-18T22:16:44.519596] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-09-18T22:16:44.992729] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-18T22:16:45.276104] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-18T22:16:45.319512] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-09-18T22:16:45.533247] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-18T22:16:45.922944] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-18T22:16:46.119548] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-09-18T22:16:46.734189] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-18T22:16:46.919589] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-09-18T22:16:47.479347] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-18T22:16:47.719577] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-09-18T22:16:48.519568] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-09-18T22:16:49.319597] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-09-18T22:16:49.843521] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-18T22:16:50.035345] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-18T22:16:50.119555] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-09-18T22:16:50.208560] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-18T22:16:50.638678] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-18T22:16:50.640291] [INFO ] [REMOTE ] UAN: Full fetch complete (8555 records). [2025-09-18T22:16:50.640399] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-09-18T22:16:50.924697] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-09-18T22:16:51.034407] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-09-18T22:16:51.034495] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-09-18T22:16:51.034773] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-09-18T22:16:51.034848] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-09-18T22:16:51.035324] [DEBUG] [LOCAL ] UAN: Trimmed 8555 records to 5573 (keeping 200 days of data) [2025-09-18T22:16:51.071032] [DEBUG] [LOCAL ] UAN: Primary data saved (5573 records). [2025-09-18T22:16:51.071165] [INFO ] [MAIN ] UAN: Full history saved. [2025-09-18T22:16:51.071349] [INFO ] [MAIN ] Update Progress: 2165/2372 symbols completed. UAN took 19.0s. Estimated remaining: 30m 17s. Rate: 6.8 symbols/min [2025-09-18T22:16:51.250479] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:16:51.305138] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-09-18T22:16:51.305288] [INFO ] [MAIN ] UBER: Loaded 53806 existing records. [2025-09-18T22:16:51.491390] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:16:51.491749] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-09-18T22:16:51.491817] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-09-18T22:16:51.492981] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-09-18T22:16:51.493045] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-09-18T22:16:51.724712] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-09-18T22:16:51.895611] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:16:52.485323] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T22:16:52.519506] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-09-18T22:16:53.319611] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-09-18T22:16:53.571605] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-18T22:16:53.816976] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-18T22:16:54.119574] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-09-18T22:16:54.919552] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-11. [2025-09-18T22:16:55.373085] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-18T22:16:55.719751] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-09-18T22:16:55.804288] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-18T22:16:56.519624] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-09-18T22:16:57.156328] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-11 (2.24 seconds). [2025-09-18T22:16:57.319578] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-09-18T22:16:57.802039] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-18T22:16:58.023276] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T22:16:58.119522] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-09-18T22:16:58.844969] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-18T22:16:58.919502] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-09-18T22:16:59.651287] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T22:16:59.719521] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-09-18T22:17:00.519616] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-09-18T22:17:00.785910] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-18T22:17:00.793344] [INFO ] [REMOTE ] UA: Full fetch complete (72711 records). [2025-09-18T22:17:00.793489] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-09-18T22:17:01.210055] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-09-18T22:17:01.210142] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-09-18T22:17:01.211182] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-09-18T22:17:01.211264] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-09-18T22:17:01.212759] [DEBUG] [LOCAL ] UA: Trimmed 72711 records to 50758 (keeping 200 days of data) [2025-09-18T22:17:01.319972] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-09-18T22:17:01.513393] [DEBUG] [LOCAL ] UA: Primary data saved (50758 records). [2025-09-18T22:17:01.513545] [INFO ] [MAIN ] UA: Full history saved. [2025-09-18T22:17:01.513729] [INFO ] [MAIN ] Update Progress: 2166/2372 symbols completed. UA took 35.8s. Estimated remaining: 30m 9s. Rate: 6.8 symbols/min [2025-09-18T22:17:01.708057] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:17:01.748795] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-18T22:17:01.806932] [DEBUG] [LOCAL ] UBS: Loaded 52509 existing records from primary storage. [2025-09-18T22:17:01.807093] [INFO ] [MAIN ] UBS: Loaded 52509 existing records. [2025-09-18T22:17:02.010983] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:17:02.011251] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-09-18T22:17:02.011299] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-09-18T22:17:02.012283] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-09-18T22:17:02.012343] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-09-18T22:17:02.123505] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-09-18T22:17:02.396399] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:17:02.910351] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-18T22:17:02.922175] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-11. [2025-09-18T22:17:03.547935] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-18T22:17:03.579919] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-18T22:17:03.588757] [INFO ] [REMOTE ] UAA: Full fetch complete (77324 records). [2025-09-18T22:17:03.588910] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-09-18T22:17:03.730523] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-09-18T22:17:03.998757] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-09-18T22:17:03.998849] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-09-18T22:17:03.999978] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-09-18T22:17:04.000043] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-09-18T22:17:04.001533] [DEBUG] [LOCAL ] UAA: Trimmed 77324 records to 53900 (keeping 200 days of data) [2025-09-18T22:17:04.329237] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-18T22:17:04.363579] [DEBUG] [LOCAL ] UAA: Primary data saved (53900 records). [2025-09-18T22:17:04.363752] [INFO ] [MAIN ] UAA: Full history saved. [2025-09-18T22:17:04.363862] [INFO ] [MAIN ] Update Progress: 2167/2372 symbols completed. UAA took 32.9s. Estimated remaining: 29m 59s. Rate: 6.8 symbols/min [2025-09-18T22:17:04.538852] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:17:04.535181] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-09-18T22:17:04.590271] [DEBUG] [LOCAL ] UCB: Loaded 38155 existing records from primary storage. [2025-09-18T22:17:04.590486] [INFO ] [MAIN ] UCB: Loaded 38155 existing records. [2025-09-18T22:17:04.774104] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:17:04.774459] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-09-18T22:17:04.774526] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-09-18T22:17:04.775552] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-09-18T22:17:04.775628] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-09-18T22:17:05.126428] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:17:05.319566] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-11. [2025-09-18T22:17:05.852591] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-18T22:17:06.119568] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-09-18T22:17:06.431708] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-18T22:17:06.602503] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-18T22:17:06.919577] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-09-18T22:17:07.719577] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-09-18T22:17:07.862502] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-18T22:17:08.519577] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-09-18T22:17:09.129382] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-18T22:17:09.319568] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-09-18T22:17:10.119608] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-09-18T22:17:10.213794] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-18T22:17:10.279361] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-18T22:17:10.488066] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-18T22:17:10.919600] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-09-18T22:17:11.719551] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-09-18T22:17:12.435090] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-18T22:17:12.475174] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-18T22:17:12.519494] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-09-18T22:17:12.874880] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-18T22:17:13.319565] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-09-18T22:17:14.119559] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-09-18T22:17:14.847426] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-18T22:17:14.919542] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-09-18T22:17:15.252996] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-18T22:17:15.411505] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-18T22:17:15.719597] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-09-18T22:17:16.519561] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-09-18T22:17:17.259401] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-18T22:17:17.319519] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-09-18T22:17:17.599203] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-18T22:17:17.606808] [INFO ] [REMOTE ] U: Full fetch complete (77872 records). [2025-09-18T22:17:17.606958] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-09-18T22:17:18.020263] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-09-18T22:17:18.020433] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-09-18T22:17:18.022796] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-09-18T22:17:18.022933] [DEBUG] [LOCAL ] U: Saving primary data. [2025-09-18T22:17:18.026708] [DEBUG] [LOCAL ] U: Trimmed 77872 records to 54189 (keeping 200 days of data) [2025-09-18T22:17:18.141328] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-09-18T22:17:18.145572] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-18T22:17:18.394360] [DEBUG] [LOCAL ] U: Primary data saved (54189 records). [2025-09-18T22:17:18.394510] [INFO ] [MAIN ] U: Full history saved. [2025-09-18T22:17:18.394715] [INFO ] [MAIN ] Update Progress: 2168/2372 symbols completed. U took 55.1s. Estimated remaining: 29m 51s. Rate: 6.8 symbols/min [2025-09-18T22:17:18.563585] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:17:18.617476] [DEBUG] [LOCAL ] UDR: Loaded 51801 existing records from primary storage. [2025-09-18T22:17:18.617676] [INFO ] [MAIN ] UDR: Loaded 51801 existing records. [2025-09-18T22:17:18.802140] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:17:18.802438] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-09-18T22:17:18.802518] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-09-18T22:17:18.803712] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-09-18T22:17:18.803795] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-09-18T22:17:18.924633] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-09-18T22:17:19.163167] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:17:19.658638] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-18T22:17:19.724778] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-09-18T22:17:19.748095] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T22:17:20.371724] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T22:17:20.519595] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-09-18T22:17:21.319567] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-11. [2025-09-18T22:17:21.769330] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-18T22:17:22.119541] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-09-18T22:17:22.421583] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-18T22:17:22.704360] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-18T22:17:22.919540] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-09-18T22:17:23.719510] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-09-18T22:17:23.892387] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-18T22:17:24.107915] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-18T22:17:24.519579] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-09-18T22:17:25.319594] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-09-18T22:17:26.064541] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-18T22:17:26.130374] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-09-18T22:17:26.135859] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-18T22:17:26.820937] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-18T22:17:26.828900] [INFO ] [REMOTE ] UBER: Full fetch complete (77952 records). [2025-09-18T22:17:26.829159] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-09-18T22:17:26.923678] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-09-18T22:17:27.182574] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-18T22:17:27.289964] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-09-18T22:17:27.290049] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-09-18T22:17:27.291122] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-09-18T22:17:27.291187] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-09-18T22:17:27.292622] [DEBUG] [LOCAL ] UBER: Trimmed 77952 records to 54196 (keeping 200 days of data) [2025-09-18T22:17:27.624228] [DEBUG] [LOCAL ] UBER: Primary data saved (54196 records). [2025-09-18T22:17:27.624369] [INFO ] [MAIN ] UBER: Full history saved. [2025-09-18T22:17:27.626103] [INFO ] [MAIN ] Update Progress: 2169/2372 symbols completed. UBER took 36.6s. Estimated remaining: 29m 42s. Rate: 6.8 symbols/min [2025-09-18T22:17:27.729300] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-09-18T22:17:27.807745] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:17:27.859526] [DEBUG] [LOCAL ] UE: Loaded 43092 existing records from primary storage. [2025-09-18T22:17:27.859718] [INFO ] [MAIN ] UE: Loaded 43092 existing records. [2025-09-18T22:17:28.082394] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:17:28.082715] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-09-18T22:17:28.082771] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-09-18T22:17:28.083834] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-09-18T22:17:28.083903] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-09-18T22:17:28.446799] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:17:28.467133] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T22:17:28.519491] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-09-18T22:17:29.319548] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-09-18T22:17:29.579901] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-18T22:17:29.654435] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T22:17:30.119546] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-09-18T22:17:30.695520] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T22:17:30.919583] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-11. [2025-09-18T22:17:31.231731] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-18T22:17:31.719566] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-09-18T22:17:32.144517] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-18T22:17:32.519567] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-09-18T22:17:33.222417] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-18T22:17:33.319495] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-09-18T22:17:34.124797] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-09-18T22:17:34.135735] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-18T22:17:34.754908] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-18T22:17:34.919554] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-09-18T22:17:35.719601] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-09-18T22:17:36.103992] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-18T22:17:36.186065] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-18T22:17:36.519702] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-09-18T22:17:37.266333] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-18T22:17:37.319505] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-09-18T22:17:37.640328] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T22:17:37.645718] [INFO ] [REMOTE ] UCB: Full fetch complete (54618 records). [2025-09-18T22:17:37.645853] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-09-18T22:17:38.054933] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-09-18T22:17:38.055026] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-09-18T22:17:38.056062] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-09-18T22:17:38.056127] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-09-18T22:17:38.059418] [DEBUG] [LOCAL ] UCB: Trimmed 54618 records to 38471 (keeping 200 days of data) [2025-09-18T22:17:38.121886] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-09-18T22:17:38.309624] [DEBUG] [LOCAL ] UCB: Primary data saved (38471 records). [2025-09-18T22:17:38.309828] [INFO ] [MAIN ] UCB: Full history saved. [2025-09-18T22:17:38.309923] [INFO ] [MAIN ] Update Progress: 2170/2372 symbols completed. UCB took 33.9s. Estimated remaining: 29m 34s. Rate: 6.8 symbols/min [2025-09-18T22:17:38.482022] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:17:38.492733] [DEBUG] [LOCAL ] UFI: Loaded 8299 existing records from primary storage. [2025-09-18T22:17:38.492858] [INFO ] [MAIN ] UFI: Loaded 8299 existing records. [2025-09-18T22:17:38.669561] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:17:38.669827] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-09-18T22:17:38.669876] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-09-18T22:17:38.670249] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-09-18T22:17:38.670309] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-09-18T22:17:38.924747] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-09-18T22:17:39.037919] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:17:39.070389] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-18T22:17:39.586190] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-18T22:17:39.719569] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-11. [2025-09-18T22:17:40.094925] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-18T22:17:40.406382] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-18T22:17:40.519531] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-09-18T22:17:41.319546] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-09-18T22:17:41.382845] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-18T22:17:42.119565] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-09-18T22:17:42.919575] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-09-18T22:17:42.998004] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-18T22:17:43.005350] [INFO ] [REMOTE ] UBS: Full fetch complete (75417 records). [2025-09-18T22:17:43.005488] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-09-18T22:17:43.393368] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-09-18T22:17:43.393498] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-09-18T22:17:43.394900] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-09-18T22:17:43.394973] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-09-18T22:17:43.399115] [DEBUG] [LOCAL ] UBS: Trimmed 75417 records to 52883 (keeping 200 days of data) [2025-09-18T22:17:43.680377] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-18T22:17:43.735443] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-09-18T22:17:43.783372] [DEBUG] [LOCAL ] UBS: Primary data saved (52883 records). [2025-09-18T22:17:43.783500] [INFO ] [MAIN ] UBS: Full history saved. [2025-09-18T22:17:43.783611] [INFO ] [MAIN ] Update Progress: 2171/2372 symbols completed. UBS took 42.3s. Estimated remaining: 29m 25s. Rate: 6.8 symbols/min [2025-09-18T22:17:43.954773] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:17:44.006612] [DEBUG] [LOCAL ] UGI: Loaded 50542 existing records from primary storage. [2025-09-18T22:17:44.006780] [INFO ] [MAIN ] UGI: Loaded 50542 existing records. [2025-09-18T22:17:44.192943] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:17:44.193463] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-09-18T22:17:44.193721] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-09-18T22:17:44.203114] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-09-18T22:17:44.218216] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-09-18T22:17:44.225841] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-18T22:17:44.521975] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-09-18T22:17:44.590696] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-18T22:17:44.667838] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:17:45.319711] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-09-18T22:17:45.921442] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T22:17:46.110495] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T22:17:46.121859] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-09-18T22:17:46.919622] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-11. [2025-09-18T22:17:47.435560] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-18T22:17:47.719608] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-09-18T22:17:48.519556] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-09-18T22:17:48.668089] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-18T22:17:48.778623] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-18T22:17:48.786403] [INFO ] [REMOTE ] UDR: Full fetch complete (74152 records). [2025-09-18T22:17:48.786526] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-09-18T22:17:49.197249] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-09-18T22:17:49.197468] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-09-18T22:17:49.198668] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-09-18T22:17:49.198841] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-09-18T22:17:49.214695] [DEBUG] [LOCAL ] UDR: Trimmed 74152 records to 52187 (keeping 200 days of data) [2025-09-18T22:17:49.226911] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-18T22:17:49.322955] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-09-18T22:17:49.555063] [DEBUG] [LOCAL ] UDR: Primary data saved (52187 records). [2025-09-18T22:17:49.555232] [INFO ] [MAIN ] UDR: Full history saved. [2025-09-18T22:17:49.555337] [INFO ] [MAIN ] Update Progress: 2172/2372 symbols completed. UDR took 31.2s. Estimated remaining: 29m 16s. Rate: 6.8 symbols/min [2025-09-18T22:17:49.728131] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:17:49.766929] [DEBUG] [LOCAL ] UGP: Loaded 42579 existing records from primary storage. [2025-09-18T22:17:49.767075] [INFO ] [MAIN ] UGP: Loaded 42579 existing records. [2025-09-18T22:17:49.949784] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:17:49.950049] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-09-18T22:17:49.950107] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-09-18T22:17:49.951023] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-09-18T22:17:49.951086] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-09-18T22:17:50.129812] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-09-18T22:17:50.166122] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-18T22:17:50.341719] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:17:50.919551] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-09-18T22:17:51.673897] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-18T22:17:51.719509] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-09-18T22:17:52.146383] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-18T22:17:52.519541] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-11. [2025-09-18T22:17:53.319588] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-09-18T22:17:53.350798] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-18T22:17:53.739235] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-18T22:17:54.119545] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-09-18T22:17:54.664009] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-18T22:17:54.919589] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-09-18T22:17:55.475371] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T22:17:55.719563] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-09-18T22:17:56.519576] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-09-18T22:17:56.588735] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T22:17:56.757147] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-18T22:17:56.763462] [INFO ] [REMOTE ] UE: Full fetch complete (61533 records). [2025-09-18T22:17:56.763589] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-09-18T22:17:57.193991] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-09-18T22:17:57.193777] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-18T22:17:57.196409] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-09-18T22:17:57.198108] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-09-18T22:17:57.198511] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-09-18T22:17:57.200234] [DEBUG] [LOCAL ] UE: Trimmed 61533 records to 43394 (keeping 200 days of data) [2025-09-18T22:17:57.319609] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-09-18T22:17:57.496586] [DEBUG] [LOCAL ] UE: Primary data saved (43394 records). [2025-09-18T22:17:57.496798] [INFO ] [MAIN ] UE: Full history saved. [2025-09-18T22:17:57.497601] [INFO ] [MAIN ] Update Progress: 2173/2372 symbols completed. UE took 29.9s. Estimated remaining: 29m 7s. Rate: 6.8 symbols/min [2025-09-18T22:17:57.685560] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:17:57.705570] [DEBUG] [LOCAL ] UHAL: Loaded 16361 existing records from primary storage. [2025-09-18T22:17:57.705779] [INFO ] [MAIN ] UHAL: Loaded 16361 existing records. [2025-09-18T22:17:57.901439] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:17:57.901767] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-09-18T22:17:57.901836] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-09-18T22:17:57.902293] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-09-18T22:17:57.902354] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-09-18T22:17:58.127288] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-09-18T22:17:58.314879] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:17:58.316775] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-18T22:17:58.919559] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-09-18T22:17:59.717957] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T22:17:59.721774] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-11. [2025-09-18T22:18:00.522307] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-09-18T22:18:00.528057] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-18T22:18:00.547611] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-18T22:18:01.319589] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-09-18T22:18:02.119548] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-09-18T22:18:02.524832] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-18T22:18:02.919577] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-09-18T22:18:03.036139] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-18T22:18:03.581604] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-18T22:18:03.719559] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-09-18T22:18:04.519557] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-09-18T22:18:04.610834] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T22:18:04.768327] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-18T22:18:05.307869] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-18T22:18:05.319497] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-09-18T22:18:06.119557] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-09-18T22:18:06.233847] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-18T22:18:06.710165] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-18T22:18:06.919573] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-09-18T22:18:07.719571] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-09-18T22:18:08.519537] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-09-18T22:18:08.666827] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-18T22:18:09.032885] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-18T22:18:09.068486] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-18T22:18:09.319556] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-09-18T22:18:10.119588] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-09-18T22:18:10.329913] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-18T22:18:10.779676] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-18T22:18:10.781279] [INFO ] [REMOTE ] UFI: Full fetch complete (12315 records). [2025-09-18T22:18:10.781350] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-09-18T22:18:10.924764] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-09-18T22:18:11.152516] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-09-18T22:18:11.152636] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-09-18T22:18:11.153107] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-09-18T22:18:11.153151] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-09-18T22:18:11.153723] [DEBUG] [LOCAL ] UFI: Trimmed 12315 records to 8340 (keeping 200 days of data) [2025-09-18T22:18:11.203587] [DEBUG] [LOCAL ] UFI: Primary data saved (8340 records). [2025-09-18T22:18:11.203766] [INFO ] [MAIN ] UFI: Full history saved. [2025-09-18T22:18:11.203867] [INFO ] [MAIN ] Update Progress: 2174/2372 symbols completed. UFI took 32.9s. Estimated remaining: 28m 58s. Rate: 6.8 symbols/min [2025-09-18T22:18:11.375187] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:18:11.423090] [DEBUG] [LOCAL ] UHS: Loaded 41525 existing records from primary storage. [2025-09-18T22:18:11.423249] [INFO ] [MAIN ] UHS: Loaded 41525 existing records. [2025-09-18T22:18:11.601887] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:18:11.602170] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-09-18T22:18:11.602222] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-09-18T22:18:11.603177] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-09-18T22:18:11.603239] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-09-18T22:18:11.724619] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-09-18T22:18:11.968606] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:18:12.519582] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-09-18T22:18:12.622024] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-18T22:18:12.720586] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-18T22:18:13.319550] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-09-18T22:18:14.119556] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-09-18T22:18:14.911885] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-18T22:18:14.920248] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-11. [2025-09-18T22:18:15.442370] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T22:18:15.719624] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-09-18T22:18:15.970090] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-18T22:18:16.385556] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-18T22:18:16.408012] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-18T22:18:16.519547] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-09-18T22:18:17.319507] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-09-18T22:18:17.433844] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-18T22:18:18.119598] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-09-18T22:18:18.919529] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-09-18T22:18:18.922903] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-18T22:18:18.943533] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-18T22:18:19.719537] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-09-18T22:18:20.435879] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-18T22:18:20.519513] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-09-18T22:18:20.640204] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-18T22:18:20.643582] [INFO ] [REMOTE ] UHAL: Full fetch complete (22972 records). [2025-09-18T22:18:20.643686] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-09-18T22:18:21.018563] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-09-18T22:18:21.018685] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-09-18T22:18:21.019176] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-09-18T22:18:21.019222] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-09-18T22:18:21.019945] [DEBUG] [LOCAL ] UHAL: Trimmed 22972 records to 16528 (keeping 200 days of data) [2025-09-18T22:18:21.118014] [DEBUG] [LOCAL ] UHAL: Primary data saved (16528 records). [2025-09-18T22:18:21.118176] [INFO ] [MAIN ] UHAL: Full history saved. [2025-09-18T22:18:21.118298] [INFO ] [MAIN ] Update Progress: 2175/2372 symbols completed. UHAL took 23.6s. Estimated remaining: 28m 50s. Rate: 6.8 symbols/min [2025-09-18T22:18:21.294146] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:18:21.305179] [DEBUG] [LOCAL ] UHT: Loaded 9994 existing records from primary storage. [2025-09-18T22:18:21.305290] [INFO ] [MAIN ] UHT: Loaded 9994 existing records. [2025-09-18T22:18:21.325827] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-09-18T22:18:21.495216] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:18:21.495615] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-09-18T22:18:21.495700] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-09-18T22:18:21.496073] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-09-18T22:18:21.496134] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-09-18T22:18:21.861224] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:18:22.119569] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-11. [2025-09-18T22:18:22.154754] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-18T22:18:22.612389] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-18T22:18:22.882703] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-18T22:18:22.919540] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-09-18T22:18:23.719593] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-09-18T22:18:24.519585] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-09-18T22:18:24.570267] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-18T22:18:24.675437] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-18T22:18:25.319575] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-09-18T22:18:26.119572] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-09-18T22:18:26.856691] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-18T22:18:26.910026] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-18T22:18:26.919489] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-09-18T22:18:27.435923] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-18T22:18:27.595060] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-18T22:18:27.719527] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-09-18T22:18:28.519546] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-09-18T22:18:29.080818] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-18T22:18:29.092120] [INFO ] [REMOTE ] UGI: Full fetch complete (73295 records). [2025-09-18T22:18:29.092361] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-09-18T22:18:29.302516] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-18T22:18:29.332614] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-09-18T22:18:29.704080] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-09-18T22:18:29.704186] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-09-18T22:18:29.705536] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-09-18T22:18:29.705618] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-09-18T22:18:29.707340] [DEBUG] [LOCAL ] UGI: Trimmed 73295 records to 50925 (keeping 200 days of data) [2025-09-18T22:18:30.088303] [DEBUG] [LOCAL ] UGI: Primary data saved (50925 records). [2025-09-18T22:18:30.088451] [INFO ] [MAIN ] UGI: Full history saved. [2025-09-18T22:18:30.088544] [INFO ] [MAIN ] Update Progress: 2176/2372 symbols completed. UGI took 46.3s. Estimated remaining: 28m 41s. Rate: 6.8 symbols/min [2025-09-18T22:18:30.124801] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-09-18T22:18:30.284281] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:18:30.299521] [DEBUG] [LOCAL ] UI: Loaded 12568 existing records from primary storage. [2025-09-18T22:18:30.299691] [INFO ] [MAIN ] UI: Loaded 12568 existing records. [2025-09-18T22:18:30.475792] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:18:30.476099] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-09-18T22:18:30.476157] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-09-18T22:18:30.476699] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-09-18T22:18:30.476776] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-09-18T22:18:30.829285] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:18:30.919532] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-11. [2025-09-18T22:18:31.086667] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-18T22:18:31.659796] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-18T22:18:31.678550] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-18T22:18:31.719486] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-09-18T22:18:32.409870] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-18T22:18:32.519527] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-09-18T22:18:33.262599] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-18T22:18:33.319493] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-09-18T22:18:34.119538] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-09-18T22:18:34.385681] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-18T22:18:34.919560] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-09-18T22:18:35.727149] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-09-18T22:18:35.730077] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-18T22:18:36.443636] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T22:18:36.450080] [INFO ] [REMOTE ] UGP: Full fetch complete (62013 records). [2025-09-18T22:18:36.450304] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-09-18T22:18:36.458939] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-18T22:18:36.524736] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-09-18T22:18:36.858572] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-09-18T22:18:36.858700] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-09-18T22:18:36.859717] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-09-18T22:18:36.859782] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-09-18T22:18:36.861099] [DEBUG] [LOCAL ] UGP: Trimmed 62013 records to 42890 (keeping 200 days of data) [2025-09-18T22:18:37.124143] [DEBUG] [LOCAL ] UGP: Primary data saved (42890 records). [2025-09-18T22:18:37.124291] [INFO ] [MAIN ] UGP: Full history saved. [2025-09-18T22:18:37.124380] [INFO ] [MAIN ] Update Progress: 2177/2372 symbols completed. UGP took 47.6s. Estimated remaining: 28m 32s. Rate: 6.8 symbols/min [2025-09-18T22:18:37.302278] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:18:37.322702] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-09-18T22:18:37.339346] [DEBUG] [LOCAL ] UIS: Loaded 37205 existing records from primary storage. [2025-09-18T22:18:37.339498] [INFO ] [MAIN ] UIS: Loaded 37205 existing records. [2025-09-18T22:18:37.533617] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:18:37.534029] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-09-18T22:18:37.534162] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-09-18T22:18:37.542287] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-09-18T22:18:37.542965] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-09-18T22:18:37.543299] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-18T22:18:37.925313] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:18:38.119604] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-09-18T22:18:38.697427] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-18T22:18:38.737350] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-18T22:18:38.919588] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-09-18T22:18:39.719614] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-09-18T22:18:39.783906] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-18T22:18:40.519587] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-09-18T22:18:41.271747] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-18T22:18:41.298494] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-18T22:18:41.319497] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-09-18T22:18:42.119571] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-09-18T22:18:42.797984] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T22:18:42.919531] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-09-18T22:18:42.983152] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-18T22:18:43.388458] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-18T22:18:43.719556] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-09-18T22:18:44.109439] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-18T22:18:44.117720] [INFO ] [REMOTE ] UHS: Full fetch complete (58274 records). [2025-09-18T22:18:44.117866] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-09-18T22:18:44.502061] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-09-18T22:18:44.502153] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-09-18T22:18:44.503109] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-09-18T22:18:44.503172] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-09-18T22:18:44.504468] [DEBUG] [LOCAL ] UHS: Trimmed 58274 records to 41794 (keeping 200 days of data) [2025-09-18T22:18:44.559723] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-09-18T22:18:44.770137] [DEBUG] [LOCAL ] UHS: Primary data saved (41794 records). [2025-09-18T22:18:44.770297] [INFO ] [MAIN ] UHS: Full history saved. [2025-09-18T22:18:44.770409] [INFO ] [MAIN ] Update Progress: 2178/2372 symbols completed. UHS took 33.6s. Estimated remaining: 28m 23s. Rate: 6.8 symbols/min [2025-09-18T22:18:44.940156] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:18:44.994172] [DEBUG] [LOCAL ] UL: Loaded 53076 existing records from primary storage. [2025-09-18T22:18:44.994315] [INFO ] [MAIN ] UL: Loaded 53076 existing records. [2025-09-18T22:18:45.205021] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:18:45.205292] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-09-18T22:18:45.205357] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-09-18T22:18:45.206541] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-09-18T22:18:45.206604] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-09-18T22:18:45.324736] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-09-18T22:18:45.583383] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:18:45.593048] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-18T22:18:46.113371] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T22:18:46.119483] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-09-18T22:18:46.846631] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-18T22:18:46.848564] [INFO ] [REMOTE ] UHT: Full fetch complete (15167 records). [2025-09-18T22:18:46.848636] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-09-18T22:18:46.924975] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-11. [2025-09-18T22:18:47.230892] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-09-18T22:18:47.231020] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-09-18T22:18:47.231491] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-09-18T22:18:47.231559] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-09-18T22:18:47.232448] [DEBUG] [LOCAL ] UHT: Trimmed 15167 records to 10094 (keeping 200 days of data) [2025-09-18T22:18:47.302984] [DEBUG] [LOCAL ] UHT: Primary data saved (10094 records). [2025-09-18T22:18:47.303132] [INFO ] [MAIN ] UHT: Full history saved. [2025-09-18T22:18:47.303237] [INFO ] [MAIN ] Update Progress: 2179/2372 symbols completed. UHT took 26.2s. Estimated remaining: 28m 14s. Rate: 6.8 symbols/min [2025-09-18T22:18:47.474261] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:18:47.516030] [DEBUG] [LOCAL ] ULS: Loaded 39196 existing records from primary storage. [2025-09-18T22:18:47.516169] [INFO ] [MAIN ] ULS: Loaded 39196 existing records. [2025-09-18T22:18:47.719113] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:18:47.719520] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-09-18T22:18:47.719906] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-09-18T22:18:47.719589] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-09-18T22:18:47.722121] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-09-18T22:18:47.722200] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-09-18T22:18:48.085608] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:18:48.433466] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-18T22:18:48.519502] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-09-18T22:18:48.574819] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T22:18:49.319682] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-09-18T22:18:49.547128] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-18T22:18:50.119572] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-11. [2025-09-18T22:18:50.919510] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-11. [2025-09-18T22:18:50.971906] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-18T22:18:51.536213] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T22:18:51.719572] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-09-18T22:18:52.213348] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-18T22:18:52.519551] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-09-18T22:18:53.319584] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-09-18T22:18:53.561873] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-18T22:18:53.583968] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-18T22:18:54.119621] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-09-18T22:18:54.391150] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-18T22:18:54.919540] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-09-18T22:18:54.931780] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-18T22:18:54.934801] [INFO ] [REMOTE ] UI: Full fetch complete (17856 records). [2025-09-18T22:18:54.934889] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-09-18T22:18:55.305660] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-09-18T22:18:55.305764] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-09-18T22:18:55.306220] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-09-18T22:18:55.306262] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-09-18T22:18:55.306911] [DEBUG] [LOCAL ] UI: Trimmed 17856 records to 12646 (keeping 200 days of data) [2025-09-18T22:18:55.393963] [DEBUG] [LOCAL ] UI: Primary data saved (12646 records). [2025-09-18T22:18:55.394134] [INFO ] [MAIN ] UI: Full history saved. [2025-09-18T22:18:55.394229] [INFO ] [MAIN ] Update Progress: 2180/2372 symbols completed. UI took 25.3s. Estimated remaining: 28m 5s. Rate: 6.8 symbols/min [2025-09-18T22:18:55.565908] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:18:55.617511] [DEBUG] [LOCAL ] UMC: Loaded 52732 existing records from primary storage. [2025-09-18T22:18:55.617703] [INFO ] [MAIN ] UMC: Loaded 52732 existing records. [2025-09-18T22:18:55.720249] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-09-18T22:18:55.799476] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:18:55.799770] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-09-18T22:18:55.799826] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-09-18T22:18:55.801075] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-09-18T22:18:55.801143] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-09-18T22:18:56.152785] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:18:56.519569] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-11. [2025-09-18T22:18:56.706720] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-18T22:18:57.031273] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T22:18:57.319549] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-09-18T22:18:58.033723] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-18T22:18:58.119549] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-09-18T22:18:58.233372] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-18T22:18:58.919546] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-09-18T22:18:59.719557] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-09-18T22:18:59.820445] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-18T22:18:59.891193] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-18T22:19:00.519588] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-09-18T22:19:01.319699] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-09-18T22:19:01.779123] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-18T22:19:01.838160] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T22:19:02.119578] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-09-18T22:19:02.361704] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-18T22:19:02.919550] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-09-18T22:19:03.719564] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-09-18T22:19:03.845359] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-18T22:19:03.883592] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-18T22:19:04.519629] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-09-18T22:19:05.065872] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-18T22:19:05.319539] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-09-18T22:19:06.119559] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-09-18T22:19:06.547473] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-18T22:19:06.670877] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-18T22:19:06.919574] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-09-18T22:19:07.719566] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-09-18T22:19:07.786964] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-18T22:19:08.519534] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-09-18T22:19:08.557090] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-18T22:19:08.845499] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-18T22:19:09.319595] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-09-18T22:19:09.998057] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-18T22:19:10.119522] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-09-18T22:19:10.899692] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-18T22:19:10.919503] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-09-18T22:19:11.423382] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-18T22:19:11.719547] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-09-18T22:19:12.519541] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-09-18T22:19:12.798097] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-18T22:19:13.161696] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-18T22:19:13.319536] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-09-18T22:19:13.639353] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-18T22:19:14.119563] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-09-18T22:19:14.919545] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-09-18T22:19:15.123683] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-18T22:19:15.149408] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-18T22:19:15.155174] [INFO ] [REMOTE ] ULS: Full fetch complete (54293 records). [2025-09-18T22:19:15.155325] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-09-18T22:19:15.540387] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-09-18T22:19:15.540472] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-09-18T22:19:15.541394] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-09-18T22:19:15.541476] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-09-18T22:19:15.542706] [DEBUG] [LOCAL ] ULS: Trimmed 54293 records to 39475 (keeping 200 days of data) [2025-09-18T22:19:15.724097] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-09-18T22:19:15.797297] [DEBUG] [LOCAL ] ULS: Primary data saved (39475 records). [2025-09-18T22:19:15.797459] [INFO ] [MAIN ] ULS: Full history saved. [2025-09-18T22:19:15.798804] [INFO ] [MAIN ] Update Progress: 2181/2372 symbols completed. ULS took 28.5s. Estimated remaining: 27m 57s. Rate: 6.8 symbols/min [2025-09-18T22:19:15.969751] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:19:16.006247] [DEBUG] [LOCAL ] UMH: Loaded 32980 existing records from primary storage. [2025-09-18T22:19:16.006390] [INFO ] [MAIN ] UMH: Loaded 32980 existing records. [2025-09-18T22:19:16.185969] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:19:16.186458] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-09-18T22:19:16.186665] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-09-18T22:19:16.187493] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-09-18T22:19:16.187554] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-09-18T22:19:16.387248] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-18T22:19:16.524785] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-09-18T22:19:16.587404] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:19:17.259536] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T22:19:17.319541] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-11. [2025-09-18T22:19:18.119545] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-09-18T22:19:18.403904] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-18T22:19:18.501007] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-18T22:19:18.919540] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-09-18T22:19:19.216425] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-18T22:19:19.719550] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-09-18T22:19:20.519704] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-09-18T22:19:20.631624] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-18T22:19:21.203991] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T22:19:21.319555] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-09-18T22:19:22.000705] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T22:19:22.119552] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-09-18T22:19:22.919596] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-09-18T22:19:23.029754] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-18T22:19:23.400475] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-18T22:19:23.719572] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-09-18T22:19:23.938337] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-18T22:19:24.519591] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-09-18T22:19:25.319604] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-09-18T22:19:25.509431] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-18T22:19:25.517473] [INFO ] [REMOTE ] UL: Full fetch complete (76674 records). [2025-09-18T22:19:25.517613] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-09-18T22:19:25.854430] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-18T22:19:25.875753] [INFO ] [REMOTE ] UIS: Full fetch complete (51785 records). [2025-09-18T22:19:25.896377] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-09-18T22:19:26.071791] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-09-18T22:19:26.074602] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-09-18T22:19:26.075878] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-09-18T22:19:26.076245] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-09-18T22:19:26.122016] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-09-18T22:19:26.157917] [DEBUG] [LOCAL ] UL: Trimmed 76674 records to 53461 (keeping 200 days of data) [2025-09-18T22:19:26.494857] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-09-18T22:19:26.495495] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-09-18T22:19:26.496748] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-09-18T22:19:26.496827] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-09-18T22:19:26.503760] [DEBUG] [LOCAL ] UIS: Trimmed 51785 records to 37454 (keeping 200 days of data) [2025-09-18T22:19:26.915943] [DEBUG] [LOCAL ] UIS: Primary data saved (37454 records). [2025-09-18T22:19:26.917062] [INFO ] [MAIN ] UIS: Full history saved. [2025-09-18T22:19:26.917579] [INFO ] [MAIN ] Update Progress: 2182/2372 symbols completed. UIS took 49.8s. Estimated remaining: 27m 49s. Rate: 6.8 symbols/min [2025-09-18T22:19:27.134635] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:19:27.182191] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-18T22:19:27.198928] [DEBUG] [LOCAL ] UL: Primary data saved (53461 records). [2025-09-18T22:19:27.202767] [INFO ] [MAIN ] UL: Full history saved. [2025-09-18T22:19:27.203009] [INFO ] [MAIN ] Update Progress: 2183/2372 symbols completed. UL took 42.4s. Estimated remaining: 27m 39s. Rate: 6.8 symbols/min [2025-09-18T22:19:27.215805] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-09-18T22:19:27.266298] [DEBUG] [LOCAL ] UNF: Loaded 11792 existing records from primary storage. [2025-09-18T22:19:27.315308] [INFO ] [MAIN ] UNF: Loaded 11792 existing records. [2025-09-18T22:19:27.376220] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T22:19:27.520575] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:19:27.615266] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:19:27.615549] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-09-18T22:19:27.615740] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-09-18T22:19:27.616232] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-09-18T22:19:27.616305] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-09-18T22:19:27.735384] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-09-18T22:19:27.848462] [DEBUG] [LOCAL ] UNFI: Loaded 41923 existing records from primary storage. [2025-09-18T22:19:27.880921] [INFO ] [MAIN ] UNFI: Loaded 41923 existing records. [2025-09-18T22:19:28.191512] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:19:28.220311] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:19:28.220529] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-09-18T22:19:28.220606] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-09-18T22:19:28.221458] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-09-18T22:19:28.221554] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-09-18T22:19:28.524732] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-11. [2025-09-18T22:19:28.581541] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:19:28.779396] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-18T22:19:29.076146] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-18T22:19:29.125739] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-18T22:19:29.133891] [INFO ] [REMOTE ] UMC: Full fetch complete (76459 records). [2025-09-18T22:19:29.134031] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-09-18T22:19:29.320847] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-11. [2025-09-18T22:19:29.548483] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-09-18T22:19:29.548567] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-09-18T22:19:29.549668] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-09-18T22:19:29.549739] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-09-18T22:19:29.553977] [DEBUG] [LOCAL ] UMC: Trimmed 76459 records to 53118 (keeping 200 days of data) [2025-09-18T22:19:29.884303] [DEBUG] [LOCAL ] UMC: Primary data saved (53118 records). [2025-09-18T22:19:29.884615] [INFO ] [MAIN ] UMC: Full history saved. [2025-09-18T22:19:29.884975] [INFO ] [MAIN ] Update Progress: 2184/2372 symbols completed. UMC took 34.5s. Estimated remaining: 27m 30s. Rate: 6.8 symbols/min [2025-09-18T22:19:30.056815] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:19:30.116170] [DEBUG] [LOCAL ] UNH: Loaded 53793 existing records from primary storage. [2025-09-18T22:19:30.116325] [INFO ] [MAIN ] UNH: Loaded 53793 existing records. [2025-09-18T22:19:30.128328] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-09-18T22:19:30.297171] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:19:30.297433] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-09-18T22:19:30.297492] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-09-18T22:19:30.298832] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-09-18T22:19:30.298892] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-09-18T22:19:30.669006] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:19:30.691087] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-18T22:19:30.919538] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-11. [2025-09-18T22:19:31.030519] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-18T22:19:31.719636] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-09-18T22:19:32.519611] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-09-18T22:19:32.830676] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-18T22:19:32.894259] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-18T22:19:33.254715] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-18T22:19:33.319491] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-09-18T22:19:33.978696] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-18T22:19:34.119566] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-09-18T22:19:34.919554] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-09-18T22:19:35.525636] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-18T22:19:35.543164] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-18T22:19:35.719543] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-09-18T22:19:36.519582] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-09-18T22:19:36.808707] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-18T22:19:37.319561] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-09-18T22:19:38.119553] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-09-18T22:19:38.690506] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-18T22:19:38.735423] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-18T22:19:38.768384] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T22:19:38.919547] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-09-18T22:19:39.719584] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-09-18T22:19:39.971463] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-18T22:19:40.519614] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-09-18T22:19:41.236192] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T22:19:41.319575] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-09-18T22:19:42.105937] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-18T22:19:42.119508] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-09-18T22:19:42.144534] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-18T22:19:42.919585] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-09-18T22:19:43.546533] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T22:19:43.719580] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-09-18T22:19:43.892353] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-18T22:19:44.297887] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-18T22:19:44.300057] [INFO ] [REMOTE ] UNF: Full fetch complete (17000 records). [2025-09-18T22:19:44.300132] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-09-18T22:19:44.524901] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-09-18T22:19:44.715209] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-09-18T22:19:44.715304] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-09-18T22:19:44.715740] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-09-18T22:19:44.715803] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-09-18T22:19:44.716429] [DEBUG] [LOCAL ] UNF: Trimmed 17000 records to 11907 (keeping 200 days of data) [2025-09-18T22:19:44.804041] [DEBUG] [LOCAL ] UNF: Primary data saved (11907 records). [2025-09-18T22:19:44.804208] [INFO ] [MAIN ] UNF: Full history saved. [2025-09-18T22:19:44.804363] [INFO ] [MAIN ] Update Progress: 2185/2372 symbols completed. UNF took 17.9s. Estimated remaining: 27m 22s. Rate: 6.8 symbols/min [2025-09-18T22:19:44.973291] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:19:45.028920] [DEBUG] [LOCAL ] UNM: Loaded 48808 existing records from primary storage. [2025-09-18T22:19:45.029069] [INFO ] [MAIN ] UNM: Loaded 48808 existing records. [2025-09-18T22:19:45.212770] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:19:45.213045] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-09-18T22:19:45.213099] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-09-18T22:19:45.215610] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-09-18T22:19:45.215707] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-09-18T22:19:45.324794] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-09-18T22:19:45.576678] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:19:45.941622] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-18T22:19:46.119556] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-11. [2025-09-18T22:19:46.919603] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-09-18T22:19:47.365907] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-18T22:19:47.719521] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-09-18T22:19:47.796988] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-18T22:19:47.870373] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-18T22:19:48.519565] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-09-18T22:19:49.319574] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-09-18T22:19:49.750086] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-18T22:19:49.900795] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-18T22:19:50.119581] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-09-18T22:19:50.832329] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-18T22:19:50.919633] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-09-18T22:19:51.719563] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-09-18T22:19:52.360032] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-18T22:19:52.519524] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-09-18T22:19:52.564879] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-18T22:19:52.619961] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-18T22:19:53.319553] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-09-18T22:19:54.037704] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T22:19:54.119540] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-09-18T22:19:54.565454] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-18T22:19:54.570706] [INFO ] [REMOTE ] UMH: Full fetch complete (46166 records). [2025-09-18T22:19:54.570802] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-09-18T22:19:54.927592] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-09-18T22:19:54.971287] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-09-18T22:19:54.971510] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-09-18T22:19:54.972480] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-09-18T22:19:54.972548] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-09-18T22:19:54.973912] [DEBUG] [LOCAL ] UMH: Trimmed 46166 records to 33251 (keeping 200 days of data) [2025-09-18T22:19:55.197491] [DEBUG] [LOCAL ] UMH: Primary data saved (33251 records). [2025-09-18T22:19:55.197628] [INFO ] [MAIN ] UMH: Full history saved. [2025-09-18T22:19:55.198376] [INFO ] [MAIN ] Update Progress: 2186/2372 symbols completed. UMH took 39.4s. Estimated remaining: 27m 13s. Rate: 6.8 symbols/min [2025-09-18T22:19:55.369132] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:19:55.379723] [DEBUG] [LOCAL ] UNMA: Loaded 3745 existing records from primary storage. [2025-09-18T22:19:55.379859] [INFO ] [MAIN ] UNMA: Loaded 3745 existing records. [2025-09-18T22:19:55.569634] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:19:55.570004] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-09-18T22:19:55.570214] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-09-18T22:19:55.570675] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-09-18T22:19:55.570867] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-09-18T22:19:55.726257] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-09-18T22:19:55.895151] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-18T22:19:55.987721] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:19:56.519582] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-09-18T22:19:57.210533] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T22:19:57.319499] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-09-18T22:19:57.575957] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-09-18T22:19:58.119582] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-11. [2025-09-18T22:19:58.287705] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-18T22:19:58.360730] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-18T22:19:58.628951] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-18T22:19:58.919522] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-09-18T22:19:59.528630] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-18T22:19:59.719552] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-09-18T22:20:00.519555] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-09-18T22:20:01.319626] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-09-18T22:20:01.556514] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-18T22:20:01.631181] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-18T22:20:02.119548] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-09-18T22:20:02.919565] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-09-18T22:20:03.535145] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-18T22:20:03.719559] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-09-18T22:20:03.810126] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-18T22:20:04.114364] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-09-18T22:20:04.192129] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-18T22:20:04.519550] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-09-18T22:20:05.319574] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-09-18T22:20:06.119611] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-09-18T22:20:06.254401] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-18T22:20:06.719395] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-18T22:20:06.919556] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-09-18T22:20:07.568565] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-18T22:20:07.719565] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-09-18T22:20:08.519555] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-09-18T22:20:09.019474] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-09-18T22:20:09.221885] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-18T22:20:09.319501] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-09-18T22:20:09.652475] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-18T22:20:10.119558] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-09-18T22:20:10.584234] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-18T22:20:10.591574] [INFO ] [REMOTE ] UNH: Full fetch complete (77723 records). [2025-09-18T22:20:10.591747] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-09-18T22:20:10.921360] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-09-18T22:20:10.994577] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-09-18T22:20:10.994756] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-09-18T22:20:10.995974] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-09-18T22:20:10.996272] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-09-18T22:20:10.998160] [DEBUG] [LOCAL ] UNH: Trimmed 77723 records to 54183 (keeping 200 days of data) [2025-09-18T22:20:11.127474] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-18T22:20:11.387283] [DEBUG] [LOCAL ] UNH: Primary data saved (54183 records). [2025-09-18T22:20:11.387430] [INFO ] [MAIN ] UNH: Full history saved. [2025-09-18T22:20:11.387529] [INFO ] [MAIN ] Update Progress: 2187/2372 symbols completed. UNH took 41.5s. Estimated remaining: 27m 5s. Rate: 6.8 symbols/min [2025-09-18T22:20:11.565441] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:20:11.568981] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-18T22:20:11.622683] [DEBUG] [LOCAL ] UNP: Loaded 53220 existing records from primary storage. [2025-09-18T22:20:11.622842] [INFO ] [MAIN ] UNP: Loaded 53220 existing records. [2025-09-18T22:20:11.722491] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-09-18T22:20:11.815528] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:20:11.816015] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-09-18T22:20:11.816089] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-09-18T22:20:11.817310] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-09-18T22:20:11.817374] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-09-18T22:20:12.197492] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:20:12.202266] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-18T22:20:12.519548] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-09-18T22:20:13.091716] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-18T22:20:13.319524] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-09-18T22:20:14.119557] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-11. [2025-09-18T22:20:14.677454] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-18T22:20:14.683600] [INFO ] [REMOTE ] UNFI: Full fetch complete (58633 records). [2025-09-18T22:20:14.683754] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-09-18T22:20:14.929168] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-09-18T22:20:15.068238] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-09-18T22:20:15.068337] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-09-18T22:20:15.069326] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-09-18T22:20:15.069419] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-09-18T22:20:15.071711] [DEBUG] [LOCAL ] UNFI: Trimmed 58633 records to 42263 (keeping 200 days of data) [2025-09-18T22:20:15.331997] [DEBUG] [LOCAL ] UNFI: Primary data saved (42263 records). [2025-09-18T22:20:15.332177] [INFO ] [MAIN ] UNFI: Full history saved. [2025-09-18T22:20:15.332309] [INFO ] [MAIN ] Update Progress: 2188/2372 symbols completed. UNFI took 48.1s. Estimated remaining: 26m 56s. Rate: 6.8 symbols/min [2025-09-18T22:20:15.503247] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:20:15.548202] [DEBUG] [LOCAL ] UP: Loaded 42932 existing records from primary storage. [2025-09-18T22:20:15.548355] [INFO ] [MAIN ] UP: Loaded 42932 existing records. [2025-09-18T22:20:15.657473] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-18T22:20:15.719521] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-09-18T22:20:15.744880] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:20:15.746274] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-09-18T22:20:15.746513] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-09-18T22:20:15.747795] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-09-18T22:20:15.747919] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-09-18T22:20:16.044263] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-18T22:20:16.167680] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:20:16.519543] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-09-18T22:20:17.005442] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-18T22:20:17.319543] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-09-18T22:20:17.356810] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T22:20:17.717943] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-18T22:20:17.719068] [INFO ] [REMOTE ] UNMA: Full fetch complete (5845 records). [2025-09-18T22:20:17.719145] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-09-18T22:20:18.113768] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-09-18T22:20:18.113863] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-09-18T22:20:18.114074] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-09-18T22:20:18.114116] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-09-18T22:20:18.114512] [DEBUG] [LOCAL ] UNMA: Trimmed 5845 records to 3759 (keeping 200 days of data) [2025-09-18T22:20:18.125847] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-09-18T22:20:18.142208] [DEBUG] [LOCAL ] UNMA: Primary data saved (3759 records). [2025-09-18T22:20:18.142335] [INFO ] [MAIN ] UNMA: Full history saved. [2025-09-18T22:20:18.142424] [INFO ] [MAIN ] Update Progress: 2189/2372 symbols completed. UNMA took 22.9s. Estimated remaining: 26m 46s. Rate: 6.8 symbols/min [2025-09-18T22:20:18.329200] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:20:18.398577] [DEBUG] [LOCAL ] UPS: Loaded 53710 existing records from primary storage. [2025-09-18T22:20:18.398780] [INFO ] [MAIN ] UPS: Loaded 53710 existing records. [2025-09-18T22:20:18.590943] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:20:18.591221] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-09-18T22:20:18.591272] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-09-18T22:20:18.592920] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-09-18T22:20:18.592984] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-09-18T22:20:18.932559] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-09-18T22:20:18.952814] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:20:19.573156] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T22:20:19.580165] [INFO ] [REMOTE ] UNM: Full fetch complete (69965 records). [2025-09-18T22:20:19.580300] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-09-18T22:20:19.729793] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-11. [2025-09-18T22:20:19.973891] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-09-18T22:20:19.973984] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-09-18T22:20:19.975090] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-09-18T22:20:19.975158] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-09-18T22:20:19.976875] [DEBUG] [LOCAL ] UNM: Trimmed 69965 records to 49184 (keeping 200 days of data) [2025-09-18T22:20:20.286087] [DEBUG] [LOCAL ] UNM: Primary data saved (49184 records). [2025-09-18T22:20:20.286269] [INFO ] [MAIN ] UNM: Full history saved. [2025-09-18T22:20:20.286389] [INFO ] [MAIN ] Update Progress: 2190/2372 symbols completed. UNM took 35.5s. Estimated remaining: 26m 37s. Rate: 6.8 symbols/min [2025-09-18T22:20:20.461484] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:20:20.501339] [DEBUG] [LOCAL ] URI: Loaded 36854 existing records from primary storage. [2025-09-18T22:20:20.501507] [INFO ] [MAIN ] URI: Loaded 36854 existing records. [2025-09-18T22:20:20.524912] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-11. [2025-09-18T22:20:20.736476] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-18T22:20:20.736666] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:20:20.753325] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-09-18T22:20:20.753634] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-09-18T22:20:20.755071] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-09-18T22:20:20.755142] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-09-18T22:20:21.148782] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:20:21.319613] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-11. [2025-09-18T22:20:21.499609] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-18T22:20:21.739495] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-18T22:20:22.119596] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-09-18T22:20:22.549477] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-18T22:20:22.919605] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-09-18T22:20:23.648598] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-18T22:20:23.719584] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-09-18T22:20:24.519561] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-09-18T22:20:24.777264] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-18T22:20:24.868064] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-18T22:20:25.319535] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-09-18T22:20:25.763717] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-18T22:20:26.119555] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-09-18T22:20:26.919566] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-09-18T22:20:26.968381] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-18T22:20:27.535308] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T22:20:27.719601] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-09-18T22:20:28.519576] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-09-18T22:20:28.929994] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-18T22:20:28.967425] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T22:20:29.319585] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-09-18T22:20:30.119588] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-09-18T22:20:30.436228] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-18T22:20:30.919555] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-09-18T22:20:31.156432] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-18T22:20:31.556740] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-18T22:20:31.719520] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-09-18T22:20:32.043962] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-18T22:20:32.519608] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-09-18T22:20:33.106274] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T22:20:33.319547] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-09-18T22:20:34.119694] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-09-18T22:20:34.204619] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-18T22:20:34.386542] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-18T22:20:34.919601] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-09-18T22:20:35.719576] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-09-18T22:20:36.042732] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-18T22:20:36.386148] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-18T22:20:36.519569] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-09-18T22:20:36.952275] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T22:20:37.319557] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-09-18T22:20:37.860016] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T22:20:38.119560] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-09-18T22:20:38.899664] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T22:20:38.919503] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-09-18T22:20:39.719553] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-09-18T22:20:40.459748] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-18T22:20:40.504992] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-18T22:20:40.519513] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-09-18T22:20:40.876783] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-18T22:20:41.319603] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-09-18T22:20:42.119704] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-09-18T22:20:42.555852] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-18T22:20:42.919614] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-09-18T22:20:43.157821] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-18T22:20:43.535605] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-18T22:20:43.719635] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-09-18T22:20:44.519696] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-09-18T22:20:44.709393] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-18T22:20:45.319698] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-09-18T22:20:45.534817] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-18T22:20:45.664207] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-18T22:20:46.119598] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-09-18T22:20:46.454958] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-18T22:20:46.462383] [INFO ] [REMOTE ] UNP: Full fetch complete (76734 records). [2025-09-18T22:20:46.462544] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-09-18T22:20:46.864725] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-09-18T22:20:46.864833] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-09-18T22:20:46.865915] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-09-18T22:20:46.866080] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-09-18T22:20:46.887844] [DEBUG] [LOCAL ] UNP: Trimmed 76734 records to 53610 (keeping 200 days of data) [2025-09-18T22:20:46.889502] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-18T22:20:46.953737] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-09-18T22:20:47.235874] [DEBUG] [LOCAL ] UNP: Primary data saved (53610 records). [2025-09-18T22:20:47.236036] [INFO ] [MAIN ] UNP: Full history saved. [2025-09-18T22:20:47.236152] [INFO ] [MAIN ] Update Progress: 2191/2372 symbols completed. UNP took 35.8s. Estimated remaining: 26m 30s. Rate: 6.8 symbols/min [2025-09-18T22:20:47.406741] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:20:47.441351] [DEBUG] [LOCAL ] USA: Loaded 36201 existing records from primary storage. [2025-09-18T22:20:47.441512] [INFO ] [MAIN ] USA: Loaded 36201 existing records. [2025-09-18T22:20:47.618871] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:20:47.619082] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-09-18T22:20:47.619128] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-09-18T22:20:47.619851] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-09-18T22:20:47.619911] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-09-18T22:20:47.721711] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-09-18T22:20:47.987127] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:20:48.384508] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-18T22:20:48.519557] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-09-18T22:20:48.896835] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-18T22:20:48.901787] [INFO ] [REMOTE ] URI: Full fetch complete (53634 records). [2025-09-18T22:20:48.901884] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-09-18T22:20:49.279015] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-09-18T22:20:49.279103] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-09-18T22:20:49.280023] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-09-18T22:20:49.280086] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-09-18T22:20:49.281233] [DEBUG] [LOCAL ] URI: Trimmed 53634 records to 37118 (keeping 200 days of data) [2025-09-18T22:20:49.339591] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-09-18T22:20:49.525221] [DEBUG] [LOCAL ] URI: Primary data saved (37118 records). [2025-09-18T22:20:49.525371] [INFO ] [MAIN ] URI: Full history saved. [2025-09-18T22:20:49.525499] [INFO ] [MAIN ] Update Progress: 2192/2372 symbols completed. URI took 29.2s. Estimated remaining: 26m 20s. Rate: 6.8 symbols/min [2025-09-18T22:20:49.695793] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:20:49.718094] [DEBUG] [LOCAL ] USAC: Loaded 22957 existing records from primary storage. [2025-09-18T22:20:49.718214] [INFO ] [MAIN ] USAC: Loaded 22957 existing records. [2025-09-18T22:20:49.899535] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:20:49.899964] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-09-18T22:20:49.900039] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-09-18T22:20:49.900757] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-09-18T22:20:49.900817] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-09-18T22:20:50.126225] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-11. [2025-09-18T22:20:50.315431] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:20:50.309697] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-18T22:20:50.694932] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T22:20:50.919509] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-11. [2025-09-18T22:20:51.178387] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-18T22:20:51.714613] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-18T22:20:51.719765] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-09-18T22:20:52.519535] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-09-18T22:20:52.896758] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-18T22:20:53.319595] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-09-18T22:20:54.119557] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-09-18T22:20:54.330458] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-18T22:20:54.579438] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-18T22:20:54.919546] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-09-18T22:20:55.330918] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-18T22:20:55.339711] [INFO ] [REMOTE ] UPS: Full fetch complete (77651 records). [2025-09-18T22:20:55.339898] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-09-18T22:20:55.724621] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-09-18T22:20:55.782673] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-09-18T22:20:55.782840] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-09-18T22:20:55.784013] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-09-18T22:20:55.784095] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-09-18T22:20:55.786124] [DEBUG] [LOCAL ] UPS: Trimmed 77651 records to 54100 (keeping 200 days of data) [2025-09-18T22:20:55.907905] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-18T22:20:56.172747] [DEBUG] [LOCAL ] UPS: Primary data saved (54100 records). [2025-09-18T22:20:56.172919] [INFO ] [MAIN ] UPS: Full history saved. [2025-09-18T22:20:56.173574] [INFO ] [MAIN ] Update Progress: 2193/2372 symbols completed. UPS took 38.0s. Estimated remaining: 26m 11s. Rate: 6.8 symbols/min [2025-09-18T22:20:56.359803] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:20:56.416919] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-09-18T22:20:56.417092] [INFO ] [MAIN ] USB: Loaded 53688 existing records. [2025-09-18T22:20:56.524717] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-09-18T22:20:56.596372] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:20:56.596717] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-09-18T22:20:56.596786] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-09-18T22:20:56.597919] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-09-18T22:20:56.597980] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-09-18T22:20:56.991148] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:20:57.033727] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-18T22:20:57.319559] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-09-18T22:20:57.633380] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-18T22:20:58.119550] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-09-18T22:20:58.692253] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-18T22:20:58.919545] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-09-18T22:20:59.312259] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-18T22:20:59.719557] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-11. [2025-09-18T22:21:00.519562] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-09-18T22:21:00.670050] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-18T22:21:00.678540] [INFO ] [REMOTE ] UP: Full fetch complete (61720 records). [2025-09-18T22:21:00.678690] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-09-18T22:21:01.105535] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-09-18T22:21:01.105619] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-09-18T22:21:01.106589] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-09-18T22:21:01.106666] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-09-18T22:21:01.110298] [DEBUG] [LOCAL ] UP: Trimmed 61720 records to 43319 (keeping 200 days of data) [2025-09-18T22:21:01.328379] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-09-18T22:21:01.347762] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-18T22:21:01.408709] [DEBUG] [LOCAL ] UP: Primary data saved (43319 records). [2025-09-18T22:21:01.408859] [INFO ] [MAIN ] UP: Full history saved. [2025-09-18T22:21:01.408957] [INFO ] [MAIN ] Update Progress: 2194/2372 symbols completed. UP took 46.1s. Estimated remaining: 26m 2s. Rate: 6.8 symbols/min [2025-09-18T22:21:01.607537] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:21:01.659576] [DEBUG] [LOCAL ] USFD: Loaded 51295 existing records from primary storage. [2025-09-18T22:21:01.659785] [INFO ] [MAIN ] USFD: Loaded 51295 existing records. [2025-09-18T22:21:01.839901] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:21:01.840247] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-09-18T22:21:01.840302] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-09-18T22:21:01.841438] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-09-18T22:21:01.841501] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-09-18T22:21:02.122501] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-09-18T22:21:02.219493] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:21:02.237917] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-18T22:21:02.906090] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T22:21:02.919515] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-09-18T22:21:03.719560] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-11. [2025-09-18T22:21:04.519627] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-09-18T22:21:05.558572] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (3.44 seconds). [2025-09-18T22:21:05.569607] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-09-18T22:21:05.668628] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-09-18T22:21:05.760139] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-18T22:21:05.958464] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-11 (2.24 seconds). [2025-09-18T22:21:06.119554] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-09-18T22:21:06.919557] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-09-18T22:21:07.289913] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-18T22:21:07.393817] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-18T22:21:07.719561] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-09-18T22:21:08.332333] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-18T22:21:08.519514] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-09-18T22:21:08.699137] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-18T22:21:09.319553] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-09-18T22:21:10.119551] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-09-18T22:21:10.304482] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-18T22:21:10.549534] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-18T22:21:10.736808] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-18T22:21:10.919549] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-09-18T22:21:11.719557] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-09-18T22:21:12.247253] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-18T22:21:12.519542] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-09-18T22:21:12.584858] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-18T22:21:13.319546] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-09-18T22:21:14.119555] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-09-18T22:21:14.618208] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-18T22:21:14.919542] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-09-18T22:21:15.333572] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-18T22:21:15.337785] [INFO ] [REMOTE ] USAC: Full fetch complete (35507 records). [2025-09-18T22:21:15.337870] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-09-18T22:21:15.730546] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-09-18T22:21:15.762529] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-09-18T22:21:15.762711] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-09-18T22:21:15.763731] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-09-18T22:21:15.763815] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-09-18T22:21:15.765265] [DEBUG] [LOCAL ] USAC: Trimmed 35507 records to 23233 (keeping 200 days of data) [2025-09-18T22:21:15.885190] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-18T22:21:15.948764] [DEBUG] [LOCAL ] USAC: Primary data saved (23233 records). [2025-09-18T22:21:15.948937] [INFO ] [MAIN ] USAC: Full history saved. [2025-09-18T22:21:15.949079] [INFO ] [MAIN ] Update Progress: 2195/2372 symbols completed. USAC took 26.4s. Estimated remaining: 25m 54s. Rate: 6.8 symbols/min [2025-09-18T22:21:16.122370] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:21:16.141097] [DEBUG] [LOCAL ] USNA: Loaded 18431 existing records from primary storage. [2025-09-18T22:21:16.141270] [INFO ] [MAIN ] USNA: Loaded 18431 existing records. [2025-09-18T22:21:16.328389] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:21:16.328635] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-09-18T22:21:16.328725] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-09-18T22:21:16.329262] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-09-18T22:21:16.329327] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-09-18T22:21:16.526116] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-09-18T22:21:16.708758] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-18T22:21:16.763083] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:21:17.319508] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-09-18T22:21:17.567401] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-18T22:21:18.020397] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T22:21:18.119517] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-11. [2025-09-18T22:21:18.480742] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-18T22:21:18.486806] [INFO ] [REMOTE ] USA: Full fetch complete (51476 records). [2025-09-18T22:21:18.486909] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-09-18T22:21:18.870242] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-09-18T22:21:18.870329] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-09-18T22:21:18.871223] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-09-18T22:21:18.871288] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-09-18T22:21:18.872453] [DEBUG] [LOCAL ] USA: Trimmed 51476 records to 36577 (keeping 200 days of data) [2025-09-18T22:21:18.925363] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-09-18T22:21:18.993101] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-18T22:21:19.109834] [DEBUG] [LOCAL ] USA: Primary data saved (36577 records). [2025-09-18T22:21:19.109987] [INFO ] [MAIN ] USA: Full history saved. [2025-09-18T22:21:19.110076] [INFO ] [MAIN ] Update Progress: 2196/2372 symbols completed. USA took 31.9s. Estimated remaining: 25m 45s. Rate: 6.8 symbols/min [2025-09-18T22:21:19.286196] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:21:19.307469] [DEBUG] [LOCAL ] USPH: Loaded 16649 existing records from primary storage. [2025-09-18T22:21:19.307625] [INFO ] [MAIN ] USPH: Loaded 16649 existing records. [2025-09-18T22:21:19.489325] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:21:19.489595] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-09-18T22:21:19.489668] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-09-18T22:21:19.490148] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-09-18T22:21:19.490207] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-09-18T22:21:19.730799] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-09-18T22:21:19.862039] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:21:20.519547] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-11. [2025-09-18T22:21:20.611385] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T22:21:20.760015] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-18T22:21:21.141888] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-18T22:21:21.319524] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-09-18T22:21:22.119604] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-09-18T22:21:22.889762] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-18T22:21:22.919524] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-09-18T22:21:23.719554] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-09-18T22:21:23.784603] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-18T22:21:24.374084] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T22:21:24.394636] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-18T22:21:24.519570] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-09-18T22:21:25.319558] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-09-18T22:21:26.119569] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-09-18T22:21:26.678925] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-18T22:21:26.919551] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-09-18T22:21:26.936258] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T22:21:27.719599] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-09-18T22:21:27.950874] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-18T22:21:28.264363] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-18T22:21:28.346847] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-18T22:21:28.519539] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-09-18T22:21:29.319581] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-09-18T22:21:30.079355] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-18T22:21:30.119516] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-09-18T22:21:30.213442] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-18T22:21:30.919519] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-09-18T22:21:30.998246] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-18T22:21:31.719619] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-09-18T22:21:31.940789] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-18T22:21:32.519808] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-09-18T22:21:32.592068] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-18T22:21:33.319548] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-09-18T22:21:33.467800] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-18T22:21:34.119563] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-09-18T22:21:34.518042] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-18T22:21:34.919581] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-09-18T22:21:35.702705] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-18T22:21:35.719495] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-09-18T22:21:36.006590] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-18T22:21:36.519559] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-09-18T22:21:37.095523] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-18T22:21:37.102864] [INFO ] [REMOTE ] USFD: Full fetch complete (73775 records). [2025-09-18T22:21:37.103024] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-09-18T22:21:37.331078] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-09-18T22:21:37.552742] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-09-18T22:21:37.552917] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-09-18T22:21:37.555037] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-09-18T22:21:37.555150] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-09-18T22:21:37.560558] [DEBUG] [LOCAL ] USFD: Trimmed 73775 records to 51643 (keeping 200 days of data) [2025-09-18T22:21:37.900184] [DEBUG] [LOCAL ] USFD: Primary data saved (51643 records). [2025-09-18T22:21:37.900321] [INFO ] [MAIN ] USFD: Full history saved. [2025-09-18T22:21:37.900531] [INFO ] [MAIN ] Update Progress: 2197/2372 symbols completed. USFD took 36.5s. Estimated remaining: 25m 37s. Rate: 6.8 symbols/min [2025-09-18T22:21:38.119553] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-09-18T22:21:38.218537] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T22:21:38.540775] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-18T22:21:38.821708] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-18T22:21:38.919565] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-09-18T22:21:39.719634] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-09-18T22:21:40.519571] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-09-18T22:21:40.767469] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-18T22:21:40.870936] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-18T22:21:41.304020] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-18T22:21:41.319496] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-09-18T22:21:42.119537] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-09-18T22:21:42.450165] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T22:21:42.554811] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-18T22:21:42.562536] [INFO ] [REMOTE ] USB: Full fetch complete (77608 records). [2025-09-18T22:21:42.562777] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-09-18T22:21:42.925254] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-09-18T22:21:42.992491] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-09-18T22:21:42.992633] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-09-18T22:21:42.993947] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-09-18T22:21:42.994033] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-09-18T22:21:42.995869] [DEBUG] [LOCAL ] USB: Trimmed 77608 records to 54078 (keeping 200 days of data) [2025-09-18T22:21:43.364050] [DEBUG] [LOCAL ] USB: Primary data saved (54078 records). [2025-09-18T22:21:43.364206] [INFO ] [MAIN ] USB: Full history saved. [2025-09-18T22:21:43.365591] [INFO ] [MAIN ] Update Progress: 2198/2372 symbols completed. USB took 47.2s. Estimated remaining: 25m 28s. Rate: 6.8 symbols/min [2025-09-18T22:21:43.719534] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-09-18T22:21:43.857007] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-18T22:21:44.346030] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T22:21:44.519563] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-09-18T22:21:45.221621] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-18T22:21:45.224242] [INFO ] [REMOTE ] USPH: Full fetch complete (22389 records). [2025-09-18T22:21:45.224324] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-09-18T22:21:45.330287] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-09-18T22:21:45.615769] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-09-18T22:21:45.615877] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-09-18T22:21:45.617109] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-09-18T22:21:45.617175] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-09-18T22:21:45.617894] [DEBUG] [LOCAL ] USPH: Trimmed 22389 records to 16781 (keeping 200 days of data) [2025-09-18T22:21:45.747773] [DEBUG] [LOCAL ] USPH: Primary data saved (16781 records). [2025-09-18T22:21:45.748085] [INFO ] [MAIN ] USPH: Full history saved. [2025-09-18T22:21:45.748214] [INFO ] [MAIN ] Update Progress: 2199/2372 symbols completed. USPH took 26.6s. Estimated remaining: 25m 19s. Rate: 6.8 symbols/min [2025-09-18T22:21:46.236257] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-18T22:21:46.240063] [INFO ] [REMOTE ] USNA: Full fetch complete (26466 records). [2025-09-18T22:21:46.240170] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-09-18T22:21:46.628097] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-09-18T22:21:46.628177] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-09-18T22:21:46.628682] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-09-18T22:21:46.628749] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-09-18T22:21:46.631063] [DEBUG] [LOCAL ] USNA: Trimmed 26466 records to 18545 (keeping 200 days of data) [2025-09-18T22:21:46.753440] [DEBUG] [LOCAL ] USNA: Primary data saved (18545 records). [2025-09-18T22:21:46.753581] [INFO ] [MAIN ] USNA: Full history saved. [2025-09-18T22:21:46.753704] [INFO ] [MAIN ] Update Progress: 2200/2372 symbols completed. USNA took 30.8s. Estimated remaining: 25m 9s. Rate: 6.8 symbols/min [2025-09-18T22:21:47.309385] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:21:47.353763] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:21:47.459773] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:21:47.477788] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:21:47.493303] [DEBUG] [LOCAL ] UTL: Loaded 10793 existing records from primary storage. [2025-09-18T22:21:47.493591] [INFO ] [MAIN ] UTL: Loaded 10793 existing records. [2025-09-18T22:21:47.699845] [DEBUG] [LOCAL ] UTZ: Loaded 44821 existing records from primary storage. [2025-09-18T22:21:47.754585] [INFO ] [MAIN ] UTZ: Loaded 44821 existing records. [2025-09-18T22:21:47.754510] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:21:47.776305] [DEBUG] [LOCAL ] UTF: Loaded 28177 existing records from primary storage. [2025-09-18T22:21:47.796954] [INFO ] [MAIN ] UTF: Loaded 28177 existing records. [2025-09-18T22:21:47.848552] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-09-18T22:21:47.922892] [DEBUG] [LOCAL ] UTI: Loaded 40683 existing records from primary storage. [2025-09-18T22:21:47.933547] [INFO ] [MAIN ] UTI: Loaded 40683 existing records. [2025-09-18T22:21:47.928180] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-09-18T22:21:47.978464] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-09-18T22:21:48.032800] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-09-18T22:21:48.327456] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:21:48.387142] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:21:48.387240] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-09-18T22:21:48.452770] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-09-18T22:21:48.469802] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-09-18T22:21:48.508875] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-09-18T22:21:48.508960] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-09-18T22:21:48.554635] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-09-18T22:21:48.540975] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:21:48.585671] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-09-18T22:21:48.624478] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-09-18T22:21:48.688444] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-09-18T22:21:48.703176] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-09-18T22:21:48.792495] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-09-18T22:21:48.792738] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-09-18T22:21:49.122309] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:21:49.175765] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-11. [2025-09-18T22:21:49.726813] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:21:49.764598] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-11. [2025-09-18T22:21:49.831794] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:21:49.833093] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-11. [2025-09-18T22:21:49.918444] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:21:49.918771] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-11. [2025-09-18T22:21:49.960603] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-18T22:21:49.963090] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-09-18T22:21:50.765245] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-18T22:21:50.767859] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-09-18T22:21:50.919246] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-18T22:21:50.926248] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-09-18T22:21:50.946029] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-18T22:21:51.016113] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-18T22:21:51.335981] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-18T22:21:51.719606] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-09-18T22:21:52.107622] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-18T22:21:52.227572] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-18T22:21:52.519551] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-09-18T22:21:53.319588] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-09-18T22:21:53.745683] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T22:21:54.119542] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-09-18T22:21:54.412878] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-18T22:21:54.919548] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-09-18T22:21:55.114183] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-18T22:21:55.465808] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-18T22:21:55.719543] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-09-18T22:21:56.519576] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-09-18T22:21:56.760924] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-18T22:21:57.319561] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-09-18T22:21:57.783507] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-18T22:21:58.119570] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-09-18T22:21:58.541703] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T22:21:58.683906] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-18T22:21:58.919541] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-09-18T22:21:59.719584] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-09-18T22:22:00.251552] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T22:22:00.347452] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-18T22:22:00.519550] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-09-18T22:22:01.319596] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-09-18T22:22:02.013268] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-18T22:22:02.125457] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-09-18T22:22:02.130935] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T22:22:02.919592] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-09-18T22:22:03.532836] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T22:22:03.719551] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-09-18T22:22:03.755505] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-18T22:22:04.519549] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-09-18T22:22:05.248475] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T22:22:05.268627] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-18T22:22:05.319501] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-09-18T22:22:06.119557] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-09-18T22:22:06.929492] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-09-18T22:22:06.958988] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T22:22:07.100213] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-18T22:22:07.103037] [INFO ] [REMOTE ] UTL: Full fetch complete (14969 records). [2025-09-18T22:22:07.103117] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-09-18T22:22:07.474198] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-09-18T22:22:07.474287] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-09-18T22:22:07.474617] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-09-18T22:22:07.474729] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-09-18T22:22:07.475249] [DEBUG] [LOCAL ] UTL: Trimmed 14969 records to 10959 (keeping 200 days of data) [2025-09-18T22:22:07.547368] [DEBUG] [LOCAL ] UTL: Primary data saved (10959 records). [2025-09-18T22:22:07.547520] [INFO ] [MAIN ] UTL: Full history saved. [2025-09-18T22:22:07.547631] [INFO ] [MAIN ] Update Progress: 2201/2372 symbols completed. UTL took 20.8s. Estimated remaining: 25m 1s. Rate: 6.8 symbols/min [2025-09-18T22:22:07.715605] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:22:07.719567] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-09-18T22:22:07.738251] [DEBUG] [LOCAL ] UVE: Loaded 21847 existing records from primary storage. [2025-09-18T22:22:07.738451] [INFO ] [MAIN ] UVE: Loaded 21847 existing records. [2025-09-18T22:22:07.944089] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:22:07.944388] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-09-18T22:22:07.944441] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-09-18T22:22:07.945236] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-09-18T22:22:07.945307] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-09-18T22:22:08.338109] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:22:08.390025] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T22:22:08.519548] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-09-18T22:22:09.143575] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-18T22:22:09.319564] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-09-18T22:22:09.848417] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T22:22:10.119555] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-09-18T22:22:10.837056] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-18T22:22:10.919522] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-11. [2025-09-18T22:22:10.987547] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-18T22:22:11.516438] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-18T22:22:11.719577] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-09-18T22:22:12.519520] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-09-18T22:22:12.534727] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-18T22:22:13.319611] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-09-18T22:22:13.970520] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T22:22:13.987799] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-18T22:22:14.119516] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-09-18T22:22:14.919541] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-09-18T22:22:15.278923] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-18T22:22:15.719540] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-09-18T22:22:16.155670] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T22:22:16.519558] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-09-18T22:22:16.631569] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-18T22:22:17.319538] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-09-18T22:22:18.119586] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-09-18T22:22:18.229108] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-18T22:22:18.761071] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-18T22:22:18.919549] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-09-18T22:22:19.077867] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-18T22:22:19.719570] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-09-18T22:22:19.818165] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-18T22:22:20.519634] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-09-18T22:22:21.049873] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-18T22:22:21.326089] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-09-18T22:22:21.330825] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-18T22:22:22.119577] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-09-18T22:22:22.352214] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-18T22:22:22.357738] [INFO ] [REMOTE ] UTI: Full fetch complete (57982 records). [2025-09-18T22:22:22.357880] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-09-18T22:22:22.759106] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-09-18T22:22:22.759195] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-09-18T22:22:22.760142] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-09-18T22:22:22.760208] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-09-18T22:22:22.761525] [DEBUG] [LOCAL ] UTI: Trimmed 57982 records to 40997 (keeping 200 days of data) [2025-09-18T22:22:22.947097] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-09-18T22:22:23.038880] [DEBUG] [LOCAL ] UTI: Primary data saved (40997 records). [2025-09-18T22:22:23.039015] [INFO ] [MAIN ] UTI: Full history saved. [2025-09-18T22:22:23.039102] [INFO ] [MAIN ] Update Progress: 2202/2372 symbols completed. UTI took 36.3s. Estimated remaining: 24m 53s. Rate: 6.8 symbols/min [2025-09-18T22:22:23.220686] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:22:23.242931] [DEBUG] [LOCAL ] UVV: Loaded 22239 existing records from primary storage. [2025-09-18T22:22:23.243101] [INFO ] [MAIN ] UVV: Loaded 22239 existing records. [2025-09-18T22:22:23.441094] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:22:23.441599] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-09-18T22:22:23.441741] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-09-18T22:22:23.447722] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-09-18T22:22:23.454039] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-09-18T22:22:23.518235] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T22:22:23.726869] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-09-18T22:22:23.835896] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:22:24.104127] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-18T22:22:24.519563] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-11. [2025-09-18T22:22:24.616397] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-18T22:22:25.319587] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-09-18T22:22:25.401509] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-18T22:22:26.119550] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-09-18T22:22:26.443172] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-18T22:22:26.919575] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-09-18T22:22:27.055616] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-18T22:22:27.060492] [INFO ] [REMOTE ] UTF: Full fetch complete (40500 records). [2025-09-18T22:22:27.060589] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-09-18T22:22:27.457031] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-09-18T22:22:27.457163] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-09-18T22:22:27.458100] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-09-18T22:22:27.458167] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-09-18T22:22:27.459456] [DEBUG] [LOCAL ] UTF: Trimmed 40500 records to 28516 (keeping 200 days of data) [2025-09-18T22:22:27.649380] [DEBUG] [LOCAL ] UTF: Primary data saved (28516 records). [2025-09-18T22:22:27.649549] [INFO ] [MAIN ] UTF: Full history saved. [2025-09-18T22:22:27.649672] [INFO ] [MAIN ] Update Progress: 2203/2372 symbols completed. UTF took 40.9s. Estimated remaining: 24m 44s. Rate: 6.8 symbols/min [2025-09-18T22:22:27.726615] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-09-18T22:22:27.834889] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:22:27.887820] [DEBUG] [LOCAL ] UWMC: Loaded 52717 existing records from primary storage. [2025-09-18T22:22:27.887977] [INFO ] [MAIN ] UWMC: Loaded 52717 existing records. [2025-09-18T22:22:28.074904] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:22:28.075406] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-09-18T22:22:28.075513] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-09-18T22:22:28.082331] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-09-18T22:22:28.094314] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-09-18T22:22:28.155804] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-18T22:22:28.499678] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:22:28.510378] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-18T22:22:28.519489] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-09-18T22:22:29.319609] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-09-18T22:22:29.618286] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-18T22:22:30.120945] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-09-18T22:22:30.122879] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-18T22:22:30.919572] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-11. [2025-09-18T22:22:31.715764] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T22:22:31.724203] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-09-18T22:22:32.411011] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-18T22:22:32.453115] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-18T22:22:32.519557] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-09-18T22:22:33.319608] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-09-18T22:22:33.655425] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-18T22:22:33.661339] [INFO ] [REMOTE ] UTZ: Full fetch complete (63398 records). [2025-09-18T22:22:33.661457] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-09-18T22:22:34.059309] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-09-18T22:22:34.059463] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-09-18T22:22:34.060509] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-09-18T22:22:34.060627] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-09-18T22:22:34.067902] [DEBUG] [LOCAL ] UTZ: Trimmed 63398 records to 45153 (keeping 200 days of data) [2025-09-18T22:22:34.073860] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-18T22:22:34.135187] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-09-18T22:22:34.365636] [DEBUG] [LOCAL ] UTZ: Primary data saved (45153 records). [2025-09-18T22:22:34.365836] [INFO ] [MAIN ] UTZ: Full history saved. [2025-09-18T22:22:34.365939] [INFO ] [MAIN ] Update Progress: 2204/2372 symbols completed. UTZ took 47.6s. Estimated remaining: 24m 35s. Rate: 6.8 symbols/min [2025-09-18T22:22:34.542272] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:22:34.551555] [DEBUG] [LOCAL ] UZD: Loaded 6377 existing records from primary storage. [2025-09-18T22:22:34.551691] [INFO ] [MAIN ] UZD: Loaded 6377 existing records. [2025-09-18T22:22:34.729142] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:22:34.729379] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-09-18T22:22:34.729428] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-09-18T22:22:34.729797] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-09-18T22:22:34.729857] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-09-18T22:22:34.928426] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-09-18T22:22:35.093144] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:22:35.321094] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-18T22:22:35.719509] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-11. [2025-09-18T22:22:35.829451] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-18T22:22:35.833884] [INFO ] [REMOTE ] UVE: Full fetch complete (29435 records). [2025-09-18T22:22:35.834161] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-09-18T22:22:36.232959] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-09-18T22:22:36.233041] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-09-18T22:22:36.233740] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-09-18T22:22:36.233803] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-09-18T22:22:36.234636] [DEBUG] [LOCAL ] UVE: Trimmed 29435 records to 22022 (keeping 200 days of data) [2025-09-18T22:22:36.371492] [DEBUG] [LOCAL ] UVE: Primary data saved (22022 records). [2025-09-18T22:22:36.371627] [INFO ] [MAIN ] UVE: Full history saved. [2025-09-18T22:22:36.371767] [INFO ] [MAIN ] Update Progress: 2205/2372 symbols completed. UVE took 28.8s. Estimated remaining: 24m 26s. Rate: 6.8 symbols/min [2025-09-18T22:22:36.499604] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-18T22:22:36.524596] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-09-18T22:22:36.582252] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:22:36.592860] [DEBUG] [LOCAL ] UZE: Loaded 7507 existing records from primary storage. [2025-09-18T22:22:36.593051] [INFO ] [MAIN ] UZE: Loaded 7507 existing records. [2025-09-18T22:22:36.789960] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:22:36.790267] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-09-18T22:22:36.790326] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-09-18T22:22:36.790728] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-09-18T22:22:36.790790] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-09-18T22:22:37.159976] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:22:37.319552] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-09-18T22:22:37.862639] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-18T22:22:37.894521] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-18T22:22:38.119557] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-09-18T22:22:38.919605] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-11. [2025-09-18T22:22:39.494371] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-18T22:22:39.719575] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-09-18T22:22:39.868710] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-18T22:22:40.519557] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-09-18T22:22:40.720107] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-18T22:22:40.984540] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-18T22:22:41.319606] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-09-18T22:22:42.046038] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-18T22:22:42.119528] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-09-18T22:22:42.919555] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-09-18T22:22:43.719548] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-09-18T22:22:43.785276] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-18T22:22:43.854044] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T22:22:44.415334] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-18T22:22:44.519605] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-09-18T22:22:45.134662] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-18T22:22:45.319554] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-09-18T22:22:45.946475] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-18T22:22:46.119572] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-09-18T22:22:46.859699] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-18T22:22:46.919500] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-09-18T22:22:47.613816] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-18T22:22:47.719691] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-09-18T22:22:48.199089] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-18T22:22:48.519561] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-09-18T22:22:49.319539] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-09-18T22:22:49.497539] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-18T22:22:49.798626] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-18T22:22:50.119548] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-09-18T22:22:50.919560] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-09-18T22:22:51.479395] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-18T22:22:51.480187] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-18T22:22:51.719601] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-09-18T22:22:52.380461] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-18T22:22:52.519521] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-09-18T22:22:53.160535] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-18T22:22:53.319618] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-09-18T22:22:54.119519] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-09-18T22:22:54.292282] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-18T22:22:54.296275] [INFO ] [REMOTE ] UVV: Full fetch complete (29499 records). [2025-09-18T22:22:54.296367] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-09-18T22:22:54.670809] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-09-18T22:22:54.670893] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-09-18T22:22:54.671437] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-09-18T22:22:54.671477] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-09-18T22:22:54.672214] [DEBUG] [LOCAL ] UVV: Trimmed 29499 records to 22438 (keeping 200 days of data) [2025-09-18T22:22:54.762493] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-18T22:22:54.811664] [DEBUG] [LOCAL ] UVV: Primary data saved (22438 records). [2025-09-18T22:22:54.811811] [INFO ] [MAIN ] UVV: Full history saved. [2025-09-18T22:22:54.811907] [INFO ] [MAIN ] Update Progress: 2206/2372 symbols completed. UVV took 31.8s. Estimated remaining: 24m 18s. Rate: 6.8 symbols/min [2025-09-18T22:22:54.924744] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-09-18T22:22:54.989896] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:22:54.998930] [DEBUG] [LOCAL ] UZF: Loaded 6519 existing records from primary storage. [2025-09-18T22:22:54.999069] [INFO ] [MAIN ] UZF: Loaded 6519 existing records. [2025-09-18T22:22:55.176890] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:22:55.177150] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-09-18T22:22:55.177198] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-09-18T22:22:55.177484] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-09-18T22:22:55.177543] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-09-18T22:22:55.528137] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:22:55.719505] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-11. [2025-09-18T22:22:55.851455] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-18T22:22:56.470838] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-18T22:22:56.519520] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-09-18T22:22:57.063980] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-18T22:22:57.319553] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-09-18T22:22:57.739282] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-18T22:22:58.119563] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-09-18T22:22:58.716546] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-18T22:22:58.718206] [INFO ] [REMOTE ] UZE: Full fetch complete (10210 records). [2025-09-18T22:22:58.718321] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-09-18T22:22:58.924808] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-09-18T22:22:59.110848] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-09-18T22:22:59.110927] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-09-18T22:22:59.111172] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-09-18T22:22:59.111212] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-09-18T22:22:59.111681] [DEBUG] [LOCAL ] UZE: Trimmed 10210 records to 7530 (keeping 200 days of data) [2025-09-18T22:22:59.160444] [DEBUG] [LOCAL ] UZE: Primary data saved (7530 records). [2025-09-18T22:22:59.160636] [INFO ] [MAIN ] UZE: Full history saved. [2025-09-18T22:22:59.160774] [INFO ] [MAIN ] Update Progress: 2207/2372 symbols completed. UZE took 22.8s. Estimated remaining: 24m 9s. Rate: 6.8 symbols/min [2025-09-18T22:22:59.334035] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:22:59.396319] [DEBUG] [LOCAL ] V: Loaded 53763 existing records from primary storage. [2025-09-18T22:22:59.396475] [INFO ] [MAIN ] V: Loaded 53763 existing records. [2025-09-18T22:22:59.578061] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:22:59.578327] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-09-18T22:22:59.578388] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-09-18T22:22:59.579791] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-09-18T22:22:59.579851] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-09-18T22:22:59.724782] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-09-18T22:22:59.947471] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:23:00.519554] [INFO ] [REMOTE ] V: Fetching primary data for 2024-11. [2025-09-18T22:23:01.319595] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-09-18T22:23:02.651248] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-11 (2.13 seconds). [2025-09-18T22:23:02.661949] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-09-18T22:23:04.168501] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (2.85 seconds). [2025-09-18T22:23:04.170897] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-09-18T22:23:04.253501] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (5.33 seconds). [2025-09-18T22:23:04.256859] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-09-18T22:23:04.701187] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-18T22:23:04.703303] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-09-18T22:23:04.715122] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-18T22:23:04.717769] [INFO ] [REMOTE ] UZD: Full fetch complete (9517 records). [2025-09-18T22:23:04.718292] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-09-18T22:23:04.864759] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (5.14 seconds). [2025-09-18T22:23:05.155410] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-09-18T22:23:05.155557] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-09-18T22:23:05.155847] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-09-18T22:23:05.155920] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-09-18T22:23:05.156445] [DEBUG] [LOCAL ] UZD: Trimmed 9517 records to 6388 (keeping 200 days of data) [2025-09-18T22:23:05.192291] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-18T22:23:05.202885] [DEBUG] [LOCAL ] UZD: Primary data saved (6388 records). [2025-09-18T22:23:05.203103] [INFO ] [MAIN ] UZD: Full history saved. [2025-09-18T22:23:05.203279] [INFO ] [MAIN ] Update Progress: 2208/2372 symbols completed. UZD took 30.8s. Estimated remaining: 23m 60s. Rate: 6.8 symbols/min [2025-09-18T22:23:05.326162] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-09-18T22:23:05.378613] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:23:05.415038] [DEBUG] [LOCAL ] VAC: Loaded 34824 existing records from primary storage. [2025-09-18T22:23:05.415291] [INFO ] [MAIN ] VAC: Loaded 34824 existing records. [2025-09-18T22:23:05.561853] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (2.90 seconds). [2025-09-18T22:23:05.647277] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:23:05.647552] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-09-18T22:23:05.647606] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-09-18T22:23:05.648773] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-09-18T22:23:05.648836] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-09-18T22:23:06.027321] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:23:06.034711] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-18T22:23:06.119564] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-09-18T22:23:06.919555] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-09-18T22:23:07.719566] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-11. [2025-09-18T22:23:08.349079] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-18T22:23:08.425315] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-18T22:23:08.519586] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-09-18T22:23:08.743880] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-18T22:23:09.319584] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-09-18T22:23:10.053934] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-18T22:23:10.128568] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-09-18T22:23:10.149408] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-18T22:23:10.628901] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-18T22:23:10.919605] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-09-18T22:23:11.719543] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-09-18T22:23:12.216936] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-18T22:23:12.519554] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-09-18T22:23:12.709063] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-18T22:23:13.319534] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-09-18T22:23:14.119515] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-09-18T22:23:14.228413] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-18T22:23:14.330895] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-18T22:23:14.919544] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-09-18T22:23:15.719600] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-09-18T22:23:15.962105] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-18T22:23:16.173071] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-18T22:23:16.519593] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-09-18T22:23:16.844320] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-18T22:23:17.319592] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-09-18T22:23:17.946195] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-18T22:23:17.948232] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-18T22:23:18.119598] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-09-18T22:23:18.919630] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-09-18T22:23:19.719579] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-09-18T22:23:20.321261] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-18T22:23:20.519578] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-09-18T22:23:20.793800] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-18T22:23:20.833523] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-18T22:23:20.953266] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-18T22:23:20.954451] [INFO ] [REMOTE ] UZF: Full fetch complete (8789 records). [2025-09-18T22:23:20.954522] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-09-18T22:23:21.316732] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-09-18T22:23:21.316815] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-09-18T22:23:21.317000] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-09-18T22:23:21.317039] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-09-18T22:23:21.317445] [DEBUG] [LOCAL ] UZF: Trimmed 8789 records to 6526 (keeping 200 days of data) [2025-09-18T22:23:21.334580] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-09-18T22:23:21.358905] [DEBUG] [LOCAL ] UZF: Primary data saved (6526 records). [2025-09-18T22:23:21.359284] [INFO ] [MAIN ] UZF: Full history saved. [2025-09-18T22:23:21.359490] [INFO ] [MAIN ] Update Progress: 2209/2372 symbols completed. UZF took 26.5s. Estimated remaining: 23m 51s. Rate: 6.8 symbols/min [2025-09-18T22:23:21.529732] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:23:21.578321] [DEBUG] [LOCAL ] VAL: Loaded 50555 existing records from primary storage. [2025-09-18T22:23:21.578489] [INFO ] [MAIN ] VAL: Loaded 50555 existing records. [2025-09-18T22:23:21.796588] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:23:21.796926] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-09-18T22:23:21.796986] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-09-18T22:23:21.798031] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-09-18T22:23:21.798092] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-09-18T22:23:22.131959] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-09-18T22:23:22.173987] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:23:22.918140] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-18T22:23:22.927372] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-09-18T22:23:23.719582] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-09-18T22:23:24.194927] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-18T22:23:24.519567] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-11. [2025-09-18T22:23:24.781968] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-18T22:23:24.790903] [INFO ] [REMOTE ] UWMC: Full fetch complete (75225 records). [2025-09-18T22:23:24.791047] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-09-18T22:23:25.255778] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-09-18T22:23:25.255891] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-09-18T22:23:25.257129] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-09-18T22:23:25.257250] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-09-18T22:23:25.285328] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-18T22:23:25.284075] [DEBUG] [LOCAL ] UWMC: Trimmed 75225 records to 53104 (keeping 200 days of data) [2025-09-18T22:23:25.342613] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-09-18T22:23:25.619806] [DEBUG] [LOCAL ] UWMC: Primary data saved (53104 records). [2025-09-18T22:23:25.619971] [INFO ] [MAIN ] UWMC: Full history saved. [2025-09-18T22:23:25.620081] [INFO ] [MAIN ] Update Progress: 2210/2372 symbols completed. UWMC took 58.0s. Estimated remaining: 23m 42s. Rate: 6.8 symbols/min [2025-09-18T22:23:25.799580] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:23:25.859261] [DEBUG] [LOCAL ] VALE: Loaded 53694 existing records from primary storage. [2025-09-18T22:23:25.859590] [INFO ] [MAIN ] VALE: Loaded 53694 existing records. [2025-09-18T22:23:26.066911] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:23:26.067416] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-09-18T22:23:26.067494] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-09-18T22:23:26.079928] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-09-18T22:23:26.085163] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-09-18T22:23:26.133309] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-09-18T22:23:26.199616] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-18T22:23:26.503490] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:23:26.556488] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-18T22:23:26.919548] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-09-18T22:23:27.719583] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-11. [2025-09-18T22:23:28.077221] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-18T22:23:28.507858] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-18T22:23:28.519492] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-09-18T22:23:29.319582] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-09-18T22:23:29.576187] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-18T22:23:30.119585] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-09-18T22:23:30.598041] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-18T22:23:30.739519] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-18T22:23:30.919607] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-09-18T22:23:31.719633] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-09-18T22:23:31.948433] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-18T22:23:32.519562] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-09-18T22:23:32.835807] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-18T22:23:33.170091] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T22:23:33.319602] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-09-18T22:23:33.800142] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-18T22:23:33.812430] [INFO ] [REMOTE ] V: Full fetch complete (77725 records). [2025-09-18T22:23:33.812736] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-09-18T22:23:34.143818] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-09-18T22:23:34.328454] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-18T22:23:34.507080] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-09-18T22:23:34.507204] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-09-18T22:23:34.509071] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-09-18T22:23:34.509200] [DEBUG] [LOCAL ] V: Saving primary data. [2025-09-18T22:23:34.517156] [DEBUG] [LOCAL ] V: Trimmed 77725 records to 54153 (keeping 200 days of data) [2025-09-18T22:23:34.912084] [DEBUG] [LOCAL ] V: Primary data saved (54153 records). [2025-09-18T22:23:34.912242] [INFO ] [MAIN ] V: Full history saved. [2025-09-18T22:23:34.912343] [INFO ] [MAIN ] Update Progress: 2211/2372 symbols completed. V took 35.8s. Estimated remaining: 23m 34s. Rate: 6.8 symbols/min [2025-09-18T22:23:34.924863] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-09-18T22:23:35.088859] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:23:35.096334] [DEBUG] [LOCAL ] VATE: Loaded 5840 existing records from primary storage. [2025-09-18T22:23:35.096468] [INFO ] [MAIN ] VATE: Loaded 5840 existing records. [2025-09-18T22:23:35.284940] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:23:35.285188] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-09-18T22:23:35.285237] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-09-18T22:23:35.285551] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-09-18T22:23:35.285612] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-09-18T22:23:35.646296] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:23:35.719559] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-09-18T22:23:36.246578] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-18T22:23:36.358862] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T22:23:36.519509] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-09-18T22:23:36.901620] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-18T22:23:36.906830] [INFO ] [REMOTE ] VAC: Full fetch complete (47490 records). [2025-09-18T22:23:36.906928] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-09-18T22:23:37.288943] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-09-18T22:23:37.289062] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-09-18T22:23:37.289992] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-09-18T22:23:37.290056] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-09-18T22:23:37.291361] [DEBUG] [LOCAL ] VAC: Trimmed 47490 records to 35090 (keeping 200 days of data) [2025-09-18T22:23:37.351439] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-09-18T22:23:37.517819] [DEBUG] [LOCAL ] VAC: Primary data saved (35090 records). [2025-09-18T22:23:37.517973] [INFO ] [MAIN ] VAC: Full history saved. [2025-09-18T22:23:37.518077] [INFO ] [MAIN ] Update Progress: 2212/2372 symbols completed. VAC took 32.3s. Estimated remaining: 23m 24s. Rate: 6.8 symbols/min [2025-09-18T22:23:37.697285] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:23:37.708410] [DEBUG] [LOCAL ] VBF: Loaded 7163 existing records from primary storage. [2025-09-18T22:23:37.708538] [INFO ] [MAIN ] VBF: Loaded 7163 existing records. [2025-09-18T22:23:37.886114] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:23:37.886515] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-09-18T22:23:37.886588] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-09-18T22:23:37.886975] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-09-18T22:23:37.887052] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-09-18T22:23:38.129173] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-11. [2025-09-18T22:23:38.285719] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:23:38.435384] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-18T22:23:38.638087] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-18T22:23:38.656048] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-18T22:23:38.919578] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-11. [2025-09-18T22:23:39.719559] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-09-18T22:23:39.727979] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-18T22:23:40.224041] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-18T22:23:40.519556] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-09-18T22:23:41.319569] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-09-18T22:23:42.119573] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-09-18T22:23:42.365337] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-18T22:23:42.920026] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-09-18T22:23:42.921903] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-18T22:23:43.180232] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-18T22:23:43.406110] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-18T22:23:43.719572] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-09-18T22:23:44.482736] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-18T22:23:44.519503] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-09-18T22:23:45.300098] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-18T22:23:45.319586] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-09-18T22:23:45.837031] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-18T22:23:46.119554] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-09-18T22:23:46.919557] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-09-18T22:23:47.449543] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-18T22:23:47.719548] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-09-18T22:23:47.896713] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-18T22:23:48.429097] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-18T22:23:48.519535] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-09-18T22:23:49.142235] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-18T22:23:49.319570] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-09-18T22:23:50.119551] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-09-18T22:23:50.141168] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-18T22:23:50.532685] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-18T22:23:50.919627] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-09-18T22:23:51.719626] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-09-18T22:23:52.519585] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-09-18T22:23:52.660418] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-18T22:23:53.002970] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-18T22:23:53.124368] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T22:23:53.319623] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-09-18T22:23:54.119612] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-09-18T22:23:54.900354] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T22:23:54.919509] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-09-18T22:23:55.719511] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-09-18T22:23:55.795126] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-18T22:23:56.144073] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-18T22:23:56.201178] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-18T22:23:56.519567] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-09-18T22:23:56.993762] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-18T22:23:57.319547] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-09-18T22:23:58.119564] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-09-18T22:23:58.729739] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-18T22:23:58.919551] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-09-18T22:23:59.301539] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-18T22:23:59.400478] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-18T22:23:59.402835] [INFO ] [REMOTE ] VATE: Full fetch complete (10490 records). [2025-09-18T22:23:59.402939] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-09-18T22:23:59.724964] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-09-18T22:23:59.815820] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-09-18T22:23:59.815926] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-09-18T22:23:59.816472] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-09-18T22:23:59.816561] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-09-18T22:23:59.817709] [DEBUG] [LOCAL ] VATE: Trimmed 10490 records to 5913 (keeping 200 days of data) [2025-09-18T22:23:59.856965] [DEBUG] [LOCAL ] VATE: Primary data saved (5913 records). [2025-09-18T22:23:59.857134] [INFO ] [MAIN ] VATE: Full history saved. [2025-09-18T22:23:59.857346] [INFO ] [MAIN ] Update Progress: 2213/2372 symbols completed. VATE took 24.9s. Estimated remaining: 23m 16s. Rate: 6.8 symbols/min [2025-09-18T22:24:00.032588] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:24:00.049412] [DEBUG] [LOCAL ] VCV: Loaded 13450 existing records from primary storage. [2025-09-18T22:24:00.049564] [INFO ] [MAIN ] VCV: Loaded 13450 existing records. [2025-09-18T22:24:00.225546] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:24:00.225832] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-09-18T22:24:00.225897] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-09-18T22:24:00.226329] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-09-18T22:24:00.226388] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-09-18T22:24:00.524778] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-09-18T22:24:00.589767] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:24:01.249557] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T22:24:01.319523] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-09-18T22:24:01.584249] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-18T22:24:02.119556] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-11. [2025-09-18T22:24:02.536941] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-18T22:24:02.919561] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-09-18T22:24:03.719551] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-09-18T22:24:04.225576] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-11 (2.11 seconds). [2025-09-18T22:24:04.519548] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-09-18T22:24:04.647400] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-18T22:24:05.294171] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-18T22:24:05.319512] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-09-18T22:24:06.119540] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-09-18T22:24:06.390608] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-18T22:24:06.558046] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-18T22:24:06.559607] [INFO ] [REMOTE ] VBF: Full fetch complete (10457 records). [2025-09-18T22:24:06.559708] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-09-18T22:24:06.925660] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-09-18T22:24:06.953042] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-09-18T22:24:06.953262] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-09-18T22:24:06.953783] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-09-18T22:24:06.954019] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-09-18T22:24:06.954932] [DEBUG] [LOCAL ] VBF: Trimmed 10457 records to 7200 (keeping 200 days of data) [2025-09-18T22:24:07.015541] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-18T22:24:07.043106] [INFO ] [REMOTE ] VAL: Full fetch complete (73078 records). [2025-09-18T22:24:07.045110] [DEBUG] [LOCAL ] VBF: Primary data saved (7200 records). [2025-09-18T22:24:07.045742] [INFO ] [MAIN ] VBF: Full history saved. [2025-09-18T22:24:07.046145] [INFO ] [MAIN ] Update Progress: 2214/2372 symbols completed. VBF took 29.5s. Estimated remaining: 23m 8s. Rate: 6.8 symbols/min [2025-09-18T22:24:07.045622] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-09-18T22:24:07.393205] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:24:07.664120] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-09-18T22:24:07.664210] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-09-18T22:24:07.665343] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-09-18T22:24:07.665428] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-09-18T22:24:07.666996] [DEBUG] [LOCAL ] VAL: Trimmed 73078 records to 50908 (keeping 200 days of data) [2025-09-18T22:24:07.685286] [DEBUG] [LOCAL ] VEEV: Loaded 47534 existing records from primary storage. [2025-09-18T22:24:07.731437] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-09-18T22:24:07.731881] [INFO ] [MAIN ] VEEV: Loaded 47534 existing records. [2025-09-18T22:24:07.966817] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:24:07.969537] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-09-18T22:24:07.969963] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-09-18T22:24:07.971699] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-09-18T22:24:07.972061] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-09-18T22:24:08.477600] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:24:08.536469] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-11. [2025-09-18T22:24:08.580442] [DEBUG] [LOCAL ] VAL: Primary data saved (50908 records). [2025-09-18T22:24:08.580581] [INFO ] [MAIN ] VAL: Full history saved. [2025-09-18T22:24:08.580710] [INFO ] [MAIN ] Update Progress: 2215/2372 symbols completed. VAL took 47.2s. Estimated remaining: 22m 58s. Rate: 6.8 symbols/min [2025-09-18T22:24:08.673077] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-18T22:24:08.744140] [INFO ] [REMOTE ] VALE: Full fetch complete (77711 records). [2025-09-18T22:24:08.794860] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-09-18T22:24:08.794633] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:24:08.808393] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-18T22:24:08.929634] [DEBUG] [LOCAL ] VEL: Loaded 12987 existing records from primary storage. [2025-09-18T22:24:08.940303] [INFO ] [MAIN ] VEL: Loaded 12987 existing records. [2025-09-18T22:24:09.321384] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-09-18T22:24:09.298100] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:24:09.328363] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-09-18T22:24:09.328566] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-09-18T22:24:09.399939] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-09-18T22:24:09.403722] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-09-18T22:24:09.500385] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-09-18T22:24:09.516307] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-09-18T22:24:09.528061] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-09-18T22:24:09.528209] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-09-18T22:24:09.596119] [DEBUG] [LOCAL ] VALE: Trimmed 77711 records to 54084 (keeping 200 days of data) [2025-09-18T22:24:09.880522] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:24:10.119785] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-11. [2025-09-18T22:24:10.130692] [DEBUG] [LOCAL ] VALE: Primary data saved (54084 records). [2025-09-18T22:24:10.130971] [INFO ] [MAIN ] VALE: Full history saved. [2025-09-18T22:24:10.131140] [INFO ] [MAIN ] Update Progress: 2216/2372 symbols completed. VALE took 44.5s. Estimated remaining: 22m 49s. Rate: 6.8 symbols/min [2025-09-18T22:24:10.322306] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:24:10.318314] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-18T22:24:10.353438] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-18T22:24:10.400200] [DEBUG] [LOCAL ] VET: Loaded 44395 existing records from primary storage. [2025-09-18T22:24:10.400341] [INFO ] [MAIN ] VET: Loaded 44395 existing records. [2025-09-18T22:24:10.582813] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:24:10.583064] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-09-18T22:24:10.583112] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-09-18T22:24:10.584726] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-09-18T22:24:10.584797] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-09-18T22:24:10.704859] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-18T22:24:10.927324] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-09-18T22:24:10.961059] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:24:11.544044] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-18T22:24:11.719589] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-09-18T22:24:12.326310] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-18T22:24:12.519598] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-09-18T22:24:13.259991] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-18T22:24:13.319555] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-09-18T22:24:14.119100] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-18T22:24:14.121766] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-11. [2025-09-18T22:24:14.919622] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-09-18T22:24:15.719581] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-09-18T22:24:16.519560] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-09-18T22:24:17.109956] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T22:24:17.168863] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-18T22:24:17.282531] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-11 (3.16 seconds). [2025-09-18T22:24:17.325030] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-09-18T22:24:17.330900] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-18T22:24:18.112831] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-18T22:24:18.119483] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-09-18T22:24:18.919577] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-09-18T22:24:18.947199] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-18T22:24:19.719557] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-09-18T22:24:19.913959] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-18T22:24:20.349303] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-18T22:24:20.519554] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-09-18T22:24:21.319539] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-09-18T22:24:22.119570] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-09-18T22:24:22.286956] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-18T22:24:22.328068] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-18T22:24:22.919553] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-09-18T22:24:23.451105] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T22:24:23.719605] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-09-18T22:24:24.247072] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T22:24:24.519558] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-09-18T22:24:24.897230] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-18T22:24:25.319558] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-09-18T22:24:26.119616] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-09-18T22:24:26.284328] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-18T22:24:26.306807] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-18T22:24:26.309870] [INFO ] [REMOTE ] VCV: Full fetch complete (19608 records). [2025-09-18T22:24:26.309992] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-09-18T22:24:26.859908] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-09-18T22:24:26.860032] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-09-18T22:24:26.860629] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-09-18T22:24:26.860725] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-09-18T22:24:26.861494] [DEBUG] [LOCAL ] VCV: Trimmed 19608 records to 13530 (keeping 200 days of data) [2025-09-18T22:24:26.928215] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-09-18T22:24:26.964813] [DEBUG] [LOCAL ] VCV: Primary data saved (13530 records). [2025-09-18T22:24:26.965031] [INFO ] [MAIN ] VCV: Full history saved. [2025-09-18T22:24:26.965153] [INFO ] [MAIN ] Update Progress: 2217/2372 symbols completed. VCV took 27.1s. Estimated remaining: 22m 41s. Rate: 6.8 symbols/min [2025-09-18T22:24:27.234181] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:24:27.293029] [DEBUG] [LOCAL ] VFC: Loaded 53610 existing records from primary storage. [2025-09-18T22:24:27.293188] [INFO ] [MAIN ] VFC: Loaded 53610 existing records. [2025-09-18T22:24:27.482130] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:24:27.482890] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-09-18T22:24:27.483378] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-09-18T22:24:27.492192] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-09-18T22:24:27.493029] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-09-18T22:24:27.493366] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-18T22:24:27.709575] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-18T22:24:27.725868] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-09-18T22:24:27.896801] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:24:28.519585] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-09-18T22:24:29.319534] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-09-18T22:24:29.683234] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-18T22:24:29.866017] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-18T22:24:29.897219] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-18T22:24:30.119618] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-09-18T22:24:30.919553] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-09-18T22:24:31.533288] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-18T22:24:31.719580] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-11. [2025-09-18T22:24:32.519614] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-09-18T22:24:32.650256] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-18T22:24:33.081544] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-18T22:24:33.325747] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-09-18T22:24:33.328992] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-18T22:24:34.119587] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-09-18T22:24:34.721663] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-18T22:24:34.919605] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-09-18T22:24:35.548436] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-18T22:24:35.719621] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-09-18T22:24:35.960639] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-18T22:24:36.519618] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-09-18T22:24:37.129480] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-18T22:24:37.319594] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-09-18T22:24:38.119560] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-09-18T22:24:38.268764] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-18T22:24:38.919599] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-09-18T22:24:38.962852] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-18T22:24:39.719611] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-09-18T22:24:39.765953] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-18T22:24:40.394507] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-18T22:24:40.519551] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-09-18T22:24:41.234317] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-18T22:24:41.319586] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-09-18T22:24:42.079845] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-18T22:24:42.119500] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-09-18T22:24:42.491749] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-18T22:24:42.497754] [INFO ] [REMOTE ] VET: Full fetch complete (64187 records). [2025-09-18T22:24:42.497912] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-09-18T22:24:42.895966] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-09-18T22:24:42.896096] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-09-18T22:24:42.897251] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-09-18T22:24:42.897349] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-09-18T22:24:42.898865] [DEBUG] [LOCAL ] VET: Trimmed 64187 records to 44645 (keeping 200 days of data) [2025-09-18T22:24:42.947994] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-09-18T22:24:43.166993] [DEBUG] [LOCAL ] VET: Primary data saved (44645 records). [2025-09-18T22:24:43.167138] [INFO ] [MAIN ] VET: Full history saved. [2025-09-18T22:24:43.167229] [INFO ] [MAIN ] Update Progress: 2218/2372 symbols completed. VET took 33.0s. Estimated remaining: 22m 33s. Rate: 6.8 symbols/min [2025-09-18T22:24:43.340429] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:24:43.340621] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-09-18T22:24:43.340694] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-09-18T22:24:43.340853] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-09-18T22:24:43.340899] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-18T22:24:43.340943] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-18T22:24:43.341002] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-09-18T22:24:43.721813] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-09-18T22:24:43.715973] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-18T22:24:43.721728] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:24:44.208495] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-18T22:24:44.519579] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-11. [2025-09-18T22:24:44.748059] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:24:44.748399] [WARN ] [REMOTE ] VG: No data returned for month 2024-11 [2025-09-18T22:24:45.174826] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T22:24:45.319530] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-09-18T22:24:46.119540] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-09-18T22:24:46.919543] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-09-18T22:24:47.127472] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-18T22:24:47.143764] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:24:47.144112] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-09-18T22:24:47.719505] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-01. [2025-09-18T22:24:47.887011] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-18T22:24:48.340456] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-18T22:24:48.519548] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-09-18T22:24:49.319546] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-09-18T22:24:49.382638] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-18T22:24:49.384891] [INFO ] [REMOTE ] VEL: Full fetch complete (16515 records). [2025-09-18T22:24:49.384967] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-09-18T22:24:49.755812] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-09-18T22:24:49.755900] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-09-18T22:24:49.756274] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-09-18T22:24:49.756316] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-09-18T22:24:49.756947] [DEBUG] [LOCAL ] VEL: Trimmed 16515 records to 13087 (keeping 200 days of data) [2025-09-18T22:24:49.834273] [DEBUG] [LOCAL ] VEL: Primary data saved (13087 records). [2025-09-18T22:24:49.834466] [INFO ] [MAIN ] VEL: Full history saved. [2025-09-18T22:24:49.834575] [INFO ] [MAIN ] Update Progress: 2219/2372 symbols completed. VEL took 41.3s. Estimated remaining: 22m 24s. Rate: 6.8 symbols/min [2025-09-18T22:24:50.028168] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:24:50.035491] [DEBUG] [LOCAL ] VGI: Loaded 5240 existing records from primary storage. [2025-09-18T22:24:50.035624] [INFO ] [MAIN ] VGI: Loaded 5240 existing records. [2025-09-18T22:24:50.125032] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-02. [2025-09-18T22:24:50.215186] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:24:50.215436] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-09-18T22:24:50.215484] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-09-18T22:24:50.215771] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-09-18T22:24:50.215830] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-09-18T22:24:50.575346] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:24:50.919571] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-09-18T22:24:51.044399] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-18T22:24:51.719614] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-11. [2025-09-18T22:24:51.977548] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-18T22:24:52.181427] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-18T22:24:52.315204] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-18T22:24:52.322480] [INFO ] [REMOTE ] VEEV: Full fetch complete (68509 records). [2025-09-18T22:24:52.322729] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-09-18T22:24:52.524755] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-09-18T22:24:52.721867] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-09-18T22:24:52.721991] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-09-18T22:24:52.723093] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-09-18T22:24:52.723159] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-09-18T22:24:52.726442] [DEBUG] [LOCAL ] VEEV: Trimmed 68509 records to 47866 (keeping 200 days of data) [2025-09-18T22:24:53.034165] [DEBUG] [LOCAL ] VEEV: Primary data saved (47866 records). [2025-09-18T22:24:53.034319] [INFO ] [MAIN ] VEEV: Full history saved. [2025-09-18T22:24:53.034410] [INFO ] [MAIN ] Update Progress: 2220/2372 symbols completed. VEEV took 46.0s. Estimated remaining: 22m 14s. Rate: 6.8 symbols/min [2025-09-18T22:24:53.205564] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:24:53.224066] [DEBUG] [LOCAL ] VGM: Loaded 18294 existing records from primary storage. [2025-09-18T22:24:53.224198] [INFO ] [MAIN ] VGM: Loaded 18294 existing records. [2025-09-18T22:24:53.326501] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-09-18T22:24:53.411807] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:24:53.412062] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-09-18T22:24:53.412111] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-09-18T22:24:53.412746] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-09-18T22:24:53.412806] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-09-18T22:24:53.783266] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:24:53.851939] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-18T22:24:54.119553] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-03. [2025-09-18T22:24:54.691963] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-18T22:24:54.919572] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-09-18T22:24:55.719574] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-11. [2025-09-18T22:24:55.883575] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-18T22:24:56.373149] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-18T22:24:56.524615] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-04. [2025-09-18T22:24:56.541891] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-18T22:24:57.319533] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-09-18T22:24:58.119565] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-09-18T22:24:58.161176] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T22:24:58.570410] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-18T22:24:58.919578] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-09-18T22:24:59.478821] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-18T22:24:59.710242] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-18T22:24:59.717748] [INFO ] [REMOTE ] VFC: Full fetch complete (77429 records). [2025-09-18T22:24:59.717868] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-09-18T22:24:59.729573] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-09-18T22:25:00.124883] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-09-18T22:25:00.124997] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-09-18T22:25:00.126254] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-09-18T22:25:00.126334] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-09-18T22:25:00.128157] [DEBUG] [LOCAL ] VFC: Trimmed 77429 records to 53999 (keeping 200 days of data) [2025-09-18T22:25:00.470177] [DEBUG] [LOCAL ] VFC: Primary data saved (53999 records). [2025-09-18T22:25:00.470334] [INFO ] [MAIN ] VFC: Full history saved. [2025-09-18T22:25:00.470425] [INFO ] [MAIN ] Update Progress: 2221/2372 symbols completed. VFC took 33.5s. Estimated remaining: 22m 6s. Rate: 6.8 symbols/min [2025-09-18T22:25:00.525932] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-05. [2025-09-18T22:25:00.580350] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-18T22:25:00.658799] [INFO ] [MAIN ] VHC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:25:00.659009] [DEBUG] [LOCAL ] VHC: No existing data file found in primary storage. [2025-09-18T22:25:00.659057] [WARN ] [MAIN ] VHC: No existing data found, performing full refresh instead. [2025-09-18T22:25:00.659297] [INFO ] [MAIN ] VHC: Wiping existing primary data before full refresh. [2025-09-18T22:25:00.659349] [INFO ] [LOCAL ] VHC: Starting deletion of primary data. [2025-09-18T22:25:00.659393] [DEBUG] [LOCAL ] VHC: No primary data file found to delete. [2025-09-18T22:25:00.659427] [INFO ] [MAIN ] VHC: Starting full primary refresh. [2025-09-18T22:25:01.072798] [INFO ] [REMOTE ] VHC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:25:01.319546] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-09-18T22:25:02.093061] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-18T22:25:02.119592] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-09-18T22:25:02.320625] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-18T22:25:02.723629] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-18T22:25:02.919542] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-09-18T22:25:03.573159] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-18T22:25:03.719553] [INFO ] [REMOTE ] VHC: Fetching primary data for 2024-11. [2025-09-18T22:25:04.122802] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2024-11 (0.40 seconds). [2025-09-18T22:25:04.519556] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-09-18T22:25:05.319536] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-09-18T22:25:05.538084] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-18T22:25:05.788083] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-18T22:25:06.119560] [INFO ] [REMOTE ] VHC: Fetching primary data for 2024-12. [2025-09-18T22:25:06.800260] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-18T22:25:06.919603] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-06. [2025-09-18T22:25:07.719585] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-09-18T22:25:08.467542] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-18T22:25:08.519492] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-09-18T22:25:08.592303] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-18T22:25:09.319545] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-09-18T22:25:09.390993] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-18T22:25:09.841320] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-18T22:25:10.119596] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-09-18T22:25:10.615035] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-18T22:25:10.919605] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-01. [2025-09-18T22:25:11.504072] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-18T22:25:11.719572] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-09-18T22:25:12.430163] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-18T22:25:12.519565] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-02. [2025-09-18T22:25:12.912802] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-18T22:25:13.319558] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-09-18T22:25:14.043903] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-18T22:25:14.045843] [INFO ] [REMOTE ] VGI: Full fetch complete (7739 records). [2025-09-18T22:25:14.045916] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-09-18T22:25:14.124781] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-07. [2025-09-18T22:25:14.436292] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-09-18T22:25:14.436419] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-09-18T22:25:14.436723] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-09-18T22:25:14.436787] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-09-18T22:25:14.437253] [DEBUG] [LOCAL ] VGI: Trimmed 7739 records to 5270 (keeping 200 days of data) [2025-09-18T22:25:14.469938] [DEBUG] [LOCAL ] VGI: Primary data saved (5270 records). [2025-09-18T22:25:14.470090] [INFO ] [MAIN ] VGI: Full history saved. [2025-09-18T22:25:14.470201] [INFO ] [MAIN ] Update Progress: 2222/2372 symbols completed. VGI took 24.6s. Estimated remaining: 21m 57s. Rate: 6.8 symbols/min [2025-09-18T22:25:14.646787] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:25:14.652266] [DEBUG] [LOCAL ] VHI: Loaded 2988 existing records from primary storage. [2025-09-18T22:25:14.652372] [INFO ] [MAIN ] VHI: Loaded 2988 existing records. [2025-09-18T22:25:14.835256] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:25:14.835530] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-09-18T22:25:14.835579] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-09-18T22:25:14.835913] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-09-18T22:25:14.835977] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-09-18T22:25:14.924776] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-03. [2025-09-18T22:25:15.228271] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:25:15.393050] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-18T22:25:15.719561] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-04. [2025-09-18T22:25:16.099501] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-18T22:25:16.142320] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-18T22:25:16.519554] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-11. [2025-09-18T22:25:17.139891] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-18T22:25:17.319559] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-09-18T22:25:18.124480] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-05. [2025-09-18T22:25:18.127985] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-18T22:25:18.481020] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-18T22:25:18.919603] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-09-18T22:25:19.675069] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-18T22:25:19.719610] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-06. [2025-09-18T22:25:20.180132] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-18T22:25:20.519567] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-07. [2025-09-18T22:25:21.217743] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-18T22:25:21.319524] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-09-18T22:25:21.953153] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-18T22:25:22.119561] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-09-18T22:25:22.919516] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-08. [2025-09-18T22:25:23.296311] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-18T22:25:23.304143] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-18T22:25:23.719551] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-09. [2025-09-18T22:25:24.165178] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-18T22:25:24.166131] [INFO ] [REMOTE ] VHC: Full fetch complete (3744 records). [2025-09-18T22:25:24.166200] [DEBUG] [VALIDATOR ] VHC: Validating primary data. [2025-09-18T22:25:24.359660] [WARN ] [VALIDATOR ] VHC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-18T22:25:24.359932] [FATAL] [MAIN ] VHC: Fetched primary data is invalid. Refusing to save it. [2025-09-18T22:25:24.360004] [WARN ] [MAIN ] VHC: Deleting existing primary and derivative data due to validation failure. [2025-09-18T22:25:24.360123] [INFO ] [LOCAL ] VHC: Starting deletion of primary data. [2025-09-18T22:25:24.360221] [DEBUG] [LOCAL ] VHC: No primary data file found to delete. [2025-09-18T22:25:24.360284] [INFO ] [LOCAL ] VHC: Starting deletion of derivative data. [2025-09-18T22:25:24.360344] [DEBUG] [LOCAL ] VHC: No derivative data file found to delete. [2025-09-18T22:25:24.360426] [INFO ] [MAIN ] Update Progress: 2223/2372 symbols completed. VHC took 23.9s. Estimated remaining: 21m 48s. Rate: 6.8 symbols/min [2025-09-18T22:25:24.532292] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-08. [2025-09-18T22:25:24.536392] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:25:24.537841] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-09-18T22:25:24.537900] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-09-18T22:25:24.538051] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-09-18T22:25:24.538094] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-18T22:25:24.538136] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-18T22:25:24.538170] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-09-18T22:25:24.926876] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:25:25.319555] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-09-18T22:25:25.747353] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-18T22:25:26.119549] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-09-18T22:25:26.654707] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-18T22:25:26.718415] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-18T22:25:26.919549] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-09-18T22:25:27.411310] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-18T22:25:27.719613] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-11. [2025-09-18T22:25:27.915316] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:25:27.915733] [WARN ] [REMOTE ] VIA: No data returned for month 2024-11 [2025-09-18T22:25:28.519561] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-09-18T22:25:28.748599] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:25:28.749021] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-09-18T22:25:29.319539] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-09-18T22:25:30.119522] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-09. [2025-09-18T22:25:30.454553] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-18T22:25:30.919604] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-09-18T22:25:31.717447] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-18T22:25:31.724746] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-01. [2025-09-18T22:25:31.726837] [INFO ] [REMOTE ] VG: Full fetch complete (63342 records). [2025-09-18T22:25:31.726988] [DEBUG] [VALIDATOR ] VG: Validating primary data. [2025-09-18T22:25:31.930760] [WARN ] [VALIDATOR ] VG: Validation failed - insufficient historical data. Have 164 unique days, need 200 days [2025-09-18T22:25:31.931400] [FATAL] [MAIN ] VG: Fetched primary data is invalid. Refusing to save it. [2025-09-18T22:25:31.931471] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to validation failure. [2025-09-18T22:25:31.931542] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-18T22:25:31.931605] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-18T22:25:31.931665] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-09-18T22:25:31.931735] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-09-18T22:25:31.931813] [INFO ] [MAIN ] Update Progress: 2224/2372 symbols completed. VG took 48.8s. Estimated remaining: 21m 40s. Rate: 6.8 symbols/min [2025-09-18T22:25:32.024800] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:25:32.042457] [WARN ] [REMOTE ] VIA: No data returned for month 2025-01 [2025-09-18T22:25:32.123426] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-18T22:25:32.126588] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:25:32.188965] [DEBUG] [LOCAL ] VICI: Loaded 53648 existing records from primary storage. [2025-09-18T22:25:32.189143] [INFO ] [MAIN ] VICI: Loaded 53648 existing records. [2025-09-18T22:25:32.366346] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:25:32.366580] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-09-18T22:25:32.366628] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-09-18T22:25:32.367926] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-09-18T22:25:32.367987] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-09-18T22:25:32.528338] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-02. [2025-09-18T22:25:32.734636] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:25:32.841453] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:25:32.841865] [WARN ] [REMOTE ] VIA: No data returned for month 2025-02 [2025-09-18T22:25:33.319602] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-03. [2025-09-18T22:25:33.560408] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:25:33.560792] [WARN ] [REMOTE ] VIA: No data returned for month 2025-03 [2025-09-18T22:25:34.119547] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-11. [2025-09-18T22:25:34.919545] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-09-18T22:25:35.354891] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-18T22:25:35.719578] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-09-18T22:25:35.969374] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-18T22:25:36.243926] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-18T22:25:36.519556] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-09-18T22:25:37.115587] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-18T22:25:37.319536] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-09-18T22:25:37.725547] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-18T22:25:38.119543] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-09-18T22:25:38.919552] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-04. [2025-09-18T22:25:39.020229] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-18T22:25:39.023869] [INFO ] [REMOTE ] VGM: Full fetch complete (26138 records). [2025-09-18T22:25:39.023968] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-09-18T22:25:39.166370] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:25:39.188800] [WARN ] [REMOTE ] VIA: No data returned for month 2025-04 [2025-09-18T22:25:39.407152] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-09-18T22:25:39.407232] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-09-18T22:25:39.407870] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-09-18T22:25:39.407947] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-09-18T22:25:39.408635] [DEBUG] [LOCAL ] VGM: Trimmed 26138 records to 18403 (keeping 200 days of data) [2025-09-18T22:25:39.519970] [DEBUG] [LOCAL ] VGM: Primary data saved (18403 records). [2025-09-18T22:25:39.520143] [INFO ] [MAIN ] VGM: Full history saved. [2025-09-18T22:25:39.520258] [INFO ] [MAIN ] Update Progress: 2225/2372 symbols completed. VGM took 46.5s. Estimated remaining: 21m 31s. Rate: 6.8 symbols/min [2025-09-18T22:25:39.695876] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:25:39.729615] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-05. [2025-09-18T22:25:39.754559] [DEBUG] [LOCAL ] VIK: Loaded 52526 existing records from primary storage. [2025-09-18T22:25:39.754764] [INFO ] [MAIN ] VIK: Loaded 52526 existing records. [2025-09-18T22:25:39.961141] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:25:39.961471] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-09-18T22:25:39.961529] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-09-18T22:25:39.962910] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-09-18T22:25:39.962973] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-09-18T22:25:40.048336] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:25:40.072241] [WARN ] [REMOTE ] VIA: No data returned for month 2025-05 [2025-09-18T22:25:40.343717] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:25:40.519551] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-11. [2025-09-18T22:25:41.319594] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-06. [2025-09-18T22:25:41.547949] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:25:41.548384] [WARN ] [REMOTE ] VIA: No data returned for month 2025-06 [2025-09-18T22:25:42.119544] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-09-18T22:25:42.327916] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-18T22:25:42.449688] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-18T22:25:42.450737] [INFO ] [REMOTE ] VHI: Full fetch complete (4729 records). [2025-09-18T22:25:42.450810] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-09-18T22:25:42.815902] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-09-18T22:25:42.815987] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-09-18T22:25:42.816139] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-09-18T22:25:42.816180] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-09-18T22:25:42.816558] [DEBUG] [LOCAL ] VHI: Trimmed 4729 records to 3006 (keeping 200 days of data) [2025-09-18T22:25:42.836236] [DEBUG] [LOCAL ] VHI: Primary data saved (3006 records). [2025-09-18T22:25:42.836323] [INFO ] [MAIN ] VHI: Full history saved. [2025-09-18T22:25:42.836402] [INFO ] [MAIN ] Update Progress: 2226/2372 symbols completed. VHI took 28.4s. Estimated remaining: 21m 22s. Rate: 6.8 symbols/min [2025-09-18T22:25:42.924637] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-09-18T22:25:43.017995] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:25:43.075363] [DEBUG] [LOCAL ] VIPS: Loaded 51401 existing records from primary storage. [2025-09-18T22:25:43.075520] [INFO ] [MAIN ] VIPS: Loaded 51401 existing records. [2025-09-18T22:25:43.262993] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:25:43.263338] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-09-18T22:25:43.263411] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-09-18T22:25:43.264729] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-09-18T22:25:43.264808] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-09-18T22:25:43.628174] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:25:43.719553] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-07. [2025-09-18T22:25:43.925087] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:25:43.925452] [WARN ] [REMOTE ] VIA: No data returned for month 2025-07 [2025-09-18T22:25:44.519553] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-08. [2025-09-18T22:25:45.020032] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:25:45.020398] [WARN ] [REMOTE ] VIA: No data returned for month 2025-08 [2025-09-18T22:25:45.079892] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-18T22:25:45.319523] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-09. [2025-09-18T22:25:46.119540] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-09-18T22:25:46.130930] [INFO ] [REMOTE ] VIA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-18T22:25:46.133546] [INFO ] [REMOTE ] VIA: Full fetch complete (1494 records). [2025-09-18T22:25:46.133621] [DEBUG] [VALIDATOR ] VIA: Validating primary data. [2025-09-18T22:25:46.320300] [WARN ] [VALIDATOR ] VIA: Validation failed - insufficient historical data. Have 5 unique days, need 200 days [2025-09-18T22:25:46.320496] [FATAL] [MAIN ] VIA: Fetched primary data is invalid. Refusing to save it. [2025-09-18T22:25:46.320580] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to validation failure. [2025-09-18T22:25:46.320695] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-18T22:25:46.320790] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-18T22:25:46.320844] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-09-18T22:25:46.320929] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-09-18T22:25:46.321047] [INFO ] [MAIN ] Update Progress: 2227/2372 symbols completed. VIA took 22.0s. Estimated remaining: 21m 12s. Rate: 6.8 symbols/min [2025-09-18T22:25:46.506784] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:25:46.557178] [DEBUG] [LOCAL ] VIRT: Loaded 47088 existing records from primary storage. [2025-09-18T22:25:46.557374] [INFO ] [MAIN ] VIRT: Loaded 47088 existing records. [2025-09-18T22:25:46.739758] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:25:46.740013] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-09-18T22:25:46.740062] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-09-18T22:25:46.742004] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-09-18T22:25:46.742066] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-09-18T22:25:46.929135] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-09-18T22:25:47.130274] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:25:47.719549] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-11. [2025-09-18T22:25:48.210091] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-18T22:25:48.392202] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-18T22:25:48.519545] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-09-18T22:25:49.157275] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-18T22:25:49.319536] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-09-18T22:25:50.119564] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-11. [2025-09-18T22:25:50.366199] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-18T22:25:50.597722] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-18T22:25:50.919554] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-09-18T22:25:51.370689] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-18T22:25:51.719569] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-09-18T22:25:52.519562] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-09-18T22:25:52.794912] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-18T22:25:53.024052] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-18T22:25:53.319528] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-09-18T22:25:53.856984] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-18T22:25:54.119543] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-09-18T22:25:54.919580] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-09-18T22:25:55.047362] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-18T22:25:55.719558] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-09-18T22:25:55.903329] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-18T22:25:56.268988] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-18T22:25:56.519541] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-09-18T22:25:57.164796] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T22:25:57.319543] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-09-18T22:25:57.818061] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-18T22:25:58.119543] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-09-18T22:25:58.851197] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T22:25:58.919548] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-09-18T22:25:59.719542] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-09-18T22:26:00.047286] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-18T22:26:00.093015] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-18T22:26:00.519553] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-09-18T22:26:01.324627] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-09-18T22:26:01.342841] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-18T22:26:01.978767] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-18T22:26:02.119574] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-09-18T22:26:02.919579] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-09-18T22:26:03.205445] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-18T22:26:03.719555] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-09-18T22:26:03.755799] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T22:26:04.263581] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-18T22:26:04.519551] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-09-18T22:26:05.165286] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-18T22:26:05.319530] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-09-18T22:26:06.119560] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-09-18T22:26:06.223871] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-18T22:26:06.675394] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-18T22:26:06.919542] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-09-18T22:26:07.490110] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-18T22:26:07.719586] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-09-18T22:26:08.519583] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-09-18T22:26:08.689039] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-18T22:26:09.082043] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T22:26:09.319563] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-09-18T22:26:09.696545] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-18T22:26:10.119552] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-09-18T22:26:10.872291] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-18T22:26:10.919503] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-09-18T22:26:11.386161] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-18T22:26:11.719591] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-09-18T22:26:12.519619] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-09-18T22:26:12.699465] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-18T22:26:12.707377] [INFO ] [REMOTE ] VIPS: Full fetch complete (74453 records). [2025-09-18T22:26:12.707565] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-09-18T22:26:13.182762] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-09-18T22:26:13.182860] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-09-18T22:26:13.184054] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-09-18T22:26:13.184124] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-09-18T22:26:13.185904] [DEBUG] [LOCAL ] VIPS: Trimmed 74453 records to 51777 (keeping 200 days of data) [2025-09-18T22:26:13.321250] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-09-18T22:26:13.511918] [DEBUG] [LOCAL ] VIPS: Primary data saved (51777 records). [2025-09-18T22:26:13.512097] [INFO ] [MAIN ] VIPS: Full history saved. [2025-09-18T22:26:13.512420] [INFO ] [MAIN ] Update Progress: 2228/2372 symbols completed. VIPS took 30.7s. Estimated remaining: 21m 5s. Rate: 6.8 symbols/min [2025-09-18T22:26:13.722747] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:26:13.799279] [DEBUG] [LOCAL ] VIST: Loaded 45954 existing records from primary storage. [2025-09-18T22:26:13.802007] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-18T22:26:13.802360] [INFO ] [MAIN ] VIST: Loaded 45954 existing records. [2025-09-18T22:26:14.020816] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:26:14.021083] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-09-18T22:26:14.021134] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-09-18T22:26:14.022268] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-09-18T22:26:14.022348] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-09-18T22:26:14.124928] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-09-18T22:26:14.399897] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:26:14.456468] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-18T22:26:14.466312] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-18T22:26:14.477890] [INFO ] [REMOTE ] VICI: Full fetch complete (77510 records). [2025-09-18T22:26:14.478545] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-09-18T22:26:14.878797] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-09-18T22:26:14.878929] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-09-18T22:26:14.880118] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-09-18T22:26:14.880351] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-09-18T22:26:14.882175] [DEBUG] [LOCAL ] VICI: Trimmed 77510 records to 54038 (keeping 200 days of data) [2025-09-18T22:26:14.951530] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-11. [2025-09-18T22:26:15.015454] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-18T22:26:15.270200] [DEBUG] [LOCAL ] VICI: Primary data saved (54038 records). [2025-09-18T22:26:15.270451] [INFO ] [MAIN ] VICI: Full history saved. [2025-09-18T22:26:15.270735] [INFO ] [MAIN ] Update Progress: 2229/2372 symbols completed. VICI took 43.3s. Estimated remaining: 20m 56s. Rate: 6.8 symbols/min [2025-09-18T22:26:15.447468] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:26:15.494552] [DEBUG] [LOCAL ] VIV: Loaded 45466 existing records from primary storage. [2025-09-18T22:26:15.494782] [INFO ] [MAIN ] VIV: Loaded 45466 existing records. [2025-09-18T22:26:15.683984] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:26:15.684264] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-09-18T22:26:15.684329] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-09-18T22:26:15.685458] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-09-18T22:26:15.685534] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-09-18T22:26:15.724785] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-09-18T22:26:16.045685] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:26:16.519610] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-11. [2025-09-18T22:26:16.670341] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-18T22:26:17.269394] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T22:26:17.319551] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-09-18T22:26:17.855253] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-18T22:26:18.119600] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-09-18T22:26:18.702766] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-18T22:26:18.919563] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-09-18T22:26:19.724717] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-09-18T22:26:19.746128] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-18T22:26:20.068030] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-18T22:26:20.076045] [INFO ] [REMOTE ] VIRT: Full fetch complete (66737 records). [2025-09-18T22:26:20.076190] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-09-18T22:26:20.484171] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-09-18T22:26:20.484258] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-09-18T22:26:20.485283] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-09-18T22:26:20.485347] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-09-18T22:26:20.488620] [DEBUG] [LOCAL ] VIRT: Trimmed 66737 records to 47404 (keeping 200 days of data) [2025-09-18T22:26:20.555986] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-09-18T22:26:20.798408] [DEBUG] [LOCAL ] VIRT: Primary data saved (47404 records). [2025-09-18T22:26:20.798561] [INFO ] [MAIN ] VIRT: Full history saved. [2025-09-18T22:26:20.798714] [INFO ] [MAIN ] Update Progress: 2230/2372 symbols completed. VIRT took 34.5s. Estimated remaining: 20m 47s. Rate: 6.8 symbols/min [2025-09-18T22:26:20.969743] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:26:20.969940] [DEBUG] [LOCAL ] VKQ: No existing data file found in primary storage. [2025-09-18T22:26:20.969997] [WARN ] [MAIN ] VKQ: No existing data found, performing full refresh instead. [2025-09-18T22:26:20.970202] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-09-18T22:26:20.970258] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-09-18T22:26:20.970303] [DEBUG] [LOCAL ] VKQ: No primary data file found to delete. [2025-09-18T22:26:20.970338] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-09-18T22:26:21.328715] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-09-18T22:26:21.342565] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:26:21.515679] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-18T22:26:21.970572] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-18T22:26:22.119543] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-09-18T22:26:22.839977] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-18T22:26:22.919587] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-11. [2025-09-18T22:26:23.300252] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-18T22:26:23.719546] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-09-18T22:26:23.801105] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-18T22:26:24.519560] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-09-18T22:26:25.306672] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-18T22:26:25.319487] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-09-18T22:26:25.876846] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-18T22:26:25.886553] [INFO ] [REMOTE ] VIK: Full fetch complete (75713 records). [2025-09-18T22:26:25.886821] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-09-18T22:26:26.129517] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-09-18T22:26:26.312251] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-09-18T22:26:26.312344] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-09-18T22:26:26.313474] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-09-18T22:26:26.313542] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-09-18T22:26:26.315779] [DEBUG] [LOCAL ] VIK: Trimmed 75713 records to 52904 (keeping 200 days of data) [2025-09-18T22:26:26.578570] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-18T22:26:26.692614] [DEBUG] [LOCAL ] VIK: Primary data saved (52904 records). [2025-09-18T22:26:26.692854] [INFO ] [MAIN ] VIK: Full history saved. [2025-09-18T22:26:26.693110] [INFO ] [MAIN ] Update Progress: 2231/2372 symbols completed. VIK took 47.2s. Estimated remaining: 20m 38s. Rate: 6.8 symbols/min [2025-09-18T22:26:26.865965] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:26:26.894287] [DEBUG] [LOCAL ] VLN: Loaded 28076 existing records from primary storage. [2025-09-18T22:26:26.894417] [INFO ] [MAIN ] VLN: Loaded 28076 existing records. [2025-09-18T22:26:26.924788] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-09-18T22:26:27.078405] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:26:27.078715] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-09-18T22:26:27.078791] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-09-18T22:26:27.079456] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-09-18T22:26:27.079518] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-09-18T22:26:27.446970] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:26:27.719580] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-11. [2025-09-18T22:26:27.898159] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-18T22:26:28.281198] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-18T22:26:28.481072] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-18T22:26:28.519494] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-09-18T22:26:29.319536] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-09-18T22:26:29.848019] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T22:26:30.119546] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-09-18T22:26:30.903059] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T22:26:30.923542] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-09-18T22:26:30.927487] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-18T22:26:31.719579] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-09-18T22:26:32.519517] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-09-18T22:26:32.629296] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-18T22:26:32.969415] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T22:26:33.319547] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-09-18T22:26:33.847174] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-18T22:26:34.119590] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-09-18T22:26:34.297208] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-18T22:26:34.919546] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-09-18T22:26:35.652839] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-18T22:26:35.719576] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-09-18T22:26:35.819135] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-18T22:26:36.471300] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-18T22:26:36.519520] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-09-18T22:26:37.319550] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-09-18T22:26:37.412821] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-18T22:26:38.119594] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-09-18T22:26:38.833282] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-18T22:26:38.919577] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-09-18T22:26:39.545828] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T22:26:39.630519] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-18T22:26:39.719554] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-09-18T22:26:40.519578] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-09-18T22:26:40.756831] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-18T22:26:41.319551] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-09-18T22:26:41.763021] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T22:26:42.119579] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-09-18T22:26:42.234009] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-18T22:26:42.738397] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-18T22:26:42.919551] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-09-18T22:26:43.719522] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-09-18T22:26:44.035071] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-18T22:26:44.519543] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-09-18T22:26:45.000548] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-18T22:26:45.278220] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-18T22:26:45.319507] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-09-18T22:26:46.119548] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-09-18T22:26:46.760075] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-18T22:26:46.919591] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-09-18T22:26:47.293992] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-18T22:26:47.719550] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-09-18T22:26:48.043591] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T22:26:48.049741] [INFO ] [REMOTE ] VIV: Full fetch complete (64815 records). [2025-09-18T22:26:48.049908] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-09-18T22:26:48.500741] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-09-18T22:26:48.501136] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-09-18T22:26:48.502383] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-09-18T22:26:48.502454] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-09-18T22:26:48.504859] [DEBUG] [LOCAL ] VIV: Trimmed 64815 records to 45797 (keeping 200 days of data) [2025-09-18T22:26:48.561720] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-09-18T22:26:48.800125] [DEBUG] [LOCAL ] VIV: Primary data saved (45797 records). [2025-09-18T22:26:48.800311] [INFO ] [MAIN ] VIV: Full history saved. [2025-09-18T22:26:48.800436] [INFO ] [MAIN ] Update Progress: 2232/2372 symbols completed. VIV took 33.5s. Estimated remaining: 20m 30s. Rate: 6.8 symbols/min [2025-09-18T22:26:48.977811] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:26:49.039455] [DEBUG] [LOCAL ] VLO: Loaded 53098 existing records from primary storage. [2025-09-18T22:26:49.039632] [INFO ] [MAIN ] VLO: Loaded 53098 existing records. [2025-09-18T22:26:49.220148] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:26:49.220803] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-09-18T22:26:49.220863] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-09-18T22:26:49.229923] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-09-18T22:26:49.230015] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-09-18T22:26:49.313110] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T22:26:49.324637] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-09-18T22:26:49.627842] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:26:50.055848] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T22:26:50.119544] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-09-18T22:26:50.368435] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-18T22:26:50.919546] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-09-18T22:26:51.703980] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-18T22:26:51.712534] [INFO ] [REMOTE ] VIST: Full fetch complete (66586 records). [2025-09-18T22:26:51.712727] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-09-18T22:26:51.725558] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-09-18T22:26:51.857695] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-18T22:26:52.158835] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-09-18T22:26:52.158978] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-09-18T22:26:52.160146] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-09-18T22:26:52.160216] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-09-18T22:26:52.161849] [DEBUG] [LOCAL ] VIST: Trimmed 66586 records to 46331 (keeping 200 days of data) [2025-09-18T22:26:52.455119] [DEBUG] [LOCAL ] VIST: Primary data saved (46331 records). [2025-09-18T22:26:52.455276] [INFO ] [MAIN ] VIST: Full history saved. [2025-09-18T22:26:52.455394] [INFO ] [MAIN ] Update Progress: 2233/2372 symbols completed. VIST took 38.9s. Estimated remaining: 20m 21s. Rate: 6.8 symbols/min [2025-09-18T22:26:52.525857] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-09-18T22:26:52.635465] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:26:52.679675] [DEBUG] [LOCAL ] VLRS: Loaded 41047 existing records from primary storage. [2025-09-18T22:26:52.679846] [INFO ] [MAIN ] VLRS: Loaded 41047 existing records. [2025-09-18T22:26:52.856281] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:26:52.856582] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-09-18T22:26:52.856638] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-09-18T22:26:52.857517] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-09-18T22:26:52.857575] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-09-18T22:26:53.230574] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:26:53.246265] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-18T22:26:53.251317] [INFO ] [REMOTE ] VLN: Full fetch complete (43451 records). [2025-09-18T22:26:53.251435] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-09-18T22:26:53.329159] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-11. [2025-09-18T22:26:53.594560] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-18T22:26:53.674314] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-09-18T22:26:53.674406] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-09-18T22:26:53.675324] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-09-18T22:26:53.675395] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-09-18T22:26:53.676607] [DEBUG] [LOCAL ] VLN: Trimmed 43451 records to 28337 (keeping 200 days of data) [2025-09-18T22:26:53.843437] [DEBUG] [LOCAL ] VLN: Primary data saved (28337 records). [2025-09-18T22:26:53.843718] [INFO ] [MAIN ] VLN: Full history saved. [2025-09-18T22:26:53.843868] [INFO ] [MAIN ] Update Progress: 2234/2372 symbols completed. VLN took 27.2s. Estimated remaining: 20m 11s. Rate: 6.8 symbols/min [2025-09-18T22:26:54.027324] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:26:54.034463] [DEBUG] [LOCAL ] VLT: Loaded 4716 existing records from primary storage. [2025-09-18T22:26:54.034574] [INFO ] [MAIN ] VLT: Loaded 4716 existing records. [2025-09-18T22:26:54.124745] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-09-18T22:26:54.226261] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:26:54.226571] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-09-18T22:26:54.226632] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-09-18T22:26:54.226997] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-09-18T22:26:54.227060] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-09-18T22:26:54.594506] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:26:54.919512] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-11. [2025-09-18T22:26:55.027182] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-18T22:26:55.030526] [INFO ] [REMOTE ] VKQ: Full fetch complete (24492 records). [2025-09-18T22:26:55.030612] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-09-18T22:26:55.421498] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-09-18T22:26:55.421679] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-09-18T22:26:55.422274] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-09-18T22:26:55.422387] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-09-18T22:26:55.423708] [DEBUG] [LOCAL ] VKQ: Trimmed 24492 records to 17670 (keeping 200 days of data) [2025-09-18T22:26:55.532603] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-11 (2.20 seconds). [2025-09-18T22:26:55.572259] [DEBUG] [LOCAL ] VKQ: Primary data saved (17670 records). [2025-09-18T22:26:55.572414] [INFO ] [MAIN ] VKQ: Full history saved. [2025-09-18T22:26:55.572498] [INFO ] [MAIN ] Update Progress: 2235/2372 symbols completed. VKQ took 34.8s. Estimated remaining: 20m 2s. Rate: 6.8 symbols/min [2025-09-18T22:26:55.725004] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-11. [2025-09-18T22:26:55.746052] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:26:55.792607] [DEBUG] [LOCAL ] VLTO: Loaded 46059 existing records from primary storage. [2025-09-18T22:26:55.792797] [INFO ] [MAIN ] VLTO: Loaded 46059 existing records. [2025-09-18T22:26:55.976518] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:26:55.976824] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-09-18T22:26:55.976890] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-09-18T22:26:55.978078] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-09-18T22:26:55.978139] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-09-18T22:26:56.288363] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-18T22:26:56.351580] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:26:56.378123] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-18T22:26:56.519545] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-09-18T22:26:57.050478] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-18T22:26:57.319564] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-09-18T22:26:58.119589] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-09-18T22:26:58.896552] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-18T22:26:58.919503] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-09-18T22:26:58.978040] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-18T22:26:59.463121] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-18T22:26:59.719543] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-09-18T22:27:00.519540] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-09-18T22:27:00.976678] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-18T22:27:01.152042] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-18T22:27:01.319543] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-09-18T22:27:02.119540] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-09-18T22:27:02.919559] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-09-18T22:27:03.338766] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-18T22:27:03.719547] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-11. [2025-09-18T22:27:03.965248] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-18T22:27:04.519550] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-09-18T22:27:05.319559] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-09-18T22:27:05.329167] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-18T22:27:05.361829] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-18T22:27:05.461952] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-09-18T22:27:06.119563] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-09-18T22:27:06.676332] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-18T22:27:06.919543] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-09-18T22:27:07.527219] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-18T22:27:07.719616] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-09-18T22:27:08.114098] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-18T22:27:08.519569] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-09-18T22:27:09.319617] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-09-18T22:27:09.591841] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-18T22:27:09.768577] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-18T22:27:10.119581] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-09-18T22:27:10.701383] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-18T22:27:10.919571] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-09-18T22:27:11.396447] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-18T22:27:11.730167] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-09-18T22:27:11.735996] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-18T22:27:12.519549] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-09-18T22:27:13.319601] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-09-18T22:27:14.063892] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-18T22:27:14.119518] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-09-18T22:27:14.365623] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-18T22:27:14.513094] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-18T22:27:14.840522] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-18T22:27:14.919498] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-09-18T22:27:15.719567] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-09-18T22:27:16.402086] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-18T22:27:16.519516] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-09-18T22:27:17.118457] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-18T22:27:17.119857] [INFO ] [REMOTE ] VLT: Full fetch complete (7521 records). [2025-09-18T22:27:17.119934] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-09-18T22:27:17.328607] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-09-18T22:27:17.500154] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-09-18T22:27:17.500360] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-09-18T22:27:17.500684] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-09-18T22:27:17.500763] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-09-18T22:27:17.501721] [DEBUG] [LOCAL ] VLT: Trimmed 7521 records to 4732 (keeping 200 days of data) [2025-09-18T22:27:17.533347] [DEBUG] [LOCAL ] VLT: Primary data saved (4732 records). [2025-09-18T22:27:17.533519] [INFO ] [MAIN ] VLT: Full history saved. [2025-09-18T22:27:17.533630] [INFO ] [MAIN ] Update Progress: 2236/2372 symbols completed. VLT took 23.7s. Estimated remaining: 19m 54s. Rate: 6.8 symbols/min [2025-09-18T22:27:17.742100] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:27:17.758851] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-18T22:27:17.819021] [DEBUG] [LOCAL ] VMC: Loaded 44086 existing records from primary storage. [2025-09-18T22:27:17.819180] [INFO ] [MAIN ] VMC: Loaded 44086 existing records. [2025-09-18T22:27:18.023835] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:27:18.024204] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-09-18T22:27:18.024262] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-09-18T22:27:18.025319] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-09-18T22:27:18.025384] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-09-18T22:27:18.124755] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-09-18T22:27:18.421832] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:27:18.919554] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-11. [2025-09-18T22:27:18.996358] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-18T22:27:19.613518] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-18T22:27:19.719580] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-09-18T22:27:20.187496] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T22:27:20.519542] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-09-18T22:27:21.319525] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-09-18T22:27:21.421352] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-18T22:27:21.744810] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T22:27:22.119554] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-09-18T22:27:22.565505] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T22:27:22.919579] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-09-18T22:27:23.529558] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-18T22:27:23.719635] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-09-18T22:27:24.444156] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-18T22:27:24.519589] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-09-18T22:27:25.037125] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-18T22:27:25.319565] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-09-18T22:27:25.451453] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-18T22:27:26.119547] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-09-18T22:27:26.919578] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-09-18T22:27:27.161750] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-18T22:27:27.531020] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-18T22:27:27.719589] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-09-18T22:27:28.012691] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-18T22:27:28.017930] [INFO ] [REMOTE ] VLRS: Full fetch complete (58754 records). [2025-09-18T22:27:28.018091] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-09-18T22:27:28.460365] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-09-18T22:27:28.460519] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-09-18T22:27:28.461580] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-09-18T22:27:28.461711] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-09-18T22:27:28.463207] [DEBUG] [LOCAL ] VLRS: Trimmed 58754 records to 41361 (keeping 200 days of data) [2025-09-18T22:27:28.520323] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-09-18T22:27:28.568081] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-18T22:27:28.586909] [INFO ] [REMOTE ] VLO: Full fetch complete (76772 records). [2025-09-18T22:27:28.590715] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-09-18T22:27:28.939856] [DEBUG] [LOCAL ] VLRS: Primary data saved (41361 records). [2025-09-18T22:27:28.986165] [INFO ] [MAIN ] VLRS: Full history saved. [2025-09-18T22:27:29.009258] [INFO ] [MAIN ] Update Progress: 2237/2372 symbols completed. VLRS took 36.6s. Estimated remaining: 19m 46s. Rate: 6.8 symbols/min [2025-09-18T22:27:29.143546] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-09-18T22:27:29.143633] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-09-18T22:27:29.145003] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-09-18T22:27:29.145069] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-09-18T22:27:29.146627] [DEBUG] [LOCAL ] VLO: Trimmed 76772 records to 53482 (keeping 200 days of data) [2025-09-18T22:27:29.325971] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-09-18T22:27:29.480558] [DEBUG] [LOCAL ] VLO: Primary data saved (53482 records). [2025-09-18T22:27:29.480738] [INFO ] [MAIN ] VLO: Full history saved. [2025-09-18T22:27:29.480839] [INFO ] [MAIN ] Update Progress: 2238/2372 symbols completed. VLO took 40.7s. Estimated remaining: 19m 36s. Rate: 6.8 symbols/min [2025-09-18T22:27:30.139276] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-18T22:27:30.149235] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-09-18T22:27:30.767797] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-18T22:27:30.919560] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-09-18T22:27:31.841323] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-18T22:27:31.850923] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-09-18T22:27:32.432930] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-18T22:27:32.519544] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-09-18T22:27:33.458396] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-18T22:27:33.467508] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-09-18T22:27:33.653729] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-18T22:27:34.119617] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-09-18T22:27:34.875495] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-18T22:27:34.919530] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-09-18T22:27:35.569059] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-18T22:27:35.719500] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-09-18T22:27:36.516138] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-18T22:27:36.525442] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-09-18T22:27:36.743508] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-18T22:27:36.749229] [INFO ] [REMOTE ] VMC: Full fetch complete (62458 records). [2025-09-18T22:27:36.749351] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-09-18T22:27:37.164196] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-09-18T22:27:37.164380] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-09-18T22:27:37.165569] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-09-18T22:27:37.165684] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-09-18T22:27:37.176000] [DEBUG] [LOCAL ] VMC: Trimmed 62458 records to 44373 (keeping 200 days of data) [2025-09-18T22:27:37.193467] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T22:27:37.320252] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-09-18T22:27:37.482659] [DEBUG] [LOCAL ] VMC: Primary data saved (44373 records). [2025-09-18T22:27:37.482837] [INFO ] [MAIN ] VMC: Full history saved. [2025-09-18T22:27:37.482958] [INFO ] [MAIN ] Update Progress: 2239/2372 symbols completed. VMC took 19.9s. Estimated remaining: 19m 27s. Rate: 6.8 symbols/min [2025-09-18T22:27:38.044850] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-18T22:27:38.052095] [INFO ] [REMOTE ] VLTO: Full fetch complete (66583 records). [2025-09-18T22:27:38.052265] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-09-18T22:27:38.459490] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-09-18T22:27:38.459612] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-09-18T22:27:38.460913] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-09-18T22:27:38.460979] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-09-18T22:27:38.462430] [DEBUG] [LOCAL ] VLTO: Trimmed 66583 records to 46408 (keeping 200 days of data) [2025-09-18T22:27:38.758388] [DEBUG] [LOCAL ] VLTO: Primary data saved (46408 records). [2025-09-18T22:27:38.758521] [INFO ] [MAIN ] VLTO: Full history saved. [2025-09-18T22:27:38.758633] [INFO ] [MAIN ] Update Progress: 2240/2372 symbols completed. VLTO took 43.2s. Estimated remaining: 19m 18s. Rate: 6.8 symbols/min [2025-09-18T22:27:39.404990] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:27:39.408468] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:27:39.438355] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:27:39.495244] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:27:39.504740] [DEBUG] [LOCAL ] VNCE: Loaded 6181 existing records from primary storage. [2025-09-18T22:27:39.504992] [INFO ] [MAIN ] VNCE: Loaded 6181 existing records. [2025-09-18T22:27:39.644002] [DEBUG] [LOCAL ] VMO: Loaded 21032 existing records from primary storage. [2025-09-18T22:27:39.655383] [DEBUG] [LOCAL ] VMI: Loaded 15552 existing records from primary storage. [2025-09-18T22:27:39.672173] [INFO ] [MAIN ] VMO: Loaded 21032 existing records. [2025-09-18T22:27:39.672059] [INFO ] [MAIN ] VMI: Loaded 15552 existing records. [2025-09-18T22:27:39.965070] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:27:40.027685] [DEBUG] [LOCAL ] VNO: Loaded 48996 existing records from primary storage. [2025-09-18T22:27:40.040540] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-09-18T22:27:40.072668] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-09-18T22:27:40.095322] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-09-18T22:27:40.110803] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-09-18T22:27:40.110738] [INFO ] [MAIN ] VNO: Loaded 48996 existing records. [2025-09-18T22:27:40.126294] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:27:40.303464] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-09-18T22:27:40.346948] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-09-18T22:27:40.395931] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-09-18T22:27:40.346771] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:27:40.396140] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-09-18T22:27:40.476988] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-09-18T22:27:40.535088] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-09-18T22:27:40.616106] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-09-18T22:27:40.686005] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-09-18T22:27:40.699552] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:27:40.883400] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-09-18T22:27:40.952636] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-09-18T22:27:40.983492] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-09-18T22:27:41.038079] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-09-18T22:27:41.179749] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:27:41.200705] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-11. [2025-09-18T22:27:41.607946] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:27:41.630129] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-11. [2025-09-18T22:27:41.768374] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-18T22:27:41.844095] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:27:41.801531] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-09-18T22:27:41.869543] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-11. [2025-09-18T22:27:41.957963] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:27:41.958368] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-11. [2025-09-18T22:27:42.751301] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T22:27:42.754540] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-09-18T22:27:42.845157] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-18T22:27:42.906131] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-18T22:27:42.919488] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-09-18T22:27:43.374719] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-18T22:27:43.380794] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T22:27:43.719558] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-09-18T22:27:43.849377] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-18T22:27:44.519573] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-09-18T22:27:45.156348] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-18T22:27:45.175418] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-18T22:27:45.319552] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-09-18T22:27:46.119547] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-09-18T22:27:46.325060] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T22:27:46.724919] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-18T22:27:46.919579] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-09-18T22:27:47.719568] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-09-18T22:27:48.077541] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-18T22:27:48.123694] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-18T22:27:48.519548] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-09-18T22:27:49.018441] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-18T22:27:49.319549] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-09-18T22:27:50.119548] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-09-18T22:27:50.717286] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-18T22:27:50.924010] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-09-18T22:27:50.932743] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-18T22:27:51.719548] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-09-18T22:27:51.818465] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-18T22:27:52.250078] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-18T22:27:52.519576] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-09-18T22:27:53.319528] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-09-18T22:27:53.388607] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-18T22:27:53.971205] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-18T22:27:54.119542] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-09-18T22:27:54.919564] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-09-18T22:27:54.948989] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-18T22:27:55.719545] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-09-18T22:27:55.770849] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-18T22:27:56.519510] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-09-18T22:27:56.721146] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-18T22:27:57.172529] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-18T22:27:57.319554] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-09-18T22:27:58.072977] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-18T22:27:58.119539] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-09-18T22:27:58.913296] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T22:27:58.919706] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-09-18T22:27:59.696915] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-18T22:27:59.699525] [INFO ] [REMOTE ] VMI: Full fetch complete (21171 records). [2025-09-18T22:27:59.699602] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-09-18T22:27:59.724607] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-09-18T22:28:00.111134] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-09-18T22:28:00.111228] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-09-18T22:28:00.112006] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-09-18T22:28:00.112083] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-09-18T22:28:00.112837] [DEBUG] [LOCAL ] VMI: Trimmed 21171 records to 15650 (keeping 200 days of data) [2025-09-18T22:28:00.217017] [DEBUG] [LOCAL ] VMI: Primary data saved (15650 records). [2025-09-18T22:28:00.217194] [INFO ] [MAIN ] VMI: Full history saved. [2025-09-18T22:28:00.217320] [INFO ] [MAIN ] Update Progress: 2241/2372 symbols completed. VMI took 21.5s. Estimated remaining: 19m 10s. Rate: 6.8 symbols/min [2025-09-18T22:28:00.402105] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:28:00.445789] [DEBUG] [LOCAL ] VNT: Loaded 44364 existing records from primary storage. [2025-09-18T22:28:00.445948] [INFO ] [MAIN ] VNT: Loaded 44364 existing records. [2025-09-18T22:28:00.524907] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-09-18T22:28:00.643079] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:28:00.643347] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-09-18T22:28:00.643415] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-09-18T22:28:00.645339] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-09-18T22:28:00.645411] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-09-18T22:28:01.021411] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:28:01.076244] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T22:28:01.319548] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-09-18T22:28:01.443550] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-18T22:28:01.786002] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-18T22:28:02.119543] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-09-18T22:28:02.919552] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-09-18T22:28:02.986762] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-18T22:28:02.990191] [INFO ] [REMOTE ] VNCE: Full fetch complete (14256 records). [2025-09-18T22:28:02.990371] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-09-18T22:28:03.353620] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-09-18T22:28:03.353734] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-09-18T22:28:03.354056] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-09-18T22:28:03.354097] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-09-18T22:28:03.354570] [DEBUG] [LOCAL ] VNCE: Trimmed 14256 records to 6374 (keeping 200 days of data) [2025-09-18T22:28:03.391175] [DEBUG] [LOCAL ] VNCE: Primary data saved (6374 records). [2025-09-18T22:28:03.391282] [INFO ] [MAIN ] VNCE: Full history saved. [2025-09-18T22:28:03.391383] [INFO ] [MAIN ] Update Progress: 2242/2372 symbols completed. VNCE took 24.6s. Estimated remaining: 19m 1s. Rate: 6.8 symbols/min [2025-09-18T22:28:03.563036] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:28:03.573483] [DEBUG] [LOCAL ] VOC: Loaded 8996 existing records from primary storage. [2025-09-18T22:28:03.573587] [INFO ] [MAIN ] VOC: Loaded 8996 existing records. [2025-09-18T22:28:03.724777] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-11. [2025-09-18T22:28:03.763471] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:28:03.763743] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-09-18T22:28:03.763800] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-09-18T22:28:03.764234] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-09-18T22:28:03.764295] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-09-18T22:28:04.128016] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:28:04.519545] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-09-18T22:28:04.612277] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-18T22:28:05.208473] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-18T22:28:05.319514] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-09-18T22:28:05.366919] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-18T22:28:06.119555] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-09-18T22:28:06.561477] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-18T22:28:06.919573] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-09-18T22:28:07.563198] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-18T22:28:07.719573] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-11. [2025-09-18T22:28:08.178925] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-18T22:28:08.484432] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-18T22:28:08.519488] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-09-18T22:28:09.163416] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-18T22:28:09.319549] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-09-18T22:28:10.119580] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-09-18T22:28:10.156873] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T22:28:10.919584] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-09-18T22:28:11.685850] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T22:28:11.719519] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-09-18T22:28:12.459625] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-18T22:28:12.519531] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-09-18T22:28:13.004129] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-18T22:28:13.319553] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-09-18T22:28:13.820865] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-18T22:28:14.119592] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-09-18T22:28:14.755118] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-18T22:28:14.919561] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-09-18T22:28:15.018348] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-18T22:28:15.686445] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-18T22:28:15.719551] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-09-18T22:28:16.519559] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-09-18T22:28:16.803007] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-18T22:28:17.319633] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-09-18T22:28:18.058734] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-18T22:28:18.081462] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-18T22:28:18.119511] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-09-18T22:28:18.919580] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-09-18T22:28:19.605005] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-18T22:28:19.713180] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-18T22:28:19.720728] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-09-18T22:28:19.722370] [INFO ] [REMOTE ] VNO: Full fetch complete (70289 records). [2025-09-18T22:28:19.722682] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-09-18T22:28:20.126009] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-09-18T22:28:20.126107] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-09-18T22:28:20.127324] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-09-18T22:28:20.127416] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-09-18T22:28:20.129068] [DEBUG] [LOCAL ] VNO: Trimmed 70289 records to 49344 (keeping 200 days of data) [2025-09-18T22:28:20.442458] [DEBUG] [LOCAL ] VNO: Primary data saved (49344 records). [2025-09-18T22:28:20.442700] [INFO ] [MAIN ] VNO: Full history saved. [2025-09-18T22:28:20.443159] [INFO ] [MAIN ] Update Progress: 2243/2372 symbols completed. VNO took 41.7s. Estimated remaining: 18m 53s. Rate: 6.8 symbols/min [2025-09-18T22:28:20.524821] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-09-18T22:28:20.618155] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:28:20.660425] [DEBUG] [LOCAL ] VOYA: Loaded 42978 existing records from primary storage. [2025-09-18T22:28:20.660578] [INFO ] [MAIN ] VOYA: Loaded 42978 existing records. [2025-09-18T22:28:20.789588] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-18T22:28:20.855778] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:28:20.856039] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-09-18T22:28:20.856089] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-09-18T22:28:20.857387] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-09-18T22:28:20.857449] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-09-18T22:28:21.227438] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:28:21.319587] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-09-18T22:28:22.077041] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-18T22:28:22.097680] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-18T22:28:22.119492] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-09-18T22:28:22.919559] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-09-18T22:28:23.543620] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-18T22:28:23.719526] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-11. [2025-09-18T22:28:24.036406] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T22:28:24.040639] [INFO ] [REMOTE ] VMO: Full fetch complete (31470 records). [2025-09-18T22:28:24.040762] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-09-18T22:28:24.410192] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-09-18T22:28:24.410279] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-09-18T22:28:24.410931] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-09-18T22:28:24.410996] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-09-18T22:28:24.412627] [DEBUG] [LOCAL ] VMO: Trimmed 31470 records to 21187 (keeping 200 days of data) [2025-09-18T22:28:24.519831] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-09-18T22:28:24.565191] [DEBUG] [LOCAL ] VMO: Primary data saved (21187 records). [2025-09-18T22:28:24.565370] [INFO ] [MAIN ] VMO: Full history saved. [2025-09-18T22:28:24.565700] [INFO ] [MAIN ] Update Progress: 2244/2372 symbols completed. VMO took 45.8s. Estimated remaining: 18m 44s. Rate: 6.8 symbols/min [2025-09-18T22:28:24.745854] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:28:24.746054] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-09-18T22:28:24.746130] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-09-18T22:28:24.746282] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-09-18T22:28:24.746327] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-18T22:28:24.746370] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-18T22:28:24.746463] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-09-18T22:28:25.121952] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:28:25.122628] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-18T22:28:25.153687] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T22:28:25.319570] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-09-18T22:28:26.119566] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-11. [2025-09-18T22:28:26.354106] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:28:26.354485] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-11 [2025-09-18T22:28:26.919539] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-09-18T22:28:26.956842] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-18T22:28:27.125159] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:28:27.125615] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-09-18T22:28:27.719588] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-09-18T22:28:28.519551] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-09-18T22:28:29.227578] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T22:28:29.319519] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-09-18T22:28:29.780476] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-18T22:28:30.119603] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-09-18T22:28:30.461394] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T22:28:30.919598] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-09-18T22:28:31.317692] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-18T22:28:31.719609] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-09-18T22:28:32.471680] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-18T22:28:32.519523] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-09-18T22:28:32.613769] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-18T22:28:33.140577] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-18T22:28:33.319581] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-01. [2025-09-18T22:28:33.554426] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:28:33.554843] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-01 [2025-09-18T22:28:34.119545] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-09-18T22:28:34.919576] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-09-18T22:28:34.957117] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-18T22:28:35.719552] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-09-18T22:28:36.284709] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-18T22:28:36.286398] [INFO ] [REMOTE ] VOC: Full fetch complete (13223 records). [2025-09-18T22:28:36.286468] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-09-18T22:28:36.529199] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-02. [2025-09-18T22:28:36.676337] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-09-18T22:28:36.676610] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-09-18T22:28:36.677086] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-09-18T22:28:36.677159] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-09-18T22:28:36.687396] [DEBUG] [LOCAL ] VOC: Trimmed 13223 records to 9063 (keeping 200 days of data) [2025-09-18T22:28:36.705592] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-18T22:28:36.768792] [DEBUG] [LOCAL ] VOC: Primary data saved (9063 records). [2025-09-18T22:28:36.768926] [INFO ] [MAIN ] VOC: Full history saved. [2025-09-18T22:28:36.769112] [INFO ] [MAIN ] Update Progress: 2245/2372 symbols completed. VOC took 33.4s. Estimated remaining: 18m 35s. Rate: 6.8 symbols/min [2025-09-18T22:28:36.844981] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:28:36.879176] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-02 [2025-09-18T22:28:36.956638] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:28:36.976157] [DEBUG] [LOCAL ] VPG: Loaded 17231 existing records from primary storage. [2025-09-18T22:28:36.976291] [INFO ] [MAIN ] VPG: Loaded 17231 existing records. [2025-09-18T22:28:37.154915] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:28:37.155181] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-09-18T22:28:37.155243] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-09-18T22:28:37.155767] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-09-18T22:28:37.155827] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-09-18T22:28:37.329413] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-09-18T22:28:37.522218] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:28:38.119547] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-11. [2025-09-18T22:28:38.919541] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-03. [2025-09-18T22:28:39.057196] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-18T22:28:39.096780] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-18T22:28:39.132913] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:28:39.133241] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-03 [2025-09-18T22:28:39.719571] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-09-18T22:28:40.519620] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-04. [2025-09-18T22:28:40.728423] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:28:40.728775] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-04 [2025-09-18T22:28:41.135934] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-18T22:28:41.145436] [INFO ] [REMOTE ] VNT: Full fetch complete (63457 records). [2025-09-18T22:28:41.145587] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-09-18T22:28:41.320255] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-09-18T22:28:41.542390] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-09-18T22:28:41.542531] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-09-18T22:28:41.543746] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-09-18T22:28:41.543815] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-09-18T22:28:41.545305] [DEBUG] [LOCAL ] VNT: Trimmed 63457 records to 44664 (keeping 200 days of data) [2025-09-18T22:28:41.843022] [DEBUG] [LOCAL ] VNT: Primary data saved (44664 records). [2025-09-18T22:28:41.843157] [INFO ] [MAIN ] VNT: Full history saved. [2025-09-18T22:28:41.843311] [INFO ] [MAIN ] Update Progress: 2246/2372 symbols completed. VNT took 41.6s. Estimated remaining: 18m 26s. Rate: 6.8 symbols/min [2025-09-18T22:28:42.015160] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:28:42.025380] [DEBUG] [LOCAL ] VPV: Loaded 5389 existing records from primary storage. [2025-09-18T22:28:42.025499] [INFO ] [MAIN ] VPV: Loaded 5389 existing records. [2025-09-18T22:28:42.124624] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-05. [2025-09-18T22:28:42.218377] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:28:42.218662] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-09-18T22:28:42.218726] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-09-18T22:28:42.219090] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-09-18T22:28:42.219152] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-09-18T22:28:42.421463] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:28:42.454879] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-05 [2025-09-18T22:28:42.536498] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-18T22:28:42.619752] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:28:42.919592] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-09-18T22:28:43.719564] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-09-18T22:28:44.375243] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-18T22:28:44.524731] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-09-18T22:28:44.544749] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-18T22:28:45.216047] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-18T22:28:45.319582] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-09-18T22:28:46.085018] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-18T22:28:46.119546] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-11. [2025-09-18T22:28:46.684406] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-18T22:28:46.919559] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-09-18T22:28:47.719548] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-06. [2025-09-18T22:28:47.742521] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-18T22:28:48.519549] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-09-18T22:28:49.040525] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-18T22:28:49.319554] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-09-18T22:28:49.332749] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-18T22:28:50.119512] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-07. [2025-09-18T22:28:50.277077] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-18T22:28:50.919546] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-09-18T22:28:51.719609] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-09-18T22:28:52.062456] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-18T22:28:52.155623] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T22:28:52.519579] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-09-18T22:28:52.669739] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-18T22:28:53.319558] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-09-18T22:28:53.839862] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-18T22:28:54.119569] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-08. [2025-09-18T22:28:54.378462] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-18T22:28:54.919552] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-09-18T22:28:55.725716] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-09-18T22:28:55.743737] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-18T22:28:56.226758] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-18T22:28:56.242698] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-18T22:28:56.519563] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-09-18T22:28:57.136048] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-18T22:28:57.319564] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-09-18T22:28:58.119565] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-09-18T22:28:58.254191] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-18T22:28:58.919550] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-09-18T22:28:59.035074] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-18T22:28:59.719568] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-09. [2025-09-18T22:29:00.165055] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-18T22:29:00.171673] [INFO ] [REMOTE ] VOYA: Full fetch complete (61994 records). [2025-09-18T22:29:00.171879] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-09-18T22:29:00.524775] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-09-18T22:29:00.592038] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-09-18T22:29:00.592132] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-09-18T22:29:00.593323] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-09-18T22:29:00.593388] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-09-18T22:29:00.594709] [DEBUG] [LOCAL ] VOYA: Trimmed 61994 records to 43279 (keeping 200 days of data) [2025-09-18T22:29:00.898069] [DEBUG] [LOCAL ] VOYA: Primary data saved (43279 records). [2025-09-18T22:29:00.898248] [INFO ] [MAIN ] VOYA: Full history saved. [2025-09-18T22:29:00.898432] [INFO ] [MAIN ] Update Progress: 2247/2372 symbols completed. VOYA took 40.5s. Estimated remaining: 18m 18s. Rate: 6.8 symbols/min [2025-09-18T22:29:01.105595] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:29:01.143921] [DEBUG] [LOCAL ] VRE: Loaded 34705 existing records from primary storage. [2025-09-18T22:29:01.144101] [INFO ] [MAIN ] VRE: Loaded 34705 existing records. [2025-09-18T22:29:01.319531] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-09-18T22:29:01.342397] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:29:01.344010] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-09-18T22:29:01.344299] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-09-18T22:29:01.359984] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-09-18T22:29:01.363760] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-09-18T22:29:01.376802] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-18T22:29:01.457696] [INFO ] [REMOTE ] VOYG: Full fetch complete (22664 records). [2025-09-18T22:29:01.484126] [DEBUG] [VALIDATOR ] VOYG: Validating primary data. [2025-09-18T22:29:01.508390] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-18T22:29:01.947492] [WARN ] [VALIDATOR ] VOYG: Validation failed - insufficient historical data. Have 69 unique days, need 200 days [2025-09-18T22:29:01.979142] [FATAL] [MAIN ] VOYG: Fetched primary data is invalid. Refusing to save it. [2025-09-18T22:29:01.979359] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to validation failure. [2025-09-18T22:29:01.991858] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-18T22:29:02.013694] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-18T22:29:02.003281] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-18T22:29:02.026993] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-09-18T22:29:02.047517] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-09-18T22:29:02.086443] [INFO ] [MAIN ] Update Progress: 2248/2372 symbols completed. VOYG took 37.5s. Estimated remaining: 18m 9s. Rate: 6.8 symbols/min [2025-09-18T22:29:02.086309] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:29:02.124668] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-09-18T22:29:02.283426] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:29:02.354469] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-09-18T22:29:02.354636] [INFO ] [MAIN ] VRT: Loaded 53753 existing records. [2025-09-18T22:29:02.541345] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:29:02.541760] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-09-18T22:29:02.541839] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-09-18T22:29:02.543588] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-09-18T22:29:02.543685] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-09-18T22:29:02.915849] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:29:02.919502] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-11. [2025-09-18T22:29:03.126507] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-18T22:29:03.130126] [INFO ] [REMOTE ] VPG: Full fetch complete (23125 records). [2025-09-18T22:29:03.130221] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-09-18T22:29:03.498795] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-09-18T22:29:03.498883] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-09-18T22:29:03.499365] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-09-18T22:29:03.499408] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-09-18T22:29:03.500177] [DEBUG] [LOCAL ] VPG: Trimmed 23125 records to 17345 (keeping 200 days of data) [2025-09-18T22:29:03.607302] [DEBUG] [LOCAL ] VPG: Primary data saved (17345 records). [2025-09-18T22:29:03.607443] [INFO ] [MAIN ] VPG: Full history saved. [2025-09-18T22:29:03.607528] [INFO ] [MAIN ] Update Progress: 2249/2372 symbols completed. VPG took 26.8s. Estimated remaining: 17m 60s. Rate: 6.8 symbols/min [2025-09-18T22:29:03.724623] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-11. [2025-09-18T22:29:03.782367] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:29:03.793711] [DEBUG] [LOCAL ] VRTS: Loaded 9066 existing records from primary storage. [2025-09-18T22:29:03.793827] [INFO ] [MAIN ] VRTS: Loaded 9066 existing records. [2025-09-18T22:29:03.976668] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:29:03.976961] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-09-18T22:29:03.977012] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-09-18T22:29:03.977437] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-09-18T22:29:03.977495] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-09-18T22:29:04.335959] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:29:04.519531] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-11. [2025-09-18T22:29:04.967001] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-18T22:29:05.245371] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-11 (2.33 seconds). [2025-09-18T22:29:05.266895] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-18T22:29:05.319497] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-09-18T22:29:05.749222] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-18T22:29:06.119599] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-09-18T22:29:06.645119] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-18T22:29:06.919591] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-09-18T22:29:07.437533] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-18T22:29:07.719614] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-09-18T22:29:08.519555] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-09-18T22:29:08.998492] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-18T22:29:09.319694] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-09-18T22:29:10.119615] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-09-18T22:29:10.188921] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-18T22:29:10.190834] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-18T22:29:10.919550] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-09-18T22:29:11.266840] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-18T22:29:11.617005] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-18T22:29:11.719614] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-09-18T22:29:12.519554] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-09-18T22:29:13.141999] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T22:29:13.143504] [INFO ] [REMOTE ] VPV: Full fetch complete (9376 records). [2025-09-18T22:29:13.143583] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-09-18T22:29:13.331883] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-09-18T22:29:13.518915] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-09-18T22:29:13.519022] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-09-18T22:29:13.519271] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-09-18T22:29:13.519340] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-09-18T22:29:13.519868] [DEBUG] [LOCAL ] VPV: Trimmed 9376 records to 5405 (keeping 200 days of data) [2025-09-18T22:29:13.552611] [DEBUG] [LOCAL ] VPV: Primary data saved (5405 records). [2025-09-18T22:29:13.552739] [INFO ] [MAIN ] VPV: Full history saved. [2025-09-18T22:29:13.552839] [INFO ] [MAIN ] Update Progress: 2250/2372 symbols completed. VPV took 31.7s. Estimated remaining: 17m 51s. Rate: 6.8 symbols/min [2025-09-18T22:29:13.727398] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:29:13.785148] [DEBUG] [LOCAL ] VSCO: Loaded 52903 existing records from primary storage. [2025-09-18T22:29:13.785303] [INFO ] [MAIN ] VSCO: Loaded 52903 existing records. [2025-09-18T22:29:13.973844] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:29:13.974383] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-09-18T22:29:13.974497] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-09-18T22:29:13.976448] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-09-18T22:29:13.976516] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-09-18T22:29:14.135537] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-09-18T22:29:14.243134] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-09-18T22:29:14.419872] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:29:14.694178] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-18T22:29:14.746979] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-18T22:29:14.919514] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-09-18T22:29:15.719544] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-09-18T22:29:15.867333] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-18T22:29:16.317064] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-18T22:29:16.519581] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-09-18T22:29:17.319560] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-09-18T22:29:17.973314] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-18T22:29:18.119601] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-09-18T22:29:18.919549] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-11. [2025-09-18T22:29:19.556915] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-18T22:29:19.590417] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-18T22:29:19.719565] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-09-18T22:29:20.336912] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-18T22:29:20.519551] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-09-18T22:29:20.714834] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-18T22:29:21.319565] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-09-18T22:29:22.119552] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-09-18T22:29:22.762413] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-18T22:29:22.839351] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-18T22:29:22.881939] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-18T22:29:22.919525] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-09-18T22:29:23.719589] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-09-18T22:29:24.519559] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-09-18T22:29:25.203402] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-18T22:29:25.319558] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-09-18T22:29:25.463975] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-18T22:29:25.521266] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-18T22:29:26.119543] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-09-18T22:29:26.850783] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-18T22:29:26.919549] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-09-18T22:29:27.472384] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-18T22:29:27.613108] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-18T22:29:27.719524] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-09-18T22:29:28.508252] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T22:29:28.519532] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-09-18T22:29:29.319545] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-09-18T22:29:30.119599] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-09-18T22:29:30.318829] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-18T22:29:30.546026] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-18T22:29:30.547605] [INFO ] [REMOTE ] VRTS: Full fetch complete (11117 records). [2025-09-18T22:29:30.547720] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-09-18T22:29:30.922765] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-09-18T22:29:30.923330] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-09-18T22:29:30.924539] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-09-18T22:29:30.924893] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-09-18T22:29:30.924958] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-09-18T22:29:30.925465] [DEBUG] [LOCAL ] VRTS: Trimmed 11117 records to 9119 (keeping 200 days of data) [2025-09-18T22:29:30.984918] [DEBUG] [LOCAL ] VRTS: Primary data saved (9119 records). [2025-09-18T22:29:30.985067] [INFO ] [MAIN ] VRTS: Full history saved. [2025-09-18T22:29:30.985173] [INFO ] [MAIN ] Update Progress: 2251/2372 symbols completed. VRTS took 27.4s. Estimated remaining: 17m 43s. Rate: 6.8 symbols/min [2025-09-18T22:29:31.159457] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:29:31.217969] [DEBUG] [LOCAL ] VSH: Loaded 48785 existing records from primary storage. [2025-09-18T22:29:31.218121] [INFO ] [MAIN ] VSH: Loaded 48785 existing records. [2025-09-18T22:29:31.401179] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:29:31.401585] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-09-18T22:29:31.401759] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-09-18T22:29:31.413931] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-09-18T22:29:31.428257] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-09-18T22:29:31.499370] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-18T22:29:31.724626] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-09-18T22:29:31.815158] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:29:32.519607] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-11. [2025-09-18T22:29:32.588031] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-18T22:29:32.810274] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-18T22:29:33.319610] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-09-18T22:29:34.017404] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-18T22:29:34.119559] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-09-18T22:29:34.245379] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-18T22:29:34.919558] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-09-18T22:29:35.719572] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-09-18T22:29:36.519579] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-09-18T22:29:36.647321] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-18T22:29:36.726614] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-18T22:29:37.287780] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-18T22:29:37.319546] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-09-18T22:29:37.480465] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-18T22:29:37.486716] [INFO ] [REMOTE ] VRE: Full fetch complete (47641 records). [2025-09-18T22:29:37.486814] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-09-18T22:29:37.866450] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-09-18T22:29:37.866536] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-09-18T22:29:37.867426] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-09-18T22:29:37.867489] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-09-18T22:29:37.868509] [DEBUG] [LOCAL ] VRE: Trimmed 47641 records to 35060 (keeping 200 days of data) [2025-09-18T22:29:38.081019] [DEBUG] [LOCAL ] VRE: Primary data saved (35060 records). [2025-09-18T22:29:38.081157] [INFO ] [MAIN ] VRE: Full history saved. [2025-09-18T22:29:38.081243] [INFO ] [MAIN ] Update Progress: 2252/2372 symbols completed. VRE took 37.2s. Estimated remaining: 17m 34s. Rate: 6.8 symbols/min [2025-09-18T22:29:38.124613] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-09-18T22:29:38.265969] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:29:38.321548] [DEBUG] [LOCAL ] VST: Loaded 53722 existing records from primary storage. [2025-09-18T22:29:38.321729] [INFO ] [MAIN ] VST: Loaded 53722 existing records. [2025-09-18T22:29:38.504275] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:29:38.504583] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-09-18T22:29:38.504639] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-09-18T22:29:38.506188] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-09-18T22:29:38.506251] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-09-18T22:29:38.881407] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:29:38.919495] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-11. [2025-09-18T22:29:38.959584] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-18T22:29:39.400571] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-18T22:29:39.719619] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-09-18T22:29:40.519571] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-09-18T22:29:41.293372] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-18T22:29:41.319490] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-09-18T22:29:41.353740] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-11 (2.43 seconds). [2025-09-18T22:29:42.119558] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-09-18T22:29:42.724564] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-18T22:29:42.919511] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-09-18T22:29:43.028081] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-18T22:29:43.679970] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-18T22:29:43.719564] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-09-18T22:29:44.519583] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-09-18T22:29:44.931941] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-18T22:29:44.941118] [INFO ] [REMOTE ] VRT: Full fetch complete (77786 records). [2025-09-18T22:29:44.941258] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-09-18T22:29:45.327462] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-09-18T22:29:45.354705] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-09-18T22:29:45.354861] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-09-18T22:29:45.356049] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-09-18T22:29:45.356162] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-09-18T22:29:45.358205] [DEBUG] [LOCAL ] VRT: Trimmed 77786 records to 54143 (keeping 200 days of data) [2025-09-18T22:29:45.502864] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-18T22:29:45.751577] [DEBUG] [LOCAL ] VRT: Primary data saved (54143 records). [2025-09-18T22:29:45.751749] [INFO ] [MAIN ] VRT: Full history saved. [2025-09-18T22:29:45.751845] [INFO ] [MAIN ] Update Progress: 2253/2372 symbols completed. VRT took 43.7s. Estimated remaining: 17m 25s. Rate: 6.8 symbols/min [2025-09-18T22:29:45.925014] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:29:45.969787] [DEBUG] [LOCAL ] VSTS: Loaded 49016 existing records from primary storage. [2025-09-18T22:29:45.969974] [INFO ] [MAIN ] VSTS: Loaded 49016 existing records. [2025-09-18T22:29:46.124697] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-09-18T22:29:46.156092] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:29:46.156259] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-09-18T22:29:46.156307] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-09-18T22:29:46.157318] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-09-18T22:29:46.157378] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-09-18T22:29:46.526136] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:29:46.919520] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-11. [2025-09-18T22:29:46.989706] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-18T22:29:47.044276] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-18T22:29:47.709796] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T22:29:47.721282] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-09-18T22:29:48.122364] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-18T22:29:48.519549] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-09-18T22:29:49.183548] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-18T22:29:49.319553] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-09-18T22:29:49.887624] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-18T22:29:50.119613] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-09-18T22:29:50.919535] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-09-18T22:29:50.995413] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-18T22:29:51.719547] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-09-18T22:29:52.351932] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T22:29:52.480877] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-18T22:29:52.519527] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-09-18T22:29:53.319572] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-09-18T22:29:53.488890] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-18T22:29:53.574933] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-18T22:29:54.119540] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-09-18T22:29:54.815874] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-18T22:29:54.823679] [INFO ] [REMOTE ] VSCO: Full fetch complete (76112 records). [2025-09-18T22:29:54.823853] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-09-18T22:29:54.926007] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-09-18T22:29:55.224922] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-09-18T22:29:55.225033] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-09-18T22:29:55.226155] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-09-18T22:29:55.226222] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-09-18T22:29:55.227842] [DEBUG] [LOCAL ] VSCO: Trimmed 76112 records to 53285 (keeping 200 days of data) [2025-09-18T22:29:55.550150] [DEBUG] [LOCAL ] VSCO: Primary data saved (53285 records). [2025-09-18T22:29:55.550292] [INFO ] [MAIN ] VSCO: Full history saved. [2025-09-18T22:29:55.550380] [INFO ] [MAIN ] Update Progress: 2254/2372 symbols completed. VSCO took 42.0s. Estimated remaining: 17m 16s. Rate: 6.8 symbols/min [2025-09-18T22:29:55.737832] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-09-18T22:29:55.767196] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-18T22:29:55.768301] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:29:55.818289] [DEBUG] [LOCAL ] VTEX: Loaded 43487 existing records from primary storage. [2025-09-18T22:29:55.818432] [INFO ] [MAIN ] VTEX: Loaded 43487 existing records. [2025-09-18T22:29:56.005063] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:29:56.005346] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-09-18T22:29:56.005396] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-09-18T22:29:56.006232] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-09-18T22:29:56.006293] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-09-18T22:29:56.405347] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:29:56.519545] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-11. [2025-09-18T22:29:57.319716] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-09-18T22:29:57.516540] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-18T22:29:58.049477] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-18T22:29:58.119538] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-09-18T22:29:58.688090] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-18T22:29:58.852971] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-11 (2.33 seconds). [2025-09-18T22:29:58.919536] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-09-18T22:29:59.719600] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-09-18T22:30:00.202587] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-18T22:30:00.327216] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-18T22:30:00.519540] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-09-18T22:30:00.988994] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-18T22:30:00.995455] [INFO ] [REMOTE ] VSH: Full fetch complete (71314 records). [2025-09-18T22:30:00.995626] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-09-18T22:30:01.324696] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-09-18T22:30:01.418420] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-09-18T22:30:01.418554] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-09-18T22:30:01.420043] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-09-18T22:30:01.420140] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-09-18T22:30:01.422301] [DEBUG] [LOCAL ] VSH: Trimmed 71314 records to 49135 (keeping 200 days of data) [2025-09-18T22:30:01.768270] [DEBUG] [LOCAL ] VSH: Primary data saved (49135 records). [2025-09-18T22:30:01.768485] [INFO ] [MAIN ] VSH: Full history saved. [2025-09-18T22:30:01.768626] [INFO ] [MAIN ] Update Progress: 2255/2372 symbols completed. VSH took 30.8s. Estimated remaining: 17m 7s. Rate: 6.8 symbols/min [2025-09-18T22:30:02.001892] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:30:02.074804] [DEBUG] [LOCAL ] VTLE: Loaded 48717 existing records from primary storage. [2025-09-18T22:30:02.075063] [INFO ] [MAIN ] VTLE: Loaded 48717 existing records. [2025-09-18T22:30:02.125380] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-09-18T22:30:02.295497] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-18T22:30:02.437142] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:30:02.438247] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-09-18T22:30:02.438329] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-09-18T22:30:02.439673] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-09-18T22:30:02.439756] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-09-18T22:30:02.924841] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-09-18T22:30:02.972773] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:30:03.719592] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-11. [2025-09-18T22:30:04.774776] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (3.45 seconds). [2025-09-18T22:30:04.786002] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-09-18T22:30:05.630055] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-09-18T22:30:05.638695] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-09-18T22:30:05.674132] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (3.55 seconds). [2025-09-18T22:30:06.011109] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-11 (2.29 seconds). [2025-09-18T22:30:06.062582] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-18T22:30:06.119502] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-09-18T22:30:06.924950] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-09-18T22:30:06.938496] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-18T22:30:07.730530] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-09-18T22:30:07.734143] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-18T22:30:08.530836] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-09-18T22:30:08.538868] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-18T22:30:09.319563] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-09-18T22:30:09.806849] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-18T22:30:10.059419] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-18T22:30:10.119538] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-09-18T22:30:10.727625] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-18T22:30:10.919580] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-09-18T22:30:11.724813] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-09-18T22:30:11.749769] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-18T22:30:12.156261] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-18T22:30:12.519556] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-09-18T22:30:13.319559] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-09-18T22:30:13.769954] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T22:30:13.957169] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-18T22:30:14.119598] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-09-18T22:30:14.919573] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-09-18T22:30:15.170159] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-18T22:30:15.719592] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-09-18T22:30:16.149245] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-18T22:30:16.519575] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-09-18T22:30:17.182571] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-18T22:30:17.319566] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-09-18T22:30:17.698241] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-18T22:30:17.727776] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-18T22:30:17.734541] [INFO ] [REMOTE ] VSTS: Full fetch complete (69746 records). [2025-09-18T22:30:17.734723] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-09-18T22:30:18.135208] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-09-18T22:30:18.141067] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-09-18T22:30:18.141882] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-09-18T22:30:18.143393] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-09-18T22:30:18.143595] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-09-18T22:30:18.145810] [DEBUG] [LOCAL ] VSTS: Trimmed 69746 records to 49379 (keeping 200 days of data) [2025-09-18T22:30:18.431708] [DEBUG] [LOCAL ] VSTS: Primary data saved (49379 records). [2025-09-18T22:30:18.431848] [INFO ] [MAIN ] VSTS: Full history saved. [2025-09-18T22:30:18.431949] [INFO ] [MAIN ] Update Progress: 2256/2372 symbols completed. VSTS took 32.7s. Estimated remaining: 16m 59s. Rate: 6.8 symbols/min [2025-09-18T22:30:18.606989] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:30:18.627163] [DEBUG] [LOCAL ] VTMX: Loaded 17367 existing records from primary storage. [2025-09-18T22:30:18.627305] [INFO ] [MAIN ] VTMX: Loaded 17367 existing records. [2025-09-18T22:30:18.805598] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:30:18.805855] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-09-18T22:30:18.805918] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-09-18T22:30:18.806418] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-09-18T22:30:18.806476] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-09-18T22:30:18.921113] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-09-18T22:30:19.175137] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:30:19.200201] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-18T22:30:19.719548] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-11. [2025-09-18T22:30:19.986276] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-18T22:30:20.444749] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-18T22:30:20.519560] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-09-18T22:30:21.183403] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-18T22:30:21.319628] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-09-18T22:30:21.651429] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-18T22:30:22.119596] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-09-18T22:30:22.600461] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-18T22:30:22.606888] [INFO ] [REMOTE ] VTEX: Full fetch complete (60631 records). [2025-09-18T22:30:22.607050] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-09-18T22:30:22.924717] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-09-18T22:30:23.008784] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-09-18T22:30:23.008870] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-09-18T22:30:23.009865] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-09-18T22:30:23.009951] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-09-18T22:30:23.011280] [DEBUG] [LOCAL ] VTEX: Trimmed 60631 records to 43859 (keeping 200 days of data) [2025-09-18T22:30:23.259151] [DEBUG] [LOCAL ] VTEX: Primary data saved (43859 records). [2025-09-18T22:30:23.259304] [INFO ] [MAIN ] VTEX: Full history saved. [2025-09-18T22:30:23.259527] [INFO ] [MAIN ] Update Progress: 2257/2372 symbols completed. VTEX took 27.7s. Estimated remaining: 16m 50s. Rate: 6.8 symbols/min [2025-09-18T22:30:23.450669] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:30:23.487544] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-18T22:30:23.503232] [DEBUG] [LOCAL ] VTN: Loaded 7183 existing records from primary storage. [2025-09-18T22:30:23.503784] [INFO ] [MAIN ] VTN: Loaded 7183 existing records. [2025-09-18T22:30:23.503557] [INFO ] [REMOTE ] VST: Full fetch complete (77730 records). [2025-09-18T22:30:23.525027] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-09-18T22:30:23.738176] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-09-18T22:30:23.752367] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-18T22:30:23.940694] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:30:23.953537] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-09-18T22:30:23.972037] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-09-18T22:30:23.980250] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-09-18T22:30:23.980383] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-09-18T22:30:24.451818] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-09-18T22:30:24.470751] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-09-18T22:30:24.482391] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-09-18T22:30:24.498937] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-09-18T22:30:24.522309] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-09-18T22:30:24.595540] [DEBUG] [LOCAL ] VST: Trimmed 77730 records to 54110 (keeping 200 days of data) [2025-09-18T22:30:24.620022] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:30:24.854141] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-18T22:30:24.994535] [DEBUG] [LOCAL ] VST: Primary data saved (54110 records). [2025-09-18T22:30:24.994763] [INFO ] [MAIN ] VST: Full history saved. [2025-09-18T22:30:24.994867] [INFO ] [MAIN ] Update Progress: 2258/2372 symbols completed. VST took 46.9s. Estimated remaining: 16m 41s. Rate: 6.8 symbols/min [2025-09-18T22:30:25.176278] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:30:25.198959] [DEBUG] [LOCAL ] VTOL: Loaded 19850 existing records from primary storage. [2025-09-18T22:30:25.199115] [INFO ] [MAIN ] VTOL: Loaded 19850 existing records. [2025-09-18T22:30:25.324715] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-09-18T22:30:25.400244] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:30:25.400530] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-09-18T22:30:25.400588] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-09-18T22:30:25.401257] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-09-18T22:30:25.401319] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-09-18T22:30:25.755821] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:30:26.117694] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-18T22:30:26.126865] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-11. [2025-09-18T22:30:26.171064] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-18T22:30:26.919573] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-09-18T22:30:27.164522] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-18T22:30:27.719533] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-11. [2025-09-18T22:30:27.743459] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-18T22:30:28.483769] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-18T22:30:28.519492] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-09-18T22:30:29.252912] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-18T22:30:29.319588] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-09-18T22:30:30.119581] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-09-18T22:30:30.155935] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T22:30:30.728465] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-18T22:30:30.919540] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-09-18T22:30:31.719565] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-09-18T22:30:31.740275] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-18T22:30:32.319119] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-18T22:30:32.519576] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-09-18T22:30:33.319580] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-09-18T22:30:34.062355] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-18T22:30:34.119584] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-09-18T22:30:34.324168] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-18T22:30:34.883592] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-18T22:30:34.919514] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-09-18T22:30:35.719578] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-09-18T22:30:35.993432] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-18T22:30:36.519590] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-09-18T22:30:37.286787] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-18T22:30:37.319558] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-09-18T22:30:37.413961] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-18T22:30:38.119593] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-09-18T22:30:38.201262] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-18T22:30:38.919553] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-09-18T22:30:39.465264] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-18T22:30:39.474610] [INFO ] [REMOTE ] VTLE: Full fetch complete (68471 records). [2025-09-18T22:30:39.474870] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-09-18T22:30:39.722460] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-09-18T22:30:39.797853] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-18T22:30:39.896973] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-09-18T22:30:39.897063] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-09-18T22:30:39.898090] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-09-18T22:30:39.898171] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-09-18T22:30:39.900086] [DEBUG] [LOCAL ] VTLE: Trimmed 68471 records to 49049 (keeping 200 days of data) [2025-09-18T22:30:40.186282] [DEBUG] [LOCAL ] VTLE: Primary data saved (49049 records). [2025-09-18T22:30:40.186428] [INFO ] [MAIN ] VTLE: Full history saved. [2025-09-18T22:30:40.186545] [INFO ] [MAIN ] Update Progress: 2259/2372 symbols completed. VTLE took 38.4s. Estimated remaining: 16m 32s. Rate: 6.8 symbols/min [2025-09-18T22:30:40.364210] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:30:40.422728] [DEBUG] [LOCAL ] VTR: Loaded 52831 existing records from primary storage. [2025-09-18T22:30:40.422879] [INFO ] [MAIN ] VTR: Loaded 52831 existing records. [2025-09-18T22:30:40.525682] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-09-18T22:30:40.607839] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:30:40.608080] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-09-18T22:30:40.608211] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-09-18T22:30:40.610003] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-09-18T22:30:40.610066] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-09-18T22:30:40.984569] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:30:40.993742] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-18T22:30:41.319606] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-09-18T22:30:41.561313] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-18T22:30:42.035055] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-18T22:30:42.119560] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-09-18T22:30:42.741852] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T22:30:42.744200] [INFO ] [REMOTE ] VTMX: Full fetch complete (26079 records). [2025-09-18T22:30:42.744281] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-09-18T22:30:42.927131] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-09-18T22:30:43.148826] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-09-18T22:30:43.148925] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-09-18T22:30:43.149594] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-09-18T22:30:43.149729] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-09-18T22:30:43.151155] [DEBUG] [LOCAL ] VTMX: Trimmed 26079 records to 17532 (keeping 200 days of data) [2025-09-18T22:30:43.269174] [DEBUG] [LOCAL ] VTMX: Primary data saved (17532 records). [2025-09-18T22:30:43.269328] [INFO ] [MAIN ] VTMX: Full history saved. [2025-09-18T22:30:43.269491] [INFO ] [MAIN ] Update Progress: 2260/2372 symbols completed. VTMX took 24.8s. Estimated remaining: 16m 23s. Rate: 6.8 symbols/min [2025-09-18T22:30:43.461637] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:30:43.497211] [DEBUG] [LOCAL ] VTS: Loaded 30328 existing records from primary storage. [2025-09-18T22:30:43.497365] [INFO ] [MAIN ] VTS: Loaded 30328 existing records. [2025-09-18T22:30:43.683981] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:30:43.684265] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-09-18T22:30:43.684317] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-09-18T22:30:43.690404] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-09-18T22:30:43.690504] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-09-18T22:30:43.724696] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-11. [2025-09-18T22:30:44.060794] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:30:44.121175] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-18T22:30:44.519591] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-11. [2025-09-18T22:30:45.319546] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-09-18T22:30:45.601238] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-18T22:30:45.636487] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T22:30:45.889860] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-18T22:30:46.119543] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-09-18T22:30:46.761743] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-18T22:30:46.919549] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-09-18T22:30:47.609360] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-18T22:30:47.719541] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-09-18T22:30:48.299002] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-18T22:30:48.519557] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-09-18T22:30:49.319513] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-09-18T22:30:49.650126] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-18T22:30:49.936927] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T22:30:49.939189] [INFO ] [REMOTE ] VTN: Full fetch complete (11492 records). [2025-09-18T22:30:49.939288] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-09-18T22:30:50.124620] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-09-18T22:30:50.327199] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-09-18T22:30:50.327280] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-09-18T22:30:50.327573] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-09-18T22:30:50.327614] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-09-18T22:30:50.328118] [DEBUG] [LOCAL ] VTN: Trimmed 11492 records to 7219 (keeping 200 days of data) [2025-09-18T22:30:50.379383] [DEBUG] [LOCAL ] VTN: Primary data saved (7219 records). [2025-09-18T22:30:50.379526] [INFO ] [MAIN ] VTN: Full history saved. [2025-09-18T22:30:50.379673] [INFO ] [MAIN ] Update Progress: 2261/2372 symbols completed. VTN took 27.1s. Estimated remaining: 16m 14s. Rate: 6.8 symbols/min [2025-09-18T22:30:50.572831] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:30:50.627768] [DEBUG] [LOCAL ] VVR: Loaded 30214 existing records from primary storage. [2025-09-18T22:30:50.627935] [INFO ] [MAIN ] VVR: Loaded 30214 existing records. [2025-09-18T22:30:50.817565] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:30:50.817942] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-09-18T22:30:50.818028] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-09-18T22:30:50.818761] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-09-18T22:30:50.818821] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-09-18T22:30:50.924729] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-09-18T22:30:51.209029] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:30:51.719560] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-11. [2025-09-18T22:30:51.931171] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-18T22:30:52.059243] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-18T22:30:52.519549] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-09-18T22:30:52.770317] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-18T22:30:53.178482] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-18T22:30:53.319558] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-09-18T22:30:54.119557] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-09-18T22:30:54.709639] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-18T22:30:54.919550] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-09-18T22:30:55.719538] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-09-18T22:30:55.809820] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-18T22:30:56.319228] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-18T22:30:56.510354] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-18T22:30:56.519539] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-09-18T22:30:57.319547] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-09-18T22:30:57.808548] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-18T22:30:58.119550] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-09-18T22:30:58.310084] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-18T22:30:58.919555] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-09-18T22:30:59.638941] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-18T22:30:59.719498] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-09-18T22:31:00.057612] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-18T22:31:00.519565] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-09-18T22:31:01.319552] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-09-18T22:31:01.616533] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-18T22:31:01.767455] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-18T22:31:02.028595] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-18T22:31:02.119547] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-09-18T22:31:02.919549] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-09-18T22:31:02.995978] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-18T22:31:03.719587] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-09-18T22:31:04.028017] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-18T22:31:04.519551] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-09-18T22:31:04.780035] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-18T22:31:05.319578] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-09-18T22:31:05.559123] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-18T22:31:06.119560] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-09-18T22:31:06.414320] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-18T22:31:06.919585] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-09-18T22:31:07.700510] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T22:31:07.719496] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-09-18T22:31:07.848580] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-18T22:31:08.519553] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-09-18T22:31:09.278952] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-18T22:31:09.283844] [INFO ] [REMOTE ] VTOL: Full fetch complete (26111 records). [2025-09-18T22:31:09.283996] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-09-18T22:31:09.324712] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-09-18T22:31:09.681975] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-09-18T22:31:09.682237] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-09-18T22:31:09.682862] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-09-18T22:31:09.682936] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-09-18T22:31:09.683933] [DEBUG] [LOCAL ] VTOL: Trimmed 26111 records to 20021 (keeping 200 days of data) [2025-09-18T22:31:09.863461] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-18T22:31:09.908099] [DEBUG] [LOCAL ] VTOL: Primary data saved (20021 records). [2025-09-18T22:31:09.908237] [INFO ] [MAIN ] VTOL: Full history saved. [2025-09-18T22:31:09.908322] [INFO ] [MAIN ] Update Progress: 2262/2372 symbols completed. VTOL took 44.9s. Estimated remaining: 16m 6s. Rate: 6.8 symbols/min [2025-09-18T22:31:10.104022] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:31:10.119555] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-09-18T22:31:10.161009] [DEBUG] [LOCAL ] VVV: Loaded 50149 existing records from primary storage. [2025-09-18T22:31:10.161156] [INFO ] [MAIN ] VVV: Loaded 50149 existing records. [2025-09-18T22:31:10.354333] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:31:10.354615] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-09-18T22:31:10.354720] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-09-18T22:31:10.355905] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-09-18T22:31:10.355965] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-09-18T22:31:10.636773] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-18T22:31:10.674378] [INFO ] [REMOTE ] VTS: Full fetch complete (40365 records). [2025-09-18T22:31:10.684939] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-09-18T22:31:10.851302] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:31:10.922491] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-11. [2025-09-18T22:31:11.183488] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-09-18T22:31:11.183584] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-09-18T22:31:11.184541] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-09-18T22:31:11.184608] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-09-18T22:31:11.185848] [DEBUG] [LOCAL ] VTS: Trimmed 40365 records to 30584 (keeping 200 days of data) [2025-09-18T22:31:11.390240] [DEBUG] [LOCAL ] VTS: Primary data saved (30584 records). [2025-09-18T22:31:11.390395] [INFO ] [MAIN ] VTS: Full history saved. [2025-09-18T22:31:11.390500] [INFO ] [MAIN ] Update Progress: 2263/2372 symbols completed. VTS took 28.1s. Estimated remaining: 15m 57s. Rate: 6.8 symbols/min [2025-09-18T22:31:11.574937] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:31:11.598707] [DEBUG] [LOCAL ] VVX: Loaded 23315 existing records from primary storage. [2025-09-18T22:31:11.598852] [INFO ] [MAIN ] VVX: Loaded 23315 existing records. [2025-09-18T22:31:11.725373] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-09-18T22:31:11.789733] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:31:11.790118] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-09-18T22:31:11.790339] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-09-18T22:31:11.799825] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-09-18T22:31:11.810440] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-09-18T22:31:11.892208] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-18T22:31:12.181616] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:31:12.431569] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-18T22:31:12.519546] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-11. [2025-09-18T22:31:13.319593] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-09-18T22:31:13.506447] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-18T22:31:13.718027] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-18T22:31:14.119599] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-09-18T22:31:14.743909] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-18T22:31:14.919562] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-09-18T22:31:15.235782] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-18T22:31:15.719553] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-09-18T22:31:15.776319] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-18T22:31:16.519604] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-09-18T22:31:17.319638] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-09-18T22:31:17.595725] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-18T22:31:17.652206] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-18T22:31:18.119566] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-09-18T22:31:18.683191] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-18T22:31:18.919582] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-09-18T22:31:19.240246] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-18T22:31:19.719541] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-09-18T22:31:20.168516] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-18T22:31:20.519548] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-09-18T22:31:21.073719] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-18T22:31:21.324532] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-09-18T22:31:21.326543] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-18T22:31:22.119563] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-09-18T22:31:22.919567] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-09-18T22:31:23.044031] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-18T22:31:23.488184] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-18T22:31:23.719539] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-09-18T22:31:23.837094] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-18T22:31:23.842869] [INFO ] [REMOTE ] VVR: Full fetch complete (45655 records). [2025-09-18T22:31:23.843050] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-09-18T22:31:24.283557] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-09-18T22:31:24.283722] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-09-18T22:31:24.285296] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-09-18T22:31:24.285449] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-09-18T22:31:24.287050] [DEBUG] [LOCAL ] VVR: Trimmed 45655 records to 30479 (keeping 200 days of data) [2025-09-18T22:31:24.312374] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-18T22:31:24.376053] [INFO ] [REMOTE ] VTR: Full fetch complete (76155 records). [2025-09-18T22:31:24.405980] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-09-18T22:31:24.520685] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-09-18T22:31:24.990721] [DEBUG] [LOCAL ] VVR: Primary data saved (30479 records). [2025-09-18T22:31:25.006061] [INFO ] [MAIN ] VVR: Full history saved. [2025-09-18T22:31:25.009819] [INFO ] [MAIN ] Update Progress: 2264/2372 symbols completed. VVR took 34.6s. Estimated remaining: 15m 48s. Rate: 6.8 symbols/min [2025-09-18T22:31:25.009910] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-09-18T22:31:25.009989] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-09-18T22:31:25.022723] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-09-18T22:31:25.043063] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-09-18T22:31:25.119981] [DEBUG] [LOCAL ] VTR: Trimmed 76155 records to 53219 (keeping 200 days of data) [2025-09-18T22:31:25.238608] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:31:25.319721] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-09-18T22:31:25.402014] [DEBUG] [LOCAL ] VYX: Loaded 49231 existing records from primary storage. [2025-09-18T22:31:25.430716] [INFO ] [MAIN ] VYX: Loaded 49231 existing records. [2025-09-18T22:31:25.662166] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:31:25.664094] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-09-18T22:31:25.665022] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-09-18T22:31:25.666372] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-09-18T22:31:25.667240] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-09-18T22:31:26.113598] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:31:26.133434] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-11. [2025-09-18T22:31:26.160920] [DEBUG] [LOCAL ] VTR: Primary data saved (53219 records). [2025-09-18T22:31:26.161108] [INFO ] [MAIN ] VTR: Full history saved. [2025-09-18T22:31:26.161424] [INFO ] [MAIN ] Update Progress: 2265/2372 symbols completed. VTR took 46.0s. Estimated remaining: 15m 39s. Rate: 6.8 symbols/min [2025-09-18T22:31:26.377390] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:31:26.378681] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-18T22:31:26.385622] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-18T22:31:26.446467] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-09-18T22:31:26.446635] [INFO ] [MAIN ] VZ: Loaded 53791 existing records. [2025-09-18T22:31:26.622858] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:31:26.623087] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-09-18T22:31:26.623135] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-09-18T22:31:26.624661] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-09-18T22:31:26.624773] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-09-18T22:31:26.924743] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-09-18T22:31:26.982888] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:31:27.698977] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-18T22:31:27.719487] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-09-18T22:31:27.762261] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-18T22:31:28.519549] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-11. [2025-09-18T22:31:29.319552] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-09-18T22:31:29.402319] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-18T22:31:30.119788] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-18T22:31:30.119917] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-09-18T22:31:30.558608] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-11 (2.04 seconds). [2025-09-18T22:31:30.919565] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-09-18T22:31:31.533227] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-18T22:31:31.719548] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-09-18T22:31:32.519550] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-09-18T22:31:33.070887] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-18T22:31:33.330442] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-09-18T22:31:33.336012] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-18T22:31:33.799741] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-18T22:31:34.119553] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-09-18T22:31:34.919523] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-09-18T22:31:35.320770] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-18T22:31:35.497376] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-18T22:31:35.719561] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-09-18T22:31:36.285916] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-18T22:31:36.519588] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-09-18T22:31:36.583428] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-18T22:31:37.319576] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-09-18T22:31:38.119580] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-09-18T22:31:38.185604] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-18T22:31:38.888840] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T22:31:38.919531] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-09-18T22:31:39.203066] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-18T22:31:39.719544] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-09-18T22:31:40.519521] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-09-18T22:31:40.555297] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-18T22:31:41.088979] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-18T22:31:41.319549] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-09-18T22:31:42.119568] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-09-18T22:31:42.515079] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-18T22:31:42.850235] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-18T22:31:42.919495] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-09-18T22:31:43.495282] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-18T22:31:43.719557] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-09-18T22:31:44.519554] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-09-18T22:31:44.902799] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-18T22:31:44.978154] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-18T22:31:45.319525] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-09-18T22:31:45.706976] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-18T22:31:45.711236] [INFO ] [REMOTE ] VVX: Full fetch complete (33315 records). [2025-09-18T22:31:45.711329] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-09-18T22:31:46.089263] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-09-18T22:31:46.089353] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-09-18T22:31:46.090038] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-09-18T22:31:46.090101] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-09-18T22:31:46.091074] [DEBUG] [LOCAL ] VVX: Trimmed 33315 records to 23575 (keeping 200 days of data) [2025-09-18T22:31:46.139183] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-09-18T22:31:46.233831] [DEBUG] [LOCAL ] VVX: Primary data saved (23575 records). [2025-09-18T22:31:46.233981] [INFO ] [MAIN ] VVX: Full history saved. [2025-09-18T22:31:46.234072] [INFO ] [MAIN ] Update Progress: 2266/2372 symbols completed. VVX took 34.8s. Estimated remaining: 15m 31s. Rate: 6.8 symbols/min [2025-09-18T22:31:46.404116] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:31:46.456106] [DEBUG] [LOCAL ] W: Loaded 53511 existing records from primary storage. [2025-09-18T22:31:46.456257] [INFO ] [MAIN ] W: Loaded 53511 existing records. [2025-09-18T22:31:46.633744] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:31:46.633994] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-09-18T22:31:46.634042] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-09-18T22:31:46.635109] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-09-18T22:31:46.635172] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-09-18T22:31:46.924881] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-09-18T22:31:46.994634] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:31:47.728635] [INFO ] [REMOTE ] W: Fetching primary data for 2024-11. [2025-09-18T22:31:47.734986] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-18T22:31:47.817403] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-18T22:31:48.319020] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-18T22:31:48.327399] [INFO ] [REMOTE ] VVV: Full fetch complete (72093 records). [2025-09-18T22:31:48.327717] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-09-18T22:31:48.526734] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-09-18T22:31:48.738120] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-09-18T22:31:48.738236] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-09-18T22:31:48.739374] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-09-18T22:31:48.739441] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-09-18T22:31:48.742609] [DEBUG] [LOCAL ] VVV: Trimmed 72093 records to 50526 (keeping 200 days of data) [2025-09-18T22:31:49.038100] [DEBUG] [LOCAL ] VVV: Primary data saved (50526 records). [2025-09-18T22:31:49.038250] [INFO ] [MAIN ] VVV: Full history saved. [2025-09-18T22:31:49.038336] [INFO ] [MAIN ] Update Progress: 2267/2372 symbols completed. VVV took 39.1s. Estimated remaining: 15m 22s. Rate: 6.8 symbols/min [2025-09-18T22:31:49.207807] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:31:49.253924] [DEBUG] [LOCAL ] WAB: Loaded 44409 existing records from primary storage. [2025-09-18T22:31:49.254074] [INFO ] [MAIN ] WAB: Loaded 44409 existing records. [2025-09-18T22:31:49.329770] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-09-18T22:31:49.440523] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:31:49.441054] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-09-18T22:31:49.441191] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-09-18T22:31:49.442469] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-09-18T22:31:49.442533] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-09-18T22:31:49.803282] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-11 (2.07 seconds). [2025-09-18T22:31:49.866557] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:31:50.119554] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-09-18T22:31:50.606583] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-18T22:31:50.919547] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-09-18T22:31:51.128984] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-18T22:31:51.604580] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-18T22:31:51.719506] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-09-18T22:31:52.519557] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-11. [2025-09-18T22:31:53.076160] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-18T22:31:53.156548] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-18T22:31:53.319533] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-09-18T22:31:53.960567] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-18T22:31:54.119545] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-09-18T22:31:54.919591] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-09-18T22:31:54.957872] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-18T22:31:55.719560] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-09-18T22:31:56.361094] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-18T22:31:56.407444] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-18T22:31:56.416889] [INFO ] [REMOTE ] VYX: Full fetch complete (70121 records). [2025-09-18T22:31:56.417031] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-09-18T22:31:56.523368] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-09-18T22:31:56.839806] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-09-18T22:31:56.839909] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-09-18T22:31:56.840981] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-09-18T22:31:56.841051] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-09-18T22:31:56.842602] [DEBUG] [LOCAL ] VYX: Trimmed 70121 records to 49577 (keeping 200 days of data) [2025-09-18T22:31:57.147735] [DEBUG] [LOCAL ] VYX: Primary data saved (49577 records). [2025-09-18T22:31:57.147918] [INFO ] [MAIN ] VYX: Full history saved. [2025-09-18T22:31:57.148016] [INFO ] [MAIN ] Update Progress: 2268/2372 symbols completed. VYX took 32.1s. Estimated remaining: 15m 13s. Rate: 6.8 symbols/min [2025-09-18T22:31:57.328457] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:31:57.324827] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-09-18T22:31:57.372573] [DEBUG] [LOCAL ] WAL: Loaded 45527 existing records from primary storage. [2025-09-18T22:31:57.372761] [INFO ] [MAIN ] WAL: Loaded 45527 existing records. [2025-09-18T22:31:57.548465] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-18T22:31:57.602396] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:31:57.602732] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-09-18T22:31:57.602790] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-09-18T22:31:57.603920] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-09-18T22:31:57.603979] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-09-18T22:31:57.961500] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:31:58.119546] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-11. [2025-09-18T22:31:58.488108] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-18T22:31:58.685856] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T22:31:58.919593] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-09-18T22:31:59.724714] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-09-18T22:31:59.737685] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-18T22:31:59.906699] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-18T22:31:59.914069] [INFO ] [REMOTE ] VZ: Full fetch complete (77905 records). [2025-09-18T22:31:59.914199] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-09-18T22:32:00.311748] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-09-18T22:32:00.311854] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-09-18T22:32:00.313108] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-09-18T22:32:00.313196] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-09-18T22:32:00.315069] [DEBUG] [LOCAL ] VZ: Trimmed 77905 records to 54181 (keeping 200 days of data) [2025-09-18T22:32:00.541493] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-09-18T22:32:00.666154] [DEBUG] [LOCAL ] VZ: Primary data saved (54181 records). [2025-09-18T22:32:00.666305] [INFO ] [MAIN ] VZ: Full history saved. [2025-09-18T22:32:00.666420] [INFO ] [MAIN ] Update Progress: 2269/2372 symbols completed. VZ took 34.5s. Estimated remaining: 15m 4s. Rate: 6.8 symbols/min [2025-09-18T22:32:00.839680] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:32:00.875168] [DEBUG] [LOCAL ] WAT: Loaded 35144 existing records from primary storage. [2025-09-18T22:32:00.875506] [INFO ] [MAIN ] WAT: Loaded 35144 existing records. [2025-09-18T22:32:01.056268] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:32:01.056537] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-09-18T22:32:01.056585] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-09-18T22:32:01.057403] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-09-18T22:32:01.057465] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-09-18T22:32:01.324730] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-09-18T22:32:01.431500] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:32:01.670303] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-18T22:32:02.035347] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T22:32:02.119540] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-09-18T22:32:02.919573] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-11. [2025-09-18T22:32:03.142911] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-18T22:32:03.653347] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-18T22:32:03.719514] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-09-18T22:32:04.116509] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-18T22:32:04.519557] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-09-18T22:32:05.319527] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-09-18T22:32:05.405939] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-18T22:32:06.119586] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-09-18T22:32:06.395689] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-18T22:32:06.714821] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-18T22:32:06.919631] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-09-18T22:32:07.637769] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T22:32:07.719549] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-09-18T22:32:08.405788] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T22:32:08.519560] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-09-18T22:32:09.018608] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-18T22:32:09.319572] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-09-18T22:32:09.811318] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-18T22:32:10.119580] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-09-18T22:32:10.638043] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-18T22:32:10.919597] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-09-18T22:32:11.248387] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-18T22:32:11.719557] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-09-18T22:32:12.383556] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T22:32:12.519545] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-09-18T22:32:13.319591] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-09-18T22:32:13.618209] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-18T22:32:14.132273] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-09-18T22:32:14.156477] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-18T22:32:14.851562] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T22:32:14.919572] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-09-18T22:32:15.446113] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-18T22:32:15.719572] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-09-18T22:32:16.517258] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-18T22:32:16.526303] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-09-18T22:32:17.319570] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-09-18T22:32:17.608363] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-18T22:32:17.931906] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-18T22:32:17.979775] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-18T22:32:17.986048] [INFO ] [REMOTE ] WAB: Full fetch complete (64318 records). [2025-09-18T22:32:17.986165] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-09-18T22:32:18.125227] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-09-18T22:32:18.417437] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-09-18T22:32:18.417545] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-09-18T22:32:18.418548] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-09-18T22:32:18.418614] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-09-18T22:32:18.419934] [DEBUG] [LOCAL ] WAB: Trimmed 64318 records to 44728 (keeping 200 days of data) [2025-09-18T22:32:18.706328] [DEBUG] [LOCAL ] WAB: Primary data saved (44728 records). [2025-09-18T22:32:18.706508] [INFO ] [MAIN ] WAB: Full history saved. [2025-09-18T22:32:18.706612] [INFO ] [MAIN ] Update Progress: 2270/2372 symbols completed. WAB took 29.7s. Estimated remaining: 14m 56s. Rate: 6.8 symbols/min [2025-09-18T22:32:18.879322] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:32:18.879539] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-09-18T22:32:18.879594] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-09-18T22:32:18.879764] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-09-18T22:32:18.879809] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-18T22:32:18.879851] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-18T22:32:18.879883] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-09-18T22:32:18.924799] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-09-18T22:32:19.242965] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:32:19.699926] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T22:32:19.719514] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-09-18T22:32:20.306938] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-18T22:32:20.315515] [INFO ] [REMOTE ] W: Full fetch complete (77295 records). [2025-09-18T22:32:20.315744] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-09-18T22:32:20.533496] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-09-18T22:32:20.734993] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-09-18T22:32:20.735078] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-09-18T22:32:20.736164] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-09-18T22:32:20.736228] [DEBUG] [LOCAL ] W: Saving primary data. [2025-09-18T22:32:20.737874] [DEBUG] [LOCAL ] W: Trimmed 77295 records to 53901 (keeping 200 days of data) [2025-09-18T22:32:21.076180] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-18T22:32:21.092476] [DEBUG] [LOCAL ] W: Primary data saved (53901 records). [2025-09-18T22:32:21.092674] [INFO ] [MAIN ] W: Full history saved. [2025-09-18T22:32:21.092790] [INFO ] [MAIN ] Update Progress: 2271/2372 symbols completed. W took 34.9s. Estimated remaining: 14m 47s. Rate: 6.8 symbols/min [2025-09-18T22:32:21.264891] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:32:21.313861] [DEBUG] [LOCAL ] WBS: Loaded 48893 existing records from primary storage. [2025-09-18T22:32:21.314015] [INFO ] [MAIN ] WBS: Loaded 48893 existing records. [2025-09-18T22:32:21.326629] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-11. [2025-09-18T22:32:21.507094] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:32:21.507344] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-09-18T22:32:21.507394] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-09-18T22:32:21.508636] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-09-18T22:32:21.508730] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-09-18T22:32:21.670820] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:32:21.689088] [WARN ] [REMOTE ] WBI: No data returned for month 2024-11 [2025-09-18T22:32:21.871147] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:32:22.072891] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-18T22:32:22.119557] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-11. [2025-09-18T22:32:22.919562] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-09-18T22:32:23.719623] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-09-18T22:32:23.858108] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-18T22:32:23.911789] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:32:23.912171] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-09-18T22:32:24.079300] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-18T22:32:24.519591] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-01. [2025-09-18T22:32:24.754208] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:32:24.754628] [WARN ] [REMOTE ] WBI: No data returned for month 2025-01 [2025-09-18T22:32:25.319563] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-02. [2025-09-18T22:32:25.522039] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:32:25.522426] [WARN ] [REMOTE ] WBI: No data returned for month 2025-02 [2025-09-18T22:32:26.119546] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-03. [2025-09-18T22:32:26.369977] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:32:26.370320] [WARN ] [REMOTE ] WBI: No data returned for month 2025-03 [2025-09-18T22:32:26.919563] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-09-18T22:32:27.719510] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-09-18T22:32:28.195149] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-18T22:32:28.519564] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-09-18T22:32:29.147426] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-18T22:32:29.319583] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-09-18T22:32:30.119540] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-09-18T22:32:30.170195] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-18T22:32:30.678199] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T22:32:30.919599] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-09-18T22:32:31.253481] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-18T22:32:31.352132] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-18T22:32:31.719594] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-04. [2025-09-18T22:32:31.981525] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:32:31.981975] [WARN ] [REMOTE ] WBI: No data returned for month 2025-04 [2025-09-18T22:32:32.519550] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-09-18T22:32:33.319546] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-05. [2025-09-18T22:32:33.550591] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:32:33.550967] [WARN ] [REMOTE ] WBI: No data returned for month 2025-05 [2025-09-18T22:32:34.119520] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-06. [2025-09-18T22:32:34.195590] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-18T22:32:34.356924] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:32:34.357265] [WARN ] [REMOTE ] WBI: No data returned for month 2025-06 [2025-09-18T22:32:34.919560] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-07. [2025-09-18T22:32:35.124977] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:32:35.125321] [WARN ] [REMOTE ] WBI: No data returned for month 2025-07 [2025-09-18T22:32:35.719567] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-08. [2025-09-18T22:32:35.921107] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:32:35.921470] [WARN ] [REMOTE ] WBI: No data returned for month 2025-08 [2025-09-18T22:32:36.519556] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-09-18T22:32:37.111550] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-18T22:32:37.116974] [INFO ] [REMOTE ] WAT: Full fetch complete (49712 records). [2025-09-18T22:32:37.117114] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-09-18T22:32:37.324823] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-09-18T22:32:37.511418] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-09-18T22:32:37.511507] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-09-18T22:32:37.512402] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-09-18T22:32:37.512465] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-09-18T22:32:37.513519] [DEBUG] [LOCAL ] WAT: Trimmed 49712 records to 35393 (keeping 200 days of data) [2025-09-18T22:32:37.728024] [DEBUG] [LOCAL ] WAT: Primary data saved (35393 records). [2025-09-18T22:32:37.728171] [INFO ] [MAIN ] WAT: Full history saved. [2025-09-18T22:32:37.728257] [INFO ] [MAIN ] Update Progress: 2272/2372 symbols completed. WAT took 37.1s. Estimated remaining: 14m 38s. Rate: 6.8 symbols/min [2025-09-18T22:32:37.898368] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:32:37.912230] [DEBUG] [LOCAL ] WBX: Loaded 13440 existing records from primary storage. [2025-09-18T22:32:37.912417] [INFO ] [MAIN ] WBX: Loaded 13440 existing records. [2025-09-18T22:32:38.089303] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:32:38.089578] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-09-18T22:32:38.089626] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-09-18T22:32:38.090067] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-09-18T22:32:38.090128] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-09-18T22:32:38.124764] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-09-18T22:32:38.448280] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:32:38.920886] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-11. [2025-09-18T22:32:38.923806] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-18T22:32:39.719546] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-09-18T22:32:39.877020] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-18T22:32:40.038433] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T22:32:40.519589] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-09. [2025-09-18T22:32:40.956966] [INFO ] [REMOTE ] WBI: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-18T22:32:40.958787] [INFO ] [REMOTE ] WBI: Full fetch complete (561 records). [2025-09-18T22:32:40.958921] [DEBUG] [VALIDATOR ] WBI: Validating primary data. [2025-09-18T22:32:41.169548] [WARN ] [VALIDATOR ] WBI: Validation failed - insufficient historical data. Have 2 unique days, need 200 days [2025-09-18T22:32:41.169933] [FATAL] [MAIN ] WBI: Fetched primary data is invalid. Refusing to save it. [2025-09-18T22:32:41.170052] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to validation failure. [2025-09-18T22:32:41.170265] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-18T22:32:41.170434] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-18T22:32:41.170553] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-09-18T22:32:41.170718] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-09-18T22:32:41.170830] [INFO ] [MAIN ] Update Progress: 2273/2372 symbols completed. WBI took 22.5s. Estimated remaining: 14m 29s. Rate: 6.8 symbols/min [2025-09-18T22:32:41.327093] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-09-18T22:32:41.347241] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:32:41.381292] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T22:32:41.427461] [DEBUG] [LOCAL ] WCC: Loaded 40333 existing records from primary storage. [2025-09-18T22:32:41.427613] [INFO ] [MAIN ] WCC: Loaded 40333 existing records. [2025-09-18T22:32:41.602945] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:32:41.603192] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-09-18T22:32:41.603241] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-09-18T22:32:41.604207] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-09-18T22:32:41.604267] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-09-18T22:32:41.967971] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:32:42.119551] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-11. [2025-09-18T22:32:42.685967] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-18T22:32:42.919545] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-09-18T22:32:43.719592] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-09-18T22:32:43.752328] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-18T22:32:44.151797] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-18T22:32:44.158578] [INFO ] [REMOTE ] WAL: Full fetch complete (66184 records). [2025-09-18T22:32:44.158761] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-09-18T22:32:44.524778] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-09-18T22:32:44.612593] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-09-18T22:32:44.612736] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-09-18T22:32:44.613987] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-09-18T22:32:44.614059] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-09-18T22:32:44.616315] [DEBUG] [LOCAL ] WAL: Trimmed 66184 records to 45891 (keeping 200 days of data) [2025-09-18T22:32:44.913897] [DEBUG] [LOCAL ] WAL: Primary data saved (45891 records). [2025-09-18T22:32:44.914060] [INFO ] [MAIN ] WAL: Full history saved. [2025-09-18T22:32:44.914157] [INFO ] [MAIN ] Update Progress: 2274/2372 symbols completed. WAL took 47.8s. Estimated remaining: 14m 20s. Rate: 6.8 symbols/min [2025-09-18T22:32:45.100196] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:32:45.163835] [DEBUG] [LOCAL ] WCN: Loaded 48091 existing records from primary storage. [2025-09-18T22:32:45.164010] [INFO ] [MAIN ] WCN: Loaded 48091 existing records. [2025-09-18T22:32:45.322042] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-09-18T22:32:45.368585] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:32:45.369005] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-09-18T22:32:45.369145] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-09-18T22:32:45.370487] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-09-18T22:32:45.370551] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-09-18T22:32:45.585432] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-18T22:32:45.810233] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:32:45.836327] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-18T22:32:46.119583] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-11. [2025-09-18T22:32:46.654900] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T22:32:46.919588] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-09-18T22:32:47.428272] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-18T22:32:47.719574] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-09-18T22:32:47.907465] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-18T22:32:48.519548] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-09-18T22:32:49.183381] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-18T22:32:49.319554] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-09-18T22:32:49.527574] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T22:32:50.119622] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-09-18T22:32:50.726463] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-18T22:32:50.919553] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-09-18T22:32:51.372267] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-18T22:32:51.719560] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-09-18T22:32:51.808055] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-18T22:32:52.519543] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-09-18T22:32:53.070583] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-18T22:32:53.319549] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-09-18T22:32:54.119550] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-09-18T22:32:54.299816] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-18T22:32:54.604412] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-18T22:32:54.919544] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-09-18T22:32:54.953379] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-18T22:32:55.719581] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-09-18T22:32:56.317234] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-18T22:32:56.519597] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-09-18T22:32:56.822808] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-18T22:32:57.319612] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-09-18T22:32:58.031827] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-18T22:32:58.119552] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-09-18T22:32:58.787379] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-18T22:32:58.919621] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-09-18T22:32:59.584285] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T22:32:59.719589] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-09-18T22:33:00.097675] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-18T22:33:00.106589] [INFO ] [REMOTE ] WBS: Full fetch complete (69187 records). [2025-09-18T22:33:00.106912] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-09-18T22:33:00.528677] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-09-18T22:33:00.700531] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-09-18T22:33:00.701371] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-09-18T22:33:00.704344] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-09-18T22:33:00.702345] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-18T22:33:00.708733] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-09-18T22:33:00.715774] [DEBUG] [LOCAL ] WBS: Trimmed 69187 records to 49249 (keeping 200 days of data) [2025-09-18T22:33:01.055497] [DEBUG] [LOCAL ] WBS: Primary data saved (49249 records). [2025-09-18T22:33:01.055675] [INFO ] [MAIN ] WBS: Full history saved. [2025-09-18T22:33:01.055840] [INFO ] [MAIN ] Update Progress: 2275/2372 symbols completed. WBS took 40.0s. Estimated remaining: 14m 12s. Rate: 6.8 symbols/min [2025-09-18T22:33:01.224806] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:33:01.248843] [DEBUG] [LOCAL ] WD: Loaded 23480 existing records from primary storage. [2025-09-18T22:33:01.248994] [INFO ] [MAIN ] WD: Loaded 23480 existing records. [2025-09-18T22:33:01.324810] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-09-18T22:33:01.427936] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:33:01.428202] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-09-18T22:33:01.428272] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-09-18T22:33:01.428961] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-09-18T22:33:01.429023] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-09-18T22:33:01.797613] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:33:02.119541] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-09-18T22:33:02.812608] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-18T22:33:02.919594] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-11. [2025-09-18T22:33:03.719557] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-09-18T22:33:04.117984] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-18T22:33:04.519567] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-09-18T22:33:04.554216] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-18T22:33:04.709328] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (3.38 seconds). [2025-09-18T22:33:05.236268] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-18T22:33:05.319585] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-09-18T22:33:05.644434] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-18T22:33:06.119573] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-09-18T22:33:06.838041] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-18T22:33:06.919514] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-09-18T22:33:07.273211] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-18T22:33:07.279521] [INFO ] [REMOTE ] WCC: Full fetch complete (57549 records). [2025-09-18T22:33:07.279773] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-09-18T22:33:07.670516] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-09-18T22:33:07.670692] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-09-18T22:33:07.671710] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-09-18T22:33:07.671775] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-09-18T22:33:07.673035] [DEBUG] [LOCAL ] WCC: Trimmed 57549 records to 40584 (keeping 200 days of data) [2025-09-18T22:33:07.745853] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-09-18T22:33:07.950955] [DEBUG] [LOCAL ] WCC: Primary data saved (40584 records). [2025-09-18T22:33:07.951094] [INFO ] [MAIN ] WCC: Full history saved. [2025-09-18T22:33:07.951217] [INFO ] [MAIN ] Update Progress: 2276/2372 symbols completed. WCC took 26.8s. Estimated remaining: 14m 3s. Rate: 6.8 symbols/min [2025-09-18T22:33:08.136661] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:33:08.155687] [DEBUG] [LOCAL ] WDH: Loaded 16292 existing records from primary storage. [2025-09-18T22:33:08.155832] [INFO ] [MAIN ] WDH: Loaded 16292 existing records. [2025-09-18T22:33:08.340735] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:33:08.341062] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-09-18T22:33:08.341118] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-09-18T22:33:08.341678] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-09-18T22:33:08.341738] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-09-18T22:33:08.453472] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-18T22:33:08.526487] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-09-18T22:33:08.717038] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:33:08.750793] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-18T22:33:09.319563] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-09-18T22:33:09.551979] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-18T22:33:09.678020] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-18T22:33:09.679567] [INFO ] [REMOTE ] WBX: Full fetch complete (26541 records). [2025-09-18T22:33:09.679756] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-09-18T22:33:10.053623] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-09-18T22:33:10.053741] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-09-18T22:33:10.054293] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-09-18T22:33:10.054337] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-09-18T22:33:10.055374] [DEBUG] [LOCAL ] WBX: Trimmed 26541 records to 13459 (keeping 200 days of data) [2025-09-18T22:33:10.121715] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-11. [2025-09-18T22:33:10.146399] [DEBUG] [LOCAL ] WBX: Primary data saved (13459 records). [2025-09-18T22:33:10.146499] [INFO ] [MAIN ] WBX: Full history saved. [2025-09-18T22:33:10.146690] [INFO ] [MAIN ] Update Progress: 2277/2372 symbols completed. WBX took 32.4s. Estimated remaining: 13m 54s. Rate: 6.8 symbols/min [2025-09-18T22:33:10.814267] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-18T22:33:10.919570] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-09-18T22:33:11.719560] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-09-18T22:33:11.972975] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-18T22:33:12.519537] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-09-18T22:33:12.666566] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-18T22:33:13.319580] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-09-18T22:33:13.871743] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-18T22:33:14.119908] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-09-18T22:33:14.125871] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-18T22:33:14.919563] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-09-18T22:33:15.186281] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-18T22:33:15.719544] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-09-18T22:33:16.458428] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-18T22:33:16.519591] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-09-18T22:33:17.130428] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-18T22:33:17.319546] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-09-18T22:33:18.103734] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-18T22:33:18.119483] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-09-18T22:33:18.137041] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-18T22:33:18.919624] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-09-18T22:33:19.498547] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T22:33:19.714174] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-18T22:33:19.719487] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-09-18T22:33:20.519545] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-09-18T22:33:20.615334] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-18T22:33:21.319518] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-09-18T22:33:21.503410] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-18T22:33:22.119633] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-09-18T22:33:22.475230] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-18T22:33:22.919616] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-09-18T22:33:23.219240] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-18T22:33:23.719572] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-09-18T22:33:24.519543] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-09-18T22:33:24.678149] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-18T22:33:24.763330] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-18T22:33:25.172789] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-18T22:33:25.319543] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-09-18T22:33:26.119593] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-09-18T22:33:26.760006] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-18T22:33:26.919601] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-09-18T22:33:27.680592] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-18T22:33:27.719507] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-09-18T22:33:27.738276] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-18T22:33:28.519552] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-09-18T22:33:29.319711] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-09-18T22:33:29.379979] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-18T22:33:29.397279] [INFO ] [REMOTE ] WCN: Full fetch complete (69116 records). [2025-09-18T22:33:29.402813] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-18T22:33:29.402391] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-09-18T22:33:29.423734] [INFO ] [REMOTE ] WDH: Full fetch complete (22067 records). [2025-09-18T22:33:29.451949] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-09-18T22:33:30.196754] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-09-18T22:33:30.208114] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-09-18T22:33:30.210103] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-09-18T22:33:30.210210] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-09-18T22:33:30.220327] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-18T22:33:30.220580] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-09-18T22:33:30.220991] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-09-18T22:33:30.224927] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-09-18T22:33:30.225312] [DEBUG] [LOCAL ] WCN: Trimmed 69116 records to 48451 (keeping 200 days of data) [2025-09-18T22:33:30.225188] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-09-18T22:33:30.227060] [DEBUG] [LOCAL ] WDH: Trimmed 22067 records to 16529 (keeping 200 days of data) [2025-09-18T22:33:30.228900] [INFO ] [REMOTE ] WD: Full fetch complete (32521 records). [2025-09-18T22:33:30.229112] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-09-18T22:33:30.945414] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-09-18T22:33:30.946932] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-09-18T22:33:30.948262] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-09-18T22:33:30.948402] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-09-18T22:33:30.963012] [DEBUG] [LOCAL ] WD: Trimmed 32521 records to 23701 (keeping 200 days of data) [2025-09-18T22:33:31.129968] [DEBUG] [LOCAL ] WDH: Primary data saved (16529 records). [2025-09-18T22:33:31.134111] [INFO ] [MAIN ] WDH: Full history saved. [2025-09-18T22:33:31.135523] [INFO ] [MAIN ] Update Progress: 2278/2372 symbols completed. WDH took 23.2s. Estimated remaining: 13m 46s. Rate: 6.8 symbols/min [2025-09-18T22:33:31.193975] [DEBUG] [LOCAL ] WCN: Primary data saved (48451 records). [2025-09-18T22:33:31.194604] [DEBUG] [LOCAL ] WD: Primary data saved (23701 records). [2025-09-18T22:33:31.194854] [INFO ] [MAIN ] WCN: Full history saved. [2025-09-18T22:33:31.195020] [INFO ] [MAIN ] Update Progress: 2279/2372 symbols completed. WCN took 46.3s. Estimated remaining: 13m 36s. Rate: 6.8 symbols/min [2025-09-18T22:33:31.195079] [INFO ] [MAIN ] WD: Full history saved. [2025-09-18T22:33:31.195343] [INFO ] [MAIN ] Update Progress: 2280/2372 symbols completed. WD took 30.1s. Estimated remaining: 13m 27s. Rate: 6.8 symbols/min [2025-09-18T22:33:31.802762] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:33:31.891033] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:33:31.936034] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:33:31.934267] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:33:31.947531] [DEBUG] [LOCAL ] WEA: Loaded 7497 existing records from primary storage. [2025-09-18T22:33:31.947793] [INFO ] [MAIN ] WEA: Loaded 7497 existing records. [2025-09-18T22:33:32.089915] [DEBUG] [LOCAL ] WDI: Loaded 21348 existing records from primary storage. [2025-09-18T22:33:32.131187] [INFO ] [MAIN ] WDI: Loaded 21348 existing records. [2025-09-18T22:33:32.198357] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:33:32.198811] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-09-18T22:33:32.199404] [DEBUG] [LOCAL ] WDS: Loaded 43801 existing records from primary storage. [2025-09-18T22:33:32.204625] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-09-18T22:33:32.205610] [DEBUG] [LOCAL ] WEAV: Loaded 42014 existing records from primary storage. [2025-09-18T22:33:32.211883] [INFO ] [MAIN ] WEAV: Loaded 42014 existing records. [2025-09-18T22:33:32.211819] [INFO ] [MAIN ] WDS: Loaded 43801 existing records. [2025-09-18T22:33:32.304468] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-09-18T22:33:32.420452] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-09-18T22:33:32.745995] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:33:32.938926] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:33:32.962388] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-09-18T22:33:32.973034] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-09-18T22:33:32.973185] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-09-18T22:33:32.972775] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:33:33.008156] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-09-18T22:33:33.014990] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-09-18T22:33:33.033730] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-09-18T22:33:33.039006] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-09-18T22:33:33.039098] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-09-18T22:33:33.024917] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-09-18T22:33:33.044369] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-09-18T22:33:33.069505] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-09-18T22:33:33.154011] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-09-18T22:33:33.531717] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:33:33.610561] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-11. [2025-09-18T22:33:34.292929] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:33:34.362607] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-11. [2025-09-18T22:33:34.372080] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:33:34.380958] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-11. [2025-09-18T22:33:34.379660] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:33:34.383075] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-11. [2025-09-18T22:33:34.386507] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-18T22:33:34.388722] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-09-18T22:33:34.918836] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-18T22:33:34.920950] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-09-18T22:33:35.243257] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-18T22:33:35.248225] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-09-18T22:33:35.365483] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-18T22:33:35.719629] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-09-18T22:33:35.959023] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-18T22:33:36.050093] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-18T22:33:36.092790] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-18T22:33:36.101511] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-18T22:33:36.519558] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-09-18T22:33:37.013063] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-18T22:33:37.319550] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-09-18T22:33:38.119554] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-09-18T22:33:38.754569] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-18T22:33:38.919545] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-09-18T22:33:39.378584] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-18T22:33:39.719566] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-09-18T22:33:40.123005] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-18T22:33:40.519567] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-09-18T22:33:41.208304] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-18T22:33:41.238391] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T22:33:41.319545] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-09-18T22:33:42.119556] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-09-18T22:33:42.810816] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T22:33:42.919511] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-09-18T22:33:42.964314] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-18T22:33:43.719546] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-09-18T22:33:44.459074] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-18T22:33:44.474661] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-18T22:33:44.519503] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-09-18T22:33:45.319542] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-09-18T22:33:45.935881] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T22:33:46.119629] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-09-18T22:33:46.420043] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-18T22:33:46.850274] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-18T22:33:46.919542] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-09-18T22:33:47.719542] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-09-18T22:33:47.995229] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-18T22:33:48.519550] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-09-18T22:33:49.058203] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-18T22:33:49.074113] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-18T22:33:49.319566] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-09-18T22:33:50.119527] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-09-18T22:33:50.287751] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-18T22:33:50.919549] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-09-18T22:33:51.306314] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-18T22:33:51.719550] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-09-18T22:33:52.049898] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-18T22:33:52.519562] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-09-18T22:33:52.848236] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T22:33:53.319571] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-09-18T22:33:54.095771] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-18T22:33:54.118069] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-18T22:33:54.122606] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-09-18T22:33:54.919549] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-09-18T22:33:55.401831] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-18T22:33:55.719602] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-09-18T22:33:56.327984] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-18T22:33:56.519558] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-09-18T22:33:56.577781] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-18T22:33:57.319636] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-09-18T22:33:57.928306] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-18T22:33:58.119553] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-09-18T22:33:58.409983] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-18T22:33:58.416057] [INFO ] [REMOTE ] WEAV: Full fetch complete (61436 records). [2025-09-18T22:33:58.416173] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-09-18T22:33:58.806126] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-09-18T22:33:58.806219] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-09-18T22:33:58.807234] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-09-18T22:33:58.807315] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-09-18T22:33:58.810547] [DEBUG] [LOCAL ] WEAV: Trimmed 61436 records to 42365 (keeping 200 days of data) [2025-09-18T22:33:58.926408] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-09-18T22:33:59.057968] [DEBUG] [LOCAL ] WEAV: Primary data saved (42365 records). [2025-09-18T22:33:59.058119] [INFO ] [MAIN ] WEAV: Full history saved. [2025-09-18T22:33:59.058208] [INFO ] [MAIN ] Update Progress: 2281/2372 symbols completed. WEAV took 27.9s. Estimated remaining: 13m 19s. Rate: 6.8 symbols/min [2025-09-18T22:33:59.226298] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:33:59.284505] [DEBUG] [LOCAL ] WEC: Loaded 52233 existing records from primary storage. [2025-09-18T22:33:59.284675] [INFO ] [MAIN ] WEC: Loaded 52233 existing records. [2025-09-18T22:33:59.463915] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:33:59.464175] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-09-18T22:33:59.464223] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-09-18T22:33:59.465760] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-09-18T22:33:59.465826] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-09-18T22:33:59.724627] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-09-18T22:33:59.835327] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:33:59.863000] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-18T22:33:59.899584] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-18T22:34:00.461696] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-18T22:34:00.519553] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-09-18T22:34:01.075263] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-18T22:34:01.077114] [INFO ] [REMOTE ] WEA: Full fetch complete (9969 records). [2025-09-18T22:34:01.077189] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-09-18T22:34:01.324909] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-09-18T22:34:01.471371] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-09-18T22:34:01.471503] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-09-18T22:34:01.471821] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-09-18T22:34:01.471888] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-09-18T22:34:01.472414] [DEBUG] [LOCAL ] WEA: Trimmed 9969 records to 7523 (keeping 200 days of data) [2025-09-18T22:34:01.518866] [DEBUG] [LOCAL ] WEA: Primary data saved (7523 records). [2025-09-18T22:34:01.518988] [INFO ] [MAIN ] WEA: Full history saved. [2025-09-18T22:34:01.519076] [INFO ] [MAIN ] Update Progress: 2282/2372 symbols completed. WEA took 30.3s. Estimated remaining: 13m 10s. Rate: 6.8 symbols/min [2025-09-18T22:34:01.689356] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:34:01.759445] [DEBUG] [LOCAL ] WELL: Loaded 52360 existing records from primary storage. [2025-09-18T22:34:01.759625] [INFO ] [MAIN ] WELL: Loaded 52360 existing records. [2025-09-18T22:34:01.959000] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:34:01.959273] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-09-18T22:34:01.959322] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-09-18T22:34:01.960587] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-09-18T22:34:01.960674] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-09-18T22:34:02.138316] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-11. [2025-09-18T22:34:02.325393] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:34:02.919574] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-09-18T22:34:03.192932] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-18T22:34:03.613885] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-18T22:34:03.616980] [INFO ] [REMOTE ] WDI: Full fetch complete (30849 records). [2025-09-18T22:34:03.617064] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-09-18T22:34:03.725331] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-09-18T22:34:04.004038] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-09-18T22:34:04.004174] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-09-18T22:34:04.004947] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-09-18T22:34:04.005031] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-09-18T22:34:04.006201] [DEBUG] [LOCAL ] WDI: Trimmed 30849 records to 21478 (keeping 200 days of data) [2025-09-18T22:34:04.133680] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-18T22:34:04.177851] [DEBUG] [LOCAL ] WDI: Primary data saved (21478 records). [2025-09-18T22:34:04.177979] [INFO ] [MAIN ] WDI: Full history saved. [2025-09-18T22:34:04.178074] [INFO ] [MAIN ] Update Progress: 2283/2372 symbols completed. WDI took 33.0s. Estimated remaining: 13m 1s. Rate: 6.8 symbols/min [2025-09-18T22:34:04.346136] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:34:04.399002] [DEBUG] [LOCAL ] WES: Loaded 48094 existing records from primary storage. [2025-09-18T22:34:04.399195] [INFO ] [MAIN ] WES: Loaded 48094 existing records. [2025-09-18T22:34:04.524754] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-11. [2025-09-18T22:34:04.579493] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:34:04.579768] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-09-18T22:34:04.579850] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-09-18T22:34:04.581125] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-09-18T22:34:04.581192] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-09-18T22:34:04.936219] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:34:05.055678] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-18T22:34:05.319555] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-11. [2025-09-18T22:34:06.100033] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-18T22:34:06.119490] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-09-18T22:34:06.597045] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-18T22:34:06.919588] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-09-18T22:34:07.719578] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-09-18T22:34:07.931554] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-18T22:34:08.097865] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-18T22:34:08.519557] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-09-18T22:34:08.924287] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-18T22:34:09.319585] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-09-18T22:34:09.629749] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-18T22:34:09.635786] [INFO ] [REMOTE ] WDS: Full fetch complete (64795 records). [2025-09-18T22:34:09.635912] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-09-18T22:34:10.041083] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-09-18T22:34:10.041197] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-09-18T22:34:10.042224] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-09-18T22:34:10.042288] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-09-18T22:34:10.044231] [DEBUG] [LOCAL ] WDS: Trimmed 64795 records to 44163 (keeping 200 days of data) [2025-09-18T22:34:10.133290] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-09-18T22:34:10.322480] [DEBUG] [LOCAL ] WDS: Primary data saved (44163 records). [2025-09-18T22:34:10.322624] [INFO ] [MAIN ] WDS: Full history saved. [2025-09-18T22:34:10.322749] [INFO ] [MAIN ] Update Progress: 2284/2372 symbols completed. WDS took 39.1s. Estimated remaining: 12m 52s. Rate: 6.8 symbols/min [2025-09-18T22:34:10.503861] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:34:10.542337] [DEBUG] [LOCAL ] WEX: Loaded 35736 existing records from primary storage. [2025-09-18T22:34:10.542508] [INFO ] [MAIN ] WEX: Loaded 35736 existing records. [2025-09-18T22:34:10.723605] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:34:10.723958] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-09-18T22:34:10.724016] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-09-18T22:34:10.724906] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-09-18T22:34:10.724967] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-09-18T22:34:10.924674] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-09-18T22:34:11.102523] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:34:11.130835] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-18T22:34:11.635408] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-18T22:34:11.719500] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-09-18T22:34:12.519604] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-09-18T22:34:12.959724] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-18T22:34:13.120845] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-18T22:34:13.319554] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-11. [2025-09-18T22:34:13.923843] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T22:34:14.119541] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-09-18T22:34:14.468500] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-18T22:34:14.919545] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-09-18T22:34:15.719575] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-09-18T22:34:15.796557] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-18T22:34:15.959422] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-18T22:34:16.519569] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-09-18T22:34:17.319548] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-09-18T22:34:17.453552] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-18T22:34:17.542212] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-18T22:34:18.119561] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-09-18T22:34:18.919577] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-09-18T22:34:19.075099] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-18T22:34:19.293817] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-18T22:34:19.719581] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-09-18T22:34:20.494018] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T22:34:20.519518] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-09-18T22:34:21.319529] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-09-18T22:34:21.364164] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-18T22:34:22.119550] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-09-18T22:34:22.257938] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-18T22:34:22.919550] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-09-18T22:34:23.158093] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-18T22:34:23.708932] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T22:34:23.719586] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-09-18T22:34:24.519565] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-09-18T22:34:24.583369] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-18T22:34:25.088316] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-18T22:34:25.319553] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-09-18T22:34:25.896957] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-18T22:34:26.119531] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-09-18T22:34:26.919548] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-09-18T22:34:27.119918] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-18T22:34:27.719544] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-09-18T22:34:27.772957] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-18T22:34:28.245162] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-18T22:34:28.519568] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-09-18T22:34:28.994192] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-18T22:34:29.319555] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-09-18T22:34:29.936940] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-18T22:34:30.119531] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-09-18T22:34:30.797065] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-18T22:34:30.919548] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-09-18T22:34:31.645842] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-18T22:34:31.719516] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-09-18T22:34:32.160463] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-18T22:34:32.167732] [INFO ] [REMOTE ] WEC: Full fetch complete (75267 records). [2025-09-18T22:34:32.167890] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-09-18T22:34:32.542413] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-09-18T22:34:32.598846] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-09-18T22:34:32.598998] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-09-18T22:34:32.600433] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-09-18T22:34:32.600561] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-09-18T22:34:32.602767] [DEBUG] [LOCAL ] WEC: Trimmed 75267 records to 52605 (keeping 200 days of data) [2025-09-18T22:34:32.741833] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-18T22:34:32.979885] [DEBUG] [LOCAL ] WEC: Primary data saved (52605 records). [2025-09-18T22:34:32.980034] [INFO ] [MAIN ] WEC: Full history saved. [2025-09-18T22:34:32.980121] [INFO ] [MAIN ] Update Progress: 2285/2372 symbols completed. WEC took 33.9s. Estimated remaining: 12m 44s. Rate: 6.8 symbols/min [2025-09-18T22:34:33.199979] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:34:33.213350] [DEBUG] [LOCAL ] WF: Loaded 11123 existing records from primary storage. [2025-09-18T22:34:33.213506] [INFO ] [MAIN ] WF: Loaded 11123 existing records. [2025-09-18T22:34:33.324822] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-09-18T22:34:33.404354] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:34:33.404603] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-09-18T22:34:33.404677] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-09-18T22:34:33.405124] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-09-18T22:34:33.405183] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-09-18T22:34:33.785059] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:34:33.897302] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-18T22:34:34.119615] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-09-18T22:34:34.640835] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-18T22:34:34.919610] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-11. [2025-09-18T22:34:35.089375] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-18T22:34:35.720536] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-09-18T22:34:35.724944] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-18T22:34:36.519570] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-09-18T22:34:37.154996] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T22:34:37.319554] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-09-18T22:34:37.413001] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-18T22:34:38.078819] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-18T22:34:38.119534] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-09-18T22:34:38.919551] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-09-18T22:34:39.719579] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-09-18T22:34:39.752808] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-18T22:34:40.371510] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-18T22:34:40.391114] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-18T22:34:40.519538] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-09-18T22:34:41.319556] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-09-18T22:34:42.030921] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T22:34:42.037888] [INFO ] [REMOTE ] WES: Full fetch complete (69518 records). [2025-09-18T22:34:42.038079] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-09-18T22:34:42.124764] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-09-18T22:34:42.406258] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-18T22:34:42.449236] [INFO ] [REMOTE ] WEX: Full fetch complete (50647 records). [2025-09-18T22:34:42.469849] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-09-18T22:34:42.473617] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-09-18T22:34:42.474053] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-09-18T22:34:42.475755] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-09-18T22:34:42.481606] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-09-18T22:34:42.587495] [DEBUG] [LOCAL ] WES: Trimmed 69518 records to 48435 (keeping 200 days of data) [2025-09-18T22:34:42.983949] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-09-18T22:34:43.132629] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-09-18T22:34:43.133281] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-09-18T22:34:43.133558] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-18T22:34:43.137845] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-09-18T22:34:43.138387] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-09-18T22:34:43.141548] [DEBUG] [LOCAL ] WEX: Trimmed 50647 records to 35964 (keeping 200 days of data) [2025-09-18T22:34:43.369331] [DEBUG] [LOCAL ] WEX: Primary data saved (35964 records). [2025-09-18T22:34:43.370226] [INFO ] [MAIN ] WEX: Full history saved. [2025-09-18T22:34:43.370747] [INFO ] [MAIN ] Update Progress: 2286/2372 symbols completed. WEX took 33.0s. Estimated remaining: 12m 35s. Rate: 6.8 symbols/min [2025-09-18T22:34:43.603987] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:34:43.649207] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-18T22:34:43.662226] [INFO ] [REMOTE ] WELL: Full fetch complete (75549 records). [2025-09-18T22:34:43.663818] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-09-18T22:34:43.668220] [DEBUG] [LOCAL ] WES: Primary data saved (48435 records). [2025-09-18T22:34:43.711311] [INFO ] [MAIN ] WES: Full history saved. [2025-09-18T22:34:43.730993] [INFO ] [MAIN ] Update Progress: 2287/2372 symbols completed. WES took 39.6s. Estimated remaining: 12m 26s. Rate: 6.8 symbols/min [2025-09-18T22:34:43.751542] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-09-18T22:34:44.083144] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-09-18T22:34:44.138536] [INFO ] [MAIN ] WFC: Loaded 53748 existing records. [2025-09-18T22:34:44.185046] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:34:44.438901] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-09-18T22:34:44.453969] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-09-18T22:34:44.459009] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-09-18T22:34:44.473196] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-09-18T22:34:44.473675] [DEBUG] [LOCAL ] WFG: Loaded 25115 existing records from primary storage. [2025-09-18T22:34:44.484441] [INFO ] [MAIN ] WFG: Loaded 25115 existing records. [2025-09-18T22:34:44.628957] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:34:44.629461] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-09-18T22:34:44.629597] [DEBUG] [LOCAL ] WELL: Trimmed 75549 records to 52746 (keeping 200 days of data) [2025-09-18T22:34:44.634883] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-09-18T22:34:44.663984] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-09-18T22:34:44.763414] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-09-18T22:34:44.843002] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-18T22:34:44.931863] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:34:44.937990] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-09-18T22:34:44.931369] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-09-18T22:34:44.945257] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-09-18T22:34:44.962584] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-09-18T22:34:44.973847] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-09-18T22:34:45.492068] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:34:45.516096] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-11. [2025-09-18T22:34:45.644422] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:34:45.882342] [DEBUG] [LOCAL ] WELL: Primary data saved (52746 records). [2025-09-18T22:34:45.882833] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-18T22:34:45.883074] [INFO ] [MAIN ] WELL: Full history saved. [2025-09-18T22:34:45.888850] [INFO ] [MAIN ] Update Progress: 2288/2372 symbols completed. WELL took 44.4s. Estimated remaining: 12m 17s. Rate: 6.8 symbols/min [2025-09-18T22:34:46.057685] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:34:46.099072] [DEBUG] [LOCAL ] WGO: Loaded 39627 existing records from primary storage. [2025-09-18T22:34:46.099261] [INFO ] [MAIN ] WGO: Loaded 39627 existing records. [2025-09-18T22:34:46.129620] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-11. [2025-09-18T22:34:46.279085] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:34:46.279305] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-09-18T22:34:46.279352] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-09-18T22:34:46.281269] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-09-18T22:34:46.281329] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-09-18T22:34:46.633346] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:34:46.919558] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-11. [2025-09-18T22:34:47.205173] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-18T22:34:47.228982] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-18T22:34:47.719547] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-09-18T22:34:48.423990] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-18T22:34:48.519537] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-09-18T22:34:49.319571] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-09-18T22:34:49.445190] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-18T22:34:49.796372] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-18T22:34:50.119549] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-09-18T22:34:50.379231] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-18T22:34:50.919543] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-09-18T22:34:51.719541] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-09-18T22:34:51.862991] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-18T22:34:51.872600] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T22:34:52.519540] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-09-18T22:34:52.551111] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-18T22:34:53.319588] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-09-18T22:34:54.119556] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-09-18T22:34:54.180588] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-18T22:34:54.263447] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-18T22:34:54.919550] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-09-18T22:34:55.272225] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T22:34:55.719527] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-09-18T22:34:56.126102] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-18T22:34:56.519568] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-09-18T22:34:57.319531] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-09-18T22:34:57.414986] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-18T22:34:57.441389] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-18T22:34:58.119563] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-09-18T22:34:58.700499] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-18T22:34:58.905603] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-18T22:34:58.919493] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-09-18T22:34:59.599448] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-18T22:34:59.601278] [INFO ] [REMOTE ] WF: Full fetch complete (16890 records). [2025-09-18T22:34:59.601349] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-09-18T22:34:59.724713] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-09-18T22:34:59.981340] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-09-18T22:34:59.981418] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-09-18T22:34:59.981814] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-09-18T22:34:59.981879] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-09-18T22:34:59.982406] [DEBUG] [LOCAL ] WF: Trimmed 16890 records to 11177 (keeping 200 days of data) [2025-09-18T22:35:00.049979] [DEBUG] [LOCAL ] WF: Primary data saved (11177 records). [2025-09-18T22:35:00.050115] [INFO ] [MAIN ] WF: Full history saved. [2025-09-18T22:35:00.050249] [INFO ] [MAIN ] Update Progress: 2289/2372 symbols completed. WF took 27.1s. Estimated remaining: 12m 9s. Rate: 6.8 symbols/min [2025-09-18T22:35:00.218152] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:35:00.267484] [DEBUG] [LOCAL ] WH: Loaded 45998 existing records from primary storage. [2025-09-18T22:35:00.267673] [INFO ] [MAIN ] WH: Loaded 45998 existing records. [2025-09-18T22:35:00.457746] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:35:00.458216] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-09-18T22:35:00.458311] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-09-18T22:35:00.459599] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-09-18T22:35:00.459730] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-09-18T22:35:00.524807] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-09-18T22:35:00.848264] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:35:01.319580] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-11. [2025-09-18T22:35:01.953106] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-18T22:35:02.119572] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-09-18T22:35:02.332818] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-18T22:35:02.591190] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-18T22:35:02.919560] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-09-18T22:35:03.719571] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-09-18T22:35:04.272765] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-18T22:35:04.335671] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T22:35:04.519622] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-09-18T22:35:05.068412] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-18T22:35:05.319598] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-09-18T22:35:05.520239] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-18T22:35:06.119545] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-09-18T22:35:06.919586] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-09-18T22:35:06.922038] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-18T22:35:07.361842] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T22:35:07.719571] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-09-18T22:35:07.867099] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-18T22:35:08.519595] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-09-18T22:35:09.084043] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-18T22:35:09.319579] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-09-18T22:35:10.070963] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-18T22:35:10.119525] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-09-18T22:35:10.791636] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-18T22:35:10.919545] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-09-18T22:35:11.290770] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-18T22:35:11.719593] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-09-18T22:35:12.218492] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-18T22:35:12.519600] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-09-18T22:35:12.741299] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-18T22:35:13.319635] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-09-18T22:35:13.914115] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-18T22:35:14.119571] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-09-18T22:35:14.632288] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-18T22:35:14.638502] [INFO ] [REMOTE ] WGO: Full fetch complete (57156 records). [2025-09-18T22:35:14.638709] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-09-18T22:35:14.924629] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-09-18T22:35:15.041270] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-09-18T22:35:15.041351] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-09-18T22:35:15.042412] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-09-18T22:35:15.042515] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-09-18T22:35:15.046085] [DEBUG] [LOCAL ] WGO: Trimmed 57156 records to 39934 (keeping 200 days of data) [2025-09-18T22:35:15.311057] [DEBUG] [LOCAL ] WGO: Primary data saved (39934 records). [2025-09-18T22:35:15.311233] [INFO ] [MAIN ] WGO: Full history saved. [2025-09-18T22:35:15.311984] [INFO ] [MAIN ] Update Progress: 2290/2372 symbols completed. WGO took 29.4s. Estimated remaining: 12m 0s. Rate: 6.8 symbols/min [2025-09-18T22:35:15.496316] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:35:15.547623] [DEBUG] [LOCAL ] WHD: Loaded 40825 existing records from primary storage. [2025-09-18T22:35:15.547812] [INFO ] [MAIN ] WHD: Loaded 40825 existing records. [2025-09-18T22:35:15.724910] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-09-18T22:35:15.730501] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:35:15.732078] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-09-18T22:35:15.732143] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-09-18T22:35:15.733118] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-09-18T22:35:15.733183] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-09-18T22:35:16.108767] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:35:16.165911] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T22:35:16.208419] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-18T22:35:16.523907] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-09-18T22:35:16.528227] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-18T22:35:17.319566] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-09-18T22:35:18.119578] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-11. [2025-09-18T22:35:18.384427] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-18T22:35:18.803163] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-18T22:35:18.919557] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-09-18T22:35:19.196355] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-18T22:35:19.719553] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-09-18T22:35:20.328706] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-18T22:35:20.519590] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-09-18T22:35:21.319563] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-09-18T22:35:21.563161] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-18T22:35:22.106026] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T22:35:22.119492] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-09-18T22:35:22.145959] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-18T22:35:22.919584] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-09-18T22:35:23.208234] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-18T22:35:23.719505] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-09-18T22:35:23.755806] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-18T22:35:24.519601] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-09-18T22:35:25.058338] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-18T22:35:25.140706] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-18T22:35:25.148457] [INFO ] [REMOTE ] WFC: Full fetch complete (77755 records). [2025-09-18T22:35:25.148629] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-09-18T22:35:25.320295] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-09-18T22:35:25.570914] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-09-18T22:35:25.571001] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-09-18T22:35:25.572121] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-09-18T22:35:25.572188] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-09-18T22:35:25.576897] [DEBUG] [LOCAL ] WFC: Trimmed 77755 records to 54138 (keeping 200 days of data) [2025-09-18T22:35:25.943917] [DEBUG] [LOCAL ] WFC: Primary data saved (54138 records). [2025-09-18T22:35:25.944465] [INFO ] [MAIN ] WFC: Full history saved. [2025-09-18T22:35:25.944799] [INFO ] [MAIN ] Update Progress: 2291/2372 symbols completed. WFC took 42.6s. Estimated remaining: 11m 51s. Rate: 6.8 symbols/min [2025-09-18T22:35:26.124810] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-09-18T22:35:26.127084] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:35:26.134504] [DEBUG] [LOCAL ] WHG: Loaded 3421 existing records from primary storage. [2025-09-18T22:35:26.135024] [INFO ] [MAIN ] WHG: Loaded 3421 existing records. [2025-09-18T22:35:26.326661] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:35:26.327296] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-09-18T22:35:26.327438] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-09-18T22:35:26.327966] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-09-18T22:35:26.328241] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-09-18T22:35:26.412430] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-18T22:35:26.457438] [INFO ] [REMOTE ] WFG: Full fetch complete (35451 records). [2025-09-18T22:35:26.460743] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-09-18T22:35:26.961018] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-09-18T22:35:27.020055] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:35:27.189188] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-09-18T22:35:27.189298] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-09-18T22:35:27.190192] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-09-18T22:35:27.190279] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-09-18T22:35:27.191479] [DEBUG] [LOCAL ] WFG: Trimmed 35451 records to 25332 (keeping 200 days of data) [2025-09-18T22:35:27.368084] [DEBUG] [LOCAL ] WFG: Primary data saved (25332 records). [2025-09-18T22:35:27.368224] [INFO ] [MAIN ] WFG: Full history saved. [2025-09-18T22:35:27.368377] [INFO ] [MAIN ] Update Progress: 2292/2372 symbols completed. WFG took 43.6s. Estimated remaining: 11m 42s. Rate: 6.8 symbols/min [2025-09-18T22:35:27.542439] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:35:27.595112] [DEBUG] [LOCAL ] WHR: Loaded 48142 existing records from primary storage. [2025-09-18T22:35:27.595273] [INFO ] [MAIN ] WHR: Loaded 48142 existing records. [2025-09-18T22:35:27.720868] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-11. [2025-09-18T22:35:27.799954] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:35:27.801054] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-09-18T22:35:27.801346] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-09-18T22:35:27.808556] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-09-18T22:35:27.818152] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-09-18T22:35:27.835373] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-18T22:35:27.919110] [INFO ] [REMOTE ] WH: Full fetch complete (64955 records). [2025-09-18T22:35:27.929626] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-09-18T22:35:28.467087] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:35:28.477933] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-18T22:35:28.522883] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-09-18T22:35:28.656888] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-09-18T22:35:28.658678] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-18T22:35:28.657330] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-09-18T22:35:28.666517] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-09-18T22:35:28.667057] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-09-18T22:35:28.668747] [DEBUG] [LOCAL ] WH: Trimmed 64955 records to 46318 (keeping 200 days of data) [2025-09-18T22:35:28.981921] [DEBUG] [LOCAL ] WH: Primary data saved (46318 records). [2025-09-18T22:35:28.982045] [INFO ] [MAIN ] WH: Full history saved. [2025-09-18T22:35:28.982141] [INFO ] [MAIN ] Update Progress: 2293/2372 symbols completed. WH took 28.9s. Estimated remaining: 11m 33s. Rate: 6.8 symbols/min [2025-09-18T22:35:29.152189] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:35:29.158360] [DEBUG] [LOCAL ] WIA: Loaded 4887 existing records from primary storage. [2025-09-18T22:35:29.158465] [INFO ] [MAIN ] WIA: Loaded 4887 existing records. [2025-09-18T22:35:29.263194] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-18T22:35:29.337689] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-09-18T22:35:29.343092] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:35:29.343342] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-09-18T22:35:29.343407] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-09-18T22:35:29.343710] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-09-18T22:35:29.343782] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-09-18T22:35:29.703417] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:35:30.119598] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-11. [2025-09-18T22:35:30.919705] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-11. [2025-09-18T22:35:30.965187] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-18T22:35:31.106308] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-18T22:35:31.719617] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-09-18T22:35:32.436696] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-18T22:35:32.519554] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-09-18T22:35:33.039997] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-18T22:35:33.319552] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-09-18T22:35:33.801255] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-18T22:35:33.878290] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-18T22:35:34.119575] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-09-18T22:35:34.617399] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-18T22:35:34.919590] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-09-18T22:35:35.398516] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-18T22:35:35.719576] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-09-18T22:35:36.397759] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-18T22:35:36.519569] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-09-18T22:35:36.976287] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-18T22:35:37.319557] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-09-18T22:35:37.836128] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-18T22:35:38.119563] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-09-18T22:35:38.612437] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-18T22:35:38.919564] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-09-18T22:35:39.533104] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-18T22:35:39.719560] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-09-18T22:35:40.519552] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-09-18T22:35:41.014791] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-18T22:35:41.330520] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-09-18T22:35:41.338034] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-18T22:35:41.916980] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-18T22:35:42.119556] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-09-18T22:35:42.919610] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-09-18T22:35:43.415114] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-18T22:35:43.444415] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T22:35:43.719561] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-09-18T22:35:44.236961] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-18T22:35:44.519623] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-09-18T22:35:45.064585] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-18T22:35:45.319548] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-09-18T22:35:46.119549] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-09-18T22:35:46.616614] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-18T22:35:46.919571] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-09-18T22:35:47.043850] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-18T22:35:47.388959] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-18T22:35:47.719542] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-09-18T22:35:48.404436] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-18T22:35:48.519540] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-09-18T22:35:49.073938] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-18T22:35:49.319549] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-09-18T22:35:50.119553] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-09-18T22:35:50.707230] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-18T22:35:50.709398] [INFO ] [REMOTE ] WIA: Full fetch complete (7355 records). [2025-09-18T22:35:50.709487] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-09-18T22:35:50.919899] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-09-18T22:35:51.133302] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-09-18T22:35:51.135909] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-09-18T22:35:51.136262] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-09-18T22:35:51.136387] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-09-18T22:35:51.138748] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-18T22:35:51.139227] [DEBUG] [LOCAL ] WIA: Trimmed 7355 records to 4916 (keeping 200 days of data) [2025-09-18T22:35:51.178098] [DEBUG] [LOCAL ] WIA: Primary data saved (4916 records). [2025-09-18T22:35:51.178264] [INFO ] [MAIN ] WIA: Full history saved. [2025-09-18T22:35:51.178365] [INFO ] [MAIN ] Update Progress: 2294/2372 symbols completed. WIA took 22.2s. Estimated remaining: 11m 25s. Rate: 6.8 symbols/min [2025-09-18T22:35:51.357716] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:35:51.371095] [DEBUG] [LOCAL ] WINN: Loaded 11950 existing records from primary storage. [2025-09-18T22:35:51.371225] [INFO ] [MAIN ] WINN: Loaded 11950 existing records. [2025-09-18T22:35:51.443136] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-18T22:35:51.474986] [INFO ] [REMOTE ] WHG: Full fetch complete (4713 records). [2025-09-18T22:35:51.483245] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-09-18T22:35:51.729258] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-09-18T22:35:51.745617] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:35:51.819419] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-09-18T22:35:51.854443] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-09-18T22:35:51.881913] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-09-18T22:35:51.893025] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-09-18T22:35:52.135096] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-09-18T22:35:52.142723] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-09-18T22:35:52.145747] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-09-18T22:35:52.147271] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-09-18T22:35:52.165913] [DEBUG] [LOCAL ] WHG: Trimmed 4713 records to 3438 (keeping 200 days of data) [2025-09-18T22:35:52.266337] [DEBUG] [LOCAL ] WHG: Primary data saved (3438 records). [2025-09-18T22:35:52.278337] [INFO ] [MAIN ] WHG: Full history saved. [2025-09-18T22:35:52.290830] [INFO ] [MAIN ] Update Progress: 2295/2372 symbols completed. WHG took 26.3s. Estimated remaining: 11m 16s. Rate: 6.8 symbols/min [2025-09-18T22:35:52.521480] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-09-18T22:35:52.526238] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:35:52.582219] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:35:52.637818] [DEBUG] [LOCAL ] WIT: Loaded 52266 existing records from primary storage. [2025-09-18T22:35:52.638001] [INFO ] [MAIN ] WIT: Loaded 52266 existing records. [2025-09-18T22:35:52.827417] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:35:52.827721] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-09-18T22:35:52.827799] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-09-18T22:35:52.829020] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-09-18T22:35:52.829081] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-09-18T22:35:53.187862] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:35:53.319599] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-11. [2025-09-18T22:35:53.348623] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-18T22:35:53.986467] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-18T22:35:54.119577] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-09-18T22:35:54.160330] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-18T22:35:54.909954] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-18T22:35:54.919487] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-09-18T22:35:55.671042] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-18T22:35:55.719589] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-09-18T22:35:56.519586] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-09-18T22:35:57.323476] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-11. [2025-09-18T22:35:57.332162] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-18T22:35:57.571619] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-18T22:35:58.119599] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-09-18T22:35:58.919617] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-09-18T22:35:59.282420] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-11 (1.96 seconds). [2025-09-18T22:35:59.547616] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-18T22:35:59.628456] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-18T22:35:59.719596] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-09-18T22:36:00.519568] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-09-18T22:36:01.304750] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T22:36:01.319494] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-09-18T22:36:01.459789] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-18T22:36:02.119583] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-09-18T22:36:02.415733] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-18T22:36:02.421341] [INFO ] [REMOTE ] WHD: Full fetch complete (57024 records). [2025-09-18T22:36:02.421471] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-09-18T22:36:02.818794] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-09-18T22:36:02.818918] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-09-18T22:36:02.819878] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-09-18T22:36:02.819944] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-09-18T22:36:02.821193] [DEBUG] [LOCAL ] WHD: Trimmed 57024 records to 41111 (keeping 200 days of data) [2025-09-18T22:36:02.921842] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-09-18T22:36:03.083835] [DEBUG] [LOCAL ] WHD: Primary data saved (41111 records). [2025-09-18T22:36:03.083975] [INFO ] [MAIN ] WHD: Full history saved. [2025-09-18T22:36:03.084687] [INFO ] [MAIN ] Update Progress: 2296/2372 symbols completed. WHD took 47.8s. Estimated remaining: 11m 7s. Rate: 6.8 symbols/min [2025-09-18T22:36:03.317379] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:36:03.339529] [DEBUG] [LOCAL ] WIW: Loaded 20861 existing records from primary storage. [2025-09-18T22:36:03.339699] [INFO ] [MAIN ] WIW: Loaded 20861 existing records. [2025-09-18T22:36:03.525684] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:36:03.525994] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-09-18T22:36:03.526057] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-09-18T22:36:03.526576] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-09-18T22:36:03.526672] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-09-18T22:36:03.689125] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-18T22:36:03.725665] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-09-18T22:36:03.922215] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:36:03.962800] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-18T22:36:04.519570] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-11. [2025-09-18T22:36:05.319756] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-09-18T22:36:05.405517] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-18T22:36:05.659914] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-18T22:36:06.119566] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-09-18T22:36:06.924043] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-09-18T22:36:06.939952] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-18T22:36:06.969786] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-18T22:36:07.719584] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-09-18T22:36:08.519570] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-09-18T22:36:08.699461] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-18T22:36:08.885007] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-18T22:36:09.243433] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T22:36:09.319559] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-09-18T22:36:10.119580] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-09-18T22:36:10.247274] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-18T22:36:10.919566] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-09-18T22:36:11.635047] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-18T22:36:11.683273] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-18T22:36:11.719537] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-09-18T22:36:12.519602] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-09-18T22:36:13.319532] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-09-18T22:36:13.390672] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-18T22:36:13.404672] [INFO ] [REMOTE ] WHR: Full fetch complete (68079 records). [2025-09-18T22:36:13.405701] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-18T22:36:13.405842] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-09-18T22:36:13.808660] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-09-18T22:36:13.808766] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-09-18T22:36:13.809835] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-09-18T22:36:13.809924] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-09-18T22:36:13.811567] [DEBUG] [LOCAL ] WHR: Trimmed 68079 records to 48527 (keeping 200 days of data) [2025-09-18T22:36:14.126538] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-09-18T22:36:14.149523] [DEBUG] [LOCAL ] WHR: Primary data saved (48527 records). [2025-09-18T22:36:14.149792] [INFO ] [MAIN ] WHR: Full history saved. [2025-09-18T22:36:14.149910] [INFO ] [MAIN ] Update Progress: 2297/2372 symbols completed. WHR took 46.8s. Estimated remaining: 10m 59s. Rate: 6.8 symbols/min [2025-09-18T22:36:14.337443] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:36:14.373490] [DEBUG] [LOCAL ] WK: Loaded 36494 existing records from primary storage. [2025-09-18T22:36:14.373703] [INFO ] [MAIN ] WK: Loaded 36494 existing records. [2025-09-18T22:36:14.555733] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:36:14.556010] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-09-18T22:36:14.556062] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-09-18T22:36:14.556853] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-09-18T22:36:14.556916] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-09-18T22:36:14.934800] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-09-18T22:36:14.940782] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:36:14.947982] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-18T22:36:14.950585] [INFO ] [REMOTE ] WINN: Full fetch complete (17718 records). [2025-09-18T22:36:14.950708] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-09-18T22:36:15.044535] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-18T22:36:15.361049] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-09-18T22:36:15.361127] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-09-18T22:36:15.361511] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-09-18T22:36:15.361553] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-09-18T22:36:15.362169] [DEBUG] [LOCAL ] WINN: Trimmed 17718 records to 12035 (keeping 200 days of data) [2025-09-18T22:36:15.438105] [DEBUG] [LOCAL ] WINN: Primary data saved (12035 records). [2025-09-18T22:36:15.438314] [INFO ] [MAIN ] WINN: Full history saved. [2025-09-18T22:36:15.438466] [INFO ] [MAIN ] Update Progress: 2298/2372 symbols completed. WINN took 24.3s. Estimated remaining: 10m 50s. Rate: 6.8 symbols/min [2025-09-18T22:36:15.614123] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:36:15.649780] [DEBUG] [LOCAL ] WKC: Loaded 35307 existing records from primary storage. [2025-09-18T22:36:15.649944] [INFO ] [MAIN ] WKC: Loaded 35307 existing records. [2025-09-18T22:36:15.725334] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-11. [2025-09-18T22:36:15.838917] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:36:15.839246] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-09-18T22:36:15.839296] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-09-18T22:36:15.840081] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-09-18T22:36:15.840143] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-09-18T22:36:16.164990] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T22:36:16.235283] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:36:16.519567] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-09-18T22:36:16.802787] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-18T22:36:17.319545] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-09-18T22:36:18.119544] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-09-18T22:36:18.310614] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-18T22:36:18.386685] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-18T22:36:18.839979] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-18T22:36:18.919532] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-11. [2025-09-18T22:36:19.719548] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-09-18T22:36:20.069108] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-18T22:36:20.449133] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-18T22:36:20.519582] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-09-18T22:36:21.319542] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-09-18T22:36:21.904260] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T22:36:22.119547] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-09-18T22:36:22.919526] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-09-18T22:36:22.972478] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-18T22:36:23.135531] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-18T22:36:23.719543] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-09-18T22:36:23.964926] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-18T22:36:24.519554] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-09-18T22:36:24.949086] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T22:36:25.319556] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-09-18T22:36:26.092530] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T22:36:26.119494] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-09-18T22:36:26.704576] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-18T22:36:26.919619] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-09-18T22:36:27.542422] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-18T22:36:27.719567] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-09-18T22:36:28.137594] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-18T22:36:28.519566] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-09-18T22:36:29.319556] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-09-18T22:36:29.421964] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-18T22:36:29.452595] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-18T22:36:30.119552] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-09-18T22:36:30.570685] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-18T22:36:30.919562] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-09-18T22:36:31.719592] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-09-18T22:36:31.812952] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-18T22:36:31.927463] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-18T22:36:32.519576] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-09-18T22:36:32.767318] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-18T22:36:33.319595] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-09-18T22:36:33.384248] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-18T22:36:34.119561] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-09-18T22:36:34.755536] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-18T22:36:34.763161] [INFO ] [REMOTE ] WIT: Full fetch complete (75379 records). [2025-09-18T22:36:34.763286] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-09-18T22:36:34.922603] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-09-18T22:36:35.019548] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-18T22:36:35.064570] [INFO ] [REMOTE ] WIW: Full fetch complete (30558 records). [2025-09-18T22:36:35.075765] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-09-18T22:36:35.380287] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-09-18T22:36:35.395820] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-09-18T22:36:35.397350] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-09-18T22:36:35.398984] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-09-18T22:36:35.511142] [DEBUG] [LOCAL ] WIT: Trimmed 75379 records to 52651 (keeping 200 days of data) [2025-09-18T22:36:35.707748] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-09-18T22:36:35.720536] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-09-18T22:36:35.721364] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-09-18T22:36:35.720409] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-09-18T22:36:35.727511] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-09-18T22:36:35.821409] [DEBUG] [LOCAL ] WIW: Trimmed 30558 records to 21003 (keeping 200 days of data) [2025-09-18T22:36:35.954542] [DEBUG] [LOCAL ] WIW: Primary data saved (21003 records). [2025-09-18T22:36:35.956127] [INFO ] [MAIN ] WIW: Full history saved. [2025-09-18T22:36:35.956584] [INFO ] [MAIN ] Update Progress: 2299/2372 symbols completed. WIW took 32.9s. Estimated remaining: 10m 41s. Rate: 6.8 symbols/min [2025-09-18T22:36:36.203709] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:36:36.238202] [DEBUG] [LOCAL ] WIT: Primary data saved (52651 records). [2025-09-18T22:36:36.238470] [INFO ] [MAIN ] WIT: Full history saved. [2025-09-18T22:36:36.238617] [INFO ] [MAIN ] Update Progress: 2300/2372 symbols completed. WIT took 43.9s. Estimated remaining: 10m 32s. Rate: 6.8 symbols/min [2025-09-18T22:36:36.380490] [DEBUG] [LOCAL ] WLK: Loaded 45252 existing records from primary storage. [2025-09-18T22:36:36.401740] [INFO ] [MAIN ] WLK: Loaded 45252 existing records. [2025-09-18T22:36:36.432985] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-18T22:36:36.497477] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:36:36.574281] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-09-18T22:36:36.601807] [DEBUG] [LOCAL ] WLKP: Loaded 6523 existing records from primary storage. [2025-09-18T22:36:36.634015] [INFO ] [MAIN ] WLKP: Loaded 6523 existing records. [2025-09-18T22:36:36.695309] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:36:36.744322] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-09-18T22:36:36.765847] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-09-18T22:36:36.772255] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-09-18T22:36:36.782504] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-09-18T22:36:36.953272] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:36:36.953832] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-09-18T22:36:36.964407] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-09-18T22:36:37.004739] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-09-18T22:36:37.040583] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-09-18T22:36:37.405459] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:36:37.429501] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-11. [2025-09-18T22:36:37.580950] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-18T22:36:37.652145] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:36:37.833714] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-18T22:36:38.119551] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-09-18T22:36:38.707305] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-18T22:36:38.919546] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-09-18T22:36:39.363244] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-18T22:36:39.719545] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-09-18T22:36:39.956987] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-18T22:36:39.962489] [INFO ] [REMOTE ] WK: Full fetch complete (51659 records). [2025-09-18T22:36:39.962587] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-09-18T22:36:40.346547] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-09-18T22:36:40.346636] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-09-18T22:36:40.347571] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-09-18T22:36:40.347628] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-09-18T22:36:40.348743] [DEBUG] [LOCAL ] WK: Trimmed 51659 records to 36780 (keeping 200 days of data) [2025-09-18T22:36:40.521220] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-09-18T22:36:40.574162] [DEBUG] [LOCAL ] WK: Primary data saved (36780 records). [2025-09-18T22:36:40.574327] [INFO ] [MAIN ] WK: Full history saved. [2025-09-18T22:36:40.574488] [INFO ] [MAIN ] Update Progress: 2301/2372 symbols completed. WK took 26.4s. Estimated remaining: 10m 23s. Rate: 6.8 symbols/min [2025-09-18T22:36:40.745938] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:36:40.746152] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-09-18T22:36:40.746199] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-09-18T22:36:40.746343] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-09-18T22:36:40.746385] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-18T22:36:40.746426] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-18T22:36:40.746458] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-09-18T22:36:41.134110] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:36:41.182084] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T22:36:41.319522] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-11. [2025-09-18T22:36:41.669600] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-18T22:36:41.710582] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-11 (0.39 seconds). [2025-09-18T22:36:42.119554] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-09-18T22:36:42.919543] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-09-18T22:36:43.170246] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-18T22:36:43.719556] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-11. [2025-09-18T22:36:44.109257] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-18T22:36:44.419135] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-18T22:36:44.519531] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-09-18T22:36:45.319546] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-09-18T22:36:45.991370] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-18T22:36:46.006311] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-18T22:36:46.119533] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-09-18T22:36:46.921639] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-09-18T22:36:46.924767] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-18T22:36:47.719583] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-09-18T22:36:48.281176] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-18T22:36:48.325762] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T22:36:48.519532] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-09-18T22:36:49.319544] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-09-18T22:36:49.787518] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-18T22:36:49.813603] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-18T22:36:50.119568] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-09-18T22:36:50.528355] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-18T22:36:50.919570] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-09-18T22:36:51.180108] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-18T22:36:51.719609] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-09-18T22:36:52.519551] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-09-18T22:36:53.047058] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-18T22:36:53.278339] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-18T22:36:53.319495] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-09-18T22:36:54.119563] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-09-18T22:36:54.751881] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T22:36:54.919563] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-09-18T22:36:54.934929] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-18T22:36:55.719542] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-09-18T22:36:56.519616] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-09-18T22:36:56.889603] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-18T22:36:56.899409] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-18T22:36:56.932080] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-18T22:36:57.319548] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-09-18T22:36:58.119549] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-09-18T22:36:58.436784] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T22:36:58.442199] [INFO ] [REMOTE ] WKC: Full fetch complete (51336 records). [2025-09-18T22:36:58.442320] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-09-18T22:36:58.832717] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-09-18T22:36:58.832827] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-09-18T22:36:58.833837] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-09-18T22:36:58.833918] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-09-18T22:36:58.835100] [DEBUG] [LOCAL ] WKC: Trimmed 51336 records to 35580 (keeping 200 days of data) [2025-09-18T22:36:58.922807] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-09-18T22:36:59.054965] [DEBUG] [LOCAL ] WKC: Primary data saved (35580 records). [2025-09-18T22:36:59.055140] [INFO ] [MAIN ] WKC: Full history saved. [2025-09-18T22:36:59.055283] [INFO ] [MAIN ] Update Progress: 2302/2372 symbols completed. WKC took 43.6s. Estimated remaining: 10m 15s. Rate: 6.8 symbols/min [2025-09-18T22:36:59.226781] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:36:59.260294] [DEBUG] [LOCAL ] WLY: Loaded 30559 existing records from primary storage. [2025-09-18T22:36:59.260447] [INFO ] [MAIN ] WLY: Loaded 30559 existing records. [2025-09-18T22:36:59.454627] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:36:59.455216] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-09-18T22:36:59.455355] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-09-18T22:36:59.456296] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-09-18T22:36:59.456362] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-09-18T22:36:59.646590] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-18T22:36:59.724296] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-09-18T22:36:59.792913] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-18T22:36:59.883548] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:37:00.521630] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-11. [2025-09-18T22:37:00.524585] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-18T22:37:01.319549] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-09-18T22:37:01.600285] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-18T22:37:01.969703] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-18T22:37:02.119592] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-09-18T22:37:02.919551] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-09-18T22:37:03.352298] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-18T22:37:03.719565] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-09-18T22:37:04.519557] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-09-18T22:37:04.609164] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-18T22:37:04.662773] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-18T22:37:04.992387] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-18T22:37:05.319575] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-09-18T22:37:06.119555] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-09-18T22:37:06.919628] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-09-18T22:37:07.054824] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-18T22:37:07.103823] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-18T22:37:07.379885] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-18T22:37:07.381593] [INFO ] [REMOTE ] WLKP: Full fetch complete (10096 records). [2025-09-18T22:37:07.381709] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-09-18T22:37:07.724638] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-09-18T22:37:07.769601] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-09-18T22:37:07.769711] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-09-18T22:37:07.769961] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-09-18T22:37:07.770002] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-09-18T22:37:07.770495] [DEBUG] [LOCAL ] WLKP: Trimmed 10096 records to 6570 (keeping 200 days of data) [2025-09-18T22:37:07.809603] [DEBUG] [LOCAL ] WLKP: Primary data saved (6570 records). [2025-09-18T22:37:07.809737] [INFO ] [MAIN ] WLKP: Full history saved. [2025-09-18T22:37:07.809841] [INFO ] [MAIN ] Update Progress: 2303/2372 symbols completed. WLKP took 31.6s. Estimated remaining: 10m 6s. Rate: 6.8 symbols/min [2025-09-18T22:37:07.978149] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:37:08.030292] [DEBUG] [LOCAL ] WM: Loaded 51033 existing records from primary storage. [2025-09-18T22:37:08.030440] [INFO ] [MAIN ] WM: Loaded 51033 existing records. [2025-09-18T22:37:08.210251] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:37:08.214991] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-09-18T22:37:08.214895] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-18T22:37:08.215212] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-09-18T22:37:08.218437] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-09-18T22:37:08.218511] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-09-18T22:37:08.524740] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-09-18T22:37:08.617277] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:37:09.319553] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-11. [2025-09-18T22:37:09.705811] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-18T22:37:10.119547] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-09-18T22:37:10.876336] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-18T22:37:10.919500] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-09-18T22:37:11.273320] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-18T22:37:11.279806] [INFO ] [REMOTE ] WLK: Full fetch complete (62419 records). [2025-09-18T22:37:11.279941] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-09-18T22:37:11.705361] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-09-18T22:37:11.705453] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-09-18T22:37:11.706479] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-09-18T22:37:11.706548] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-09-18T22:37:11.708480] [DEBUG] [LOCAL ] WLK: Trimmed 62419 records to 45575 (keeping 200 days of data) [2025-09-18T22:37:11.765248] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-09-18T22:37:12.015098] [DEBUG] [LOCAL ] WLK: Primary data saved (45575 records). [2025-09-18T22:37:12.015243] [INFO ] [MAIN ] WLK: Full history saved. [2025-09-18T22:37:12.016741] [INFO ] [MAIN ] Update Progress: 2304/2372 symbols completed. WLK took 36.1s. Estimated remaining: 9m 57s. Rate: 6.8 symbols/min [2025-09-18T22:37:12.185156] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:37:12.245357] [DEBUG] [LOCAL ] WMB: Loaded 53671 existing records from primary storage. [2025-09-18T22:37:12.245511] [INFO ] [MAIN ] WMB: Loaded 53671 existing records. [2025-09-18T22:37:12.423346] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:37:12.423598] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-09-18T22:37:12.423668] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-09-18T22:37:12.424950] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-09-18T22:37:12.425013] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-09-18T22:37:12.526020] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-09-18T22:37:12.798264] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:37:12.858621] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-18T22:37:12.868295] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-18T22:37:12.902269] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-18T22:37:13.319566] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-09-18T22:37:14.119570] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-09-18T22:37:14.462323] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-18T22:37:14.919584] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-09-18T22:37:15.245075] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-18T22:37:15.719680] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-09-18T22:37:16.121542] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-18T22:37:16.168851] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-18T22:37:16.519619] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-09-18T22:37:17.319558] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-09-18T22:37:17.757960] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-18T22:37:18.119550] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-18T22:37:18.188744] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T22:37:18.461531] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-18T22:37:18.462326] [INFO ] [REMOTE ] WLTG: Full fetch complete (1658 records). [2025-09-18T22:37:18.462412] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-09-18T22:37:18.646850] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-18T22:37:18.647037] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-09-18T22:37:18.647113] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-09-18T22:37:18.647200] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-18T22:37:18.647288] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-18T22:37:18.647382] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-09-18T22:37:18.647436] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-09-18T22:37:18.647543] [INFO ] [MAIN ] Update Progress: 2305/2372 symbols completed. WLTG took 38.1s. Estimated remaining: 9m 48s. Rate: 6.8 symbols/min [2025-09-18T22:37:18.816162] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:37:18.836090] [DEBUG] [LOCAL ] WMK: Loaded 14480 existing records from primary storage. [2025-09-18T22:37:18.836216] [INFO ] [MAIN ] WMK: Loaded 14480 existing records. [2025-09-18T22:37:18.924790] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-09-18T22:37:19.018428] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:37:19.018750] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-09-18T22:37:19.018810] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-09-18T22:37:19.019304] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-09-18T22:37:19.019365] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-09-18T22:37:19.415923] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:37:19.719566] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-11. [2025-09-18T22:37:20.519547] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-09-18T22:37:20.921895] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-18T22:37:20.956953] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-18T22:37:21.319604] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-11. [2025-09-18T22:37:21.485605] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-18T22:37:22.119588] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-09-18T22:37:22.896428] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-18T22:37:22.919492] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-09-18T22:37:23.719506] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-09-18T22:37:24.225881] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-18T22:37:24.324777] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-18T22:37:24.519584] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-09-18T22:37:24.977056] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-18T22:37:25.319576] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-09-18T22:37:26.119558] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-09-18T22:37:26.528921] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-18T22:37:26.803529] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-18T22:37:26.919553] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-09-18T22:37:27.047219] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-18T22:37:27.719555] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-09-18T22:37:28.519565] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-09-18T22:37:28.765219] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-18T22:37:29.259110] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T22:37:29.319498] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-09-18T22:37:29.397686] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-18T22:37:30.119558] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-09-18T22:37:30.919575] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-09-18T22:37:31.054301] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-18T22:37:31.561437] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-18T22:37:31.719530] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-09-18T22:37:31.752567] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-18T22:37:32.519507] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-09-18T22:37:32.702539] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-18T22:37:32.707219] [INFO ] [REMOTE ] WLY: Full fetch complete (43206 records). [2025-09-18T22:37:32.707376] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-09-18T22:37:33.109337] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-09-18T22:37:33.109454] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-09-18T22:37:33.110676] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-09-18T22:37:33.110772] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-09-18T22:37:33.113789] [DEBUG] [LOCAL ] WLY: Trimmed 43206 records to 30818 (keeping 200 days of data) [2025-09-18T22:37:33.319747] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-09-18T22:37:33.339505] [DEBUG] [LOCAL ] WLY: Primary data saved (30818 records). [2025-09-18T22:37:33.339694] [INFO ] [MAIN ] WLY: Full history saved. [2025-09-18T22:37:33.339861] [INFO ] [MAIN ] Update Progress: 2306/2372 symbols completed. WLY took 34.3s. Estimated remaining: 9m 40s. Rate: 6.8 symbols/min [2025-09-18T22:37:33.516591] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:37:33.562849] [DEBUG] [LOCAL ] WMS: Loaded 39601 existing records from primary storage. [2025-09-18T22:37:33.563006] [INFO ] [MAIN ] WMS: Loaded 39601 existing records. [2025-09-18T22:37:33.747848] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:37:33.748372] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-09-18T22:37:33.748439] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-09-18T22:37:33.749769] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-09-18T22:37:33.749840] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-09-18T22:37:34.104726] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:37:34.119504] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-11. [2025-09-18T22:37:34.220312] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-18T22:37:34.481460] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-18T22:37:34.919554] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-09-18T22:37:35.369285] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-18T22:37:35.719567] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-09-18T22:37:36.508368] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-18T22:37:36.519537] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-09-18T22:37:36.643602] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-18T22:37:37.319544] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-09-18T22:37:38.008973] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-18T22:37:38.016062] [INFO ] [REMOTE ] WM: Full fetch complete (73522 records). [2025-09-18T22:37:38.016189] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-09-18T22:37:38.124762] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-09-18T22:37:38.419697] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-09-18T22:37:38.419875] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-09-18T22:37:38.421015] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-09-18T22:37:38.421195] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-09-18T22:37:38.446551] [DEBUG] [LOCAL ] WM: Trimmed 73522 records to 51376 (keeping 200 days of data) [2025-09-18T22:37:38.460009] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-18T22:37:38.794791] [DEBUG] [LOCAL ] WM: Primary data saved (51376 records). [2025-09-18T22:37:38.794947] [INFO ] [MAIN ] WM: Full history saved. [2025-09-18T22:37:38.795058] [INFO ] [MAIN ] Update Progress: 2307/2372 symbols completed. WM took 31.0s. Estimated remaining: 9m 31s. Rate: 6.8 symbols/min [2025-09-18T22:37:38.924976] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-09-18T22:37:38.969493] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:37:39.038547] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-09-18T22:37:39.038970] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-18T22:37:39.039240] [INFO ] [MAIN ] WMT: Loaded 53800 existing records. [2025-09-18T22:37:39.222864] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:37:39.223138] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-09-18T22:37:39.223185] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-09-18T22:37:39.224854] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-09-18T22:37:39.224914] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-09-18T22:37:39.584872] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:37:39.719503] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-11. [2025-09-18T22:37:40.519562] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-09-18T22:37:40.557953] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-18T22:37:41.319542] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-09-18T22:37:41.531021] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-18T22:37:42.006528] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-11 (2.29 seconds). [2025-09-18T22:37:42.119504] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-09-18T22:37:42.359924] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-18T22:37:42.919590] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-09-18T22:37:43.527473] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-18T22:37:43.719597] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-09-18T22:37:44.474169] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-18T22:37:44.519522] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-09-18T22:37:44.571798] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-18T22:37:45.319562] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-09-18T22:37:46.119611] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-09-18T22:37:46.425113] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-18T22:37:46.462788] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T22:37:46.919585] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-09-18T22:37:47.719563] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-09-18T22:37:47.743755] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-18T22:37:48.351088] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-18T22:37:48.519538] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-09-18T22:37:49.307764] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T22:37:49.319506] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-09-18T22:37:50.119558] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-09-18T22:37:50.806960] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-18T22:37:50.919101] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-09-18T22:37:50.928414] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-09-18T22:37:51.719511] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-09-18T22:37:51.781255] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-18T22:37:52.173591] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-18T22:37:52.310127] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-18T22:37:52.312907] [INFO ] [REMOTE ] WMK: Full fetch complete (19136 records). [2025-09-18T22:37:52.312988] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-09-18T22:37:52.532450] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-09-18T22:37:52.721110] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-09-18T22:37:52.721190] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-09-18T22:37:52.721598] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-09-18T22:37:52.721638] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-09-18T22:37:52.723041] [DEBUG] [LOCAL ] WMK: Trimmed 19136 records to 14621 (keeping 200 days of data) [2025-09-18T22:37:52.825711] [DEBUG] [LOCAL ] WMK: Primary data saved (14621 records). [2025-09-18T22:37:52.825875] [INFO ] [MAIN ] WMK: Full history saved. [2025-09-18T22:37:52.826009] [INFO ] [MAIN ] Update Progress: 2308/2372 symbols completed. WMK took 34.2s. Estimated remaining: 9m 22s. Rate: 6.8 symbols/min [2025-09-18T22:37:53.008521] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:37:53.059805] [DEBUG] [LOCAL ] WNC: Loaded 40654 existing records from primary storage. [2025-09-18T22:37:53.059962] [INFO ] [MAIN ] WNC: Loaded 40654 existing records. [2025-09-18T22:37:53.237181] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:37:53.237465] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-09-18T22:37:53.237517] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-09-18T22:37:53.238674] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-09-18T22:37:53.238753] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-09-18T22:37:53.324879] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-09-18T22:37:53.608697] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:37:54.119604] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-09-18T22:37:54.509774] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-18T22:37:54.919795] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-11. [2025-09-18T22:37:55.299825] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-09-18T22:37:55.660441] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-18T22:37:55.719514] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-09-18T22:37:56.032249] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-18T22:37:56.040026] [INFO ] [REMOTE ] WMB: Full fetch complete (77535 records). [2025-09-18T22:37:56.040178] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-09-18T22:37:56.492180] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-09-18T22:37:56.492383] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-09-18T22:37:56.493897] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-09-18T22:37:56.494014] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-09-18T22:37:56.516161] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-18T22:37:56.523951] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-09-18T22:37:56.525423] [DEBUG] [LOCAL ] WMB: Trimmed 77535 records to 54061 (keeping 200 days of data) [2025-09-18T22:37:56.893310] [DEBUG] [LOCAL ] WMB: Primary data saved (54061 records). [2025-09-18T22:37:56.893469] [INFO ] [MAIN ] WMB: Full history saved. [2025-09-18T22:37:56.894358] [INFO ] [MAIN ] Update Progress: 2309/2372 symbols completed. WMB took 44.9s. Estimated remaining: 9m 13s. Rate: 6.8 symbols/min [2025-09-18T22:37:57.080743] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:37:57.132722] [DEBUG] [LOCAL ] WNS: Loaded 39829 existing records from primary storage. [2025-09-18T22:37:57.132889] [INFO ] [MAIN ] WNS: Loaded 39829 existing records. [2025-09-18T22:37:57.317744] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:37:57.318007] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-09-18T22:37:57.318055] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-09-18T22:37:57.318899] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-09-18T22:37:57.318972] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-09-18T22:37:57.330317] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-09-18T22:37:57.693451] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:37:57.714608] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-18T22:37:58.119557] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-09-18T22:37:58.919534] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-09-18T22:37:59.016098] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-18T22:37:59.178120] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-18T22:37:59.719573] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-11. [2025-09-18T22:38:00.519581] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-09-18T22:38:00.933767] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-18T22:38:01.319544] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-09-18T22:38:01.370621] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-18T22:38:02.031309] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-18T22:38:02.119550] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-09-18T22:38:02.594782] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-18T22:38:02.919634] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-09-18T22:38:03.585767] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-18T22:38:03.719521] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-09-18T22:38:04.124010] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-18T22:38:04.519575] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-09-18T22:38:05.207929] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-18T22:38:05.319579] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-09-18T22:38:05.810701] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-18T22:38:05.816794] [INFO ] [REMOTE ] WMS: Full fetch complete (57206 records). [2025-09-18T22:38:05.816907] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-09-18T22:38:06.124669] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-09-18T22:38:06.211253] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-09-18T22:38:06.211380] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-09-18T22:38:06.212509] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-09-18T22:38:06.212587] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-09-18T22:38:06.214283] [DEBUG] [LOCAL ] WMS: Trimmed 57206 records to 39951 (keeping 200 days of data) [2025-09-18T22:38:06.476683] [DEBUG] [LOCAL ] WMS: Primary data saved (39951 records). [2025-09-18T22:38:06.476860] [INFO ] [MAIN ] WMS: Full history saved. [2025-09-18T22:38:06.477017] [INFO ] [MAIN ] Update Progress: 2310/2372 symbols completed. WMS took 33.1s. Estimated remaining: 9m 4s. Rate: 6.8 symbols/min [2025-09-18T22:38:06.654792] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:38:06.710968] [DEBUG] [LOCAL ] WOLF: Loaded 53532 existing records from primary storage. [2025-09-18T22:38:06.711121] [INFO ] [MAIN ] WOLF: Loaded 53532 existing records. [2025-09-18T22:38:06.889146] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:38:06.889416] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-09-18T22:38:06.889465] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-09-18T22:38:06.890676] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-09-18T22:38:06.890748] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-09-18T22:38:06.924689] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-09-18T22:38:07.266385] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:38:07.317972] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-18T22:38:07.363635] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-18T22:38:07.719594] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-09-18T22:38:08.079411] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-18T22:38:08.519579] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-09-18T22:38:09.319603] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-11. [2025-09-18T22:38:09.589814] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-18T22:38:10.119580] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-09-18T22:38:10.186996] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-18T22:38:10.919591] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-09-18T22:38:11.044441] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-18T22:38:11.270552] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-11 (1.95 seconds). [2025-09-18T22:38:11.719584] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-09-18T22:38:12.519560] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-09-18T22:38:13.151800] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-18T22:38:13.319527] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-09-18T22:38:13.381609] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-18T22:38:14.119556] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-09-18T22:38:14.271959] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-18T22:38:14.919545] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-09-18T22:38:15.323331] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-18T22:38:15.719555] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-09-18T22:38:15.760739] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-18T22:38:16.519546] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-09-18T22:38:16.884127] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-18T22:38:17.001802] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-18T22:38:17.319569] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-09-18T22:38:17.517681] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-18T22:38:17.821219] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-18T22:38:17.828754] [INFO ] [REMOTE ] WMT: Full fetch complete (77964 records). [2025-09-18T22:38:17.828913] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-09-18T22:38:18.127293] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-09-18T22:38:18.228908] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-09-18T22:38:18.229010] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-09-18T22:38:18.230212] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-09-18T22:38:18.230279] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-09-18T22:38:18.232363] [DEBUG] [LOCAL ] WMT: Trimmed 77964 records to 54190 (keeping 200 days of data) [2025-09-18T22:38:18.585445] [DEBUG] [LOCAL ] WMT: Primary data saved (54190 records). [2025-09-18T22:38:18.585660] [INFO ] [MAIN ] WMT: Full history saved. [2025-09-18T22:38:18.585788] [INFO ] [MAIN ] Update Progress: 2311/2372 symbols completed. WMT took 39.8s. Estimated remaining: 8m 56s. Rate: 6.8 symbols/min [2025-09-18T22:38:18.798927] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:38:18.822421] [DEBUG] [LOCAL ] WOR: Loaded 24771 existing records from primary storage. [2025-09-18T22:38:18.822548] [INFO ] [MAIN ] WOR: Loaded 24771 existing records. [2025-09-18T22:38:18.922685] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-09-18T22:38:19.002060] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:38:19.002408] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-09-18T22:38:19.002460] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-09-18T22:38:19.003154] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-09-18T22:38:19.003215] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-09-18T22:38:19.371129] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:38:19.719588] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-09-18T22:38:19.815354] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-18T22:38:20.253262] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-18T22:38:20.519553] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-09-18T22:38:21.319557] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-11. [2025-09-18T22:38:21.797902] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-18T22:38:21.865481] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-18T22:38:22.119579] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-09-18T22:38:22.203228] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-18T22:38:22.919571] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-09-18T22:38:23.719589] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-09-18T22:38:24.081086] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-18T22:38:24.263366] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-18T22:38:24.519544] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-09-18T22:38:25.027204] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-18T22:38:25.319545] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-09-18T22:38:26.119614] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-09-18T22:38:26.153922] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-18T22:38:26.158294] [INFO ] [REMOTE ] WNC: Full fetch complete (57471 records). [2025-09-18T22:38:26.158424] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-09-18T22:38:26.566476] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-09-18T22:38:26.566686] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-09-18T22:38:26.567894] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-09-18T22:38:26.568040] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-09-18T22:38:26.569887] [DEBUG] [LOCAL ] WNC: Trimmed 57471 records to 40856 (keeping 200 days of data) [2025-09-18T22:38:26.698551] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-18T22:38:26.861851] [DEBUG] [LOCAL ] WNC: Primary data saved (40856 records). [2025-09-18T22:38:26.861989] [INFO ] [MAIN ] WNC: Full history saved. [2025-09-18T22:38:26.862076] [INFO ] [MAIN ] Update Progress: 2312/2372 symbols completed. WNC took 34.0s. Estimated remaining: 8m 47s. Rate: 6.8 symbols/min [2025-09-18T22:38:26.923678] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-09-18T22:38:27.047214] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:38:27.065844] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-18T22:38:27.072721] [INFO ] [REMOTE ] WNS: Full fetch complete (54603 records). [2025-09-18T22:38:27.072919] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-09-18T22:38:27.263457] [DEBUG] [LOCAL ] WOW: Loaded 29671 existing records from primary storage. [2025-09-18T22:38:27.297094] [INFO ] [MAIN ] WOW: Loaded 29671 existing records. [2025-09-18T22:38:27.666545] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-09-18T22:38:27.667004] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-09-18T22:38:27.685100] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-09-18T22:38:27.690687] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:38:27.690923] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-09-18T22:38:27.691506] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-09-18T22:38:27.691570] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-09-18T22:38:27.692257] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-09-18T22:38:27.692330] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-09-18T22:38:27.724129] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-09-18T22:38:27.775699] [DEBUG] [LOCAL ] WNS: Trimmed 54603 records to 40016 (keeping 200 days of data) [2025-09-18T22:38:28.161845] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:38:28.305709] [DEBUG] [LOCAL ] WNS: Primary data saved (40016 records). [2025-09-18T22:38:28.305871] [INFO ] [MAIN ] WNS: Full history saved. [2025-09-18T22:38:28.306568] [INFO ] [MAIN ] Update Progress: 2313/2372 symbols completed. WNS took 31.4s. Estimated remaining: 8m 38s. Rate: 6.8 symbols/min [2025-09-18T22:38:28.475310] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:38:28.521477] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-11. [2025-09-18T22:38:28.523208] [DEBUG] [LOCAL ] WPC: Loaded 48777 existing records from primary storage. [2025-09-18T22:38:28.523300] [INFO ] [MAIN ] WPC: Loaded 48777 existing records. [2025-09-18T22:38:28.715054] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:38:28.715357] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-09-18T22:38:28.715426] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-09-18T22:38:28.716564] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-09-18T22:38:28.716667] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-09-18T22:38:29.090378] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:38:29.106422] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-18T22:38:29.235345] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-18T22:38:29.319553] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-09-18T22:38:29.379215] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-18T22:38:30.119541] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-11. [2025-09-18T22:38:30.919603] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-09-18T22:38:31.353486] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-18T22:38:31.719546] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-09-18T22:38:31.846313] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-18T22:38:31.902383] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-18T22:38:32.519542] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-09-18T22:38:33.319552] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-09-18T22:38:33.420334] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-18T22:38:34.063908] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-18T22:38:34.119504] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-09-18T22:38:34.184374] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-18T22:38:34.919564] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-09-18T22:38:35.719613] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-09-18T22:38:36.021585] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-18T22:38:36.197682] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-18T22:38:36.519594] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-09-18T22:38:36.794889] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-18T22:38:37.319625] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-09-18T22:38:38.094610] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-18T22:38:38.119508] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-09-18T22:38:38.287326] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-18T22:38:38.919512] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-09-18T22:38:38.963054] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-18T22:38:39.719545] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-09-18T22:38:40.519550] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-09-18T22:38:40.950771] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-18T22:38:40.958324] [INFO ] [REMOTE ] WOLF: Full fetch complete (77532 records). [2025-09-18T22:38:40.958461] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-09-18T22:38:41.321763] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-09-18T22:38:41.381225] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-09-18T22:38:41.381506] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-09-18T22:38:41.382877] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-09-18T22:38:41.383010] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-09-18T22:38:41.385431] [DEBUG] [LOCAL ] WOLF: Trimmed 77532 records to 53922 (keeping 200 days of data) [2025-09-18T22:38:41.460250] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-18T22:38:41.653742] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-18T22:38:41.769501] [DEBUG] [LOCAL ] WOLF: Primary data saved (53922 records). [2025-09-18T22:38:41.769708] [INFO ] [MAIN ] WOLF: Full history saved. [2025-09-18T22:38:41.769823] [INFO ] [MAIN ] Update Progress: 2314/2372 symbols completed. WOLF took 35.3s. Estimated remaining: 8m 29s. Rate: 6.8 symbols/min [2025-09-18T22:38:41.943969] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:38:41.998538] [DEBUG] [LOCAL ] WPM: Loaded 52721 existing records from primary storage. [2025-09-18T22:38:41.998758] [INFO ] [MAIN ] WPM: Loaded 52721 existing records. [2025-09-18T22:38:42.124766] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-09-18T22:38:42.189922] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:38:42.190200] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-09-18T22:38:42.190251] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-09-18T22:38:42.191554] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-09-18T22:38:42.191617] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-09-18T22:38:42.554767] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-18T22:38:42.605580] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:38:42.919565] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-11. [2025-09-18T22:38:42.989759] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-18T22:38:43.719572] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-09-18T22:38:44.519550] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-09-18T22:38:44.885184] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-18T22:38:44.944773] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-18T22:38:45.319569] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-09-18T22:38:45.571510] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-18T22:38:46.119603] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-09-18T22:38:46.630619] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-18T22:38:46.919549] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-09-18T22:38:47.713281] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-18T22:38:47.723441] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-09-18T22:38:47.977171] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-18T22:38:48.519553] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-09-18T22:38:49.319537] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-09-18T22:38:49.391781] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-18T22:38:49.541065] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-18T22:38:50.119570] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-09-18T22:38:50.437056] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-18T22:38:50.919562] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-09-18T22:38:51.591533] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-18T22:38:51.719570] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-09-18T22:38:52.519617] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-09-18T22:38:52.798569] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-18T22:38:53.024297] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-18T22:38:53.319581] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-09-18T22:38:53.940539] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-18T22:38:54.119627] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-09-18T22:38:54.919606] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-09-18T22:38:55.232877] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-18T22:38:55.607888] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-18T22:38:55.719560] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-09-18T22:38:55.854343] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-18T22:38:55.859562] [INFO ] [REMOTE ] WOW: Full fetch complete (41225 records). [2025-09-18T22:38:55.859684] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-09-18T22:38:56.231582] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-09-18T22:38:56.231699] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-09-18T22:38:56.232524] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-09-18T22:38:56.232581] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-09-18T22:38:56.233549] [DEBUG] [LOCAL ] WOW: Trimmed 41225 records to 30017 (keeping 200 days of data) [2025-09-18T22:38:56.404715] [DEBUG] [LOCAL ] WOW: Primary data saved (30017 records). [2025-09-18T22:38:56.404988] [INFO ] [MAIN ] WOW: Full history saved. [2025-09-18T22:38:56.405135] [INFO ] [MAIN ] Update Progress: 2315/2372 symbols completed. WOW took 29.5s. Estimated remaining: 8m 21s. Rate: 6.8 symbols/min [2025-09-18T22:38:56.524777] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-09-18T22:38:56.579432] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:38:56.612673] [DEBUG] [LOCAL ] WPP: Loaded 33606 existing records from primary storage. [2025-09-18T22:38:56.612830] [INFO ] [MAIN ] WPP: Loaded 33606 existing records. [2025-09-18T22:38:56.790776] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:38:56.791047] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-09-18T22:38:56.791108] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-09-18T22:38:56.791953] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-09-18T22:38:56.792014] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-09-18T22:38:57.147321] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:38:57.319499] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-11. [2025-09-18T22:38:57.829275] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-18T22:38:58.045966] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-18T22:38:58.119499] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-09-18T22:38:58.435844] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-18T22:38:58.919578] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-09-18T22:38:59.719565] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-09-18T22:38:59.862164] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-18T22:38:59.926496] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-18T22:39:00.519545] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-09-18T22:39:01.229865] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-18T22:39:01.319598] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-09-18T22:39:01.481619] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-18T22:39:02.119590] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-09-18T22:39:02.749018] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-18T22:39:02.791458] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-18T22:39:02.794873] [INFO ] [REMOTE ] WOR: Full fetch complete (35515 records). [2025-09-18T22:39:02.794955] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-09-18T22:39:02.924742] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-09-18T22:39:03.181303] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-09-18T22:39:03.181385] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-09-18T22:39:03.182057] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-09-18T22:39:03.182120] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-09-18T22:39:03.182911] [DEBUG] [LOCAL ] WOR: Trimmed 35515 records to 24959 (keeping 200 days of data) [2025-09-18T22:39:03.333295] [DEBUG] [LOCAL ] WOR: Primary data saved (24959 records). [2025-09-18T22:39:03.333432] [INFO ] [MAIN ] WOR: Full history saved. [2025-09-18T22:39:03.333537] [INFO ] [MAIN ] Update Progress: 2316/2372 symbols completed. WOR took 44.7s. Estimated remaining: 8m 12s. Rate: 6.8 symbols/min [2025-09-18T22:39:03.502844] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:39:03.553934] [DEBUG] [LOCAL ] WRB: Loaded 50611 existing records from primary storage. [2025-09-18T22:39:03.554077] [INFO ] [MAIN ] WRB: Loaded 50611 existing records. [2025-09-18T22:39:03.728989] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-09-18T22:39:03.736541] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:39:03.736783] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-09-18T22:39:03.736863] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-09-18T22:39:03.738073] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-09-18T22:39:03.738138] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-09-18T22:39:04.105906] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:39:04.519931] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-11. [2025-09-18T22:39:04.522360] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-18T22:39:04.531420] [INFO ] [REMOTE ] WPC: Full fetch complete (70892 records). [2025-09-18T22:39:04.531525] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-09-18T22:39:04.929843] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-09-18T22:39:04.929927] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-09-18T22:39:04.931017] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-09-18T22:39:04.931082] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-09-18T22:39:04.932495] [DEBUG] [LOCAL ] WPC: Trimmed 70892 records to 49108 (keeping 200 days of data) [2025-09-18T22:39:05.237681] [DEBUG] [LOCAL ] WPC: Primary data saved (49108 records). [2025-09-18T22:39:05.237824] [INFO ] [MAIN ] WPC: Full history saved. [2025-09-18T22:39:05.239097] [INFO ] [MAIN ] Update Progress: 2317/2372 symbols completed. WPC took 36.9s. Estimated remaining: 8m 3s. Rate: 6.8 symbols/min [2025-09-18T22:39:05.319509] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-09-18T22:39:05.365350] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-18T22:39:05.987067] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-18T22:39:06.121616] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-09-18T22:39:06.125025] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-18T22:39:06.919560] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-09-18T22:39:07.719625] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-09-18T22:39:07.917692] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-18T22:39:08.519512] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-09-18T22:39:08.650051] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-18T22:39:08.791754] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-18T22:39:09.319561] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-09-18T22:39:10.028612] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T22:39:10.119564] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-09-18T22:39:10.732562] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-18T22:39:10.919559] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-09-18T22:39:11.409374] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-18T22:39:11.719593] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-09-18T22:39:11.867865] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-18T22:39:12.519555] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-09-18T22:39:13.319695] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-09-18T22:39:13.623617] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-18T22:39:13.681614] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-18T22:39:14.119540] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-09-18T22:39:14.849239] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-18T22:39:14.919561] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-09-18T22:39:15.721753] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-09-18T22:39:15.724061] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-18T22:39:15.731825] [INFO ] [REMOTE ] WPM: Full fetch complete (75609 records). [2025-09-18T22:39:15.731945] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-09-18T22:39:16.134484] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-09-18T22:39:16.134591] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-09-18T22:39:16.135718] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-09-18T22:39:16.135783] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-09-18T22:39:16.137286] [DEBUG] [LOCAL ] WPM: Trimmed 75609 records to 53099 (keeping 200 days of data) [2025-09-18T22:39:16.483834] [DEBUG] [LOCAL ] WPM: Primary data saved (53099 records). [2025-09-18T22:39:16.499186] [INFO ] [MAIN ] WPM: Full history saved. [2025-09-18T22:39:16.512317] [INFO ] [MAIN ] Update Progress: 2318/2372 symbols completed. WPM took 34.7s. Estimated remaining: 7m 54s. Rate: 6.8 symbols/min [2025-09-18T22:39:16.514394] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-18T22:39:16.525577] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-09-18T22:39:17.414070] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-18T22:39:17.423218] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-09-18T22:39:18.086512] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T22:39:18.119494] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-09-18T22:39:18.963506] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-18T22:39:18.971461] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-09-18T22:39:19.409531] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-18T22:39:19.719596] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-09-18T22:39:20.086476] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T22:39:20.091351] [INFO ] [REMOTE ] WPP: Full fetch complete (44588 records). [2025-09-18T22:39:20.091461] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-09-18T22:39:20.475096] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-09-18T22:39:20.475180] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-09-18T22:39:20.476160] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-09-18T22:39:20.476226] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-09-18T22:39:20.477321] [DEBUG] [LOCAL ] WPP: Trimmed 44588 records to 33871 (keeping 200 days of data) [2025-09-18T22:39:20.680086] [DEBUG] [LOCAL ] WPP: Primary data saved (33871 records). [2025-09-18T22:39:20.680239] [INFO ] [MAIN ] WPP: Full history saved. [2025-09-18T22:39:20.680331] [INFO ] [MAIN ] Update Progress: 2319/2372 symbols completed. WPP took 24.3s. Estimated remaining: 7m 45s. Rate: 6.8 symbols/min [2025-09-18T22:39:21.606352] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-18T22:39:21.618375] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-09-18T22:39:23.058799] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-18T22:39:23.071350] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-09-18T22:39:23.507267] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-18T22:39:23.514325] [INFO ] [REMOTE ] WRB: Full fetch complete (72858 records). [2025-09-18T22:39:23.514461] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-09-18T22:39:23.916181] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-09-18T22:39:23.916287] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-09-18T22:39:23.917522] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-09-18T22:39:23.917597] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-09-18T22:39:23.919227] [DEBUG] [LOCAL ] WRB: Trimmed 72858 records to 50994 (keeping 200 days of data) [2025-09-18T22:39:24.251477] [DEBUG] [LOCAL ] WRB: Primary data saved (50994 records). [2025-09-18T22:39:24.251633] [INFO ] [MAIN ] WRB: Full history saved. [2025-09-18T22:39:24.251798] [INFO ] [MAIN ] Update Progress: 2320/2372 symbols completed. WRB took 20.9s. Estimated remaining: 7m 36s. Rate: 6.8 symbols/min [2025-09-18T22:39:24.834568] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:39:24.943574] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:39:24.939803] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:39:24.984153] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:39:25.014080] [DEBUG] [LOCAL ] WS: Loaded 23952 existing records from primary storage. [2025-09-18T22:39:25.014414] [INFO ] [MAIN ] WS: Loaded 23952 existing records. [2025-09-18T22:39:25.154857] [DEBUG] [LOCAL ] WSO: Loaded 24680 existing records from primary storage. [2025-09-18T22:39:25.161031] [INFO ] [MAIN ] WSO: Loaded 24680 existing records. [2025-09-18T22:39:25.302859] [DEBUG] [LOCAL ] WSM: Loaded 50153 existing records from primary storage. [2025-09-18T22:39:25.332088] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:39:25.347686] [INFO ] [MAIN ] WSM: Loaded 50153 existing records. [2025-09-18T22:39:25.353218] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-09-18T22:39:25.405817] [DEBUG] [LOCAL ] WRBY: Loaded 50921 existing records from primary storage. [2025-09-18T22:39:25.409452] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-09-18T22:39:25.414865] [INFO ] [MAIN ] WRBY: Loaded 50921 existing records. [2025-09-18T22:39:25.425362] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-09-18T22:39:25.434409] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-09-18T22:39:25.848011] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:39:25.997141] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-09-18T22:39:26.010451] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:39:26.034978] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-09-18T22:39:26.064597] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-09-18T22:39:26.122619] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-09-18T22:39:26.111494] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:39:26.116795] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-09-18T22:39:26.122792] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-09-18T22:39:26.160241] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-09-18T22:39:26.160377] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-09-18T22:39:26.203950] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-09-18T22:39:26.203768] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-09-18T22:39:26.214837] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-09-18T22:39:26.286617] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-09-18T22:39:26.405991] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:39:26.468747] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-11. [2025-09-18T22:39:27.143287] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:39:27.169941] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-11. [2025-09-18T22:39:27.316828] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:39:27.339913] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-11. [2025-09-18T22:39:27.345213] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:39:27.346290] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-11. [2025-09-18T22:39:27.558357] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-18T22:39:27.563093] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-09-18T22:39:28.130080] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-18T22:39:28.134629] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-09-18T22:39:28.586524] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-18T22:39:28.596465] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-09-18T22:39:28.913416] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-18T22:39:28.919829] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-09-18T22:39:29.010426] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T22:39:29.053701] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-09-18T22:39:29.057570] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-18T22:39:29.319551] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-09-18T22:39:29.852694] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-18T22:39:30.001005] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-18T22:39:30.106521] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-18T22:39:30.119509] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-09-18T22:39:30.678576] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T22:39:30.919623] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-09-18T22:39:31.625039] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T22:39:31.719511] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-09-18T22:39:32.060818] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T22:39:32.519550] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-09-18T22:39:33.141256] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T22:39:33.319518] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-09-18T22:39:33.510887] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-18T22:39:34.119606] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-09-18T22:39:34.919602] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-09-18T22:39:35.014678] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-18T22:39:35.090953] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-18T22:39:35.719565] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-09-18T22:39:35.841080] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-18T22:39:36.519539] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-09-18T22:39:37.311695] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-18T22:39:37.321425] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-09-18T22:39:38.119546] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-09-18T22:39:38.201449] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-18T22:39:38.356736] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-18T22:39:38.919549] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-09-18T22:39:39.176565] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-18T22:39:39.719602] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-09-18T22:39:40.156293] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T22:39:40.519545] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-09-18T22:39:41.319516] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-09-18T22:39:41.424596] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-18T22:39:41.767074] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-18T22:39:42.119577] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-09-18T22:39:42.310474] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-18T22:39:42.919575] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-09-18T22:39:43.572309] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T22:39:43.719510] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-09-18T22:39:43.987834] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-18T22:39:44.519546] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-09-18T22:39:45.319571] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-09-18T22:39:45.399960] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-18T22:39:45.425304] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-18T22:39:46.119555] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-09-18T22:39:46.771292] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-18T22:39:46.919547] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-09-18T22:39:47.719608] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-09-18T22:39:48.162184] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-18T22:39:48.233714] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-18T22:39:48.519512] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-09-18T22:39:48.682311] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-18T22:39:49.319531] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-09-18T22:39:50.119599] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-09-18T22:39:50.206079] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-18T22:39:50.272282] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-18T22:39:50.919559] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-09-18T22:39:51.686323] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-18T22:39:51.719499] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-09-18T22:39:52.153381] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-18T22:39:52.160527] [INFO ] [REMOTE ] WRBY: Full fetch complete (73185 records). [2025-09-18T22:39:52.160713] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-09-18T22:39:52.528136] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-09-18T22:39:52.595220] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-09-18T22:39:52.595334] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-09-18T22:39:52.596898] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-09-18T22:39:52.597022] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-09-18T22:39:52.600970] [DEBUG] [LOCAL ] WRBY: Trimmed 73185 records to 51304 (keeping 200 days of data) [2025-09-18T22:39:52.924543] [DEBUG] [LOCAL ] WRBY: Primary data saved (51304 records). [2025-09-18T22:39:52.924732] [INFO ] [MAIN ] WRBY: Full history saved. [2025-09-18T22:39:52.925000] [INFO ] [MAIN ] Update Progress: 2321/2372 symbols completed. WRBY took 28.7s. Estimated remaining: 7m 28s. Rate: 6.8 symbols/min [2025-09-18T22:39:53.107025] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:39:53.132711] [DEBUG] [LOCAL ] WSR: Loaded 23511 existing records from primary storage. [2025-09-18T22:39:53.132865] [INFO ] [MAIN ] WSR: Loaded 23511 existing records. [2025-09-18T22:39:53.319125] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:39:53.319504] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-09-18T22:39:53.320995] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-09-18T22:39:53.321761] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-09-18T22:39:53.350845] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-18T22:39:53.349824] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-09-18T22:39:53.361636] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-09-18T22:39:53.738202] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:39:53.753941] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-18T22:39:54.119505] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-09-18T22:39:54.421130] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-18T22:39:54.424616] [INFO ] [REMOTE ] WS: Full fetch complete (36036 records). [2025-09-18T22:39:54.424748] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-09-18T22:39:54.800864] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-09-18T22:39:54.800945] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-09-18T22:39:54.801665] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-09-18T22:39:54.801730] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-09-18T22:39:54.803116] [DEBUG] [LOCAL ] WS: Trimmed 36036 records to 24126 (keeping 200 days of data) [2025-09-18T22:39:54.921840] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-11. [2025-09-18T22:39:54.974737] [DEBUG] [LOCAL ] WS: Primary data saved (24126 records). [2025-09-18T22:39:54.974882] [INFO ] [MAIN ] WS: Full history saved. [2025-09-18T22:39:54.975080] [INFO ] [MAIN ] Update Progress: 2322/2372 symbols completed. WS took 30.7s. Estimated remaining: 7m 19s. Rate: 6.8 symbols/min [2025-09-18T22:39:55.150830] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:39:55.164252] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-18T22:39:55.168994] [INFO ] [REMOTE ] WSO: Full fetch complete (33630 records). [2025-09-18T22:39:55.169105] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-09-18T22:39:55.440879] [DEBUG] [LOCAL ] WST: Loaded 38034 existing records from primary storage. [2025-09-18T22:39:55.461228] [INFO ] [MAIN ] WST: Loaded 38034 existing records. [2025-09-18T22:39:55.727102] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-09-18T22:39:55.767620] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-09-18T22:39:55.768724] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-09-18T22:39:55.792493] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-09-18T22:39:55.792786] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-09-18T22:39:55.792685] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:39:55.793209] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-09-18T22:39:55.793530] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-09-18T22:39:55.794925] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-09-18T22:39:55.794994] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-09-18T22:39:55.826675] [DEBUG] [LOCAL ] WSO: Trimmed 33630 records to 24862 (keeping 200 days of data) [2025-09-18T22:39:56.175168] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-18T22:39:56.356106] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:39:56.371265] [DEBUG] [LOCAL ] WSO: Primary data saved (24862 records). [2025-09-18T22:39:56.371347] [INFO ] [MAIN ] WSO: Full history saved. [2025-09-18T22:39:56.371448] [INFO ] [MAIN ] Update Progress: 2323/2372 symbols completed. WSO took 32.1s. Estimated remaining: 7m 10s. Rate: 6.8 symbols/min [2025-09-18T22:39:56.522169] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-09-18T22:39:56.541764] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:39:56.589332] [DEBUG] [LOCAL ] WT: Loaded 47526 existing records from primary storage. [2025-09-18T22:39:56.589487] [INFO ] [MAIN ] WT: Loaded 47526 existing records. [2025-09-18T22:39:56.765819] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:39:56.766129] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-09-18T22:39:56.766178] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-09-18T22:39:56.767252] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-09-18T22:39:56.767314] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-09-18T22:39:57.128422] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:39:57.324463] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-11. [2025-09-18T22:39:57.330125] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-18T22:39:57.369297] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-18T22:39:58.119548] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-11. [2025-09-18T22:39:58.787399] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-18T22:39:58.919596] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-09-18T22:39:59.719555] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-09-18T22:39:59.772299] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-18T22:40:00.121518] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-18T22:40:00.519558] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-09-18T22:40:01.329143] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-09-18T22:40:01.335761] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-18T22:40:01.613405] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-18T22:40:02.119601] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-09-18T22:40:02.816607] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-18T22:40:02.826796] [INFO ] [REMOTE ] WSM: Full fetch complete (72255 records). [2025-09-18T22:40:02.827121] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-09-18T22:40:02.928409] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-09-18T22:40:03.286517] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-18T22:40:03.342238] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-09-18T22:40:03.342352] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-09-18T22:40:03.343554] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-09-18T22:40:03.343633] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-09-18T22:40:03.345410] [DEBUG] [LOCAL ] WSM: Trimmed 72255 records to 50456 (keeping 200 days of data) [2025-09-18T22:40:03.683581] [DEBUG] [LOCAL ] WSM: Primary data saved (50456 records). [2025-09-18T22:40:03.683785] [INFO ] [MAIN ] WSM: Full history saved. [2025-09-18T22:40:03.683944] [INFO ] [MAIN ] Update Progress: 2324/2372 symbols completed. WSM took 39.4s. Estimated remaining: 7m 1s. Rate: 6.8 symbols/min [2025-09-18T22:40:03.727683] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-09-18T22:40:03.859553] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:40:03.903132] [DEBUG] [LOCAL ] WTI: Loaded 43725 existing records from primary storage. [2025-09-18T22:40:03.903280] [INFO ] [MAIN ] WTI: Loaded 43725 existing records. [2025-09-18T22:40:04.083312] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:40:04.083573] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-09-18T22:40:04.083621] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-09-18T22:40:04.084677] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-09-18T22:40:04.084759] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-09-18T22:40:04.454191] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:40:04.492096] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-18T22:40:04.519494] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-09-18T22:40:05.319547] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-09-18T22:40:05.476006] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-18T22:40:05.711876] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-18T22:40:06.119538] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-09-18T22:40:06.160159] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-18T22:40:06.919547] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-09-18T22:40:07.440406] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-18T22:40:07.719595] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-09-18T22:40:08.082858] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-18T22:40:08.519536] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-11. [2025-09-18T22:40:09.195233] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-18T22:40:09.319612] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-09-18T22:40:10.119536] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-09-18T22:40:10.346058] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-18T22:40:10.588175] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-18T22:40:10.919556] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-09-18T22:40:11.340017] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-18T22:40:11.719578] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-09-18T22:40:12.383332] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T22:40:12.519566] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-09-18T22:40:12.704121] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-18T22:40:13.319568] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-09-18T22:40:14.119570] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-09-18T22:40:14.316456] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-18T22:40:14.399162] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-18T22:40:14.919567] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-09-18T22:40:15.719528] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-09-18T22:40:15.798138] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-18T22:40:15.850232] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-18T22:40:16.519590] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-09-18T22:40:17.187428] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-18T22:40:17.319548] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-09-18T22:40:18.063570] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-18T22:40:18.119562] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-09-18T22:40:18.927713] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-09-18T22:40:18.956660] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-18T22:40:19.316173] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-18T22:40:19.719563] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-09-18T22:40:20.286141] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-18T22:40:20.519572] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-09-18T22:40:21.157959] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-18T22:40:21.319547] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-09-18T22:40:21.794727] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-18T22:40:22.119552] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-09-18T22:40:22.194947] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-18T22:40:22.919574] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-09-18T22:40:23.539045] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-18T22:40:23.719585] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-09-18T22:40:24.519698] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-09-18T22:40:24.698567] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-18T22:40:25.093936] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-18T22:40:25.199698] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-18T22:40:25.319591] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-09-18T22:40:26.119593] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-09-18T22:40:26.663531] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-18T22:40:26.670797] [INFO ] [REMOTE ] WT: Full fetch complete (68906 records). [2025-09-18T22:40:26.670947] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-09-18T22:40:26.924634] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-09-18T22:40:27.095259] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-09-18T22:40:27.095387] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-09-18T22:40:27.096682] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-09-18T22:40:27.096773] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-09-18T22:40:27.099316] [DEBUG] [LOCAL ] WT: Trimmed 68906 records to 47905 (keeping 200 days of data) [2025-09-18T22:40:27.403939] [DEBUG] [LOCAL ] WT: Primary data saved (47905 records). [2025-09-18T22:40:27.404104] [INFO ] [MAIN ] WT: Full history saved. [2025-09-18T22:40:27.404219] [INFO ] [MAIN ] Update Progress: 2325/2372 symbols completed. WT took 31.0s. Estimated remaining: 6m 53s. Rate: 6.8 symbols/min [2025-09-18T22:40:27.623802] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:40:27.624225] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-09-18T22:40:27.624409] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-09-18T22:40:27.624969] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-09-18T22:40:27.625114] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-18T22:40:27.625403] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-18T22:40:27.625619] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-09-18T22:40:27.722949] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-09-18T22:40:27.903872] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-18T22:40:27.961579] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-18T22:40:28.101744] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:40:28.519509] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-11. [2025-09-18T22:40:28.626673] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-18T22:40:28.630023] [INFO ] [REMOTE ] WSR: Full fetch complete (32791 records). [2025-09-18T22:40:28.630112] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-09-18T22:40:29.033377] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-09-18T22:40:29.033307] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-18T22:40:29.034495] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-09-18T22:40:29.035283] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-09-18T22:40:29.035348] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-09-18T22:40:29.036210] [DEBUG] [LOCAL ] WSR: Trimmed 32791 records to 23770 (keeping 200 days of data) [2025-09-18T22:40:29.179959] [DEBUG] [LOCAL ] WSR: Primary data saved (23770 records). [2025-09-18T22:40:29.180089] [INFO ] [MAIN ] WSR: Full history saved. [2025-09-18T22:40:29.180171] [INFO ] [MAIN ] Update Progress: 2326/2372 symbols completed. WSR took 36.3s. Estimated remaining: 6m 44s. Rate: 6.8 symbols/min [2025-09-18T22:40:29.324726] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-09-18T22:40:29.373842] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:40:29.428942] [DEBUG] [LOCAL ] WTRG: Loaded 50962 existing records from primary storage. [2025-09-18T22:40:29.429094] [INFO ] [MAIN ] WTRG: Loaded 50962 existing records. [2025-09-18T22:40:29.611337] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:40:29.611602] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-09-18T22:40:29.611679] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-09-18T22:40:29.612838] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-09-18T22:40:29.612898] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-09-18T22:40:29.990301] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:40:30.004029] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-18T22:40:30.009206] [INFO ] [REMOTE ] WST: Full fetch complete (53300 records). [2025-09-18T22:40:30.009315] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-09-18T22:40:30.124739] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-09-18T22:40:30.445117] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-09-18T22:40:30.445216] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-09-18T22:40:30.446173] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-09-18T22:40:30.446242] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-09-18T22:40:30.447553] [DEBUG] [LOCAL ] WST: Trimmed 53300 records to 38269 (keeping 200 days of data) [2025-09-18T22:40:30.691794] [DEBUG] [LOCAL ] WST: Primary data saved (38269 records). [2025-09-18T22:40:30.691979] [INFO ] [MAIN ] WST: Full history saved. [2025-09-18T22:40:30.692086] [INFO ] [MAIN ] Update Progress: 2327/2372 symbols completed. WST took 35.7s. Estimated remaining: 6m 35s. Rate: 6.8 symbols/min [2025-09-18T22:40:30.915020] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:40:30.919519] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-11. [2025-09-18T22:40:30.935764] [DEBUG] [LOCAL ] WTS: Loaded 18753 existing records from primary storage. [2025-09-18T22:40:30.935892] [INFO ] [MAIN ] WTS: Loaded 18753 existing records. [2025-09-18T22:40:31.120062] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:40:31.120313] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-09-18T22:40:31.120365] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-09-18T22:40:31.120990] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-09-18T22:40:31.121053] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-09-18T22:40:31.503239] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:40:31.719578] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-11. [2025-09-18T22:40:32.062769] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-18T22:40:32.519509] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-09-18T22:40:32.562056] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-18T22:40:32.582751] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-18T22:40:33.319553] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-09-18T22:40:33.717739] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-18T22:40:33.999853] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-18T22:40:34.119510] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-09-18T22:40:34.919551] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-09-18T22:40:35.403301] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-18T22:40:35.724693] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-09-18T22:40:35.741138] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-18T22:40:36.160045] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-18T22:40:36.519543] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-09-18T22:40:36.937335] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-18T22:40:37.319545] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-09-18T22:40:38.119538] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-09-18T22:40:38.361154] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-18T22:40:38.919603] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-09-18T22:40:39.303238] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-18T22:40:39.309018] [INFO ] [REMOTE ] WTI: Full fetch complete (64020 records). [2025-09-18T22:40:39.309198] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-09-18T22:40:39.415397] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-18T22:40:39.704796] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-09-18T22:40:39.704884] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-09-18T22:40:39.706000] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-09-18T22:40:39.706069] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-09-18T22:40:39.707380] [DEBUG] [LOCAL ] WTI: Trimmed 64020 records to 44095 (keeping 200 days of data) [2025-09-18T22:40:39.756563] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-09-18T22:40:39.965933] [DEBUG] [LOCAL ] WTI: Primary data saved (44095 records). [2025-09-18T22:40:39.966078] [INFO ] [MAIN ] WTI: Full history saved. [2025-09-18T22:40:39.966170] [INFO ] [MAIN ] Update Progress: 2328/2372 symbols completed. WTI took 36.3s. Estimated remaining: 6m 26s. Rate: 6.8 symbols/min [2025-09-18T22:40:40.141098] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:40:40.185266] [DEBUG] [LOCAL ] WTTR: Loaded 45093 existing records from primary storage. [2025-09-18T22:40:40.185426] [INFO ] [MAIN ] WTTR: Loaded 45093 existing records. [2025-09-18T22:40:40.276437] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-18T22:40:40.440787] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:40:40.441173] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-09-18T22:40:40.441240] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-09-18T22:40:40.442458] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-09-18T22:40:40.442538] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-09-18T22:40:40.524864] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-09-18T22:40:40.933008] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:40:41.033268] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-18T22:40:41.319570] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-09-18T22:40:41.844968] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-18T22:40:42.119559] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-09-18T22:40:42.635181] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-18T22:40:42.919565] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-18T22:40:43.434902] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-18T22:40:43.436030] [INFO ] [REMOTE ] WTM: Full fetch complete (2135 records). [2025-09-18T22:40:43.436101] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-09-18T22:40:43.628928] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-18T22:40:43.629141] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-09-18T22:40:43.629213] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-09-18T22:40:43.629288] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-18T22:40:43.629354] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-18T22:40:43.629392] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-09-18T22:40:43.629468] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-09-18T22:40:43.629557] [INFO ] [MAIN ] Update Progress: 2329/2372 symbols completed. WTM took 16.2s. Estimated remaining: 6m 17s. Rate: 6.8 symbols/min [2025-09-18T22:40:43.724737] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-09-18T22:40:43.810317] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:40:43.860542] [DEBUG] [LOCAL ] WU: Loaded 53445 existing records from primary storage. [2025-09-18T22:40:43.860713] [INFO ] [MAIN ] WU: Loaded 53445 existing records. [2025-09-18T22:40:44.042278] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:40:44.042522] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-09-18T22:40:44.042570] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-09-18T22:40:44.043738] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-09-18T22:40:44.043800] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-09-18T22:40:44.396712] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:40:44.519521] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-11. [2025-09-18T22:40:44.592718] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-18T22:40:45.319562] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-09-18T22:40:46.119617] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-09-18T22:40:46.323610] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-18T22:40:46.919579] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-11. [2025-09-18T22:40:47.075344] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-18T22:40:47.155110] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-18T22:40:47.719582] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-09-18T22:40:48.480574] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-18T22:40:48.519509] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-09-18T22:40:49.055200] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-18T22:40:49.319568] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-09-18T22:40:49.883534] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T22:40:50.119552] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-09-18T22:40:50.919609] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-09-18T22:40:51.051924] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-18T22:40:51.100743] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-18T22:40:51.719719] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-09-18T22:40:52.194201] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-18T22:40:52.519542] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-09-18T22:40:53.228467] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-18T22:40:53.319554] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-09-18T22:40:53.481887] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-18T22:40:54.119569] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-09-18T22:40:54.663534] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-18T22:40:54.919569] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-09-18T22:40:55.719521] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-09-18T22:40:55.745905] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-18T22:40:56.519520] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-09-18T22:40:56.605941] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-18T22:40:57.319561] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-09-18T22:40:57.400283] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-18T22:40:58.119605] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-09-18T22:40:58.247498] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-18T22:40:58.693916] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-18T22:40:58.919568] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-09-18T22:40:59.719578] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-09-18T22:40:59.794355] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-18T22:41:00.165454] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-18T22:41:00.519547] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-09-18T22:41:00.593215] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-18T22:41:01.319609] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-09-18T22:41:01.965444] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-18T22:41:02.036119] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-18T22:41:02.119578] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-09-18T22:41:02.919511] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-09-18T22:41:03.249454] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T22:41:03.719716] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-09-18T22:41:04.351153] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-18T22:41:04.519503] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-09-18T22:41:05.319516] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-09-18T22:41:05.701751] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-18T22:41:05.992127] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-18T22:41:06.119580] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-09-18T22:41:06.700843] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T22:41:06.920223] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-09-18T22:41:06.922498] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-18T22:41:07.719611] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-09-18T22:41:08.345071] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-18T22:41:08.519539] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-09-18T22:41:09.319591] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-09-18T22:41:09.663236] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-18T22:41:09.913582] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T22:41:10.119540] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-09-18T22:41:10.848890] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-18T22:41:10.919512] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-09-18T22:41:11.683332] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-18T22:41:11.719558] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-09-18T22:41:12.316071] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-18T22:41:12.519541] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-09-18T22:41:12.854502] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-18T22:41:12.861063] [INFO ] [REMOTE ] WTTR: Full fetch complete (65396 records). [2025-09-18T22:41:12.861195] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-09-18T22:41:13.245135] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-18T22:41:13.272769] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-09-18T22:41:13.272884] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-09-18T22:41:13.274451] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-09-18T22:41:13.274554] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-09-18T22:41:13.274926] [INFO ] [REMOTE ] WTS: Full fetch complete (26376 records). [2025-09-18T22:41:13.275028] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-09-18T22:41:13.320175] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-09-18T22:41:13.378811] [DEBUG] [LOCAL ] WTTR: Trimmed 65396 records to 45470 (keeping 200 days of data) [2025-09-18T22:41:13.768371] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-09-18T22:41:13.768709] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-09-18T22:41:13.769561] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-09-18T22:41:13.769661] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-09-18T22:41:13.773230] [DEBUG] [LOCAL ] WTS: Trimmed 26376 records to 18888 (keeping 200 days of data) [2025-09-18T22:41:14.009733] [DEBUG] [LOCAL ] WTS: Primary data saved (18888 records). [2025-09-18T22:41:14.010394] [INFO ] [MAIN ] WTS: Full history saved. [2025-09-18T22:41:14.010822] [INFO ] [MAIN ] Update Progress: 2330/2372 symbols completed. WTS took 43.3s. Estimated remaining: 6m 9s. Rate: 6.8 symbols/min [2025-09-18T22:41:14.120303] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-09-18T22:41:14.236617] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:41:14.286838] [DEBUG] [LOCAL ] WTTR: Primary data saved (45470 records). [2025-09-18T22:41:14.287003] [INFO ] [MAIN ] WTTR: Full history saved. [2025-09-18T22:41:14.287117] [INFO ] [MAIN ] Update Progress: 2331/2372 symbols completed. WTTR took 34.3s. Estimated remaining: 6m 0s. Rate: 6.8 symbols/min [2025-09-18T22:41:14.509360] [DEBUG] [LOCAL ] WWW: Loaded 49141 existing records from primary storage. [2025-09-18T22:41:14.509245] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:41:14.509524] [INFO ] [MAIN ] WWW: Loaded 49141 existing records. [2025-09-18T22:41:14.701173] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:41:14.701493] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-09-18T22:41:14.701577] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-09-18T22:41:14.703060] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-09-18T22:41:14.703125] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-09-18T22:41:14.883755] [DEBUG] [LOCAL ] WY: Loaded 53114 existing records from primary storage. [2025-09-18T22:41:14.892458] [INFO ] [MAIN ] WY: Loaded 53114 existing records. [2025-09-18T22:41:15.271838] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:41:15.303227] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:41:15.303975] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-11. [2025-09-18T22:41:15.304919] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-09-18T22:41:15.305092] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-09-18T22:41:15.311988] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-09-18T22:41:15.321379] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-09-18T22:41:15.356894] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-18T22:41:15.439131] [INFO ] [REMOTE ] WTRG: Full fetch complete (73036 records). [2025-09-18T22:41:15.444911] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-09-18T22:41:16.020886] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:41:16.038010] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-11. [2025-09-18T22:41:16.154506] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-09-18T22:41:16.154682] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-09-18T22:41:16.155906] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-09-18T22:41:16.155998] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-09-18T22:41:16.174104] [DEBUG] [LOCAL ] WTRG: Trimmed 73036 records to 51341 (keeping 200 days of data) [2025-09-18T22:41:16.189671] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-18T22:41:16.516843] [DEBUG] [LOCAL ] WTRG: Primary data saved (51341 records). [2025-09-18T22:41:16.516992] [INFO ] [MAIN ] WTRG: Full history saved. [2025-09-18T22:41:16.518276] [INFO ] [MAIN ] Update Progress: 2332/2372 symbols completed. WTRG took 47.3s. Estimated remaining: 5m 51s. Rate: 6.8 symbols/min [2025-09-18T22:41:16.550026] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-09-18T22:41:16.695365] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:41:16.730439] [DEBUG] [LOCAL ] XFLT: Loaded 29852 existing records from primary storage. [2025-09-18T22:41:16.730629] [INFO ] [MAIN ] XFLT: Loaded 29852 existing records. [2025-09-18T22:41:16.916771] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-18T22:41:16.956238] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:41:16.956535] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-09-18T22:41:16.956583] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-09-18T22:41:16.957427] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-09-18T22:41:16.957488] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-09-18T22:41:17.307369] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:41:17.319493] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-11. [2025-09-18T22:41:17.914170] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-18T22:41:18.119531] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-09-18T22:41:18.173163] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-18T22:41:18.329290] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-18T22:41:18.919556] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-09-18T22:41:19.441802] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-18T22:41:19.719561] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-09-18T22:41:20.385877] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-18T22:41:20.519552] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-09-18T22:41:21.319578] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-09-18T22:41:21.446882] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-18T22:41:21.455807] [INFO ] [REMOTE ] WU: Full fetch complete (77155 records). [2025-09-18T22:41:21.455974] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-09-18T22:41:21.872806] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-09-18T22:41:21.872899] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-09-18T22:41:21.874122] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-09-18T22:41:21.874189] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-09-18T22:41:21.876805] [DEBUG] [LOCAL ] WU: Trimmed 77155 records to 53835 (keeping 200 days of data) [2025-09-18T22:41:22.007721] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T22:41:22.119516] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-09-18T22:41:22.241816] [DEBUG] [LOCAL ] WU: Primary data saved (53835 records). [2025-09-18T22:41:22.241958] [INFO ] [MAIN ] WU: Full history saved. [2025-09-18T22:41:22.242044] [INFO ] [MAIN ] Update Progress: 2333/2372 symbols completed. WU took 38.6s. Estimated remaining: 5m 42s. Rate: 6.8 symbols/min [2025-09-18T22:41:22.408263] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:41:22.452908] [DEBUG] [LOCAL ] XHR: Loaded 44461 existing records from primary storage. [2025-09-18T22:41:22.453055] [INFO ] [MAIN ] XHR: Loaded 44461 existing records. [2025-09-18T22:41:22.632314] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:41:22.632556] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-09-18T22:41:22.632608] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-09-18T22:41:22.633621] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-09-18T22:41:22.633710] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-09-18T22:41:22.926366] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-09-18T22:41:23.010188] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:41:23.040666] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-18T22:41:23.453468] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-18T22:41:23.719547] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-11. [2025-09-18T22:41:24.493180] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-18T22:41:24.519549] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-09-18T22:41:25.144701] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T22:41:25.319554] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-09-18T22:41:25.458896] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-18T22:41:26.119548] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-09-18T22:41:26.845073] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-18T22:41:26.919504] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-09-18T22:41:27.151007] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-18T22:41:27.719572] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-09-18T22:41:28.519510] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-09-18T22:41:28.613068] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-18T22:41:28.968404] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-18T22:41:29.319552] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-09-18T22:41:29.740759] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-18T22:41:30.119598] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-09-18T22:41:30.919514] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-09-18T22:41:30.970302] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-18T22:41:31.553111] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-18T22:41:31.719561] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-09-18T22:41:32.330082] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-18T22:41:32.519537] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-09-18T22:41:32.817475] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-18T22:41:33.319598] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-09-18T22:41:34.101468] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-18T22:41:34.119544] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-09-18T22:41:34.919568] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-09-18T22:41:35.006336] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-18T22:41:35.539912] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-18T22:41:35.719561] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-09-18T22:41:36.161242] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T22:41:36.519545] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-09-18T22:41:37.313595] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-18T22:41:37.324240] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-09-18T22:41:37.951193] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T22:41:38.119596] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-09-18T22:41:38.757956] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-18T22:41:38.919571] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-09-18T22:41:39.512459] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-18T22:41:39.719558] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-09-18T22:41:40.525759] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-09-18T22:41:40.543122] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-18T22:41:41.319623] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-09-18T22:41:41.595814] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-18T22:41:41.627539] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-18T22:41:42.119546] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-09-18T22:41:42.825035] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-18T22:41:42.919545] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-09-18T22:41:43.644300] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-18T22:41:43.719510] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-09-18T22:41:43.867061] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-18T22:41:43.871742] [INFO ] [REMOTE ] XFLT: Full fetch complete (44692 records). [2025-09-18T22:41:43.871846] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-09-18T22:41:44.254951] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-09-18T22:41:44.255038] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-09-18T22:41:44.256031] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-09-18T22:41:44.256094] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-09-18T22:41:44.257241] [DEBUG] [LOCAL ] XFLT: Trimmed 44692 records to 30172 (keeping 200 days of data) [2025-09-18T22:41:44.450296] [DEBUG] [LOCAL ] XFLT: Primary data saved (30172 records). [2025-09-18T22:41:44.450463] [INFO ] [MAIN ] XFLT: Full history saved. [2025-09-18T22:41:44.450635] [INFO ] [MAIN ] Update Progress: 2334/2372 symbols completed. XFLT took 27.9s. Estimated remaining: 5m 34s. Rate: 6.8 symbols/min [2025-09-18T22:41:44.525616] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-09-18T22:41:44.623741] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:41:44.623939] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-09-18T22:41:44.623995] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-09-18T22:41:44.624142] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-09-18T22:41:44.624189] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-18T22:41:44.624231] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-18T22:41:44.624264] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-09-18T22:41:44.992662] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:41:45.057023] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-18T22:41:45.319582] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-09-18T22:41:46.119561] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-09-18T22:41:46.155812] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-18T22:41:46.678724] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-18T22:41:46.919548] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-11. [2025-09-18T22:41:47.168852] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:41:47.169215] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-11 [2025-09-18T22:41:47.719533] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-09-18T22:41:48.186927] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-18T22:41:48.519610] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-09-18T22:41:48.941991] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-18T22:41:48.953470] [INFO ] [REMOTE ] WWW: Full fetch complete (69605 records). [2025-09-18T22:41:48.953709] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-09-18T22:41:49.330379] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-09-18T22:41:49.383761] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-09-18T22:41:49.383932] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-09-18T22:41:49.385232] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-09-18T22:41:49.385495] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-09-18T22:41:49.402042] [DEBUG] [LOCAL ] WWW: Trimmed 69605 records to 49510 (keeping 200 days of data) [2025-09-18T22:41:49.428479] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-18T22:41:49.615248] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:41:49.649904] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-09-18T22:41:49.739451] [DEBUG] [LOCAL ] WWW: Primary data saved (49510 records). [2025-09-18T22:41:49.739595] [INFO ] [MAIN ] WWW: Full history saved. [2025-09-18T22:41:49.739839] [INFO ] [MAIN ] Update Progress: 2335/2372 symbols completed. WWW took 35.7s. Estimated remaining: 5m 25s. Rate: 6.8 symbols/min [2025-09-18T22:41:49.915949] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:41:49.980178] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-09-18T22:41:49.980324] [INFO ] [MAIN ] XOM: Loaded 53793 existing records. [2025-09-18T22:41:50.129705] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-09-18T22:41:50.162678] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:41:50.162901] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-09-18T22:41:50.162969] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-09-18T22:41:50.164949] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-09-18T22:41:50.165019] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-09-18T22:41:50.519735] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:41:50.919544] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-11. [2025-09-18T22:41:51.595248] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-18T22:41:51.719583] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-01. [2025-09-18T22:41:51.961976] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:41:51.962325] [WARN ] [REMOTE ] XIFR: No data returned for month 2025-01 [2025-09-18T22:41:52.519538] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-02. [2025-09-18T22:41:52.988838] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-11 (2.07 seconds). [2025-09-18T22:41:53.319605] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-09-18T22:41:54.119547] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-09-18T22:41:54.369286] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-18T22:41:54.919601] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-09-18T22:41:55.247378] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-18T22:41:55.255866] [INFO ] [REMOTE ] WY: Full fetch complete (76640 records). [2025-09-18T22:41:55.256057] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-09-18T22:41:55.654691] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-18T22:41:55.722617] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-03. [2025-09-18T22:41:55.771886] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-09-18T22:41:55.789919] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-09-18T22:41:55.791811] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-09-18T22:41:55.802211] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-09-18T22:41:55.809332] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-18T22:41:55.822867] [DEBUG] [LOCAL ] WY: Trimmed 76640 records to 53503 (keeping 200 days of data) [2025-09-18T22:41:56.206519] [DEBUG] [LOCAL ] WY: Primary data saved (53503 records). [2025-09-18T22:41:56.206823] [INFO ] [MAIN ] WY: Full history saved. [2025-09-18T22:41:56.206985] [INFO ] [MAIN ] Update Progress: 2336/2372 symbols completed. WY took 41.9s. Estimated remaining: 5m 16s. Rate: 6.8 symbols/min [2025-09-18T22:41:56.392087] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:41:56.435404] [DEBUG] [LOCAL ] XPER: Loaded 29548 existing records from primary storage. [2025-09-18T22:41:56.435833] [INFO ] [MAIN ] XPER: Loaded 29548 existing records. [2025-09-18T22:41:56.524795] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-09-18T22:41:56.640335] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:41:56.640802] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-09-18T22:41:56.640872] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-09-18T22:41:56.641881] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-09-18T22:41:56.641961] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-09-18T22:41:57.136806] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:41:57.319622] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-09-18T22:41:57.436677] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-18T22:41:58.119608] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-11. [2025-09-18T22:41:58.474067] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-18T22:41:58.480295] [INFO ] [REMOTE ] XHR: Full fetch complete (61449 records). [2025-09-18T22:41:58.480448] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-09-18T22:41:58.883369] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-09-18T22:41:58.883608] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-09-18T22:41:58.884758] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-09-18T22:41:58.884888] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-09-18T22:41:58.886278] [DEBUG] [LOCAL ] XHR: Trimmed 61449 records to 44783 (keeping 200 days of data) [2025-09-18T22:41:58.960264] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-04. [2025-09-18T22:41:59.051079] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-09-18T22:41:59.224104] [DEBUG] [LOCAL ] XHR: Primary data saved (44783 records). [2025-09-18T22:41:59.224262] [INFO ] [MAIN ] XHR: Full history saved. [2025-09-18T22:41:59.224379] [INFO ] [MAIN ] Update Progress: 2337/2372 symbols completed. XHR took 37.0s. Estimated remaining: 5m 7s. Rate: 6.8 symbols/min [2025-09-18T22:41:59.395886] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:41:59.455460] [DEBUG] [LOCAL ] XPEV: Loaded 53645 existing records from primary storage. [2025-09-18T22:41:59.455624] [INFO ] [MAIN ] XPEV: Loaded 53645 existing records. [2025-09-18T22:41:59.643085] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:41:59.643915] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-09-18T22:41:59.644024] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-09-18T22:41:59.651534] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-09-18T22:41:59.663019] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-09-18T22:41:59.727885] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-09-18T22:41:59.696336] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-18T22:42:00.039719] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:42:00.446464] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-18T22:42:00.519531] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-09-18T22:42:01.319580] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-05. [2025-09-18T22:42:01.696324] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-18T22:42:01.775934] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-18T22:42:02.119608] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-11. [2025-09-18T22:42:02.638107] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-18T22:42:02.919559] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-06. [2025-09-18T22:42:03.719573] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-09-18T22:42:04.471887] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-18T22:42:04.519562] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-07. [2025-09-18T22:42:04.584125] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-11 (2.46 seconds). [2025-09-18T22:42:05.319614] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-09-18T22:42:06.007876] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-18T22:42:06.119530] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-09-18T22:42:06.309708] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-18T22:42:06.919599] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-08. [2025-09-18T22:42:07.460188] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-18T22:42:07.719548] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-09-18T22:42:08.198625] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-18T22:42:08.519516] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-09. [2025-09-18T22:42:08.820777] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-18T22:42:09.319610] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-09-18T22:42:09.637677] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T22:42:09.644222] [INFO ] [REMOTE ] XIFR: Full fetch complete (53261 records). [2025-09-18T22:42:09.644534] [DEBUG] [VALIDATOR ] XIFR: Validating primary data. [2025-09-18T22:42:09.846183] [WARN ] [VALIDATOR ] XIFR: Validation failed - insufficient historical data. Have 158 unique days, need 200 days [2025-09-18T22:42:09.847071] [FATAL] [MAIN ] XIFR: Fetched primary data is invalid. Refusing to save it. [2025-09-18T22:42:09.847176] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to validation failure. [2025-09-18T22:42:09.847418] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-18T22:42:09.847559] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-18T22:42:09.847773] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-09-18T22:42:09.847977] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-09-18T22:42:09.848129] [INFO ] [MAIN ] Update Progress: 2338/2372 symbols completed. XIFR took 25.4s. Estimated remaining: 4m 59s. Rate: 6.8 symbols/min [2025-09-18T22:42:10.017570] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-18T22:42:10.073934] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:42:10.126071] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-09-18T22:42:10.128979] [DEBUG] [LOCAL ] XPO: Loaded 48354 existing records from primary storage. [2025-09-18T22:42:10.129157] [INFO ] [MAIN ] XPO: Loaded 48354 existing records. [2025-09-18T22:42:10.311502] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:42:10.311923] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-09-18T22:42:10.312004] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-09-18T22:42:10.321754] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-09-18T22:42:10.337271] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-09-18T22:42:10.415633] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-18T22:42:10.704002] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:42:10.919545] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-11. [2025-09-18T22:42:11.719594] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-09-18T22:42:12.270458] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-18T22:42:12.519525] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-09-18T22:42:12.600918] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-18T22:42:13.319553] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-09-18T22:42:13.994847] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-18T22:42:14.119599] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-09-18T22:42:14.919625] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-09-18T22:42:15.121256] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-09-18T22:42:15.197390] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-18T22:42:15.719560] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-09-18T22:42:15.750108] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-18T22:42:16.509543] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-18T22:42:16.523022] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-09-18T22:42:17.319567] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-09-18T22:42:18.119522] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-09-18T22:42:18.292989] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-18T22:42:18.360795] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-18T22:42:18.387585] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-18T22:42:18.919575] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-09-18T22:42:19.719575] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-09-18T22:42:20.354706] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-18T22:42:20.480776] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-18T22:42:20.519493] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-09-18T22:42:21.319616] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-09-18T22:42:21.966516] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-18T22:42:22.119534] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-09-18T22:42:22.680011] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-18T22:42:22.721581] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-18T22:42:22.919550] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-09-18T22:42:23.719604] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-09-18T22:42:24.153889] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-18T22:42:24.188810] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-18T22:42:24.247566] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-18T22:42:24.256356] [INFO ] [REMOTE ] XOM: Full fetch complete (77880 records). [2025-09-18T22:42:24.256481] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-09-18T22:42:24.524803] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-09-18T22:42:24.649907] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-09-18T22:42:24.649989] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-09-18T22:42:24.651087] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-09-18T22:42:24.651164] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-09-18T22:42:24.652621] [DEBUG] [LOCAL ] XOM: Trimmed 77880 records to 54183 (keeping 200 days of data) [2025-09-18T22:42:25.007564] [DEBUG] [LOCAL ] XOM: Primary data saved (54183 records). [2025-09-18T22:42:25.007774] [INFO ] [MAIN ] XOM: Full history saved. [2025-09-18T22:42:25.007907] [INFO ] [MAIN ] Update Progress: 2339/2372 symbols completed. XOM took 35.3s. Estimated remaining: 4m 50s. Rate: 6.8 symbols/min [2025-09-18T22:42:25.184344] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:42:25.223571] [DEBUG] [LOCAL ] XPOF: Loaded 38919 existing records from primary storage. [2025-09-18T22:42:25.223742] [INFO ] [MAIN ] XPOF: Loaded 38919 existing records. [2025-09-18T22:42:25.324107] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-09-18T22:42:25.405280] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:42:25.405535] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-09-18T22:42:25.405583] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-09-18T22:42:25.406384] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-09-18T22:42:25.406444] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-09-18T22:42:25.765285] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:42:25.868179] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-18T22:42:26.119588] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-11. [2025-09-18T22:42:26.919557] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-09-18T22:42:27.507445] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-18T22:42:27.580276] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-18T22:42:27.719512] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-09-18T22:42:27.984186] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-18T22:42:28.519557] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-09-18T22:42:28.595754] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-18T22:42:29.319567] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-09-18T22:42:29.555533] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-18T22:42:29.560207] [INFO ] [REMOTE ] XPER: Full fetch complete (43152 records). [2025-09-18T22:42:29.560307] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-09-18T22:42:29.943633] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-09-18T22:42:29.943768] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-09-18T22:42:29.944629] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-09-18T22:42:29.944708] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-09-18T22:42:29.945735] [DEBUG] [LOCAL ] XPER: Trimmed 43152 records to 29858 (keeping 200 days of data) [2025-09-18T22:42:30.116428] [DEBUG] [LOCAL ] XPER: Primary data saved (29858 records). [2025-09-18T22:42:30.116620] [INFO ] [MAIN ] XPER: Full history saved. [2025-09-18T22:42:30.116777] [INFO ] [MAIN ] Update Progress: 2340/2372 symbols completed. XPER took 33.9s. Estimated remaining: 4m 41s. Rate: 6.8 symbols/min [2025-09-18T22:42:30.128785] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-09-18T22:42:30.307310] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:42:30.350527] [DEBUG] [LOCAL ] XPRO: Loaded 46239 existing records from primary storage. [2025-09-18T22:42:30.350709] [INFO ] [MAIN ] XPRO: Loaded 46239 existing records. [2025-09-18T22:42:30.532701] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:42:30.532930] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-09-18T22:42:30.532979] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-09-18T22:42:30.533977] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-09-18T22:42:30.534037] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-09-18T22:42:30.913816] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:42:30.919492] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-11. [2025-09-18T22:42:30.967037] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-18T22:42:31.107101] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-18T22:42:31.719555] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-09-18T22:42:32.112752] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-18T22:42:32.519591] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-09-18T22:42:33.006839] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-18T22:42:33.319586] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-09-18T22:42:34.049394] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-18T22:42:34.119501] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-09-18T22:42:34.888501] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T22:42:34.919534] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-09-18T22:42:35.535460] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-18T22:42:35.719543] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-09-18T22:42:36.383899] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-18T22:42:36.519530] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-09-18T22:42:36.864057] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-18T22:42:37.319550] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-09-18T22:42:38.119561] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-09-18T22:42:38.704365] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-18T22:42:38.810145] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-18T22:42:38.919543] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-09-18T22:42:39.436286] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-18T22:42:39.719531] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-09-18T22:42:40.155764] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T22:42:40.519529] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-09-18T22:42:41.319553] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-09-18T22:42:41.539539] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-18T22:42:41.614612] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-18T22:42:42.119567] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-09-18T22:42:42.919615] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-09-18T22:42:43.478376] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-18T22:42:43.499248] [INFO ] [REMOTE ] XPEV: Full fetch complete (77599 records). [2025-09-18T22:42:43.508223] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-09-18T22:42:43.510371] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T22:42:43.724624] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-09-18T22:42:43.921517] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-09-18T22:42:43.921615] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-09-18T22:42:43.922780] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-09-18T22:42:43.922845] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-09-18T22:42:43.924356] [DEBUG] [LOCAL ] XPEV: Trimmed 77599 records to 54033 (keeping 200 days of data) [2025-09-18T22:42:44.254551] [DEBUG] [LOCAL ] XPEV: Primary data saved (54033 records). [2025-09-18T22:42:44.254760] [INFO ] [MAIN ] XPEV: Full history saved. [2025-09-18T22:42:44.254893] [INFO ] [MAIN ] Update Progress: 2341/2372 symbols completed. XPEV took 45.0s. Estimated remaining: 4m 32s. Rate: 6.8 symbols/min [2025-09-18T22:42:44.442357] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:42:44.471325] [DEBUG] [LOCAL ] XYF: Loaded 27743 existing records from primary storage. [2025-09-18T22:42:44.471487] [INFO ] [MAIN ] XYF: Loaded 27743 existing records. [2025-09-18T22:42:44.524821] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-09-18T22:42:44.680885] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:42:44.681684] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-09-18T22:42:44.681785] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-09-18T22:42:44.682869] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-09-18T22:42:44.683104] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-09-18T22:42:45.006151] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-18T22:42:45.104161] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:42:45.215784] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-18T22:42:45.319552] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-09-18T22:42:45.531019] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-18T22:42:45.536055] [INFO ] [REMOTE ] XPOF: Full fetch complete (51957 records). [2025-09-18T22:42:45.536150] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-09-18T22:42:45.916386] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-09-18T22:42:45.916469] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-09-18T22:42:45.917396] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-09-18T22:42:45.917460] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-09-18T22:42:45.918820] [DEBUG] [LOCAL ] XPOF: Trimmed 51957 records to 39147 (keeping 200 days of data) [2025-09-18T22:42:46.122721] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-09-18T22:42:46.146617] [DEBUG] [LOCAL ] XPOF: Primary data saved (39147 records). [2025-09-18T22:42:46.146842] [INFO ] [MAIN ] XPOF: Full history saved. [2025-09-18T22:42:46.146942] [INFO ] [MAIN ] Update Progress: 2342/2372 symbols completed. XPOF took 21.1s. Estimated remaining: 4m 23s. Rate: 6.8 symbols/min [2025-09-18T22:42:46.336409] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:42:46.392526] [DEBUG] [LOCAL ] XYL: Loaded 48208 existing records from primary storage. [2025-09-18T22:42:46.392743] [INFO ] [MAIN ] XYL: Loaded 48208 existing records. [2025-09-18T22:42:46.676753] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:42:46.677316] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-09-18T22:42:46.677413] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-09-18T22:42:46.679306] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-09-18T22:42:46.679390] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-09-18T22:42:46.920059] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-11. [2025-09-18T22:42:46.949369] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-18T22:42:47.319524] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:42:47.406770] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-18T22:42:47.466428] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-18T22:42:47.719556] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-09-18T22:42:48.519531] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-11. [2025-09-18T22:42:48.532515] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-18T22:42:49.319579] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-09-18T22:42:49.913924] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-18T22:42:50.119550] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-09-18T22:42:50.244287] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-18T22:42:50.919590] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-09-18T22:42:51.416810] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-18T22:42:51.719570] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-09-18T22:42:51.731681] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-18T22:42:52.519532] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-09-18T22:42:53.282102] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-18T22:42:53.319501] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-09-18T22:42:53.658912] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-18T22:42:54.119592] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-09-18T22:42:54.865546] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-18T22:42:54.919496] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-09-18T22:42:55.363444] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-18T22:42:55.719594] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-09-18T22:42:56.190118] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-18T22:42:56.196592] [INFO ] [REMOTE ] XPO: Full fetch complete (70135 records). [2025-09-18T22:42:56.196736] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-09-18T22:42:56.524803] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-09-18T22:42:56.596235] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-09-18T22:42:56.596327] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-09-18T22:42:56.597435] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-09-18T22:42:56.597501] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-09-18T22:42:56.599497] [DEBUG] [LOCAL ] XPO: Trimmed 70135 records to 48679 (keeping 200 days of data) [2025-09-18T22:42:56.906520] [DEBUG] [LOCAL ] XPO: Primary data saved (48679 records). [2025-09-18T22:42:56.906759] [INFO ] [MAIN ] XPO: Full history saved. [2025-09-18T22:42:56.906881] [INFO ] [MAIN ] Update Progress: 2343/2372 symbols completed. XPO took 47.1s. Estimated remaining: 4m 15s. Rate: 6.8 symbols/min [2025-09-18T22:42:57.162322] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:42:57.162633] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-09-18T22:42:57.162931] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-09-18T22:42:57.163376] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-09-18T22:42:57.163596] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-18T22:42:57.163869] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-18T22:42:57.164028] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-09-18T22:42:57.323220] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-09-18T22:42:57.512867] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-18T22:42:57.618902] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:42:58.071517] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-18T22:42:58.119512] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-11. [2025-09-18T22:42:58.295711] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-18T22:42:58.365167] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:42:58.365507] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-11 [2025-09-18T22:42:58.919546] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-09-18T22:42:59.719539] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-09-18T22:43:00.176369] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-18T22:43:00.519542] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-09-18T22:43:00.759620] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-18T22:43:00.759985] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-09-18T22:43:01.319541] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-01. [2025-09-18T22:43:01.355142] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-18T22:43:02.119588] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-09-18T22:43:02.552588] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-18T22:43:02.919548] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-09-18T22:43:03.719552] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-09-18T22:43:03.790962] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-18T22:43:04.189616] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-18T22:43:04.519588] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-09-18T22:43:04.668212] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-18T22:43:05.319621] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-02. [2025-09-18T22:43:05.941247] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-18T22:43:05.947568] [INFO ] [REMOTE ] XPRO: Full fetch complete (66636 records). [2025-09-18T22:43:05.947712] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-09-18T22:43:06.124010] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-09-18T22:43:06.351502] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-09-18T22:43:06.351588] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-09-18T22:43:06.352767] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-09-18T22:43:06.352858] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-09-18T22:43:06.354277] [DEBUG] [LOCAL ] XPRO: Trimmed 66636 records to 46557 (keeping 200 days of data) [2025-09-18T22:43:06.631356] [DEBUG] [LOCAL ] XPRO: Primary data saved (46557 records). [2025-09-18T22:43:06.631524] [INFO ] [MAIN ] XPRO: Full history saved. [2025-09-18T22:43:06.631626] [INFO ] [MAIN ] Update Progress: 2344/2372 symbols completed. XPRO took 36.5s. Estimated remaining: 4m 6s. Rate: 6.8 symbols/min [2025-09-18T22:43:06.811796] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:43:06.846634] [DEBUG] [LOCAL ] YALA: Loaded 37334 existing records from primary storage. [2025-09-18T22:43:06.846814] [INFO ] [MAIN ] YALA: Loaded 37334 existing records. [2025-09-18T22:43:06.926705] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-09-18T22:43:07.039252] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:43:07.039495] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-09-18T22:43:07.039556] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-09-18T22:43:07.040324] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-09-18T22:43:07.040384] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-09-18T22:43:07.424088] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:43:07.472121] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-18T22:43:07.719572] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-03. [2025-09-18T22:43:08.195742] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-18T22:43:08.226896] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-18T22:43:08.519549] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-09-18T22:43:09.319555] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-11. [2025-09-18T22:43:09.754761] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-18T22:43:09.988075] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-18T22:43:10.119513] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-09-18T22:43:10.176835] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-18T22:43:10.919543] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-09-18T22:43:11.719534] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-04. [2025-09-18T22:43:11.827187] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-18T22:43:11.937966] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-18T22:43:12.519536] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-09-18T22:43:13.319585] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-09-18T22:43:13.488261] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-18T22:43:13.795184] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-18T22:43:14.119556] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-05. [2025-09-18T22:43:14.528787] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-18T22:43:14.919582] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-09-18T22:43:15.719597] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-09-18T22:43:16.024199] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-18T22:43:16.284883] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-18T22:43:16.518569] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-18T22:43:16.521844] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-06. [2025-09-18T22:43:16.523360] [INFO ] [REMOTE ] XYF: Full fetch complete (31056 records). [2025-09-18T22:43:16.523441] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-09-18T22:43:16.895476] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-09-18T22:43:16.895560] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-09-18T22:43:16.896211] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-09-18T22:43:16.896275] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-09-18T22:43:16.897096] [DEBUG] [LOCAL ] XYF: Trimmed 31056 records to 27857 (keeping 200 days of data) [2025-09-18T22:43:17.061981] [DEBUG] [LOCAL ] XYF: Primary data saved (27857 records). [2025-09-18T22:43:17.062153] [INFO ] [MAIN ] XYF: Full history saved. [2025-09-18T22:43:17.062256] [INFO ] [MAIN ] Update Progress: 2345/2372 symbols completed. XYF took 32.8s. Estimated remaining: 3m 57s. Rate: 6.8 symbols/min [2025-09-18T22:43:17.232471] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:43:17.274601] [DEBUG] [LOCAL ] YELP: Loaded 45369 existing records from primary storage. [2025-09-18T22:43:17.274793] [INFO ] [MAIN ] YELP: Loaded 45369 existing records. [2025-09-18T22:43:17.328750] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-09-18T22:43:17.453175] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:43:17.453396] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-09-18T22:43:17.453444] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-09-18T22:43:17.454461] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-09-18T22:43:17.454522] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-09-18T22:43:17.815131] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:43:18.119551] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-11. [2025-09-18T22:43:18.841049] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-18T22:43:18.870564] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-18T22:43:18.919502] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-09-18T22:43:19.526877] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-18T22:43:19.719581] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-09-18T22:43:20.274445] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-18T22:43:20.519544] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-09-18T22:43:21.324752] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-09-18T22:43:21.340485] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-18T22:43:22.016059] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-18T22:43:22.119509] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-09-18T22:43:22.780233] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-18T22:43:22.919566] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-09-18T22:43:23.662881] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-18T22:43:23.719510] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-09-18T22:43:24.376267] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-18T22:43:24.519549] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-09-18T22:43:24.724677] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-18T22:43:25.319548] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-07. [2025-09-18T22:43:25.899013] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-18T22:43:26.119573] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-09-18T22:43:26.849962] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-18T22:43:26.857374] [INFO ] [REMOTE ] XYL: Full fetch complete (69816 records). [2025-09-18T22:43:26.857543] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-09-18T22:43:26.924893] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-09-18T22:43:27.271303] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-09-18T22:43:27.271399] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-09-18T22:43:27.272532] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-09-18T22:43:27.272597] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-09-18T22:43:27.274027] [DEBUG] [LOCAL ] XYL: Trimmed 69816 records to 48586 (keeping 200 days of data) [2025-09-18T22:43:27.425858] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-18T22:43:27.642447] [DEBUG] [LOCAL ] XYL: Primary data saved (48586 records). [2025-09-18T22:43:27.642598] [INFO ] [MAIN ] XYL: Full history saved. [2025-09-18T22:43:27.642716] [INFO ] [MAIN ] Update Progress: 2346/2372 symbols completed. XYL took 41.5s. Estimated remaining: 3m 48s. Rate: 6.8 symbols/min [2025-09-18T22:43:27.724900] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-09-18T22:43:27.834991] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:43:27.888962] [DEBUG] [LOCAL ] YETI: Loaded 52527 existing records from primary storage. [2025-09-18T22:43:27.889120] [INFO ] [MAIN ] YETI: Loaded 52527 existing records. [2025-09-18T22:43:28.085120] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:43:28.085374] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-09-18T22:43:28.085422] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-09-18T22:43:28.086544] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-09-18T22:43:28.086605] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-09-18T22:43:28.449199] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:43:28.472945] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-18T22:43:28.519535] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-11. [2025-09-18T22:43:29.253231] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-18T22:43:29.319512] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-09-18T22:43:30.031080] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-18T22:43:30.116724] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-18T22:43:30.120584] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-08. [2025-09-18T22:43:30.122575] [INFO ] [REMOTE ] YALA: Full fetch complete (46601 records). [2025-09-18T22:43:30.122690] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-09-18T22:43:30.509710] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-09-18T22:43:30.509802] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-09-18T22:43:30.510793] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-09-18T22:43:30.510858] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-09-18T22:43:30.511955] [DEBUG] [LOCAL ] YALA: Trimmed 46601 records to 37536 (keeping 200 days of data) [2025-09-18T22:43:30.718261] [DEBUG] [LOCAL ] YALA: Primary data saved (37536 records). [2025-09-18T22:43:30.718409] [INFO ] [MAIN ] YALA: Full history saved. [2025-09-18T22:43:30.718501] [INFO ] [MAIN ] Update Progress: 2347/2372 symbols completed. YALA took 24.1s. Estimated remaining: 3m 40s. Rate: 6.8 symbols/min [2025-09-18T22:43:30.896757] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:43:30.919548] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-09-18T22:43:30.937416] [DEBUG] [LOCAL ] YEXT: Loaded 43383 existing records from primary storage. [2025-09-18T22:43:30.937578] [INFO ] [MAIN ] YEXT: Loaded 43383 existing records. [2025-09-18T22:43:31.116516] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:43:31.116804] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-09-18T22:43:31.116855] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-09-18T22:43:31.117873] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-09-18T22:43:31.117932] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-09-18T22:43:31.468465] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:43:31.719547] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-11. [2025-09-18T22:43:32.221910] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-18T22:43:32.367560] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-18T22:43:32.519524] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-09. [2025-09-18T22:43:33.239741] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-18T22:43:33.247882] [INFO ] [REMOTE ] XYZ: Full fetch complete (65057 records). [2025-09-18T22:43:33.248086] [DEBUG] [VALIDATOR ] XYZ: Validating primary data. [2025-09-18T22:43:33.323116] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-09-18T22:43:33.457578] [WARN ] [VALIDATOR ] XYZ: Validation failed - insufficient historical data. Have 167 unique days, need 200 days [2025-09-18T22:43:33.458451] [FATAL] [MAIN ] XYZ: Fetched primary data is invalid. Refusing to save it. [2025-09-18T22:43:33.458606] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to validation failure. [2025-09-18T22:43:33.458809] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-18T22:43:33.459101] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-18T22:43:33.459166] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-09-18T22:43:33.473141] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-09-18T22:43:33.473291] [INFO ] [MAIN ] Update Progress: 2348/2372 symbols completed. XYZ took 36.6s. Estimated remaining: 3m 31s. Rate: 6.8 symbols/min [2025-09-18T22:43:33.517080] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-18T22:43:33.665690] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:43:33.724075] [DEBUG] [LOCAL ] YMM: Loaded 52713 existing records from primary storage. [2025-09-18T22:43:33.724236] [INFO ] [MAIN ] YMM: Loaded 52713 existing records. [2025-09-18T22:43:33.905546] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:43:33.905842] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-09-18T22:43:33.905915] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-09-18T22:43:33.907285] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-09-18T22:43:33.907360] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-09-18T22:43:34.124921] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-09-18T22:43:34.303150] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:43:34.919574] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-09-18T22:43:35.090357] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-18T22:43:35.503692] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-18T22:43:35.719568] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-09-18T22:43:36.165106] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-18T22:43:36.519544] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-09-18T22:43:37.056605] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-18T22:43:37.319569] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-09-18T22:43:37.639473] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-18T22:43:38.119548] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-09-18T22:43:38.793950] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-18T22:43:38.919569] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-11. [2025-09-18T22:43:39.715275] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-18T22:43:39.727980] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-09-18T22:43:40.347176] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-18T22:43:40.519495] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-09-18T22:43:41.132223] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-18T22:43:41.319595] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-09-18T22:43:41.720384] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-18T22:43:42.119562] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-09-18T22:43:42.736295] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-18T22:43:42.919549] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-09-18T22:43:43.719568] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-09-18T22:43:43.845051] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-18T22:43:44.095314] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-18T22:43:44.519558] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-09-18T22:43:45.319515] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-09-18T22:43:45.381799] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-18T22:43:46.100431] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-18T22:43:46.119497] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-09-18T22:43:46.754272] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-18T22:43:46.919516] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-09-18T22:43:47.475385] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-18T22:43:47.719552] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-09-18T22:43:48.236361] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-18T22:43:48.519581] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-09-18T22:43:48.856191] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-18T22:43:49.319561] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-09-18T22:43:50.119598] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-09-18T22:43:50.323373] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-18T22:43:50.849846] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-18T22:43:50.919505] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-09-18T22:43:51.341084] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-18T22:43:51.347717] [INFO ] [REMOTE ] YELP: Full fetch complete (64004 records). [2025-09-18T22:43:51.347866] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-09-18T22:43:51.723211] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-09-18T22:43:51.740158] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-09-18T22:43:51.740219] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-09-18T22:43:51.741242] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-09-18T22:43:51.741417] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-09-18T22:43:51.742823] [DEBUG] [LOCAL ] YELP: Trimmed 64004 records to 45701 (keeping 200 days of data) [2025-09-18T22:43:52.012603] [DEBUG] [LOCAL ] YELP: Primary data saved (45701 records). [2025-09-18T22:43:52.012766] [INFO ] [MAIN ] YELP: Full history saved. [2025-09-18T22:43:52.012890] [INFO ] [MAIN ] Update Progress: 2349/2372 symbols completed. YELP took 35.0s. Estimated remaining: 3m 22s. Rate: 6.8 symbols/min [2025-09-18T22:43:52.200750] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:43:52.249677] [DEBUG] [LOCAL ] YOU: Loaded 49955 existing records from primary storage. [2025-09-18T22:43:52.249836] [INFO ] [MAIN ] YOU: Loaded 49955 existing records. [2025-09-18T22:43:52.438533] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:43:52.438860] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-09-18T22:43:52.438993] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-09-18T22:43:52.440171] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-09-18T22:43:52.440235] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-09-18T22:43:52.524979] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-09-18T22:43:52.646057] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-18T22:43:52.862919] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:43:53.319562] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-09-18T22:43:53.478924] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-18T22:43:54.087290] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-18T22:43:54.119501] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-09-18T22:43:54.919213] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-18T22:43:54.930898] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-11. [2025-09-18T22:43:55.642883] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-18T22:43:55.719582] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-09-18T22:43:56.519598] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-09-18T22:43:56.856839] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-18T22:43:57.324211] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-09-18T22:43:57.331056] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-18T22:43:57.726225] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-18T22:43:58.119626] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-09-18T22:43:58.838884] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-18T22:43:58.919582] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-09-18T22:43:59.418206] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-18T22:43:59.719559] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-09-18T22:44:00.519603] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-09-18T22:44:00.766966] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-18T22:44:01.077199] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T22:44:01.319565] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-09-18T22:44:01.968390] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-18T22:44:01.976247] [INFO ] [REMOTE ] YETI: Full fetch complete (75246 records). [2025-09-18T22:44:01.976451] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-09-18T22:44:02.124632] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-09-18T22:44:02.454865] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-09-18T22:44:02.454961] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-09-18T22:44:02.456172] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-09-18T22:44:02.456242] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-09-18T22:44:02.457851] [DEBUG] [LOCAL ] YETI: Trimmed 75246 records to 52894 (keeping 200 days of data) [2025-09-18T22:44:02.811299] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-18T22:44:02.841266] [DEBUG] [LOCAL ] YETI: Primary data saved (52894 records). [2025-09-18T22:44:02.841399] [INFO ] [MAIN ] YETI: Full history saved. [2025-09-18T22:44:02.841525] [INFO ] [MAIN ] Update Progress: 2350/2372 symbols completed. YETI took 35.2s. Estimated remaining: 3m 13s. Rate: 6.8 symbols/min [2025-09-18T22:44:02.924952] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-09-18T22:44:03.018342] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:44:03.074619] [DEBUG] [LOCAL ] YPF: Loaded 50452 existing records from primary storage. [2025-09-18T22:44:03.074859] [INFO ] [MAIN ] YPF: Loaded 50452 existing records. [2025-09-18T22:44:03.256624] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:44:03.256952] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-09-18T22:44:03.257024] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-09-18T22:44:03.258160] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-09-18T22:44:03.258257] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-09-18T22:44:03.630507] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-18T22:44:03.671782] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:44:03.671913] [INFO ] [REMOTE ] YEXT: Full fetch complete (63345 records). [2025-09-18T22:44:03.672162] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-09-18T22:44:03.728127] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-09-18T22:44:04.075144] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-09-18T22:44:04.075234] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-09-18T22:44:04.076389] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-09-18T22:44:04.076480] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-09-18T22:44:04.079741] [DEBUG] [LOCAL ] YEXT: Trimmed 63345 records to 43747 (keeping 200 days of data) [2025-09-18T22:44:04.355003] [DEBUG] [LOCAL ] YEXT: Primary data saved (43747 records). [2025-09-18T22:44:04.355705] [INFO ] [MAIN ] YEXT: Full history saved. [2025-09-18T22:44:04.355926] [INFO ] [MAIN ] Update Progress: 2351/2372 symbols completed. YEXT took 33.6s. Estimated remaining: 3m 4s. Rate: 6.8 symbols/min [2025-09-18T22:44:04.524391] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-11. [2025-09-18T22:44:04.551548] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:44:04.594192] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-18T22:44:04.599457] [DEBUG] [LOCAL ] YRD: Loaded 12651 existing records from primary storage. [2025-09-18T22:44:04.609966] [INFO ] [MAIN ] YRD: Loaded 12651 existing records. [2025-09-18T22:44:04.788854] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:44:04.789132] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-09-18T22:44:04.789815] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-09-18T22:44:04.790326] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-09-18T22:44:04.790386] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-09-18T22:44:05.149493] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:44:05.226047] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-18T22:44:05.319565] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-11. [2025-09-18T22:44:06.119600] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-09-18T22:44:06.446950] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-18T22:44:06.447675] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-18T22:44:06.919594] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-09-18T22:44:07.719579] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-09-18T22:44:07.801146] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-18T22:44:07.947317] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-18T22:44:08.519604] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-09-18T22:44:09.319604] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-09-18T22:44:09.545931] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-18T22:44:09.921416] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-18T22:44:10.073033] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-18T22:44:10.119503] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-09-18T22:44:10.919558] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-09-18T22:44:11.719582] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-09-18T22:44:11.886411] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-18T22:44:11.897961] [INFO ] [REMOTE ] YMM: Full fetch complete (76294 records). [2025-09-18T22:44:11.898111] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-09-18T22:44:12.328940] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-09-18T22:44:12.329098] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-09-18T22:44:12.330353] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-09-18T22:44:12.330419] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-09-18T22:44:12.331976] [DEBUG] [LOCAL ] YMM: Trimmed 76294 records to 53095 (keeping 200 days of data) [2025-09-18T22:44:12.525919] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-09-18T22:44:12.599025] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-18T22:44:12.725811] [DEBUG] [LOCAL ] YMM: Primary data saved (53095 records). [2025-09-18T22:44:12.725954] [INFO ] [MAIN ] YMM: Full history saved. [2025-09-18T22:44:12.727370] [INFO ] [MAIN ] Update Progress: 2352/2372 symbols completed. YMM took 39.2s. Estimated remaining: 2m 56s. Rate: 6.8 symbols/min [2025-09-18T22:44:12.899951] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:44:12.929085] [DEBUG] [LOCAL ] YSG: Loaded 24658 existing records from primary storage. [2025-09-18T22:44:12.929256] [INFO ] [MAIN ] YSG: Loaded 24658 existing records. [2025-09-18T22:44:13.121119] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:44:13.121506] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-09-18T22:44:13.121566] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-09-18T22:44:13.122248] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-09-18T22:44:13.122309] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-09-18T22:44:13.320469] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-09-18T22:44:13.499294] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:44:13.512807] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-18T22:44:13.547044] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-18T22:44:14.119560] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-11. [2025-09-18T22:44:14.919539] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-09-18T22:44:15.012892] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-18T22:44:15.041475] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-18T22:44:15.719544] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-09-18T22:44:16.519527] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-09-18T22:44:16.583347] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-18T22:44:16.685063] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-18T22:44:17.313299] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-18T22:44:17.319491] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-09-18T22:44:18.087418] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-18T22:44:18.119498] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-09-18T22:44:18.767996] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-18T22:44:18.919587] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-09-18T22:44:19.719600] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-09-18T22:44:20.365461] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-18T22:44:20.519513] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-09-18T22:44:20.607233] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-18T22:44:21.319545] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-09-18T22:44:22.119783] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-09-18T22:44:22.121092] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-18T22:44:22.815099] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-18T22:44:22.919552] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-09-18T22:44:22.988277] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-18T22:44:23.719607] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-09-18T22:44:24.519555] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-09-18T22:44:24.661255] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-18T22:44:25.106852] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-18T22:44:25.275102] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-18T22:44:25.319570] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-09-18T22:44:26.119557] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-09-18T22:44:26.139755] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-18T22:44:26.919556] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-09-18T22:44:27.665024] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-18T22:44:27.719505] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-09-18T22:44:27.770881] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-18T22:44:28.519603] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-09-18T22:44:29.160003] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-18T22:44:29.166843] [INFO ] [REMOTE ] YOU: Full fetch complete (72113 records). [2025-09-18T22:44:29.166961] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-09-18T22:44:29.327491] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-09-18T22:44:29.563754] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-09-18T22:44:29.563838] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-09-18T22:44:29.565092] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-09-18T22:44:29.565161] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-09-18T22:44:29.568946] [DEBUG] [LOCAL ] YOU: Trimmed 72113 records to 50326 (keeping 200 days of data) [2025-09-18T22:44:29.895480] [DEBUG] [LOCAL ] YOU: Primary data saved (50326 records). [2025-09-18T22:44:29.895635] [INFO ] [MAIN ] YOU: Full history saved. [2025-09-18T22:44:29.895759] [INFO ] [MAIN ] Update Progress: 2353/2372 symbols completed. YOU took 37.9s. Estimated remaining: 2m 47s. Rate: 6.8 symbols/min [2025-09-18T22:44:30.087546] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:44:30.093510] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-18T22:44:30.128564] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-09-18T22:44:30.180840] [DEBUG] [LOCAL ] YUM: Loaded 51314 existing records from primary storage. [2025-09-18T22:44:30.181025] [INFO ] [MAIN ] YUM: Loaded 51314 existing records. [2025-09-18T22:44:30.228556] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-18T22:44:30.383053] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:44:30.383350] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-09-18T22:44:30.383399] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-09-18T22:44:30.384669] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-09-18T22:44:30.384752] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-09-18T22:44:30.761197] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:44:30.919505] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-11. [2025-09-18T22:44:31.016019] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-18T22:44:31.719547] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-09-18T22:44:32.519717] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-09-18T22:44:32.704064] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-18T22:44:32.721804] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-18T22:44:33.241267] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-18T22:44:33.243365] [INFO ] [REMOTE ] YRD: Full fetch complete (19442 records). [2025-09-18T22:44:33.243457] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-09-18T22:44:33.324683] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-09-18T22:44:33.640350] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-09-18T22:44:33.640461] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-09-18T22:44:33.641025] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-09-18T22:44:33.641092] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-09-18T22:44:33.641873] [DEBUG] [LOCAL ] YRD: Trimmed 19442 records to 12743 (keeping 200 days of data) [2025-09-18T22:44:33.721098] [DEBUG] [LOCAL ] YRD: Primary data saved (12743 records). [2025-09-18T22:44:33.721243] [INFO ] [MAIN ] YRD: Full history saved. [2025-09-18T22:44:33.721354] [INFO ] [MAIN ] Update Progress: 2354/2372 symbols completed. YRD took 29.4s. Estimated remaining: 2m 38s. Rate: 6.8 symbols/min [2025-09-18T22:44:33.913934] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:44:33.972104] [DEBUG] [LOCAL ] YUMC: Loaded 52730 existing records from primary storage. [2025-09-18T22:44:33.972296] [INFO ] [MAIN ] YUMC: Loaded 52730 existing records. [2025-09-18T22:44:34.124619] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-09-18T22:44:34.198309] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:44:34.198604] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-09-18T22:44:34.198718] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-09-18T22:44:34.200743] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-09-18T22:44:34.200821] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-09-18T22:44:34.633762] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:44:34.656011] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-18T22:44:34.919545] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-11. [2025-09-18T22:44:35.719558] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-09-18T22:44:36.054869] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-18T22:44:36.411667] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-18T22:44:36.519541] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-09-18T22:44:36.853103] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-18T22:44:37.319546] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-09-18T22:44:38.029485] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-18T22:44:38.119525] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-09-18T22:44:38.580042] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-18T22:44:38.919548] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-09-18T22:44:39.439985] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-18T22:44:39.719571] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-09-18T22:44:40.519568] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-09-18T22:44:40.702818] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-18T22:44:41.235675] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T22:44:41.319511] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-09-18T22:44:42.048448] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-18T22:44:42.119516] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-09-18T22:44:42.613782] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-18T22:44:42.919525] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-09-18T22:44:43.147410] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-18T22:44:43.719613] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-09-18T22:44:44.519604] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-09-18T22:44:44.696458] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-18T22:44:45.289452] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-18T22:44:45.312235] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-18T22:44:45.316211] [INFO ] [REMOTE ] YSG: Full fetch complete (32870 records). [2025-09-18T22:44:45.316290] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-09-18T22:44:45.327817] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-09-18T22:44:45.695699] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-09-18T22:44:45.695811] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-09-18T22:44:45.696457] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-09-18T22:44:45.696526] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-09-18T22:44:45.697398] [DEBUG] [LOCAL ] YSG: Trimmed 32870 records to 24787 (keeping 200 days of data) [2025-09-18T22:44:45.837129] [DEBUG] [LOCAL ] YSG: Primary data saved (24787 records). [2025-09-18T22:44:45.837263] [INFO ] [MAIN ] YSG: Full history saved. [2025-09-18T22:44:45.837359] [INFO ] [MAIN ] Update Progress: 2355/2372 symbols completed. YSG took 33.1s. Estimated remaining: 2m 29s. Rate: 6.8 symbols/min [2025-09-18T22:44:46.008252] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:44:46.062685] [DEBUG] [LOCAL ] ZBH: Loaded 51212 existing records from primary storage. [2025-09-18T22:44:46.062848] [INFO ] [MAIN ] ZBH: Loaded 51212 existing records. [2025-09-18T22:44:46.126673] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-09-18T22:44:46.249968] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:44:46.250243] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-09-18T22:44:46.250291] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-09-18T22:44:46.251408] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-09-18T22:44:46.251467] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-09-18T22:44:46.604277] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:44:46.919592] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-09-18T22:44:46.953277] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-18T22:44:46.961401] [INFO ] [REMOTE ] YPF: Full fetch complete (73373 records). [2025-09-18T22:44:46.961567] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-09-18T22:44:47.395033] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-09-18T22:44:47.395168] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-09-18T22:44:47.396563] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-09-18T22:44:47.396631] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-09-18T22:44:47.399222] [DEBUG] [LOCAL ] YPF: Trimmed 73373 records to 50842 (keeping 200 days of data) [2025-09-18T22:44:47.714689] [DEBUG] [LOCAL ] YPF: Primary data saved (50842 records). [2025-09-18T22:44:47.714882] [INFO ] [MAIN ] YPF: Full history saved. [2025-09-18T22:44:47.714996] [INFO ] [MAIN ] Update Progress: 2356/2372 symbols completed. YPF took 44.9s. Estimated remaining: 2m 20s. Rate: 6.8 symbols/min [2025-09-18T22:44:47.747142] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-11. [2025-09-18T22:44:47.895388] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:44:47.913429] [DEBUG] [LOCAL ] ZEPP: Loaded 16029 existing records from primary storage. [2025-09-18T22:44:47.913567] [INFO ] [MAIN ] ZEPP: Loaded 16029 existing records. [2025-09-18T22:44:48.137839] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:44:48.138365] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-09-18T22:44:48.138431] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-09-18T22:44:48.139007] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-09-18T22:44:48.139188] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-09-18T22:44:48.488445] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-18T22:44:48.555238] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-09-18T22:44:48.554959] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:44:48.591330] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-18T22:44:49.319514] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-11. [2025-09-18T22:44:49.347104] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-18T22:44:49.820852] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-18T22:44:50.119555] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-09-18T22:44:50.455290] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-18T22:44:50.556376] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-18T22:44:50.919555] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-09-18T22:44:51.343304] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-18T22:44:51.719580] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-09-18T22:44:52.157141] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-18T22:44:52.519692] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-09-18T22:44:53.008314] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-18T22:44:53.319556] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-09-18T22:44:53.774480] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-18T22:44:54.119569] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-09-18T22:44:54.919552] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-09-18T22:44:55.719560] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-09-18T22:44:55.900360] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-18T22:44:56.519523] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-09-18T22:44:56.605253] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-18T22:44:57.053913] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-18T22:44:57.319549] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-09-18T22:44:58.070671] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-18T22:44:58.119522] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-09-18T22:44:58.919564] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-09-18T22:44:59.300949] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-18T22:44:59.319007] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-18T22:44:59.719557] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-09-18T22:44:59.760299] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T22:45:00.519595] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-09-18T22:45:01.173185] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-18T22:45:01.319613] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-09-18T22:45:01.516913] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-18T22:45:01.768411] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-18T22:45:01.776822] [INFO ] [REMOTE ] YUM: Full fetch complete (74198 records). [2025-09-18T22:45:01.777108] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-09-18T22:45:02.124876] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-09-18T22:45:02.292253] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-09-18T22:45:02.292416] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-09-18T22:45:02.294489] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-09-18T22:45:02.294572] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-09-18T22:45:02.297163] [DEBUG] [LOCAL ] YUM: Trimmed 74198 records to 51701 (keeping 200 days of data) [2025-09-18T22:45:02.661424] [DEBUG] [LOCAL ] YUM: Primary data saved (51701 records). [2025-09-18T22:45:02.661676] [INFO ] [MAIN ] YUM: Full history saved. [2025-09-18T22:45:02.661820] [INFO ] [MAIN ] Update Progress: 2357/2372 symbols completed. YUM took 32.8s. Estimated remaining: 2m 12s. Rate: 6.8 symbols/min [2025-09-18T22:45:02.919589] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-09-18T22:45:03.602901] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-18T22:45:03.719579] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-09-18T22:45:04.077703] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-18T22:45:04.519606] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-09-18T22:45:05.197748] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-18T22:45:05.319611] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-09-18T22:45:05.983419] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-18T22:45:06.119601] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-09-18T22:45:06.878552] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-18T22:45:06.919572] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-09-18T22:45:07.506026] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-18T22:45:07.719587] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-09-18T22:45:08.519603] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-09-18T22:45:08.920110] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-18T22:45:09.090190] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-18T22:45:09.319596] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-09-18T22:45:09.715281] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-18T22:45:09.720288] [INFO ] [REMOTE ] ZEPP: Full fetch complete (17540 records). [2025-09-18T22:45:09.720403] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-09-18T22:45:10.125198] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-09-18T22:45:10.125345] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-09-18T22:45:10.125905] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-09-18T22:45:10.124877] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-09-18T22:45:10.126084] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-09-18T22:45:10.127855] [DEBUG] [LOCAL ] ZEPP: Trimmed 17540 records to 16264 (keeping 200 days of data) [2025-09-18T22:45:10.228547] [DEBUG] [LOCAL ] ZEPP: Primary data saved (16264 records). [2025-09-18T22:45:10.228777] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-09-18T22:45:10.228884] [INFO ] [MAIN ] Update Progress: 2358/2372 symbols completed. ZEPP took 22.5s. Estimated remaining: 2m 3s. Rate: 6.8 symbols/min [2025-09-18T22:45:11.271193] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-18T22:45:11.283115] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-09-18T22:45:11.494896] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-18T22:45:11.502303] [INFO ] [REMOTE ] YUMC: Full fetch complete (75945 records). [2025-09-18T22:45:11.502442] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-09-18T22:45:11.922199] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-09-18T22:45:11.922295] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-09-18T22:45:11.923470] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-09-18T22:45:11.923536] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-09-18T22:45:11.925249] [DEBUG] [LOCAL ] YUMC: Trimmed 75945 records to 53118 (keeping 200 days of data) [2025-09-18T22:45:12.261419] [DEBUG] [LOCAL ] YUMC: Primary data saved (53118 records). [2025-09-18T22:45:12.261573] [INFO ] [MAIN ] YUMC: Full history saved. [2025-09-18T22:45:12.261696] [INFO ] [MAIN ] Update Progress: 2359/2372 symbols completed. YUMC took 38.5s. Estimated remaining: 1m 54s. Rate: 6.8 symbols/min [2025-09-18T22:45:12.718331] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-18T22:45:12.729034] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-09-18T22:45:14.335964] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-18T22:45:14.347334] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-09-18T22:45:15.970475] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-18T22:45:15.981348] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-09-18T22:45:16.718255] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-18T22:45:16.725338] [INFO ] [REMOTE ] ZBH: Full fetch complete (73571 records). [2025-09-18T22:45:16.725484] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-09-18T22:45:17.123709] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-09-18T22:45:17.123845] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-09-18T22:45:17.125278] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-09-18T22:45:17.125346] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-09-18T22:45:17.127622] [DEBUG] [LOCAL ] ZBH: Trimmed 73571 records to 51591 (keeping 200 days of data) [2025-09-18T22:45:17.452228] [DEBUG] [LOCAL ] ZBH: Primary data saved (51591 records). [2025-09-18T22:45:17.452377] [INFO ] [MAIN ] ZBH: Full history saved. [2025-09-18T22:45:17.453061] [INFO ] [MAIN ] Update Progress: 2360/2372 symbols completed. ZBH took 31.6s. Estimated remaining: 1m 45s. Rate: 6.8 symbols/min [2025-09-18T22:45:18.047383] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:45:18.115454] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:45:18.188788] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:45:18.205613] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:45:18.244264] [DEBUG] [LOCAL ] ZH: Loaded 27184 existing records from primary storage. [2025-09-18T22:45:18.244476] [INFO ] [MAIN ] ZH: Loaded 27184 existing records. [2025-09-18T22:45:18.340005] [DEBUG] [LOCAL ] ZGN: Loaded 40911 existing records from primary storage. [2025-09-18T22:45:18.356284] [INFO ] [MAIN ] ZGN: Loaded 40911 existing records. [2025-09-18T22:45:18.592245] [DEBUG] [LOCAL ] ZIM: Loaded 53551 existing records from primary storage. [2025-09-18T22:45:18.603365] [DEBUG] [LOCAL ] ZETA: Loaded 53595 existing records from primary storage. [2025-09-18T22:45:18.609082] [INFO ] [MAIN ] ZIM: Loaded 53551 existing records. [2025-09-18T22:45:18.632206] [INFO ] [MAIN ] ZETA: Loaded 53595 existing records. [2025-09-18T22:45:18.664332] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:45:18.867729] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-09-18T22:45:18.893552] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:45:18.893700] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-09-18T22:45:18.968474] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-09-18T22:45:18.971841] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-09-18T22:45:18.972236] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-09-18T22:45:18.987815] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-09-18T22:45:19.014461] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-09-18T22:45:19.048395] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-09-18T22:45:19.214248] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:45:19.262953] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:45:19.318393] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-09-18T22:45:19.334219] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-09-18T22:45:19.355972] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-09-18T22:45:19.388377] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-09-18T22:45:19.417624] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-09-18T22:45:19.417729] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-09-18T22:45:19.453078] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-09-18T22:45:19.477144] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-09-18T22:45:20.090312] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:45:20.131833] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-11. [2025-09-18T22:45:20.445911] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:45:20.463061] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-11. [2025-09-18T22:45:20.588080] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:45:20.598831] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-11. [2025-09-18T22:45:20.629548] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:45:20.629945] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-11. [2025-09-18T22:45:21.293078] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-18T22:45:21.301202] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-09-18T22:45:22.079790] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-18T22:45:22.090731] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-09-18T22:45:22.129182] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-18T22:45:22.134947] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-09-18T22:45:22.782406] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-11 (2.18 seconds). [2025-09-18T22:45:22.793188] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-09-18T22:45:22.837815] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-11 (2.21 seconds). [2025-09-18T22:45:22.848317] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-09-18T22:45:23.186324] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-18T22:45:23.195001] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-09-18T22:45:23.222156] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-18T22:45:23.229563] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-09-18T22:45:24.484355] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-18T22:45:24.493316] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-09-18T22:45:24.761842] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-18T22:45:24.775686] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-09-18T22:45:24.865033] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-18T22:45:24.881188] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-09-18T22:45:25.135213] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-18T22:45:25.319627] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-09-18T22:45:25.526721] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-18T22:45:26.003745] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T22:45:26.119548] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-09-18T22:45:26.894441] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-18T22:45:26.919505] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-09-18T22:45:27.286597] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-18T22:45:27.500210] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-18T22:45:27.719581] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-09-18T22:45:28.519588] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-09-18T22:45:28.735618] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-18T22:45:28.778220] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-18T22:45:29.319548] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-09-18T22:45:30.119535] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-09-18T22:45:30.661636] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-18T22:45:30.896001] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-18T22:45:30.919496] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-09-18T22:45:31.370618] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-18T22:45:31.719509] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-09-18T22:45:31.996986] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-18T22:45:32.519544] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-09-18T22:45:33.319554] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-09-18T22:45:33.793046] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-18T22:45:33.917365] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-18T22:45:34.119561] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-09-18T22:45:34.919552] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-09-18T22:45:35.205811] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-18T22:45:35.332515] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-18T22:45:35.719569] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-09-18T22:45:36.272968] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-18T22:45:36.519566] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-09-18T22:45:37.319590] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-09-18T22:45:37.693470] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-18T22:45:37.697938] [INFO ] [REMOTE ] ZH: Full fetch complete (39687 records). [2025-09-18T22:45:37.698048] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-09-18T22:45:38.099491] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-09-18T22:45:38.099599] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-09-18T22:45:38.100435] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-09-18T22:45:38.100682] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-09-18T22:45:38.113086] [DEBUG] [LOCAL ] ZH: Trimmed 39687 records to 27380 (keeping 200 days of data) [2025-09-18T22:45:38.129213] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-09-18T22:45:38.138934] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-18T22:45:38.301982] [DEBUG] [LOCAL ] ZH: Primary data saved (27380 records). [2025-09-18T22:45:38.302154] [INFO ] [MAIN ] ZH: Full history saved. [2025-09-18T22:45:38.302257] [INFO ] [MAIN ] Update Progress: 2361/2372 symbols completed. ZH took 20.8s. Estimated remaining: 1m 37s. Rate: 6.8 symbols/min [2025-09-18T22:45:38.493873] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:45:38.536402] [DEBUG] [LOCAL ] ZIP: Loaded 44608 existing records from primary storage. [2025-09-18T22:45:38.536553] [INFO ] [MAIN ] ZIP: Loaded 44608 existing records. [2025-09-18T22:45:38.744144] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:45:38.744567] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-09-18T22:45:38.744728] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-09-18T22:45:38.753357] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-09-18T22:45:38.766637] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-09-18T22:45:38.839802] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-18T22:45:38.924666] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-09-18T22:45:39.158613] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:45:39.719631] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-11. [2025-09-18T22:45:39.873810] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-18T22:45:40.500704] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-18T22:45:40.519491] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-09-18T22:45:40.901027] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-18T22:45:41.319586] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-09-18T22:45:41.880291] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-18T22:45:42.119584] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-09-18T22:45:42.919586] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-09-18T22:45:43.206540] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-18T22:45:43.661707] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-18T22:45:43.719505] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-09-18T22:45:44.003497] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-18T22:45:44.519579] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-09-18T22:45:45.319586] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-09-18T22:45:45.638242] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-18T22:45:45.644432] [INFO ] [REMOTE ] ZGN: Full fetch complete (58355 records). [2025-09-18T22:45:45.644575] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-09-18T22:45:46.065816] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-09-18T22:45:46.065958] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-09-18T22:45:46.066972] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-09-18T22:45:46.067054] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-09-18T22:45:46.085962] [DEBUG] [LOCAL ] ZGN: Trimmed 58355 records to 41220 (keeping 200 days of data) [2025-09-18T22:45:46.170859] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-09-18T22:45:46.119506] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-18T22:45:46.390838] [DEBUG] [LOCAL ] ZGN: Primary data saved (41220 records). [2025-09-18T22:45:46.391015] [INFO ] [MAIN ] ZGN: Full history saved. [2025-09-18T22:45:46.391184] [INFO ] [MAIN ] Update Progress: 2362/2372 symbols completed. ZGN took 28.9s. Estimated remaining: 1m 28s. Rate: 6.8 symbols/min [2025-09-18T22:45:46.576367] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:45:46.617602] [DEBUG] [LOCAL ] ZK: Loaded 40105 existing records from primary storage. [2025-09-18T22:45:46.617839] [INFO ] [MAIN ] ZK: Loaded 40105 existing records. [2025-09-18T22:45:46.802494] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:45:46.802788] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-09-18T22:45:46.802841] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-09-18T22:45:46.803781] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-09-18T22:45:46.803841] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-09-18T22:45:46.925011] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-09-18T22:45:47.169071] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:45:47.241074] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-18T22:45:47.481916] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-18T22:45:47.719548] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-09-18T22:45:48.519573] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-11. [2025-09-18T22:45:49.056242] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-18T22:45:49.319591] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-09-18T22:45:49.974229] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-18T22:45:50.019716] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-18T22:45:50.119589] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-09-18T22:45:50.320110] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-18T22:45:50.919598] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-09-18T22:45:51.685204] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-18T22:45:51.719492] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-09-18T22:45:52.519690] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-09-18T22:45:52.880802] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-18T22:45:53.042275] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-18T22:45:53.319540] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-09-18T22:45:54.119575] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-09-18T22:45:54.352019] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-18T22:45:54.360353] [INFO ] [REMOTE ] ZIM: Full fetch complete (77512 records). [2025-09-18T22:45:54.360497] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-09-18T22:45:54.805327] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-09-18T22:45:54.805680] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-09-18T22:45:54.807362] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-09-18T22:45:54.808571] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-09-18T22:45:54.808473] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-18T22:45:54.818471] [DEBUG] [LOCAL ] ZIM: Trimmed 77512 records to 53941 (keeping 200 days of data) [2025-09-18T22:45:54.919692] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-09-18T22:45:55.169031] [DEBUG] [LOCAL ] ZIM: Primary data saved (53941 records). [2025-09-18T22:45:55.169225] [INFO ] [MAIN ] ZIM: Full history saved. [2025-09-18T22:45:55.171492] [INFO ] [MAIN ] Update Progress: 2363/2372 symbols completed. ZIM took 37.7s. Estimated remaining: 1m 19s. Rate: 6.8 symbols/min [2025-09-18T22:45:55.348160] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:45:55.360633] [DEBUG] [LOCAL ] ZKH: Loaded 8027 existing records from primary storage. [2025-09-18T22:45:55.360948] [INFO ] [MAIN ] ZKH: Loaded 8027 existing records. [2025-09-18T22:45:55.542419] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:45:55.542731] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-09-18T22:45:55.542794] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-09-18T22:45:55.543105] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-09-18T22:45:55.543165] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-09-18T22:45:55.726768] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-09-18T22:45:55.914052] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:45:56.387632] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-18T22:45:56.519554] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-09-18T22:45:56.636732] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-18T22:45:57.064934] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-18T22:45:57.319612] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-09-18T22:45:58.119602] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-11. [2025-09-18T22:45:58.647314] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-18T22:45:58.656200] [INFO ] [REMOTE ] ZETA: Full fetch complete (77640 records). [2025-09-18T22:45:58.656390] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-09-18T22:45:58.765350] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-18T22:45:58.920780] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-09-18T22:45:59.034626] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-18T22:45:59.148750] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-09-18T22:45:59.148843] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-09-18T22:45:59.150023] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-09-18T22:45:59.150115] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-09-18T22:45:59.156161] [DEBUG] [LOCAL ] ZETA: Trimmed 77640 records to 53985 (keeping 200 days of data) [2025-09-18T22:45:59.527356] [DEBUG] [LOCAL ] ZETA: Primary data saved (53985 records). [2025-09-18T22:45:59.527553] [INFO ] [MAIN ] ZETA: Full history saved. [2025-09-18T22:45:59.527849] [INFO ] [MAIN ] Update Progress: 2364/2372 symbols completed. ZETA took 42.1s. Estimated remaining: 1m 10s. Rate: 6.8 symbols/min [2025-09-18T22:45:59.661708] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-18T22:45:59.727857] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-09-18T22:45:59.732181] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:45:59.784226] [DEBUG] [LOCAL ] ZTO: Loaded 50213 existing records from primary storage. [2025-09-18T22:45:59.784384] [INFO ] [MAIN ] ZTO: Loaded 50213 existing records. [2025-09-18T22:45:59.976844] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:45:59.977102] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-09-18T22:45:59.977154] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-09-18T22:45:59.978211] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-09-18T22:45:59.978284] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-09-18T22:46:00.368015] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:46:00.375231] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-18T22:46:00.519543] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-09-18T22:46:01.319622] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-11. [2025-09-18T22:46:01.890885] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-18T22:46:02.119557] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-09-18T22:46:02.919603] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-09-18T22:46:03.041410] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-18T22:46:03.363017] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-18T22:46:03.719591] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-09-18T22:46:04.510671] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-18T22:46:04.519760] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-09-18T22:46:05.129384] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-18T22:46:05.231534] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-18T22:46:05.319552] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-09-18T22:46:06.119564] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-09-18T22:46:06.919561] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-09-18T22:46:07.178203] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-18T22:46:07.323988] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-18T22:46:07.412551] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-18T22:46:07.719567] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-09-18T22:46:08.370905] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-18T22:46:08.519561] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-09-18T22:46:08.998390] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-18T22:46:09.319567] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-09-18T22:46:10.119543] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-09-18T22:46:10.522015] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-18T22:46:10.919593] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-09-18T22:46:11.719571] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-09-18T22:46:11.894948] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-18T22:46:12.069171] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-18T22:46:12.157245] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-18T22:46:12.519552] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-09-18T22:46:13.319565] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-09-18T22:46:14.119575] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-09-18T22:46:14.183129] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-18T22:46:14.428423] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-18T22:46:14.436730] [INFO ] [REMOTE ] ZK: Full fetch complete (57246 records). [2025-09-18T22:46:14.436870] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-09-18T22:46:14.856295] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-09-18T22:46:14.856449] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-09-18T22:46:14.857597] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-09-18T22:46:14.857792] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-09-18T22:46:14.859879] [DEBUG] [LOCAL ] ZK: Trimmed 57246 records to 40457 (keeping 200 days of data) [2025-09-18T22:46:14.924673] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-09-18T22:46:15.147464] [DEBUG] [LOCAL ] ZK: Primary data saved (40457 records). [2025-09-18T22:46:15.147598] [INFO ] [MAIN ] ZK: Full history saved. [2025-09-18T22:46:15.147728] [INFO ] [MAIN ] Update Progress: 2365/2372 symbols completed. ZK took 28.8s. Estimated remaining: 1m 1s. Rate: 6.8 symbols/min [2025-09-18T22:46:15.326691] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:46:15.345388] [DEBUG] [LOCAL ] ZTR: Loaded 16881 existing records from primary storage. [2025-09-18T22:46:15.345534] [INFO ] [MAIN ] ZTR: Loaded 16881 existing records. [2025-09-18T22:46:15.548874] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-18T22:46:15.580703] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:46:15.582009] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-09-18T22:46:15.582071] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-09-18T22:46:15.582756] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-09-18T22:46:15.582826] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-09-18T22:46:15.733893] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-09-18T22:46:15.979566] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:46:15.992563] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-18T22:46:16.519604] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-11. [2025-09-18T22:46:17.194019] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-18T22:46:17.224110] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-18T22:46:17.319543] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-09-18T22:46:18.119578] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-09-18T22:46:18.732207] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-18T22:46:18.737919] [INFO ] [REMOTE ] ZIP: Full fetch complete (59047 records). [2025-09-18T22:46:18.738058] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-09-18T22:46:18.927723] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-09-18T22:46:19.147747] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-09-18T22:46:19.147841] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-09-18T22:46:19.148933] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-09-18T22:46:19.149000] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-09-18T22:46:19.150369] [DEBUG] [LOCAL ] ZIP: Trimmed 59047 records to 44909 (keeping 200 days of data) [2025-09-18T22:46:19.415456] [DEBUG] [LOCAL ] ZIP: Primary data saved (44909 records). [2025-09-18T22:46:19.415591] [INFO ] [MAIN ] ZIP: Full history saved. [2025-09-18T22:46:19.415721] [INFO ] [MAIN ] Update Progress: 2366/2372 symbols completed. ZIP took 41.1s. Estimated remaining: 52.7s. Rate: 6.8 symbols/min [2025-09-18T22:46:19.593761] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:46:19.656779] [DEBUG] [LOCAL ] ZTS: Loaded 52987 existing records from primary storage. [2025-09-18T22:46:19.656927] [INFO ] [MAIN ] ZTS: Loaded 52987 existing records. [2025-09-18T22:46:19.724987] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-09-18T22:46:19.855148] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:46:19.855627] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-09-18T22:46:19.855761] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-09-18T22:46:19.861887] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-09-18T22:46:19.866826] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-09-18T22:46:19.915178] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-18T22:46:20.021070] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-18T22:46:20.292847] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:46:20.519534] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-11. [2025-09-18T22:46:20.555277] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-18T22:46:21.319547] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-09-18T22:46:22.036899] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-18T22:46:22.038605] [INFO ] [REMOTE ] ZKH: Full fetch complete (11795 records). [2025-09-18T22:46:22.038706] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-09-18T22:46:22.126202] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-09-18T22:46:22.468985] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-09-18T22:46:22.469677] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-09-18T22:46:22.471020] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-11 (1.95 seconds). [2025-09-18T22:46:22.469997] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-09-18T22:46:22.480678] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-09-18T22:46:22.481802] [DEBUG] [LOCAL ] ZKH: Trimmed 11795 records to 8114 (keeping 200 days of data) [2025-09-18T22:46:22.532402] [DEBUG] [LOCAL ] ZKH: Primary data saved (8114 records). [2025-09-18T22:46:22.532538] [INFO ] [MAIN ] ZKH: Full history saved. [2025-09-18T22:46:22.532626] [INFO ] [MAIN ] Update Progress: 2367/2372 symbols completed. ZKH took 27.4s. Estimated remaining: 43.9s. Rate: 6.8 symbols/min [2025-09-18T22:46:22.711028] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:46:22.768064] [DEBUG] [LOCAL ] ZVIA: Loaded 35388 existing records from primary storage. [2025-09-18T22:46:22.768210] [INFO ] [MAIN ] ZVIA: Loaded 35388 existing records. [2025-09-18T22:46:22.924729] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-09-18T22:46:22.955152] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:46:22.956266] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-09-18T22:46:22.956317] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-09-18T22:46:22.957383] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-09-18T22:46:22.957450] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-09-18T22:46:23.332830] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:46:23.348106] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-18T22:46:23.719535] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-09-18T22:46:24.519572] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-09-18T22:46:25.000941] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-18T22:46:25.079933] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-18T22:46:25.319684] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-09-18T22:46:25.439534] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-18T22:46:26.119560] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-11. [2025-09-18T22:46:26.919554] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-09-18T22:46:27.176387] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-18T22:46:27.204180] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-18T22:46:27.719547] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-09-18T22:46:28.482313] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-18T22:46:28.519588] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-09-18T22:46:29.319568] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-09-18T22:46:29.573581] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-18T22:46:29.878889] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-18T22:46:30.119546] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-09-18T22:46:30.600264] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-18T22:46:30.919616] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-09-18T22:46:31.701125] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-18T22:46:31.719505] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-09-18T22:46:32.271844] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-18T22:46:32.519586] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-09-18T22:46:32.672266] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-18T22:46:33.319561] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-09-18T22:46:34.119576] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-09-18T22:46:34.158181] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-18T22:46:34.390619] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-18T22:46:34.919537] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-09-18T22:46:35.349957] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-18T22:46:35.719542] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-09-18T22:46:36.228232] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-18T22:46:36.235803] [INFO ] [REMOTE ] ZTO: Full fetch complete (73118 records). [2025-09-18T22:46:36.236015] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-09-18T22:46:36.529399] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-09-18T22:46:36.772614] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-09-18T22:46:36.772798] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-09-18T22:46:36.774850] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-09-18T22:46:36.774958] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-09-18T22:46:36.777250] [DEBUG] [LOCAL ] ZTO: Trimmed 73118 records to 50566 (keeping 200 days of data) [2025-09-18T22:46:36.956103] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-18T22:46:37.201770] [DEBUG] [LOCAL ] ZTO: Primary data saved (50566 records). [2025-09-18T22:46:37.201947] [INFO ] [MAIN ] ZTO: Full history saved. [2025-09-18T22:46:37.202044] [INFO ] [MAIN ] Update Progress: 2368/2372 symbols completed. ZTO took 37.7s. Estimated remaining: 35.1s. Rate: 6.8 symbols/min [2025-09-18T22:46:37.324785] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-09-18T22:46:37.398889] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-10 to 2025-09-18. [2025-09-18T22:46:37.447155] [DEBUG] [LOCAL ] ZWS: Loaded 42567 existing records from primary storage. [2025-09-18T22:46:37.447322] [INFO ] [MAIN ] ZWS: Loaded 42567 existing records. [2025-09-18T22:46:37.648019] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-11-29 for 200 day retention. Performing full refresh. [2025-09-18T22:46:37.648403] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-09-18T22:46:37.648569] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-09-18T22:46:37.655375] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-09-18T22:46:37.665764] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-09-18T22:46:37.672448] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-18T22:46:38.069705] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-11-29 to 2025-09-18 (requires 11 months of data pull). [2025-09-18T22:46:38.119519] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-11. [2025-09-18T22:46:38.911557] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-18T22:46:38.922357] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-09-18T22:46:39.683826] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-18T22:46:39.719548] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-09-18T22:46:40.153236] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-18T22:46:40.519575] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-09-18T22:46:41.218790] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-18T22:46:41.319569] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-09-18T22:46:41.903373] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-18T22:46:42.119565] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-09-18T22:46:42.524063] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-18T22:46:42.919612] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-09-18T22:46:43.359770] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-18T22:46:43.719537] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-09-18T22:46:44.519563] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-09-18T22:46:44.570064] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-18T22:46:44.898932] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-18T22:46:45.319555] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-09-18T22:46:46.044219] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-18T22:46:46.073752] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-18T22:46:46.119500] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-09-18T22:46:46.919606] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-09-18T22:46:47.719607] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-09-18T22:46:47.977150] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-18T22:46:48.060373] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-18T22:46:48.066546] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52372 records). [2025-09-18T22:46:48.066683] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-09-18T22:46:48.487529] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-09-18T22:46:48.487620] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-09-18T22:46:48.488703] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-09-18T22:46:48.488794] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-09-18T22:46:48.490034] [DEBUG] [LOCAL ] ZVIA: Trimmed 52372 records to 35635 (keeping 200 days of data) [2025-09-18T22:46:48.545138] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-09-18T22:46:48.722887] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35635 records). [2025-09-18T22:46:48.723055] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-09-18T22:46:48.723160] [INFO ] [MAIN ] Update Progress: 2369/2372 symbols completed. ZVIA took 26.2s. Estimated remaining: 26.3s. Rate: 6.8 symbols/min [2025-09-18T22:46:49.009613] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-18T22:46:49.319567] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-09-18T22:46:50.120735] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-09-18T22:46:50.123911] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-18T22:46:50.256909] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-18T22:46:50.919563] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-09-18T22:46:51.723321] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-09-18T22:46:51.725900] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-18T22:46:52.519561] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-09-18T22:46:52.621308] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-18T22:46:52.657139] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-18T22:46:53.319560] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-09-18T22:46:53.985136] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-18T22:46:54.071262] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-18T22:46:54.078837] [INFO ] [REMOTE ] ZTS: Full fetch complete (76529 records). [2025-09-18T22:46:54.078983] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-09-18T22:46:54.127131] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-09-18T22:46:54.525739] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-09-18T22:46:54.525884] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-09-18T22:46:54.527202] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-09-18T22:46:54.527284] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-09-18T22:46:54.529053] [DEBUG] [LOCAL ] ZTS: Trimmed 76529 records to 53375 (keeping 200 days of data) [2025-09-18T22:46:54.893174] [DEBUG] [LOCAL ] ZTS: Primary data saved (53375 records). [2025-09-18T22:46:54.893887] [INFO ] [MAIN ] ZTS: Full history saved. [2025-09-18T22:46:54.896173] [INFO ] [MAIN ] Update Progress: 2370/2372 symbols completed. ZTS took 35.5s. Estimated remaining: 17.6s. Rate: 6.8 symbols/min [2025-09-18T22:46:54.919584] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-09-18T22:46:55.055817] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-18T22:46:55.719568] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-09-18T22:46:56.471547] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-18T22:46:56.523134] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-18T22:46:56.522307] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-09-18T22:46:56.526690] [INFO ] [REMOTE ] ZTR: Full fetch complete (26990 records). [2025-09-18T22:46:56.526789] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-09-18T22:46:56.907261] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-09-18T22:46:56.907341] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-09-18T22:46:56.907965] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-09-18T22:46:56.908084] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-09-18T22:46:56.908829] [DEBUG] [LOCAL ] ZTR: Trimmed 26990 records to 16956 (keeping 200 days of data) [2025-09-18T22:46:57.008672] [DEBUG] [LOCAL ] ZTR: Primary data saved (16956 records). [2025-09-18T22:46:57.008827] [INFO ] [MAIN ] ZTR: Full history saved. [2025-09-18T22:46:57.008933] [INFO ] [MAIN ] Update Progress: 2371/2372 symbols completed. ZTR took 41.9s. Estimated remaining: 8.8s. Rate: 6.8 symbols/min [2025-09-18T22:46:57.924090] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-18T22:46:57.931859] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-09-18T22:46:59.630510] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-18T22:46:59.640545] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-09-18T22:47:01.410260] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-18T22:47:01.421555] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-09-18T22:47:02.960756] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-18T22:47:02.967309] [INFO ] [REMOTE ] ZWS: Full fetch complete (61761 records). [2025-09-18T22:47:02.967461] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-09-18T22:47:03.365519] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-09-18T22:47:03.365602] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-09-18T22:47:03.366575] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-09-18T22:47:03.366638] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-09-18T22:47:03.367939] [DEBUG] [LOCAL ] ZWS: Trimmed 61761 records to 42869 (keeping 200 days of data) [2025-09-18T22:47:03.630565] [DEBUG] [LOCAL ] ZWS: Primary data saved (42869 records). [2025-09-18T22:47:03.630719] [INFO ] [MAIN ] ZWS: Full history saved. [2025-09-18T22:47:03.630822] [INFO ] [MAIN ] Update Progress: 2372/2372 symbols completed. ZWS took 26.4s. Estimated remaining: 0.0s. Rate: 6.8 symbols/min [2025-09-18T22:47:03.632501] [INFO ] [MAIN ] Parallel update completed in 5h 47m 0s [2025-09-18T22:47:03.632670] [WARN ] [MAIN ] Failed symbols (297): AAM, AACT, AAMI, A, AA, AAUC, AB, ACV, AD, ACRE... [2025-09-18T22:47:03.632767] [INFO ] [MAIN ] Update success rate: 87.5% (2075/2372 symbols) [2025-09-18T22:47:04.592382] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2075/2372 @ 87.48%)' [2025-09-18T22:47:04.593489] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-18T22:47:04.593859] [INFO ] [STATE ] Last completion updated: 2025-09-18T22:47:04.593571 [2025-09-18T22:47:04.594077] [WARN ] [STATE ] State set to: RUNNING [2025-09-18T22:47:04.594178] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-18T22:47:04.594344] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-18T22:47:04.594427] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-18T22:47:04.596393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-09-18T22:47:04.596758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-09-18T22:47:04.597106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-09-18T22:47:04.597412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLOW.csv [2025-09-18T22:47:04.597671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-09-18T22:47:04.598063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-09-18T22:47:04.598451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-09-18T22:47:04.598822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-09-18T22:47:04.599203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-09-18T22:47:04.599687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-09-18T22:47:04.600037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-09-18T22:47:04.600457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-09-18T22:47:04.600785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-09-18T22:47:04.601127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-09-18T22:47:04.601523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-09-18T22:47:04.601930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-09-18T22:47:04.602260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-09-18T22:47:04.602557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-09-18T22:47:04.602911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-09-18T22:47:04.603295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-09-18T22:47:04.603713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-09-18T22:47:04.604083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-09-18T22:47:04.604404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-09-18T22:47:04.604784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-09-18T22:47:04.605129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-09-18T22:47:04.605466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-09-18T22:47:04.605853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-09-18T22:47:04.606136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-09-18T22:47:04.606346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-09-18T22:47:04.606629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-09-18T22:47:04.607023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-09-18T22:47:04.607283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-09-18T22:47:04.607474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-09-18T22:47:04.607734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-09-18T22:47:04.608178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-09-18T22:47:04.608489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-09-18T22:47:04.608837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-09-18T22:47:04.609103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-09-18T22:47:04.609364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-09-18T22:47:04.609741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-09-18T22:47:04.609954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-09-18T22:47:04.610205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-09-18T22:47:04.610439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-09-18T22:47:04.610730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-09-18T22:47:04.611043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-09-18T22:47:04.611315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-09-18T22:47:04.611608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-09-18T22:47:04.611935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-09-18T22:47:04.612239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-09-18T22:47:04.612506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-09-18T22:47:04.612848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-09-18T22:47:04.613126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-09-18T22:47:04.613386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-09-18T22:47:04.613725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-09-18T22:47:04.613945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-09-18T22:47:04.614237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-09-18T22:47:04.614457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-09-18T22:47:04.614958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-09-18T22:47:04.615188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-09-18T22:47:04.615479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-09-18T22:47:04.615737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-09-18T22:47:04.615987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-09-18T22:47:04.616214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-09-18T22:47:04.616422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-09-18T22:47:04.616773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-09-18T22:47:04.617037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-09-18T22:47:04.617234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-09-18T22:47:04.617522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-09-18T22:47:04.617920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-09-18T22:47:04.618216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-09-18T22:47:04.618459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-09-18T22:47:04.618828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-09-18T22:47:04.619116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-09-18T22:47:04.619351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-09-18T22:47:04.619554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-09-18T22:47:04.619787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-09-18T22:47:04.620087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-09-18T22:47:04.620374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-09-18T22:47:04.620680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-09-18T22:47:04.621000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-09-18T22:47:04.621298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-09-18T22:47:04.621518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNW.csv [2025-09-18T22:47:04.621862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-09-18T22:47:04.622137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-09-18T22:47:04.622466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-09-18T22:47:04.622775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-09-18T22:47:04.623090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-09-18T22:47:04.623379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OSCR.csv [2025-09-18T22:47:04.623609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-09-18T22:47:04.623899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-09-18T22:47:04.624264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-09-18T22:47:04.624632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-09-18T22:47:04.625049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-09-18T22:47:04.625331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-09-18T22:47:04.625683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-09-18T22:47:04.626036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-09-18T22:47:04.626382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-09-18T22:47:04.626870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-09-18T22:47:04.627113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-09-18T22:47:04.627338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-09-18T22:47:04.627544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAG.csv [2025-09-18T22:47:04.627779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-09-18T22:47:04.628008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-09-18T22:47:04.628234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-09-18T22:47:04.628433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-09-18T22:47:04.628720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-09-18T22:47:04.628879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-09-18T22:47:04.629080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-09-18T22:47:04.629343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-09-18T22:47:04.629546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-09-18T22:47:04.629787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-09-18T22:47:04.629991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-09-18T22:47:04.630242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-09-18T22:47:04.630542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-09-18T22:47:04.630932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-09-18T22:47:04.631140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-09-18T22:47:04.631371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-09-18T22:47:04.631586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-09-18T22:47:04.631833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-09-18T22:47:04.632051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-09-18T22:47:04.632228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-09-18T22:47:04.632442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-09-18T22:47:04.632695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-09-18T22:47:04.632959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-09-18T22:47:04.633140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-09-18T22:47:04.633371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-09-18T22:47:04.633631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-09-18T22:47:04.633879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-09-18T22:47:04.634150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-09-18T22:47:04.634350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-09-18T22:47:04.634552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-09-18T22:47:04.635012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-09-18T22:47:04.635191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-09-18T22:47:04.635406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-09-18T22:47:04.635601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-09-18T22:47:04.635847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-09-18T22:47:04.636061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-09-18T22:47:04.636291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-09-18T22:47:04.636496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-09-18T22:47:04.636728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-09-18T22:47:04.636958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-09-18T22:47:04.637124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-09-18T22:47:04.637306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-09-18T22:47:04.637521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-09-18T22:47:04.637802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-09-18T22:47:04.638014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-09-18T22:47:04.638229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-09-18T22:47:04.638506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-09-18T22:47:04.638778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-09-18T22:47:04.639041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-09-18T22:47:04.639303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGN.csv [2025-09-18T22:47:04.639592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-09-18T22:47:04.639854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-09-18T22:47:04.640104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-09-18T22:47:04.640460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-09-18T22:47:04.640718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-09-18T22:47:04.641000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-09-18T22:47:04.641292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-09-18T22:47:04.641586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-09-18T22:47:04.641852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-09-18T22:47:04.642197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-09-18T22:47:04.642470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-09-18T22:47:04.643099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-09-18T22:47:04.643368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-09-18T22:47:04.643687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-09-18T22:47:04.643916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-09-18T22:47:04.644158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-09-18T22:47:04.644457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-09-18T22:47:04.644810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-09-18T22:47:04.645198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-09-18T22:47:04.645413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-09-18T22:47:04.645679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-09-18T22:47:04.645850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-09-18T22:47:04.646043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-09-18T22:47:04.646245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-09-18T22:47:04.646423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-09-18T22:47:04.646610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-09-18T22:47:04.646848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEA.csv [2025-09-18T22:47:04.647020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-09-18T22:47:04.647184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-09-18T22:47:04.647354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-09-18T22:47:04.647550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-09-18T22:47:04.647880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-09-18T22:47:04.648102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-09-18T22:47:04.648304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-09-18T22:47:04.648470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-09-18T22:47:04.648686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-09-18T22:47:04.648908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-09-18T22:47:04.649072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-09-18T22:47:04.649288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-09-18T22:47:04.649506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-09-18T22:47:04.649732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-09-18T22:47:04.649982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-09-18T22:47:04.650152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-09-18T22:47:04.650318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-09-18T22:47:04.650539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-09-18T22:47:04.650907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-09-18T22:47:04.651057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-09-18T22:47:04.651278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-09-18T22:47:04.651540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-09-18T22:47:04.651745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-09-18T22:47:04.652006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-09-18T22:47:04.652220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-09-18T22:47:04.652400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-09-18T22:47:04.652552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-09-18T22:47:04.652790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-09-18T22:47:04.653003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-09-18T22:47:04.653222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-09-18T22:47:04.653452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-09-18T22:47:04.653726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-09-18T22:47:04.653923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-09-18T22:47:04.654093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-09-18T22:47:04.654306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-09-18T22:47:04.654466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-09-18T22:47:04.654676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-09-18T22:47:04.654896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-09-18T22:47:04.655162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-09-18T22:47:04.655329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-09-18T22:47:04.655619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-09-18T22:47:04.655878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-09-18T22:47:04.656114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-09-18T22:47:04.656354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-09-18T22:47:04.656670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-09-18T22:47:04.656899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-09-18T22:47:04.657216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-09-18T22:47:04.657476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-09-18T22:47:04.657833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-09-18T22:47:04.658122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-09-18T22:47:04.658379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-09-18T22:47:04.658663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-09-18T22:47:04.658917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-09-18T22:47:04.659147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-09-18T22:47:04.659425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-09-18T22:47:04.659626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVEO.csv [2025-09-18T22:47:04.660011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-09-18T22:47:04.660249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-09-18T22:47:04.660555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-09-18T22:47:04.660862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-09-18T22:47:04.661060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-09-18T22:47:04.661286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-09-18T22:47:04.661544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-09-18T22:47:04.661849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-09-18T22:47:04.662065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-09-18T22:47:04.662227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-09-18T22:47:04.662427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-09-18T22:47:04.662631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-09-18T22:47:04.662839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-09-18T22:47:04.663007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-09-18T22:47:04.663201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-09-18T22:47:04.663384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-09-18T22:47:04.663555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-09-18T22:47:04.663739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-09-18T22:47:04.663933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-09-18T22:47:04.664179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-09-18T22:47:04.664516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-09-18T22:47:04.664721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-09-18T22:47:04.664948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-09-18T22:47:04.665109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-09-18T22:47:04.665358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-09-18T22:47:04.665549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-09-18T22:47:04.665817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-09-18T22:47:04.666069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-09-18T22:47:04.666258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-09-18T22:47:04.666442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-09-18T22:47:04.666759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-09-18T22:47:04.666942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-09-18T22:47:04.667143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-09-18T22:47:04.667380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-09-18T22:47:04.667570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-09-18T22:47:04.667787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-09-18T22:47:04.667978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-09-18T22:47:04.668143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-09-18T22:47:04.668359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-09-18T22:47:04.668546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-09-18T22:47:04.668727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-09-18T22:47:04.668888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-09-18T22:47:04.669082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-09-18T22:47:04.669253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-09-18T22:47:04.669571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-09-18T22:47:04.669777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-09-18T22:47:04.669957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-09-18T22:47:04.670122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-09-18T22:47:04.670341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-09-18T22:47:04.670519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-09-18T22:47:04.670735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-09-18T22:47:04.670927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-09-18T22:47:04.671066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-09-18T22:47:04.671233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-09-18T22:47:04.671442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-09-18T22:47:04.671701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-09-18T22:47:04.671939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-09-18T22:47:04.672181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-09-18T22:47:04.672427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-09-18T22:47:04.672757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-09-18T22:47:04.673035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-09-18T22:47:04.673230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-09-18T22:47:04.673525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-09-18T22:47:04.673804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-09-18T22:47:04.674067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-09-18T22:47:04.674415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-09-18T22:47:04.674622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-09-18T22:47:04.675033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-09-18T22:47:04.675296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-09-18T22:47:04.675565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-09-18T22:47:04.675805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-09-18T22:47:04.676050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKE.csv [2025-09-18T22:47:04.676264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-09-18T22:47:04.676485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-09-18T22:47:04.676734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-09-18T22:47:04.676978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-09-18T22:47:04.677227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-09-18T22:47:04.677424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-09-18T22:47:04.677601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-09-18T22:47:04.677855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-09-18T22:47:04.678047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-09-18T22:47:04.678208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-09-18T22:47:04.678416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-09-18T22:47:04.678593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-09-18T22:47:04.678811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-09-18T22:47:04.679001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-09-18T22:47:04.679170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-09-18T22:47:04.679314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-09-18T22:47:04.679530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-09-18T22:47:04.679752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-09-18T22:47:04.679951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-09-18T22:47:04.680146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-09-18T22:47:04.680342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-09-18T22:47:04.680507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-09-18T22:47:04.680694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLD.csv [2025-09-18T22:47:04.680952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-09-18T22:47:04.681146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-09-18T22:47:04.681310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-09-18T22:47:04.681500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-09-18T22:47:04.681724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-09-18T22:47:04.681954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-09-18T22:47:04.682156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-09-18T22:47:04.682324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-09-18T22:47:04.682501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-09-18T22:47:04.682746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-09-18T22:47:04.682911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-09-18T22:47:04.683138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-09-18T22:47:04.683343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-09-18T22:47:04.683536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-09-18T22:47:04.683758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-09-18T22:47:04.683946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-09-18T22:47:04.684097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-09-18T22:47:04.684272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-09-18T22:47:04.684462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-09-18T22:47:04.684624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-09-18T22:47:04.684821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-09-18T22:47:04.685018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-09-18T22:47:04.685218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-09-18T22:47:04.685395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-09-18T22:47:04.685599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-09-18T22:47:04.685820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-09-18T22:47:04.685978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-09-18T22:47:04.686162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-09-18T22:47:04.686364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPG.csv [2025-09-18T22:47:04.686543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-09-18T22:47:04.686771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-09-18T22:47:04.687010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-09-18T22:47:04.687251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-09-18T22:47:04.687459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-09-18T22:47:04.687859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-09-18T22:47:04.688059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-09-18T22:47:04.688326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-09-18T22:47:04.688557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-09-18T22:47:04.688784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-09-18T22:47:04.688994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-09-18T22:47:04.689232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-09-18T22:47:04.689495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDDT.csv [2025-09-18T22:47:04.689772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-09-18T22:47:04.690022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADC.csv [2025-09-18T22:47:04.690267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-09-18T22:47:04.690477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-09-18T22:47:04.690809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-09-18T22:47:04.691031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-09-18T22:47:04.691249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-09-18T22:47:04.691508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-09-18T22:47:04.691750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-09-18T22:47:04.691957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-09-18T22:47:04.692176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-09-18T22:47:04.692393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-09-18T22:47:04.692621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-09-18T22:47:04.692875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARIS.csv [2025-09-18T22:47:04.693089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-09-18T22:47:04.693423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-09-18T22:47:04.693573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-09-18T22:47:04.693786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-09-18T22:47:04.693945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-09-18T22:47:04.694168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-09-18T22:47:04.694356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-09-18T22:47:04.694553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-09-18T22:47:04.694729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-09-18T22:47:04.698412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-09-18T22:47:04.698622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-09-18T22:47:04.698917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OXM.csv [2025-09-18T22:47:04.699097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-09-18T22:47:04.699260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-09-18T22:47:04.699448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-09-18T22:47:04.699660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-09-18T22:47:04.699835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-09-18T22:47:04.699988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-09-18T22:47:04.700141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-09-18T22:47:04.700305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-09-18T22:47:04.700459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-09-18T22:47:04.700668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-09-18T22:47:04.700855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-09-18T22:47:04.701011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-09-18T22:47:04.701219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-09-18T22:47:04.701404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-09-18T22:47:04.701565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-09-18T22:47:04.701751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-09-18T22:47:04.701909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-09-18T22:47:04.702055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-09-18T22:47:04.702242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-09-18T22:47:04.702431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-09-18T22:47:04.702613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-09-18T22:47:04.702810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-09-18T22:47:04.702971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-09-18T22:47:04.703126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-09-18T22:47:04.703292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-09-18T22:47:04.703473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-09-18T22:47:04.703684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-09-18T22:47:04.703863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-09-18T22:47:04.704033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-09-18T22:47:04.704211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-09-18T22:47:04.704351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-09-18T22:47:04.704537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-09-18T22:47:04.704715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-09-18T22:47:04.704926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-09-18T22:47:04.705186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-09-18T22:47:04.705480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-09-18T22:47:04.705748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-09-18T22:47:04.705968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-09-18T22:47:04.706195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-09-18T22:47:04.706449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACA.csv [2025-09-18T22:47:04.706799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-09-18T22:47:04.707030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-09-18T22:47:04.707263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGR.csv [2025-09-18T22:47:04.707479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-09-18T22:47:04.707742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-09-18T22:47:04.707978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-09-18T22:47:04.708235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-09-18T22:47:04.708418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-09-18T22:47:04.708679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-09-18T22:47:04.708898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-09-18T22:47:04.709140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-09-18T22:47:04.709371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-09-18T22:47:04.709624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-09-18T22:47:04.709853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-09-18T22:47:04.710216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-09-18T22:47:04.710482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-09-18T22:47:04.710715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-09-18T22:47:04.710937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-09-18T22:47:04.711125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-09-18T22:47:04.711308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-09-18T22:47:04.711487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-09-18T22:47:04.711705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-09-18T22:47:04.711863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-09-18T22:47:04.712021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-09-18T22:47:04.712183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-09-18T22:47:04.712360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-09-18T22:47:04.712503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-09-18T22:47:04.712672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-09-18T22:47:04.712866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-09-18T22:47:04.713036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-09-18T22:47:04.713218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-09-18T22:47:04.713380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-09-18T22:47:04.713565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-09-18T22:47:04.713748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-09-18T22:47:04.713907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-09-18T22:47:04.714080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-09-18T22:47:04.714262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-09-18T22:47:04.714407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-09-18T22:47:04.714595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-09-18T22:47:04.714989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-09-18T22:47:04.715176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-09-18T22:47:04.715341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-09-18T22:47:04.715558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-09-18T22:47:04.715724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-09-18T22:47:04.715894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHI.csv [2025-09-18T22:47:04.716076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-09-18T22:47:04.716244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-09-18T22:47:04.716417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQN.csv [2025-09-18T22:47:04.716570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-09-18T22:47:04.716748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-09-18T22:47:04.716912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-09-18T22:47:04.717106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-09-18T22:47:04.717288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-09-18T22:47:04.717471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-09-18T22:47:04.717823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-09-18T22:47:04.717993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-09-18T22:47:04.718142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-09-18T22:47:04.718322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-09-18T22:47:04.718475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-09-18T22:47:04.718657] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-09-18T22:47:04.718832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-09-18T22:47:04.719023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-09-18T22:47:04.719186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-09-18T22:47:04.719348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENFY.csv [2025-09-18T22:47:04.719523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-09-18T22:47:04.719757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OC.csv [2025-09-18T22:47:04.719957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-09-18T22:47:04.720170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHD.csv [2025-09-18T22:47:04.720404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-09-18T22:47:04.720616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-09-18T22:47:04.720877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-09-18T22:47:04.721085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-09-18T22:47:04.721277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-09-18T22:47:04.721525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-09-18T22:47:04.721853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-09-18T22:47:04.722075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-09-18T22:47:04.722289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-09-18T22:47:04.722488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-09-18T22:47:04.722714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-09-18T22:47:04.722923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTG.csv [2025-09-18T22:47:04.723159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-09-18T22:47:04.723410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-09-18T22:47:04.723623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-09-18T22:47:04.723879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-09-18T22:47:04.724098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-09-18T22:47:04.724295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-09-18T22:47:04.724474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-09-18T22:47:04.724698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-09-18T22:47:04.724979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-09-18T22:47:04.725176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-09-18T22:47:04.725398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-09-18T22:47:04.725575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-09-18T22:47:04.725756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-09-18T22:47:04.725895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-09-18T22:47:04.726042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-09-18T22:47:04.726226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-09-18T22:47:04.726372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-09-18T22:47:04.726533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-09-18T22:47:04.726699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-09-18T22:47:04.726886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-09-18T22:47:04.727296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-09-18T22:47:04.727469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-09-18T22:47:04.727637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-09-18T22:47:04.727835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-09-18T22:47:04.728016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-09-18T22:47:04.728180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACCO.csv [2025-09-18T22:47:04.728358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-09-18T22:47:04.728551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-09-18T22:47:04.728744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-09-18T22:47:04.728879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-09-18T22:47:04.729032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-09-18T22:47:04.729182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-09-18T22:47:04.729335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-09-18T22:47:04.729504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-09-18T22:47:04.729727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-09-18T22:47:04.729891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EARN.csv [2025-09-18T22:47:04.730038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-09-18T22:47:04.730213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-09-18T22:47:04.730373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-09-18T22:47:04.730549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-09-18T22:47:04.730747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-09-18T22:47:04.730914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-09-18T22:47:04.731072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-09-18T22:47:04.731245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RL.csv [2025-09-18T22:47:04.731374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-09-18T22:47:04.731533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-09-18T22:47:04.731707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-09-18T22:47:04.731856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-09-18T22:47:04.732022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-09-18T22:47:04.732200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-09-18T22:47:04.732342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-09-18T22:47:04.732508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-09-18T22:47:04.732675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-09-18T22:47:04.732855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-09-18T22:47:04.733017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-09-18T22:47:04.733178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-09-18T22:47:04.733377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-09-18T22:47:04.733572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-09-18T22:47:04.733807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-09-18T22:47:04.734021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSA.csv [2025-09-18T22:47:04.734221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-09-18T22:47:04.734411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-09-18T22:47:04.734601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-09-18T22:47:04.734887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-09-18T22:47:04.735128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-09-18T22:47:04.735333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-09-18T22:47:04.735551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBI.csv [2025-09-18T22:47:04.735779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-09-18T22:47:04.736078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-09-18T22:47:04.736269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-09-18T22:47:04.736477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-09-18T22:47:04.736733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-09-18T22:47:04.736918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-09-18T22:47:04.737182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-09-18T22:47:04.737379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-09-18T22:47:04.737594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCUS.csv [2025-09-18T22:47:04.737815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-09-18T22:47:04.738004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-09-18T22:47:04.738206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-09-18T22:47:04.738369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-09-18T22:47:04.738595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-09-18T22:47:04.738917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-09-18T22:47:04.739084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-09-18T22:47:04.739235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-09-18T22:47:04.739406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-09-18T22:47:04.739554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-09-18T22:47:04.739733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-09-18T22:47:04.739882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-09-18T22:47:04.740050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-09-18T22:47:04.740196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-09-18T22:47:04.740344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-09-18T22:47:04.740499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-09-18T22:47:04.740814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-09-18T22:47:04.740981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-09-18T22:47:04.741150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-09-18T22:47:04.741307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-09-18T22:47:04.741482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-09-18T22:47:04.741660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-09-18T22:47:04.741808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-09-18T22:47:04.741961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-09-18T22:47:04.742121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-09-18T22:47:04.742263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-09-18T22:47:04.742420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-09-18T22:47:04.742575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-09-18T22:47:04.742739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-09-18T22:47:04.742887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-09-18T22:47:04.743045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-09-18T22:47:04.743226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-09-18T22:47:04.743392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLN.csv [2025-09-18T22:47:04.743541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-09-18T22:47:04.743714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-09-18T22:47:04.743874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-09-18T22:47:04.744032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-09-18T22:47:04.744218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-09-18T22:47:04.744361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-09-18T22:47:04.744503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMI.csv [2025-09-18T22:47:04.744714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-09-18T22:47:04.744897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-09-18T22:47:04.745026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-09-18T22:47:04.745204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-09-18T22:47:04.745348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-09-18T22:47:04.745509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-09-18T22:47:04.745785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-09-18T22:47:04.745933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-09-18T22:47:04.746200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-09-18T22:47:04.746345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-09-18T22:47:04.746503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-09-18T22:47:04.746745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-09-18T22:47:04.746941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-09-18T22:47:04.747152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-09-18T22:47:04.747347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-09-18T22:47:04.747557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-09-18T22:47:04.747793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-09-18T22:47:04.748016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-09-18T22:47:04.748239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-09-18T22:47:04.748434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-09-18T22:47:04.748696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-09-18T22:47:04.748912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-09-18T22:47:04.749122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-09-18T22:47:04.749321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-09-18T22:47:04.749830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-09-18T22:47:04.750043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-09-18T22:47:04.750238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-09-18T22:47:04.750448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-09-18T22:47:04.750684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-09-18T22:47:04.750895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-09-18T22:47:04.751107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-09-18T22:47:04.751303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-09-18T22:47:04.751498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-09-18T22:47:04.751721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-09-18T22:47:04.751927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-09-18T22:47:04.752090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-09-18T22:47:04.752234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-09-18T22:47:04.752400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-09-18T22:47:04.752549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-09-18T22:47:04.752733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-09-18T22:47:04.752924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-09-18T22:47:04.753075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-09-18T22:47:04.753247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-09-18T22:47:04.753408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-09-18T22:47:04.753684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-09-18T22:47:04.753832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-09-18T22:47:04.754045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-09-18T22:47:04.754207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-09-18T22:47:04.754388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SO.csv [2025-09-18T22:47:04.754546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-09-18T22:47:04.754721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-09-18T22:47:04.754911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-09-18T22:47:04.755070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-09-18T22:47:04.755234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-09-18T22:47:04.755386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-09-18T22:47:04.755551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-09-18T22:47:04.755725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUMP.csv [2025-09-18T22:47:04.755915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-09-18T22:47:04.756065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-09-18T22:47:04.756211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-09-18T22:47:04.756358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-09-18T22:47:04.756510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-09-18T22:47:04.756695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-09-18T22:47:04.756861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-09-18T22:47:04.757032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-09-18T22:47:04.757189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-09-18T22:47:04.757350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-09-18T22:47:04.757506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-09-18T22:47:04.757838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-09-18T22:47:04.758026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-09-18T22:47:04.758164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-09-18T22:47:04.758317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-09-18T22:47:04.758477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-09-18T22:47:04.758658] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-09-18T22:47:04.758798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-09-18T22:47:04.758958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-09-18T22:47:04.759095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-09-18T22:47:04.759303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-09-18T22:47:04.759464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-09-18T22:47:04.759608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-09-18T22:47:04.759784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-09-18T22:47:04.759940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-09-18T22:47:04.760142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-09-18T22:47:04.760328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-09-18T22:47:04.760568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-09-18T22:47:04.760790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-09-18T22:47:04.760994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-09-18T22:47:04.761202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-09-18T22:47:04.761399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-09-18T22:47:04.761610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-09-18T22:47:04.761831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-09-18T22:47:04.762017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-09-18T22:47:04.762210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-09-18T22:47:04.762413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-09-18T22:47:04.762599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-09-18T22:47:04.762865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-09-18T22:47:04.763097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-09-18T22:47:04.763300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-09-18T22:47:04.763492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-09-18T22:47:04.763744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-09-18T22:47:04.763944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-09-18T22:47:04.764183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-09-18T22:47:04.764383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-09-18T22:47:04.764568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-09-18T22:47:04.764921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-09-18T22:47:04.765129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-09-18T22:47:04.765364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-09-18T22:47:04.765509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-09-18T22:47:04.765701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-09-18T22:47:04.765843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-09-18T22:47:04.766007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-09-18T22:47:04.766162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-09-18T22:47:04.766334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-09-18T22:47:04.766472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-09-18T22:47:04.766634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-09-18T22:47:04.766834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-09-18T22:47:04.767046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-09-18T22:47:04.767208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-09-18T22:47:04.767364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-09-18T22:47:04.767521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-09-18T22:47:04.767695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-09-18T22:47:04.767840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-09-18T22:47:04.767991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-09-18T22:47:04.768161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-09-18T22:47:04.768284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-09-18T22:47:04.768411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-09-18T22:47:04.768543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-09-18T22:47:04.768728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-09-18T22:47:04.768870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-09-18T22:47:04.769159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-09-18T22:47:04.769295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-09-18T22:47:04.769449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-09-18T22:47:04.769599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-09-18T22:47:04.769765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-09-18T22:47:04.769916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-09-18T22:47:04.770053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-09-18T22:47:04.770226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-09-18T22:47:04.770382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHT.csv [2025-09-18T22:47:04.770521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-09-18T22:47:04.770779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-09-18T22:47:04.770920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-09-18T22:47:04.771062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-09-18T22:47:04.771232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-09-18T22:47:04.771373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-09-18T22:47:04.771541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-09-18T22:47:04.771721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-09-18T22:47:04.771872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-09-18T22:47:04.772043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-09-18T22:47:04.772193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-09-18T22:47:04.772340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-09-18T22:47:04.772522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-09-18T22:47:04.772685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-09-18T22:47:04.772822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-09-18T22:47:04.773007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-09-18T22:47:04.773208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-09-18T22:47:04.773399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-09-18T22:47:04.773621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHR.csv [2025-09-18T22:47:04.773883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-09-18T22:47:04.774062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-09-18T22:47:04.774263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-09-18T22:47:04.774482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-09-18T22:47:04.774700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-09-18T22:47:04.774910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-09-18T22:47:04.775104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-09-18T22:47:04.775297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-09-18T22:47:04.775487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-09-18T22:47:04.775797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-09-18T22:47:04.775978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-09-18T22:47:04.776192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-09-18T22:47:04.776393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-09-18T22:47:04.776607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-09-18T22:47:04.776797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-09-18T22:47:04.777033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-09-18T22:47:04.777220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-09-18T22:47:04.777448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-09-18T22:47:04.777846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-09-18T22:47:04.778056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-09-18T22:47:04.778285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-09-18T22:47:04.778492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-09-18T22:47:04.778634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-09-18T22:47:04.778854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-09-18T22:47:04.778995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-09-18T22:47:04.779212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-09-18T22:47:04.779379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-09-18T22:47:04.779536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-09-18T22:47:04.779707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-09-18T22:47:04.779855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-09-18T22:47:04.779982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-09-18T22:47:04.780117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-09-18T22:47:04.780252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-09-18T22:47:04.780395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-09-18T22:47:04.780552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-09-18T22:47:04.780708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-09-18T22:47:04.780846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-09-18T22:47:04.780995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-09-18T22:47:04.781128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-09-18T22:47:04.781275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-09-18T22:47:04.781428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-09-18T22:47:04.781567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KO.csv [2025-09-18T22:47:04.781740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-09-18T22:47:04.781900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-09-18T22:47:04.782051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-09-18T22:47:04.782176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-09-18T22:47:04.782339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-09-18T22:47:04.782500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-09-18T22:47:04.782692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-09-18T22:47:04.782857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-09-18T22:47:04.783006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-09-18T22:47:04.783173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-09-18T22:47:04.783327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OTIS.csv [2025-09-18T22:47:04.783466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-09-18T22:47:04.783613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-09-18T22:47:04.784012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-09-18T22:47:04.784170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-09-18T22:47:04.784314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-09-18T22:47:04.784459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-09-18T22:47:04.784665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-09-18T22:47:04.784833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-09-18T22:47:04.785011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-09-18T22:47:04.785150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-09-18T22:47:04.785293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVN.csv [2025-09-18T22:47:04.785448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-09-18T22:47:04.785604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-09-18T22:47:04.785767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-09-18T22:47:04.785967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-09-18T22:47:04.786160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-09-18T22:47:04.786374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-09-18T22:47:04.786558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-09-18T22:47:04.786753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-09-18T22:47:04.786939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-09-18T22:47:04.787113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-09-18T22:47:04.787310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-09-18T22:47:04.787510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-09-18T22:47:04.787737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-09-18T22:47:04.787962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-09-18T22:47:04.788158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-09-18T22:47:04.788365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-09-18T22:47:04.788557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-09-18T22:47:04.788801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-09-18T22:47:04.789005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-09-18T22:47:04.789198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-09-18T22:47:04.789392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-09-18T22:47:04.789591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-09-18T22:47:04.789812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-09-18T22:47:04.790042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-09-18T22:47:04.790253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-09-18T22:47:04.790459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-09-18T22:47:04.790699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-09-18T22:47:04.790866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-09-18T22:47:04.791004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-09-18T22:47:04.791159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-09-18T22:47:04.791328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-09-18T22:47:04.791493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-09-18T22:47:04.791637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-09-18T22:47:04.791836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-09-18T22:47:04.791978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-09-18T22:47:04.792111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-09-18T22:47:04.792257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-09-18T22:47:04.792429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-09-18T22:47:04.792566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-09-18T22:47:04.792737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-09-18T22:47:04.792875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PX.csv [2025-09-18T22:47:04.793020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-09-18T22:47:04.793187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-09-18T22:47:04.793330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-09-18T22:47:04.793487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-09-18T22:47:04.793631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-09-18T22:47:04.793987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-09-18T22:47:04.794132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-09-18T22:47:04.794365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-09-18T22:47:04.794494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-09-18T22:47:04.794675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-09-18T22:47:04.794846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-09-18T22:47:04.795002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-09-18T22:47:04.795151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-09-18T22:47:04.795339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-09-18T22:47:04.795476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-09-18T22:47:04.795617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-09-18T22:47:04.795807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-09-18T22:47:04.795961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-09-18T22:47:04.796115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-09-18T22:47:04.796262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-09-18T22:47:04.796405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-09-18T22:47:04.796586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-09-18T22:47:04.796799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-09-18T22:47:04.796950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-09-18T22:47:04.797095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-09-18T22:47:04.797227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-09-18T22:47:04.797393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-09-18T22:47:04.797545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-09-18T22:47:04.797728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-09-18T22:47:04.797869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-09-18T22:47:04.798047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-09-18T22:47:04.798191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-09-18T22:47:04.798334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-09-18T22:47:04.798510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-09-18T22:47:04.798732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-09-18T22:47:04.798961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-09-18T22:47:04.799157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-09-18T22:47:04.799360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-09-18T22:47:04.799546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-09-18T22:47:04.799750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-09-18T22:47:04.799967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-09-18T22:47:04.800159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-09-18T22:47:04.800341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-09-18T22:47:04.800629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-09-18T22:47:04.800934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-09-18T22:47:04.801117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-09-18T22:47:04.801330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-09-18T22:47:04.801531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-09-18T22:47:04.801805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-09-18T22:47:04.802003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-09-18T22:47:04.802177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-09-18T22:47:04.802388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-09-18T22:47:04.802577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-09-18T22:47:04.802779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-09-18T22:47:04.802960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-09-18T22:47:04.803140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-09-18T22:47:04.803305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-09-18T22:47:04.803468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-09-18T22:47:04.803625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-09-18T22:47:04.803829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-09-18T22:47:04.803964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-09-18T22:47:04.804098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-09-18T22:47:04.804236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-09-18T22:47:04.804390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-09-18T22:47:04.804525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-09-18T22:47:04.804762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-09-18T22:47:04.804938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-09-18T22:47:04.805081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-09-18T22:47:04.805249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-09-18T22:47:04.805384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-09-18T22:47:04.805545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-09-18T22:47:04.805710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-09-18T22:47:04.805940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-09-18T22:47:04.806109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-09-18T22:47:04.806293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-09-18T22:47:04.806451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-09-18T22:47:04.806620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-09-18T22:47:04.806784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-09-18T22:47:04.806935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-09-18T22:47:04.807085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-09-18T22:47:04.807236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-09-18T22:47:04.807380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-09-18T22:47:04.807513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-09-18T22:47:04.807706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-09-18T22:47:04.807843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-09-18T22:47:04.808007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-09-18T22:47:04.808165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-09-18T22:47:04.808320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-09-18T22:47:04.808476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-09-18T22:47:04.808622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-09-18T22:47:04.808789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-09-18T22:47:04.808932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-09-18T22:47:04.809087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-09-18T22:47:04.809223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-09-18T22:47:04.809346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-09-18T22:47:04.809445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-09-18T22:47:04.809564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-09-18T22:47:04.809715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-09-18T22:47:04.809865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-09-18T22:47:04.810007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-09-18T22:47:04.810328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-09-18T22:47:04.810490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-09-18T22:47:04.810638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-09-18T22:47:04.810799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-09-18T22:47:04.810972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-09-18T22:47:04.811156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMC.csv [2025-09-18T22:47:04.811368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-09-18T22:47:04.811591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-09-18T22:47:04.811821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-09-18T22:47:04.812059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-09-18T22:47:04.812325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-09-18T22:47:04.812536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-09-18T22:47:04.812754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-09-18T22:47:04.812943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-09-18T22:47:04.813125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-09-18T22:47:04.813317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-09-18T22:47:04.813502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-09-18T22:47:04.813842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-09-18T22:47:04.814040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-09-18T22:47:04.814221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-09-18T22:47:04.814430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-09-18T22:47:04.814588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-09-18T22:47:04.814827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-09-18T22:47:04.815016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PH.csv [2025-09-18T22:47:04.815260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-09-18T22:47:04.815454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-09-18T22:47:04.815628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-09-18T22:47:04.815877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-09-18T22:47:04.816065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-09-18T22:47:04.816211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-09-18T22:47:04.816335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-09-18T22:47:04.816459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-09-18T22:47:04.816603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-09-18T22:47:04.816805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-09-18T22:47:04.816956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-09-18T22:47:04.817108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-09-18T22:47:04.817256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-09-18T22:47:04.817439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-09-18T22:47:04.817584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-09-18T22:47:04.817745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-09-18T22:47:04.817897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-09-18T22:47:04.818035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-09-18T22:47:04.818179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-09-18T22:47:04.818348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-09-18T22:47:04.818491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-09-18T22:47:04.818692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-09-18T22:47:04.818847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-09-18T22:47:04.818987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-09-18T22:47:04.819137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-09-18T22:47:04.819292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-09-18T22:47:04.819446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-09-18T22:47:04.819568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-09-18T22:47:04.819737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-09-18T22:47:04.819877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-09-18T22:47:04.820023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-09-18T22:47:04.820170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-09-18T22:47:04.820308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-09-18T22:47:04.820453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-09-18T22:47:04.820592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-09-18T22:47:04.820924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-09-18T22:47:04.821053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-09-18T22:47:04.821162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-09-18T22:47:04.821300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-09-18T22:47:04.821491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-09-18T22:47:04.821634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-09-18T22:47:04.821806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-09-18T22:47:04.821954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-09-18T22:47:04.822091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-09-18T22:47:04.822228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-09-18T22:47:04.822372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-09-18T22:47:04.822522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-09-18T22:47:04.822685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-09-18T22:47:04.822828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-09-18T22:47:04.822971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-09-18T22:47:04.823120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-09-18T22:47:04.823298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-09-18T22:47:04.823481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-09-18T22:47:04.823686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-09-18T22:47:04.823888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-09-18T22:47:04.824066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-09-18T22:47:04.824256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-09-18T22:47:04.824448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-09-18T22:47:04.824625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-09-18T22:47:04.824893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-09-18T22:47:04.825090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-09-18T22:47:04.825288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-09-18T22:47:04.825478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-09-18T22:47:04.825662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-09-18T22:47:04.825824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-09-18T22:47:04.826032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-09-18T22:47:04.826209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-09-18T22:47:04.826429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-09-18T22:47:04.826620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-09-18T22:47:04.826862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-09-18T22:47:04.827049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-09-18T22:47:04.827249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-09-18T22:47:04.827436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-09-18T22:47:04.827829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-09-18T22:47:04.828053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-09-18T22:47:04.828234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-09-18T22:47:04.828382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-09-18T22:47:04.828522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-09-18T22:47:04.828788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-09-18T22:47:04.828926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-09-18T22:47:04.829083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEO.csv [2025-09-18T22:47:04.829235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-09-18T22:47:04.829392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-09-18T22:47:04.829547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-09-18T22:47:04.829705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-09-18T22:47:04.829848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-09-18T22:47:04.830012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-09-18T22:47:04.830168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-09-18T22:47:04.830316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-09-18T22:47:04.830503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-09-18T22:47:04.830671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-09-18T22:47:04.830822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-09-18T22:47:04.830972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-09-18T22:47:04.831124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-09-18T22:47:04.831273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-09-18T22:47:04.831433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-09-18T22:47:04.831574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSG.csv [2025-09-18T22:47:04.831775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-09-18T22:47:04.831925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-09-18T22:47:04.832079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-09-18T22:47:04.832221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-09-18T22:47:04.832341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-09-18T22:47:04.832479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-09-18T22:47:04.832620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-09-18T22:47:04.832926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMR.csv [2025-09-18T22:47:04.833078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-09-18T22:47:04.833229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-09-18T22:47:04.833386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-09-18T22:47:04.833532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-09-18T22:47:04.833781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHI.csv [2025-09-18T22:47:04.834085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-09-18T22:47:04.834225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-09-18T22:47:04.834375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-09-18T22:47:04.834516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-09-18T22:47:04.834681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-09-18T22:47:04.834872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-09-18T22:47:04.835033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-09-18T22:47:04.835169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-09-18T22:47:04.835322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-09-18T22:47:04.835471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-09-18T22:47:04.835629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-09-18T22:47:04.835816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-09-18T22:47:04.835990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGA.csv [2025-09-18T22:47:04.836172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-09-18T22:47:04.836356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-09-18T22:47:04.836549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-09-18T22:47:04.836769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-09-18T22:47:04.836956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-09-18T22:47:04.837145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-09-18T22:47:04.837337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-09-18T22:47:04.837511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-09-18T22:47:04.837716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-09-18T22:47:04.837928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-09-18T22:47:04.838115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-09-18T22:47:04.838300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-09-18T22:47:04.838561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-09-18T22:47:04.838812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POR.csv [2025-09-18T22:47:04.839006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-09-18T22:47:04.839217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-09-18T22:47:04.839386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-09-18T22:47:04.839559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-09-18T22:47:04.839765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-09-18T22:47:04.839981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-09-18T22:47:04.840185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-09-18T22:47:04.840391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-09-18T22:47:04.840576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-09-18T22:47:04.840776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-09-18T22:47:04.840925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-09-18T22:47:04.841085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-09-18T22:47:04.841353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-09-18T22:47:04.841497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-09-18T22:47:04.841771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-09-18T22:47:04.841900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-09-18T22:47:04.842253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-09-18T22:47:04.842412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-09-18T22:47:04.842552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-09-18T22:47:04.842713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-09-18T22:47:04.842874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-09-18T22:47:04.843024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-09-18T22:47:04.843182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-09-18T22:47:04.843317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-09-18T22:47:04.843492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-09-18T22:47:04.843634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-09-18T22:47:04.843803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-09-18T22:47:04.843950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-09-18T22:47:04.844092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-09-18T22:47:04.844253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-09-18T22:47:04.844400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-09-18T22:47:04.844569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-09-18T22:47:04.844758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-09-18T22:47:04.844943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-09-18T22:47:04.845085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-09-18T22:47:04.845245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-09-18T22:47:04.845435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-09-18T22:47:04.845572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-09-18T22:47:04.845730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-09-18T22:47:04.845849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-09-18T22:47:04.845973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-09-18T22:47:04.846103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-09-18T22:47:04.846270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-09-18T22:47:04.846429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-09-18T22:47:04.846766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-09-18T22:47:04.846912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-09-18T22:47:04.847061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-09-18T22:47:04.847211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-09-18T22:47:04.847368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-09-18T22:47:04.847531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-09-18T22:47:04.847739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVTY.csv [2025-09-18T22:47:04.847864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-09-18T22:47:04.847997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-09-18T22:47:04.848154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-09-18T22:47:04.848284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-09-18T22:47:04.848403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-09-18T22:47:04.848584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-09-18T22:47:04.848797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-09-18T22:47:04.848993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-09-18T22:47:04.849194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-09-18T22:47:04.849384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-09-18T22:47:04.849605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-09-18T22:47:04.849882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-09-18T22:47:04.850082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-09-18T22:47:04.850302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-09-18T22:47:04.850499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-09-18T22:47:04.850726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-09-18T22:47:04.850929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-09-18T22:47:04.851126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-09-18T22:47:04.851338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRC.csv [2025-09-18T22:47:04.851511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-09-18T22:47:04.851722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-09-18T22:47:04.851921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-09-18T22:47:04.852109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-09-18T22:47:04.852311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-09-18T22:47:04.852495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-09-18T22:47:04.852727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-09-18T22:47:04.852931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-09-18T22:47:04.853136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-09-18T22:47:04.853316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-09-18T22:47:04.853639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-09-18T22:47:04.853823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-09-18T22:47:04.853965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-09-18T22:47:04.854109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-09-18T22:47:04.854271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-09-18T22:47:04.854397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-09-18T22:47:04.854515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-09-18T22:47:04.854697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-09-18T22:47:04.854899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-09-18T22:47:04.855058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-09-18T22:47:04.855195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-09-18T22:47:04.855340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-09-18T22:47:04.855526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-09-18T22:47:04.855700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-09-18T22:47:04.855855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-09-18T22:47:04.856008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-09-18T22:47:04.856160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-09-18T22:47:04.856320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-09-18T22:47:04.856479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-09-18T22:47:04.856620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-09-18T22:47:04.856792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-09-18T22:47:04.856918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-09-18T22:47:04.857049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROK.csv [2025-09-18T22:47:04.857171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-09-18T22:47:04.857269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-09-18T22:47:04.857376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-09-18T22:47:04.857878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-09-18T22:47:04.858008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-09-18T22:47:04.858136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRU.csv [2025-09-18T22:47:04.858293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-09-18T22:47:04.858454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RF.csv [2025-09-18T22:47:04.858593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-09-18T22:47:04.858742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-09-18T22:47:04.858897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-09-18T22:47:04.859011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-09-18T22:47:04.859165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-09-18T22:47:04.859315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-09-18T22:47:04.859473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIO.csv [2025-09-18T22:47:04.859606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-09-18T22:47:04.859779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-09-18T22:47:04.859934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RJF.csv [2025-09-18T22:47:04.860082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-09-18T22:47:04.860221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-09-18T22:47:04.860383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-09-18T22:47:04.860532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-09-18T22:47:04.860727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-09-18T22:47:04.860926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-09-18T22:47:04.861127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-09-18T22:47:04.861311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-09-18T22:47:04.861526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-09-18T22:47:04.861734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-09-18T22:47:04.861919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-09-18T22:47:04.862141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-09-18T22:47:04.862336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-09-18T22:47:04.862510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-09-18T22:47:04.862736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-09-18T22:47:04.862908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-09-18T22:47:04.863101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-09-18T22:47:04.863289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-09-18T22:47:04.863488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-09-18T22:47:04.863706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-09-18T22:47:04.863914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-09-18T22:47:04.864131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-09-18T22:47:04.864317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-09-18T22:47:04.864506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-09-18T22:47:04.864729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-09-18T22:47:04.864953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SE.csv [2025-09-18T22:47:04.865145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-09-18T22:47:04.865324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-09-18T22:47:04.865498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-09-18T22:47:04.865847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-09-18T22:47:04.866067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-09-18T22:47:04.866242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-09-18T22:47:04.866431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-09-18T22:47:04.866599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-09-18T22:47:04.866761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-09-18T22:47:04.866941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-09-18T22:47:04.867081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-09-18T22:47:04.867216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-09-18T22:47:04.867370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-09-18T22:47:04.867525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-09-18T22:47:04.867677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-09-18T22:47:04.867826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-09-18T22:47:04.867965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-09-18T22:47:04.868112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-09-18T22:47:04.868257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-09-18T22:47:04.868418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-09-18T22:47:04.868576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-09-18T22:47:04.868745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-09-18T22:47:04.869051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPI.csv [2025-09-18T22:47:04.869177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-09-18T22:47:04.869310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-09-18T22:47:04.869459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-09-18T22:47:04.869612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-09-18T22:47:04.869783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-09-18T22:47:04.869983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-09-18T22:47:04.870119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-09-18T22:47:04.870271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-09-18T22:47:04.870413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-09-18T22:47:04.870565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-09-18T22:47:04.870713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-09-18T22:47:04.870875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-09-18T22:47:04.871001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-09-18T22:47:04.871157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-09-18T22:47:04.871338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-09-18T22:47:04.871520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNOW.csv [2025-09-18T22:47:04.871674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-09-18T22:47:04.871820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-09-18T22:47:04.871968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-09-18T22:47:04.872139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-09-18T22:47:04.872290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-09-18T22:47:04.872439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNTY.csv [2025-09-18T22:47:04.872597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-09-18T22:47:04.872768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-09-18T22:47:04.872905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-09-18T22:47:04.873027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-09-18T22:47:04.873145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-09-18T22:47:04.873268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-09-18T22:47:04.873443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-09-18T22:47:04.873815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-09-18T22:47:04.874000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-09-18T22:47:04.874206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-09-18T22:47:04.874383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-09-18T22:47:04.874558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-09-18T22:47:04.874780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-09-18T22:47:04.875006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-09-18T22:47:04.875205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-09-18T22:47:04.875398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-09-18T22:47:04.875585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-09-18T22:47:04.875796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-09-18T22:47:04.876184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-09-18T22:47:04.876366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-09-18T22:47:04.876536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-09-18T22:47:04.876745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-09-18T22:47:04.876982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-09-18T22:47:04.877175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-09-18T22:47:04.877362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-09-18T22:47:04.877564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-09-18T22:47:04.877795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-09-18T22:47:04.877978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-09-18T22:47:04.878168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-09-18T22:47:04.878347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-09-18T22:47:04.878497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-09-18T22:47:04.878679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-09-18T22:47:04.878827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-09-18T22:47:04.878976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-09-18T22:47:04.879127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-09-18T22:47:04.879304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-09-18T22:47:04.879446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-09-18T22:47:04.879574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-09-18T22:47:04.879714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-09-18T22:47:04.879837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-09-18T22:47:04.879939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-09-18T22:47:04.880064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-09-18T22:47:04.880207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-09-18T22:47:04.880334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-09-18T22:47:04.880463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-09-18T22:47:04.880606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-09-18T22:47:04.880779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-09-18T22:47:04.880925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-09-18T22:47:04.881077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-09-18T22:47:04.881196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-09-18T22:47:04.881319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-09-18T22:47:04.881504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-09-18T22:47:04.881777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACP.csv [2025-09-18T22:47:04.882077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-09-18T22:47:04.882242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-09-18T22:47:04.882373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-09-18T22:47:04.882498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-09-18T22:47:04.882670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-09-18T22:47:04.882816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-09-18T22:47:04.882957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-09-18T22:47:04.883087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-09-18T22:47:04.883213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-09-18T22:47:04.883342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-09-18T22:47:04.883478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-09-18T22:47:04.883620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-09-18T22:47:04.884023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-09-18T22:47:04.884166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-09-18T22:47:04.884301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-09-18T22:47:04.884425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-09-18T22:47:04.884557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-09-18T22:47:04.884735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-09-18T22:47:04.884920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-09-18T22:47:04.885042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-09-18T22:47:04.885159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-09-18T22:47:04.885312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-09-18T22:47:04.885458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-09-18T22:47:04.885596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-09-18T22:47:04.885795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-09-18T22:47:04.885971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-09-18T22:47:04.886168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-09-18T22:47:04.886397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-09-18T22:47:04.886607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGE.csv [2025-09-18T22:47:04.886823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-09-18T22:47:04.887008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-09-18T22:47:04.887192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-09-18T22:47:04.887363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-09-18T22:47:04.887537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-09-18T22:47:04.887918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-09-18T22:47:04.888111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-09-18T22:47:04.888331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-09-18T22:47:04.888507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-09-18T22:47:04.888722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-09-18T22:47:04.888933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-09-18T22:47:04.889110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-09-18T22:47:04.889303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-09-18T22:47:04.889503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-09-18T22:47:04.889721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-09-18T22:47:04.889917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-09-18T22:47:04.890117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-09-18T22:47:04.890292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-09-18T22:47:04.890479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-09-18T22:47:04.890857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-09-18T22:47:04.890999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-09-18T22:47:04.891155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-09-18T22:47:04.891290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-09-18T22:47:04.891443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-09-18T22:47:04.891580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-09-18T22:47:04.891755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-09-18T22:47:04.891910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-09-18T22:47:04.892035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-09-18T22:47:04.892143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-09-18T22:47:04.892292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-09-18T22:47:04.892457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-09-18T22:47:04.892619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-09-18T22:47:04.892803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-09-18T22:47:04.892956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-09-18T22:47:04.893219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-09-18T22:47:04.893377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-09-18T22:47:04.893513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-09-18T22:47:04.893632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-09-18T22:47:04.893789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-09-18T22:47:04.893925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-09-18T22:47:04.894060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-09-18T22:47:04.894193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-09-18T22:47:04.894310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-09-18T22:47:04.894430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-09-18T22:47:04.894590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-09-18T22:47:04.894775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-09-18T22:47:04.894927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-09-18T22:47:04.895068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-09-18T22:47:04.895201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-09-18T22:47:04.895336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-09-18T22:47:04.895473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-09-18T22:47:04.895676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-09-18T22:47:04.895826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-09-18T22:47:04.895962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-09-18T22:47:04.896110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-09-18T22:47:04.896244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-09-18T22:47:04.896371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-09-18T22:47:04.896510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-09-18T22:47:04.896674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-09-18T22:47:04.896808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-09-18T22:47:04.896933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-09-18T22:47:04.897034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-09-18T22:47:04.897151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-09-18T22:47:04.897290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-09-18T22:47:04.897447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-09-18T22:47:04.897584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-09-18T22:47:04.897925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-09-18T22:47:04.898149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-09-18T22:47:04.898357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-09-18T22:47:04.898557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-09-18T22:47:04.898765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-09-18T22:47:04.898990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-09-18T22:47:04.899295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-09-18T22:47:04.899483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSX.csv [2025-09-18T22:47:04.899696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-09-18T22:47:04.899881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-09-18T22:47:04.900067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-09-18T22:47:04.900371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-09-18T22:47:04.900558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-09-18T22:47:04.900797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-09-18T22:47:04.901003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-09-18T22:47:04.901202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-09-18T22:47:04.901370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-09-18T22:47:04.901586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTX.csv [2025-09-18T22:47:04.901814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-09-18T22:47:04.901990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-09-18T22:47:04.902177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-09-18T22:47:04.902379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-09-18T22:47:04.902568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-09-18T22:47:04.902755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-09-18T22:47:04.902903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAYC.csv [2025-09-18T22:47:04.903042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-09-18T22:47:04.903197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-09-18T22:47:04.903351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-09-18T22:47:04.903684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-09-18T22:47:04.903813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-09-18T22:47:04.903917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-09-18T22:47:04.904018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-09-18T22:47:04.904133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-09-18T22:47:04.904285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-09-18T22:47:04.904439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-09-18T22:47:04.904639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-09-18T22:47:04.904838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-09-18T22:47:04.904968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-09-18T22:47:04.905105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-09-18T22:47:04.905231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-09-18T22:47:04.905378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-09-18T22:47:04.905530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-09-18T22:47:04.905814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-09-18T22:47:04.905963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-09-18T22:47:04.906115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-09-18T22:47:04.906260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-09-18T22:47:04.906399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-09-18T22:47:04.906545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-09-18T22:47:04.906704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-09-18T22:47:04.906846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-09-18T22:47:04.907007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-09-18T22:47:04.907141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PWR.csv [2025-09-18T22:47:04.907257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-09-18T22:47:04.907396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-09-18T22:47:04.907519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-09-18T22:47:04.907670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-09-18T22:47:04.907820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-09-18T22:47:04.907963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-09-18T22:47:04.908106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-09-18T22:47:04.908268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-09-18T22:47:04.908429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-09-18T22:47:04.908583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-09-18T22:47:04.908752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-09-18T22:47:04.908899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-09-18T22:47:04.909033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-09-18T22:47:04.909173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-09-18T22:47:04.909330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-09-18T22:47:04.909733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-09-18T22:47:04.909883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-09-18T22:47:04.910031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-09-18T22:47:04.910195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-09-18T22:47:04.910393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-09-18T22:47:04.910569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-09-18T22:47:04.910759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-09-18T22:47:04.910943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-09-18T22:47:04.911113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-09-18T22:47:04.911286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-09-18T22:47:04.911466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-09-18T22:47:04.911699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-09-18T22:47:04.911868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-09-18T22:47:04.912055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-09-18T22:47:04.912239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-09-18T22:47:04.912421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-09-18T22:47:04.912706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-09-18T22:47:04.912901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-09-18T22:47:04.913090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-09-18T22:47:04.913286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-09-18T22:47:04.913481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-09-18T22:47:04.913802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-09-18T22:47:04.913973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-09-18T22:47:04.914169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-09-18T22:47:04.914347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-09-18T22:47:04.914517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-09-18T22:47:04.914709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSA.csv [2025-09-18T22:47:04.914876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-09-18T22:47:04.914993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-09-18T22:47:04.915093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-09-18T22:47:04.915210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-09-18T22:47:04.915347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-09-18T22:47:04.915469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-09-18T22:47:04.915609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RS.csv [2025-09-18T22:47:04.915791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-09-18T22:47:04.915911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-09-18T22:47:04.916034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-09-18T22:47:04.916188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBA.csv [2025-09-18T22:47:04.916330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-09-18T22:47:04.916474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-09-18T22:47:04.916599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-09-18T22:47:04.916744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-09-18T22:47:04.916902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-09-18T22:47:04.917059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-09-18T22:47:04.917200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-09-18T22:47:04.917337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-09-18T22:47:04.917479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-09-18T22:47:04.917626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-09-18T22:47:04.917773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-09-18T22:47:04.917903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-09-18T22:47:04.918054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-09-18T22:47:04.918189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-09-18T22:47:04.918364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-09-18T22:47:04.918492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-09-18T22:47:04.918618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PB.csv [2025-09-18T22:47:04.918774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-09-18T22:47:04.918896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-09-18T22:47:04.919026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-09-18T22:47:04.919300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-09-18T22:47:04.919478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-09-18T22:47:04.919626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-09-18T22:47:04.919783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-09-18T22:47:04.919920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-09-18T22:47:04.920052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-09-18T22:47:04.920183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-09-18T22:47:04.920320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-09-18T22:47:04.920459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OVV.csv [2025-09-18T22:47:04.920614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-09-18T22:47:04.920796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-09-18T22:47:04.920941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-09-18T22:47:04.921074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-09-18T22:47:04.921219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-09-18T22:47:04.921366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-09-18T22:47:04.921514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-09-18T22:47:04.921769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-09-18T22:47:04.922001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RAMP.csv [2025-09-18T22:47:04.922210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-09-18T22:47:04.922399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-09-18T22:47:04.922580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-09-18T22:47:04.922804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-09-18T22:47:04.922981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-09-18T22:47:04.923185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-09-18T22:47:04.923379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-09-18T22:47:04.923571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-09-18T22:47:04.923806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-09-18T22:47:04.924006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLG.csv [2025-09-18T22:47:04.924179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-09-18T22:47:04.924356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-09-18T22:47:04.924565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-09-18T22:47:04.924853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-09-18T22:47:04.925052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-09-18T22:47:04.925243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-09-18T22:47:04.925432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-09-18T22:47:04.925768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-09-18T22:47:04.925953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-09-18T22:47:04.926131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-09-18T22:47:04.926333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-09-18T22:47:04.926521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-09-18T22:47:04.926720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-09-18T22:47:04.926861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-09-18T22:47:04.926984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-09-18T22:47:04.927101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-09-18T22:47:04.927248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-09-18T22:47:04.927380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-09-18T22:47:04.927521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-09-18T22:47:04.927676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-09-18T22:47:04.927813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DELL.csv [2025-09-18T22:47:04.927957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-09-18T22:47:04.928117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-09-18T22:47:04.928255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-09-18T22:47:04.928396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-09-18T22:47:04.928512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEUE.csv [2025-09-18T22:47:04.928681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-09-18T22:47:04.928877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-09-18T22:47:04.929034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCD.csv [2025-09-18T22:47:04.929182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-09-18T22:47:04.929335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-09-18T22:47:04.929458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-09-18T22:47:04.929567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROL.csv [2025-09-18T22:47:04.930009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-09-18T22:47:04.930165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-09-18T22:47:04.930289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-09-18T22:47:04.930419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-09-18T22:47:04.930539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-09-18T22:47:04.930674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-09-18T22:47:04.930813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-09-18T22:47:04.930961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-09-18T22:47:04.931094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-09-18T22:47:04.931211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-09-18T22:47:04.931325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-09-18T22:47:04.931464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-09-18T22:47:04.931585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-09-18T22:47:04.931717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-09-18T22:47:04.931863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-09-18T22:47:04.931999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-09-18T22:47:04.932117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-09-18T22:47:04.932217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-09-18T22:47:04.932342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-09-18T22:47:04.932504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-09-18T22:47:04.932626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-09-18T22:47:04.932801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-09-18T22:47:04.932924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-09-18T22:47:04.933186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-09-18T22:47:04.933329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-09-18T22:47:04.933478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-09-18T22:47:04.933616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-09-18T22:47:04.933824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-09-18T22:47:04.934024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-09-18T22:47:04.934235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-09-18T22:47:04.934404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-09-18T22:47:04.934616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-09-18T22:47:04.934860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-09-18T22:47:04.935058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-09-18T22:47:04.935241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-09-18T22:47:04.935416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-09-18T22:47:04.935623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-09-18T22:47:04.935839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-09-18T22:47:04.936030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-09-18T22:47:04.936208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-09-18T22:47:04.936392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-09-18T22:47:04.936564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-09-18T22:47:04.936832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-09-18T22:47:04.937015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACEL.csv [2025-09-18T22:47:04.937184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-09-18T22:47:04.937396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-09-18T22:47:04.937568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-09-18T22:47:04.937907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-09-18T22:47:04.938096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-09-18T22:47:04.938297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWN.csv [2025-09-18T22:47:04.938683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-09-18T22:47:04.938863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-09-18T22:47:04.939012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-09-18T22:47:04.939150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-09-18T22:47:04.939279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-09-18T22:47:04.939416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-09-18T22:47:04.939561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-09-18T22:47:04.939731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-09-18T22:47:04.939884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-09-18T22:47:04.940026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-09-18T22:47:04.940200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-09-18T22:47:04.940344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-09-18T22:47:04.940497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-09-18T22:47:04.940673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-09-18T22:47:04.940827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBLX.csv [2025-09-18T22:47:04.940973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-09-18T22:47:04.941116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-09-18T22:47:04.941254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-09-18T22:47:04.941401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-09-18T22:47:04.941527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-09-18T22:47:04.941636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-09-18T22:47:04.941795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-09-18T22:47:04.941949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-09-18T22:47:04.942086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-09-18T22:47:04.942232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-09-18T22:47:04.942601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-09-18T22:47:04.942768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-09-18T22:47:04.942909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-09-18T22:47:04.943037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-09-18T22:47:04.943188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-09-18T22:47:04.943329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-09-18T22:47:04.943460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-09-18T22:47:04.943609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-09-18T22:47:04.943794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-09-18T22:47:04.943945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-09-18T22:47:04.944074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-09-18T22:47:04.944243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-09-18T22:47:04.944365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-09-18T22:47:04.944495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-09-18T22:47:04.944617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-09-18T22:47:04.944811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNS.csv [2025-09-18T22:47:04.944938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-09-18T22:47:04.945053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-09-18T22:47:04.945171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-09-18T22:47:04.945290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-09-18T22:47:04.945408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-09-18T22:47:04.945524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-09-18T22:47:04.945789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-09-18T22:47:04.945989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-09-18T22:47:04.946184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-09-18T22:47:04.946348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-09-18T22:47:04.946540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-09-18T22:47:04.946748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-09-18T22:47:04.946947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-09-18T22:47:04.947146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-09-18T22:47:04.947326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-09-18T22:47:04.947510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-09-18T22:47:04.947813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-09-18T22:47:04.947983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-09-18T22:47:04.948161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-09-18T22:47:04.948353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-09-18T22:47:04.948533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-09-18T22:47:04.948764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-09-18T22:47:04.948936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-09-18T22:47:04.949130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-09-18T22:47:04.949291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-09-18T22:47:04.949469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-09-18T22:47:04.949668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-09-18T22:47:04.949854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-09-18T22:47:04.950030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-09-18T22:47:04.950222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-09-18T22:47:04.950394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-09-18T22:47:04.950541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-09-18T22:47:04.950725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-09-18T22:47:04.950872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-09-18T22:47:04.951142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-09-18T22:47:04.951266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-09-18T22:47:04.951380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-09-18T22:47:04.951515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-09-18T22:47:04.951669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-09-18T22:47:04.951812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-09-18T22:47:04.951985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-09-18T22:47:04.952106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-09-18T22:47:04.952220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-09-18T22:47:04.952338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-09-18T22:47:04.952452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-09-18T22:47:04.952606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-09-18T22:47:04.952775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-09-18T22:47:04.952907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-09-18T22:47:04.953042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-09-18T22:47:04.953163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-09-18T22:47:04.953263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-09-18T22:47:04.953390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELV.csv [2025-09-18T22:47:04.953510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-09-18T22:47:04.953625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-09-18T22:47:04.953889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-09-18T22:47:04.954006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-09-18T22:47:04.954124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-09-18T22:47:04.954266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-09-18T22:47:04.954403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-09-18T22:47:04.954540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-09-18T22:47:04.954895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-09-18T22:47:04.955036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-09-18T22:47:04.955176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-09-18T22:47:04.955296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-09-18T22:47:04.955417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-09-18T22:47:04.955553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-09-18T22:47:04.955721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-09-18T22:47:04.955853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-09-18T22:47:04.956013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-09-18T22:47:04.956171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-09-18T22:47:04.956328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-09-18T22:47:04.956496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-09-18T22:47:04.956683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-09-18T22:47:04.956807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-09-18T22:47:04.956921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-09-18T22:47:04.957055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-09-18T22:47:04.957189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-09-18T22:47:04.957308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-09-18T22:47:04.957483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-09-18T22:47:04.957682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-09-18T22:47:04.957847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-09-18T22:47:04.958045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-09-18T22:47:04.958228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-09-18T22:47:04.958407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-09-18T22:47:04.958595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-09-18T22:47:04.958820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-09-18T22:47:04.958996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-09-18T22:47:04.959177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-09-18T22:47:04.959381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-09-18T22:47:04.959547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-09-18T22:47:04.959729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-09-18T22:47:04.959899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-09-18T22:47:04.960082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-09-18T22:47:04.960277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-09-18T22:47:04.960457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-09-18T22:47:04.960680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-09-18T22:47:04.960855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-09-18T22:47:04.961095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-09-18T22:47:04.961266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-09-18T22:47:04.961456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-09-18T22:47:04.961638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGS.csv [2025-09-18T22:47:04.961934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-09-18T22:47:04.962106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-09-18T22:47:04.962266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-09-18T22:47:04.962407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-09-18T22:47:04.962552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-09-18T22:47:04.962721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-09-18T22:47:04.962876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-09-18T22:47:04.963034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-09-18T22:47:04.963169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-09-18T22:47:04.963291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-09-18T22:47:04.963414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-09-18T22:47:04.963516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKG.csv [2025-09-18T22:47:04.963612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-09-18T22:47:04.963752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-09-18T22:47:04.963889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-09-18T22:47:04.964017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-09-18T22:47:04.964142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-09-18T22:47:04.964283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-09-18T22:47:04.964447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-09-18T22:47:04.964574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-09-18T22:47:04.964738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-09-18T22:47:04.964912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-09-18T22:47:04.965038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-09-18T22:47:04.965154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-09-18T22:47:04.965476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-09-18T22:47:04.965629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-09-18T22:47:04.965792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-09-18T22:47:04.965917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-09-18T22:47:04.966040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-09-18T22:47:04.966188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-09-18T22:47:04.966326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-09-18T22:47:04.966448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-09-18T22:47:04.966606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-09-18T22:47:04.966780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABBV.csv [2025-09-18T22:47:04.966922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-09-18T22:47:04.967073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-09-18T22:47:04.967200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-09-18T22:47:04.967312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-09-18T22:47:04.967445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-09-18T22:47:04.967565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-09-18T22:47:04.967704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-09-18T22:47:04.967824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-09-18T22:47:04.967943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-09-18T22:47:04.968086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-09-18T22:47:04.968249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-09-18T22:47:04.968385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-09-18T22:47:04.968524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-09-18T22:47:04.968718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-09-18T22:47:04.968911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-09-18T22:47:04.969108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-09-18T22:47:04.969285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-09-18T22:47:04.969455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-09-18T22:47:04.969634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-09-18T22:47:04.969917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-09-18T22:47:04.970127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-09-18T22:47:04.970309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-09-18T22:47:04.970491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-09-18T22:47:04.970741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-09-18T22:47:04.970895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-09-18T22:47:04.971090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-09-18T22:47:04.971263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-09-18T22:47:04.971434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-09-18T22:47:04.971661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-09-18T22:47:04.971827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-09-18T22:47:04.971999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-09-18T22:47:04.972213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-09-18T22:47:04.972401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-09-18T22:47:04.972576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-09-18T22:47:04.972776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-09-18T22:47:04.973149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTAL.csv [2025-09-18T22:47:04.973307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-09-18T22:47:04.973442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-09-18T22:47:04.973569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-09-18T22:47:04.973710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-09-18T22:47:04.973831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-09-18T22:47:04.973929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-09-18T22:47:04.974040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-09-18T22:47:04.974161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-09-18T22:47:04.974275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-09-18T22:47:04.974402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-09-18T22:47:04.974537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-09-18T22:47:04.974677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-09-18T22:47:04.974847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-09-18T22:47:04.974959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-09-18T22:47:04.975054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-09-18T22:47:04.975178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-09-18T22:47:04.975313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-09-18T22:47:04.975431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-09-18T22:47:04.975551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRGO.csv [2025-09-18T22:47:04.975707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-09-18T22:47:04.975858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-09-18T22:47:04.976012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHT.csv [2025-09-18T22:47:04.976159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-09-18T22:47:04.976279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-09-18T22:47:04.976403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-09-18T22:47:04.976517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-09-18T22:47:04.976635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-09-18T22:47:04.976801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-09-18T22:47:04.976938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-09-18T22:47:04.977077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-09-18T22:47:04.977204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-09-18T22:47:04.977324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-09-18T22:47:04.977422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-09-18T22:47:04.977537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-09-18T22:47:04.977771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-09-18T22:47:04.977909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMD.csv [2025-09-18T22:47:04.978074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-09-18T22:47:04.978216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-09-18T22:47:04.978351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-09-18T22:47:04.978490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-09-18T22:47:04.978840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-09-18T22:47:04.978976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-09-18T22:47:04.979123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-09-18T22:47:04.979240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-09-18T22:47:04.979338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-09-18T22:47:04.979563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-09-18T22:47:04.979685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-09-18T22:47:04.979826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-09-18T22:47:04.979936] [INFO ] [LOCAL ] Deleted 1992 derivative data files. [2025-09-18T22:47:04.980024] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-09-18T22:47:04.982880] [INFO ] [LOCAL ] Found 2075 symbols with primary data. [2025-09-18T22:47:04.986512] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2075 symbols [2025-09-18T22:47:04.988135] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:04.988455] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:04.988632] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:05.036256] [DEBUG] [LOCAL ] AAT: Loaded 30832 existing records from primary storage. [2025-09-18T22:47:05.036519] [INFO ] [MAIN ] AAT: Loaded 30832 primary data records. [2025-09-18T22:47:05.176928] [DEBUG] [LOCAL ] AAP: Loaded 52568 existing records from primary storage. [2025-09-18T22:47:05.218264] [DEBUG] [LOCAL ] ABBV: Loaded 54077 existing records from primary storage. [2025-09-18T22:47:05.196849] [INFO ] [MAIN ] AAP: Loaded 52568 primary data records. [2025-09-18T22:47:05.218406] [INFO ] [MAIN ] ABBV: Loaded 54077 primary data records. [2025-09-18T22:47:06.109979] [DEBUG] [MAIN ] AAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:06.111199] [INFO ] [MAIN ] AAT: Generated 1807 derivative records from 30832 primary records. [2025-09-18T22:47:06.111571] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-09-18T22:47:06.125801] [DEBUG] [MAIN ] AAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:06.141342] [INFO ] [MAIN ] AAP: Generated 1807 derivative records from 52568 primary records. [2025-09-18T22:47:06.141754] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-09-18T22:47:06.144516] [DEBUG] [LOCAL ] AAT: Derivative data saved (1807 records). [2025-09-18T22:47:06.145677] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-09-18T22:47:06.171030] [DEBUG] [MAIN ] ABBV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:06.170610] [INFO ] [MAIN ] Derivative Progress: 1/2075 symbols completed. AAT took 1.2s. Estimated remaining: 41m 3s. Rate: 50.5 symbols/min [2025-09-18T22:47:06.172119] [INFO ] [MAIN ] ABBV: Generated 1807 derivative records from 54077 primary records. [2025-09-18T22:47:06.172483] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-09-18T22:47:06.173592] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:06.191966] [DEBUG] [LOCAL ] AAP: Derivative data saved (1807 records). [2025-09-18T22:47:06.192739] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-09-18T22:47:06.195218] [INFO ] [MAIN ] Derivative Progress: 2/2075 symbols completed. AAP took 1.2s. Estimated remaining: 20m 56s. Rate: 99.0 symbols/min [2025-09-18T22:47:06.196250] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:06.197581] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1807 records). [2025-09-18T22:47:06.197752] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-09-18T22:47:06.200302] [INFO ] [MAIN ] Derivative Progress: 3/2075 symbols completed. ABBV took 1.2s. Estimated remaining: 14m 1s. Rate: 147.9 symbols/min [2025-09-18T22:47:06.200667] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:06.230780] [DEBUG] [LOCAL ] ABG: Loaded 19091 existing records from primary storage. [2025-09-18T22:47:06.230918] [INFO ] [MAIN ] ABG: Loaded 19091 primary data records. [2025-09-18T22:47:06.354591] [DEBUG] [LOCAL ] ABCB: Loaded 31012 existing records from primary storage. [2025-09-18T22:47:06.358381] [INFO ] [MAIN ] ABCB: Loaded 31012 primary data records. [2025-09-18T22:47:06.560697] [DEBUG] [LOCAL ] ABEV: Loaded 53660 existing records from primary storage. [2025-09-18T22:47:06.662681] [INFO ] [MAIN ] ABEV: Loaded 53660 primary data records. [2025-09-18T22:47:07.278018] [DEBUG] [MAIN ] ABG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:07.279627] [INFO ] [MAIN ] ABG: Generated 1807 derivative records from 19091 primary records. [2025-09-18T22:47:07.280260] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-09-18T22:47:07.311761] [DEBUG] [MAIN ] ABCB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:07.311866] [DEBUG] [LOCAL ] ABG: Derivative data saved (1807 records). [2025-09-18T22:47:07.312038] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-09-18T22:47:07.312764] [INFO ] [MAIN ] ABCB: Generated 1807 derivative records from 31012 primary records. [2025-09-18T22:47:07.314566] [INFO ] [MAIN ] Derivative Progress: 4/2075 symbols completed. ABG took 1.1s. Estimated remaining: 20m 7s. Rate: 102.9 symbols/min [2025-09-18T22:47:07.312849] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-09-18T22:47:07.317060] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:07.334158] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1807 records). [2025-09-18T22:47:07.334517] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-09-18T22:47:07.336760] [INFO ] [MAIN ] Derivative Progress: 5/2075 symbols completed. ABCB took 1.2s. Estimated remaining: 16m 14s. Rate: 127.5 symbols/min [2025-09-18T22:47:07.344842] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:07.350576] [DEBUG] [MAIN ] ABEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:07.351530] [INFO ] [MAIN ] ABEV: Generated 1807 derivative records from 53660 primary records. [2025-09-18T22:47:07.351805] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-09-18T22:47:07.381564] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1807 records). [2025-09-18T22:47:07.381768] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-09-18T22:47:07.385023] [INFO ] [MAIN ] Derivative Progress: 6/2075 symbols completed. ABEV took 1.2s. Estimated remaining: 13m 48s. Rate: 149.9 symbols/min [2025-09-18T22:47:07.385564] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:07.405453] [DEBUG] [LOCAL ] ABM: Loaded 32511 existing records from primary storage. [2025-09-18T22:47:07.419011] [INFO ] [MAIN ] ABM: Loaded 32511 primary data records. [2025-09-18T22:47:07.545842] [DEBUG] [LOCAL ] ABR: Loaded 52531 existing records from primary storage. [2025-09-18T22:47:07.551850] [INFO ] [MAIN ] ABR: Loaded 52531 primary data records. [2025-09-18T22:47:07.964555] [DEBUG] [LOCAL ] ABT: Loaded 54011 existing records from primary storage. [2025-09-18T22:47:08.074133] [INFO ] [MAIN ] ABT: Loaded 54011 primary data records. [2025-09-18T22:47:08.433522] [DEBUG] [MAIN ] ABM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:08.435023] [INFO ] [MAIN ] ABM: Generated 1807 derivative records from 32511 primary records. [2025-09-18T22:47:08.435313] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-09-18T22:47:08.468821] [DEBUG] [MAIN ] ABR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:08.470905] [INFO ] [MAIN ] ABR: Generated 1807 derivative records from 52531 primary records. [2025-09-18T22:47:08.470199] [DEBUG] [LOCAL ] ABM: Derivative data saved (1807 records). [2025-09-18T22:47:08.471150] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-09-18T22:47:08.471203] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-09-18T22:47:08.473439] [INFO ] [MAIN ] Derivative Progress: 7/2075 symbols completed. ABM took 1.2s. Estimated remaining: 17m 11s. Rate: 120.3 symbols/min [2025-09-18T22:47:08.473886] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:08.512751] [DEBUG] [MAIN ] ABT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:08.514365] [INFO ] [MAIN ] ABT: Generated 1807 derivative records from 54011 primary records. [2025-09-18T22:47:08.514536] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-09-18T22:47:08.513612] [DEBUG] [LOCAL ] ABR: Derivative data saved (1807 records). [2025-09-18T22:47:08.514669] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-09-18T22:47:08.516720] [INFO ] [MAIN ] Derivative Progress: 8/2075 symbols completed. ABR took 1.2s. Estimated remaining: 15m 13s. Rate: 135.8 symbols/min [2025-09-18T22:47:08.517692] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:08.541357] [DEBUG] [LOCAL ] ACA: Loaded 24478 existing records from primary storage. [2025-09-18T22:47:08.542665] [DEBUG] [LOCAL ] ABT: Derivative data saved (1807 records). [2025-09-18T22:47:08.542760] [INFO ] [MAIN ] ACA: Loaded 24478 primary data records. [2025-09-18T22:47:08.542839] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-09-18T22:47:08.545491] [INFO ] [MAIN ] Derivative Progress: 9/2075 symbols completed. ABT took 1.2s. Estimated remaining: 13m 38s. Rate: 151.6 symbols/min [2025-09-18T22:47:08.557523] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:08.883328] [DEBUG] [LOCAL ] ACCO: Loaded 38341 existing records from primary storage. [2025-09-18T22:47:08.884081] [DEBUG] [LOCAL ] ACEL: Loaded 27701 existing records from primary storage. [2025-09-18T22:47:08.884200] [INFO ] [MAIN ] ACCO: Loaded 38341 primary data records. [2025-09-18T22:47:08.884280] [INFO ] [MAIN ] ACEL: Loaded 27701 primary data records. [2025-09-18T22:47:09.587338] [DEBUG] [MAIN ] ACA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:09.589196] [INFO ] [MAIN ] ACA: Generated 1807 derivative records from 24478 primary records. [2025-09-18T22:47:09.589571] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-09-18T22:47:09.607957] [DEBUG] [LOCAL ] ACA: Derivative data saved (1807 records). [2025-09-18T22:47:09.608206] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-09-18T22:47:09.610428] [INFO ] [MAIN ] Derivative Progress: 10/2075 symbols completed. ACA took 1.1s. Estimated remaining: 15m 56s. Rate: 129.7 symbols/min [2025-09-18T22:47:09.611016] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:09.628329] [DEBUG] [MAIN ] ACCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:09.629110] [INFO ] [MAIN ] ACCO: Generated 1807 derivative records from 38341 primary records. [2025-09-18T22:47:09.629261] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-09-18T22:47:09.659265] [DEBUG] [MAIN ] ACEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:09.660238] [INFO ] [MAIN ] ACEL: Generated 1807 derivative records from 27701 primary records. [2025-09-18T22:47:09.660771] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-09-18T22:47:09.670065] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1807 records). [2025-09-18T22:47:09.676027] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-09-18T22:47:09.678376] [INFO ] [MAIN ] Derivative Progress: 11/2075 symbols completed. ACCO took 1.2s. Estimated remaining: 14m 41s. Rate: 140.6 symbols/min [2025-09-18T22:47:09.678931] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1807 records). [2025-09-18T22:47:09.679300] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-09-18T22:47:09.679140] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:09.681592] [INFO ] [MAIN ] Derivative Progress: 12/2075 symbols completed. ACEL took 1.1s. Estimated remaining: 13m 28s. Rate: 153.2 symbols/min [2025-09-18T22:47:09.695884] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:09.718623] [DEBUG] [LOCAL ] ACHR: Loaded 54208 existing records from primary storage. [2025-09-18T22:47:09.718900] [INFO ] [MAIN ] ACHR: Loaded 54208 primary data records. [2025-09-18T22:47:10.065836] [DEBUG] [LOCAL ] ACM: Loaded 43495 existing records from primary storage. [2025-09-18T22:47:10.067212] [INFO ] [MAIN ] ACM: Loaded 43495 primary data records. [2025-09-18T22:47:10.068081] [DEBUG] [LOCAL ] ACI: Loaded 53663 existing records from primary storage. [2025-09-18T22:47:10.073452] [INFO ] [MAIN ] ACI: Loaded 53663 primary data records. [2025-09-18T22:47:10.755964] [DEBUG] [MAIN ] ACHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:10.757209] [INFO ] [MAIN ] ACHR: Generated 1807 derivative records from 54208 primary records. [2025-09-18T22:47:10.757311] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-09-18T22:47:10.778198] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1807 records). [2025-09-18T22:47:10.778510] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-09-18T22:47:10.780846] [INFO ] [MAIN ] Derivative Progress: 13/2075 symbols completed. ACHR took 1.2s. Estimated remaining: 15m 20s. Rate: 134.5 symbols/min [2025-09-18T22:47:10.799638] [DEBUG] [MAIN ] ACM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:10.800530] [INFO ] [MAIN ] ACM: Generated 1807 derivative records from 43495 primary records. [2025-09-18T22:47:10.812390] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-09-18T22:47:10.813237] [DEBUG] [MAIN ] ACI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:10.814046] [INFO ] [MAIN ] ACI: Generated 1807 derivative records from 53663 primary records. [2025-09-18T22:47:10.821274] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-09-18T22:47:10.842897] [DEBUG] [LOCAL ] ACI: Derivative data saved (1807 records). [2025-09-18T22:47:10.843208] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-09-18T22:47:10.846440] [INFO ] [MAIN ] Derivative Progress: 14/2075 symbols completed. ACI took 1.2s. Estimated remaining: 14m 23s. Rate: 143.3 symbols/min [2025-09-18T22:47:10.848108] [DEBUG] [LOCAL ] ACM: Derivative data saved (1807 records). [2025-09-18T22:47:10.848175] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-09-18T22:47:10.850012] [INFO ] [MAIN ] Derivative Progress: 15/2075 symbols completed. ACM took 1.2s. Estimated remaining: 13m 26s. Rate: 153.4 symbols/min [2025-09-18T22:47:10.850787] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:10.850673] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:10.850491] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:10.865408] [DEBUG] [LOCAL ] ACR: Loaded 6525 existing records from primary storage. [2025-09-18T22:47:10.865583] [INFO ] [MAIN ] ACR: Loaded 6525 primary data records. [2025-09-18T22:47:11.217907] [DEBUG] [LOCAL ] ACP: Loaded 31597 existing records from primary storage. [2025-09-18T22:47:11.218773] [INFO ] [MAIN ] ACP: Loaded 31597 primary data records. [2025-09-18T22:47:11.219504] [DEBUG] [LOCAL ] ACN: Loaded 53809 existing records from primary storage. [2025-09-18T22:47:11.219851] [INFO ] [MAIN ] ACN: Loaded 53809 primary data records. [2025-09-18T22:47:11.929451] [DEBUG] [MAIN ] ACR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:11.930563] [INFO ] [MAIN ] ACR: Generated 1807 derivative records from 6525 primary records. [2025-09-18T22:47:11.930686] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-09-18T22:47:11.951753] [DEBUG] [LOCAL ] ACR: Derivative data saved (1807 records). [2025-09-18T22:47:11.952244] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-09-18T22:47:11.956006] [INFO ] [MAIN ] Derivative Progress: 16/2075 symbols completed. ACR took 1.1s. Estimated remaining: 14m 57s. Rate: 137.7 symbols/min [2025-09-18T22:47:11.957725] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:11.974300] [DEBUG] [MAIN ] ACP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:11.987479] [INFO ] [MAIN ] ACP: Generated 1807 derivative records from 31597 primary records. [2025-09-18T22:47:11.988027] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-09-18T22:47:11.996322] [DEBUG] [MAIN ] ACN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:12.005321] [INFO ] [MAIN ] ACN: Generated 1807 derivative records from 53809 primary records. [2025-09-18T22:47:12.004483] [DEBUG] [LOCAL ] ACP: Derivative data saved (1807 records). [2025-09-18T22:47:12.005549] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-09-18T22:47:12.006062] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-09-18T22:47:12.008257] [INFO ] [MAIN ] Derivative Progress: 17/2075 symbols completed. ACP took 1.2s. Estimated remaining: 14m 10s. Rate: 145.2 symbols/min [2025-09-18T22:47:12.016107] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:12.026052] [DEBUG] [LOCAL ] ACN: Derivative data saved (1807 records). [2025-09-18T22:47:12.026263] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-09-18T22:47:12.028790] [INFO ] [MAIN ] Derivative Progress: 18/2075 symbols completed. ACN took 1.2s. Estimated remaining: 13m 25s. Rate: 153.3 symbols/min [2025-09-18T22:47:12.029257] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:12.063050] [DEBUG] [LOCAL ] ACVA: Loaded 49750 existing records from primary storage. [2025-09-18T22:47:12.063283] [INFO ] [MAIN ] ACVA: Loaded 49750 primary data records. [2025-09-18T22:47:12.222759] [DEBUG] [LOCAL ] ADCT: Loaded 33823 existing records from primary storage. [2025-09-18T22:47:12.255044] [INFO ] [MAIN ] ADCT: Loaded 33823 primary data records. [2025-09-18T22:47:12.255710] [DEBUG] [LOCAL ] ADC: Loaded 46911 existing records from primary storage. [2025-09-18T22:47:12.255827] [INFO ] [MAIN ] ADC: Loaded 46911 primary data records. [2025-09-18T22:47:13.039952] [DEBUG] [MAIN ] ACVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:13.041031] [INFO ] [MAIN ] ACVA: Generated 1807 derivative records from 49750 primary records. [2025-09-18T22:47:13.041494] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-09-18T22:47:13.063469] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1807 records). [2025-09-18T22:47:13.063772] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-09-18T22:47:13.090266] [DEBUG] [MAIN ] ADC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:13.085222] [INFO ] [MAIN ] Derivative Progress: 19/2075 symbols completed. ACVA took 1.1s. Estimated remaining: 14m 37s. Rate: 140.7 symbols/min [2025-09-18T22:47:13.090749] [DEBUG] [MAIN ] ADCT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:13.091474] [INFO ] [MAIN ] ADCT: Generated 1807 derivative records from 33823 primary records. [2025-09-18T22:47:13.092142] [INFO ] [MAIN ] ADC: Generated 1807 derivative records from 46911 primary records. [2025-09-18T22:47:13.092247] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-09-18T22:47:13.092768] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-09-18T22:47:13.094089] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:13.119468] [DEBUG] [LOCAL ] ADC: Derivative data saved (1807 records). [2025-09-18T22:47:13.119678] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-09-18T22:47:13.122558] [INFO ] [MAIN ] Derivative Progress: 20/2075 symbols completed. ADC took 1.1s. Estimated remaining: 13m 56s. Rate: 147.4 symbols/min [2025-09-18T22:47:13.123439] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:13.128677] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1807 records). [2025-09-18T22:47:13.128869] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-09-18T22:47:13.131188] [INFO ] [MAIN ] Derivative Progress: 21/2075 symbols completed. ADCT took 1.1s. Estimated remaining: 13m 17s. Rate: 154.6 symbols/min [2025-09-18T22:47:13.131611] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:13.210857] [DEBUG] [LOCAL ] ADM: Loaded 53786 existing records from primary storage. [2025-09-18T22:47:13.212012] [INFO ] [MAIN ] ADM: Loaded 53786 primary data records. [2025-09-18T22:47:13.249380] [DEBUG] [LOCAL ] ADNT: Loaded 48010 existing records from primary storage. [2025-09-18T22:47:13.277544] [INFO ] [MAIN ] ADNT: Loaded 48010 primary data records. [2025-09-18T22:47:13.412101] [DEBUG] [LOCAL ] ADT: Loaded 53843 existing records from primary storage. [2025-09-18T22:47:13.450367] [INFO ] [MAIN ] ADT: Loaded 53843 primary data records. [2025-09-18T22:47:14.195112] [DEBUG] [MAIN ] ADM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:14.195578] [DEBUG] [MAIN ] ADNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:14.197210] [INFO ] [MAIN ] ADM: Generated 1807 derivative records from 53786 primary records. [2025-09-18T22:47:14.196479] [INFO ] [MAIN ] ADNT: Generated 1807 derivative records from 48010 primary records. [2025-09-18T22:47:14.197393] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-09-18T22:47:14.198589] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-09-18T22:47:14.239727] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1807 records). [2025-09-18T22:47:14.240052] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-09-18T22:47:14.240411] [DEBUG] [MAIN ] ADT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:14.241944] [INFO ] [MAIN ] ADT: Generated 1807 derivative records from 53843 primary records. [2025-09-18T22:47:14.244887] [INFO ] [MAIN ] Derivative Progress: 22/2075 symbols completed. ADNT took 1.1s. Estimated remaining: 14m 24s. Rate: 142.5 symbols/min [2025-09-18T22:47:14.245340] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:14.242946] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-09-18T22:47:14.248007] [DEBUG] [LOCAL ] ADM: Derivative data saved (1807 records). [2025-09-18T22:47:14.248069] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-09-18T22:47:14.249816] [INFO ] [MAIN ] Derivative Progress: 23/2075 symbols completed. ADM took 1.2s. Estimated remaining: 13m 47s. Rate: 148.9 symbols/min [2025-09-18T22:47:14.257309] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:14.266617] [DEBUG] [LOCAL ] ADT: Derivative data saved (1807 records). [2025-09-18T22:47:14.266780] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-09-18T22:47:14.269199] [INFO ] [MAIN ] Derivative Progress: 24/2075 symbols completed. ADT took 1.1s. Estimated remaining: 13m 14s. Rate: 155.1 symbols/min [2025-09-18T22:47:14.269487] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:14.287753] [DEBUG] [LOCAL ] AEFC: Loaded 8742 existing records from primary storage. [2025-09-18T22:47:14.287880] [INFO ] [MAIN ] AEFC: Loaded 8742 primary data records. [2025-09-18T22:47:14.378098] [DEBUG] [LOCAL ] ADX: Loaded 28341 existing records from primary storage. [2025-09-18T22:47:14.412985] [INFO ] [MAIN ] ADX: Loaded 28341 primary data records. [2025-09-18T22:47:14.646625] [DEBUG] [LOCAL ] AEE: Loaded 50683 existing records from primary storage. [2025-09-18T22:47:14.725990] [INFO ] [MAIN ] AEE: Loaded 50683 primary data records. [2025-09-18T22:47:15.341839] [DEBUG] [MAIN ] AEFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:15.344145] [INFO ] [MAIN ] AEFC: Generated 1807 derivative records from 8742 primary records. [2025-09-18T22:47:15.344333] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-09-18T22:47:15.369213] [DEBUG] [MAIN ] ADX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:15.369964] [INFO ] [MAIN ] ADX: Generated 1807 derivative records from 28341 primary records. [2025-09-18T22:47:15.370063] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-09-18T22:47:15.375008] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1807 records). [2025-09-18T22:47:15.383002] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-09-18T22:47:15.392498] [INFO ] [MAIN ] Derivative Progress: 25/2075 symbols completed. AEFC took 1.1s. Estimated remaining: 14m 14s. Rate: 144.1 symbols/min [2025-09-18T22:47:15.394991] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:15.398878] [DEBUG] [LOCAL ] ADX: Derivative data saved (1807 records). [2025-09-18T22:47:15.400308] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-09-18T22:47:15.403752] [INFO ] [MAIN ] Derivative Progress: 26/2075 symbols completed. ADX took 1.2s. Estimated remaining: 13m 41s. Rate: 149.7 symbols/min [2025-09-18T22:47:15.405094] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:15.418419] [DEBUG] [MAIN ] AEE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:15.419377] [INFO ] [MAIN ] AEE: Generated 1807 derivative records from 50683 primary records. [2025-09-18T22:47:15.419527] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-09-18T22:47:15.436529] [DEBUG] [LOCAL ] AEE: Derivative data saved (1807 records). [2025-09-18T22:47:15.436763] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-09-18T22:47:15.439228] [INFO ] [MAIN ] Derivative Progress: 27/2075 symbols completed. AEE took 1.2s. Estimated remaining: 13m 13s. Rate: 154.9 symbols/min [2025-09-18T22:47:15.439520] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:15.488472] [DEBUG] [LOCAL ] AEG: Loaded 49975 existing records from primary storage. [2025-09-18T22:47:15.488625] [INFO ] [MAIN ] AEG: Loaded 49975 primary data records. [2025-09-18T22:47:15.626111] [DEBUG] [LOCAL ] AEM: Loaded 53854 existing records from primary storage. [2025-09-18T22:47:15.626348] [INFO ] [MAIN ] AEM: Loaded 53854 primary data records. [2025-09-18T22:47:15.831373] [DEBUG] [LOCAL ] AEO: Loaded 53947 existing records from primary storage. [2025-09-18T22:47:16.023033] [INFO ] [MAIN ] AEO: Loaded 53947 primary data records. [2025-09-18T22:47:16.488543] [DEBUG] [MAIN ] AEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:16.489932] [INFO ] [MAIN ] AEG: Generated 1807 derivative records from 49975 primary records. [2025-09-18T22:47:16.490321] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-09-18T22:47:16.511289] [DEBUG] [MAIN ] AEM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:16.513398] [INFO ] [MAIN ] AEM: Generated 1807 derivative records from 53854 primary records. [2025-09-18T22:47:16.513631] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-09-18T22:47:16.533060] [DEBUG] [LOCAL ] AEG: Derivative data saved (1807 records). [2025-09-18T22:47:16.533210] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-09-18T22:47:16.535221] [INFO ] [MAIN ] Derivative Progress: 28/2075 symbols completed. AEG took 1.1s. Estimated remaining: 14m 5s. Rate: 145.4 symbols/min [2025-09-18T22:47:16.542624] [DEBUG] [LOCAL ] AEM: Derivative data saved (1807 records). [2025-09-18T22:47:16.542817] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-09-18T22:47:16.559809] [INFO ] [MAIN ] Derivative Progress: 29/2075 symbols completed. AEM took 1.2s. Estimated remaining: 13m 37s. Rate: 150.3 symbols/min [2025-09-18T22:47:16.560344] [DEBUG] [MAIN ] AEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:16.561152] [INFO ] [MAIN ] AEO: Generated 1807 derivative records from 53947 primary records. [2025-09-18T22:47:16.561216] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-09-18T22:47:16.577036] [DEBUG] [LOCAL ] AEO: Derivative data saved (1807 records). [2025-09-18T22:47:16.577102] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-09-18T22:47:16.579688] [INFO ] [MAIN ] Derivative Progress: 30/2075 symbols completed. AEO took 1.1s. Estimated remaining: 13m 11s. Rate: 155.2 symbols/min [2025-09-18T22:47:16.580193] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:16.580293] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:16.580480] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:16.638383] [DEBUG] [LOCAL ] AFG: Loaded 32981 existing records from primary storage. [2025-09-18T22:47:16.652446] [INFO ] [MAIN ] AFG: Loaded 32981 primary data records. [2025-09-18T22:47:16.791606] [DEBUG] [LOCAL ] AER: Loaded 49227 existing records from primary storage. [2025-09-18T22:47:16.802994] [INFO ] [MAIN ] AER: Loaded 49227 primary data records. [2025-09-18T22:47:16.819524] [DEBUG] [LOCAL ] AES: Loaded 54064 existing records from primary storage. [2025-09-18T22:47:16.835248] [INFO ] [MAIN ] AES: Loaded 54064 primary data records. [2025-09-18T22:47:17.706934] [DEBUG] [MAIN ] AFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:17.708382] [INFO ] [MAIN ] AFG: Generated 1807 derivative records from 32981 primary records. [2025-09-18T22:47:17.708691] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-09-18T22:47:17.742797] [DEBUG] [LOCAL ] AFG: Derivative data saved (1807 records). [2025-09-18T22:47:17.743731] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-09-18T22:47:17.745677] [INFO ] [MAIN ] Derivative Progress: 31/2075 symbols completed. AFG took 1.2s. Estimated remaining: 14m 2s. Rate: 145.7 symbols/min [2025-09-18T22:47:17.746434] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:17.746877] [DEBUG] [MAIN ] AER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:17.759719] [DEBUG] [MAIN ] AES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:17.760520] [INFO ] [MAIN ] AER: Generated 1807 derivative records from 49227 primary records. [2025-09-18T22:47:17.762009] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-09-18T22:47:17.761160] [INFO ] [MAIN ] AES: Generated 1807 derivative records from 54064 primary records. [2025-09-18T22:47:17.762129] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-09-18T22:47:17.782359] [DEBUG] [LOCAL ] AFGB: Loaded 2536 existing records from primary storage. [2025-09-18T22:47:17.789951] [INFO ] [MAIN ] AFGB: Loaded 2536 primary data records. [2025-09-18T22:47:17.883561] [DEBUG] [LOCAL ] AES: Derivative data saved (1807 records). [2025-09-18T22:47:17.895120] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-09-18T22:47:17.889820] [DEBUG] [LOCAL ] AER: Derivative data saved (1807 records). [2025-09-18T22:47:17.902320] [INFO ] [MAIN ] Derivative Progress: 32/2075 symbols completed. AES took 1.3s. Estimated remaining: 13m 45s. Rate: 148.6 symbols/min [2025-09-18T22:47:17.926383] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:17.922422] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-09-18T22:47:17.929401] [INFO ] [MAIN ] Derivative Progress: 33/2075 symbols completed. AER took 1.3s. Estimated remaining: 13m 21s. Rate: 152.9 symbols/min [2025-09-18T22:47:18.002492] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:18.010975] [DEBUG] [LOCAL ] AFGC: Loaded 2566 existing records from primary storage. [2025-09-18T22:47:18.129709] [INFO ] [MAIN ] AFGC: Loaded 2566 primary data records. [2025-09-18T22:47:18.200218] [DEBUG] [LOCAL ] AFGD: Loaded 1906 existing records from primary storage. [2025-09-18T22:47:18.218201] [INFO ] [MAIN ] AFGD: Loaded 1906 primary data records. [2025-09-18T22:47:18.780969] [DEBUG] [MAIN ] AFGB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:18.782506] [INFO ] [MAIN ] AFGB: Generated 1807 derivative records from 2536 primary records. [2025-09-18T22:47:18.782997] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-09-18T22:47:18.800519] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1807 records). [2025-09-18T22:47:18.801076] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-09-18T22:47:18.802978] [INFO ] [MAIN ] Derivative Progress: 34/2075 symbols completed. AFGB took 1.1s. Estimated remaining: 13m 50s. Rate: 147.6 symbols/min [2025-09-18T22:47:18.803750] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:18.811583] [DEBUG] [LOCAL ] AFGE: Loaded 2533 existing records from primary storage. [2025-09-18T22:47:18.812477] [INFO ] [MAIN ] AFGE: Loaded 2533 primary data records. [2025-09-18T22:47:18.911167] [DEBUG] [MAIN ] AFGC: Filtered 6966 bins outside market hours, 7765 incomplete bins [2025-09-18T22:47:18.942116] [INFO ] [MAIN ] AFGC: Generated 1801 derivative records from 2566 primary records. [2025-09-18T22:47:18.947254] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-09-18T22:47:18.958427] [DEBUG] [MAIN ] AFGD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:18.975323] [INFO ] [MAIN ] AFGD: Generated 1807 derivative records from 1906 primary records. [2025-09-18T22:47:19.035089] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-09-18T22:47:19.173776] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1801 records). [2025-09-18T22:47:19.174711] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-09-18T22:47:19.176406] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1807 records). [2025-09-18T22:47:19.178389] [INFO ] [MAIN ] Derivative Progress: 35/2075 symbols completed. AFGC took 1.3s. Estimated remaining: 13m 47s. Rate: 147.9 symbols/min [2025-09-18T22:47:19.178565] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-09-18T22:47:19.181120] [INFO ] [MAIN ] Derivative Progress: 36/2075 symbols completed. AFGD took 1.2s. Estimated remaining: 13m 24s. Rate: 152.1 symbols/min [2025-09-18T22:47:19.179057] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:19.182188] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:19.204330] [DEBUG] [MAIN ] AFGE: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-09-18T22:47:19.205225] [INFO ] [MAIN ] AFGE: Generated 1805 derivative records from 2533 primary records. [2025-09-18T22:47:19.205331] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-09-18T22:47:19.220240] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1805 records). [2025-09-18T22:47:19.220426] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-09-18T22:47:19.222721] [INFO ] [MAIN ] Derivative Progress: 37/2075 symbols completed. AFGE took 0.4s. Estimated remaining: 13m 4s. Rate: 155.9 symbols/min [2025-09-18T22:47:19.223048] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:19.274303] [DEBUG] [LOCAL ] AG: Loaded 54031 existing records from primary storage. [2025-09-18T22:47:19.275067] [INFO ] [MAIN ] AG: Loaded 54031 primary data records. [2025-09-18T22:47:19.392968] [DEBUG] [LOCAL ] AFL: Loaded 53537 existing records from primary storage. [2025-09-18T22:47:19.410747] [INFO ] [MAIN ] AFL: Loaded 53537 primary data records. [2025-09-18T22:47:19.594122] [DEBUG] [LOCAL ] AGCO: Loaded 43138 existing records from primary storage. [2025-09-18T22:47:19.774985] [INFO ] [MAIN ] AGCO: Loaded 43138 primary data records. [2025-09-18T22:47:20.309770] [DEBUG] [MAIN ] AG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:20.310755] [INFO ] [MAIN ] AG: Generated 1807 derivative records from 54031 primary records. [2025-09-18T22:47:20.311575] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-09-18T22:47:20.330835] [DEBUG] [LOCAL ] AG: Derivative data saved (1807 records). [2025-09-18T22:47:20.330942] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-09-18T22:47:20.334773] [INFO ] [MAIN ] Derivative Progress: 38/2075 symbols completed. AG took 1.2s. Estimated remaining: 13m 43s. Rate: 148.5 symbols/min [2025-09-18T22:47:20.335479] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:20.349667] [DEBUG] [MAIN ] AFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:20.352471] [INFO ] [MAIN ] AFL: Generated 1807 derivative records from 53537 primary records. [2025-09-18T22:47:20.353462] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-09-18T22:47:20.383080] [DEBUG] [LOCAL ] AFL: Derivative data saved (1807 records). [2025-09-18T22:47:20.383497] [DEBUG] [MAIN ] AGCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:20.383768] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-09-18T22:47:20.386896] [INFO ] [MAIN ] Derivative Progress: 39/2075 symbols completed. AFL took 1.2s. Estimated remaining: 13m 24s. Rate: 151.9 symbols/min [2025-09-18T22:47:20.384612] [INFO ] [MAIN ] AGCO: Generated 1807 derivative records from 43138 primary records. [2025-09-18T22:47:20.387329] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-09-18T22:47:20.387537] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:20.415735] [DEBUG] [LOCAL ] AGD: Loaded 17701 existing records from primary storage. [2025-09-18T22:47:20.416239] [INFO ] [MAIN ] AGD: Loaded 17701 primary data records. [2025-09-18T22:47:20.482708] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1807 records). [2025-09-18T22:47:20.494579] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-09-18T22:47:20.512926] [INFO ] [MAIN ] Derivative Progress: 40/2075 symbols completed. AGCO took 1.3s. Estimated remaining: 13m 10s. Rate: 154.5 symbols/min [2025-09-18T22:47:20.524194] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:20.750120] [DEBUG] [LOCAL ] AGI: Loaded 53802 existing records from primary storage. [2025-09-18T22:47:20.751272] [INFO ] [MAIN ] AGI: Loaded 53802 primary data records. [2025-09-18T22:47:20.987012] [DEBUG] [LOCAL ] AGL: Loaded 52793 existing records from primary storage. [2025-09-18T22:47:21.101291] [INFO ] [MAIN ] AGL: Loaded 52793 primary data records. [2025-09-18T22:47:21.447684] [DEBUG] [MAIN ] AGD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:21.483186] [INFO ] [MAIN ] AGD: Generated 1807 derivative records from 17701 primary records. [2025-09-18T22:47:21.483725] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-09-18T22:47:21.502950] [DEBUG] [LOCAL ] AGD: Derivative data saved (1807 records). [2025-09-18T22:47:21.504087] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-09-18T22:47:21.506677] [INFO ] [MAIN ] Derivative Progress: 41/2075 symbols completed. AGD took 1.2s. Estimated remaining: 13m 40s. Rate: 148.9 symbols/min [2025-09-18T22:47:21.507336] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:21.526717] [DEBUG] [MAIN ] AGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:21.527452] [INFO ] [MAIN ] AGI: Generated 1807 derivative records from 53802 primary records. [2025-09-18T22:47:21.527724] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-09-18T22:47:21.545919] [DEBUG] [LOCAL ] AGI: Derivative data saved (1807 records). [2025-09-18T22:47:21.546163] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-09-18T22:47:21.551256] [INFO ] [MAIN ] Derivative Progress: 42/2075 symbols completed. AGI took 1.2s. Estimated remaining: 13m 22s. Rate: 152.1 symbols/min [2025-09-18T22:47:21.552041] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:21.579540] [DEBUG] [MAIN ] AGL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:21.580392] [INFO ] [MAIN ] AGL: Generated 1807 derivative records from 52793 primary records. [2025-09-18T22:47:21.580524] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-09-18T22:47:21.610241] [DEBUG] [LOCAL ] AGL: Derivative data saved (1807 records). [2025-09-18T22:47:21.609251] [DEBUG] [LOCAL ] AGO: Loaded 28350 existing records from primary storage. [2025-09-18T22:47:21.610822] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-09-18T22:47:21.610530] [INFO ] [MAIN ] AGO: Loaded 28350 primary data records. [2025-09-18T22:47:21.612924] [INFO ] [MAIN ] Derivative Progress: 43/2075 symbols completed. AGL took 1.1s. Estimated remaining: 13m 6s. Rate: 155.1 symbols/min [2025-09-18T22:47:21.746162] [DEBUG] [LOCAL ] AGRO: Loaded 34245 existing records from primary storage. [2025-09-18T22:47:21.756516] [INFO ] [MAIN ] AGRO: Loaded 34245 primary data records. [2025-09-18T22:47:22.272132] [DEBUG] [MAIN ] AGO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:22.273078] [INFO ] [MAIN ] AGO: Generated 1807 derivative records from 28350 primary records. [2025-09-18T22:47:22.273286] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-09-18T22:47:22.292513] [DEBUG] [LOCAL ] AGO: Derivative data saved (1807 records). [2025-09-18T22:47:22.292699] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-09-18T22:47:22.295476] [INFO ] [MAIN ] Derivative Progress: 44/2075 symbols completed. AGO took 0.8s. Estimated remaining: 13m 19s. Rate: 152.5 symbols/min [2025-09-18T22:47:22.308985] [DEBUG] [MAIN ] AGRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:22.309519] [INFO ] [MAIN ] AGRO: Generated 1807 derivative records from 34245 primary records. [2025-09-18T22:47:22.309578] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-09-18T22:47:22.324596] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1807 records). [2025-09-18T22:47:22.324684] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-09-18T22:47:22.326630] [INFO ] [MAIN ] Derivative Progress: 45/2075 symbols completed. AGRO took 0.8s. Estimated remaining: 13m 2s. Rate: 155.7 symbols/min [2025-09-18T22:47:22.327205] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:22.327466] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:22.327839] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:22.363947] [DEBUG] [LOCAL ] AGX: Loaded 33860 existing records from primary storage. [2025-09-18T22:47:22.364130] [INFO ] [MAIN ] AGX: Loaded 33860 primary data records. [2025-09-18T22:47:22.559321] [DEBUG] [LOCAL ] AHH: Loaded 41921 existing records from primary storage. [2025-09-18T22:47:22.598246] [INFO ] [MAIN ] AHH: Loaded 41921 primary data records. [2025-09-18T22:47:22.604895] [DEBUG] [LOCAL ] AHR: Loaded 49738 existing records from primary storage. [2025-09-18T22:47:22.752250] [INFO ] [MAIN ] AHR: Loaded 49738 primary data records. [2025-09-18T22:47:23.359496] [DEBUG] [MAIN ] AGX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:23.360363] [INFO ] [MAIN ] AGX: Generated 1807 derivative records from 33860 primary records. [2025-09-18T22:47:23.360520] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-09-18T22:47:23.380544] [DEBUG] [LOCAL ] AGX: Derivative data saved (1807 records). [2025-09-18T22:47:23.381708] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-09-18T22:47:23.384244] [INFO ] [MAIN ] Derivative Progress: 46/2075 symbols completed. AGX took 1.1s. Estimated remaining: 13m 32s. Rate: 150.0 symbols/min [2025-09-18T22:47:23.384614] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:23.401499] [DEBUG] [MAIN ] AHH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:23.402586] [INFO ] [MAIN ] AHH: Generated 1807 derivative records from 41921 primary records. [2025-09-18T22:47:23.402834] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-09-18T22:47:23.429761] [DEBUG] [MAIN ] AHR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:47:23.431202] [INFO ] [MAIN ] AHR: Generated 1806 derivative records from 49738 primary records. [2025-09-18T22:47:23.432079] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-09-18T22:47:23.437827] [DEBUG] [LOCAL ] AHT: Loaded 5997 existing records from primary storage. [2025-09-18T22:47:23.449382] [INFO ] [MAIN ] AHT: Loaded 5997 primary data records. [2025-09-18T22:47:23.485591] [DEBUG] [LOCAL ] AHH: Derivative data saved (1807 records). [2025-09-18T22:47:23.492198] [DEBUG] [LOCAL ] AHR: Derivative data saved (1806 records). [2025-09-18T22:47:23.499425] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-09-18T22:47:23.525216] [INFO ] [MAIN ] Derivative Progress: 47/2075 symbols completed. AHR took 1.2s. Estimated remaining: 13m 20s. Rate: 152.1 symbols/min [2025-09-18T22:47:23.542625] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:23.512477] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-09-18T22:47:23.565512] [INFO ] [MAIN ] Derivative Progress: 48/2075 symbols completed. AHH took 1.2s. Estimated remaining: 13m 5s. Rate: 155.0 symbols/min [2025-09-18T22:47:23.569892] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:23.873196] [DEBUG] [MAIN ] AHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:23.887234] [DEBUG] [LOCAL ] AI: Loaded 54139 existing records from primary storage. [2025-09-18T22:47:23.889129] [INFO ] [MAIN ] AHT: Generated 1807 derivative records from 5997 primary records. [2025-09-18T22:47:23.889279] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-09-18T22:47:23.890022] [DEBUG] [LOCAL ] AIG: Loaded 53867 existing records from primary storage. [2025-09-18T22:47:23.889396] [INFO ] [MAIN ] AI: Loaded 54139 primary data records. [2025-09-18T22:47:23.890900] [INFO ] [MAIN ] AIG: Loaded 53867 primary data records. [2025-09-18T22:47:24.098414] [DEBUG] [LOCAL ] AHT: Derivative data saved (1807 records). [2025-09-18T22:47:24.113321] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-09-18T22:47:24.116129] [INFO ] [MAIN ] Derivative Progress: 49/2075 symbols completed. AHT took 0.7s. Estimated remaining: 13m 11s. Rate: 153.7 symbols/min [2025-09-18T22:47:24.121915] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:24.561049] [DEBUG] [LOCAL ] AIN: Loaded 24805 existing records from primary storage. [2025-09-18T22:47:24.561874] [INFO ] [MAIN ] AIN: Loaded 24805 primary data records. [2025-09-18T22:47:24.904484] [DEBUG] [MAIN ] AIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:24.904150] [DEBUG] [MAIN ] AI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:24.907209] [INFO ] [MAIN ] AIG: Generated 1807 derivative records from 53867 primary records. [2025-09-18T22:47:24.908223] [INFO ] [MAIN ] AI: Generated 1807 derivative records from 54139 primary records. [2025-09-18T22:47:24.908325] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-09-18T22:47:24.908831] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-09-18T22:47:24.934117] [DEBUG] [LOCAL ] AI: Derivative data saved (1807 records). [2025-09-18T22:47:24.937638] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-09-18T22:47:24.940806] [INFO ] [MAIN ] Derivative Progress: 50/2075 symbols completed. AI took 1.4s. Estimated remaining: 13m 28s. Rate: 150.3 symbols/min [2025-09-18T22:47:24.941571] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:24.948130] [DEBUG] [LOCAL ] AIG: Derivative data saved (1807 records). [2025-09-18T22:47:24.948294] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-09-18T22:47:24.950267] [INFO ] [MAIN ] Derivative Progress: 51/2075 symbols completed. AIG took 1.4s. Estimated remaining: 13m 12s. Rate: 153.3 symbols/min [2025-09-18T22:47:24.950667] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:24.969994] [DEBUG] [MAIN ] AIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:24.976266] [INFO ] [MAIN ] AIN: Generated 1807 derivative records from 24805 primary records. [2025-09-18T22:47:24.976464] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-09-18T22:47:24.975513] [DEBUG] [LOCAL ] AIO: Loaded 13488 existing records from primary storage. [2025-09-18T22:47:24.976998] [INFO ] [MAIN ] AIO: Loaded 13488 primary data records. [2025-09-18T22:47:25.091906] [DEBUG] [LOCAL ] AIN: Derivative data saved (1807 records). [2025-09-18T22:47:25.102747] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-09-18T22:47:25.104987] [INFO ] [MAIN ] Derivative Progress: 52/2075 symbols completed. AIN took 1.0s. Estimated remaining: 13m 3s. Rate: 155.1 symbols/min [2025-09-18T22:47:25.124057] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:25.134992] [DEBUG] [LOCAL ] AIR: Loaded 27262 existing records from primary storage. [2025-09-18T22:47:25.153610] [INFO ] [MAIN ] AIR: Loaded 27262 primary data records. [2025-09-18T22:47:25.678311] [DEBUG] [LOCAL ] AIT: Loaded 28647 existing records from primary storage. [2025-09-18T22:47:25.678697] [INFO ] [MAIN ] AIT: Loaded 28647 primary data records. [2025-09-18T22:47:26.016801] [DEBUG] [MAIN ] AIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:26.019437] [INFO ] [MAIN ] AIO: Generated 1807 derivative records from 13488 primary records. [2025-09-18T22:47:26.019867] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-09-18T22:47:26.036824] [DEBUG] [LOCAL ] AIO: Derivative data saved (1807 records). [2025-09-18T22:47:26.037029] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-09-18T22:47:26.039726] [INFO ] [MAIN ] Derivative Progress: 53/2075 symbols completed. AIO took 1.1s. Estimated remaining: 13m 23s. Rate: 151.0 symbols/min [2025-09-18T22:47:26.043441] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:26.058479] [DEBUG] [MAIN ] AIR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:26.059313] [INFO ] [MAIN ] AIR: Generated 1807 derivative records from 27262 primary records. [2025-09-18T22:47:26.063283] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-09-18T22:47:26.088894] [DEBUG] [MAIN ] AIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:26.092391] [DEBUG] [LOCAL ] AIR: Derivative data saved (1807 records). [2025-09-18T22:47:26.093076] [INFO ] [MAIN ] AIT: Generated 1807 derivative records from 28647 primary records. [2025-09-18T22:47:26.093222] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-09-18T22:47:26.093137] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-09-18T22:47:26.096082] [INFO ] [MAIN ] Derivative Progress: 54/2075 symbols completed. AIR took 1.1s. Estimated remaining: 13m 10s. Rate: 153.5 symbols/min [2025-09-18T22:47:26.107492] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:26.111573] [DEBUG] [LOCAL ] AIT: Derivative data saved (1807 records). [2025-09-18T22:47:26.121091] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-09-18T22:47:26.123225] [INFO ] [MAIN ] Derivative Progress: 55/2075 symbols completed. AIT took 1.0s. Estimated remaining: 12m 56s. Rate: 156.1 symbols/min [2025-09-18T22:47:26.123593] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:26.140569] [DEBUG] [LOCAL ] AIV: Loaded 40482 existing records from primary storage. [2025-09-18T22:47:26.140844] [INFO ] [MAIN ] AIV: Loaded 40482 primary data records. [2025-09-18T22:47:26.341211] [DEBUG] [LOCAL ] AIZ: Loaded 30647 existing records from primary storage. [2025-09-18T22:47:26.376197] [INFO ] [MAIN ] AIZ: Loaded 30647 primary data records. [2025-09-18T22:47:26.481244] [DEBUG] [LOCAL ] AKR: Loaded 46021 existing records from primary storage. [2025-09-18T22:47:26.491822] [INFO ] [MAIN ] AKR: Loaded 46021 primary data records. [2025-09-18T22:47:27.140957] [DEBUG] [MAIN ] AIV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:27.141937] [INFO ] [MAIN ] AIV: Generated 1807 derivative records from 40482 primary records. [2025-09-18T22:47:27.142079] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-09-18T22:47:27.160172] [DEBUG] [LOCAL ] AIV: Derivative data saved (1807 records). [2025-09-18T22:47:27.160522] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-09-18T22:47:27.162886] [INFO ] [MAIN ] Derivative Progress: 56/2075 symbols completed. AIV took 1.1s. Estimated remaining: 13m 20s. Rate: 151.5 symbols/min [2025-09-18T22:47:27.163239] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:27.183986] [DEBUG] [MAIN ] AKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:27.196278] [INFO ] [MAIN ] AKR: Generated 1807 derivative records from 46021 primary records. [2025-09-18T22:47:27.196530] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-09-18T22:47:27.197813] [DEBUG] [MAIN ] AIZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:27.198606] [INFO ] [MAIN ] AIZ: Generated 1807 derivative records from 30647 primary records. [2025-09-18T22:47:27.206031] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-09-18T22:47:27.223527] [DEBUG] [LOCAL ] AKR: Derivative data saved (1807 records). [2025-09-18T22:47:27.224551] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-09-18T22:47:27.229024] [INFO ] [MAIN ] Derivative Progress: 57/2075 symbols completed. AKR took 1.1s. Estimated remaining: 13m 8s. Rate: 153.7 symbols/min [2025-09-18T22:47:27.229483] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:27.234248] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1807 records). [2025-09-18T22:47:27.234445] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-09-18T22:47:27.236758] [INFO ] [MAIN ] Derivative Progress: 58/2075 symbols completed. AIZ took 1.1s. Estimated remaining: 12m 54s. Rate: 156.4 symbols/min [2025-09-18T22:47:27.264083] [DEBUG] [LOCAL ] AL: Loaded 44281 existing records from primary storage. [2025-09-18T22:47:27.264240] [INFO ] [MAIN ] AL: Loaded 44281 primary data records. [2025-09-18T22:47:27.615708] [DEBUG] [LOCAL ] ALB: Loaded 53627 existing records from primary storage. [2025-09-18T22:47:27.615904] [INFO ] [MAIN ] ALB: Loaded 53627 primary data records. [2025-09-18T22:47:27.947302] [DEBUG] [MAIN ] AL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:27.948199] [INFO ] [MAIN ] AL: Generated 1807 derivative records from 44281 primary records. [2025-09-18T22:47:27.948463] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-09-18T22:47:27.965050] [DEBUG] [LOCAL ] AL: Derivative data saved (1807 records). [2025-09-18T22:47:27.965233] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-09-18T22:47:27.968009] [INFO ] [MAIN ] Derivative Progress: 59/2075 symbols completed. AL took 0.8s. Estimated remaining: 13m 5s. Rate: 154.0 symbols/min [2025-09-18T22:47:27.983451] [DEBUG] [MAIN ] ALB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:27.984100] [INFO ] [MAIN ] ALB: Generated 1807 derivative records from 53627 primary records. [2025-09-18T22:47:27.984164] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-09-18T22:47:27.999313] [DEBUG] [LOCAL ] ALB: Derivative data saved (1807 records). [2025-09-18T22:47:27.999375] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-09-18T22:47:28.001477] [INFO ] [MAIN ] Derivative Progress: 60/2075 symbols completed. ALB took 0.8s. Estimated remaining: 12m 53s. Rate: 156.4 symbols/min [2025-09-18T22:47:28.002233] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:28.002342] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:28.002103] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:28.048087] [DEBUG] [LOCAL ] ALEX: Loaded 31856 existing records from primary storage. [2025-09-18T22:47:28.048265] [INFO ] [MAIN ] ALEX: Loaded 31856 primary data records. [2025-09-18T22:47:28.165379] [DEBUG] [LOCAL ] ALE: Loaded 30334 existing records from primary storage. [2025-09-18T22:47:28.173513] [INFO ] [MAIN ] ALE: Loaded 30334 primary data records. [2025-09-18T22:47:28.326965] [DEBUG] [LOCAL ] ALC: Loaded 51186 existing records from primary storage. [2025-09-18T22:47:28.364030] [INFO ] [MAIN ] ALC: Loaded 51186 primary data records. [2025-09-18T22:47:29.046884] [DEBUG] [MAIN ] ALEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:29.047879] [INFO ] [MAIN ] ALEX: Generated 1807 derivative records from 31856 primary records. [2025-09-18T22:47:29.048286] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-09-18T22:47:29.066454] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1807 records). [2025-09-18T22:47:29.066849] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-09-18T22:47:29.068820] [INFO ] [MAIN ] Derivative Progress: 61/2075 symbols completed. ALEX took 1.1s. Estimated remaining: 13m 15s. Rate: 152.0 symbols/min [2025-09-18T22:47:29.069378] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:29.087062] [DEBUG] [MAIN ] ALE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:29.091451] [INFO ] [MAIN ] ALE: Generated 1807 derivative records from 30334 primary records. [2025-09-18T22:47:29.093405] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-09-18T22:47:29.114564] [DEBUG] [LOCAL ] ALG: Loaded 10773 existing records from primary storage. [2025-09-18T22:47:29.125345] [INFO ] [MAIN ] ALG: Loaded 10773 primary data records. [2025-09-18T22:47:29.126233] [DEBUG] [LOCAL ] ALE: Derivative data saved (1807 records). [2025-09-18T22:47:29.159497] [DEBUG] [MAIN ] ALC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:29.131576] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-09-18T22:47:29.173013] [INFO ] [MAIN ] ALC: Generated 1807 derivative records from 51186 primary records. [2025-09-18T22:47:29.188485] [INFO ] [MAIN ] Derivative Progress: 62/2075 symbols completed. ALE took 1.2s. Estimated remaining: 13m 6s. Rate: 153.7 symbols/min [2025-09-18T22:47:29.178291] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-09-18T22:47:29.198846] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:29.493503] [DEBUG] [LOCAL ] ALC: Derivative data saved (1807 records). [2025-09-18T22:47:29.502422] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-09-18T22:47:29.504505] [INFO ] [MAIN ] Derivative Progress: 63/2075 symbols completed. ALC took 1.5s. Estimated remaining: 13m 3s. Rate: 154.2 symbols/min [2025-09-18T22:47:29.504993] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:29.548220] [DEBUG] [LOCAL ] ALIT: Loaded 53112 existing records from primary storage. [2025-09-18T22:47:29.548771] [INFO ] [MAIN ] ALIT: Loaded 53112 primary data records. [2025-09-18T22:47:29.735272] [DEBUG] [MAIN ] ALG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:29.779902] [INFO ] [MAIN ] ALG: Generated 1807 derivative records from 10773 primary records. [2025-09-18T22:47:29.952450] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-09-18T22:47:29.956431] [DEBUG] [LOCAL ] ALK: Loaded 53456 existing records from primary storage. [2025-09-18T22:47:29.972992] [INFO ] [MAIN ] ALK: Loaded 53456 primary data records. [2025-09-18T22:47:29.981886] [DEBUG] [LOCAL ] ALG: Derivative data saved (1807 records). [2025-09-18T22:47:29.998912] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-09-18T22:47:30.003311] [INFO ] [MAIN ] Derivative Progress: 64/2075 symbols completed. ALG took 0.9s. Estimated remaining: 13m 6s. Rate: 153.5 symbols/min [2025-09-18T22:47:30.022081] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:30.465827] [DEBUG] [MAIN ] ALIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:30.485513] [INFO ] [MAIN ] ALIT: Generated 1807 derivative records from 53112 primary records. [2025-09-18T22:47:30.485734] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-09-18T22:47:30.514510] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1807 records). [2025-09-18T22:47:30.516120] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-09-18T22:47:30.520635] [INFO ] [MAIN ] Derivative Progress: 65/2075 symbols completed. ALIT took 1.3s. Estimated remaining: 13m 10s. Rate: 152.7 symbols/min [2025-09-18T22:47:30.521443] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:30.546023] [DEBUG] [LOCAL ] ALL: Loaded 50589 existing records from primary storage. [2025-09-18T22:47:30.546583] [INFO ] [MAIN ] ALL: Loaded 50589 primary data records. [2025-09-18T22:47:30.733170] [DEBUG] [MAIN ] ALK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:30.754680] [INFO ] [MAIN ] ALK: Generated 1807 derivative records from 53456 primary records. [2025-09-18T22:47:30.801852] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-09-18T22:47:30.976954] [DEBUG] [LOCAL ] ALLE: Loaded 45630 existing records from primary storage. [2025-09-18T22:47:30.982465] [INFO ] [MAIN ] ALLE: Loaded 45630 primary data records. [2025-09-18T22:47:30.985879] [DEBUG] [LOCAL ] ALK: Derivative data saved (1807 records). [2025-09-18T22:47:30.986102] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-09-18T22:47:30.988227] [INFO ] [MAIN ] Derivative Progress: 66/2075 symbols completed. ALK took 1.5s. Estimated remaining: 13m 12s. Rate: 152.3 symbols/min [2025-09-18T22:47:31.000486] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:31.338094] [DEBUG] [MAIN ] ALL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:31.339336] [INFO ] [MAIN ] ALL: Generated 1807 derivative records from 50589 primary records. [2025-09-18T22:47:31.339900] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-09-18T22:47:31.358077] [DEBUG] [LOCAL ] ALL: Derivative data saved (1807 records). [2025-09-18T22:47:31.358291] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-09-18T22:47:31.360539] [INFO ] [MAIN ] Derivative Progress: 67/2075 symbols completed. ALL took 1.3s. Estimated remaining: 13m 11s. Rate: 152.4 symbols/min [2025-09-18T22:47:31.375550] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:31.377185] [DEBUG] [LOCAL ] ALLY: Loaded 53607 existing records from primary storage. [2025-09-18T22:47:31.377560] [INFO ] [MAIN ] ALLY: Loaded 53607 primary data records. [2025-09-18T22:47:31.590557] [DEBUG] [MAIN ] ALLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:31.712325] [INFO ] [MAIN ] ALLE: Generated 1807 derivative records from 45630 primary records. [2025-09-18T22:47:31.713426] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-09-18T22:47:31.733239] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1807 records). [2025-09-18T22:47:31.745715] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-09-18T22:47:31.748467] [INFO ] [MAIN ] Derivative Progress: 68/2075 symbols completed. ALLE took 1.2s. Estimated remaining: 13m 10s. Rate: 152.4 symbols/min [2025-09-18T22:47:31.750856] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:31.752594] [DEBUG] [LOCAL ] ALSN: Loaded 43709 existing records from primary storage. [2025-09-18T22:47:31.752996] [INFO ] [MAIN ] ALSN: Loaded 43709 primary data records. [2025-09-18T22:47:31.947170] [DEBUG] [LOCAL ] ALTG: Loaded 24477 existing records from primary storage. [2025-09-18T22:47:31.971128] [INFO ] [MAIN ] ALTG: Loaded 24477 primary data records. [2025-09-18T22:47:32.174047] [DEBUG] [MAIN ] ALLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:32.200301] [INFO ] [MAIN ] ALLY: Generated 1807 derivative records from 53607 primary records. [2025-09-18T22:47:32.215507] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-09-18T22:47:32.349905] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1807 records). [2025-09-18T22:47:32.350053] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-09-18T22:47:32.364704] [INFO ] [MAIN ] Derivative Progress: 69/2075 symbols completed. ALLY took 1.4s. Estimated remaining: 13m 16s. Rate: 151.2 symbols/min [2025-09-18T22:47:32.470143] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:32.494484] [DEBUG] [MAIN ] ALSN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:32.495423] [INFO ] [MAIN ] ALSN: Generated 1807 derivative records from 43709 primary records. [2025-09-18T22:47:32.496529] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-09-18T22:47:32.513549] [DEBUG] [LOCAL ] ALUR: Loaded 11174 existing records from primary storage. [2025-09-18T22:47:32.514563] [INFO ] [MAIN ] ALUR: Loaded 11174 primary data records. [2025-09-18T22:47:32.629846] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1807 records). [2025-09-18T22:47:32.631846] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-09-18T22:47:32.639528] [INFO ] [MAIN ] Derivative Progress: 70/2075 symbols completed. ALSN took 1.3s. Estimated remaining: 13m 12s. Rate: 151.9 symbols/min [2025-09-18T22:47:32.655208] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:32.723407] [DEBUG] [MAIN ] ALTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:32.730615] [INFO ] [MAIN ] ALTG: Generated 1807 derivative records from 24477 primary records. [2025-09-18T22:47:32.730942] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-09-18T22:47:32.879980] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1807 records). [2025-09-18T22:47:32.880229] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-09-18T22:47:32.883230] [INFO ] [MAIN ] Derivative Progress: 71/2075 symbols completed. ALTG took 1.1s. Estimated remaining: 13m 7s. Rate: 152.7 symbols/min [2025-09-18T22:47:32.885338] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:32.906347] [DEBUG] [LOCAL ] ALX: Loaded 5828 existing records from primary storage. [2025-09-18T22:47:32.906848] [INFO ] [MAIN ] ALX: Loaded 5828 primary data records. [2025-09-18T22:47:33.037623] [DEBUG] [LOCAL ] ALV: Loaded 43233 existing records from primary storage. [2025-09-18T22:47:33.065954] [INFO ] [MAIN ] ALV: Loaded 43233 primary data records. [2025-09-18T22:47:33.082481] [DEBUG] [MAIN ] ALUR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:47:33.334254] [INFO ] [MAIN ] ALUR: Generated 1806 derivative records from 11174 primary records. [2025-09-18T22:47:33.352228] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-09-18T22:47:33.469126] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1806 records). [2025-09-18T22:47:33.469273] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-09-18T22:47:33.471547] [INFO ] [MAIN ] Derivative Progress: 72/2075 symbols completed. ALUR took 1.0s. Estimated remaining: 13m 13s. Rate: 151.6 symbols/min [2025-09-18T22:47:33.589550] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:33.620049] [DEBUG] [MAIN ] ALX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:33.620947] [INFO ] [MAIN ] ALX: Generated 1807 derivative records from 5828 primary records. [2025-09-18T22:47:33.621358] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-09-18T22:47:33.637848] [DEBUG] [LOCAL ] ALX: Derivative data saved (1807 records). [2025-09-18T22:47:33.638151] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-09-18T22:47:33.640228] [INFO ] [MAIN ] Derivative Progress: 73/2075 symbols completed. ALX took 0.8s. Estimated remaining: 13m 6s. Rate: 152.8 symbols/min [2025-09-18T22:47:33.671808] [DEBUG] [MAIN ] ALV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:33.672487] [INFO ] [MAIN ] ALV: Generated 1807 derivative records from 43233 primary records. [2025-09-18T22:47:33.672549] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-09-18T22:47:33.703765] [DEBUG] [LOCAL ] AM: Loaded 52557 existing records from primary storage. [2025-09-18T22:47:33.704681] [INFO ] [MAIN ] AM: Loaded 52557 primary data records. [2025-09-18T22:47:33.705247] [DEBUG] [LOCAL ] ALV: Derivative data saved (1807 records). [2025-09-18T22:47:33.778721] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-09-18T22:47:33.798378] [INFO ] [MAIN ] Derivative Progress: 74/2075 symbols completed. ALV took 1.1s. Estimated remaining: 12m 59s. Rate: 154.1 symbols/min [2025-09-18T22:47:34.063544] [DEBUG] [MAIN ] AM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:34.064230] [INFO ] [MAIN ] AM: Generated 1807 derivative records from 52557 primary records. [2025-09-18T22:47:34.064295] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-09-18T22:47:34.080076] [DEBUG] [LOCAL ] AM: Derivative data saved (1807 records). [2025-09-18T22:47:34.080146] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-09-18T22:47:34.082280] [INFO ] [MAIN ] Derivative Progress: 75/2075 symbols completed. AM took 0.5s. Estimated remaining: 12m 56s. Rate: 154.6 symbols/min [2025-09-18T22:47:34.083040] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:34.083417] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:34.083522] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:34.146439] [DEBUG] [LOCAL ] AMBC: Loaded 37906 existing records from primary storage. [2025-09-18T22:47:34.158137] [INFO ] [MAIN ] AMBC: Loaded 37906 primary data records. [2025-09-18T22:47:34.210095] [DEBUG] [LOCAL ] AMBP: Loaded 45660 existing records from primary storage. [2025-09-18T22:47:34.242774] [INFO ] [MAIN ] AMBP: Loaded 45660 primary data records. [2025-09-18T22:47:34.300012] [DEBUG] [LOCAL ] AMC: Loaded 54147 existing records from primary storage. [2025-09-18T22:47:34.323190] [INFO ] [MAIN ] AMC: Loaded 54147 primary data records. [2025-09-18T22:47:35.170885] [DEBUG] [MAIN ] AMBC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:47:35.171888] [INFO ] [MAIN ] AMBC: Generated 1806 derivative records from 37906 primary records. [2025-09-18T22:47:35.172097] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-09-18T22:47:35.194638] [DEBUG] [MAIN ] AMBP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:35.207445] [INFO ] [MAIN ] AMBP: Generated 1807 derivative records from 45660 primary records. [2025-09-18T22:47:35.207546] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-09-18T22:47:35.214699] [DEBUG] [MAIN ] AMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:35.227017] [INFO ] [MAIN ] AMC: Generated 1807 derivative records from 54147 primary records. [2025-09-18T22:47:35.227321] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-09-18T22:47:35.247113] [DEBUG] [LOCAL ] AMC: Derivative data saved (1807 records). [2025-09-18T22:47:35.247565] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1806 records). [2025-09-18T22:47:35.248331] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-09-18T22:47:35.252300] [INFO ] [MAIN ] Derivative Progress: 76/2075 symbols completed. AMBC took 1.2s. Estimated remaining: 13m 16s. Rate: 150.6 symbols/min [2025-09-18T22:47:35.253155] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:35.253286] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-09-18T22:47:35.255021] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1807 records). [2025-09-18T22:47:35.257495] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-09-18T22:47:35.257294] [INFO ] [MAIN ] Derivative Progress: 77/2075 symbols completed. AMC took 1.2s. Estimated remaining: 13m 6s. Rate: 152.6 symbols/min [2025-09-18T22:47:35.260529] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:35.260620] [INFO ] [MAIN ] Derivative Progress: 78/2075 symbols completed. AMBP took 1.2s. Estimated remaining: 12m 55s. Rate: 154.6 symbols/min [2025-09-18T22:47:35.261275] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:35.294148] [DEBUG] [LOCAL ] AMG: Loaded 21044 existing records from primary storage. [2025-09-18T22:47:35.294392] [INFO ] [MAIN ] AMG: Loaded 21044 primary data records. [2025-09-18T22:47:35.458925] [DEBUG] [LOCAL ] AMCR: Loaded 54059 existing records from primary storage. [2025-09-18T22:47:35.485992] [INFO ] [MAIN ] AMCR: Loaded 54059 primary data records. [2025-09-18T22:47:35.620558] [DEBUG] [LOCAL ] AME: Loaded 48968 existing records from primary storage. [2025-09-18T22:47:35.744314] [INFO ] [MAIN ] AME: Loaded 48968 primary data records. [2025-09-18T22:47:36.346799] [DEBUG] [MAIN ] AMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:36.347936] [INFO ] [MAIN ] AMG: Generated 1807 derivative records from 21044 primary records. [2025-09-18T22:47:36.348147] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-09-18T22:47:36.369615] [DEBUG] [MAIN ] AMCR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:36.371720] [INFO ] [MAIN ] AMCR: Generated 1807 derivative records from 54059 primary records. [2025-09-18T22:47:36.376574] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-09-18T22:47:36.380536] [DEBUG] [LOCAL ] AMG: Derivative data saved (1807 records). [2025-09-18T22:47:36.381966] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-09-18T22:47:36.399044] [INFO ] [MAIN ] Derivative Progress: 79/2075 symbols completed. AMG took 1.1s. Estimated remaining: 13m 14s. Rate: 150.9 symbols/min [2025-09-18T22:47:36.407632] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:36.409395] [DEBUG] [MAIN ] AME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:36.410923] [INFO ] [MAIN ] AME: Generated 1807 derivative records from 48968 primary records. [2025-09-18T22:47:36.411107] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-09-18T22:47:36.428870] [DEBUG] [LOCAL ] AME: Derivative data saved (1807 records). [2025-09-18T22:47:36.429502] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-09-18T22:47:36.431636] [INFO ] [MAIN ] Derivative Progress: 80/2075 symbols completed. AME took 1.2s. Estimated remaining: 13m 4s. Rate: 152.6 symbols/min [2025-09-18T22:47:36.432424] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:36.434036] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1807 records). [2025-09-18T22:47:36.434422] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-09-18T22:47:36.436605] [INFO ] [MAIN ] Derivative Progress: 81/2075 symbols completed. AMCR took 1.2s. Estimated remaining: 12m 54s. Rate: 154.5 symbols/min [2025-09-18T22:47:36.437058] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:36.519050] [DEBUG] [LOCAL ] AMP: Loaded 33159 existing records from primary storage. [2025-09-18T22:47:36.519876] [INFO ] [MAIN ] AMP: Loaded 33159 primary data records. [2025-09-18T22:47:36.572487] [DEBUG] [LOCAL ] AMN: Loaded 42501 existing records from primary storage. [2025-09-18T22:47:36.579751] [INFO ] [MAIN ] AMN: Loaded 42501 primary data records. [2025-09-18T22:47:36.601817] [DEBUG] [LOCAL ] AMH: Loaded 52077 existing records from primary storage. [2025-09-18T22:47:36.657488] [INFO ] [MAIN ] AMH: Loaded 52077 primary data records. [2025-09-18T22:47:37.500135] [DEBUG] [MAIN ] AMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:37.502450] [INFO ] [MAIN ] AMP: Generated 1807 derivative records from 33159 primary records. [2025-09-18T22:47:37.502822] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-09-18T22:47:37.525168] [DEBUG] [MAIN ] AMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:37.525997] [INFO ] [MAIN ] AMN: Generated 1807 derivative records from 42501 primary records. [2025-09-18T22:47:37.528236] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-09-18T22:47:37.536397] [DEBUG] [LOCAL ] AMP: Derivative data saved (1807 records). [2025-09-18T22:47:37.536846] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-09-18T22:47:37.538880] [INFO ] [MAIN ] Derivative Progress: 82/2075 symbols completed. AMP took 1.1s. Estimated remaining: 13m 11s. Rate: 151.1 symbols/min [2025-09-18T22:47:37.566092] [DEBUG] [LOCAL ] AMN: Derivative data saved (1807 records). [2025-09-18T22:47:37.566934] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-09-18T22:47:37.561679] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:37.569545] [INFO ] [MAIN ] Derivative Progress: 83/2075 symbols completed. AMN took 1.1s. Estimated remaining: 13m 2s. Rate: 152.8 symbols/min [2025-09-18T22:47:37.567271] [DEBUG] [MAIN ] AMH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:37.570700] [INFO ] [MAIN ] AMH: Generated 1807 derivative records from 52077 primary records. [2025-09-18T22:47:37.571123] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:37.571194] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-09-18T22:47:37.589561] [DEBUG] [LOCAL ] AMH: Derivative data saved (1807 records). [2025-09-18T22:47:37.589781] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-09-18T22:47:37.591834] [INFO ] [MAIN ] Derivative Progress: 84/2075 symbols completed. AMH took 1.2s. Estimated remaining: 12m 53s. Rate: 154.6 symbols/min [2025-09-18T22:47:37.592137] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:37.680854] [DEBUG] [LOCAL ] AMPX: Loaded 52458 existing records from primary storage. [2025-09-18T22:47:37.690986] [DEBUG] [LOCAL ] AMPY: Loaded 37679 existing records from primary storage. [2025-09-18T22:47:37.690387] [INFO ] [MAIN ] AMPX: Loaded 52458 primary data records. [2025-09-18T22:47:37.691115] [INFO ] [MAIN ] AMPY: Loaded 37679 primary data records. [2025-09-18T22:47:37.697116] [DEBUG] [LOCAL ] AMR: Loaded 29544 existing records from primary storage. [2025-09-18T22:47:37.766771] [INFO ] [MAIN ] AMR: Loaded 29544 primary data records. [2025-09-18T22:47:38.706792] [DEBUG] [MAIN ] AMPX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:38.705640] [DEBUG] [MAIN ] AMPY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:38.706407] [DEBUG] [MAIN ] AMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:38.709845] [INFO ] [MAIN ] AMPX: Generated 1807 derivative records from 52458 primary records. [2025-09-18T22:47:38.708948] [INFO ] [MAIN ] AMPY: Generated 1807 derivative records from 37679 primary records. [2025-09-18T22:47:38.710118] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-09-18T22:47:38.710044] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-09-18T22:47:38.707948] [INFO ] [MAIN ] AMR: Generated 1807 derivative records from 29544 primary records. [2025-09-18T22:47:38.712441] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-09-18T22:47:38.763752] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1807 records). [2025-09-18T22:47:38.764992] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-09-18T22:47:38.767897] [INFO ] [MAIN ] Derivative Progress: 85/2075 symbols completed. AMPX took 1.2s. Estimated remaining: 13m 11s. Rate: 151.0 symbols/min [2025-09-18T22:47:38.768533] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:38.763130] [DEBUG] [LOCAL ] AMR: Derivative data saved (1807 records). [2025-09-18T22:47:38.770273] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-09-18T22:47:38.772933] [INFO ] [MAIN ] Derivative Progress: 86/2075 symbols completed. AMR took 1.2s. Estimated remaining: 13m 1s. Rate: 152.7 symbols/min [2025-09-18T22:47:38.777500] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:38.780686] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1807 records). [2025-09-18T22:47:38.781075] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-09-18T22:47:38.783553] [INFO ] [MAIN ] Derivative Progress: 87/2075 symbols completed. AMPY took 1.2s. Estimated remaining: 12m 52s. Rate: 154.4 symbols/min [2025-09-18T22:47:38.784104] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:38.839270] [DEBUG] [LOCAL ] AMTB: Loaded 20824 existing records from primary storage. [2025-09-18T22:47:38.851298] [INFO ] [MAIN ] AMTB: Loaded 20824 primary data records. [2025-09-18T22:47:38.853405] [DEBUG] [LOCAL ] AMRC: Loaded 39026 existing records from primary storage. [2025-09-18T22:47:38.911281] [INFO ] [MAIN ] AMRC: Loaded 39026 primary data records. [2025-09-18T22:47:38.905991] [DEBUG] [LOCAL ] AMT: Loaded 52847 existing records from primary storage. [2025-09-18T22:47:38.965772] [INFO ] [MAIN ] AMT: Loaded 52847 primary data records. [2025-09-18T22:47:39.848295] [DEBUG] [MAIN ] AMTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:39.857629] [INFO ] [MAIN ] AMTB: Generated 1807 derivative records from 20824 primary records. [2025-09-18T22:47:39.862688] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-09-18T22:47:39.864690] [DEBUG] [MAIN ] AMRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:39.866366] [INFO ] [MAIN ] AMRC: Generated 1807 derivative records from 39026 primary records. [2025-09-18T22:47:39.866718] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-09-18T22:47:39.895676] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1807 records). [2025-09-18T22:47:39.907505] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-09-18T22:47:39.907154] [DEBUG] [MAIN ] AMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:39.911232] [INFO ] [MAIN ] AMT: Generated 1807 derivative records from 52847 primary records. [2025-09-18T22:47:39.910072] [INFO ] [MAIN ] Derivative Progress: 88/2075 symbols completed. AMTB took 1.1s. Estimated remaining: 13m 9s. Rate: 151.2 symbols/min [2025-09-18T22:47:39.911900] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-09-18T22:47:39.929745] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1807 records). [2025-09-18T22:47:39.930274] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-09-18T22:47:39.932846] [INFO ] [MAIN ] Derivative Progress: 89/2075 symbols completed. AMRC took 1.2s. Estimated remaining: 12m 60s. Rate: 152.8 symbols/min [2025-09-18T22:47:39.936064] [DEBUG] [LOCAL ] AMT: Derivative data saved (1807 records). [2025-09-18T22:47:39.936268] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-09-18T22:47:39.938540] [INFO ] [MAIN ] Derivative Progress: 90/2075 symbols completed. AMT took 1.2s. Estimated remaining: 12m 51s. Rate: 154.5 symbols/min [2025-09-18T22:47:39.939423] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:39.939495] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:39.939697] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:39.949975] [DEBUG] [LOCAL ] AMTD: Loaded 3564 existing records from primary storage. [2025-09-18T22:47:39.950118] [INFO ] [MAIN ] AMTD: Loaded 3564 primary data records. [2025-09-18T22:47:40.038085] [DEBUG] [LOCAL ] AMWL: Loaded 8740 existing records from primary storage. [2025-09-18T22:47:40.049243] [INFO ] [MAIN ] AMWL: Loaded 8740 primary data records. [2025-09-18T22:47:40.647468] [DEBUG] [LOCAL ] AMTM: Loaded 51128 existing records from primary storage. [2025-09-18T22:47:40.647893] [INFO ] [MAIN ] AMTM: Loaded 51128 primary data records. [2025-09-18T22:47:40.977302] [DEBUG] [MAIN ] AMTD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:40.979007] [INFO ] [MAIN ] AMTD: Generated 1807 derivative records from 3564 primary records. [2025-09-18T22:47:40.979200] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-09-18T22:47:40.996902] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1807 records). [2025-09-18T22:47:40.997537] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-09-18T22:47:40.999678] [INFO ] [MAIN ] Derivative Progress: 91/2075 symbols completed. AMTD took 1.1s. Estimated remaining: 13m 5s. Rate: 151.6 symbols/min [2025-09-18T22:47:41.007718] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:41.013332] [DEBUG] [MAIN ] AMWL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:41.014340] [INFO ] [MAIN ] AMWL: Generated 1807 derivative records from 8740 primary records. [2025-09-18T22:47:41.014528] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-09-18T22:47:41.040986] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1807 records). [2025-09-18T22:47:41.046325] [DEBUG] [MAIN ] AMTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:41.046522] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-09-18T22:47:41.047309] [INFO ] [MAIN ] AMTM: Generated 1807 derivative records from 51128 primary records. [2025-09-18T22:47:41.049568] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-09-18T22:47:41.049483] [INFO ] [MAIN ] Derivative Progress: 92/2075 symbols completed. AMWL took 1.1s. Estimated remaining: 12m 57s. Rate: 153.1 symbols/min [2025-09-18T22:47:41.050303] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:41.067198] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1807 records). [2025-09-18T22:47:41.077429] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-09-18T22:47:41.079631] [INFO ] [MAIN ] Derivative Progress: 93/2075 symbols completed. AMTM took 1.1s. Estimated remaining: 12m 49s. Rate: 154.6 symbols/min [2025-09-18T22:47:41.080142] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:41.105064] [DEBUG] [LOCAL ] AMX: Loaded 49447 existing records from primary storage. [2025-09-18T22:47:41.105301] [INFO ] [MAIN ] AMX: Loaded 49447 primary data records. [2025-09-18T22:47:41.193442] [DEBUG] [LOCAL ] ANRO: Loaded 20424 existing records from primary storage. [2025-09-18T22:47:41.217760] [INFO ] [MAIN ] ANRO: Loaded 20424 primary data records. [2025-09-18T22:47:41.387077] [DEBUG] [LOCAL ] ANF: Loaded 52666 existing records from primary storage. [2025-09-18T22:47:41.550194] [INFO ] [MAIN ] ANF: Loaded 52666 primary data records. [2025-09-18T22:47:42.146617] [DEBUG] [MAIN ] AMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:42.148682] [INFO ] [MAIN ] AMX: Generated 1807 derivative records from 49447 primary records. [2025-09-18T22:47:42.156422] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-09-18T22:47:42.162214] [DEBUG] [MAIN ] ANRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:42.163481] [INFO ] [MAIN ] ANRO: Generated 1807 derivative records from 20424 primary records. [2025-09-18T22:47:42.163944] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-09-18T22:47:42.191339] [DEBUG] [LOCAL ] AMX: Derivative data saved (1807 records). [2025-09-18T22:47:42.191542] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-09-18T22:47:42.199319] [INFO ] [MAIN ] Derivative Progress: 94/2075 symbols completed. AMX took 1.2s. Estimated remaining: 13m 4s. Rate: 151.5 symbols/min [2025-09-18T22:47:42.200305] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:42.196594] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1807 records). [2025-09-18T22:47:42.201010] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-09-18T22:47:42.203406] [INFO ] [MAIN ] Derivative Progress: 95/2075 symbols completed. ANRO took 1.1s. Estimated remaining: 12m 56s. Rate: 153.1 symbols/min [2025-09-18T22:47:42.203936] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:42.217250] [DEBUG] [MAIN ] ANF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:42.218027] [INFO ] [MAIN ] ANF: Generated 1807 derivative records from 52666 primary records. [2025-09-18T22:47:42.218185] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-09-18T22:47:42.240229] [DEBUG] [LOCAL ] ANF: Derivative data saved (1807 records). [2025-09-18T22:47:42.240370] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-09-18T22:47:42.242562] [INFO ] [MAIN ] Derivative Progress: 96/2075 symbols completed. ANF took 1.2s. Estimated remaining: 12m 48s. Rate: 154.6 symbols/min [2025-09-18T22:47:42.250495] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:42.250993] [DEBUG] [LOCAL ] ANVS: Loaded 23530 existing records from primary storage. [2025-09-18T22:47:42.251338] [INFO ] [MAIN ] ANVS: Loaded 23530 primary data records. [2025-09-18T22:47:42.575626] [DEBUG] [LOCAL ] AON: Loaded 46012 existing records from primary storage. [2025-09-18T22:47:42.576117] [INFO ] [MAIN ] AON: Loaded 46012 primary data records. [2025-09-18T22:47:42.897697] [DEBUG] [LOCAL ] AOS: Loaded 49823 existing records from primary storage. [2025-09-18T22:47:42.906488] [INFO ] [MAIN ] AOS: Loaded 49823 primary data records. [2025-09-18T22:47:43.107534] [DEBUG] [MAIN ] ANVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:43.112451] [INFO ] [MAIN ] ANVS: Generated 1807 derivative records from 23530 primary records. [2025-09-18T22:47:43.220203] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-09-18T22:47:43.247254] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1807 records). [2025-09-18T22:47:43.247725] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-09-18T22:47:43.249928] [INFO ] [MAIN ] Derivative Progress: 97/2075 symbols completed. ANVS took 1.0s. Estimated remaining: 13m 0s. Rate: 152.1 symbols/min [2025-09-18T22:47:43.251091] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:43.278174] [DEBUG] [MAIN ] AON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:43.279302] [INFO ] [MAIN ] AON: Generated 1807 derivative records from 46012 primary records. [2025-09-18T22:47:43.279442] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-09-18T22:47:43.296606] [DEBUG] [LOCAL ] AON: Derivative data saved (1807 records). [2025-09-18T22:47:43.296909] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-09-18T22:47:43.299307] [INFO ] [MAIN ] Derivative Progress: 98/2075 symbols completed. AON took 1.1s. Estimated remaining: 12m 53s. Rate: 153.5 symbols/min [2025-09-18T22:47:43.299909] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:43.327050] [DEBUG] [MAIN ] AOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:43.327913] [INFO ] [MAIN ] AOS: Generated 1807 derivative records from 49823 primary records. [2025-09-18T22:47:43.328100] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-09-18T22:47:43.356507] [DEBUG] [LOCAL ] AOS: Derivative data saved (1807 records). [2025-09-18T22:47:43.356723] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-09-18T22:47:43.359189] [INFO ] [MAIN ] Derivative Progress: 99/2075 symbols completed. AOS took 1.1s. Estimated remaining: 12m 46s. Rate: 154.8 symbols/min [2025-09-18T22:47:43.359570] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:43.360369] [DEBUG] [LOCAL ] APAM: Loaded 37094 existing records from primary storage. [2025-09-18T22:47:43.360934] [INFO ] [MAIN ] APAM: Loaded 37094 primary data records. [2025-09-18T22:47:43.676063] [DEBUG] [LOCAL ] APD: Loaded 45876 existing records from primary storage. [2025-09-18T22:47:43.685051] [INFO ] [MAIN ] APD: Loaded 45876 primary data records. [2025-09-18T22:47:43.889781] [DEBUG] [LOCAL ] APG: Loaded 50625 existing records from primary storage. [2025-09-18T22:47:43.912841] [INFO ] [MAIN ] APG: Loaded 50625 primary data records. [2025-09-18T22:47:44.250193] [DEBUG] [MAIN ] APAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:44.417773] [INFO ] [MAIN ] APAM: Generated 1807 derivative records from 37094 primary records. [2025-09-18T22:47:44.418416] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-09-18T22:47:44.437415] [DEBUG] [LOCAL ] APAM: Derivative data saved (1807 records). [2025-09-18T22:47:44.437800] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-09-18T22:47:44.441187] [INFO ] [MAIN ] Derivative Progress: 100/2075 symbols completed. APAM took 1.2s. Estimated remaining: 12m 59s. Rate: 152.1 symbols/min [2025-09-18T22:47:44.441491] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:44.460809] [DEBUG] [MAIN ] APD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:44.461752] [INFO ] [MAIN ] APD: Generated 1807 derivative records from 45876 primary records. [2025-09-18T22:47:44.462124] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-09-18T22:47:44.483553] [DEBUG] [LOCAL ] APD: Derivative data saved (1807 records). [2025-09-18T22:47:44.483814] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-09-18T22:47:44.486200] [INFO ] [MAIN ] Derivative Progress: 101/2075 symbols completed. APD took 1.2s. Estimated remaining: 12m 52s. Rate: 153.4 symbols/min [2025-09-18T22:47:44.486806] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:44.501068] [DEBUG] [MAIN ] APG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:44.502083] [INFO ] [MAIN ] APG: Generated 1807 derivative records from 50625 primary records. [2025-09-18T22:47:44.502209] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-09-18T22:47:44.533341] [DEBUG] [LOCAL ] APG: Derivative data saved (1807 records). [2025-09-18T22:47:44.533607] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-09-18T22:47:44.536390] [INFO ] [MAIN ] Derivative Progress: 102/2075 symbols completed. APG took 1.2s. Estimated remaining: 12m 45s. Rate: 154.7 symbols/min [2025-09-18T22:47:44.537445] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:44.553345] [DEBUG] [LOCAL ] APH: Loaded 54081 existing records from primary storage. [2025-09-18T22:47:44.553599] [INFO ] [MAIN ] APH: Loaded 54081 primary data records. [2025-09-18T22:47:44.902692] [DEBUG] [LOCAL ] APLE: Loaded 52448 existing records from primary storage. [2025-09-18T22:47:44.903674] [INFO ] [MAIN ] APLE: Loaded 52448 primary data records. [2025-09-18T22:47:45.036284] [DEBUG] [LOCAL ] APO: Loaded 53772 existing records from primary storage. [2025-09-18T22:47:45.054139] [INFO ] [MAIN ] APO: Loaded 53772 primary data records. [2025-09-18T22:47:45.427981] [DEBUG] [MAIN ] APH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:45.466182] [INFO ] [MAIN ] APH: Generated 1807 derivative records from 54081 primary records. [2025-09-18T22:47:45.473573] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-09-18T22:47:45.616846] [DEBUG] [LOCAL ] APH: Derivative data saved (1807 records). [2025-09-18T22:47:45.617416] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-09-18T22:47:45.620222] [INFO ] [MAIN ] Derivative Progress: 103/2075 symbols completed. APH took 1.2s. Estimated remaining: 12m 58s. Rate: 152.1 symbols/min [2025-09-18T22:47:45.639211] [DEBUG] [MAIN ] APLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:45.640064] [INFO ] [MAIN ] APLE: Generated 1807 derivative records from 52448 primary records. [2025-09-18T22:47:45.640214] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-09-18T22:47:45.658987] [DEBUG] [LOCAL ] APLE: Derivative data saved (1807 records). [2025-09-18T22:47:45.659127] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-09-18T22:47:45.661945] [INFO ] [MAIN ] Derivative Progress: 104/2075 symbols completed. APLE took 1.2s. Estimated remaining: 12m 51s. Rate: 153.4 symbols/min [2025-09-18T22:47:45.674666] [DEBUG] [MAIN ] APO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:45.675288] [INFO ] [MAIN ] APO: Generated 1807 derivative records from 53772 primary records. [2025-09-18T22:47:45.675351] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-09-18T22:47:45.690991] [DEBUG] [LOCAL ] APO: Derivative data saved (1807 records). [2025-09-18T22:47:45.691056] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-09-18T22:47:45.693348] [INFO ] [MAIN ] Derivative Progress: 105/2075 symbols completed. APO took 1.2s. Estimated remaining: 12m 44s. Rate: 154.8 symbols/min [2025-09-18T22:47:45.693920] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:45.694067] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:45.694394] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:45.708504] [DEBUG] [LOCAL ] APOS: Loaded 7503 existing records from primary storage. [2025-09-18T22:47:45.708694] [INFO ] [MAIN ] APOS: Loaded 7503 primary data records. [2025-09-18T22:47:46.092854] [DEBUG] [LOCAL ] AQN: Loaded 52366 existing records from primary storage. [2025-09-18T22:47:46.093032] [INFO ] [MAIN ] AQN: Loaded 52366 primary data records. [2025-09-18T22:47:46.092177] [DEBUG] [LOCAL ] APTV: Loaded 52636 existing records from primary storage. [2025-09-18T22:47:46.093349] [INFO ] [MAIN ] APTV: Loaded 52636 primary data records. [2025-09-18T22:47:46.766056] [DEBUG] [MAIN ] APOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:46.767497] [INFO ] [MAIN ] APOS: Generated 1807 derivative records from 7503 primary records. [2025-09-18T22:47:46.767820] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-09-18T22:47:46.786735] [DEBUG] [LOCAL ] APOS: Derivative data saved (1807 records). [2025-09-18T22:47:46.787336] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-09-18T22:47:46.791094] [INFO ] [MAIN ] Derivative Progress: 106/2075 symbols completed. APOS took 1.1s. Estimated remaining: 12m 57s. Rate: 152.1 symbols/min [2025-09-18T22:47:46.793022] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:46.802222] [DEBUG] [LOCAL ] AQNB: Loaded 4254 existing records from primary storage. [2025-09-18T22:47:46.803374] [INFO ] [MAIN ] AQNB: Loaded 4254 primary data records. [2025-09-18T22:47:46.868140] [DEBUG] [MAIN ] AQN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:46.886296] [INFO ] [MAIN ] AQN: Generated 1807 derivative records from 52366 primary records. [2025-09-18T22:47:46.899217] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-09-18T22:47:47.008772] [DEBUG] [MAIN ] APTV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:47.069968] [INFO ] [MAIN ] APTV: Generated 1807 derivative records from 52636 primary records. [2025-09-18T22:47:47.165357] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-09-18T22:47:47.182531] [DEBUG] [LOCAL ] AQN: Derivative data saved (1807 records). [2025-09-18T22:47:47.185557] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-09-18T22:47:47.187810] [INFO ] [MAIN ] Derivative Progress: 107/2075 symbols completed. AQN took 1.5s. Estimated remaining: 12m 56s. Rate: 152.1 symbols/min [2025-09-18T22:47:47.188131] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:47.192911] [DEBUG] [LOCAL ] APTV: Derivative data saved (1807 records). [2025-09-18T22:47:47.193144] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-09-18T22:47:47.196724] [INFO ] [MAIN ] Derivative Progress: 108/2075 symbols completed. APTV took 1.5s. Estimated remaining: 12m 49s. Rate: 153.5 symbols/min [2025-09-18T22:47:47.197290] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:47.231269] [DEBUG] [MAIN ] AQNB: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-09-18T22:47:47.240943] [INFO ] [MAIN ] AQNB: Generated 1805 derivative records from 4254 primary records. [2025-09-18T22:47:47.250463] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-09-18T22:47:47.275744] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1805 records). [2025-09-18T22:47:47.276566] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-09-18T22:47:47.279739] [INFO ] [MAIN ] Derivative Progress: 109/2075 symbols completed. AQNB took 0.5s. Estimated remaining: 12m 43s. Rate: 154.6 symbols/min [2025-09-18T22:47:47.280050] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:47.281315] [DEBUG] [LOCAL ] ARDT: Loaded 28901 existing records from primary storage. [2025-09-18T22:47:47.281508] [INFO ] [MAIN ] ARDT: Loaded 28901 primary data records. [2025-09-18T22:47:47.353494] [DEBUG] [LOCAL ] ARCO: Loaded 45022 existing records from primary storage. [2025-09-18T22:47:47.368144] [INFO ] [MAIN ] ARCO: Loaded 45022 primary data records. [2025-09-18T22:47:47.856850] [DEBUG] [LOCAL ] ARE: Loaded 50937 existing records from primary storage. [2025-09-18T22:47:47.975005] [INFO ] [MAIN ] ARE: Loaded 50937 primary data records. [2025-09-18T22:47:48.355839] [DEBUG] [MAIN ] ARDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:48.357167] [INFO ] [MAIN ] ARDT: Generated 1807 derivative records from 28901 primary records. [2025-09-18T22:47:48.357271] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-09-18T22:47:48.390448] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1807 records). [2025-09-18T22:47:48.390821] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-09-18T22:47:48.391098] [DEBUG] [MAIN ] ARCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:48.393442] [INFO ] [MAIN ] Derivative Progress: 110/2075 symbols completed. ARDT took 1.2s. Estimated remaining: 12m 55s. Rate: 152.0 symbols/min [2025-09-18T22:47:48.394438] [INFO ] [MAIN ] ARCO: Generated 1807 derivative records from 45022 primary records. [2025-09-18T22:47:48.394941] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-09-18T22:47:48.394805] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:48.412420] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1807 records). [2025-09-18T22:47:48.412618] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-09-18T22:47:48.414928] [INFO ] [MAIN ] Derivative Progress: 111/2075 symbols completed. ARCO took 1.2s. Estimated remaining: 12m 48s. Rate: 153.3 symbols/min [2025-09-18T22:47:48.415223] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:48.431702] [DEBUG] [MAIN ] ARE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:48.432434] [INFO ] [MAIN ] ARE: Generated 1807 derivative records from 50937 primary records. [2025-09-18T22:47:48.432589] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-09-18T22:47:48.449061] [DEBUG] [LOCAL ] ARE: Derivative data saved (1807 records). [2025-09-18T22:47:48.449201] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-09-18T22:47:48.451860] [INFO ] [MAIN ] Derivative Progress: 112/2075 symbols completed. ARE took 1.2s. Estimated remaining: 12m 42s. Rate: 154.6 symbols/min [2025-09-18T22:47:48.452313] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:48.502936] [DEBUG] [LOCAL ] ARI: Loaded 43621 existing records from primary storage. [2025-09-18T22:47:48.518616] [INFO ] [MAIN ] ARI: Loaded 43621 primary data records. [2025-09-18T22:47:48.552176] [DEBUG] [LOCAL ] ARES: Loaded 50098 existing records from primary storage. [2025-09-18T22:47:48.589138] [INFO ] [MAIN ] ARES: Loaded 50098 primary data records. [2025-09-18T22:47:48.702319] [DEBUG] [LOCAL ] ARIS: Loaded 42356 existing records from primary storage. [2025-09-18T22:47:48.720882] [INFO ] [MAIN ] ARIS: Loaded 42356 primary data records. [2025-09-18T22:47:49.515838] [DEBUG] [MAIN ] ARI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:49.517034] [INFO ] [MAIN ] ARI: Generated 1807 derivative records from 43621 primary records. [2025-09-18T22:47:49.518003] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-09-18T22:47:49.550631] [DEBUG] [MAIN ] ARES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:49.553396] [INFO ] [MAIN ] ARES: Generated 1807 derivative records from 50098 primary records. [2025-09-18T22:47:49.561978] [DEBUG] [LOCAL ] ARI: Derivative data saved (1807 records). [2025-09-18T22:47:49.566907] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-09-18T22:47:49.566753] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-09-18T22:47:49.569018] [INFO ] [MAIN ] Derivative Progress: 113/2075 symbols completed. ARI took 1.2s. Estimated remaining: 12m 54s. Rate: 152.1 symbols/min [2025-09-18T22:47:49.570489] [DEBUG] [MAIN ] ARIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:49.578306] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:49.579196] [INFO ] [MAIN ] ARIS: Generated 1807 derivative records from 42356 primary records. [2025-09-18T22:47:49.583246] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-09-18T22:47:49.602665] [DEBUG] [LOCAL ] ARES: Derivative data saved (1807 records). [2025-09-18T22:47:49.604476] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-09-18T22:47:49.605708] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1807 records). [2025-09-18T22:47:49.608089] [INFO ] [MAIN ] Derivative Progress: 114/2075 symbols completed. ARES took 1.2s. Estimated remaining: 12m 48s. Rate: 153.3 symbols/min [2025-09-18T22:47:49.608352] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:49.608612] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-09-18T22:47:49.611594] [INFO ] [MAIN ] Derivative Progress: 115/2075 symbols completed. ARIS took 1.2s. Estimated remaining: 12m 41s. Rate: 154.6 symbols/min [2025-09-18T22:47:49.612025] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:49.648893] [DEBUG] [LOCAL ] ARLO: Loaded 44533 existing records from primary storage. [2025-09-18T22:47:49.649152] [INFO ] [MAIN ] ARLO: Loaded 44533 primary data records. [2025-09-18T22:47:49.960873] [DEBUG] [LOCAL ] AROC: Loaded 49382 existing records from primary storage. [2025-09-18T22:47:50.015376] [INFO ] [MAIN ] AROC: Loaded 49382 primary data records. [2025-09-18T22:47:50.006396] [DEBUG] [LOCAL ] ARR: Loaded 52416 existing records from primary storage. [2025-09-18T22:47:50.016133] [INFO ] [MAIN ] ARR: Loaded 52416 primary data records. [2025-09-18T22:47:50.714266] [DEBUG] [MAIN ] ARLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:50.715515] [INFO ] [MAIN ] ARLO: Generated 1807 derivative records from 44533 primary records. [2025-09-18T22:47:50.715701] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-09-18T22:47:50.737324] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1807 records). [2025-09-18T22:47:50.738450] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-09-18T22:47:50.743311] [INFO ] [MAIN ] Derivative Progress: 116/2075 symbols completed. ARLO took 1.2s. Estimated remaining: 12m 53s. Rate: 152.1 symbols/min [2025-09-18T22:47:50.745205] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:50.766070] [DEBUG] [MAIN ] AROC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:50.771241] [DEBUG] [MAIN ] ARR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:50.771996] [INFO ] [MAIN ] AROC: Generated 1807 derivative records from 49382 primary records. [2025-09-18T22:47:50.772727] [INFO ] [MAIN ] ARR: Generated 1807 derivative records from 52416 primary records. [2025-09-18T22:47:50.772783] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-09-18T22:47:50.773212] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-09-18T22:47:50.806329] [DEBUG] [LOCAL ] ARR: Derivative data saved (1807 records). [2025-09-18T22:47:50.806222] [DEBUG] [LOCAL ] AROC: Derivative data saved (1807 records). [2025-09-18T22:47:50.814221] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-09-18T22:47:50.814320] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-09-18T22:47:50.817797] [INFO ] [MAIN ] Derivative Progress: 117/2075 symbols completed. AROC took 1.2s. Estimated remaining: 12m 47s. Rate: 153.2 symbols/min [2025-09-18T22:47:50.821166] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:50.821345] [INFO ] [MAIN ] Derivative Progress: 118/2075 symbols completed. ARR took 1.2s. Estimated remaining: 12m 40s. Rate: 154.5 symbols/min [2025-09-18T22:47:50.834871] [DEBUG] [LOCAL ] ARW: Loaded 33464 existing records from primary storage. [2025-09-18T22:47:50.835014] [INFO ] [MAIN ] ARW: Loaded 33464 primary data records. [2025-09-18T22:47:51.169193] [DEBUG] [LOCAL ] AS: Loaded 53456 existing records from primary storage. [2025-09-18T22:47:51.170063] [INFO ] [MAIN ] AS: Loaded 53456 primary data records. [2025-09-18T22:47:51.496894] [DEBUG] [MAIN ] ARW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:51.497865] [INFO ] [MAIN ] ARW: Generated 1807 derivative records from 33464 primary records. [2025-09-18T22:47:51.497949] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-09-18T22:47:51.516854] [DEBUG] [LOCAL ] ARW: Derivative data saved (1807 records). [2025-09-18T22:47:51.516922] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-09-18T22:47:51.518990] [INFO ] [MAIN ] Derivative Progress: 119/2075 symbols completed. ARW took 0.8s. Estimated remaining: 12m 45s. Rate: 153.4 symbols/min [2025-09-18T22:47:51.535243] [DEBUG] [MAIN ] AS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:51.536018] [INFO ] [MAIN ] AS: Generated 1807 derivative records from 53456 primary records. [2025-09-18T22:47:51.536084] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-09-18T22:47:51.552422] [DEBUG] [LOCAL ] AS: Derivative data saved (1807 records). [2025-09-18T22:47:51.552562] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-09-18T22:47:51.554985] [INFO ] [MAIN ] Derivative Progress: 120/2075 symbols completed. AS took 0.7s. Estimated remaining: 12m 39s. Rate: 154.6 symbols/min [2025-09-18T22:47:51.556278] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:51.556123] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:51.555893] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:51.573107] [DEBUG] [LOCAL ] ASA: Loaded 13569 existing records from primary storage. [2025-09-18T22:47:51.573328] [INFO ] [MAIN ] ASA: Loaded 13569 primary data records. [2025-09-18T22:47:51.937051] [DEBUG] [LOCAL ] ASAN: Loaded 53150 existing records from primary storage. [2025-09-18T22:47:51.937936] [INFO ] [MAIN ] ASAN: Loaded 53150 primary data records. [2025-09-18T22:47:51.938826] [DEBUG] [LOCAL ] ASB: Loaded 50015 existing records from primary storage. [2025-09-18T22:47:51.971285] [INFO ] [MAIN ] ASB: Loaded 50015 primary data records. [2025-09-18T22:47:52.627467] [DEBUG] [MAIN ] ASA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:52.628530] [INFO ] [MAIN ] ASA: Generated 1807 derivative records from 13569 primary records. [2025-09-18T22:47:52.628806] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-09-18T22:47:52.652290] [DEBUG] [LOCAL ] ASA: Derivative data saved (1807 records). [2025-09-18T22:47:52.652613] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-09-18T22:47:52.664286] [INFO ] [MAIN ] Derivative Progress: 121/2075 symbols completed. ASA took 1.1s. Estimated remaining: 12m 50s. Rate: 152.3 symbols/min [2025-09-18T22:47:52.669925] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:52.678874] [DEBUG] [MAIN ] ASAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:52.684864] [INFO ] [MAIN ] ASAN: Generated 1807 derivative records from 53150 primary records. [2025-09-18T22:47:52.686293] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-09-18T22:47:52.686583] [DEBUG] [MAIN ] ASB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:52.688299] [INFO ] [MAIN ] ASB: Generated 1807 derivative records from 50015 primary records. [2025-09-18T22:47:52.688449] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-09-18T22:47:52.700614] [DEBUG] [LOCAL ] ASBA: Loaded 3449 existing records from primary storage. [2025-09-18T22:47:52.705702] [INFO ] [MAIN ] ASBA: Loaded 3449 primary data records. [2025-09-18T22:47:52.741306] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1807 records). [2025-09-18T22:47:52.757481] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-09-18T22:47:52.788670] [INFO ] [MAIN ] Derivative Progress: 122/2075 symbols completed. ASAN took 1.2s. Estimated remaining: 12m 45s. Rate: 153.1 symbols/min [2025-09-18T22:47:52.799309] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:52.837104] [DEBUG] [LOCAL ] ASB: Derivative data saved (1807 records). [2025-09-18T22:47:52.837315] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-09-18T22:47:52.845636] [INFO ] [MAIN ] Derivative Progress: 123/2075 symbols completed. ASB took 1.3s. Estimated remaining: 12m 40s. Rate: 154.2 symbols/min [2025-09-18T22:47:52.846013] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:53.082030] [DEBUG] [LOCAL ] ASG: Loaded 21240 existing records from primary storage. [2025-09-18T22:47:53.082373] [INFO ] [MAIN ] ASG: Loaded 21240 primary data records. [2025-09-18T22:47:53.084131] [DEBUG] [LOCAL ] ASC: Loaded 38414 existing records from primary storage. [2025-09-18T22:47:53.096737] [INFO ] [MAIN ] ASC: Loaded 38414 primary data records. [2025-09-18T22:47:53.735947] [DEBUG] [MAIN ] ASBA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:53.737450] [INFO ] [MAIN ] ASBA: Generated 1807 derivative records from 3449 primary records. [2025-09-18T22:47:53.738838] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-09-18T22:47:53.760763] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1807 records). [2025-09-18T22:47:53.760921] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-09-18T22:47:53.763461] [INFO ] [MAIN ] Derivative Progress: 124/2075 symbols completed. ASBA took 1.1s. Estimated remaining: 12m 48s. Rate: 152.5 symbols/min [2025-09-18T22:47:53.763969] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:53.782411] [DEBUG] [MAIN ] ASC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:53.783270] [INFO ] [MAIN ] ASC: Generated 1807 derivative records from 38414 primary records. [2025-09-18T22:47:53.783483] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-09-18T22:47:53.818128] [DEBUG] [MAIN ] ASG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:53.821326] [INFO ] [MAIN ] ASG: Generated 1807 derivative records from 21240 primary records. [2025-09-18T22:47:53.821743] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-09-18T22:47:53.823702] [DEBUG] [LOCAL ] ASC: Derivative data saved (1807 records). [2025-09-18T22:47:53.823792] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-09-18T22:47:53.826035] [INFO ] [MAIN ] Derivative Progress: 125/2075 symbols completed. ASC took 1.0s. Estimated remaining: 12m 42s. Rate: 153.6 symbols/min [2025-09-18T22:47:53.841685] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:53.845302] [DEBUG] [LOCAL ] ASGI: Loaded 22345 existing records from primary storage. [2025-09-18T22:47:53.846125] [INFO ] [MAIN ] ASGI: Loaded 22345 primary data records. [2025-09-18T22:47:53.975732] [DEBUG] [LOCAL ] ASG: Derivative data saved (1807 records). [2025-09-18T22:47:53.987863] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-09-18T22:47:54.017723] [INFO ] [MAIN ] Derivative Progress: 126/2075 symbols completed. ASG took 1.2s. Estimated remaining: 12m 38s. Rate: 154.2 symbols/min [2025-09-18T22:47:54.074840] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:54.205336] [DEBUG] [LOCAL ] ASGN: Loaded 36292 existing records from primary storage. [2025-09-18T22:47:54.205683] [INFO ] [MAIN ] ASGN: Loaded 36292 primary data records. [2025-09-18T22:47:54.596632] [DEBUG] [LOCAL ] ASH: Loaded 38304 existing records from primary storage. [2025-09-18T22:47:54.597578] [INFO ] [MAIN ] ASH: Loaded 38304 primary data records. [2025-09-18T22:47:54.699804] [DEBUG] [MAIN ] ASGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:54.724029] [INFO ] [MAIN ] ASGI: Generated 1807 derivative records from 22345 primary records. [2025-09-18T22:47:54.724678] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-09-18T22:47:54.944124] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1807 records). [2025-09-18T22:47:54.945189] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-09-18T22:47:54.948947] [INFO ] [MAIN ] Derivative Progress: 127/2075 symbols completed. ASGI took 1.2s. Estimated remaining: 12m 46s. Rate: 152.5 symbols/min [2025-09-18T22:47:54.949331] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:54.965243] [DEBUG] [MAIN ] ASGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:54.966540] [INFO ] [MAIN ] ASGN: Generated 1807 derivative records from 36292 primary records. [2025-09-18T22:47:54.966819] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-09-18T22:47:54.991302] [DEBUG] [LOCAL ] ASR: Loaded 9250 existing records from primary storage. [2025-09-18T22:47:54.992353] [INFO ] [MAIN ] ASR: Loaded 9250 primary data records. [2025-09-18T22:47:55.005365] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1807 records). [2025-09-18T22:47:55.039927] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-09-18T22:47:55.042868] [INFO ] [MAIN ] Derivative Progress: 128/2075 symbols completed. ASGN took 1.2s. Estimated remaining: 12m 41s. Rate: 153.4 symbols/min [2025-09-18T22:47:55.072702] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:55.138700] [DEBUG] [MAIN ] ASH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:55.202583] [INFO ] [MAIN ] ASH: Generated 1807 derivative records from 38304 primary records. [2025-09-18T22:47:55.208409] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-09-18T22:47:55.344210] [DEBUG] [LOCAL ] ASH: Derivative data saved (1807 records). [2025-09-18T22:47:55.344991] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-09-18T22:47:55.347707] [INFO ] [MAIN ] Derivative Progress: 129/2075 symbols completed. ASH took 1.3s. Estimated remaining: 12m 40s. Rate: 153.7 symbols/min [2025-09-18T22:47:55.361485] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:55.403763] [DEBUG] [MAIN ] ASR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:55.405023] [DEBUG] [LOCAL ] ASX: Loaded 53316 existing records from primary storage. [2025-09-18T22:47:55.406004] [INFO ] [MAIN ] ASR: Generated 1807 derivative records from 9250 primary records. [2025-09-18T22:47:55.406110] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-09-18T22:47:55.406213] [INFO ] [MAIN ] ASX: Loaded 53316 primary data records. [2025-09-18T22:47:55.604685] [DEBUG] [LOCAL ] ASR: Derivative data saved (1807 records). [2025-09-18T22:47:55.749550] [DEBUG] [LOCAL ] ATGE: Loaded 32387 existing records from primary storage. [2025-09-18T22:47:55.740212] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-09-18T22:47:55.750291] [INFO ] [MAIN ] ATGE: Loaded 32387 primary data records. [2025-09-18T22:47:55.753485] [INFO ] [MAIN ] Derivative Progress: 130/2075 symbols completed. ASR took 0.8s. Estimated remaining: 12m 40s. Rate: 153.6 symbols/min [2025-09-18T22:47:55.801592] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:56.098401] [DEBUG] [LOCAL ] ATHM: Loaded 33337 existing records from primary storage. [2025-09-18T22:47:56.099821] [INFO ] [MAIN ] ATHM: Loaded 33337 primary data records. [2025-09-18T22:47:56.290073] [DEBUG] [MAIN ] ASX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:56.316802] [INFO ] [MAIN ] ASX: Generated 1807 derivative records from 53316 primary records. [2025-09-18T22:47:56.329155] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-09-18T22:47:56.572306] [DEBUG] [MAIN ] ATGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:56.574220] [DEBUG] [LOCAL ] ASX: Derivative data saved (1807 records). [2025-09-18T22:47:56.573722] [INFO ] [MAIN ] ATGE: Generated 1807 derivative records from 32387 primary records. [2025-09-18T22:47:56.574466] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-09-18T22:47:56.574545] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-09-18T22:47:56.576971] [INFO ] [MAIN ] Derivative Progress: 131/2075 symbols completed. ASX took 1.5s. Estimated remaining: 12m 46s. Rate: 152.3 symbols/min [2025-09-18T22:47:56.578510] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:56.606461] [DEBUG] [LOCAL ] ATHS: Loaded 7270 existing records from primary storage. [2025-09-18T22:47:56.606035] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1807 records). [2025-09-18T22:47:56.606991] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-09-18T22:47:56.606810] [INFO ] [MAIN ] ATHS: Loaded 7270 primary data records. [2025-09-18T22:47:56.609406] [INFO ] [MAIN ] Derivative Progress: 132/2075 symbols completed. ATGE took 1.2s. Estimated remaining: 12m 40s. Rate: 153.4 symbols/min [2025-09-18T22:47:56.632731] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:56.886045] [DEBUG] [MAIN ] ATHM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:56.965791] [INFO ] [MAIN ] ATHM: Generated 1807 derivative records from 33337 primary records. [2025-09-18T22:47:56.966105] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-09-18T22:47:56.999534] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1807 records). [2025-09-18T22:47:57.000299] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-09-18T22:47:57.002747] [INFO ] [MAIN ] Derivative Progress: 133/2075 symbols completed. ATHM took 1.2s. Estimated remaining: 12m 40s. Rate: 153.4 symbols/min [2025-09-18T22:47:57.020310] [DEBUG] [LOCAL ] ATI: Loaded 52046 existing records from primary storage. [2025-09-18T22:47:57.020710] [INFO ] [MAIN ] ATI: Loaded 52046 primary data records. [2025-09-18T22:47:57.330571] [DEBUG] [MAIN ] ATHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:57.331421] [INFO ] [MAIN ] ATHS: Generated 1807 derivative records from 7270 primary records. [2025-09-18T22:47:57.331543] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-09-18T22:47:57.349554] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1807 records). [2025-09-18T22:47:57.349809] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-09-18T22:47:57.352058] [INFO ] [MAIN ] Derivative Progress: 134/2075 symbols completed. ATHS took 0.8s. Estimated remaining: 12m 39s. Rate: 153.5 symbols/min [2025-09-18T22:47:57.368851] [DEBUG] [MAIN ] ATI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:57.369364] [INFO ] [MAIN ] ATI: Generated 1807 derivative records from 52046 primary records. [2025-09-18T22:47:57.369423] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-09-18T22:47:57.384817] [DEBUG] [LOCAL ] ATI: Derivative data saved (1807 records). [2025-09-18T22:47:57.384879] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-09-18T22:47:57.387051] [INFO ] [MAIN ] Derivative Progress: 135/2075 symbols completed. ATI took 0.8s. Estimated remaining: 12m 33s. Rate: 154.6 symbols/min [2025-09-18T22:47:57.387519] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:57.387939] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:57.387817] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:57.445470] [DEBUG] [LOCAL ] ATR: Loaded 30720 existing records from primary storage. [2025-09-18T22:47:57.456461] [INFO ] [MAIN ] ATR: Loaded 30720 primary data records. [2025-09-18T22:47:57.478430] [DEBUG] [LOCAL ] ATMU: Loaded 40021 existing records from primary storage. [2025-09-18T22:47:57.523532] [INFO ] [MAIN ] ATMU: Loaded 40021 primary data records. [2025-09-18T22:47:57.578446] [DEBUG] [LOCAL ] ATO: Loaded 42420 existing records from primary storage. [2025-09-18T22:47:57.637357] [INFO ] [MAIN ] ATO: Loaded 42420 primary data records. [2025-09-18T22:47:58.448476] [DEBUG] [MAIN ] ATR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:58.449747] [INFO ] [MAIN ] ATR: Generated 1807 derivative records from 30720 primary records. [2025-09-18T22:47:58.461671] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-09-18T22:47:58.462757] [DEBUG] [MAIN ] ATMU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:58.463940] [INFO ] [MAIN ] ATMU: Generated 1807 derivative records from 40021 primary records. [2025-09-18T22:47:58.464213] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-09-18T22:47:58.489966] [DEBUG] [LOCAL ] ATR: Derivative data saved (1807 records). [2025-09-18T22:47:58.490120] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-09-18T22:47:58.496573] [INFO ] [MAIN ] Derivative Progress: 136/2075 symbols completed. ATR took 1.1s. Estimated remaining: 12m 43s. Rate: 152.5 symbols/min [2025-09-18T22:47:58.497505] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:58.513443] [DEBUG] [MAIN ] ATO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:58.515477] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1807 records). [2025-09-18T22:47:58.516565] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-09-18T22:47:58.516371] [INFO ] [MAIN ] ATO: Generated 1807 derivative records from 42420 primary records. [2025-09-18T22:47:58.518998] [INFO ] [MAIN ] Derivative Progress: 137/2075 symbols completed. ATMU took 1.1s. Estimated remaining: 12m 37s. Rate: 153.5 symbols/min [2025-09-18T22:47:58.519182] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-09-18T22:47:58.519465] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:58.548963] [DEBUG] [LOCAL ] ATS: Loaded 18391 existing records from primary storage. [2025-09-18T22:47:58.550266] [DEBUG] [LOCAL ] ATO: Derivative data saved (1807 records). [2025-09-18T22:47:58.550431] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-09-18T22:47:58.553397] [INFO ] [MAIN ] Derivative Progress: 138/2075 symbols completed. ATO took 1.2s. Estimated remaining: 12m 32s. Rate: 154.6 symbols/min [2025-09-18T22:47:58.550514] [INFO ] [MAIN ] ATS: Loaded 18391 primary data records. [2025-09-18T22:47:58.553883] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:58.807181] [DEBUG] [LOCAL ] ATUS: Loaded 49567 existing records from primary storage. [2025-09-18T22:47:58.903511] [INFO ] [MAIN ] ATUS: Loaded 49567 primary data records. [2025-09-18T22:47:59.079624] [DEBUG] [LOCAL ] AU: Loaded 53292 existing records from primary storage. [2025-09-18T22:47:59.119153] [INFO ] [MAIN ] AU: Loaded 53292 primary data records. [2025-09-18T22:47:59.586420] [DEBUG] [MAIN ] ATS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:59.587522] [INFO ] [MAIN ] ATS: Generated 1807 derivative records from 18391 primary records. [2025-09-18T22:47:59.589078] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-09-18T22:47:59.609205] [DEBUG] [LOCAL ] ATS: Derivative data saved (1807 records). [2025-09-18T22:47:59.609959] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-09-18T22:47:59.612338] [INFO ] [MAIN ] Derivative Progress: 139/2075 symbols completed. ATS took 1.1s. Estimated remaining: 12m 41s. Rate: 152.7 symbols/min [2025-09-18T22:47:59.612856] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:59.635082] [DEBUG] [MAIN ] ATUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:59.636369] [INFO ] [MAIN ] ATUS: Generated 1807 derivative records from 49567 primary records. [2025-09-18T22:47:59.637467] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-09-18T22:47:59.669784] [DEBUG] [MAIN ] AU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:47:59.670373] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1807 records). [2025-09-18T22:47:59.671509] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-09-18T22:47:59.671370] [INFO ] [MAIN ] AU: Generated 1807 derivative records from 53292 primary records. [2025-09-18T22:47:59.671690] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-09-18T22:47:59.675044] [INFO ] [MAIN ] Derivative Progress: 140/2075 symbols completed. ATUS took 1.2s. Estimated remaining: 12m 36s. Rate: 153.6 symbols/min [2025-09-18T22:47:59.675638] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:59.710350] [DEBUG] [LOCAL ] AU: Derivative data saved (1807 records). [2025-09-18T22:47:59.711369] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-09-18T22:47:59.727875] [INFO ] [MAIN ] Derivative Progress: 141/2075 symbols completed. AU took 1.2s. Estimated remaining: 12m 31s. Rate: 154.5 symbols/min [2025-09-18T22:47:59.728413] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:47:59.730418] [DEBUG] [LOCAL ] AUB: Loaded 46863 existing records from primary storage. [2025-09-18T22:47:59.730784] [INFO ] [MAIN ] AUB: Loaded 46863 primary data records. [2025-09-18T22:47:59.832810] [DEBUG] [LOCAL ] AVAL: Loaded 9597 existing records from primary storage. [2025-09-18T22:47:59.852967] [INFO ] [MAIN ] AVAL: Loaded 9597 primary data records. [2025-09-18T22:48:00.056998] [DEBUG] [LOCAL ] AVA: Loaded 40043 existing records from primary storage. [2025-09-18T22:48:00.192838] [INFO ] [MAIN ] AVA: Loaded 40043 primary data records. [2025-09-18T22:48:00.821893] [DEBUG] [MAIN ] AUB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:00.824328] [INFO ] [MAIN ] AUB: Generated 1807 derivative records from 46863 primary records. [2025-09-18T22:48:00.824588] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-09-18T22:48:00.854627] [DEBUG] [MAIN ] AVAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:00.855854] [INFO ] [MAIN ] AVAL: Generated 1807 derivative records from 9597 primary records. [2025-09-18T22:48:00.856301] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-09-18T22:48:00.877120] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1807 records). [2025-09-18T22:48:00.877846] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-09-18T22:48:00.880540] [INFO ] [MAIN ] Derivative Progress: 142/2075 symbols completed. AVAL took 1.2s. Estimated remaining: 12m 41s. Rate: 152.4 symbols/min [2025-09-18T22:48:00.880930] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:00.894101] [DEBUG] [LOCAL ] AUB: Derivative data saved (1807 records). [2025-09-18T22:48:00.894836] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-09-18T22:48:00.897051] [INFO ] [MAIN ] Derivative Progress: 143/2075 symbols completed. AUB took 1.3s. Estimated remaining: 12m 35s. Rate: 153.4 symbols/min [2025-09-18T22:48:00.897677] [DEBUG] [MAIN ] AVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:00.898838] [INFO ] [MAIN ] AVA: Generated 1807 derivative records from 40043 primary records. [2025-09-18T22:48:00.898964] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:00.899086] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-09-18T22:48:00.916633] [DEBUG] [LOCAL ] AVA: Derivative data saved (1807 records). [2025-09-18T22:48:00.916864] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-09-18T22:48:00.919702] [INFO ] [MAIN ] Derivative Progress: 144/2075 symbols completed. AVA took 1.2s. Estimated remaining: 12m 30s. Rate: 154.5 symbols/min [2025-09-18T22:48:00.920114] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:00.938631] [DEBUG] [LOCAL ] AVD: Loaded 23445 existing records from primary storage. [2025-09-18T22:48:00.938787] [INFO ] [MAIN ] AVD: Loaded 23445 primary data records. [2025-09-18T22:48:01.061782] [DEBUG] [LOCAL ] AVK: Loaded 18339 existing records from primary storage. [2025-09-18T22:48:01.088901] [INFO ] [MAIN ] AVK: Loaded 18339 primary data records. [2025-09-18T22:48:01.262088] [DEBUG] [LOCAL ] AVB: Loaded 41875 existing records from primary storage. [2025-09-18T22:48:01.307243] [INFO ] [MAIN ] AVB: Loaded 41875 primary data records. [2025-09-18T22:48:01.966270] [DEBUG] [MAIN ] AVD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:01.967267] [INFO ] [MAIN ] AVD: Generated 1807 derivative records from 23445 primary records. [2025-09-18T22:48:01.968683] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-09-18T22:48:01.990008] [DEBUG] [LOCAL ] AVD: Derivative data saved (1807 records). [2025-09-18T22:48:01.990347] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-09-18T22:48:01.992713] [INFO ] [MAIN ] Derivative Progress: 145/2075 symbols completed. AVD took 1.1s. Estimated remaining: 12m 39s. Rate: 152.6 symbols/min [2025-09-18T22:48:01.993575] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:02.007367] [DEBUG] [MAIN ] AVK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:02.008547] [INFO ] [MAIN ] AVK: Generated 1807 derivative records from 18339 primary records. [2025-09-18T22:48:02.009765] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-09-18T22:48:02.041907] [DEBUG] [LOCAL ] AVK: Derivative data saved (1807 records). [2025-09-18T22:48:02.042426] [DEBUG] [MAIN ] AVB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:02.042497] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-09-18T22:48:02.043564] [INFO ] [MAIN ] AVB: Generated 1807 derivative records from 41875 primary records. [2025-09-18T22:48:02.043787] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-09-18T22:48:02.046081] [INFO ] [MAIN ] Derivative Progress: 146/2075 symbols completed. AVK took 1.1s. Estimated remaining: 12m 34s. Rate: 153.5 symbols/min [2025-09-18T22:48:02.047792] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:02.073275] [DEBUG] [LOCAL ] AVB: Derivative data saved (1807 records). [2025-09-18T22:48:02.073428] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-09-18T22:48:02.076165] [INFO ] [MAIN ] Derivative Progress: 147/2075 symbols completed. AVB took 1.2s. Estimated remaining: 12m 29s. Rate: 154.5 symbols/min [2025-09-18T22:48:02.076771] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:02.089584] [DEBUG] [LOCAL ] AVNS: Loaded 33953 existing records from primary storage. [2025-09-18T22:48:02.089897] [INFO ] [MAIN ] AVNS: Loaded 33953 primary data records. [2025-09-18T22:48:02.277682] [DEBUG] [LOCAL ] AVNT: Loaded 39891 existing records from primary storage. [2025-09-18T22:48:02.320364] [INFO ] [MAIN ] AVNT: Loaded 39891 primary data records. [2025-09-18T22:48:02.598877] [DEBUG] [LOCAL ] AVTR: Loaded 53961 existing records from primary storage. [2025-09-18T22:48:02.599216] [INFO ] [MAIN ] AVTR: Loaded 53961 primary data records. [2025-09-18T22:48:03.200311] [DEBUG] [MAIN ] AVNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:03.201582] [INFO ] [MAIN ] AVNS: Generated 1807 derivative records from 33953 primary records. [2025-09-18T22:48:03.202320] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-09-18T22:48:03.232593] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1807 records). [2025-09-18T22:48:03.232980] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-09-18T22:48:03.235587] [INFO ] [MAIN ] Derivative Progress: 148/2075 symbols completed. AVNS took 1.2s. Estimated remaining: 12m 38s. Rate: 152.4 symbols/min [2025-09-18T22:48:03.253690] [DEBUG] [MAIN ] AVNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:03.254487] [INFO ] [MAIN ] AVNT: Generated 1807 derivative records from 39891 primary records. [2025-09-18T22:48:03.254669] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-09-18T22:48:03.286917] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1807 records). [2025-09-18T22:48:03.286218] [DEBUG] [MAIN ] AVTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:03.287779] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-09-18T22:48:03.287717] [INFO ] [MAIN ] AVTR: Generated 1807 derivative records from 53961 primary records. [2025-09-18T22:48:03.290227] [INFO ] [MAIN ] Derivative Progress: 149/2075 symbols completed. AVNT took 1.2s. Estimated remaining: 12m 34s. Rate: 153.3 symbols/min [2025-09-18T22:48:03.290375] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-09-18T22:48:03.307036] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1807 records). [2025-09-18T22:48:03.307122] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-09-18T22:48:03.310007] [INFO ] [MAIN ] Derivative Progress: 150/2075 symbols completed. AVTR took 1.2s. Estimated remaining: 12m 29s. Rate: 154.3 symbols/min [2025-09-18T22:48:03.310713] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:03.311425] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:03.310863] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:03.351429] [DEBUG] [LOCAL ] AWI: Loaded 26410 existing records from primary storage. [2025-09-18T22:48:03.351579] [INFO ] [MAIN ] AWI: Loaded 26410 primary data records. [2025-09-18T22:48:03.457432] [DEBUG] [LOCAL ] AVY: Loaded 38091 existing records from primary storage. [2025-09-18T22:48:03.490232] [INFO ] [MAIN ] AVY: Loaded 38091 primary data records. [2025-09-18T22:48:03.547684] [DEBUG] [LOCAL ] AWK: Loaded 49258 existing records from primary storage. [2025-09-18T22:48:03.564131] [INFO ] [MAIN ] AWK: Loaded 49258 primary data records. [2025-09-18T22:48:04.404195] [DEBUG] [MAIN ] AWI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:04.406435] [INFO ] [MAIN ] AWI: Generated 1807 derivative records from 26410 primary records. [2025-09-18T22:48:04.406668] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-09-18T22:48:04.434844] [DEBUG] [MAIN ] AVY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:04.436406] [INFO ] [MAIN ] AVY: Generated 1807 derivative records from 38091 primary records. [2025-09-18T22:48:04.437475] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-09-18T22:48:04.453889] [DEBUG] [LOCAL ] AWI: Derivative data saved (1807 records). [2025-09-18T22:48:04.458883] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-09-18T22:48:04.457795] [DEBUG] [LOCAL ] AVY: Derivative data saved (1807 records). [2025-09-18T22:48:04.460922] [INFO ] [MAIN ] Derivative Progress: 151/2075 symbols completed. AWI took 1.1s. Estimated remaining: 12m 38s. Rate: 152.3 symbols/min [2025-09-18T22:48:04.462112] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-09-18T22:48:04.464862] [INFO ] [MAIN ] Derivative Progress: 152/2075 symbols completed. AVY took 1.2s. Estimated remaining: 12m 33s. Rate: 153.3 symbols/min [2025-09-18T22:48:04.465210] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:04.465277] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:04.482004] [DEBUG] [MAIN ] AWK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:04.482815] [INFO ] [MAIN ] AWK: Generated 1807 derivative records from 49258 primary records. [2025-09-18T22:48:04.482981] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-09-18T22:48:04.511760] [DEBUG] [LOCAL ] AWK: Derivative data saved (1807 records). [2025-09-18T22:48:04.512012] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-09-18T22:48:04.514838] [INFO ] [MAIN ] Derivative Progress: 153/2075 symbols completed. AWK took 1.2s. Estimated remaining: 12m 28s. Rate: 154.2 symbols/min [2025-09-18T22:48:04.515239] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:04.531689] [DEBUG] [LOCAL ] AWP: Loaded 22372 existing records from primary storage. [2025-09-18T22:48:04.532248] [DEBUG] [LOCAL ] AWR: Loaded 22621 existing records from primary storage. [2025-09-18T22:48:04.531885] [INFO ] [MAIN ] AWP: Loaded 22372 primary data records. [2025-09-18T22:48:04.532561] [INFO ] [MAIN ] AWR: Loaded 22621 primary data records. [2025-09-18T22:48:04.925289] [DEBUG] [LOCAL ] AX: Loaded 29039 existing records from primary storage. [2025-09-18T22:48:05.158745] [INFO ] [MAIN ] AX: Loaded 29039 primary data records. [2025-09-18T22:48:05.563244] [DEBUG] [MAIN ] AWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:05.564291] [INFO ] [MAIN ] AWR: Generated 1807 derivative records from 22621 primary records. [2025-09-18T22:48:05.564432] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-09-18T22:48:05.597454] [DEBUG] [MAIN ] AWP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:05.598758] [INFO ] [MAIN ] AWP: Generated 1807 derivative records from 22372 primary records. [2025-09-18T22:48:05.599114] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-09-18T22:48:05.614486] [DEBUG] [LOCAL ] AWR: Derivative data saved (1807 records). [2025-09-18T22:48:05.614810] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-09-18T22:48:05.620621] [INFO ] [MAIN ] Derivative Progress: 154/2075 symbols completed. AWR took 1.2s. Estimated remaining: 12m 36s. Rate: 152.4 symbols/min [2025-09-18T22:48:05.622386] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:05.637865] [DEBUG] [MAIN ] AX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:05.639259] [INFO ] [MAIN ] AX: Generated 1807 derivative records from 29039 primary records. [2025-09-18T22:48:05.639393] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-09-18T22:48:05.639703] [DEBUG] [LOCAL ] AWP: Derivative data saved (1807 records). [2025-09-18T22:48:05.639805] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-09-18T22:48:05.642949] [INFO ] [MAIN ] Derivative Progress: 155/2075 symbols completed. AWP took 1.2s. Estimated remaining: 12m 31s. Rate: 153.3 symbols/min [2025-09-18T22:48:05.643548] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:05.659870] [DEBUG] [LOCAL ] AX: Derivative data saved (1807 records). [2025-09-18T22:48:05.660051] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-09-18T22:48:05.663290] [INFO ] [MAIN ] Derivative Progress: 156/2075 symbols completed. AX took 1.1s. Estimated remaining: 12m 26s. Rate: 154.3 symbols/min [2025-09-18T22:48:05.663687] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:05.670252] [DEBUG] [LOCAL ] AXR: Loaded 3173 existing records from primary storage. [2025-09-18T22:48:05.670403] [INFO ] [MAIN ] AXR: Loaded 3173 primary data records. [2025-09-18T22:48:05.854895] [DEBUG] [LOCAL ] AXL: Loaded 50932 existing records from primary storage. [2025-09-18T22:48:05.855437] [INFO ] [MAIN ] AXL: Loaded 50932 primary data records. [2025-09-18T22:48:06.206248] [DEBUG] [LOCAL ] AXP: Loaded 53656 existing records from primary storage. [2025-09-18T22:48:06.217794] [INFO ] [MAIN ] AXP: Loaded 53656 primary data records. [2025-09-18T22:48:06.744227] [DEBUG] [MAIN ] AXR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:48:06.745110] [INFO ] [MAIN ] AXR: Generated 1806 derivative records from 3173 primary records. [2025-09-18T22:48:06.745396] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-09-18T22:48:06.764252] [DEBUG] [LOCAL ] AXR: Derivative data saved (1806 records). [2025-09-18T22:48:06.764459] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-09-18T22:48:06.766840] [INFO ] [MAIN ] Derivative Progress: 157/2075 symbols completed. AXR took 1.1s. Estimated remaining: 12m 35s. Rate: 152.5 symbols/min [2025-09-18T22:48:06.774739] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:06.780615] [DEBUG] [MAIN ] AXL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:06.781342] [INFO ] [MAIN ] AXL: Generated 1807 derivative records from 50932 primary records. [2025-09-18T22:48:06.781785] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-09-18T22:48:06.798481] [DEBUG] [LOCAL ] AXL: Derivative data saved (1807 records). [2025-09-18T22:48:06.799664] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-09-18T22:48:06.802074] [INFO ] [MAIN ] Derivative Progress: 158/2075 symbols completed. AXL took 1.2s. Estimated remaining: 12m 30s. Rate: 153.4 symbols/min [2025-09-18T22:48:06.804166] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:06.817571] [DEBUG] [MAIN ] AXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:06.818374] [INFO ] [MAIN ] AXP: Generated 1807 derivative records from 53656 primary records. [2025-09-18T22:48:06.818545] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-09-18T22:48:06.834870] [DEBUG] [LOCAL ] AXP: Derivative data saved (1807 records). [2025-09-18T22:48:06.835043] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-09-18T22:48:06.837838] [INFO ] [MAIN ] Derivative Progress: 159/2075 symbols completed. AXP took 1.2s. Estimated remaining: 12m 25s. Rate: 154.2 symbols/min [2025-09-18T22:48:06.847214] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:06.864204] [DEBUG] [LOCAL ] AXS: Loaded 38587 existing records from primary storage. [2025-09-18T22:48:06.864407] [INFO ] [MAIN ] AXS: Loaded 38587 primary data records. [2025-09-18T22:48:06.997448] [DEBUG] [LOCAL ] AYI: Loaded 25741 existing records from primary storage. [2025-09-18T22:48:07.008372] [INFO ] [MAIN ] AYI: Loaded 25741 primary data records. [2025-09-18T22:48:07.350858] [DEBUG] [LOCAL ] AXTA: Loaded 52428 existing records from primary storage. [2025-09-18T22:48:07.362704] [INFO ] [MAIN ] AXTA: Loaded 52428 primary data records. [2025-09-18T22:48:07.897449] [DEBUG] [MAIN ] AXS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:07.899365] [INFO ] [MAIN ] AXS: Generated 1807 derivative records from 38587 primary records. [2025-09-18T22:48:07.899748] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-09-18T22:48:07.938735] [DEBUG] [LOCAL ] AXS: Derivative data saved (1807 records). [2025-09-18T22:48:07.965178] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-09-18T22:48:07.952748] [DEBUG] [MAIN ] AYI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:07.966479] [INFO ] [MAIN ] AYI: Generated 1807 derivative records from 25741 primary records. [2025-09-18T22:48:07.969338] [INFO ] [MAIN ] Derivative Progress: 160/2075 symbols completed. AXS took 1.2s. Estimated remaining: 12m 34s. Rate: 152.4 symbols/min [2025-09-18T22:48:07.969498] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-09-18T22:48:07.970024] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:07.972490] [DEBUG] [MAIN ] AXTA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:07.984305] [INFO ] [MAIN ] AXTA: Generated 1807 derivative records from 52428 primary records. [2025-09-18T22:48:07.984424] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-09-18T22:48:08.005332] [DEBUG] [LOCAL ] AYI: Derivative data saved (1807 records). [2025-09-18T22:48:08.008296] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-09-18T22:48:08.012260] [INFO ] [MAIN ] Derivative Progress: 161/2075 symbols completed. AYI took 1.2s. Estimated remaining: 12m 29s. Rate: 153.3 symbols/min [2025-09-18T22:48:08.017561] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:08.019114] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1807 records). [2025-09-18T22:48:08.019355] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-09-18T22:48:08.027683] [INFO ] [MAIN ] Derivative Progress: 162/2075 symbols completed. AXTA took 1.2s. Estimated remaining: 12m 24s. Rate: 154.2 symbols/min [2025-09-18T22:48:08.028305] [DEBUG] [LOCAL ] AZO: Loaded 11696 existing records from primary storage. [2025-09-18T22:48:08.028517] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:08.028736] [INFO ] [MAIN ] AZO: Loaded 11696 primary data records. [2025-09-18T22:48:08.163761] [DEBUG] [LOCAL ] AZZ: Loaded 22399 existing records from primary storage. [2025-09-18T22:48:08.174351] [INFO ] [MAIN ] AZZ: Loaded 22399 primary data records. [2025-09-18T22:48:08.556163] [DEBUG] [LOCAL ] BA: Loaded 54181 existing records from primary storage. [2025-09-18T22:48:08.574613] [INFO ] [MAIN ] BA: Loaded 54181 primary data records. [2025-09-18T22:48:09.116989] [DEBUG] [MAIN ] AZO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:09.117994] [INFO ] [MAIN ] AZO: Generated 1807 derivative records from 11696 primary records. [2025-09-18T22:48:09.118243] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-09-18T22:48:09.153628] [DEBUG] [MAIN ] AZZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:09.154533] [DEBUG] [LOCAL ] AZO: Derivative data saved (1807 records). [2025-09-18T22:48:09.155415] [INFO ] [MAIN ] AZZ: Generated 1807 derivative records from 22399 primary records. [2025-09-18T22:48:09.155672] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-09-18T22:48:09.155592] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-09-18T22:48:09.158194] [INFO ] [MAIN ] Derivative Progress: 163/2075 symbols completed. AZO took 1.2s. Estimated remaining: 12m 33s. Rate: 152.4 symbols/min [2025-09-18T22:48:09.175172] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1807 records). [2025-09-18T22:48:09.175371] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-09-18T22:48:09.177840] [INFO ] [MAIN ] Derivative Progress: 164/2075 symbols completed. AZZ took 1.2s. Estimated remaining: 12m 28s. Rate: 153.3 symbols/min [2025-09-18T22:48:09.194344] [DEBUG] [MAIN ] BA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:09.194943] [INFO ] [MAIN ] BA: Generated 1807 derivative records from 54181 primary records. [2025-09-18T22:48:09.195004] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-09-18T22:48:09.210295] [DEBUG] [LOCAL ] BA: Derivative data saved (1807 records). [2025-09-18T22:48:09.210354] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-09-18T22:48:09.213045] [INFO ] [MAIN ] Derivative Progress: 165/2075 symbols completed. BA took 1.2s. Estimated remaining: 12m 24s. Rate: 154.1 symbols/min [2025-09-18T22:48:09.213633] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:09.213851] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:09.213807] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:09.267722] [DEBUG] [LOCAL ] BAK: Loaded 39196 existing records from primary storage. [2025-09-18T22:48:09.267935] [INFO ] [MAIN ] BAK: Loaded 39196 primary data records. [2025-09-18T22:48:09.435187] [DEBUG] [LOCAL ] BAC: Loaded 54198 existing records from primary storage. [2025-09-18T22:48:09.423684] [DEBUG] [LOCAL ] BABA: Loaded 54210 existing records from primary storage. [2025-09-18T22:48:09.445615] [INFO ] [MAIN ] BABA: Loaded 54210 primary data records. [2025-09-18T22:48:09.541202] [INFO ] [MAIN ] BAC: Loaded 54198 primary data records. [2025-09-18T22:48:10.295183] [DEBUG] [MAIN ] BAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:10.297476] [INFO ] [MAIN ] BAK: Generated 1807 derivative records from 39196 primary records. [2025-09-18T22:48:10.297858] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-09-18T22:48:10.317999] [DEBUG] [LOCAL ] BAK: Derivative data saved (1807 records). [2025-09-18T22:48:10.330672] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-09-18T22:48:10.332830] [INFO ] [MAIN ] Derivative Progress: 166/2075 symbols completed. BAK took 1.1s. Estimated remaining: 12m 32s. Rate: 152.4 symbols/min [2025-09-18T22:48:10.333267] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:10.334395] [DEBUG] [MAIN ] BABA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:10.335455] [INFO ] [MAIN ] BABA: Generated 1807 derivative records from 54210 primary records. [2025-09-18T22:48:10.336683] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-09-18T22:48:10.369457] [DEBUG] [LOCAL ] BABA: Derivative data saved (1807 records). [2025-09-18T22:48:10.369679] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-09-18T22:48:10.372485] [INFO ] [MAIN ] Derivative Progress: 167/2075 symbols completed. BABA took 1.2s. Estimated remaining: 12m 27s. Rate: 153.2 symbols/min [2025-09-18T22:48:10.373410] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:10.373176] [DEBUG] [MAIN ] BAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:10.374367] [INFO ] [MAIN ] BAC: Generated 1807 derivative records from 54198 primary records. [2025-09-18T22:48:10.374926] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-09-18T22:48:10.400554] [DEBUG] [LOCAL ] BAC: Derivative data saved (1807 records). [2025-09-18T22:48:10.400915] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-09-18T22:48:10.404735] [INFO ] [MAIN ] Derivative Progress: 168/2075 symbols completed. BAC took 1.2s. Estimated remaining: 12m 23s. Rate: 154.1 symbols/min [2025-09-18T22:48:10.405145] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:10.458020] [DEBUG] [LOCAL ] BALL: Loaded 52223 existing records from primary storage. [2025-09-18T22:48:10.458348] [INFO ] [MAIN ] BALL: Loaded 52223 primary data records. [2025-09-18T22:48:10.600894] [DEBUG] [LOCAL ] BARK: Loaded 38908 existing records from primary storage. [2025-09-18T22:48:10.601135] [INFO ] [MAIN ] BARK: Loaded 38908 primary data records. [2025-09-18T22:48:10.619765] [DEBUG] [LOCAL ] BANC: Loaded 51659 existing records from primary storage. [2025-09-18T22:48:10.639755] [INFO ] [MAIN ] BANC: Loaded 51659 primary data records. [2025-09-18T22:48:11.525782] [DEBUG] [MAIN ] BALL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:11.526861] [INFO ] [MAIN ] BALL: Generated 1807 derivative records from 52223 primary records. [2025-09-18T22:48:11.530100] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-09-18T22:48:11.563395] [DEBUG] [MAIN ] BARK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:11.568455] [INFO ] [MAIN ] BARK: Generated 1807 derivative records from 38908 primary records. [2025-09-18T22:48:11.570007] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-09-18T22:48:11.577831] [DEBUG] [LOCAL ] BALL: Derivative data saved (1807 records). [2025-09-18T22:48:11.584628] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-09-18T22:48:11.584083] [DEBUG] [MAIN ] BANC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:11.587938] [INFO ] [MAIN ] Derivative Progress: 169/2075 symbols completed. BALL took 1.3s. Estimated remaining: 12m 31s. Rate: 152.2 symbols/min [2025-09-18T22:48:11.585845] [INFO ] [MAIN ] BANC: Generated 1807 derivative records from 51659 primary records. [2025-09-18T22:48:11.588071] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-09-18T22:48:11.588367] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:11.623317] [DEBUG] [LOCAL ] BARK: Derivative data saved (1807 records). [2025-09-18T22:48:11.623444] [DEBUG] [LOCAL ] BANC: Derivative data saved (1807 records). [2025-09-18T22:48:11.623812] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-09-18T22:48:11.623916] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-09-18T22:48:11.627354] [INFO ] [MAIN ] Derivative Progress: 170/2075 symbols completed. BARK took 1.2s. Estimated remaining: 12m 27s. Rate: 153.1 symbols/min [2025-09-18T22:48:11.630689] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:11.630767] [INFO ] [MAIN ] Derivative Progress: 171/2075 symbols completed. BANC took 1.3s. Estimated remaining: 12m 22s. Rate: 153.9 symbols/min [2025-09-18T22:48:11.631762] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:11.679740] [DEBUG] [LOCAL ] BAX: Loaded 53879 existing records from primary storage. [2025-09-18T22:48:11.679906] [INFO ] [MAIN ] BAX: Loaded 53879 primary data records. [2025-09-18T22:48:11.806659] [DEBUG] [LOCAL ] BBAR: Loaded 41348 existing records from primary storage. [2025-09-18T22:48:11.832339] [INFO ] [MAIN ] BBAR: Loaded 41348 primary data records. [2025-09-18T22:48:12.161051] [DEBUG] [LOCAL ] BB: Loaded 53314 existing records from primary storage. [2025-09-18T22:48:12.177431] [INFO ] [MAIN ] BB: Loaded 53314 primary data records. [2025-09-18T22:48:12.701027] [DEBUG] [MAIN ] BAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:12.702044] [INFO ] [MAIN ] BAX: Generated 1807 derivative records from 53879 primary records. [2025-09-18T22:48:12.702280] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-09-18T22:48:12.737681] [DEBUG] [LOCAL ] BAX: Derivative data saved (1807 records). [2025-09-18T22:48:12.738401] [DEBUG] [MAIN ] BBAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:12.738739] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-09-18T22:48:12.741240] [INFO ] [MAIN ] Derivative Progress: 172/2075 symbols completed. BAX took 1.2s. Estimated remaining: 12m 30s. Rate: 152.3 symbols/min [2025-09-18T22:48:12.742245] [INFO ] [MAIN ] BBAR: Generated 1807 derivative records from 41348 primary records. [2025-09-18T22:48:12.742626] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-09-18T22:48:12.742468] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:12.772470] [DEBUG] [MAIN ] BB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:12.773845] [INFO ] [MAIN ] BB: Generated 1807 derivative records from 53314 primary records. [2025-09-18T22:48:12.774708] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-09-18T22:48:12.794043] [DEBUG] [LOCAL ] BB: Derivative data saved (1807 records). [2025-09-18T22:48:12.795813] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-09-18T22:48:12.798810] [INFO ] [MAIN ] Derivative Progress: 173/2075 symbols completed. BB took 1.2s. Estimated remaining: 12m 26s. Rate: 153.1 symbols/min [2025-09-18T22:48:12.796013] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1807 records). [2025-09-18T22:48:12.799521] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:12.799441] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-09-18T22:48:12.802468] [INFO ] [MAIN ] Derivative Progress: 174/2075 symbols completed. BBAR took 1.2s. Estimated remaining: 12m 21s. Rate: 153.9 symbols/min [2025-09-18T22:48:12.802947] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:12.825883] [DEBUG] [LOCAL ] BBDO: Loaded 5090 existing records from primary storage. [2025-09-18T22:48:12.826022] [INFO ] [MAIN ] BBDO: Loaded 5090 primary data records. [2025-09-18T22:48:12.958437] [DEBUG] [LOCAL ] BBD: Loaded 53566 existing records from primary storage. [2025-09-18T22:48:12.974958] [INFO ] [MAIN ] BBD: Loaded 53566 primary data records. [2025-09-18T22:48:13.234671] [DEBUG] [LOCAL ] BBDC: Loaded 33755 existing records from primary storage. [2025-09-18T22:48:13.257020] [INFO ] [MAIN ] BBDC: Loaded 33755 primary data records. [2025-09-18T22:48:13.893402] [DEBUG] [MAIN ] BBDO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:13.895340] [INFO ] [MAIN ] BBDO: Generated 1807 derivative records from 5090 primary records. [2025-09-18T22:48:13.895882] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-09-18T22:48:13.912917] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1807 records). [2025-09-18T22:48:13.913023] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-09-18T22:48:13.915504] [INFO ] [MAIN ] Derivative Progress: 175/2075 symbols completed. BBDO took 1.1s. Estimated remaining: 12m 28s. Rate: 152.3 symbols/min [2025-09-18T22:48:13.918317] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:13.937088] [DEBUG] [MAIN ] BBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:13.938171] [INFO ] [MAIN ] BBD: Generated 1807 derivative records from 53566 primary records. [2025-09-18T22:48:13.938436] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-09-18T22:48:13.982042] [DEBUG] [MAIN ] BBDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:13.983779] [DEBUG] [LOCAL ] BBN: Loaded 18195 existing records from primary storage. [2025-09-18T22:48:13.985503] [INFO ] [MAIN ] BBN: Loaded 18195 primary data records. [2025-09-18T22:48:13.985291] [INFO ] [MAIN ] BBDC: Generated 1807 derivative records from 33755 primary records. [2025-09-18T22:48:13.997484] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-09-18T22:48:14.026115] [DEBUG] [LOCAL ] BBD: Derivative data saved (1807 records). [2025-09-18T22:48:14.066538] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-09-18T22:48:14.084305] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1807 records). [2025-09-18T22:48:14.097785] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-09-18T22:48:14.092243] [INFO ] [MAIN ] Derivative Progress: 176/2075 symbols completed. BBD took 1.3s. Estimated remaining: 12m 26s. Rate: 152.8 symbols/min [2025-09-18T22:48:14.109214] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:14.109477] [INFO ] [MAIN ] Derivative Progress: 177/2075 symbols completed. BBDC took 1.3s. Estimated remaining: 12m 21s. Rate: 153.6 symbols/min [2025-09-18T22:48:14.126831] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:14.185679] [DEBUG] [LOCAL ] BBU: Loaded 4094 existing records from primary storage. [2025-09-18T22:48:14.211239] [INFO ] [MAIN ] BBU: Loaded 4094 primary data records. [2025-09-18T22:48:14.369463] [DEBUG] [LOCAL ] BBUC: Loaded 13344 existing records from primary storage. [2025-09-18T22:48:14.395793] [INFO ] [MAIN ] BBUC: Loaded 13344 primary data records. [2025-09-18T22:48:15.026971] [DEBUG] [MAIN ] BBN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:15.028609] [INFO ] [MAIN ] BBN: Generated 1807 derivative records from 18195 primary records. [2025-09-18T22:48:15.029708] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-09-18T22:48:15.050574] [DEBUG] [LOCAL ] BBN: Derivative data saved (1807 records). [2025-09-18T22:48:15.051048] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-09-18T22:48:15.053408] [INFO ] [MAIN ] Derivative Progress: 178/2075 symbols completed. BBN took 1.1s. Estimated remaining: 12m 27s. Rate: 152.4 symbols/min [2025-09-18T22:48:15.076258] [DEBUG] [MAIN ] BBU: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:48:15.078500] [INFO ] [MAIN ] BBU: Generated 1806 derivative records from 4094 primary records. [2025-09-18T22:48:15.078838] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-09-18T22:48:15.093731] [DEBUG] [MAIN ] BBUC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:15.102850] [INFO ] [MAIN ] BBUC: Generated 1807 derivative records from 13344 primary records. [2025-09-18T22:48:15.106117] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-09-18T22:48:15.125802] [DEBUG] [LOCAL ] BBU: Derivative data saved (1806 records). [2025-09-18T22:48:15.126880] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-09-18T22:48:15.129909] [INFO ] [MAIN ] Derivative Progress: 179/2075 symbols completed. BBU took 1.0s. Estimated remaining: 12m 23s. Rate: 153.1 symbols/min [2025-09-18T22:48:15.131977] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1807 records). [2025-09-18T22:48:15.132493] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-09-18T22:48:15.136402] [INFO ] [MAIN ] Derivative Progress: 180/2075 symbols completed. BBUC took 1.0s. Estimated remaining: 12m 19s. Rate: 153.9 symbols/min [2025-09-18T22:48:15.137385] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:15.137684] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:15.137557] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:15.168255] [DEBUG] [LOCAL ] BBW: Loaded 26696 existing records from primary storage. [2025-09-18T22:48:15.168478] [INFO ] [MAIN ] BBW: Loaded 26696 primary data records. [2025-09-18T22:48:15.352118] [DEBUG] [LOCAL ] BBVA: Loaded 49977 existing records from primary storage. [2025-09-18T22:48:15.376230] [INFO ] [MAIN ] BBVA: Loaded 49977 primary data records. [2025-09-18T22:48:15.489142] [DEBUG] [LOCAL ] BBWI: Loaded 53964 existing records from primary storage. [2025-09-18T22:48:15.499924] [INFO ] [MAIN ] BBWI: Loaded 53964 primary data records. [2025-09-18T22:48:16.273904] [DEBUG] [MAIN ] BBW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:16.275076] [INFO ] [MAIN ] BBW: Generated 1807 derivative records from 26696 primary records. [2025-09-18T22:48:16.275364] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-09-18T22:48:16.308604] [DEBUG] [MAIN ] BBVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:16.310468] [INFO ] [MAIN ] BBVA: Generated 1807 derivative records from 49977 primary records. [2025-09-18T22:48:16.311346] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-09-18T22:48:16.326579] [DEBUG] [LOCAL ] BBW: Derivative data saved (1807 records). [2025-09-18T22:48:16.326275] [DEBUG] [MAIN ] BBWI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:16.327065] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-09-18T22:48:16.334943] [INFO ] [MAIN ] BBWI: Generated 1807 derivative records from 53964 primary records. [2025-09-18T22:48:16.338157] [INFO ] [MAIN ] Derivative Progress: 181/2075 symbols completed. BBW took 1.2s. Estimated remaining: 12m 27s. Rate: 152.2 symbols/min [2025-09-18T22:48:16.341391] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-09-18T22:48:16.342216] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:16.363486] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1807 records). [2025-09-18T22:48:16.364179] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-09-18T22:48:16.367136] [INFO ] [MAIN ] Derivative Progress: 182/2075 symbols completed. BBVA took 1.2s. Estimated remaining: 12m 22s. Rate: 153.0 symbols/min [2025-09-18T22:48:16.368044] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:16.369876] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1807 records). [2025-09-18T22:48:16.369950] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-09-18T22:48:16.372560] [INFO ] [MAIN ] Derivative Progress: 183/2075 symbols completed. BBWI took 1.2s. Estimated remaining: 12m 18s. Rate: 153.8 symbols/min [2025-09-18T22:48:16.373510] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:16.431416] [DEBUG] [LOCAL ] BCC: Loaded 28653 existing records from primary storage. [2025-09-18T22:48:16.431676] [INFO ] [MAIN ] BCC: Loaded 28653 primary data records. [2025-09-18T22:48:16.574127] [DEBUG] [LOCAL ] BBY: Loaded 53876 existing records from primary storage. [2025-09-18T22:48:16.565863] [DEBUG] [LOCAL ] BC: Loaded 45007 existing records from primary storage. [2025-09-18T22:48:16.590556] [INFO ] [MAIN ] BC: Loaded 45007 primary data records. [2025-09-18T22:48:16.590362] [INFO ] [MAIN ] BBY: Loaded 53876 primary data records. [2025-09-18T22:48:17.562412] [DEBUG] [MAIN ] BCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:17.563413] [INFO ] [MAIN ] BCC: Generated 1807 derivative records from 28653 primary records. [2025-09-18T22:48:17.563521] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-09-18T22:48:17.595954] [DEBUG] [MAIN ] BC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:17.597344] [INFO ] [MAIN ] BC: Generated 1807 derivative records from 45007 primary records. [2025-09-18T22:48:17.598111] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-09-18T22:48:17.616890] [DEBUG] [LOCAL ] BCC: Derivative data saved (1807 records). [2025-09-18T22:48:17.617398] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-09-18T22:48:17.627362] [INFO ] [MAIN ] Derivative Progress: 184/2075 symbols completed. BCC took 1.3s. Estimated remaining: 12m 27s. Rate: 152.0 symbols/min [2025-09-18T22:48:17.628214] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:17.635703] [DEBUG] [MAIN ] BBY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:17.637318] [INFO ] [MAIN ] BBY: Generated 1807 derivative records from 53876 primary records. [2025-09-18T22:48:17.638838] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-09-18T22:48:17.649268] [DEBUG] [LOCAL ] BC: Derivative data saved (1807 records). [2025-09-18T22:48:17.650785] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-09-18T22:48:17.656383] [INFO ] [MAIN ] Derivative Progress: 185/2075 symbols completed. BC took 1.3s. Estimated remaining: 12m 22s. Rate: 152.7 symbols/min [2025-09-18T22:48:17.656905] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:17.663963] [DEBUG] [LOCAL ] BBY: Derivative data saved (1807 records). [2025-09-18T22:48:17.664048] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-09-18T22:48:17.667314] [INFO ] [MAIN ] Derivative Progress: 186/2075 symbols completed. BBY took 1.3s. Estimated remaining: 12m 18s. Rate: 153.5 symbols/min [2025-09-18T22:48:17.667585] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:17.717055] [DEBUG] [LOCAL ] BCO: Loaded 26698 existing records from primary storage. [2025-09-18T22:48:17.717318] [INFO ] [MAIN ] BCO: Loaded 26698 primary data records. [2025-09-18T22:48:17.838105] [DEBUG] [LOCAL ] BCE: Loaded 52752 existing records from primary storage. [2025-09-18T22:48:17.856446] [INFO ] [MAIN ] BCE: Loaded 52752 primary data records. [2025-09-18T22:48:18.174158] [DEBUG] [LOCAL ] BCS: Loaded 53865 existing records from primary storage. [2025-09-18T22:48:18.179536] [INFO ] [MAIN ] BCS: Loaded 53865 primary data records. [2025-09-18T22:48:18.762417] [DEBUG] [MAIN ] BCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:18.763442] [INFO ] [MAIN ] BCO: Generated 1807 derivative records from 26698 primary records. [2025-09-18T22:48:18.765390] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-09-18T22:48:18.785010] [DEBUG] [LOCAL ] BCO: Derivative data saved (1807 records). [2025-09-18T22:48:18.785252] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-09-18T22:48:18.787493] [INFO ] [MAIN ] Derivative Progress: 187/2075 symbols completed. BCO took 1.1s. Estimated remaining: 12m 25s. Rate: 152.0 symbols/min [2025-09-18T22:48:18.787922] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:18.807545] [DEBUG] [MAIN ] BCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:18.820447] [INFO ] [MAIN ] BCS: Generated 1807 derivative records from 53865 primary records. [2025-09-18T22:48:18.820832] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-09-18T22:48:18.821451] [DEBUG] [MAIN ] BCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:18.822467] [INFO ] [MAIN ] BCE: Generated 1807 derivative records from 52752 primary records. [2025-09-18T22:48:18.822562] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-09-18T22:48:18.859883] [DEBUG] [LOCAL ] BCS: Derivative data saved (1807 records). [2025-09-18T22:48:18.860692] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-09-18T22:48:18.863369] [INFO ] [MAIN ] Derivative Progress: 188/2075 symbols completed. BCS took 1.2s. Estimated remaining: 12m 22s. Rate: 152.7 symbols/min [2025-09-18T22:48:18.864163] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:18.877193] [DEBUG] [LOCAL ] BCE: Derivative data saved (1807 records). [2025-09-18T22:48:18.877340] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-09-18T22:48:18.880334] [INFO ] [MAIN ] Derivative Progress: 189/2075 symbols completed. BCE took 1.3s. Estimated remaining: 12m 17s. Rate: 153.5 symbols/min [2025-09-18T22:48:18.881184] [DEBUG] [LOCAL ] BCSF: Loaded 28159 existing records from primary storage. [2025-09-18T22:48:18.881458] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:18.881548] [INFO ] [MAIN ] BCSF: Loaded 28159 primary data records. [2025-09-18T22:48:19.007027] [DEBUG] [LOCAL ] BCX: Loaded 22175 existing records from primary storage. [2025-09-18T22:48:19.013164] [INFO ] [MAIN ] BCX: Loaded 22175 primary data records. [2025-09-18T22:48:19.316695] [DEBUG] [LOCAL ] BDC: Loaded 25249 existing records from primary storage. [2025-09-18T22:48:19.328516] [INFO ] [MAIN ] BDC: Loaded 25249 primary data records. [2025-09-18T22:48:19.906694] [DEBUG] [MAIN ] BCSF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:19.909087] [INFO ] [MAIN ] BCSF: Generated 1807 derivative records from 28159 primary records. [2025-09-18T22:48:19.909543] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-09-18T22:48:19.943485] [DEBUG] [MAIN ] BCX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:19.945503] [INFO ] [MAIN ] BCX: Generated 1807 derivative records from 22175 primary records. [2025-09-18T22:48:19.944795] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1807 records). [2025-09-18T22:48:19.945720] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-09-18T22:48:19.946260] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-09-18T22:48:19.948799] [INFO ] [MAIN ] Derivative Progress: 190/2075 symbols completed. BCSF took 1.2s. Estimated remaining: 12m 24s. Rate: 152.1 symbols/min [2025-09-18T22:48:19.957006] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:19.966599] [DEBUG] [LOCAL ] BCX: Derivative data saved (1807 records). [2025-09-18T22:48:19.966817] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-09-18T22:48:19.969533] [INFO ] [MAIN ] Derivative Progress: 191/2075 symbols completed. BCX took 1.1s. Estimated remaining: 12m 20s. Rate: 152.8 symbols/min [2025-09-18T22:48:19.970155] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:19.987360] [DEBUG] [MAIN ] BDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:19.988155] [INFO ] [MAIN ] BDC: Generated 1807 derivative records from 25249 primary records. [2025-09-18T22:48:19.988255] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-09-18T22:48:20.007808] [DEBUG] [LOCAL ] BDC: Derivative data saved (1807 records). [2025-09-18T22:48:20.018211] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-09-18T22:48:20.021141] [INFO ] [MAIN ] Derivative Progress: 192/2075 symbols completed. BDC took 1.1s. Estimated remaining: 12m 16s. Rate: 153.5 symbols/min [2025-09-18T22:48:20.021689] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:20.040365] [DEBUG] [LOCAL ] BDN: Loaded 48037 existing records from primary storage. [2025-09-18T22:48:20.040615] [INFO ] [MAIN ] BDN: Loaded 48037 primary data records. [2025-09-18T22:48:20.219611] [DEBUG] [LOCAL ] BDX: Loaded 52896 existing records from primary storage. [2025-09-18T22:48:20.248828] [INFO ] [MAIN ] BDX: Loaded 52896 primary data records. [2025-09-18T22:48:20.339076] [DEBUG] [LOCAL ] BE: Loaded 54043 existing records from primary storage. [2025-09-18T22:48:20.496580] [INFO ] [MAIN ] BE: Loaded 54043 primary data records. [2025-09-18T22:48:21.057507] [DEBUG] [MAIN ] BDN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:21.058483] [INFO ] [MAIN ] BDN: Generated 1807 derivative records from 48037 primary records. [2025-09-18T22:48:21.058904] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-09-18T22:48:21.092347] [DEBUG] [LOCAL ] BDN: Derivative data saved (1807 records). [2025-09-18T22:48:21.093192] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-09-18T22:48:21.093601] [DEBUG] [MAIN ] BDX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:21.095672] [INFO ] [MAIN ] Derivative Progress: 193/2075 symbols completed. BDN took 1.1s. Estimated remaining: 12m 22s. Rate: 152.1 symbols/min [2025-09-18T22:48:21.097363] [INFO ] [MAIN ] BDX: Generated 1807 derivative records from 52896 primary records. [2025-09-18T22:48:21.097525] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-09-18T22:48:21.126511] [DEBUG] [MAIN ] BE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:21.127745] [INFO ] [MAIN ] BE: Generated 1807 derivative records from 54043 primary records. [2025-09-18T22:48:21.128066] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-09-18T22:48:21.145601] [DEBUG] [LOCAL ] BDX: Derivative data saved (1807 records). [2025-09-18T22:48:21.145959] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-09-18T22:48:21.150253] [INFO ] [MAIN ] Derivative Progress: 194/2075 symbols completed. BDX took 1.2s. Estimated remaining: 12m 19s. Rate: 152.8 symbols/min [2025-09-18T22:48:21.153477] [DEBUG] [LOCAL ] BE: Derivative data saved (1807 records). [2025-09-18T22:48:21.153545] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-09-18T22:48:21.156481] [INFO ] [MAIN ] Derivative Progress: 195/2075 symbols completed. BE took 1.1s. Estimated remaining: 12m 14s. Rate: 153.6 symbols/min [2025-09-18T22:48:21.157155] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:21.157052] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:21.157109] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:21.225064] [DEBUG] [LOCAL ] BEP: Loaded 39066 existing records from primary storage. [2025-09-18T22:48:21.225286] [INFO ] [MAIN ] BEP: Loaded 39066 primary data records. [2025-09-18T22:48:21.365636] [DEBUG] [LOCAL ] BEKE: Loaded 53656 existing records from primary storage. [2025-09-18T22:48:21.361162] [DEBUG] [LOCAL ] BEN: Loaded 53466 existing records from primary storage. [2025-09-18T22:48:21.365866] [INFO ] [MAIN ] BEKE: Loaded 53656 primary data records. [2025-09-18T22:48:21.376900] [INFO ] [MAIN ] BEN: Loaded 53466 primary data records. [2025-09-18T22:48:22.237802] [DEBUG] [MAIN ] BEP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:22.238524] [INFO ] [MAIN ] BEP: Generated 1807 derivative records from 39066 primary records. [2025-09-18T22:48:22.238834] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-09-18T22:48:22.255559] [DEBUG] [LOCAL ] BEP: Derivative data saved (1807 records). [2025-09-18T22:48:22.255914] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-09-18T22:48:22.257781] [INFO ] [MAIN ] Derivative Progress: 196/2075 symbols completed. BEP took 1.1s. Estimated remaining: 12m 21s. Rate: 152.2 symbols/min [2025-09-18T22:48:22.258029] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:22.288249] [DEBUG] [MAIN ] BEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:22.288717] [DEBUG] [MAIN ] BEKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:22.290292] [INFO ] [MAIN ] BEKE: Generated 1807 derivative records from 53656 primary records. [2025-09-18T22:48:22.290402] [INFO ] [MAIN ] BEN: Generated 1807 derivative records from 53466 primary records. [2025-09-18T22:48:22.290504] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-09-18T22:48:22.290566] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-09-18T22:48:22.323605] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1807 records). [2025-09-18T22:48:22.324204] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-09-18T22:48:22.327483] [INFO ] [MAIN ] Derivative Progress: 197/2075 symbols completed. BEKE took 1.2s. Estimated remaining: 12m 17s. Rate: 152.8 symbols/min [2025-09-18T22:48:22.329410] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:22.329162] [DEBUG] [LOCAL ] BEN: Derivative data saved (1807 records). [2025-09-18T22:48:22.329995] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-09-18T22:48:22.332812] [INFO ] [MAIN ] Derivative Progress: 198/2075 symbols completed. BEN took 1.2s. Estimated remaining: 12m 13s. Rate: 153.6 symbols/min [2025-09-18T22:48:22.333315] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:22.352607] [DEBUG] [LOCAL ] BEPI: Loaded 3451 existing records from primary storage. [2025-09-18T22:48:22.352806] [DEBUG] [LOCAL ] BEPH: Loaded 5249 existing records from primary storage. [2025-09-18T22:48:22.352955] [INFO ] [MAIN ] BEPH: Loaded 5249 primary data records. [2025-09-18T22:48:22.353046] [INFO ] [MAIN ] BEPI: Loaded 3451 primary data records. [2025-09-18T22:48:22.561573] [DEBUG] [LOCAL ] BEPC: Loaded 46987 existing records from primary storage. [2025-09-18T22:48:22.581333] [INFO ] [MAIN ] BEPC: Loaded 46987 primary data records. [2025-09-18T22:48:23.592033] [DEBUG] [MAIN ] BEPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:23.595989] [INFO ] [MAIN ] BEPH: Generated 1807 derivative records from 5249 primary records. [2025-09-18T22:48:23.596464] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-09-18T22:48:23.629197] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1807 records). [2025-09-18T22:48:23.632167] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-09-18T22:48:23.635947] [INFO ] [MAIN ] Derivative Progress: 199/2075 symbols completed. BEPH took 1.3s. Estimated remaining: 12m 21s. Rate: 151.8 symbols/min [2025-09-18T22:48:23.637842] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:23.666739] [DEBUG] [MAIN ] BEPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:23.668387] [INFO ] [MAIN ] BEPI: Generated 1807 derivative records from 3451 primary records. [2025-09-18T22:48:23.685009] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-09-18T22:48:23.678526] [DEBUG] [LOCAL ] BEPJ: Loaded 3312 existing records from primary storage. [2025-09-18T22:48:23.692919] [INFO ] [MAIN ] BEPJ: Loaded 3312 primary data records. [2025-09-18T22:48:23.693362] [DEBUG] [MAIN ] BEPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:23.694178] [INFO ] [MAIN ] BEPC: Generated 1807 derivative records from 46987 primary records. [2025-09-18T22:48:23.699539] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-09-18T22:48:23.909315] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1807 records). [2025-09-18T22:48:23.922516] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1807 records). [2025-09-18T22:48:23.922385] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-09-18T22:48:23.927897] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-09-18T22:48:23.942330] [INFO ] [MAIN ] Derivative Progress: 200/2075 symbols completed. BEPC took 1.7s. Estimated remaining: 12m 20s. Rate: 152.0 symbols/min [2025-09-18T22:48:23.982751] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:23.982432] [INFO ] [MAIN ] Derivative Progress: 201/2075 symbols completed. BEPI took 1.6s. Estimated remaining: 12m 17s. Rate: 152.7 symbols/min [2025-09-18T22:48:24.027884] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:24.263586] [DEBUG] [MAIN ] BEPJ: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:48:24.272989] [DEBUG] [LOCAL ] BFAM: Loaded 33173 existing records from primary storage. [2025-09-18T22:48:24.274068] [INFO ] [MAIN ] BEPJ: Generated 1806 derivative records from 3312 primary records. [2025-09-18T22:48:24.274335] [INFO ] [MAIN ] BFAM: Loaded 33173 primary data records. [2025-09-18T22:48:24.274419] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-09-18T22:48:24.412488] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1806 records). [2025-09-18T22:48:24.413669] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-09-18T22:48:24.413218] [DEBUG] [LOCAL ] BFH: Loaded 42319 existing records from primary storage. [2025-09-18T22:48:24.434452] [INFO ] [MAIN ] BFH: Loaded 42319 primary data records. [2025-09-18T22:48:24.437154] [INFO ] [MAIN ] Derivative Progress: 202/2075 symbols completed. BEPJ took 0.8s. Estimated remaining: 12m 17s. Rate: 152.5 symbols/min [2025-09-18T22:48:24.488612] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:24.732929] [DEBUG] [LOCAL ] BFK: Loaded 14147 existing records from primary storage. [2025-09-18T22:48:24.754775] [INFO ] [MAIN ] BFK: Loaded 14147 primary data records. [2025-09-18T22:48:25.282026] [DEBUG] [MAIN ] BFAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:25.283591] [INFO ] [MAIN ] BFAM: Generated 1807 derivative records from 33173 primary records. [2025-09-18T22:48:25.283915] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-09-18T22:48:25.304619] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1807 records). [2025-09-18T22:48:25.305625] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-09-18T22:48:25.308459] [INFO ] [MAIN ] Derivative Progress: 203/2075 symbols completed. BFAM took 1.3s. Estimated remaining: 12m 21s. Rate: 151.6 symbols/min [2025-09-18T22:48:25.309968] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:25.324487] [DEBUG] [MAIN ] BFH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:25.325591] [INFO ] [MAIN ] BFH: Generated 1807 derivative records from 42319 primary records. [2025-09-18T22:48:25.325901] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-09-18T22:48:25.357205] [DEBUG] [MAIN ] BFK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:25.359292] [INFO ] [MAIN ] BFK: Generated 1807 derivative records from 14147 primary records. [2025-09-18T22:48:25.359473] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-09-18T22:48:25.360494] [DEBUG] [LOCAL ] BFH: Derivative data saved (1807 records). [2025-09-18T22:48:25.360994] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-09-18T22:48:25.363818] [INFO ] [MAIN ] Derivative Progress: 204/2075 symbols completed. BFH took 1.3s. Estimated remaining: 12m 17s. Rate: 152.3 symbols/min [2025-09-18T22:48:25.374839] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:25.378886] [DEBUG] [LOCAL ] BFK: Derivative data saved (1807 records). [2025-09-18T22:48:25.379156] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-09-18T22:48:25.382078] [INFO ] [MAIN ] Derivative Progress: 205/2075 symbols completed. BFK took 0.9s. Estimated remaining: 12m 13s. Rate: 153.0 symbols/min [2025-09-18T22:48:25.382526] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:25.404698] [DEBUG] [LOCAL ] BFS: Loaded 9113 existing records from primary storage. [2025-09-18T22:48:25.404855] [INFO ] [MAIN ] BFS: Loaded 9113 primary data records. [2025-09-18T22:48:25.534141] [DEBUG] [LOCAL ] BFZ: Loaded 11514 existing records from primary storage. [2025-09-18T22:48:25.535360] [DEBUG] [LOCAL ] BFLY: Loaded 52218 existing records from primary storage. [2025-09-18T22:48:25.535787] [INFO ] [MAIN ] BFLY: Loaded 52218 primary data records. [2025-09-18T22:48:25.535495] [INFO ] [MAIN ] BFZ: Loaded 11514 primary data records. [2025-09-18T22:48:26.426916] [DEBUG] [MAIN ] BFS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:26.428018] [INFO ] [MAIN ] BFS: Generated 1807 derivative records from 9113 primary records. [2025-09-18T22:48:26.428294] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-09-18T22:48:26.445783] [DEBUG] [LOCAL ] BFS: Derivative data saved (1807 records). [2025-09-18T22:48:26.446733] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-09-18T22:48:26.450234] [INFO ] [MAIN ] Derivative Progress: 206/2075 symbols completed. BFS took 1.1s. Estimated remaining: 12m 19s. Rate: 151.7 symbols/min [2025-09-18T22:48:26.450600] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:26.478348] [DEBUG] [MAIN ] BFLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:26.478077] [DEBUG] [MAIN ] BFZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:26.479191] [INFO ] [MAIN ] BFLY: Generated 1807 derivative records from 52218 primary records. [2025-09-18T22:48:26.479839] [INFO ] [MAIN ] BFZ: Generated 1807 derivative records from 11514 primary records. [2025-09-18T22:48:26.479940] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-09-18T22:48:26.480024] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-09-18T22:48:26.509940] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1807 records). [2025-09-18T22:48:26.510691] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-09-18T22:48:26.513598] [INFO ] [MAIN ] Derivative Progress: 207/2075 symbols completed. BFLY took 1.2s. Estimated remaining: 12m 16s. Rate: 152.3 symbols/min [2025-09-18T22:48:26.515035] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:26.517199] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1807 records). [2025-09-18T22:48:26.517274] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-09-18T22:48:26.519903] [INFO ] [MAIN ] Derivative Progress: 208/2075 symbols completed. BFZ took 1.1s. Estimated remaining: 12m 12s. Rate: 153.1 symbols/min [2025-09-18T22:48:26.550557] [DEBUG] [LOCAL ] BGB: Loaded 17754 existing records from primary storage. [2025-09-18T22:48:26.550738] [INFO ] [MAIN ] BGB: Loaded 17754 primary data records. [2025-09-18T22:48:26.678423] [DEBUG] [LOCAL ] BG: Loaded 50741 existing records from primary storage. [2025-09-18T22:48:26.678867] [INFO ] [MAIN ] BG: Loaded 50741 primary data records. [2025-09-18T22:48:27.223802] [DEBUG] [MAIN ] BGB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:27.224699] [INFO ] [MAIN ] BGB: Generated 1807 derivative records from 17754 primary records. [2025-09-18T22:48:27.224863] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-09-18T22:48:27.255612] [DEBUG] [LOCAL ] BGB: Derivative data saved (1807 records). [2025-09-18T22:48:27.254837] [DEBUG] [MAIN ] BG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:27.255721] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-09-18T22:48:27.256336] [INFO ] [MAIN ] BG: Generated 1807 derivative records from 50741 primary records. [2025-09-18T22:48:27.256451] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-09-18T22:48:27.258565] [INFO ] [MAIN ] Derivative Progress: 209/2075 symbols completed. BGB took 0.7s. Estimated remaining: 12m 15s. Rate: 152.4 symbols/min [2025-09-18T22:48:27.274147] [DEBUG] [LOCAL ] BG: Derivative data saved (1807 records). [2025-09-18T22:48:27.274209] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-09-18T22:48:27.276744] [INFO ] [MAIN ] Derivative Progress: 210/2075 symbols completed. BG took 0.8s. Estimated remaining: 12m 11s. Rate: 153.1 symbols/min [2025-09-18T22:48:27.277491] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:27.277412] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:27.277765] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:27.297414] [DEBUG] [LOCAL ] BGR: Loaded 13714 existing records from primary storage. [2025-09-18T22:48:27.297568] [INFO ] [MAIN ] BGR: Loaded 13714 primary data records. [2025-09-18T22:48:27.407746] [DEBUG] [LOCAL ] BGH: Loaded 16601 existing records from primary storage. [2025-09-18T22:48:27.407990] [INFO ] [MAIN ] BGH: Loaded 16601 primary data records. [2025-09-18T22:48:27.613083] [DEBUG] [LOCAL ] BGS: Loaded 50790 existing records from primary storage. [2025-09-18T22:48:27.717556] [INFO ] [MAIN ] BGS: Loaded 50790 primary data records. [2025-09-18T22:48:28.312364] [DEBUG] [MAIN ] BGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:28.313476] [INFO ] [MAIN ] BGR: Generated 1807 derivative records from 13714 primary records. [2025-09-18T22:48:28.314477] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-09-18T22:48:28.342530] [DEBUG] [MAIN ] BGH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:28.344149] [INFO ] [MAIN ] BGH: Generated 1807 derivative records from 16601 primary records. [2025-09-18T22:48:28.344549] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-09-18T22:48:28.357516] [DEBUG] [LOCAL ] BGR: Derivative data saved (1807 records). [2025-09-18T22:48:28.376121] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-09-18T22:48:28.377745] [DEBUG] [LOCAL ] BGH: Derivative data saved (1807 records). [2025-09-18T22:48:28.377689] [DEBUG] [MAIN ] BGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:28.380018] [INFO ] [MAIN ] Derivative Progress: 211/2075 symbols completed. BGR took 1.1s. Estimated remaining: 12m 17s. Rate: 151.8 symbols/min [2025-09-18T22:48:28.381190] [INFO ] [MAIN ] BGS: Generated 1807 derivative records from 50790 primary records. [2025-09-18T22:48:28.381377] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-09-18T22:48:28.381271] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:28.384297] [INFO ] [MAIN ] Derivative Progress: 212/2075 symbols completed. BGH took 1.1s. Estimated remaining: 12m 13s. Rate: 152.5 symbols/min [2025-09-18T22:48:28.384546] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:28.385064] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-09-18T22:48:28.403476] [DEBUG] [LOCAL ] BGS: Derivative data saved (1807 records). [2025-09-18T22:48:28.403596] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-09-18T22:48:28.405963] [INFO ] [MAIN ] Derivative Progress: 213/2075 symbols completed. BGS took 1.1s. Estimated remaining: 12m 9s. Rate: 153.2 symbols/min [2025-09-18T22:48:28.406435] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:28.415338] [DEBUG] [LOCAL ] BGSF: Loaded 6142 existing records from primary storage. [2025-09-18T22:48:28.415542] [INFO ] [MAIN ] BGSF: Loaded 6142 primary data records. [2025-09-18T22:48:28.496202] [DEBUG] [LOCAL ] BGT: Loaded 16821 existing records from primary storage. [2025-09-18T22:48:28.509017] [INFO ] [MAIN ] BGT: Loaded 16821 primary data records. [2025-09-18T22:48:28.576173] [DEBUG] [LOCAL ] BGX: Loaded 10952 existing records from primary storage. [2025-09-18T22:48:28.637973] [INFO ] [MAIN ] BGX: Loaded 10952 primary data records. [2025-09-18T22:48:29.398639] [DEBUG] [MAIN ] BGSF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:29.412427] [DEBUG] [MAIN ] BGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:29.415186] [INFO ] [MAIN ] BGT: Generated 1807 derivative records from 16821 primary records. [2025-09-18T22:48:29.414319] [INFO ] [MAIN ] BGSF: Generated 1807 derivative records from 6142 primary records. [2025-09-18T22:48:29.415376] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-09-18T22:48:29.415462] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-09-18T22:48:29.456221] [DEBUG] [MAIN ] BGX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:29.457754] [INFO ] [MAIN ] BGX: Generated 1807 derivative records from 10952 primary records. [2025-09-18T22:48:29.455910] [DEBUG] [LOCAL ] BGT: Derivative data saved (1807 records). [2025-09-18T22:48:29.458496] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-09-18T22:48:29.458421] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-09-18T22:48:29.461587] [INFO ] [MAIN ] Derivative Progress: 214/2075 symbols completed. BGT took 1.1s. Estimated remaining: 12m 15s. Rate: 152.0 symbols/min [2025-09-18T22:48:29.463522] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:29.477108] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1807 records). [2025-09-18T22:48:29.480146] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-09-18T22:48:29.483020] [INFO ] [MAIN ] Derivative Progress: 215/2075 symbols completed. BGSF took 1.1s. Estimated remaining: 12m 11s. Rate: 152.7 symbols/min [2025-09-18T22:48:29.484569] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:29.485346] [DEBUG] [LOCAL ] BGX: Derivative data saved (1807 records). [2025-09-18T22:48:29.485955] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-09-18T22:48:29.488622] [INFO ] [MAIN ] Derivative Progress: 216/2075 symbols completed. BGX took 1.1s. Estimated remaining: 12m 7s. Rate: 153.4 symbols/min [2025-09-18T22:48:29.489082] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:29.511020] [DEBUG] [LOCAL ] BH: Loaded 15344 existing records from primary storage. [2025-09-18T22:48:29.519700] [INFO ] [MAIN ] BH: Loaded 15344 primary data records. [2025-09-18T22:48:29.520116] [DEBUG] [LOCAL ] BGY: Loaded 23265 existing records from primary storage. [2025-09-18T22:48:29.520362] [INFO ] [MAIN ] BGY: Loaded 23265 primary data records. [2025-09-18T22:48:29.837906] [DEBUG] [LOCAL ] BHC: Loaded 47122 existing records from primary storage. [2025-09-18T22:48:29.918589] [INFO ] [MAIN ] BHC: Loaded 47122 primary data records. [2025-09-18T22:48:30.570024] [DEBUG] [MAIN ] BH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:30.572931] [INFO ] [MAIN ] BH: Generated 1807 derivative records from 15344 primary records. [2025-09-18T22:48:30.573229] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-09-18T22:48:30.587438] [DEBUG] [MAIN ] BGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:30.588420] [INFO ] [MAIN ] BGY: Generated 1807 derivative records from 23265 primary records. [2025-09-18T22:48:30.588761] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-09-18T22:48:30.618889] [DEBUG] [LOCAL ] BH: Derivative data saved (1807 records). [2025-09-18T22:48:30.619235] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-09-18T22:48:30.621722] [INFO ] [MAIN ] Derivative Progress: 217/2075 symbols completed. BH took 1.1s. Estimated remaining: 12m 13s. Rate: 152.0 symbols/min [2025-09-18T22:48:30.622866] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:30.626188] [DEBUG] [LOCAL ] BGY: Derivative data saved (1807 records). [2025-09-18T22:48:30.626405] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-09-18T22:48:30.629881] [INFO ] [MAIN ] Derivative Progress: 218/2075 symbols completed. BGY took 1.2s. Estimated remaining: 12m 10s. Rate: 152.7 symbols/min [2025-09-18T22:48:30.632299] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:30.646598] [DEBUG] [MAIN ] BHC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:48:30.647422] [INFO ] [MAIN ] BHC: Generated 1806 derivative records from 47122 primary records. [2025-09-18T22:48:30.647612] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-09-18T22:48:30.695012] [DEBUG] [LOCAL ] BHC: Derivative data saved (1806 records). [2025-09-18T22:48:30.684618] [DEBUG] [LOCAL ] BHE: Loaded 25630 existing records from primary storage. [2025-09-18T22:48:30.696296] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-09-18T22:48:30.699231] [INFO ] [MAIN ] Derivative Progress: 219/2075 symbols completed. BHC took 1.2s. Estimated remaining: 12m 6s. Rate: 153.3 symbols/min [2025-09-18T22:48:30.699702] [INFO ] [MAIN ] BHE: Loaded 25630 primary data records. [2025-09-18T22:48:30.699810] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:30.758032] [DEBUG] [LOCAL ] BHK: Loaded 22566 existing records from primary storage. [2025-09-18T22:48:30.795749] [INFO ] [MAIN ] BHK: Loaded 22566 primary data records. [2025-09-18T22:48:31.347474] [DEBUG] [LOCAL ] BHP: Loaded 53780 existing records from primary storage. [2025-09-18T22:48:31.349612] [INFO ] [MAIN ] BHP: Loaded 53780 primary data records. [2025-09-18T22:48:31.675466] [DEBUG] [MAIN ] BHE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:31.685034] [INFO ] [MAIN ] BHE: Generated 1807 derivative records from 25630 primary records. [2025-09-18T22:48:31.685266] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-09-18T22:48:31.718453] [DEBUG] [MAIN ] BHK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:31.719830] [INFO ] [MAIN ] BHK: Generated 1807 derivative records from 22566 primary records. [2025-09-18T22:48:31.719954] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-09-18T22:48:31.722247] [DEBUG] [LOCAL ] BHE: Derivative data saved (1807 records). [2025-09-18T22:48:31.722577] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-09-18T22:48:31.725933] [INFO ] [MAIN ] Derivative Progress: 220/2075 symbols completed. BHE took 1.1s. Estimated remaining: 12m 11s. Rate: 152.2 symbols/min [2025-09-18T22:48:31.726764] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:31.744972] [DEBUG] [LOCAL ] BHK: Derivative data saved (1807 records). [2025-09-18T22:48:31.745153] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-09-18T22:48:31.748155] [INFO ] [MAIN ] Derivative Progress: 221/2075 symbols completed. BHK took 1.1s. Estimated remaining: 12m 8s. Rate: 152.8 symbols/min [2025-09-18T22:48:31.748739] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:31.765701] [DEBUG] [MAIN ] BHP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:31.772140] [INFO ] [MAIN ] BHP: Generated 1807 derivative records from 53780 primary records. [2025-09-18T22:48:31.772356] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-09-18T22:48:31.800611] [DEBUG] [LOCAL ] BHR: Loaded 21610 existing records from primary storage. [2025-09-18T22:48:31.801287] [INFO ] [MAIN ] BHR: Loaded 21610 primary data records. [2025-09-18T22:48:31.869836] [DEBUG] [LOCAL ] BHP: Derivative data saved (1807 records). [2025-09-18T22:48:31.903902] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-09-18T22:48:31.919915] [INFO ] [MAIN ] Derivative Progress: 222/2075 symbols completed. BHP took 1.2s. Estimated remaining: 12m 6s. Rate: 153.2 symbols/min [2025-09-18T22:48:31.923893] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:32.167456] [DEBUG] [LOCAL ] BHVN: Loaded 49937 existing records from primary storage. [2025-09-18T22:48:32.168374] [INFO ] [MAIN ] BHVN: Loaded 49937 primary data records. [2025-09-18T22:48:32.524551] [DEBUG] [LOCAL ] BILL: Loaded 52709 existing records from primary storage. [2025-09-18T22:48:32.525143] [INFO ] [MAIN ] BILL: Loaded 52709 primary data records. [2025-09-18T22:48:32.685426] [DEBUG] [MAIN ] BHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:32.708498] [INFO ] [MAIN ] BHR: Generated 1807 derivative records from 21610 primary records. [2025-09-18T22:48:32.733267] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-09-18T22:48:32.896135] [DEBUG] [LOCAL ] BHR: Derivative data saved (1807 records). [2025-09-18T22:48:32.897111] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-09-18T22:48:32.902035] [INFO ] [MAIN ] Derivative Progress: 223/2075 symbols completed. BHR took 1.2s. Estimated remaining: 12m 10s. Rate: 152.2 symbols/min [2025-09-18T22:48:32.916016] [DEBUG] [MAIN ] BHVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:32.917433] [INFO ] [MAIN ] BHVN: Generated 1807 derivative records from 49937 primary records. [2025-09-18T22:48:32.917518] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-09-18T22:48:32.935285] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1807 records). [2025-09-18T22:48:32.935542] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-09-18T22:48:32.938566] [INFO ] [MAIN ] Derivative Progress: 224/2075 symbols completed. BHVN took 1.2s. Estimated remaining: 12m 7s. Rate: 152.8 symbols/min [2025-09-18T22:48:32.956902] [DEBUG] [MAIN ] BILL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:32.957618] [INFO ] [MAIN ] BILL: Generated 1807 derivative records from 52709 primary records. [2025-09-18T22:48:32.957707] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-09-18T22:48:32.974566] [DEBUG] [LOCAL ] BILL: Derivative data saved (1807 records). [2025-09-18T22:48:32.974697] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-09-18T22:48:32.977341] [INFO ] [MAIN ] Derivative Progress: 225/2075 symbols completed. BILL took 1.1s. Estimated remaining: 12m 4s. Rate: 153.4 symbols/min [2025-09-18T22:48:32.978136] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:32.978306] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:32.978421] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:33.021071] [DEBUG] [LOCAL ] BIO: Loaded 25946 existing records from primary storage. [2025-09-18T22:48:33.021258] [INFO ] [MAIN ] BIO: Loaded 25946 primary data records. [2025-09-18T22:48:33.139466] [DEBUG] [LOCAL ] BIP: Loaded 40063 existing records from primary storage. [2025-09-18T22:48:33.169528] [INFO ] [MAIN ] BIP: Loaded 40063 primary data records. [2025-09-18T22:48:33.191938] [DEBUG] [LOCAL ] BIPC: Loaded 42113 existing records from primary storage. [2025-09-18T22:48:33.229024] [INFO ] [MAIN ] BIPC: Loaded 42113 primary data records. [2025-09-18T22:48:34.055938] [DEBUG] [MAIN ] BIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:34.057095] [INFO ] [MAIN ] BIO: Generated 1807 derivative records from 25946 primary records. [2025-09-18T22:48:34.057559] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-09-18T22:48:34.087579] [DEBUG] [LOCAL ] BIO: Derivative data saved (1807 records). [2025-09-18T22:48:34.092926] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-09-18T22:48:34.093384] [DEBUG] [MAIN ] BIP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:34.099088] [INFO ] [MAIN ] BIP: Generated 1807 derivative records from 40063 primary records. [2025-09-18T22:48:34.100002] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-09-18T22:48:34.096832] [INFO ] [MAIN ] Derivative Progress: 226/2075 symbols completed. BIO took 1.1s. Estimated remaining: 12m 9s. Rate: 152.2 symbols/min [2025-09-18T22:48:34.101372] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:34.129010] [DEBUG] [MAIN ] BIPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:34.133834] [INFO ] [MAIN ] BIPC: Generated 1807 derivative records from 42113 primary records. [2025-09-18T22:48:34.134053] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-09-18T22:48:34.132732] [DEBUG] [LOCAL ] BIP: Derivative data saved (1807 records). [2025-09-18T22:48:34.136923] [DEBUG] [LOCAL ] BIPH: Loaded 2641 existing records from primary storage. [2025-09-18T22:48:34.138094] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-09-18T22:48:34.140905] [INFO ] [MAIN ] Derivative Progress: 227/2075 symbols completed. BIP took 1.2s. Estimated remaining: 12m 6s. Rate: 152.8 symbols/min [2025-09-18T22:48:34.141363] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:34.141127] [INFO ] [MAIN ] BIPH: Loaded 2641 primary data records. [2025-09-18T22:48:34.262263] [DEBUG] [LOCAL ] BIPI: Loaded 3452 existing records from primary storage. [2025-09-18T22:48:34.273174] [INFO ] [MAIN ] BIPI: Loaded 3452 primary data records. [2025-09-18T22:48:34.391027] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1807 records). [2025-09-18T22:48:34.416889] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-09-18T22:48:34.473921] [INFO ] [MAIN ] Derivative Progress: 228/2075 symbols completed. BIPC took 1.5s. Estimated remaining: 12m 5s. Rate: 152.9 symbols/min [2025-09-18T22:48:34.699391] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:34.874222] [DEBUG] [LOCAL ] BIPJ: Loaded 2902 existing records from primary storage. [2025-09-18T22:48:34.875739] [INFO ] [MAIN ] BIPJ: Loaded 2902 primary data records. [2025-09-18T22:48:35.208976] [DEBUG] [MAIN ] BIPH: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:48:35.210244] [INFO ] [MAIN ] BIPH: Generated 1806 derivative records from 2641 primary records. [2025-09-18T22:48:35.210558] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-09-18T22:48:35.229293] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1806 records). [2025-09-18T22:48:35.229931] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-09-18T22:48:35.232010] [INFO ] [MAIN ] Derivative Progress: 229/2075 symbols completed. BIPH took 1.1s. Estimated remaining: 12m 8s. Rate: 152.2 symbols/min [2025-09-18T22:48:35.232939] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:35.250929] [DEBUG] [MAIN ] BIPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:35.251866] [INFO ] [MAIN ] BIPI: Generated 1807 derivative records from 3452 primary records. [2025-09-18T22:48:35.252143] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-09-18T22:48:35.273890] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1807 records). [2025-09-18T22:48:35.275256] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-09-18T22:48:35.280067] [INFO ] [MAIN ] Derivative Progress: 230/2075 symbols completed. BIPI took 1.1s. Estimated remaining: 12m 4s. Rate: 152.8 symbols/min [2025-09-18T22:48:35.280721] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:35.295929] [DEBUG] [MAIN ] BIPJ: Filtered 6966 bins outside market hours, 7762 incomplete bins [2025-09-18T22:48:35.296826] [INFO ] [MAIN ] BIPJ: Generated 1804 derivative records from 2902 primary records. [2025-09-18T22:48:35.297008] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-09-18T22:48:35.331755] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1804 records). [2025-09-18T22:48:35.331966] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-09-18T22:48:35.334514] [INFO ] [MAIN ] Derivative Progress: 231/2075 symbols completed. BIPJ took 0.7s. Estimated remaining: 12m 1s. Rate: 153.4 symbols/min [2025-09-18T22:48:35.334997] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:35.344357] [DEBUG] [LOCAL ] BIT: Loaded 22188 existing records from primary storage. [2025-09-18T22:48:35.344803] [INFO ] [MAIN ] BIT: Loaded 22188 primary data records. [2025-09-18T22:48:35.405016] [DEBUG] [LOCAL ] BIRK: Loaded 51180 existing records from primary storage. [2025-09-18T22:48:35.432151] [INFO ] [MAIN ] BIRK: Loaded 51180 primary data records. [2025-09-18T22:48:36.019994] [DEBUG] [LOCAL ] BJ: Loaded 51813 existing records from primary storage. [2025-09-18T22:48:36.036165] [INFO ] [MAIN ] BJ: Loaded 51813 primary data records. [2025-09-18T22:48:36.441475] [DEBUG] [MAIN ] BIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:36.443513] [INFO ] [MAIN ] BIT: Generated 1807 derivative records from 22188 primary records. [2025-09-18T22:48:36.443624] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-09-18T22:48:36.464202] [DEBUG] [LOCAL ] BIT: Derivative data saved (1807 records). [2025-09-18T22:48:36.464940] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-09-18T22:48:36.467505] [INFO ] [MAIN ] Derivative Progress: 232/2075 symbols completed. BIT took 1.2s. Estimated remaining: 12m 7s. Rate: 152.2 symbols/min [2025-09-18T22:48:36.469332] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:36.487035] [DEBUG] [MAIN ] BIRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:36.487864] [INFO ] [MAIN ] BIRK: Generated 1807 derivative records from 51180 primary records. [2025-09-18T22:48:36.487968] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-09-18T22:48:36.512699] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1807 records). [2025-09-18T22:48:36.512860] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-09-18T22:48:36.515838] [INFO ] [MAIN ] Derivative Progress: 233/2075 symbols completed. BIRK took 1.3s. Estimated remaining: 12m 4s. Rate: 152.7 symbols/min [2025-09-18T22:48:36.516454] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:36.548713] [DEBUG] [MAIN ] BJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:36.549604] [INFO ] [MAIN ] BJ: Generated 1807 derivative records from 51813 primary records. [2025-09-18T22:48:36.549810] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-09-18T22:48:36.583875] [DEBUG] [LOCAL ] BJ: Derivative data saved (1807 records). [2025-09-18T22:48:36.584046] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-09-18T22:48:36.585360] [DEBUG] [LOCAL ] BK: Loaded 53955 existing records from primary storage. [2025-09-18T22:48:36.588218] [INFO ] [MAIN ] Derivative Progress: 234/2075 symbols completed. BJ took 1.3s. Estimated remaining: 12m 1s. Rate: 153.3 symbols/min [2025-09-18T22:48:36.588385] [INFO ] [MAIN ] BK: Loaded 53955 primary data records. [2025-09-18T22:48:36.588709] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:36.832106] [DEBUG] [LOCAL ] BKD: Loaded 50478 existing records from primary storage. [2025-09-18T22:48:36.951904] [INFO ] [MAIN ] BKD: Loaded 50478 primary data records. [2025-09-18T22:48:37.024344] [DEBUG] [LOCAL ] BKH: Loaded 37008 existing records from primary storage. [2025-09-18T22:48:37.052264] [INFO ] [MAIN ] BKH: Loaded 37008 primary data records. [2025-09-18T22:48:37.602782] [DEBUG] [MAIN ] BK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:37.605576] [INFO ] [MAIN ] BK: Generated 1807 derivative records from 53955 primary records. [2025-09-18T22:48:37.605918] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-09-18T22:48:37.628422] [DEBUG] [LOCAL ] BK: Derivative data saved (1807 records). [2025-09-18T22:48:37.628957] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-09-18T22:48:37.631749] [INFO ] [MAIN ] Derivative Progress: 235/2075 symbols completed. BK took 1.2s. Estimated remaining: 12m 5s. Rate: 152.2 symbols/min [2025-09-18T22:48:37.632296] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:37.651959] [DEBUG] [MAIN ] BKH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:37.652982] [INFO ] [MAIN ] BKH: Generated 1807 derivative records from 37008 primary records. [2025-09-18T22:48:37.653315] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-09-18T22:48:37.667027] [DEBUG] [MAIN ] BKD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:37.675028] [INFO ] [MAIN ] BKD: Generated 1807 derivative records from 50478 primary records. [2025-09-18T22:48:37.675223] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-09-18T22:48:37.696637] [DEBUG] [LOCAL ] BKH: Derivative data saved (1807 records). [2025-09-18T22:48:37.705866] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-09-18T22:48:37.708806] [INFO ] [MAIN ] Derivative Progress: 236/2075 symbols completed. BKH took 1.1s. Estimated remaining: 12m 3s. Rate: 152.7 symbols/min [2025-09-18T22:48:37.709669] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:37.713178] [DEBUG] [LOCAL ] BKD: Derivative data saved (1807 records). [2025-09-18T22:48:37.713386] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-09-18T22:48:37.716141] [INFO ] [MAIN ] Derivative Progress: 237/2075 symbols completed. BKD took 1.2s. Estimated remaining: 11m 59s. Rate: 153.3 symbols/min [2025-09-18T22:48:37.728967] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:37.729583] [DEBUG] [LOCAL ] BKKT: Loaded 34296 existing records from primary storage. [2025-09-18T22:48:37.730159] [INFO ] [MAIN ] BKKT: Loaded 34296 primary data records. [2025-09-18T22:48:37.775204] [DEBUG] [LOCAL ] BKN: Loaded 7722 existing records from primary storage. [2025-09-18T22:48:37.803634] [INFO ] [MAIN ] BKN: Loaded 7722 primary data records. [2025-09-18T22:48:38.423089] [DEBUG] [LOCAL ] BKSY: Loaded 48677 existing records from primary storage. [2025-09-18T22:48:38.433236] [INFO ] [MAIN ] BKSY: Loaded 48677 primary data records. [2025-09-18T22:48:38.781476] [DEBUG] [MAIN ] BKKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:38.783035] [INFO ] [MAIN ] BKKT: Generated 1807 derivative records from 34296 primary records. [2025-09-18T22:48:38.783141] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-09-18T22:48:38.803494] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1807 records). [2025-09-18T22:48:38.804920] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-09-18T22:48:38.807314] [INFO ] [MAIN ] Derivative Progress: 238/2075 symbols completed. BKKT took 1.2s. Estimated remaining: 12m 4s. Rate: 152.2 symbols/min [2025-09-18T22:48:38.822357] [DEBUG] [MAIN ] BKN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:38.823118] [INFO ] [MAIN ] BKN: Generated 1807 derivative records from 7722 primary records. [2025-09-18T22:48:38.823395] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-09-18T22:48:38.842996] [DEBUG] [LOCAL ] BKN: Derivative data saved (1807 records). [2025-09-18T22:48:38.843183] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-09-18T22:48:38.846524] [INFO ] [MAIN ] Derivative Progress: 239/2075 symbols completed. BKN took 1.1s. Estimated remaining: 12m 1s. Rate: 152.8 symbols/min [2025-09-18T22:48:38.859431] [DEBUG] [MAIN ] BKSY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:38.860126] [INFO ] [MAIN ] BKSY: Generated 1807 derivative records from 48677 primary records. [2025-09-18T22:48:38.860188] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-09-18T22:48:38.875678] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1807 records). [2025-09-18T22:48:38.875746] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-09-18T22:48:38.878220] [INFO ] [MAIN ] Derivative Progress: 240/2075 symbols completed. BKSY took 1.2s. Estimated remaining: 11m 58s. Rate: 153.4 symbols/min [2025-09-18T22:48:38.879109] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:38.878946] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:38.879413] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:38.932702] [DEBUG] [LOCAL ] BKV: Loaded 30424 existing records from primary storage. [2025-09-18T22:48:38.933020] [INFO ] [MAIN ] BKV: Loaded 30424 primary data records. [2025-09-18T22:48:39.057679] [DEBUG] [LOCAL ] BLCO: Loaded 36511 existing records from primary storage. [2025-09-18T22:48:39.062092] [INFO ] [MAIN ] BLCO: Loaded 36511 primary data records. [2025-09-18T22:48:39.062806] [DEBUG] [LOCAL ] BKU: Loaded 42458 existing records from primary storage. [2025-09-18T22:48:39.074428] [INFO ] [MAIN ] BKU: Loaded 42458 primary data records. [2025-09-18T22:48:39.922064] [DEBUG] [MAIN ] BKV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:39.923084] [INFO ] [MAIN ] BKV: Generated 1807 derivative records from 30424 primary records. [2025-09-18T22:48:39.923300] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-09-18T22:48:39.950955] [DEBUG] [LOCAL ] BKV: Derivative data saved (1807 records). [2025-09-18T22:48:39.958928] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-09-18T22:48:39.958160] [DEBUG] [MAIN ] BKU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:39.962206] [INFO ] [MAIN ] BKU: Generated 1807 derivative records from 42458 primary records. [2025-09-18T22:48:39.962349] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-09-18T22:48:39.961100] [INFO ] [MAIN ] Derivative Progress: 241/2075 symbols completed. BKV took 1.1s. Estimated remaining: 12m 3s. Rate: 152.2 symbols/min [2025-09-18T22:48:39.963083] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:39.992625] [DEBUG] [LOCAL ] BKU: Derivative data saved (1807 records). [2025-09-18T22:48:39.990902] [DEBUG] [MAIN ] BLCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:39.992793] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-09-18T22:48:39.995634] [INFO ] [MAIN ] Derivative Progress: 242/2075 symbols completed. BKU took 1.1s. Estimated remaining: 11m 60s. Rate: 152.8 symbols/min [2025-09-18T22:48:39.996475] [INFO ] [MAIN ] BLCO: Generated 1807 derivative records from 36511 primary records. [2025-09-18T22:48:39.996815] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:39.996979] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-09-18T22:48:40.022256] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1807 records). [2025-09-18T22:48:40.022388] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-09-18T22:48:40.025163] [INFO ] [MAIN ] Derivative Progress: 243/2075 symbols completed. BLCO took 1.1s. Estimated remaining: 11m 57s. Rate: 153.4 symbols/min [2025-09-18T22:48:40.025540] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:40.037498] [DEBUG] [LOCAL ] BLD: Loaded 28388 existing records from primary storage. [2025-09-18T22:48:40.037674] [INFO ] [MAIN ] BLD: Loaded 28388 primary data records. [2025-09-18T22:48:40.151091] [DEBUG] [LOCAL ] BLE: Loaded 14919 existing records from primary storage. [2025-09-18T22:48:40.180356] [INFO ] [MAIN ] BLE: Loaded 14919 primary data records. [2025-09-18T22:48:40.526421] [DEBUG] [LOCAL ] BLDR: Loaded 52011 existing records from primary storage. [2025-09-18T22:48:40.527324] [INFO ] [MAIN ] BLDR: Loaded 52011 primary data records. [2025-09-18T22:48:41.058051] [DEBUG] [MAIN ] BLD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:41.059133] [INFO ] [MAIN ] BLD: Generated 1807 derivative records from 28388 primary records. [2025-09-18T22:48:41.060168] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-09-18T22:48:41.091906] [DEBUG] [MAIN ] BLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:41.094871] [INFO ] [MAIN ] BLE: Generated 1807 derivative records from 14919 primary records. [2025-09-18T22:48:41.094065] [DEBUG] [LOCAL ] BLD: Derivative data saved (1807 records). [2025-09-18T22:48:41.095007] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-09-18T22:48:41.096583] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-09-18T22:48:41.105950] [INFO ] [MAIN ] Derivative Progress: 244/2075 symbols completed. BLD took 1.1s. Estimated remaining: 12m 1s. Rate: 152.3 symbols/min [2025-09-18T22:48:41.106233] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:41.128310] [DEBUG] [LOCAL ] BLE: Derivative data saved (1807 records). [2025-09-18T22:48:41.128412] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-09-18T22:48:41.127887] [DEBUG] [MAIN ] BLDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:41.130904] [INFO ] [MAIN ] Derivative Progress: 245/2075 symbols completed. BLE took 1.1s. Estimated remaining: 11m 58s. Rate: 152.9 symbols/min [2025-09-18T22:48:41.132008] [INFO ] [MAIN ] BLDR: Generated 1807 derivative records from 52011 primary records. [2025-09-18T22:48:41.132176] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:41.132251] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-09-18T22:48:41.149868] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1807 records). [2025-09-18T22:48:41.150019] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-09-18T22:48:41.152985] [INFO ] [MAIN ] Derivative Progress: 246/2075 symbols completed. BLDR took 1.2s. Estimated remaining: 11m 55s. Rate: 153.5 symbols/min [2025-09-18T22:48:41.153357] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:41.177292] [DEBUG] [LOCAL ] BLW: Loaded 13018 existing records from primary storage. [2025-09-18T22:48:41.186918] [INFO ] [MAIN ] BLW: Loaded 13018 primary data records. [2025-09-18T22:48:41.218432] [DEBUG] [LOCAL ] BLK: Loaded 35664 existing records from primary storage. [2025-09-18T22:48:41.253941] [INFO ] [MAIN ] BLK: Loaded 35664 primary data records. [2025-09-18T22:48:41.430299] [DEBUG] [LOCAL ] BLND: Loaded 49897 existing records from primary storage. [2025-09-18T22:48:41.485449] [INFO ] [MAIN ] BLND: Loaded 49897 primary data records. [2025-09-18T22:48:42.192262] [DEBUG] [MAIN ] BLW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:42.192532] [DEBUG] [MAIN ] BLK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:42.194442] [INFO ] [MAIN ] BLK: Generated 1807 derivative records from 35664 primary records. [2025-09-18T22:48:42.194567] [INFO ] [MAIN ] BLW: Generated 1807 derivative records from 13018 primary records. [2025-09-18T22:48:42.194834] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-09-18T22:48:42.194919] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-09-18T22:48:42.224155] [DEBUG] [LOCAL ] BLW: Derivative data saved (1807 records). [2025-09-18T22:48:42.228964] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-09-18T22:48:42.231660] [INFO ] [MAIN ] Derivative Progress: 247/2075 symbols completed. BLW took 1.1s. Estimated remaining: 11m 60s. Rate: 152.4 symbols/min [2025-09-18T22:48:42.232210] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:42.233214] [DEBUG] [LOCAL ] BLK: Derivative data saved (1807 records). [2025-09-18T22:48:42.234087] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-09-18T22:48:42.236950] [INFO ] [MAIN ] Derivative Progress: 248/2075 symbols completed. BLK took 1.1s. Estimated remaining: 11m 56s. Rate: 153.0 symbols/min [2025-09-18T22:48:42.237324] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:42.250824] [DEBUG] [MAIN ] BLND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:42.251518] [INFO ] [MAIN ] BLND: Generated 1807 derivative records from 49897 primary records. [2025-09-18T22:48:42.251696] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-09-18T22:48:42.273491] [DEBUG] [LOCAL ] BLND: Derivative data saved (1807 records). [2025-09-18T22:48:42.273637] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-09-18T22:48:42.276738] [INFO ] [MAIN ] Derivative Progress: 249/2075 symbols completed. BLND took 1.1s. Estimated remaining: 11m 53s. Rate: 153.6 symbols/min [2025-09-18T22:48:42.277105] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:42.295889] [DEBUG] [LOCAL ] BLX: Loaded 16165 existing records from primary storage. [2025-09-18T22:48:42.296036] [INFO ] [MAIN ] BLX: Loaded 16165 primary data records. [2025-09-18T22:48:42.412122] [DEBUG] [LOCAL ] BME: Loaded 10989 existing records from primary storage. [2025-09-18T22:48:42.425704] [INFO ] [MAIN ] BME: Loaded 10989 primary data records. [2025-09-18T22:48:42.474036] [DEBUG] [LOCAL ] BMA: Loaded 34794 existing records from primary storage. [2025-09-18T22:48:42.491476] [INFO ] [MAIN ] BMA: Loaded 34794 primary data records. [2025-09-18T22:48:43.293567] [DEBUG] [MAIN ] BLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:43.294746] [INFO ] [MAIN ] BLX: Generated 1807 derivative records from 16165 primary records. [2025-09-18T22:48:43.295130] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-09-18T22:48:43.317451] [DEBUG] [LOCAL ] BLX: Derivative data saved (1807 records). [2025-09-18T22:48:43.317605] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-09-18T22:48:43.319953] [INFO ] [MAIN ] Derivative Progress: 250/2075 symbols completed. BLX took 1.1s. Estimated remaining: 11m 58s. Rate: 152.5 symbols/min [2025-09-18T22:48:43.346450] [DEBUG] [MAIN ] BMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:43.346557] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:43.347173] [DEBUG] [MAIN ] BME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:43.348062] [INFO ] [MAIN ] BME: Generated 1807 derivative records from 10989 primary records. [2025-09-18T22:48:43.348985] [INFO ] [MAIN ] BMA: Generated 1807 derivative records from 34794 primary records. [2025-09-18T22:48:43.349260] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-09-18T22:48:43.349315] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-09-18T22:48:43.378552] [DEBUG] [LOCAL ] BMA: Derivative data saved (1807 records). [2025-09-18T22:48:43.379580] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-09-18T22:48:43.382679] [INFO ] [MAIN ] Derivative Progress: 251/2075 symbols completed. BMA took 1.1s. Estimated remaining: 11m 55s. Rate: 153.0 symbols/min [2025-09-18T22:48:43.384491] [DEBUG] [LOCAL ] BME: Derivative data saved (1807 records). [2025-09-18T22:48:43.384721] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:43.384660] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-09-18T22:48:43.387774] [INFO ] [MAIN ] Derivative Progress: 252/2075 symbols completed. BME took 1.1s. Estimated remaining: 11m 52s. Rate: 153.7 symbols/min [2025-09-18T22:48:43.388173] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:43.401058] [DEBUG] [LOCAL ] BMN: Loaded 2590 existing records from primary storage. [2025-09-18T22:48:43.401241] [INFO ] [MAIN ] BMN: Loaded 2590 primary data records. [2025-09-18T22:48:43.475552] [DEBUG] [LOCAL ] BMEZ: Loaded 26386 existing records from primary storage. [2025-09-18T22:48:43.504151] [INFO ] [MAIN ] BMEZ: Loaded 26386 primary data records. [2025-09-18T22:48:43.614199] [DEBUG] [LOCAL ] BMI: Loaded 24204 existing records from primary storage. [2025-09-18T22:48:43.630397] [INFO ] [MAIN ] BMI: Loaded 24204 primary data records. [2025-09-18T22:48:44.426867] [DEBUG] [MAIN ] BMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:44.439962] [INFO ] [MAIN ] BMN: Generated 1807 derivative records from 2590 primary records. [2025-09-18T22:48:44.440471] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-09-18T22:48:44.442675] [DEBUG] [MAIN ] BMEZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:44.443745] [INFO ] [MAIN ] BMEZ: Generated 1807 derivative records from 26386 primary records. [2025-09-18T22:48:44.452000] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-09-18T22:48:44.472990] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1807 records). [2025-09-18T22:48:44.473184] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-09-18T22:48:44.483354] [INFO ] [MAIN ] Derivative Progress: 253/2075 symbols completed. BMEZ took 1.1s. Estimated remaining: 11m 57s. Rate: 152.6 symbols/min [2025-09-18T22:48:44.490894] [DEBUG] [LOCAL ] BMN: Derivative data saved (1807 records). [2025-09-18T22:48:44.490836] [DEBUG] [MAIN ] BMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:44.491607] [INFO ] [MAIN ] BMI: Generated 1807 derivative records from 24204 primary records. [2025-09-18T22:48:44.491691] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-09-18T22:48:44.493889] [INFO ] [MAIN ] Derivative Progress: 254/2075 symbols completed. BMN took 1.1s. Estimated remaining: 11m 53s. Rate: 153.1 symbols/min [2025-09-18T22:48:44.493975] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-09-18T22:48:44.509573] [DEBUG] [LOCAL ] BMI: Derivative data saved (1807 records). [2025-09-18T22:48:44.509635] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-09-18T22:48:44.512851] [INFO ] [MAIN ] Derivative Progress: 255/2075 symbols completed. BMI took 1.1s. Estimated remaining: 11m 50s. Rate: 153.7 symbols/min [2025-09-18T22:48:44.513412] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:44.513606] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:44.513820] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:44.589288] [DEBUG] [LOCAL ] BN: Loaded 53396 existing records from primary storage. [2025-09-18T22:48:44.600714] [INFO ] [MAIN ] BN: Loaded 53396 primary data records. [2025-09-18T22:48:44.622238] [DEBUG] [LOCAL ] BMO: Loaded 41787 existing records from primary storage. [2025-09-18T22:48:44.632679] [INFO ] [MAIN ] BMO: Loaded 41787 primary data records. [2025-09-18T22:48:44.761794] [DEBUG] [LOCAL ] BMY: Loaded 54147 existing records from primary storage. [2025-09-18T22:48:44.802047] [INFO ] [MAIN ] BMY: Loaded 54147 primary data records. [2025-09-18T22:48:45.563597] [DEBUG] [MAIN ] BN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:45.564691] [INFO ] [MAIN ] BN: Generated 1807 derivative records from 53396 primary records. [2025-09-18T22:48:45.564908] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-09-18T22:48:45.598414] [DEBUG] [MAIN ] BMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:45.611489] [DEBUG] [LOCAL ] BN: Derivative data saved (1807 records). [2025-09-18T22:48:45.611618] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-09-18T22:48:45.611914] [DEBUG] [MAIN ] BMY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:45.612623] [INFO ] [MAIN ] BMO: Generated 1807 derivative records from 41787 primary records. [2025-09-18T22:48:45.613361] [INFO ] [MAIN ] BMY: Generated 1807 derivative records from 54147 primary records. [2025-09-18T22:48:45.612793] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-09-18T22:48:45.615683] [INFO ] [MAIN ] Derivative Progress: 256/2075 symbols completed. BN took 1.1s. Estimated remaining: 11m 55s. Rate: 152.6 symbols/min [2025-09-18T22:48:45.616542] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:45.616196] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-09-18T22:48:45.646929] [DEBUG] [LOCAL ] BMO: Derivative data saved (1807 records). [2025-09-18T22:48:45.647553] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-09-18T22:48:45.650607] [INFO ] [MAIN ] Derivative Progress: 257/2075 symbols completed. BMO took 1.1s. Estimated remaining: 11m 52s. Rate: 153.2 symbols/min [2025-09-18T22:48:45.651899] [DEBUG] [LOCAL ] BMY: Derivative data saved (1807 records). [2025-09-18T22:48:45.652167] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-09-18T22:48:45.652233] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:45.654912] [INFO ] [MAIN ] Derivative Progress: 258/2075 symbols completed. BMY took 1.1s. Estimated remaining: 11m 49s. Rate: 153.8 symbols/min [2025-09-18T22:48:45.655451] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:45.660273] [DEBUG] [LOCAL ] BNJ: Loaded 2643 existing records from primary storage. [2025-09-18T22:48:45.660449] [INFO ] [MAIN ] BNJ: Loaded 2643 primary data records. [2025-09-18T22:48:45.782951] [DEBUG] [LOCAL ] BNED: Loaded 30247 existing records from primary storage. [2025-09-18T22:48:45.786504] [INFO ] [MAIN ] BNED: Loaded 30247 primary data records. [2025-09-18T22:48:45.782253] [DEBUG] [LOCAL ] BNH: Loaded 4853 existing records from primary storage. [2025-09-18T22:48:45.786723] [INFO ] [MAIN ] BNH: Loaded 4853 primary data records. [2025-09-18T22:48:46.676769] [DEBUG] [MAIN ] BNJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:46.678674] [INFO ] [MAIN ] BNJ: Generated 1807 derivative records from 2643 primary records. [2025-09-18T22:48:46.679984] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-09-18T22:48:46.708358] [DEBUG] [MAIN ] BNED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:46.711044] [INFO ] [MAIN ] BNED: Generated 1807 derivative records from 30247 primary records. [2025-09-18T22:48:46.711191] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-09-18T22:48:46.725423] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1807 records). [2025-09-18T22:48:46.736202] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-09-18T22:48:46.739534] [INFO ] [MAIN ] Derivative Progress: 259/2075 symbols completed. BNJ took 1.1s. Estimated remaining: 11m 53s. Rate: 152.7 symbols/min [2025-09-18T22:48:46.737521] [DEBUG] [MAIN ] BNH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:46.741237] [INFO ] [MAIN ] BNH: Generated 1807 derivative records from 4853 primary records. [2025-09-18T22:48:46.744063] [DEBUG] [LOCAL ] BNED: Derivative data saved (1807 records). [2025-09-18T22:48:46.744308] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:46.744472] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-09-18T22:48:46.744558] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-09-18T22:48:46.748149] [INFO ] [MAIN ] Derivative Progress: 260/2075 symbols completed. BNED took 1.1s. Estimated remaining: 11m 50s. Rate: 153.3 symbols/min [2025-09-18T22:48:46.748989] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:46.765305] [DEBUG] [LOCAL ] BNH: Derivative data saved (1807 records). [2025-09-18T22:48:46.765632] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-09-18T22:48:46.768507] [INFO ] [MAIN ] Derivative Progress: 261/2075 symbols completed. BNH took 1.1s. Estimated remaining: 11m 47s. Rate: 153.9 symbols/min [2025-09-18T22:48:46.768876] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:46.775815] [DEBUG] [LOCAL ] BNT: Loaded 3411 existing records from primary storage. [2025-09-18T22:48:46.775997] [INFO ] [MAIN ] BNT: Loaded 3411 primary data records. [2025-09-18T22:48:47.143290] [DEBUG] [LOCAL ] BNS: Loaded 51882 existing records from primary storage. [2025-09-18T22:48:47.144025] [INFO ] [MAIN ] BNS: Loaded 51882 primary data records. [2025-09-18T22:48:47.150526] [DEBUG] [LOCAL ] BNL: Loaded 47287 existing records from primary storage. [2025-09-18T22:48:47.182444] [INFO ] [MAIN ] BNL: Loaded 47287 primary data records. [2025-09-18T22:48:47.803270] [DEBUG] [MAIN ] BNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:47.806139] [INFO ] [MAIN ] BNT: Generated 1807 derivative records from 3411 primary records. [2025-09-18T22:48:47.806359] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-09-18T22:48:47.823535] [DEBUG] [LOCAL ] BNT: Derivative data saved (1807 records). [2025-09-18T22:48:47.824057] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-09-18T22:48:47.826636] [INFO ] [MAIN ] Derivative Progress: 262/2075 symbols completed. BNT took 1.1s. Estimated remaining: 11m 52s. Rate: 152.9 symbols/min [2025-09-18T22:48:47.829089] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:47.847180] [DEBUG] [MAIN ] BNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:47.848196] [INFO ] [MAIN ] BNS: Generated 1807 derivative records from 51882 primary records. [2025-09-18T22:48:47.848942] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-09-18T22:48:47.854778] [DEBUG] [LOCAL ] BNY: Loaded 7463 existing records from primary storage. [2025-09-18T22:48:47.862730] [INFO ] [MAIN ] BNY: Loaded 7463 primary data records. [2025-09-18T22:48:47.959297] [DEBUG] [MAIN ] BNL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:47.971102] [INFO ] [MAIN ] BNL: Generated 1807 derivative records from 47287 primary records. [2025-09-18T22:48:47.965182] [DEBUG] [LOCAL ] BNS: Derivative data saved (1807 records). [2025-09-18T22:48:47.984726] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-09-18T22:48:47.990051] [INFO ] [MAIN ] Derivative Progress: 263/2075 symbols completed. BNS took 1.2s. Estimated remaining: 11m 50s. Rate: 153.2 symbols/min [2025-09-18T22:48:47.977048] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-09-18T22:48:48.002377] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:48.088436] [DEBUG] [LOCAL ] BNL: Derivative data saved (1807 records). [2025-09-18T22:48:48.205811] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-09-18T22:48:48.209060] [INFO ] [MAIN ] Derivative Progress: 264/2075 symbols completed. BNL took 1.5s. Estimated remaining: 11m 48s. Rate: 153.4 symbols/min [2025-09-18T22:48:48.209391] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:48.236250] [DEBUG] [LOCAL ] BOC: Loaded 18551 existing records from primary storage. [2025-09-18T22:48:48.236466] [INFO ] [MAIN ] BOC: Loaded 18551 primary data records. [2025-09-18T22:48:48.300909] [DEBUG] [LOCAL ] BOE: Loaded 17840 existing records from primary storage. [2025-09-18T22:48:48.313196] [INFO ] [MAIN ] BOE: Loaded 17840 primary data records. [2025-09-18T22:48:48.799527] [DEBUG] [MAIN ] BNY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:48.932318] [INFO ] [MAIN ] BNY: Generated 1807 derivative records from 7463 primary records. [2025-09-18T22:48:48.946320] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-09-18T22:48:48.968966] [DEBUG] [LOCAL ] BNY: Derivative data saved (1807 records). [2025-09-18T22:48:48.969573] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-09-18T22:48:48.971756] [INFO ] [MAIN ] Derivative Progress: 265/2075 symbols completed. BNY took 1.1s. Estimated remaining: 11m 50s. Rate: 152.9 symbols/min [2025-09-18T22:48:48.972213] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:48.994001] [DEBUG] [MAIN ] BOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:48.995191] [INFO ] [MAIN ] BOC: Generated 1807 derivative records from 18551 primary records. [2025-09-18T22:48:48.995287] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-09-18T22:48:49.041712] [DEBUG] [MAIN ] BOE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:49.043849] [INFO ] [MAIN ] BOE: Generated 1807 derivative records from 17840 primary records. [2025-09-18T22:48:49.043072] [DEBUG] [LOCAL ] BOC: Derivative data saved (1807 records). [2025-09-18T22:48:49.043980] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-09-18T22:48:49.044148] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-09-18T22:48:49.048035] [INFO ] [MAIN ] Derivative Progress: 266/2075 symbols completed. BOC took 1.1s. Estimated remaining: 11m 48s. Rate: 153.4 symbols/min [2025-09-18T22:48:49.068404] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:49.070507] [DEBUG] [LOCAL ] BOH: Loaded 31739 existing records from primary storage. [2025-09-18T22:48:49.071526] [INFO ] [MAIN ] BOH: Loaded 31739 primary data records. [2025-09-18T22:48:49.110501] [DEBUG] [LOCAL ] BOE: Derivative data saved (1807 records). [2025-09-18T22:48:49.143735] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-09-18T22:48:49.176267] [INFO ] [MAIN ] Derivative Progress: 267/2075 symbols completed. BOE took 1.0s. Estimated remaining: 11m 46s. Rate: 153.8 symbols/min [2025-09-18T22:48:49.187898] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:49.389500] [DEBUG] [LOCAL ] BOND: Loaded 32453 existing records from primary storage. [2025-09-18T22:48:49.404419] [INFO ] [MAIN ] BOND: Loaded 32453 primary data records. [2025-09-18T22:48:49.577533] [DEBUG] [LOCAL ] BOOT: Loaded 41664 existing records from primary storage. [2025-09-18T22:48:49.617842] [INFO ] [MAIN ] BOOT: Loaded 41664 primary data records. [2025-09-18T22:48:50.079365] [DEBUG] [MAIN ] BOH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:50.080214] [INFO ] [MAIN ] BOH: Generated 1807 derivative records from 31739 primary records. [2025-09-18T22:48:50.080323] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-09-18T22:48:50.100796] [DEBUG] [LOCAL ] BOH: Derivative data saved (1807 records). [2025-09-18T22:48:50.103270] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-09-18T22:48:50.105876] [INFO ] [MAIN ] Derivative Progress: 268/2075 symbols completed. BOH took 1.1s. Estimated remaining: 11m 49s. Rate: 153.0 symbols/min [2025-09-18T22:48:50.118962] [DEBUG] [MAIN ] BOND: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:48:50.119692] [INFO ] [MAIN ] BOND: Generated 1806 derivative records from 32453 primary records. [2025-09-18T22:48:50.120009] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-09-18T22:48:50.136947] [DEBUG] [LOCAL ] BOND: Derivative data saved (1806 records). [2025-09-18T22:48:50.137169] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-09-18T22:48:50.139810] [INFO ] [MAIN ] Derivative Progress: 269/2075 symbols completed. BOND took 1.1s. Estimated remaining: 11m 46s. Rate: 153.5 symbols/min [2025-09-18T22:48:50.155922] [DEBUG] [MAIN ] BOOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:50.156436] [INFO ] [MAIN ] BOOT: Generated 1807 derivative records from 41664 primary records. [2025-09-18T22:48:50.156495] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-09-18T22:48:50.172108] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1807 records). [2025-09-18T22:48:50.172170] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-09-18T22:48:50.174999] [INFO ] [MAIN ] Derivative Progress: 270/2075 symbols completed. BOOT took 1.0s. Estimated remaining: 11m 43s. Rate: 154.0 symbols/min [2025-09-18T22:48:50.175596] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:50.175544] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:50.175871] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:50.200691] [DEBUG] [LOCAL ] BOW: Loaded 23934 existing records from primary storage. [2025-09-18T22:48:50.200837] [INFO ] [MAIN ] BOW: Loaded 23934 primary data records. [2025-09-18T22:48:50.619603] [DEBUG] [LOCAL ] BORR: Loaded 51586 existing records from primary storage. [2025-09-18T22:48:50.620482] [DEBUG] [LOCAL ] BOX: Loaded 50755 existing records from primary storage. [2025-09-18T22:48:50.620678] [INFO ] [MAIN ] BOX: Loaded 50755 primary data records. [2025-09-18T22:48:50.620603] [INFO ] [MAIN ] BORR: Loaded 51586 primary data records. [2025-09-18T22:48:51.269819] [DEBUG] [MAIN ] BOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:51.272330] [INFO ] [MAIN ] BOW: Generated 1807 derivative records from 23934 primary records. [2025-09-18T22:48:51.272620] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-09-18T22:48:51.293473] [DEBUG] [LOCAL ] BOW: Derivative data saved (1807 records). [2025-09-18T22:48:51.293823] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-09-18T22:48:51.299416] [INFO ] [MAIN ] Derivative Progress: 271/2075 symbols completed. BOW took 1.1s. Estimated remaining: 11m 48s. Rate: 152.9 symbols/min [2025-09-18T22:48:51.300757] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:51.318082] [DEBUG] [MAIN ] BORR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:51.319190] [INFO ] [MAIN ] BORR: Generated 1807 derivative records from 51586 primary records. [2025-09-18T22:48:51.319469] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-09-18T22:48:51.334350] [DEBUG] [MAIN ] BOX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:51.342576] [INFO ] [MAIN ] BOX: Generated 1807 derivative records from 50755 primary records. [2025-09-18T22:48:51.342784] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-09-18T22:48:51.361195] [DEBUG] [LOCAL ] BORR: Derivative data saved (1807 records). [2025-09-18T22:48:51.365761] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-09-18T22:48:51.368498] [INFO ] [MAIN ] Derivative Progress: 272/2075 symbols completed. BORR took 1.2s. Estimated remaining: 11m 45s. Rate: 153.4 symbols/min [2025-09-18T22:48:51.370044] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:51.375728] [DEBUG] [LOCAL ] BOX: Derivative data saved (1807 records). [2025-09-18T22:48:51.376030] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-09-18T22:48:51.378117] [INFO ] [MAIN ] Derivative Progress: 273/2075 symbols completed. BOX took 1.2s. Estimated remaining: 11m 42s. Rate: 154.0 symbols/min [2025-09-18T22:48:51.378520] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:51.417139] [DEBUG] [LOCAL ] BP: Loaded 54101 existing records from primary storage. [2025-09-18T22:48:51.417377] [INFO ] [MAIN ] BP: Loaded 54101 primary data records. [2025-09-18T22:48:51.560552] [DEBUG] [LOCAL ] BRC: Loaded 19955 existing records from primary storage. [2025-09-18T22:48:51.571623] [INFO ] [MAIN ] BRC: Loaded 19955 primary data records. [2025-09-18T22:48:51.691248] [DEBUG] [LOCAL ] BRBR: Loaded 51577 existing records from primary storage. [2025-09-18T22:48:51.731829] [INFO ] [MAIN ] BRBR: Loaded 51577 primary data records. [2025-09-18T22:48:52.476506] [DEBUG] [MAIN ] BP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:52.477410] [INFO ] [MAIN ] BP: Generated 1807 derivative records from 54101 primary records. [2025-09-18T22:48:52.478451] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-09-18T22:48:52.509673] [DEBUG] [MAIN ] BRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:52.511003] [DEBUG] [LOCAL ] BP: Derivative data saved (1807 records). [2025-09-18T22:48:52.511183] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-09-18T22:48:52.511947] [INFO ] [MAIN ] BRC: Generated 1807 derivative records from 19955 primary records. [2025-09-18T22:48:52.514177] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-09-18T22:48:52.514111] [INFO ] [MAIN ] Derivative Progress: 274/2075 symbols completed. BP took 1.2s. Estimated remaining: 11m 47s. Rate: 152.9 symbols/min [2025-09-18T22:48:52.517731] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:52.547618] [DEBUG] [MAIN ] BRBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:52.548423] [INFO ] [MAIN ] BRBR: Generated 1807 derivative records from 51577 primary records. [2025-09-18T22:48:52.547292] [DEBUG] [LOCAL ] BRC: Derivative data saved (1807 records). [2025-09-18T22:48:52.548711] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-09-18T22:48:52.548795] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-09-18T22:48:52.551817] [INFO ] [MAIN ] Derivative Progress: 275/2075 symbols completed. BRC took 1.2s. Estimated remaining: 11m 44s. Rate: 153.4 symbols/min [2025-09-18T22:48:52.552427] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:52.570259] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1807 records). [2025-09-18T22:48:52.570475] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-09-18T22:48:52.573377] [INFO ] [MAIN ] Derivative Progress: 276/2075 symbols completed. BRBR took 1.2s. Estimated remaining: 11m 41s. Rate: 153.9 symbols/min [2025-09-18T22:48:52.573736] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:52.593961] [DEBUG] [LOCAL ] BRT: Loaded 4864 existing records from primary storage. [2025-09-18T22:48:52.594102] [INFO ] [MAIN ] BRT: Loaded 4864 primary data records. [2025-09-18T22:48:52.713563] [DEBUG] [LOCAL ] BRCC: Loaded 40797 existing records from primary storage. [2025-09-18T22:48:52.719340] [INFO ] [MAIN ] BRCC: Loaded 40797 primary data records. [2025-09-18T22:48:53.073210] [DEBUG] [LOCAL ] BRO: Loaded 52306 existing records from primary storage. [2025-09-18T22:48:53.092107] [INFO ] [MAIN ] BRO: Loaded 52306 primary data records. [2025-09-18T22:48:53.613746] [DEBUG] [MAIN ] BRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:53.615630] [INFO ] [MAIN ] BRT: Generated 1807 derivative records from 4864 primary records. [2025-09-18T22:48:53.617675] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-09-18T22:48:53.653277] [DEBUG] [MAIN ] BRCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:53.655099] [INFO ] [MAIN ] BRCC: Generated 1807 derivative records from 40797 primary records. [2025-09-18T22:48:53.655376] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-09-18T22:48:53.676424] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1807 records). [2025-09-18T22:48:53.677567] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-09-18T22:48:53.677491] [DEBUG] [LOCAL ] BRT: Derivative data saved (1807 records). [2025-09-18T22:48:53.679890] [INFO ] [MAIN ] Derivative Progress: 277/2075 symbols completed. BRCC took 1.2s. Estimated remaining: 11m 46s. Rate: 152.9 symbols/min [2025-09-18T22:48:53.680209] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-09-18T22:48:53.685042] [INFO ] [MAIN ] Derivative Progress: 278/2075 symbols completed. BRT took 1.1s. Estimated remaining: 11m 43s. Rate: 153.4 symbols/min [2025-09-18T22:48:53.683836] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:53.685725] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:53.702601] [DEBUG] [MAIN ] BRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:53.703566] [INFO ] [MAIN ] BRO: Generated 1807 derivative records from 52306 primary records. [2025-09-18T22:48:53.703724] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-09-18T22:48:53.735370] [DEBUG] [LOCAL ] BRO: Derivative data saved (1807 records). [2025-09-18T22:48:53.736095] [DEBUG] [LOCAL ] BRW: Loaded 19407 existing records from primary storage. [2025-09-18T22:48:53.736283] [INFO ] [MAIN ] BRW: Loaded 19407 primary data records. [2025-09-18T22:48:53.736504] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-09-18T22:48:53.753626] [INFO ] [MAIN ] Derivative Progress: 279/2075 symbols completed. BRO took 1.2s. Estimated remaining: 11m 40s. Rate: 153.9 symbols/min [2025-09-18T22:48:53.780902] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:54.104217] [DEBUG] [LOCAL ] BRX: Loaded 52216 existing records from primary storage. [2025-09-18T22:48:54.104677] [INFO ] [MAIN ] BRX: Loaded 52216 primary data records. [2025-09-18T22:48:54.211639] [DEBUG] [LOCAL ] BSBR: Loaded 35306 existing records from primary storage. [2025-09-18T22:48:54.225478] [INFO ] [MAIN ] BSBR: Loaded 35306 primary data records. [2025-09-18T22:48:54.818253] [DEBUG] [MAIN ] BRW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:54.819934] [INFO ] [MAIN ] BRW: Generated 1807 derivative records from 19407 primary records. [2025-09-18T22:48:54.820089] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-09-18T22:48:54.838048] [DEBUG] [LOCAL ] BRW: Derivative data saved (1807 records). [2025-09-18T22:48:54.838196] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-09-18T22:48:54.841071] [INFO ] [MAIN ] Derivative Progress: 280/2075 symbols completed. BRW took 1.2s. Estimated remaining: 11m 44s. Rate: 152.9 symbols/min [2025-09-18T22:48:54.841594] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:54.862549] [DEBUG] [MAIN ] BRX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:54.863366] [INFO ] [MAIN ] BRX: Generated 1807 derivative records from 52216 primary records. [2025-09-18T22:48:54.866989] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-09-18T22:48:54.867220] [DEBUG] [LOCAL ] BSL: Loaded 8070 existing records from primary storage. [2025-09-18T22:48:54.868344] [INFO ] [MAIN ] BSL: Loaded 8070 primary data records. [2025-09-18T22:48:55.031131] [DEBUG] [MAIN ] BSBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:55.025729] [DEBUG] [LOCAL ] BRX: Derivative data saved (1807 records). [2025-09-18T22:48:55.058399] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-09-18T22:48:55.069388] [INFO ] [MAIN ] BSBR: Generated 1807 derivative records from 35306 primary records. [2025-09-18T22:48:55.089677] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-09-18T22:48:55.092094] [INFO ] [MAIN ] Derivative Progress: 281/2075 symbols completed. BRX took 1.4s. Estimated remaining: 11m 43s. Rate: 153.1 symbols/min [2025-09-18T22:48:55.213996] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:55.234228] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1807 records). [2025-09-18T22:48:55.235358] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-09-18T22:48:55.238099] [INFO ] [MAIN ] Derivative Progress: 282/2075 symbols completed. BSBR took 1.5s. Estimated remaining: 11m 41s. Rate: 153.5 symbols/min [2025-09-18T22:48:55.238600] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:55.266374] [DEBUG] [MAIN ] BSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:55.267199] [INFO ] [MAIN ] BSL: Generated 1807 derivative records from 8070 primary records. [2025-09-18T22:48:55.267409] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-09-18T22:48:55.302743] [DEBUG] [LOCAL ] BSM: Loaded 32852 existing records from primary storage. [2025-09-18T22:48:55.303760] [INFO ] [MAIN ] BSM: Loaded 32852 primary data records. [2025-09-18T22:48:55.311395] [DEBUG] [LOCAL ] BSL: Derivative data saved (1807 records). [2025-09-18T22:48:55.347572] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-09-18T22:48:55.354780] [DEBUG] [LOCAL ] BSTZ: Loaded 25254 existing records from primary storage. [2025-09-18T22:48:55.369141] [INFO ] [MAIN ] Derivative Progress: 283/2075 symbols completed. BSL took 0.5s. Estimated remaining: 11m 39s. Rate: 153.8 symbols/min [2025-09-18T22:48:55.378132] [INFO ] [MAIN ] BSTZ: Loaded 25254 primary data records. [2025-09-18T22:48:55.948852] [DEBUG] [MAIN ] BSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:55.949735] [INFO ] [MAIN ] BSM: Generated 1807 derivative records from 32852 primary records. [2025-09-18T22:48:55.961809] [DEBUG] [MAIN ] BSTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:55.961873] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-09-18T22:48:55.962474] [INFO ] [MAIN ] BSTZ: Generated 1807 derivative records from 25254 primary records. [2025-09-18T22:48:55.962578] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-09-18T22:48:55.994211] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1807 records). [2025-09-18T22:48:55.994302] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-09-18T22:48:55.994148] [DEBUG] [LOCAL ] BSM: Derivative data saved (1807 records). [2025-09-18T22:48:55.996588] [INFO ] [MAIN ] Derivative Progress: 284/2075 symbols completed. BSTZ took 0.8s. Estimated remaining: 11m 40s. Rate: 153.5 symbols/min [2025-09-18T22:48:55.996721] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-09-18T22:48:55.999095] [INFO ] [MAIN ] Derivative Progress: 285/2075 symbols completed. BSM took 0.8s. Estimated remaining: 11m 37s. Rate: 154.0 symbols/min [2025-09-18T22:48:55.999688] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:55.999982] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:55.999867] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:56.008159] [DEBUG] [LOCAL ] BTA: Loaded 5346 existing records from primary storage. [2025-09-18T22:48:56.008287] [INFO ] [MAIN ] BTA: Loaded 5346 primary data records. [2025-09-18T22:48:56.113119] [DEBUG] [LOCAL ] BTCM: Loaded 14279 existing records from primary storage. [2025-09-18T22:48:56.132047] [INFO ] [MAIN ] BTCM: Loaded 14279 primary data records. [2025-09-18T22:48:56.487934] [DEBUG] [LOCAL ] BSX: Loaded 54078 existing records from primary storage. [2025-09-18T22:48:56.499031] [INFO ] [MAIN ] BSX: Loaded 54078 primary data records. [2025-09-18T22:48:57.043896] [DEBUG] [MAIN ] BTA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:57.045379] [INFO ] [MAIN ] BTA: Generated 1807 derivative records from 5346 primary records. [2025-09-18T22:48:57.045849] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-09-18T22:48:57.076204] [DEBUG] [MAIN ] BTCM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:57.078123] [INFO ] [MAIN ] BTCM: Generated 1807 derivative records from 14279 primary records. [2025-09-18T22:48:57.078618] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-09-18T22:48:57.092804] [DEBUG] [LOCAL ] BTA: Derivative data saved (1807 records). [2025-09-18T22:48:57.094126] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-09-18T22:48:57.096817] [INFO ] [MAIN ] Derivative Progress: 286/2075 symbols completed. BTA took 1.1s. Estimated remaining: 11m 41s. Rate: 153.1 symbols/min [2025-09-18T22:48:57.101070] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1807 records). [2025-09-18T22:48:57.097079] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:57.101777] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-09-18T22:48:57.105993] [INFO ] [MAIN ] Derivative Progress: 287/2075 symbols completed. BTCM took 1.1s. Estimated remaining: 11m 39s. Rate: 153.6 symbols/min [2025-09-18T22:48:57.106565] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:57.121747] [DEBUG] [MAIN ] BSX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:57.122841] [INFO ] [MAIN ] BSX: Generated 1807 derivative records from 54078 primary records. [2025-09-18T22:48:57.122978] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-09-18T22:48:57.144070] [DEBUG] [LOCAL ] BSX: Derivative data saved (1807 records). [2025-09-18T22:48:57.144255] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-09-18T22:48:57.147494] [INFO ] [MAIN ] Derivative Progress: 288/2075 symbols completed. BSX took 1.1s. Estimated remaining: 11m 36s. Rate: 154.1 symbols/min [2025-09-18T22:48:57.147927] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:57.173864] [DEBUG] [LOCAL ] BTO: Loaded 9115 existing records from primary storage. [2025-09-18T22:48:57.174058] [INFO ] [MAIN ] BTO: Loaded 9115 primary data records. [2025-09-18T22:48:57.310363] [DEBUG] [LOCAL ] BTI: Loaded 53942 existing records from primary storage. [2025-09-18T22:48:57.314552] [INFO ] [MAIN ] BTI: Loaded 53942 primary data records. [2025-09-18T22:48:57.391558] [DEBUG] [LOCAL ] BTE: Loaded 53147 existing records from primary storage. [2025-09-18T22:48:57.408149] [INFO ] [MAIN ] BTE: Loaded 53147 primary data records. [2025-09-18T22:48:58.215607] [DEBUG] [MAIN ] BTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:58.215872] [DEBUG] [MAIN ] BTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:58.218384] [INFO ] [MAIN ] BTI: Generated 1807 derivative records from 53942 primary records. [2025-09-18T22:48:58.219398] [INFO ] [MAIN ] BTO: Generated 1807 derivative records from 9115 primary records. [2025-09-18T22:48:58.219530] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-09-18T22:48:58.220185] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-09-18T22:48:58.254581] [DEBUG] [MAIN ] BTE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:58.260175] [INFO ] [MAIN ] BTE: Generated 1807 derivative records from 53147 primary records. [2025-09-18T22:48:58.263291] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-09-18T22:48:58.259280] [DEBUG] [LOCAL ] BTI: Derivative data saved (1807 records). [2025-09-18T22:48:58.274883] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-09-18T22:48:58.282310] [DEBUG] [LOCAL ] BTO: Derivative data saved (1807 records). [2025-09-18T22:48:58.284056] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-09-18T22:48:58.279630] [INFO ] [MAIN ] Derivative Progress: 289/2075 symbols completed. BTI took 1.2s. Estimated remaining: 11m 40s. Rate: 153.0 symbols/min [2025-09-18T22:48:58.287359] [INFO ] [MAIN ] Derivative Progress: 290/2075 symbols completed. BTO took 1.1s. Estimated remaining: 11m 37s. Rate: 153.6 symbols/min [2025-09-18T22:48:58.287711] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:58.289758] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:58.292205] [DEBUG] [LOCAL ] BTE: Derivative data saved (1807 records). [2025-09-18T22:48:58.292278] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-09-18T22:48:58.295225] [INFO ] [MAIN ] Derivative Progress: 291/2075 symbols completed. BTE took 1.2s. Estimated remaining: 11m 35s. Rate: 154.1 symbols/min [2025-09-18T22:48:58.295693] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:58.312439] [DEBUG] [LOCAL ] BTT: Loaded 16236 existing records from primary storage. [2025-09-18T22:48:58.312592] [INFO ] [MAIN ] BTT: Loaded 16236 primary data records. [2025-09-18T22:48:58.457204] [DEBUG] [LOCAL ] BTZ: Loaded 23255 existing records from primary storage. [2025-09-18T22:48:58.469734] [INFO ] [MAIN ] BTZ: Loaded 23255 primary data records. [2025-09-18T22:48:58.815845] [DEBUG] [LOCAL ] BTU: Loaded 53692 existing records from primary storage. [2025-09-18T22:48:58.820439] [INFO ] [MAIN ] BTU: Loaded 53692 primary data records. [2025-09-18T22:48:59.369289] [DEBUG] [MAIN ] BTT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:59.371326] [INFO ] [MAIN ] BTT: Generated 1807 derivative records from 16236 primary records. [2025-09-18T22:48:59.371983] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-09-18T22:48:59.391064] [DEBUG] [LOCAL ] BTT: Derivative data saved (1807 records). [2025-09-18T22:48:59.391571] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-09-18T22:48:59.394178] [INFO ] [MAIN ] Derivative Progress: 292/2075 symbols completed. BTT took 1.1s. Estimated remaining: 11m 39s. Rate: 153.1 symbols/min [2025-09-18T22:48:59.397055] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:59.412467] [DEBUG] [MAIN ] BTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:59.413669] [INFO ] [MAIN ] BTZ: Generated 1807 derivative records from 23255 primary records. [2025-09-18T22:48:59.413835] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-09-18T22:48:59.446499] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1807 records). [2025-09-18T22:48:59.446014] [DEBUG] [MAIN ] BTU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:48:59.447406] [INFO ] [MAIN ] BTU: Generated 1807 derivative records from 53692 primary records. [2025-09-18T22:48:59.447587] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-09-18T22:48:59.447526] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-09-18T22:48:59.450610] [INFO ] [MAIN ] Derivative Progress: 293/2075 symbols completed. BTZ took 1.2s. Estimated remaining: 11m 36s. Rate: 153.6 symbols/min [2025-09-18T22:48:59.451073] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:59.484743] [DEBUG] [LOCAL ] BTU: Derivative data saved (1807 records). [2025-09-18T22:48:59.484933] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-09-18T22:48:59.488379] [INFO ] [MAIN ] Derivative Progress: 294/2075 symbols completed. BTU took 1.2s. Estimated remaining: 11m 34s. Rate: 154.1 symbols/min [2025-09-18T22:48:59.493754] [DEBUG] [LOCAL ] BUI: Loaded 11572 existing records from primary storage. [2025-09-18T22:48:59.494091] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:48:59.494172] [INFO ] [MAIN ] BUI: Loaded 11572 primary data records. [2025-09-18T22:48:59.622022] [DEBUG] [LOCAL ] BUD: Loaded 53148 existing records from primary storage. [2025-09-18T22:48:59.628086] [INFO ] [MAIN ] BUD: Loaded 53148 primary data records. [2025-09-18T22:49:00.019536] [DEBUG] [LOCAL ] BUR: Loaded 45435 existing records from primary storage. [2025-09-18T22:49:00.020150] [INFO ] [MAIN ] BUR: Loaded 45435 primary data records. [2025-09-18T22:49:00.558703] [DEBUG] [MAIN ] BUI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:00.560024] [INFO ] [MAIN ] BUI: Generated 1807 derivative records from 11572 primary records. [2025-09-18T22:49:00.560289] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-09-18T22:49:00.580407] [DEBUG] [LOCAL ] BUI: Derivative data saved (1807 records). [2025-09-18T22:49:00.581398] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-09-18T22:49:00.583605] [INFO ] [MAIN ] Derivative Progress: 295/2075 symbols completed. BUI took 1.1s. Estimated remaining: 11m 38s. Rate: 153.1 symbols/min [2025-09-18T22:49:00.584203] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:00.598160] [DEBUG] [MAIN ] BUD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:00.598910] [INFO ] [MAIN ] BUD: Generated 1807 derivative records from 53148 primary records. [2025-09-18T22:49:00.599095] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-09-18T22:49:00.617681] [DEBUG] [LOCAL ] BUD: Derivative data saved (1807 records). [2025-09-18T22:49:00.617833] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-09-18T22:49:00.620138] [INFO ] [MAIN ] Derivative Progress: 296/2075 symbols completed. BUD took 1.2s. Estimated remaining: 11m 35s. Rate: 153.6 symbols/min [2025-09-18T22:49:00.620763] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:00.634640] [DEBUG] [MAIN ] BUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:00.635549] [INFO ] [MAIN ] BUR: Generated 1807 derivative records from 45435 primary records. [2025-09-18T22:49:00.635669] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-09-18T22:49:00.672489] [DEBUG] [LOCAL ] BUR: Derivative data saved (1807 records). [2025-09-18T22:49:00.682672] [DEBUG] [LOCAL ] BUXX: Loaded 15320 existing records from primary storage. [2025-09-18T22:49:00.682007] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-09-18T22:49:00.685710] [INFO ] [MAIN ] BUXX: Loaded 15320 primary data records. [2025-09-18T22:49:00.685603] [INFO ] [MAIN ] Derivative Progress: 297/2075 symbols completed. BUR took 1.2s. Estimated remaining: 11m 33s. Rate: 154.0 symbols/min [2025-09-18T22:49:00.691427] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:00.809755] [DEBUG] [LOCAL ] BURL: Loaded 46881 existing records from primary storage. [2025-09-18T22:49:00.821103] [INFO ] [MAIN ] BURL: Loaded 46881 primary data records. [2025-09-18T22:49:01.167264] [DEBUG] [LOCAL ] BV: Loaded 38955 existing records from primary storage. [2025-09-18T22:49:01.229848] [INFO ] [MAIN ] BV: Loaded 38955 primary data records. [2025-09-18T22:49:01.699700] [DEBUG] [MAIN ] BUXX: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:49:01.701132] [INFO ] [MAIN ] BUXX: Generated 1806 derivative records from 15320 primary records. [2025-09-18T22:49:01.701321] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-09-18T22:49:01.737851] [DEBUG] [MAIN ] BURL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:01.738720] [INFO ] [MAIN ] BURL: Generated 1807 derivative records from 46881 primary records. [2025-09-18T22:49:01.737423] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1806 records). [2025-09-18T22:49:01.738925] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-09-18T22:49:01.739210] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-09-18T22:49:01.741199] [INFO ] [MAIN ] Derivative Progress: 298/2075 symbols completed. BUXX took 1.1s. Estimated remaining: 11m 36s. Rate: 153.1 symbols/min [2025-09-18T22:49:01.773824] [DEBUG] [LOCAL ] BURL: Derivative data saved (1807 records). [2025-09-18T22:49:01.774034] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-09-18T22:49:01.774323] [DEBUG] [MAIN ] BV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:01.782568] [INFO ] [MAIN ] BV: Generated 1807 derivative records from 38955 primary records. [2025-09-18T22:49:01.780978] [INFO ] [MAIN ] Derivative Progress: 299/2075 symbols completed. BURL took 1.2s. Estimated remaining: 11m 34s. Rate: 153.6 symbols/min [2025-09-18T22:49:01.782709] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-09-18T22:49:01.799897] [DEBUG] [LOCAL ] BV: Derivative data saved (1807 records). [2025-09-18T22:49:01.800005] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-09-18T22:49:01.802539] [INFO ] [MAIN ] Derivative Progress: 300/2075 symbols completed. BV took 1.1s. Estimated remaining: 11m 31s. Rate: 154.1 symbols/min [2025-09-18T22:49:01.803388] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:01.803245] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:01.803512] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:01.859864] [DEBUG] [LOCAL ] BW: Loaded 39797 existing records from primary storage. [2025-09-18T22:49:01.873273] [INFO ] [MAIN ] BW: Loaded 39797 primary data records. [2025-09-18T22:49:02.023720] [DEBUG] [LOCAL ] BWA: Loaded 52658 existing records from primary storage. [2025-09-18T22:49:02.054700] [INFO ] [MAIN ] BWA: Loaded 52658 primary data records. [2025-09-18T22:49:02.034683] [DEBUG] [LOCAL ] BVN: Loaded 43859 existing records from primary storage. [2025-09-18T22:49:02.246343] [INFO ] [MAIN ] BVN: Loaded 43859 primary data records. [2025-09-18T22:49:02.946352] [DEBUG] [MAIN ] BW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:02.947740] [INFO ] [MAIN ] BW: Generated 1807 derivative records from 39797 primary records. [2025-09-18T22:49:02.947957] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-09-18T22:49:02.965811] [DEBUG] [LOCAL ] BW: Derivative data saved (1807 records). [2025-09-18T22:49:02.967946] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-09-18T22:49:02.972499] [INFO ] [MAIN ] Derivative Progress: 301/2075 symbols completed. BW took 1.2s. Estimated remaining: 11m 35s. Rate: 153.1 symbols/min [2025-09-18T22:49:02.973990] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:03.000995] [DEBUG] [MAIN ] BWA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:03.000621] [DEBUG] [MAIN ] BVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:03.001968] [INFO ] [MAIN ] BWA: Generated 1807 derivative records from 52658 primary records. [2025-09-18T22:49:03.002082] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-09-18T22:49:03.002930] [INFO ] [MAIN ] BVN: Generated 1807 derivative records from 43859 primary records. [2025-09-18T22:49:03.003878] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-09-18T22:49:03.037855] [DEBUG] [LOCAL ] BWG: Loaded 12419 existing records from primary storage. [2025-09-18T22:49:03.039095] [INFO ] [MAIN ] BWG: Loaded 12419 primary data records. [2025-09-18T22:49:03.054305] [DEBUG] [LOCAL ] BVN: Derivative data saved (1807 records). [2025-09-18T22:49:03.075978] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-09-18T22:49:03.083601] [INFO ] [MAIN ] Derivative Progress: 302/2075 symbols completed. BVN took 1.3s. Estimated remaining: 11m 33s. Rate: 153.4 symbols/min [2025-09-18T22:49:03.091862] [DEBUG] [LOCAL ] BWA: Derivative data saved (1807 records). [2025-09-18T22:49:03.091805] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:03.092056] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-09-18T22:49:03.107260] [INFO ] [MAIN ] Derivative Progress: 303/2075 symbols completed. BWA took 1.3s. Estimated remaining: 11m 31s. Rate: 153.9 symbols/min [2025-09-18T22:49:03.114978] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:03.245188] [DEBUG] [LOCAL ] BWMX: Loaded 7627 existing records from primary storage. [2025-09-18T22:49:03.253101] [INFO ] [MAIN ] BWMX: Loaded 7627 primary data records. [2025-09-18T22:49:03.491464] [DEBUG] [LOCAL ] BWLP: Loaded 33217 existing records from primary storage. [2025-09-18T22:49:03.492121] [INFO ] [MAIN ] BWLP: Loaded 33217 primary data records. [2025-09-18T22:49:04.037056] [DEBUG] [MAIN ] BWG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:04.038611] [INFO ] [MAIN ] BWG: Generated 1807 derivative records from 12419 primary records. [2025-09-18T22:49:04.039065] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-09-18T22:49:04.059275] [DEBUG] [LOCAL ] BWG: Derivative data saved (1807 records). [2025-09-18T22:49:04.060460] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-09-18T22:49:04.063804] [INFO ] [MAIN ] Derivative Progress: 304/2075 symbols completed. BWG took 1.1s. Estimated remaining: 11m 34s. Rate: 153.2 symbols/min [2025-09-18T22:49:04.064462] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:04.078391] [DEBUG] [MAIN ] BWMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:04.081522] [INFO ] [MAIN ] BWMX: Generated 1807 derivative records from 7627 primary records. [2025-09-18T22:49:04.082557] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-09-18T22:49:04.113393] [DEBUG] [LOCAL ] BWNB: Loaded 4527 existing records from primary storage. [2025-09-18T22:49:04.114128] [INFO ] [MAIN ] BWNB: Loaded 4527 primary data records. [2025-09-18T22:49:04.113809] [DEBUG] [MAIN ] BWLP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:04.127011] [INFO ] [MAIN ] BWLP: Generated 1807 derivative records from 33217 primary records. [2025-09-18T22:49:04.160880] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-09-18T22:49:04.183213] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1807 records). [2025-09-18T22:49:04.183761] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-09-18T22:49:04.186235] [INFO ] [MAIN ] Derivative Progress: 305/2075 symbols completed. BWMX took 1.1s. Estimated remaining: 11m 32s. Rate: 153.5 symbols/min [2025-09-18T22:49:04.211612] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:04.261840] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1807 records). [2025-09-18T22:49:04.319413] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-09-18T22:49:04.328083] [INFO ] [MAIN ] Derivative Progress: 306/2075 symbols completed. BWLP took 1.2s. Estimated remaining: 11m 30s. Rate: 153.8 symbols/min [2025-09-18T22:49:04.365820] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:04.442079] [DEBUG] [LOCAL ] BWSN: Loaded 5136 existing records from primary storage. [2025-09-18T22:49:04.451267] [INFO ] [MAIN ] BWSN: Loaded 5136 primary data records. [2025-09-18T22:49:04.831600] [DEBUG] [LOCAL ] BWXT: Loaded 47026 existing records from primary storage. [2025-09-18T22:49:04.832059] [INFO ] [MAIN ] BWXT: Loaded 47026 primary data records. [2025-09-18T22:49:04.903831] [DEBUG] [MAIN ] BWNB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:04.920269] [INFO ] [MAIN ] BWNB: Generated 1807 derivative records from 4527 primary records. [2025-09-18T22:49:04.931938] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-09-18T22:49:05.034455] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1807 records). [2025-09-18T22:49:05.184856] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-09-18T22:49:05.201705] [INFO ] [MAIN ] Derivative Progress: 307/2075 symbols completed. BWNB took 1.1s. Estimated remaining: 11m 32s. Rate: 153.2 symbols/min [2025-09-18T22:49:05.202468] [DEBUG] [MAIN ] BWSN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:05.203425] [INFO ] [MAIN ] BWSN: Generated 1807 derivative records from 5136 primary records. [2025-09-18T22:49:05.203711] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-09-18T22:49:05.204040] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:05.229105] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1807 records). [2025-09-18T22:49:05.229913] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-09-18T22:49:05.233255] [INFO ] [MAIN ] Derivative Progress: 308/2075 symbols completed. BWSN took 1.0s. Estimated remaining: 11m 30s. Rate: 153.7 symbols/min [2025-09-18T22:49:05.233670] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:05.251288] [DEBUG] [LOCAL ] BXC: Loaded 13710 existing records from primary storage. [2025-09-18T22:49:05.252451] [INFO ] [MAIN ] BXC: Loaded 13710 primary data records. [2025-09-18T22:49:05.365190] [DEBUG] [MAIN ] BWXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:05.376556] [INFO ] [MAIN ] BWXT: Generated 1807 derivative records from 47026 primary records. [2025-09-18T22:49:05.396781] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-09-18T22:49:05.515519] [DEBUG] [LOCAL ] BX: Loaded 53891 existing records from primary storage. [2025-09-18T22:49:05.559115] [INFO ] [MAIN ] BX: Loaded 53891 primary data records. [2025-09-18T22:49:05.734420] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1807 records). [2025-09-18T22:49:05.754599] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-09-18T22:49:05.761050] [INFO ] [MAIN ] Derivative Progress: 309/2075 symbols completed. BWXT took 1.4s. Estimated remaining: 11m 30s. Rate: 153.5 symbols/min [2025-09-18T22:49:05.761446] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:05.983746] [DEBUG] [MAIN ] BXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:05.995501] [INFO ] [MAIN ] BXC: Generated 1807 derivative records from 13710 primary records. [2025-09-18T22:49:05.996123] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-09-18T22:49:06.014467] [DEBUG] [LOCAL ] BXC: Derivative data saved (1807 records). [2025-09-18T22:49:06.015105] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-09-18T22:49:06.017580] [INFO ] [MAIN ] Derivative Progress: 310/2075 symbols completed. BXC took 0.8s. Estimated remaining: 11m 29s. Rate: 153.7 symbols/min [2025-09-18T22:49:06.033215] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:06.034517] [DEBUG] [LOCAL ] BXMT: Loaded 47617 existing records from primary storage. [2025-09-18T22:49:06.035411] [INFO ] [MAIN ] BXMT: Loaded 47617 primary data records. [2025-09-18T22:49:06.196576] [DEBUG] [LOCAL ] BXMX: Loaded 19877 existing records from primary storage. [2025-09-18T22:49:06.212347] [INFO ] [MAIN ] BXMX: Loaded 19877 primary data records. [2025-09-18T22:49:06.212767] [DEBUG] [MAIN ] BX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:06.256393] [INFO ] [MAIN ] BX: Generated 1807 derivative records from 53891 primary records. [2025-09-18T22:49:06.284585] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-09-18T22:49:06.390092] [DEBUG] [LOCAL ] BX: Derivative data saved (1807 records). [2025-09-18T22:49:06.403400] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-09-18T22:49:06.516218] [INFO ] [MAIN ] Derivative Progress: 311/2075 symbols completed. BX took 1.3s. Estimated remaining: 11m 29s. Rate: 153.5 symbols/min [2025-09-18T22:49:06.538033] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:06.831531] [DEBUG] [MAIN ] BXMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:06.846205] [INFO ] [MAIN ] BXMT: Generated 1807 derivative records from 47617 primary records. [2025-09-18T22:49:06.846367] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-09-18T22:49:06.847953] [DEBUG] [LOCAL ] BXP: Loaded 50269 existing records from primary storage. [2025-09-18T22:49:06.855533] [INFO ] [MAIN ] BXP: Loaded 50269 primary data records. [2025-09-18T22:49:06.961996] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1807 records). [2025-09-18T22:49:06.970633] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-09-18T22:49:06.976604] [INFO ] [MAIN ] Derivative Progress: 312/2075 symbols completed. BXMT took 1.2s. Estimated remaining: 11m 29s. Rate: 153.5 symbols/min [2025-09-18T22:49:06.982584] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:07.046704] [DEBUG] [MAIN ] BXMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:07.065580] [INFO ] [MAIN ] BXMX: Generated 1807 derivative records from 19877 primary records. [2025-09-18T22:49:07.186951] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-09-18T22:49:07.205530] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1807 records). [2025-09-18T22:49:07.206056] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-09-18T22:49:07.209079] [INFO ] [MAIN ] Derivative Progress: 313/2075 symbols completed. BXMX took 1.2s. Estimated remaining: 11m 28s. Rate: 153.6 symbols/min [2025-09-18T22:49:07.241151] [DEBUG] [MAIN ] BXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:07.242468] [INFO ] [MAIN ] BXP: Generated 1807 derivative records from 50269 primary records. [2025-09-18T22:49:07.242628] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-09-18T22:49:07.257798] [DEBUG] [LOCAL ] BXSL: Loaded 47757 existing records from primary storage. [2025-09-18T22:49:07.270924] [INFO ] [MAIN ] BXSL: Loaded 47757 primary data records. [2025-09-18T22:49:07.350791] [DEBUG] [LOCAL ] BXP: Derivative data saved (1807 records). [2025-09-18T22:49:07.374926] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-09-18T22:49:07.380016] [INFO ] [MAIN ] Derivative Progress: 314/2075 symbols completed. BXP took 0.8s. Estimated remaining: 11m 26s. Rate: 153.9 symbols/min [2025-09-18T22:49:07.601855] [DEBUG] [MAIN ] BXSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:07.602833] [INFO ] [MAIN ] BXSL: Generated 1807 derivative records from 47757 primary records. [2025-09-18T22:49:07.602919] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-09-18T22:49:07.621168] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1807 records). [2025-09-18T22:49:07.621301] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-09-18T22:49:07.623334] [INFO ] [MAIN ] Derivative Progress: 315/2075 symbols completed. BXSL took 0.6s. Estimated remaining: 11m 25s. Rate: 154.1 symbols/min [2025-09-18T22:49:07.624077] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:07.624155] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:07.624351] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:07.639016] [DEBUG] [LOCAL ] BYM: Loaded 12392 existing records from primary storage. [2025-09-18T22:49:07.639167] [INFO ] [MAIN ] BYM: Loaded 12392 primary data records. [2025-09-18T22:49:07.757131] [DEBUG] [LOCAL ] BY: Loaded 21642 existing records from primary storage. [2025-09-18T22:49:07.778999] [INFO ] [MAIN ] BY: Loaded 21642 primary data records. [2025-09-18T22:49:08.126811] [DEBUG] [LOCAL ] BYD: Loaded 45747 existing records from primary storage. [2025-09-18T22:49:08.132833] [INFO ] [MAIN ] BYD: Loaded 45747 primary data records. [2025-09-18T22:49:08.673872] [DEBUG] [MAIN ] BYM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:08.675244] [INFO ] [MAIN ] BYM: Generated 1807 derivative records from 12392 primary records. [2025-09-18T22:49:08.675713] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-09-18T22:49:08.706310] [DEBUG] [MAIN ] BY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:08.708830] [INFO ] [MAIN ] BY: Generated 1807 derivative records from 21642 primary records. [2025-09-18T22:49:08.709250] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-09-18T22:49:08.721228] [DEBUG] [LOCAL ] BYM: Derivative data saved (1807 records). [2025-09-18T22:49:08.721419] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-09-18T22:49:08.724278] [INFO ] [MAIN ] Derivative Progress: 316/2075 symbols completed. BYM took 1.1s. Estimated remaining: 11m 29s. Rate: 153.2 symbols/min [2025-09-18T22:49:08.727487] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:08.734282] [DEBUG] [LOCAL ] BY: Derivative data saved (1807 records). [2025-09-18T22:49:08.734608] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-09-18T22:49:08.736812] [INFO ] [MAIN ] Derivative Progress: 317/2075 symbols completed. BY took 1.1s. Estimated remaining: 11m 26s. Rate: 153.7 symbols/min [2025-09-18T22:49:08.737599] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:08.757721] [DEBUG] [MAIN ] BYD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:08.758491] [INFO ] [MAIN ] BYD: Generated 1807 derivative records from 45747 primary records. [2025-09-18T22:49:08.758662] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-09-18T22:49:08.791143] [DEBUG] [LOCAL ] BYD: Derivative data saved (1807 records). [2025-09-18T22:49:08.799776] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-09-18T22:49:08.805582] [DEBUG] [LOCAL ] BZH: Loaded 33190 existing records from primary storage. [2025-09-18T22:49:08.804249] [INFO ] [MAIN ] Derivative Progress: 318/2075 symbols completed. BYD took 1.2s. Estimated remaining: 11m 24s. Rate: 154.1 symbols/min [2025-09-18T22:49:08.805848] [INFO ] [MAIN ] BZH: Loaded 33190 primary data records. [2025-09-18T22:49:08.806191] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:08.998428] [DEBUG] [LOCAL ] C: Loaded 54131 existing records from primary storage. [2025-09-18T22:49:09.029066] [INFO ] [MAIN ] C: Loaded 54131 primary data records. [2025-09-18T22:49:09.038976] [DEBUG] [LOCAL ] CAAP: Loaded 19312 existing records from primary storage. [2025-09-18T22:49:09.114000] [INFO ] [MAIN ] CAAP: Loaded 19312 primary data records. [2025-09-18T22:49:09.836882] [DEBUG] [MAIN ] BZH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:09.841626] [INFO ] [MAIN ] BZH: Generated 1807 derivative records from 33190 primary records. [2025-09-18T22:49:09.841969] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-09-18T22:49:09.863843] [DEBUG] [MAIN ] C: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:09.869127] [INFO ] [MAIN ] C: Generated 1807 derivative records from 54131 primary records. [2025-09-18T22:49:09.871207] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-09-18T22:49:09.874340] [DEBUG] [LOCAL ] BZH: Derivative data saved (1807 records). [2025-09-18T22:49:09.874456] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-09-18T22:49:09.876912] [INFO ] [MAIN ] Derivative Progress: 319/2075 symbols completed. BZH took 1.2s. Estimated remaining: 11m 28s. Rate: 153.3 symbols/min [2025-09-18T22:49:09.884570] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:09.907910] [DEBUG] [MAIN ] CAAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:09.910001] [INFO ] [MAIN ] CAAP: Generated 1807 derivative records from 19312 primary records. [2025-09-18T22:49:09.910601] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-09-18T22:49:09.911536] [DEBUG] [LOCAL ] C: Derivative data saved (1807 records). [2025-09-18T22:49:09.916169] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-09-18T22:49:09.918736] [INFO ] [MAIN ] Derivative Progress: 320/2075 symbols completed. C took 1.2s. Estimated remaining: 11m 25s. Rate: 153.7 symbols/min [2025-09-18T22:49:09.930814] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:09.941144] [DEBUG] [LOCAL ] CABO: Loaded 17861 existing records from primary storage. [2025-09-18T22:49:09.942373] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1807 records). [2025-09-18T22:49:09.942597] [INFO ] [MAIN ] CABO: Loaded 17861 primary data records. [2025-09-18T22:49:09.942842] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-09-18T22:49:09.970622] [INFO ] [MAIN ] Derivative Progress: 321/2075 symbols completed. CAAP took 1.1s. Estimated remaining: 11m 23s. Rate: 154.1 symbols/min [2025-09-18T22:49:10.008343] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:10.156300] [DEBUG] [LOCAL ] CACI: Loaded 26140 existing records from primary storage. [2025-09-18T22:49:10.267622] [INFO ] [MAIN ] CACI: Loaded 26140 primary data records. [2025-09-18T22:49:10.619097] [DEBUG] [LOCAL ] CADE: Loaded 49099 existing records from primary storage. [2025-09-18T22:49:10.619507] [INFO ] [MAIN ] CADE: Loaded 49099 primary data records. [2025-09-18T22:49:10.892516] [DEBUG] [MAIN ] CABO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:10.986792] [INFO ] [MAIN ] CABO: Generated 1807 derivative records from 17861 primary records. [2025-09-18T22:49:10.987561] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-09-18T22:49:11.022016] [DEBUG] [MAIN ] CACI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:49:11.023759] [INFO ] [MAIN ] CACI: Generated 1806 derivative records from 26140 primary records. [2025-09-18T22:49:11.024726] [DEBUG] [LOCAL ] CABO: Derivative data saved (1807 records). [2025-09-18T22:49:11.024993] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-09-18T22:49:11.024359] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-09-18T22:49:11.027339] [INFO ] [MAIN ] Derivative Progress: 322/2075 symbols completed. CABO took 1.1s. Estimated remaining: 11m 26s. Rate: 153.3 symbols/min [2025-09-18T22:49:11.028920] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:11.047836] [DEBUG] [LOCAL ] CACI: Derivative data saved (1806 records). [2025-09-18T22:49:11.047957] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-09-18T22:49:11.050106] [INFO ] [MAIN ] Derivative Progress: 323/2075 symbols completed. CACI took 1.1s. Estimated remaining: 11m 24s. Rate: 153.7 symbols/min [2025-09-18T22:49:11.050544] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:11.058347] [DEBUG] [LOCAL ] CAF: Loaded 3464 existing records from primary storage. [2025-09-18T22:49:11.071488] [DEBUG] [MAIN ] CADE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:11.070706] [INFO ] [MAIN ] CAF: Loaded 3464 primary data records. [2025-09-18T22:49:11.083428] [INFO ] [MAIN ] CADE: Generated 1807 derivative records from 49099 primary records. [2025-09-18T22:49:11.125674] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-09-18T22:49:11.233669] [DEBUG] [LOCAL ] CAE: Loaded 39162 existing records from primary storage. [2025-09-18T22:49:11.244305] [INFO ] [MAIN ] CAE: Loaded 39162 primary data records. [2025-09-18T22:49:11.499449] [DEBUG] [LOCAL ] CADE: Derivative data saved (1807 records). [2025-09-18T22:49:11.519165] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-09-18T22:49:11.525770] [INFO ] [MAIN ] Derivative Progress: 324/2075 symbols completed. CADE took 1.5s. Estimated remaining: 11m 24s. Rate: 153.6 symbols/min [2025-09-18T22:49:11.547594] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:11.746324] [DEBUG] [MAIN ] CAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:11.747434] [INFO ] [MAIN ] CAF: Generated 1807 derivative records from 3464 primary records. [2025-09-18T22:49:11.747828] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-09-18T22:49:11.766146] [DEBUG] [LOCAL ] CAF: Derivative data saved (1807 records). [2025-09-18T22:49:11.766440] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-09-18T22:49:11.782507] [INFO ] [MAIN ] Derivative Progress: 325/2075 symbols completed. CAF took 0.7s. Estimated remaining: 11m 23s. Rate: 153.8 symbols/min [2025-09-18T22:49:11.783219] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:11.797171] [DEBUG] [MAIN ] CAE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:11.798121] [INFO ] [MAIN ] CAE: Generated 1807 derivative records from 39162 primary records. [2025-09-18T22:49:11.798314] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-09-18T22:49:11.831251] [DEBUG] [LOCAL ] CAE: Derivative data saved (1807 records). [2025-09-18T22:49:11.832292] [DEBUG] [LOCAL ] CAG: Loaded 54048 existing records from primary storage. [2025-09-18T22:49:11.832721] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-09-18T22:49:11.832615] [INFO ] [MAIN ] CAG: Loaded 54048 primary data records. [2025-09-18T22:49:11.837512] [INFO ] [MAIN ] Derivative Progress: 326/2075 symbols completed. CAE took 0.8s. Estimated remaining: 11m 21s. Rate: 154.2 symbols/min [2025-09-18T22:49:11.843306] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:12.198938] [DEBUG] [LOCAL ] CAH: Loaded 51889 existing records from primary storage. [2025-09-18T22:49:12.199878] [INFO ] [MAIN ] CAH: Loaded 51889 primary data records. [2025-09-18T22:49:12.332121] [DEBUG] [LOCAL ] CAL: Loaded 43648 existing records from primary storage. [2025-09-18T22:49:12.332381] [INFO ] [MAIN ] CAL: Loaded 43648 primary data records. [2025-09-18T22:49:12.906928] [DEBUG] [MAIN ] CAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:12.908394] [INFO ] [MAIN ] CAG: Generated 1807 derivative records from 54048 primary records. [2025-09-18T22:49:12.908671] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-09-18T22:49:12.927320] [DEBUG] [LOCAL ] CAG: Derivative data saved (1807 records). [2025-09-18T22:49:12.927780] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-09-18T22:49:12.930323] [INFO ] [MAIN ] Derivative Progress: 327/2075 symbols completed. CAG took 1.4s. Estimated remaining: 11m 24s. Rate: 153.3 symbols/min [2025-09-18T22:49:12.931073] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:12.949926] [DEBUG] [MAIN ] CAH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:12.950784] [INFO ] [MAIN ] CAH: Generated 1807 derivative records from 51889 primary records. [2025-09-18T22:49:12.950954] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-09-18T22:49:12.991890] [DEBUG] [LOCAL ] CAH: Derivative data saved (1807 records). [2025-09-18T22:49:12.992165] [DEBUG] [MAIN ] CAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:12.993063] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-09-18T22:49:12.995265] [INFO ] [MAIN ] Derivative Progress: 328/2075 symbols completed. CAH took 1.2s. Estimated remaining: 11m 22s. Rate: 153.7 symbols/min [2025-09-18T22:49:12.993001] [INFO ] [MAIN ] CAL: Generated 1807 derivative records from 43648 primary records. [2025-09-18T22:49:12.995596] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-09-18T22:49:13.022225] [DEBUG] [LOCAL ] CALX: Loaded 39114 existing records from primary storage. [2025-09-18T22:49:13.022885] [INFO ] [MAIN ] CALX: Loaded 39114 primary data records. [2025-09-18T22:49:13.127494] [DEBUG] [LOCAL ] CAL: Derivative data saved (1807 records). [2025-09-18T22:49:13.130259] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-09-18T22:49:13.132771] [INFO ] [MAIN ] Derivative Progress: 329/2075 symbols completed. CAL took 1.3s. Estimated remaining: 11m 20s. Rate: 154.0 symbols/min [2025-09-18T22:49:13.351531] [DEBUG] [MAIN ] CALX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:13.352227] [INFO ] [MAIN ] CALX: Generated 1807 derivative records from 39114 primary records. [2025-09-18T22:49:13.352292] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-09-18T22:49:13.367990] [DEBUG] [LOCAL ] CALX: Derivative data saved (1807 records). [2025-09-18T22:49:13.368055] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-09-18T22:49:13.370126] [INFO ] [MAIN ] Derivative Progress: 330/2075 symbols completed. CALX took 0.4s. Estimated remaining: 11m 19s. Rate: 154.2 symbols/min [2025-09-18T22:49:13.370920] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:13.371214] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:13.370635] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:13.381760] [DEBUG] [LOCAL ] CAPL: Loaded 5996 existing records from primary storage. [2025-09-18T22:49:13.381948] [INFO ] [MAIN ] CAPL: Loaded 5996 primary data records. [2025-09-18T22:49:13.539118] [DEBUG] [LOCAL ] CANG: Loaded 26838 existing records from primary storage. [2025-09-18T22:49:13.589062] [INFO ] [MAIN ] CANG: Loaded 26838 primary data records. [2025-09-18T22:49:13.960096] [DEBUG] [LOCAL ] CARR: Loaded 53988 existing records from primary storage. [2025-09-18T22:49:14.078738] [INFO ] [MAIN ] CARR: Loaded 53988 primary data records. [2025-09-18T22:49:14.410004] [DEBUG] [MAIN ] CAPL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:14.411128] [INFO ] [MAIN ] CAPL: Generated 1807 derivative records from 5996 primary records. [2025-09-18T22:49:14.411928] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-09-18T22:49:14.430119] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1807 records). [2025-09-18T22:49:14.430661] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-09-18T22:49:14.433012] [INFO ] [MAIN ] Derivative Progress: 331/2075 symbols completed. CAPL took 1.1s. Estimated remaining: 11m 22s. Rate: 153.4 symbols/min [2025-09-18T22:49:14.433278] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:14.453180] [DEBUG] [MAIN ] CANG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:14.453992] [INFO ] [MAIN ] CANG: Generated 1807 derivative records from 26838 primary records. [2025-09-18T22:49:14.454223] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-09-18T22:49:14.473043] [DEBUG] [LOCAL ] CANG: Derivative data saved (1807 records). [2025-09-18T22:49:14.483883] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-09-18T22:49:14.486060] [INFO ] [MAIN ] Derivative Progress: 332/2075 symbols completed. CANG took 1.1s. Estimated remaining: 11m 20s. Rate: 153.8 symbols/min [2025-09-18T22:49:14.486479] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:14.499904] [DEBUG] [MAIN ] CARR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:14.500617] [INFO ] [MAIN ] CARR: Generated 1807 derivative records from 53988 primary records. [2025-09-18T22:49:14.500748] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-09-18T22:49:14.528863] [DEBUG] [LOCAL ] CARS: Loaded 40751 existing records from primary storage. [2025-09-18T22:49:14.529568] [INFO ] [MAIN ] CARS: Loaded 40751 primary data records. [2025-09-18T22:49:14.530332] [DEBUG] [LOCAL ] CARR: Derivative data saved (1807 records). [2025-09-18T22:49:14.541890] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-09-18T22:49:14.554151] [INFO ] [MAIN ] Derivative Progress: 333/2075 symbols completed. CARR took 1.2s. Estimated remaining: 11m 18s. Rate: 154.2 symbols/min [2025-09-18T22:49:14.575521] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:14.738559] [DEBUG] [LOCAL ] CATO: Loaded 7490 existing records from primary storage. [2025-09-18T22:49:14.883666] [INFO ] [MAIN ] CATO: Loaded 7490 primary data records. [2025-09-18T22:49:15.047547] [DEBUG] [LOCAL ] CAT: Loaded 53322 existing records from primary storage. [2025-09-18T22:49:15.103785] [INFO ] [MAIN ] CAT: Loaded 53322 primary data records. [2025-09-18T22:49:15.558677] [DEBUG] [MAIN ] CARS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:15.576805] [INFO ] [MAIN ] CARS: Generated 1807 derivative records from 40751 primary records. [2025-09-18T22:49:15.577518] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-09-18T22:49:15.603910] [DEBUG] [LOCAL ] CARS: Derivative data saved (1807 records). [2025-09-18T22:49:15.605692] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-09-18T22:49:15.608747] [INFO ] [MAIN ] Derivative Progress: 334/2075 symbols completed. CARS took 1.2s. Estimated remaining: 11m 21s. Rate: 153.4 symbols/min [2025-09-18T22:49:15.609717] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:15.641040] [DEBUG] [MAIN ] CATO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:15.642587] [INFO ] [MAIN ] CATO: Generated 1807 derivative records from 7490 primary records. [2025-09-18T22:49:15.642889] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-09-18T22:49:15.676068] [DEBUG] [LOCAL ] CATO: Derivative data saved (1807 records). [2025-09-18T22:49:15.676858] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-09-18T22:49:15.680265] [INFO ] [MAIN ] Derivative Progress: 335/2075 symbols completed. CATO took 1.1s. Estimated remaining: 11m 19s. Rate: 153.8 symbols/min [2025-09-18T22:49:15.687511] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:15.702245] [DEBUG] [MAIN ] CAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:15.719271] [INFO ] [MAIN ] CAT: Generated 1807 derivative records from 53322 primary records. [2025-09-18T22:49:15.719586] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-09-18T22:49:15.763747] [DEBUG] [LOCAL ] CAVA: Loaded 53942 existing records from primary storage. [2025-09-18T22:49:15.764327] [INFO ] [MAIN ] CAVA: Loaded 53942 primary data records. [2025-09-18T22:49:15.764700] [DEBUG] [LOCAL ] CAT: Derivative data saved (1807 records). [2025-09-18T22:49:15.779139] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-09-18T22:49:15.817777] [INFO ] [MAIN ] Derivative Progress: 336/2075 symbols completed. CAT took 1.3s. Estimated remaining: 11m 17s. Rate: 154.1 symbols/min [2025-09-18T22:49:15.854162] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:16.046136] [DEBUG] [LOCAL ] CBAN: Loaded 11306 existing records from primary storage. [2025-09-18T22:49:16.048213] [DEBUG] [LOCAL ] CB: Loaded 50493 existing records from primary storage. [2025-09-18T22:49:16.084470] [INFO ] [MAIN ] CBAN: Loaded 11306 primary data records. [2025-09-18T22:49:16.225953] [INFO ] [MAIN ] CB: Loaded 50493 primary data records. [2025-09-18T22:49:17.039537] [DEBUG] [MAIN ] CAVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:17.040535] [INFO ] [MAIN ] CAVA: Generated 1807 derivative records from 53942 primary records. [2025-09-18T22:49:17.041154] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-09-18T22:49:17.064107] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1807 records). [2025-09-18T22:49:17.064468] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-09-18T22:49:17.066571] [INFO ] [MAIN ] Derivative Progress: 337/2075 symbols completed. CAVA took 1.5s. Estimated remaining: 11m 21s. Rate: 153.1 symbols/min [2025-09-18T22:49:17.066857] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:17.087673] [DEBUG] [MAIN ] CBAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:17.105615] [DEBUG] [MAIN ] CB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:17.105247] [INFO ] [MAIN ] CBAN: Generated 1807 derivative records from 11306 primary records. [2025-09-18T22:49:17.106596] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-09-18T22:49:17.106511] [INFO ] [MAIN ] CB: Generated 1807 derivative records from 50493 primary records. [2025-09-18T22:49:17.106821] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-09-18T22:49:17.137268] [DEBUG] [LOCAL ] CBL: Loaded 16995 existing records from primary storage. [2025-09-18T22:49:17.141189] [INFO ] [MAIN ] CBL: Loaded 16995 primary data records. [2025-09-18T22:49:17.142801] [DEBUG] [LOCAL ] CB: Derivative data saved (1807 records). [2025-09-18T22:49:17.155451] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-09-18T22:49:17.158494] [INFO ] [MAIN ] Derivative Progress: 338/2075 symbols completed. CB took 1.5s. Estimated remaining: 11m 19s. Rate: 153.4 symbols/min [2025-09-18T22:49:17.158791] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:17.229755] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1807 records). [2025-09-18T22:49:17.229991] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-09-18T22:49:17.237586] [INFO ] [MAIN ] Derivative Progress: 339/2075 symbols completed. CBAN took 1.4s. Estimated remaining: 11m 17s. Rate: 153.8 symbols/min [2025-09-18T22:49:17.251902] [DEBUG] [LOCAL ] CBNA: Loaded 2970 existing records from primary storage. [2025-09-18T22:49:17.260696] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:17.264571] [INFO ] [MAIN ] CBNA: Loaded 2970 primary data records. [2025-09-18T22:49:17.882151] [DEBUG] [LOCAL ] CBRE: Loaded 51090 existing records from primary storage. [2025-09-18T22:49:17.881211] [DEBUG] [MAIN ] CBL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:17.883199] [INFO ] [MAIN ] CBL: Generated 1807 derivative records from 16995 primary records. [2025-09-18T22:49:17.883443] [INFO ] [MAIN ] CBRE: Loaded 51090 primary data records. [2025-09-18T22:49:17.883502] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-09-18T22:49:17.960490] [DEBUG] [LOCAL ] CBL: Derivative data saved (1807 records). [2025-09-18T22:49:18.005961] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-09-18T22:49:18.024169] [INFO ] [MAIN ] Derivative Progress: 340/2075 symbols completed. CBL took 1.0s. Estimated remaining: 11m 19s. Rate: 153.3 symbols/min [2025-09-18T22:49:18.024779] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:18.025744] [DEBUG] [MAIN ] CBNA: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:49:18.026578] [INFO ] [MAIN ] CBNA: Generated 1806 derivative records from 2970 primary records. [2025-09-18T22:49:18.027074] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-09-18T22:49:18.122875] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1806 records). [2025-09-18T22:49:18.123815] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-09-18T22:49:18.246013] [INFO ] [MAIN ] Derivative Progress: 341/2075 symbols completed. CBNA took 1.1s. Estimated remaining: 11m 18s. Rate: 153.5 symbols/min [2025-09-18T22:49:18.246440] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:18.269955] [DEBUG] [LOCAL ] CBT: Loaded 31624 existing records from primary storage. [2025-09-18T22:49:18.270734] [INFO ] [MAIN ] CBT: Loaded 31624 primary data records. [2025-09-18T22:49:18.414502] [DEBUG] [LOCAL ] CBU: Loaded 23167 existing records from primary storage. [2025-09-18T22:49:18.451213] [INFO ] [MAIN ] CBU: Loaded 23167 primary data records. [2025-09-18T22:49:18.713749] [DEBUG] [MAIN ] CBRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:18.735538] [INFO ] [MAIN ] CBRE: Generated 1807 derivative records from 51090 primary records. [2025-09-18T22:49:18.754396] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-09-18T22:49:18.935538] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1807 records). [2025-09-18T22:49:18.935987] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-09-18T22:49:18.938166] [INFO ] [MAIN ] Derivative Progress: 342/2075 symbols completed. CBRE took 1.7s. Estimated remaining: 11m 19s. Rate: 153.2 symbols/min [2025-09-18T22:49:18.938963] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:18.962606] [DEBUG] [MAIN ] CBT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:18.963370] [INFO ] [MAIN ] CBT: Generated 1807 derivative records from 31624 primary records. [2025-09-18T22:49:18.963555] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-09-18T22:49:18.992291] [DEBUG] [LOCAL ] CBT: Derivative data saved (1807 records). [2025-09-18T22:49:18.992676] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-09-18T22:49:18.995145] [INFO ] [MAIN ] Derivative Progress: 343/2075 symbols completed. CBT took 1.0s. Estimated remaining: 11m 17s. Rate: 153.6 symbols/min [2025-09-18T22:49:19.017023] [DEBUG] [MAIN ] CBU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:19.018578] [INFO ] [MAIN ] CBU: Generated 1807 derivative records from 23167 primary records. [2025-09-18T22:49:19.018733] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-09-18T22:49:19.019162] [DEBUG] [LOCAL ] CBZ: Loaded 33568 existing records from primary storage. [2025-09-18T22:49:19.019684] [INFO ] [MAIN ] CBZ: Loaded 33568 primary data records. [2025-09-18T22:49:19.213173] [DEBUG] [LOCAL ] CBU: Derivative data saved (1807 records). [2025-09-18T22:49:19.373678] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-09-18T22:49:19.376958] [INFO ] [MAIN ] Derivative Progress: 344/2075 symbols completed. CBU took 1.1s. Estimated remaining: 11m 16s. Rate: 153.6 symbols/min [2025-09-18T22:49:19.401544] [DEBUG] [MAIN ] CBZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:19.402175] [INFO ] [MAIN ] CBZ: Generated 1807 derivative records from 33568 primary records. [2025-09-18T22:49:19.402241] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-09-18T22:49:19.417385] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1807 records). [2025-09-18T22:49:19.417445] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-09-18T22:49:19.420141] [INFO ] [MAIN ] Derivative Progress: 345/2075 symbols completed. CBZ took 0.5s. Estimated remaining: 11m 14s. Rate: 154.0 symbols/min [2025-09-18T22:49:19.420770] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:19.420716] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:19.421010] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:19.440895] [DEBUG] [LOCAL ] CCIF: Loaded 15358 existing records from primary storage. [2025-09-18T22:49:19.441172] [INFO ] [MAIN ] CCIF: Loaded 15358 primary data records. [2025-09-18T22:49:19.816378] [DEBUG] [LOCAL ] CCI: Loaded 53549 existing records from primary storage. [2025-09-18T22:49:19.817099] [DEBUG] [LOCAL ] CC: Loaded 53424 existing records from primary storage. [2025-09-18T22:49:19.817513] [INFO ] [MAIN ] CCI: Loaded 53549 primary data records. [2025-09-18T22:49:19.817592] [INFO ] [MAIN ] CC: Loaded 53424 primary data records. [2025-09-18T22:49:20.451429] [DEBUG] [MAIN ] CCIF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:20.452435] [INFO ] [MAIN ] CCIF: Generated 1807 derivative records from 15358 primary records. [2025-09-18T22:49:20.453696] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-09-18T22:49:20.470789] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1807 records). [2025-09-18T22:49:20.470997] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-09-18T22:49:20.473812] [INFO ] [MAIN ] Derivative Progress: 346/2075 symbols completed. CCIF took 1.1s. Estimated remaining: 11m 17s. Rate: 153.2 symbols/min [2025-09-18T22:49:20.474244] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:20.507808] [DEBUG] [MAIN ] CC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:20.508065] [DEBUG] [MAIN ] CCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:20.508882] [INFO ] [MAIN ] CCI: Generated 1807 derivative records from 53549 primary records. [2025-09-18T22:49:20.509568] [INFO ] [MAIN ] CC: Generated 1807 derivative records from 53424 primary records. [2025-09-18T22:49:20.508991] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-09-18T22:49:20.510111] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-09-18T22:49:20.540193] [DEBUG] [LOCAL ] CCI: Derivative data saved (1807 records). [2025-09-18T22:49:20.541491] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-09-18T22:49:20.543621] [INFO ] [MAIN ] Derivative Progress: 347/2075 symbols completed. CCI took 1.1s. Estimated remaining: 11m 15s. Rate: 153.6 symbols/min [2025-09-18T22:49:20.544734] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:20.545437] [DEBUG] [LOCAL ] CC: Derivative data saved (1807 records). [2025-09-18T22:49:20.545526] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-09-18T22:49:20.548479] [INFO ] [MAIN ] Derivative Progress: 348/2075 symbols completed. CC took 1.1s. Estimated remaining: 11m 13s. Rate: 154.0 symbols/min [2025-09-18T22:49:20.549088] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:20.588106] [DEBUG] [LOCAL ] CCJ: Loaded 54065 existing records from primary storage. [2025-09-18T22:49:20.588405] [INFO ] [MAIN ] CCJ: Loaded 54065 primary data records. [2025-09-18T22:49:20.951787] [DEBUG] [LOCAL ] CCO: Loaded 47879 existing records from primary storage. [2025-09-18T22:49:20.952680] [DEBUG] [LOCAL ] CCL: Loaded 54190 existing records from primary storage. [2025-09-18T22:49:20.952800] [INFO ] [MAIN ] CCO: Loaded 47879 primary data records. [2025-09-18T22:49:20.953015] [INFO ] [MAIN ] CCL: Loaded 54190 primary data records. [2025-09-18T22:49:21.619103] [DEBUG] [MAIN ] CCJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:21.619931] [INFO ] [MAIN ] CCJ: Generated 1807 derivative records from 54065 primary records. [2025-09-18T22:49:21.620460] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-09-18T22:49:21.638220] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1807 records). [2025-09-18T22:49:21.638415] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-09-18T22:49:21.641045] [INFO ] [MAIN ] Derivative Progress: 349/2075 symbols completed. CCJ took 1.2s. Estimated remaining: 11m 16s. Rate: 153.2 symbols/min [2025-09-18T22:49:21.641432] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:21.662111] [DEBUG] [MAIN ] CCL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:21.669682] [INFO ] [MAIN ] CCL: Generated 1807 derivative records from 54190 primary records. [2025-09-18T22:49:21.668618] [DEBUG] [LOCAL ] CCRD: Loaded 9003 existing records from primary storage. [2025-09-18T22:49:21.669971] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-09-18T22:49:21.669902] [INFO ] [MAIN ] CCRD: Loaded 9003 primary data records. [2025-09-18T22:49:21.733332] [DEBUG] [MAIN ] CCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:21.763111] [INFO ] [MAIN ] CCO: Generated 1807 derivative records from 47879 primary records. [2025-09-18T22:49:21.775200] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-09-18T22:49:21.813124] [DEBUG] [LOCAL ] CCL: Derivative data saved (1807 records). [2025-09-18T22:49:21.834597] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-09-18T22:49:21.869118] [INFO ] [MAIN ] Derivative Progress: 350/2075 symbols completed. CCL took 1.3s. Estimated remaining: 11m 15s. Rate: 153.4 symbols/min [2025-09-18T22:49:21.894566] [DEBUG] [LOCAL ] CCO: Derivative data saved (1807 records). [2025-09-18T22:49:21.899587] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-09-18T22:49:21.931847] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:21.998212] [INFO ] [MAIN ] Derivative Progress: 351/2075 symbols completed. CCO took 1.4s. Estimated remaining: 11m 13s. Rate: 153.7 symbols/min [2025-09-18T22:49:22.020179] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:22.065337] [DEBUG] [MAIN ] CCRD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:22.066984] [DEBUG] [LOCAL ] CCU: Loaded 24155 existing records from primary storage. [2025-09-18T22:49:22.067868] [INFO ] [MAIN ] CCRD: Generated 1807 derivative records from 9003 primary records. [2025-09-18T22:49:22.067138] [INFO ] [MAIN ] CCU: Loaded 24155 primary data records. [2025-09-18T22:49:22.068007] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-09-18T22:49:22.113737] [DEBUG] [LOCAL ] CCS: Loaded 30923 existing records from primary storage. [2025-09-18T22:49:22.121045] [INFO ] [MAIN ] CCS: Loaded 30923 primary data records. [2025-09-18T22:49:22.394606] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1807 records). [2025-09-18T22:49:22.434564] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-09-18T22:49:22.453234] [INFO ] [MAIN ] Derivative Progress: 352/2075 symbols completed. CCRD took 0.8s. Estimated remaining: 11m 13s. Rate: 153.6 symbols/min [2025-09-18T22:49:22.458758] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:22.748476] [DEBUG] [MAIN ] CCU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:22.768490] [DEBUG] [MAIN ] CCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:22.766748] [INFO ] [MAIN ] CCU: Generated 1807 derivative records from 24155 primary records. [2025-09-18T22:49:22.791194] [INFO ] [MAIN ] CCS: Generated 1807 derivative records from 30923 primary records. [2025-09-18T22:49:22.768773] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-09-18T22:49:22.793517] [DEBUG] [LOCAL ] CDE: Loaded 54031 existing records from primary storage. [2025-09-18T22:49:22.793977] [INFO ] [MAIN ] CDE: Loaded 54031 primary data records. [2025-09-18T22:49:22.793685] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-09-18T22:49:22.912822] [DEBUG] [LOCAL ] CCU: Derivative data saved (1807 records). [2025-09-18T22:49:22.920238] [DEBUG] [LOCAL ] CCS: Derivative data saved (1807 records). [2025-09-18T22:49:22.928054] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-09-18T22:49:22.930054] [INFO ] [MAIN ] Derivative Progress: 353/2075 symbols completed. CCU took 0.9s. Estimated remaining: 11m 13s. Rate: 153.5 symbols/min [2025-09-18T22:49:22.927997] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-09-18T22:49:22.936320] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:22.936140] [INFO ] [MAIN ] Derivative Progress: 354/2075 symbols completed. CCS took 1.0s. Estimated remaining: 11m 11s. Rate: 154.0 symbols/min [2025-09-18T22:49:22.953005] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:23.166228] [DEBUG] [LOCAL ] CDRE: Loaded 25336 existing records from primary storage. [2025-09-18T22:49:23.166480] [INFO ] [MAIN ] CDRE: Loaded 25336 primary data records. [2025-09-18T22:49:23.285347] [DEBUG] [LOCAL ] CDP: Loaded 43105 existing records from primary storage. [2025-09-18T22:49:23.286029] [INFO ] [MAIN ] CDP: Loaded 43105 primary data records. [2025-09-18T22:49:23.362543] [DEBUG] [MAIN ] CDE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:23.394582] [INFO ] [MAIN ] CDE: Generated 1807 derivative records from 54031 primary records. [2025-09-18T22:49:23.429694] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-09-18T22:49:23.934467] [DEBUG] [LOCAL ] CDE: Derivative data saved (1807 records). [2025-09-18T22:49:23.935668] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-09-18T22:49:23.938558] [INFO ] [MAIN ] Derivative Progress: 355/2075 symbols completed. CDE took 1.5s. Estimated remaining: 11m 13s. Rate: 153.3 symbols/min [2025-09-18T22:49:23.940107] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:23.964096] [DEBUG] [MAIN ] CDRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:23.965158] [INFO ] [MAIN ] CDRE: Generated 1807 derivative records from 25336 primary records. [2025-09-18T22:49:23.965521] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-09-18T22:49:24.014541] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1807 records). [2025-09-18T22:49:24.015357] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-09-18T22:49:24.015303] [DEBUG] [MAIN ] CDP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:24.018676] [INFO ] [MAIN ] CDP: Generated 1807 derivative records from 43105 primary records. [2025-09-18T22:49:24.017773] [INFO ] [MAIN ] Derivative Progress: 356/2075 symbols completed. CDRE took 1.1s. Estimated remaining: 11m 11s. Rate: 153.6 symbols/min [2025-09-18T22:49:24.019051] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:24.019170] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-09-18T22:49:24.052423] [DEBUG] [LOCAL ] CDP: Derivative data saved (1807 records). [2025-09-18T22:49:24.056813] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-09-18T22:49:24.057038] [DEBUG] [LOCAL ] CEE: Loaded 7051 existing records from primary storage. [2025-09-18T22:49:24.056573] [DEBUG] [LOCAL ] CE: Loaded 51968 existing records from primary storage. [2025-09-18T22:49:24.059624] [INFO ] [MAIN ] Derivative Progress: 357/2075 symbols completed. CDP took 1.1s. Estimated remaining: 11m 9s. Rate: 154.0 symbols/min [2025-09-18T22:49:24.060067] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:24.059890] [INFO ] [MAIN ] CEE: Loaded 7051 primary data records. [2025-09-18T22:49:24.059947] [INFO ] [MAIN ] CE: Loaded 51968 primary data records. [2025-09-18T22:49:24.400701] [DEBUG] [LOCAL ] CEPU: Loaded 25891 existing records from primary storage. [2025-09-18T22:49:24.521960] [INFO ] [MAIN ] CEPU: Loaded 25891 primary data records. [2025-09-18T22:49:25.041057] [DEBUG] [MAIN ] CEE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:25.043361] [INFO ] [MAIN ] CEE: Generated 1807 derivative records from 7051 primary records. [2025-09-18T22:49:25.043591] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-09-18T22:49:25.069337] [DEBUG] [MAIN ] CE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:25.071041] [INFO ] [MAIN ] CE: Generated 1807 derivative records from 51968 primary records. [2025-09-18T22:49:25.071565] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-09-18T22:49:25.090349] [DEBUG] [LOCAL ] CE: Derivative data saved (1807 records). [2025-09-18T22:49:25.091779] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-09-18T22:49:25.094534] [INFO ] [MAIN ] Derivative Progress: 358/2075 symbols completed. CE took 1.2s. Estimated remaining: 11m 12s. Rate: 153.3 symbols/min [2025-09-18T22:49:25.095705] [DEBUG] [LOCAL ] CEE: Derivative data saved (1807 records). [2025-09-18T22:49:25.096074] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-09-18T22:49:25.098208] [INFO ] [MAIN ] Derivative Progress: 359/2075 symbols completed. CEE took 1.1s. Estimated remaining: 11m 10s. Rate: 153.7 symbols/min [2025-09-18T22:49:25.113882] [DEBUG] [MAIN ] CEPU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:25.114481] [INFO ] [MAIN ] CEPU: Generated 1807 derivative records from 25891 primary records. [2025-09-18T22:49:25.114543] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-09-18T22:49:25.130808] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1807 records). [2025-09-18T22:49:25.130873] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-09-18T22:49:25.133412] [INFO ] [MAIN ] Derivative Progress: 360/2075 symbols completed. CEPU took 1.1s. Estimated remaining: 11m 8s. Rate: 154.1 symbols/min [2025-09-18T22:49:25.134027] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:25.134107] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:25.134248] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:25.196934] [DEBUG] [LOCAL ] CFR: Loaded 33951 existing records from primary storage. [2025-09-18T22:49:25.208529] [INFO ] [MAIN ] CFR: Loaded 33951 primary data records. [2025-09-18T22:49:25.241486] [DEBUG] [LOCAL ] CGAU: Loaded 42806 existing records from primary storage. [2025-09-18T22:49:25.275425] [INFO ] [MAIN ] CGAU: Loaded 42806 primary data records. [2025-09-18T22:49:25.383970] [DEBUG] [LOCAL ] CF: Loaded 52631 existing records from primary storage. [2025-09-18T22:49:25.431416] [INFO ] [MAIN ] CF: Loaded 52631 primary data records. [2025-09-18T22:49:26.229492] [DEBUG] [MAIN ] CGAU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:26.242880] [DEBUG] [MAIN ] CFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:26.243734] [INFO ] [MAIN ] CGAU: Generated 1807 derivative records from 42806 primary records. [2025-09-18T22:49:26.245786] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-09-18T22:49:26.245687] [INFO ] [MAIN ] CFR: Generated 1807 derivative records from 33951 primary records. [2025-09-18T22:49:26.246375] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-09-18T22:49:26.283959] [DEBUG] [LOCAL ] CFR: Derivative data saved (1807 records). [2025-09-18T22:49:26.283192] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1807 records). [2025-09-18T22:49:26.284193] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-09-18T22:49:26.287079] [INFO ] [MAIN ] Derivative Progress: 361/2075 symbols completed. CFR took 1.2s. Estimated remaining: 11m 11s. Rate: 153.3 symbols/min [2025-09-18T22:49:26.288372] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:26.284382] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-09-18T22:49:26.292321] [INFO ] [MAIN ] Derivative Progress: 362/2075 symbols completed. CGAU took 1.2s. Estimated remaining: 11m 9s. Rate: 153.7 symbols/min [2025-09-18T22:49:26.292986] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:26.309439] [DEBUG] [LOCAL ] CGV: Loaded 1446 existing records from primary storage. [2025-09-18T22:49:26.307627] [DEBUG] [MAIN ] CF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:26.310275] [INFO ] [MAIN ] CF: Generated 1807 derivative records from 52631 primary records. [2025-09-18T22:49:26.310447] [INFO ] [MAIN ] CGV: Loaded 1446 primary data records. [2025-09-18T22:49:26.310543] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-09-18T22:49:26.433549] [DEBUG] [LOCAL ] CF: Derivative data saved (1807 records). [2025-09-18T22:49:26.436998] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-09-18T22:49:26.439856] [INFO ] [MAIN ] Derivative Progress: 363/2075 symbols completed. CF took 1.3s. Estimated remaining: 11m 7s. Rate: 154.0 symbols/min [2025-09-18T22:49:26.458877] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:26.488477] [DEBUG] [LOCAL ] CHCT: Loaded 24304 existing records from primary storage. [2025-09-18T22:49:26.524852] [INFO ] [MAIN ] CHCT: Loaded 24304 primary data records. [2025-09-18T22:49:27.003741] [DEBUG] [LOCAL ] CHD: Loaded 52379 existing records from primary storage. [2025-09-18T22:49:27.005190] [INFO ] [MAIN ] CHD: Loaded 52379 primary data records. [2025-09-18T22:49:27.005822] [DEBUG] [MAIN ] CGV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:49:27.006781] [INFO ] [MAIN ] CGV: Generated 1806 derivative records from 1446 primary records. [2025-09-18T22:49:27.006983] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-09-18T22:49:27.169695] [DEBUG] [LOCAL ] CGV: Derivative data saved (1806 records). [2025-09-18T22:49:27.173924] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-09-18T22:49:27.207075] [INFO ] [MAIN ] Derivative Progress: 364/2075 symbols completed. CGV took 0.9s. Estimated remaining: 11m 9s. Rate: 153.6 symbols/min [2025-09-18T22:49:27.404756] [DEBUG] [MAIN ] CHCT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:27.405461] [INFO ] [MAIN ] CHCT: Generated 1807 derivative records from 24304 primary records. [2025-09-18T22:49:27.403268] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:27.405683] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-09-18T22:49:27.437634] [DEBUG] [LOCAL ] CHE: Loaded 14730 existing records from primary storage. [2025-09-18T22:49:27.437946] [INFO ] [MAIN ] CHE: Loaded 14730 primary data records. [2025-09-18T22:49:27.437337] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1807 records). [2025-09-18T22:49:27.469676] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-09-18T22:49:27.490148] [INFO ] [MAIN ] Derivative Progress: 365/2075 symbols completed. CHCT took 1.2s. Estimated remaining: 11m 8s. Rate: 153.7 symbols/min [2025-09-18T22:49:27.524597] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:27.771838] [DEBUG] [MAIN ] CHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:27.773068] [INFO ] [MAIN ] CHD: Generated 1807 derivative records from 52379 primary records. [2025-09-18T22:49:27.773233] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-09-18T22:49:27.806025] [DEBUG] [LOCAL ] CHD: Derivative data saved (1807 records). [2025-09-18T22:49:27.806731] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-09-18T22:49:27.811001] [INFO ] [MAIN ] Derivative Progress: 366/2075 symbols completed. CHD took 1.4s. Estimated remaining: 11m 7s. Rate: 153.8 symbols/min [2025-09-18T22:49:27.811392] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:27.828826] [DEBUG] [LOCAL ] CHGG: Loaded 48206 existing records from primary storage. [2025-09-18T22:49:27.829237] [INFO ] [MAIN ] CHGG: Loaded 48206 primary data records. [2025-09-18T22:49:27.963457] [DEBUG] [LOCAL ] CHMI: Loaded 22199 existing records from primary storage. [2025-09-18T22:49:27.969482] [INFO ] [MAIN ] CHMI: Loaded 22199 primary data records. [2025-09-18T22:49:27.964023] [DEBUG] [MAIN ] CHE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:28.004873] [INFO ] [MAIN ] CHE: Generated 1807 derivative records from 14730 primary records. [2025-09-18T22:49:28.019008] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-09-18T22:49:28.363115] [DEBUG] [LOCAL ] CHE: Derivative data saved (1807 records). [2025-09-18T22:49:28.394564] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-09-18T22:49:28.516522] [INFO ] [MAIN ] Derivative Progress: 367/2075 symbols completed. CHE took 1.1s. Estimated remaining: 11m 8s. Rate: 153.4 symbols/min [2025-09-18T22:49:28.527882] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:28.538865] [DEBUG] [LOCAL ] CHN: Loaded 4842 existing records from primary storage. [2025-09-18T22:49:28.539513] [INFO ] [MAIN ] CHN: Loaded 4842 primary data records. [2025-09-18T22:49:28.731560] [DEBUG] [MAIN ] CHGG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:28.765834] [INFO ] [MAIN ] CHGG: Generated 1807 derivative records from 48206 primary records. [2025-09-18T22:49:28.892859] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-09-18T22:49:28.926841] [DEBUG] [MAIN ] CHMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:28.928579] [INFO ] [MAIN ] CHMI: Generated 1807 derivative records from 22199 primary records. [2025-09-18T22:49:28.928988] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-09-18T22:49:28.943842] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1807 records). [2025-09-18T22:49:28.945153] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-09-18T22:49:28.947398] [INFO ] [MAIN ] Derivative Progress: 368/2075 symbols completed. CHGG took 1.4s. Estimated remaining: 11m 8s. Rate: 153.4 symbols/min [2025-09-18T22:49:28.947868] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:28.953093] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1807 records). [2025-09-18T22:49:28.953519] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-09-18T22:49:28.955740] [INFO ] [MAIN ] Derivative Progress: 369/2075 symbols completed. CHMI took 1.1s. Estimated remaining: 11m 6s. Rate: 153.8 symbols/min [2025-09-18T22:49:28.956133] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:28.974806] [DEBUG] [MAIN ] CHN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:28.975680] [INFO ] [MAIN ] CHN: Generated 1807 derivative records from 4842 primary records. [2025-09-18T22:49:28.975815] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-09-18T22:49:28.997457] [DEBUG] [LOCAL ] CHN: Derivative data saved (1807 records). [2025-09-18T22:49:29.007832] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-09-18T22:49:29.017070] [INFO ] [MAIN ] Derivative Progress: 370/2075 symbols completed. CHN took 0.5s. Estimated remaining: 11m 4s. Rate: 154.1 symbols/min [2025-09-18T22:49:29.018002] [DEBUG] [LOCAL ] CHT: Loaded 19893 existing records from primary storage. [2025-09-18T22:49:29.018273] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:29.018375] [INFO ] [MAIN ] CHT: Loaded 19893 primary data records. [2025-09-18T22:49:29.144522] [DEBUG] [LOCAL ] CHPT: Loaded 50058 existing records from primary storage. [2025-09-18T22:49:29.145219] [INFO ] [MAIN ] CHPT: Loaded 50058 primary data records. [2025-09-18T22:49:29.737539] [DEBUG] [LOCAL ] CI: Loaded 50340 existing records from primary storage. [2025-09-18T22:49:29.738120] [INFO ] [MAIN ] CI: Loaded 50340 primary data records. [2025-09-18T22:49:30.082733] [DEBUG] [MAIN ] CHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:30.084519] [INFO ] [MAIN ] CHT: Generated 1807 derivative records from 19893 primary records. [2025-09-18T22:49:30.084883] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-09-18T22:49:30.113434] [DEBUG] [MAIN ] CHPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:30.116348] [INFO ] [MAIN ] CHPT: Generated 1807 derivative records from 50058 primary records. [2025-09-18T22:49:30.117418] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-09-18T22:49:30.136878] [DEBUG] [LOCAL ] CHT: Derivative data saved (1807 records). [2025-09-18T22:49:30.138112] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-09-18T22:49:30.140796] [INFO ] [MAIN ] Derivative Progress: 371/2075 symbols completed. CHT took 1.2s. Estimated remaining: 11m 7s. Rate: 153.4 symbols/min [2025-09-18T22:49:30.142000] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:30.144806] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1807 records). [2025-09-18T22:49:30.146946] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-09-18T22:49:30.150384] [INFO ] [MAIN ] Derivative Progress: 372/2075 symbols completed. CHPT took 1.2s. Estimated remaining: 11m 5s. Rate: 153.8 symbols/min [2025-09-18T22:49:30.151111] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:30.167501] [DEBUG] [MAIN ] CI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:30.168357] [INFO ] [MAIN ] CI: Generated 1807 derivative records from 50340 primary records. [2025-09-18T22:49:30.168502] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-09-18T22:49:30.195794] [DEBUG] [LOCAL ] CI: Derivative data saved (1807 records). [2025-09-18T22:49:30.205270] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-09-18T22:49:30.207704] [INFO ] [MAIN ] Derivative Progress: 373/2075 symbols completed. CI took 1.2s. Estimated remaining: 11m 3s. Rate: 154.1 symbols/min [2025-09-18T22:49:30.209059] [DEBUG] [LOCAL ] CIB: Loaded 31402 existing records from primary storage. [2025-09-18T22:49:30.209244] [INFO ] [MAIN ] CIB: Loaded 31402 primary data records. [2025-09-18T22:49:30.549627] [DEBUG] [LOCAL ] CIEN: Loaded 52491 existing records from primary storage. [2025-09-18T22:49:30.563589] [INFO ] [MAIN ] CIEN: Loaded 52491 primary data records. [2025-09-18T22:49:30.889461] [DEBUG] [MAIN ] CIB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:30.890588] [INFO ] [MAIN ] CIB: Generated 1807 derivative records from 31402 primary records. [2025-09-18T22:49:30.890998] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-09-18T22:49:30.908939] [DEBUG] [LOCAL ] CIB: Derivative data saved (1807 records). [2025-09-18T22:49:30.909049] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-09-18T22:49:30.911257] [INFO ] [MAIN ] Derivative Progress: 374/2075 symbols completed. CIB took 0.8s. Estimated remaining: 11m 4s. Rate: 153.8 symbols/min [2025-09-18T22:49:30.928110] [DEBUG] [MAIN ] CIEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:30.928673] [INFO ] [MAIN ] CIEN: Generated 1807 derivative records from 52491 primary records. [2025-09-18T22:49:30.928737] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-09-18T22:49:30.944315] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1807 records). [2025-09-18T22:49:30.944381] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-09-18T22:49:30.946709] [INFO ] [MAIN ] Derivative Progress: 375/2075 symbols completed. CIEN took 0.8s. Estimated remaining: 11m 2s. Rate: 154.1 symbols/min [2025-09-18T22:49:30.947248] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:30.947420] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:30.947467] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:30.956834] [DEBUG] [LOCAL ] CIF: Loaded 4548 existing records from primary storage. [2025-09-18T22:49:30.957047] [INFO ] [MAIN ] CIF: Loaded 4548 primary data records. [2025-09-18T22:49:31.052822] [DEBUG] [LOCAL ] CII: Loaded 15979 existing records from primary storage. [2025-09-18T22:49:31.069842] [INFO ] [MAIN ] CII: Loaded 15979 primary data records. [2025-09-18T22:49:31.267446] [DEBUG] [LOCAL ] CIG: Loaded 44042 existing records from primary storage. [2025-09-18T22:49:31.408095] [INFO ] [MAIN ] CIG: Loaded 44042 primary data records. [2025-09-18T22:49:32.015473] [DEBUG] [MAIN ] CIF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:32.016778] [INFO ] [MAIN ] CIF: Generated 1807 derivative records from 4548 primary records. [2025-09-18T22:49:32.017001] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-09-18T22:49:32.047119] [DEBUG] [MAIN ] CII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:32.049185] [INFO ] [MAIN ] CII: Generated 1807 derivative records from 15979 primary records. [2025-09-18T22:49:32.050030] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-09-18T22:49:32.051737] [DEBUG] [LOCAL ] CIF: Derivative data saved (1807 records). [2025-09-18T22:49:32.059184] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-09-18T22:49:32.062921] [INFO ] [MAIN ] Derivative Progress: 376/2075 symbols completed. CIF took 1.1s. Estimated remaining: 11m 5s. Rate: 153.4 symbols/min [2025-09-18T22:49:32.066236] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:32.086284] [DEBUG] [LOCAL ] CII: Derivative data saved (1807 records). [2025-09-18T22:49:32.086381] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-09-18T22:49:32.086710] [DEBUG] [MAIN ] CIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:32.089233] [INFO ] [MAIN ] Derivative Progress: 377/2075 symbols completed. CII took 1.1s. Estimated remaining: 11m 3s. Rate: 153.8 symbols/min [2025-09-18T22:49:32.090181] [INFO ] [MAIN ] CIG: Generated 1807 derivative records from 44042 primary records. [2025-09-18T22:49:32.090438] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:32.090978] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-09-18T22:49:32.108430] [DEBUG] [LOCAL ] CIG: Derivative data saved (1807 records). [2025-09-18T22:49:32.108773] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-09-18T22:49:32.111435] [INFO ] [MAIN ] Derivative Progress: 378/2075 symbols completed. CIG took 1.2s. Estimated remaining: 11m 1s. Rate: 154.2 symbols/min [2025-09-18T22:49:32.111920] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:32.115132] [DEBUG] [LOCAL ] CIMN: Loaded 2676 existing records from primary storage. [2025-09-18T22:49:32.115286] [INFO ] [MAIN ] CIMN: Loaded 2676 primary data records. [2025-09-18T22:49:32.251158] [DEBUG] [LOCAL ] CINT: Loaded 18294 existing records from primary storage. [2025-09-18T22:49:32.262027] [INFO ] [MAIN ] CINT: Loaded 18294 primary data records. [2025-09-18T22:49:32.278211] [DEBUG] [LOCAL ] CIM: Loaded 37425 existing records from primary storage. [2025-09-18T22:49:32.308087] [INFO ] [MAIN ] CIM: Loaded 37425 primary data records. [2025-09-18T22:49:33.126052] [DEBUG] [MAIN ] CIMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:33.127943] [INFO ] [MAIN ] CIMN: Generated 1807 derivative records from 2676 primary records. [2025-09-18T22:49:33.128294] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-09-18T22:49:33.160839] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1807 records). [2025-09-18T22:49:33.161158] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-09-18T22:49:33.161587] [DEBUG] [MAIN ] CINT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:33.169422] [INFO ] [MAIN ] CINT: Generated 1807 derivative records from 18294 primary records. [2025-09-18T22:49:33.166064] [INFO ] [MAIN ] Derivative Progress: 379/2075 symbols completed. CIMN took 1.1s. Estimated remaining: 11m 3s. Rate: 153.5 symbols/min [2025-09-18T22:49:33.169613] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-09-18T22:49:33.170909] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:33.199250] [DEBUG] [MAIN ] CIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:33.201060] [INFO ] [MAIN ] CIM: Generated 1807 derivative records from 37425 primary records. [2025-09-18T22:49:33.201979] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-09-18T22:49:33.227235] [DEBUG] [LOCAL ] CINT: Derivative data saved (1807 records). [2025-09-18T22:49:33.227357] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-09-18T22:49:33.226836] [DEBUG] [LOCAL ] CIM: Derivative data saved (1807 records). [2025-09-18T22:49:33.227475] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-09-18T22:49:33.230092] [INFO ] [MAIN ] Derivative Progress: 380/2075 symbols completed. CINT took 1.1s. Estimated remaining: 11m 1s. Rate: 153.8 symbols/min [2025-09-18T22:49:33.233201] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:33.233032] [INFO ] [MAIN ] Derivative Progress: 381/2075 symbols completed. CIM took 1.2s. Estimated remaining: 10m 59s. Rate: 154.2 symbols/min [2025-09-18T22:49:33.241982] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:33.255368] [DEBUG] [LOCAL ] CION: Loaded 29561 existing records from primary storage. [2025-09-18T22:49:33.255598] [INFO ] [MAIN ] CION: Loaded 29561 primary data records. [2025-09-18T22:49:33.698083] [DEBUG] [LOCAL ] CIVI: Loaded 52973 existing records from primary storage. [2025-09-18T22:49:33.697354] [DEBUG] [LOCAL ] CL: Loaded 54034 existing records from primary storage. [2025-09-18T22:49:33.698693] [INFO ] [MAIN ] CL: Loaded 54034 primary data records. [2025-09-18T22:49:33.698776] [INFO ] [MAIN ] CIVI: Loaded 52973 primary data records. [2025-09-18T22:49:34.350102] [DEBUG] [MAIN ] CION: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:34.352064] [INFO ] [MAIN ] CION: Generated 1807 derivative records from 29561 primary records. [2025-09-18T22:49:34.352417] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-09-18T22:49:34.376186] [DEBUG] [LOCAL ] CION: Derivative data saved (1807 records). [2025-09-18T22:49:34.376464] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-09-18T22:49:34.379362] [INFO ] [MAIN ] Derivative Progress: 382/2075 symbols completed. CION took 1.2s. Estimated remaining: 11m 2s. Rate: 153.4 symbols/min [2025-09-18T22:49:34.379947] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:34.399411] [DEBUG] [MAIN ] CL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:34.400488] [INFO ] [MAIN ] CL: Generated 1807 derivative records from 54034 primary records. [2025-09-18T22:49:34.401497] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-09-18T22:49:34.432492] [DEBUG] [MAIN ] CIVI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:34.442856] [DEBUG] [LOCAL ] CL: Derivative data saved (1807 records). [2025-09-18T22:49:34.442007] [INFO ] [MAIN ] CIVI: Generated 1807 derivative records from 52973 primary records. [2025-09-18T22:49:34.442999] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-09-18T22:49:34.443393] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-09-18T22:49:34.445507] [INFO ] [MAIN ] Derivative Progress: 383/2075 symbols completed. CL took 1.2s. Estimated remaining: 11m 0s. Rate: 153.8 symbols/min [2025-09-18T22:49:34.446268] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:34.465793] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1807 records). [2025-09-18T22:49:34.474397] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-09-18T22:49:34.478239] [INFO ] [MAIN ] Derivative Progress: 384/2075 symbols completed. CIVI took 1.2s. Estimated remaining: 10m 58s. Rate: 154.1 symbols/min [2025-09-18T22:49:34.478683] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:34.479414] [DEBUG] [LOCAL ] CLB: Loaded 33545 existing records from primary storage. [2025-09-18T22:49:34.479636] [INFO ] [MAIN ] CLB: Loaded 33545 primary data records. [2025-09-18T22:49:34.614626] [DEBUG] [LOCAL ] CLDT: Loaded 26416 existing records from primary storage. [2025-09-18T22:49:34.615130] [INFO ] [MAIN ] CLDT: Loaded 26416 primary data records. [2025-09-18T22:49:35.156916] [DEBUG] [LOCAL ] CLF: Loaded 54131 existing records from primary storage. [2025-09-18T22:49:35.157304] [INFO ] [MAIN ] CLF: Loaded 54131 primary data records. [2025-09-18T22:49:35.558232] [DEBUG] [MAIN ] CLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:35.557862] [DEBUG] [MAIN ] CLDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:35.559679] [INFO ] [MAIN ] CLB: Generated 1807 derivative records from 33545 primary records. [2025-09-18T22:49:35.559966] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-09-18T22:49:35.561732] [INFO ] [MAIN ] CLDT: Generated 1807 derivative records from 26416 primary records. [2025-09-18T22:49:35.561847] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-09-18T22:49:35.592200] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1807 records). [2025-09-18T22:49:35.593120] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-09-18T22:49:35.595986] [INFO ] [MAIN ] Derivative Progress: 385/2075 symbols completed. CLDT took 1.1s. Estimated remaining: 11m 1s. Rate: 153.4 symbols/min [2025-09-18T22:49:35.597150] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:35.602343] [DEBUG] [LOCAL ] CLB: Derivative data saved (1807 records). [2025-09-18T22:49:35.602731] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-09-18T22:49:35.604959] [INFO ] [MAIN ] Derivative Progress: 386/2075 symbols completed. CLB took 1.2s. Estimated remaining: 10m 59s. Rate: 153.8 symbols/min [2025-09-18T22:49:35.605334] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:35.627748] [DEBUG] [MAIN ] CLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:35.628780] [INFO ] [MAIN ] CLF: Generated 1807 derivative records from 54131 primary records. [2025-09-18T22:49:35.628988] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-09-18T22:49:35.654701] [DEBUG] [LOCAL ] CLF: Derivative data saved (1807 records). [2025-09-18T22:49:35.655019] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-09-18T22:49:35.658063] [INFO ] [MAIN ] Derivative Progress: 387/2075 symbols completed. CLF took 1.2s. Estimated remaining: 10m 57s. Rate: 154.1 symbols/min [2025-09-18T22:49:35.658563] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:35.669790] [DEBUG] [LOCAL ] CLH: Loaded 28807 existing records from primary storage. [2025-09-18T22:49:35.670033] [INFO ] [MAIN ] CLH: Loaded 28807 primary data records. [2025-09-18T22:49:35.803804] [DEBUG] [LOCAL ] CLW: Loaded 22217 existing records from primary storage. [2025-09-18T22:49:35.843283] [INFO ] [MAIN ] CLW: Loaded 22217 primary data records. [2025-09-18T22:49:36.025089] [DEBUG] [LOCAL ] CLVT: Loaded 52395 existing records from primary storage. [2025-09-18T22:49:36.070860] [INFO ] [MAIN ] CLVT: Loaded 52395 primary data records. [2025-09-18T22:49:36.671259] [DEBUG] [MAIN ] CLH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:36.673141] [INFO ] [MAIN ] CLH: Generated 1807 derivative records from 28807 primary records. [2025-09-18T22:49:36.673639] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-09-18T22:49:36.697824] [DEBUG] [LOCAL ] CLH: Derivative data saved (1807 records). [2025-09-18T22:49:36.698437] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-09-18T22:49:36.702020] [INFO ] [MAIN ] Derivative Progress: 388/2075 symbols completed. CLH took 1.1s. Estimated remaining: 10m 60s. Rate: 153.4 symbols/min [2025-09-18T22:49:36.732065] [DEBUG] [MAIN ] CLW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:36.733185] [INFO ] [MAIN ] CLW: Generated 1807 derivative records from 22217 primary records. [2025-09-18T22:49:36.733273] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-09-18T22:49:36.732457] [DEBUG] [MAIN ] CLVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:36.733898] [INFO ] [MAIN ] CLVT: Generated 1807 derivative records from 52395 primary records. [2025-09-18T22:49:36.734246] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-09-18T22:49:36.763500] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1807 records). [2025-09-18T22:49:36.764183] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-09-18T22:49:36.766783] [INFO ] [MAIN ] Derivative Progress: 389/2075 symbols completed. CLVT took 1.2s. Estimated remaining: 10m 58s. Rate: 153.8 symbols/min [2025-09-18T22:49:36.769067] [DEBUG] [LOCAL ] CLW: Derivative data saved (1807 records). [2025-09-18T22:49:36.769133] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-09-18T22:49:36.771192] [INFO ] [MAIN ] Derivative Progress: 390/2075 symbols completed. CLW took 1.1s. Estimated remaining: 10m 56s. Rate: 154.2 symbols/min [2025-09-18T22:49:36.771994] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:36.772234] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:36.772335] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:36.827405] [DEBUG] [LOCAL ] CMA: Loaded 50675 existing records from primary storage. [2025-09-18T22:49:36.827679] [INFO ] [MAIN ] CMA: Loaded 50675 primary data records. [2025-09-18T22:49:37.069094] [DEBUG] [LOCAL ] CM: Loaded 49009 existing records from primary storage. [2025-09-18T22:49:37.182233] [INFO ] [MAIN ] CM: Loaded 49009 primary data records. [2025-09-18T22:49:37.218330] [DEBUG] [LOCAL ] CLX: Loaded 51779 existing records from primary storage. [2025-09-18T22:49:37.239338] [INFO ] [MAIN ] CLX: Loaded 51779 primary data records. [2025-09-18T22:49:37.930279] [DEBUG] [MAIN ] CMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:37.932000] [INFO ] [MAIN ] CMA: Generated 1807 derivative records from 50675 primary records. [2025-09-18T22:49:37.932342] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-09-18T22:49:37.956734] [DEBUG] [LOCAL ] CMA: Derivative data saved (1807 records). [2025-09-18T22:49:37.964734] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-09-18T22:49:37.972389] [INFO ] [MAIN ] Derivative Progress: 391/2075 symbols completed. CMA took 1.2s. Estimated remaining: 10m 59s. Rate: 153.3 symbols/min [2025-09-18T22:49:37.973337] [DEBUG] [MAIN ] CM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:37.973787] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:37.974634] [INFO ] [MAIN ] CM: Generated 1807 derivative records from 49009 primary records. [2025-09-18T22:49:37.974926] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-09-18T22:49:38.009218] [DEBUG] [LOCAL ] CM: Derivative data saved (1807 records). [2025-09-18T22:49:38.007935] [DEBUG] [MAIN ] CLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:38.009452] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-09-18T22:49:38.010433] [INFO ] [MAIN ] CLX: Generated 1807 derivative records from 51779 primary records. [2025-09-18T22:49:38.012472] [INFO ] [MAIN ] Derivative Progress: 392/2075 symbols completed. CM took 1.2s. Estimated remaining: 10m 57s. Rate: 153.7 symbols/min [2025-09-18T22:49:38.012893] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:38.013042] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-09-18T22:49:38.036327] [DEBUG] [LOCAL ] CMCM: Loaded 4678 existing records from primary storage. [2025-09-18T22:49:38.037270] [INFO ] [MAIN ] CMCM: Loaded 4678 primary data records. [2025-09-18T22:49:38.118221] [DEBUG] [LOCAL ] CLX: Derivative data saved (1807 records). [2025-09-18T22:49:38.135742] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-09-18T22:49:38.144531] [INFO ] [MAIN ] Derivative Progress: 393/2075 symbols completed. CLX took 1.4s. Estimated remaining: 10m 56s. Rate: 154.0 symbols/min [2025-09-18T22:49:38.163604] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:38.210476] [DEBUG] [LOCAL ] CMC: Loaded 46140 existing records from primary storage. [2025-09-18T22:49:38.230819] [INFO ] [MAIN ] CMC: Loaded 46140 primary data records. [2025-09-18T22:49:38.724580] [DEBUG] [LOCAL ] CMG: Loaded 54110 existing records from primary storage. [2025-09-18T22:49:38.724933] [INFO ] [MAIN ] CMG: Loaded 54110 primary data records. [2025-09-18T22:49:39.000037] [DEBUG] [MAIN ] CMCM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:39.053395] [INFO ] [MAIN ] CMCM: Generated 1807 derivative records from 4678 primary records. [2025-09-18T22:49:39.053838] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-09-18T22:49:39.070994] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1807 records). [2025-09-18T22:49:39.072856] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-09-18T22:49:39.075296] [INFO ] [MAIN ] Derivative Progress: 394/2075 symbols completed. CMCM took 1.1s. Estimated remaining: 10m 57s. Rate: 153.4 symbols/min [2025-09-18T22:49:39.076165] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:39.089973] [DEBUG] [MAIN ] CMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:39.090914] [INFO ] [MAIN ] CMC: Generated 1807 derivative records from 46140 primary records. [2025-09-18T22:49:39.091112] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-09-18T22:49:39.110296] [DEBUG] [LOCAL ] CMC: Derivative data saved (1807 records). [2025-09-18T22:49:39.110803] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-09-18T22:49:39.113495] [INFO ] [MAIN ] Derivative Progress: 395/2075 symbols completed. CMC took 1.1s. Estimated remaining: 10m 56s. Rate: 153.8 symbols/min [2025-09-18T22:49:39.113920] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:39.140427] [DEBUG] [MAIN ] CMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:39.141345] [INFO ] [MAIN ] CMG: Generated 1807 derivative records from 54110 primary records. [2025-09-18T22:49:39.141501] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-09-18T22:49:39.171885] [DEBUG] [LOCAL ] CMI: Loaded 42298 existing records from primary storage. [2025-09-18T22:49:39.173295] [INFO ] [MAIN ] CMI: Loaded 42298 primary data records. [2025-09-18T22:49:39.212771] [DEBUG] [LOCAL ] CMG: Derivative data saved (1807 records). [2025-09-18T22:49:39.237420] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-09-18T22:49:39.271517] [INFO ] [MAIN ] Derivative Progress: 396/2075 symbols completed. CMG took 1.1s. Estimated remaining: 10m 54s. Rate: 154.0 symbols/min [2025-09-18T22:49:39.277910] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:39.302316] [DEBUG] [LOCAL ] CMP: Loaded 36915 existing records from primary storage. [2025-09-18T22:49:39.313787] [INFO ] [MAIN ] CMP: Loaded 36915 primary data records. [2025-09-18T22:49:39.821712] [DEBUG] [LOCAL ] CMRE: Loaded 35979 existing records from primary storage. [2025-09-18T22:49:39.882794] [INFO ] [MAIN ] CMRE: Loaded 35979 primary data records. [2025-09-18T22:49:40.235900] [DEBUG] [MAIN ] CMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:40.237083] [INFO ] [MAIN ] CMI: Generated 1807 derivative records from 42298 primary records. [2025-09-18T22:49:40.237529] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-09-18T22:49:40.274966] [DEBUG] [MAIN ] CMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:40.275162] [DEBUG] [LOCAL ] CMI: Derivative data saved (1807 records). [2025-09-18T22:49:40.276467] [INFO ] [MAIN ] CMP: Generated 1807 derivative records from 36915 primary records. [2025-09-18T22:49:40.276692] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-09-18T22:49:40.276551] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-09-18T22:49:40.279113] [INFO ] [MAIN ] Derivative Progress: 397/2075 symbols completed. CMI took 1.2s. Estimated remaining: 10m 56s. Rate: 153.4 symbols/min [2025-09-18T22:49:40.280195] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:40.298613] [DEBUG] [LOCAL ] CMP: Derivative data saved (1807 records). [2025-09-18T22:49:40.298867] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-09-18T22:49:40.301595] [INFO ] [MAIN ] Derivative Progress: 398/2075 symbols completed. CMP took 1.2s. Estimated remaining: 10m 54s. Rate: 153.7 symbols/min [2025-09-18T22:49:40.302868] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:40.320012] [DEBUG] [MAIN ] CMRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:40.320871] [INFO ] [MAIN ] CMRE: Generated 1807 derivative records from 35979 primary records. [2025-09-18T22:49:40.321016] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-09-18T22:49:40.324500] [DEBUG] [LOCAL ] CMSA: Loaded 3384 existing records from primary storage. [2025-09-18T22:49:40.324832] [INFO ] [MAIN ] CMSA: Loaded 3384 primary data records. [2025-09-18T22:49:40.561630] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1807 records). [2025-09-18T22:49:40.708495] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-09-18T22:49:40.711180] [INFO ] [MAIN ] Derivative Progress: 399/2075 symbols completed. CMRE took 1.4s. Estimated remaining: 10m 54s. Rate: 153.7 symbols/min [2025-09-18T22:49:40.711595] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:40.712875] [DEBUG] [LOCAL ] CMS: Loaded 53032 existing records from primary storage. [2025-09-18T22:49:40.713861] [INFO ] [MAIN ] CMS: Loaded 53032 primary data records. [2025-09-18T22:49:40.828229] [DEBUG] [LOCAL ] CMSC: Loaded 5156 existing records from primary storage. [2025-09-18T22:49:40.828410] [INFO ] [MAIN ] CMSC: Loaded 5156 primary data records. [2025-09-18T22:49:41.382026] [DEBUG] [MAIN ] CMSA: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:49:41.384095] [INFO ] [MAIN ] CMSA: Generated 1806 derivative records from 3384 primary records. [2025-09-18T22:49:41.384340] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-09-18T22:49:41.419952] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1806 records). [2025-09-18T22:49:41.419491] [DEBUG] [MAIN ] CMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:41.420084] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-09-18T22:49:41.422511] [INFO ] [MAIN ] Derivative Progress: 400/2075 symbols completed. CMSA took 1.1s. Estimated remaining: 10m 55s. Rate: 153.4 symbols/min [2025-09-18T22:49:41.424422] [INFO ] [MAIN ] CMS: Generated 1807 derivative records from 53032 primary records. [2025-09-18T22:49:41.424814] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-09-18T22:49:41.425917] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:41.454805] [DEBUG] [MAIN ] CMSC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:41.457418] [INFO ] [MAIN ] CMSC: Generated 1807 derivative records from 5156 primary records. [2025-09-18T22:49:41.461063] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-09-18T22:49:41.462634] [DEBUG] [LOCAL ] CMS: Derivative data saved (1807 records). [2025-09-18T22:49:41.473424] [DEBUG] [LOCAL ] CMSD: Loaded 8213 existing records from primary storage. [2025-09-18T22:49:41.473692] [INFO ] [MAIN ] CMSD: Loaded 8213 primary data records. [2025-09-18T22:49:41.473524] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-09-18T22:49:41.479998] [INFO ] [MAIN ] Derivative Progress: 401/2075 symbols completed. CMS took 1.2s. Estimated remaining: 10m 53s. Rate: 153.7 symbols/min [2025-09-18T22:49:41.512767] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:41.599260] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1807 records). [2025-09-18T22:49:41.610187] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-09-18T22:49:41.638210] [INFO ] [MAIN ] Derivative Progress: 402/2075 symbols completed. CMSC took 0.9s. Estimated remaining: 10m 52s. Rate: 154.0 symbols/min [2025-09-18T22:49:41.656598] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:41.860814] [DEBUG] [LOCAL ] CMU: Loaded 7421 existing records from primary storage. [2025-09-18T22:49:41.861107] [INFO ] [MAIN ] CMU: Loaded 7421 primary data records. [2025-09-18T22:49:41.952872] [DEBUG] [LOCAL ] CMTG: Loaded 38077 existing records from primary storage. [2025-09-18T22:49:41.981040] [INFO ] [MAIN ] CMTG: Loaded 38077 primary data records. [2025-09-18T22:49:42.538816] [DEBUG] [MAIN ] CMSD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:42.541729] [INFO ] [MAIN ] CMSD: Generated 1807 derivative records from 8213 primary records. [2025-09-18T22:49:42.542094] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-09-18T22:49:42.562239] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1807 records). [2025-09-18T22:49:42.562851] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-09-18T22:49:42.565114] [INFO ] [MAIN ] Derivative Progress: 403/2075 symbols completed. CMSD took 1.1s. Estimated remaining: 10m 54s. Rate: 153.4 symbols/min [2025-09-18T22:49:42.586555] [DEBUG] [MAIN ] CMU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:42.589301] [INFO ] [MAIN ] CMU: Generated 1807 derivative records from 7421 primary records. [2025-09-18T22:49:42.589607] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-09-18T22:49:42.602946] [DEBUG] [MAIN ] CMTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:42.604121] [INFO ] [MAIN ] CMTG: Generated 1807 derivative records from 38077 primary records. [2025-09-18T22:49:42.604509] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-09-18T22:49:42.634161] [DEBUG] [LOCAL ] CMU: Derivative data saved (1807 records). [2025-09-18T22:49:42.634509] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-09-18T22:49:42.637617] [INFO ] [MAIN ] Derivative Progress: 404/2075 symbols completed. CMU took 1.0s. Estimated remaining: 10m 52s. Rate: 153.8 symbols/min [2025-09-18T22:49:42.639007] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1807 records). [2025-09-18T22:49:42.639114] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-09-18T22:49:42.641961] [INFO ] [MAIN ] Derivative Progress: 405/2075 symbols completed. CMTG took 1.1s. Estimated remaining: 10m 50s. Rate: 154.1 symbols/min [2025-09-18T22:49:42.642569] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:42.642751] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:42.642944] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:42.656071] [DEBUG] [LOCAL ] CNF: Loaded 10837 existing records from primary storage. [2025-09-18T22:49:42.656277] [INFO ] [MAIN ] CNF: Loaded 10837 primary data records. [2025-09-18T22:49:42.880044] [DEBUG] [LOCAL ] CNA: Loaded 33018 existing records from primary storage. [2025-09-18T22:49:42.880478] [INFO ] [MAIN ] CNA: Loaded 33018 primary data records. [2025-09-18T22:49:43.057233] [DEBUG] [LOCAL ] CNC: Loaded 54119 existing records from primary storage. [2025-09-18T22:49:43.084362] [INFO ] [MAIN ] CNC: Loaded 54119 primary data records. [2025-09-18T22:49:43.663310] [DEBUG] [MAIN ] CNF: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:49:43.664595] [INFO ] [MAIN ] CNF: Generated 1806 derivative records from 10837 primary records. [2025-09-18T22:49:43.664806] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-09-18T22:49:43.683087] [DEBUG] [LOCAL ] CNF: Derivative data saved (1806 records). [2025-09-18T22:49:43.683415] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-09-18T22:49:43.686011] [INFO ] [MAIN ] Derivative Progress: 406/2075 symbols completed. CNF took 1.0s. Estimated remaining: 10m 52s. Rate: 153.5 symbols/min [2025-09-18T22:49:43.686953] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:43.715348] [DEBUG] [MAIN ] CNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:43.720977] [INFO ] [MAIN ] CNA: Generated 1807 derivative records from 33018 primary records. [2025-09-18T22:49:43.721303] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-09-18T22:49:43.721665] [DEBUG] [MAIN ] CNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:43.723521] [INFO ] [MAIN ] CNC: Generated 1807 derivative records from 54119 primary records. [2025-09-18T22:49:43.732053] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-09-18T22:49:43.768765] [DEBUG] [LOCAL ] CNA: Derivative data saved (1807 records). [2025-09-18T22:49:43.768968] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-09-18T22:49:43.771232] [INFO ] [MAIN ] Derivative Progress: 407/2075 symbols completed. CNA took 1.1s. Estimated remaining: 10m 51s. Rate: 153.8 symbols/min [2025-09-18T22:49:43.772037] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:43.773872] [DEBUG] [LOCAL ] CNC: Derivative data saved (1807 records). [2025-09-18T22:49:43.774087] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-09-18T22:49:43.777280] [INFO ] [MAIN ] Derivative Progress: 408/2075 symbols completed. CNC took 1.1s. Estimated remaining: 10m 49s. Rate: 154.2 symbols/min [2025-09-18T22:49:43.777866] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:43.795085] [DEBUG] [LOCAL ] CNI: Loaded 52046 existing records from primary storage. [2025-09-18T22:49:43.795327] [INFO ] [MAIN ] CNI: Loaded 52046 primary data records. [2025-09-18T22:49:44.160016] [DEBUG] [LOCAL ] CNM: Loaded 51337 existing records from primary storage. [2025-09-18T22:49:44.161515] [INFO ] [MAIN ] CNM: Loaded 51337 primary data records. [2025-09-18T22:49:44.255246] [DEBUG] [LOCAL ] CNK: Loaded 53299 existing records from primary storage. [2025-09-18T22:49:44.288985] [INFO ] [MAIN ] CNK: Loaded 53299 primary data records. [2025-09-18T22:49:44.843139] [DEBUG] [MAIN ] CNI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:44.844159] [INFO ] [MAIN ] CNI: Generated 1807 derivative records from 52046 primary records. [2025-09-18T22:49:44.845767] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-09-18T22:49:44.865245] [DEBUG] [LOCAL ] CNI: Derivative data saved (1807 records). [2025-09-18T22:49:44.865818] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-09-18T22:49:44.868568] [INFO ] [MAIN ] Derivative Progress: 409/2075 symbols completed. CNI took 1.2s. Estimated remaining: 10m 51s. Rate: 153.5 symbols/min [2025-09-18T22:49:44.869403] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:44.889969] [DEBUG] [MAIN ] CNM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:44.890769] [INFO ] [MAIN ] CNM: Generated 1807 derivative records from 51337 primary records. [2025-09-18T22:49:44.891012] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-09-18T22:49:44.908604] [DEBUG] [LOCAL ] CNM: Derivative data saved (1807 records). [2025-09-18T22:49:44.910680] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-09-18T22:49:44.912848] [INFO ] [MAIN ] Derivative Progress: 410/2075 symbols completed. CNM took 1.1s. Estimated remaining: 10m 49s. Rate: 153.8 symbols/min [2025-09-18T22:49:44.913428] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:44.926926] [DEBUG] [MAIN ] CNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:44.936604] [INFO ] [MAIN ] CNK: Generated 1807 derivative records from 53299 primary records. [2025-09-18T22:49:44.936872] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-09-18T22:49:44.960830] [DEBUG] [LOCAL ] CNMD: Loaded 32887 existing records from primary storage. [2025-09-18T22:49:44.961606] [INFO ] [MAIN ] CNMD: Loaded 32887 primary data records. [2025-09-18T22:49:45.001143] [DEBUG] [LOCAL ] CNK: Derivative data saved (1807 records). [2025-09-18T22:49:45.028686] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-09-18T22:49:45.031610] [INFO ] [MAIN ] Derivative Progress: 411/2075 symbols completed. CNK took 1.3s. Estimated remaining: 10m 48s. Rate: 154.1 symbols/min [2025-09-18T22:49:45.058094] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:45.176123] [DEBUG] [LOCAL ] CNNE: Loaded 37218 existing records from primary storage. [2025-09-18T22:49:45.292576] [INFO ] [MAIN ] CNNE: Loaded 37218 primary data records. [2025-09-18T22:49:45.496855] [DEBUG] [LOCAL ] CNO: Loaded 41931 existing records from primary storage. [2025-09-18T22:49:45.501445] [INFO ] [MAIN ] CNO: Loaded 41931 primary data records. [2025-09-18T22:49:46.002814] [DEBUG] [MAIN ] CNMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:46.005106] [INFO ] [MAIN ] CNMD: Generated 1807 derivative records from 32887 primary records. [2025-09-18T22:49:46.006057] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-09-18T22:49:46.023953] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1807 records). [2025-09-18T22:49:46.026124] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-09-18T22:49:46.028093] [INFO ] [MAIN ] Derivative Progress: 412/2075 symbols completed. CNMD took 1.2s. Estimated remaining: 10m 50s. Rate: 153.5 symbols/min [2025-09-18T22:49:46.030347] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:46.046119] [DEBUG] [MAIN ] CNNE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:46.046937] [INFO ] [MAIN ] CNNE: Generated 1807 derivative records from 37218 primary records. [2025-09-18T22:49:46.047106] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-09-18T22:49:46.064173] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1807 records). [2025-09-18T22:49:46.064348] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-09-18T22:49:46.067700] [INFO ] [MAIN ] Derivative Progress: 413/2075 symbols completed. CNNE took 1.2s. Estimated remaining: 10m 48s. Rate: 153.8 symbols/min [2025-09-18T22:49:46.068232] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:46.083562] [DEBUG] [MAIN ] CNO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:46.084385] [INFO ] [MAIN ] CNO: Generated 1807 derivative records from 41931 primary records. [2025-09-18T22:49:46.084488] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-09-18T22:49:46.126528] [DEBUG] [LOCAL ] CNO: Derivative data saved (1807 records). [2025-09-18T22:49:46.127391] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-09-18T22:49:46.127236] [DEBUG] [LOCAL ] CNS: Loaded 21340 existing records from primary storage. [2025-09-18T22:49:46.130384] [INFO ] [MAIN ] Derivative Progress: 414/2075 symbols completed. CNO took 1.1s. Estimated remaining: 10m 47s. Rate: 154.1 symbols/min [2025-09-18T22:49:46.130740] [INFO ] [MAIN ] CNS: Loaded 21340 primary data records. [2025-09-18T22:49:46.136276] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:46.249025] [DEBUG] [LOCAL ] CNP: Loaded 53859 existing records from primary storage. [2025-09-18T22:49:46.252614] [INFO ] [MAIN ] CNP: Loaded 53859 primary data records. [2025-09-18T22:49:46.785930] [DEBUG] [LOCAL ] CNX: Loaded 51751 existing records from primary storage. [2025-09-18T22:49:46.786137] [INFO ] [MAIN ] CNX: Loaded 51751 primary data records. [2025-09-18T22:49:47.107025] [DEBUG] [MAIN ] CNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:47.108568] [INFO ] [MAIN ] CNS: Generated 1807 derivative records from 21340 primary records. [2025-09-18T22:49:47.108741] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-09-18T22:49:47.143212] [DEBUG] [MAIN ] CNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:47.144266] [INFO ] [MAIN ] CNP: Generated 1807 derivative records from 53859 primary records. [2025-09-18T22:49:47.143466] [DEBUG] [LOCAL ] CNS: Derivative data saved (1807 records). [2025-09-18T22:49:47.144484] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-09-18T22:49:47.145069] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-09-18T22:49:47.147432] [INFO ] [MAIN ] Derivative Progress: 415/2075 symbols completed. CNS took 1.1s. Estimated remaining: 10m 49s. Rate: 153.5 symbols/min [2025-09-18T22:49:47.148315] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:47.167708] [DEBUG] [LOCAL ] CNP: Derivative data saved (1807 records). [2025-09-18T22:49:47.168554] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-09-18T22:49:47.171100] [INFO ] [MAIN ] Derivative Progress: 416/2075 symbols completed. CNP took 1.1s. Estimated remaining: 10m 47s. Rate: 153.9 symbols/min [2025-09-18T22:49:47.171543] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:47.185755] [DEBUG] [MAIN ] CNX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:47.186536] [INFO ] [MAIN ] CNX: Generated 1807 derivative records from 51751 primary records. [2025-09-18T22:49:47.186776] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-09-18T22:49:47.211536] [DEBUG] [LOCAL ] CNX: Derivative data saved (1807 records). [2025-09-18T22:49:47.211685] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-09-18T22:49:47.214179] [INFO ] [MAIN ] Derivative Progress: 417/2075 symbols completed. CNX took 1.1s. Estimated remaining: 10m 45s. Rate: 154.2 symbols/min [2025-09-18T22:49:47.214591] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:47.234907] [DEBUG] [LOCAL ] CODI: Loaded 39862 existing records from primary storage. [2025-09-18T22:49:47.235132] [INFO ] [MAIN ] CODI: Loaded 39862 primary data records. [2025-09-18T22:49:47.575320] [DEBUG] [LOCAL ] COHR: Loaded 53762 existing records from primary storage. [2025-09-18T22:49:47.576094] [INFO ] [MAIN ] COHR: Loaded 53762 primary data records. [2025-09-18T22:49:47.667204] [DEBUG] [LOCAL ] COLD: Loaded 52280 existing records from primary storage. [2025-09-18T22:49:47.702397] [INFO ] [MAIN ] COLD: Loaded 52280 primary data records. [2025-09-18T22:49:48.260954] [DEBUG] [MAIN ] CODI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:48.262360] [INFO ] [MAIN ] CODI: Generated 1807 derivative records from 39862 primary records. [2025-09-18T22:49:48.262973] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-09-18T22:49:48.285570] [DEBUG] [LOCAL ] CODI: Derivative data saved (1807 records). [2025-09-18T22:49:48.286080] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-09-18T22:49:48.288811] [INFO ] [MAIN ] Derivative Progress: 418/2075 symbols completed. CODI took 1.1s. Estimated remaining: 10m 47s. Rate: 153.6 symbols/min [2025-09-18T22:49:48.301706] [DEBUG] [MAIN ] COHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:48.302621] [INFO ] [MAIN ] COHR: Generated 1807 derivative records from 53762 primary records. [2025-09-18T22:49:48.302800] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-09-18T22:49:48.331168] [DEBUG] [MAIN ] COLD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:48.332258] [INFO ] [MAIN ] COLD: Generated 1807 derivative records from 52280 primary records. [2025-09-18T22:49:48.333752] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-09-18T22:49:48.334816] [DEBUG] [LOCAL ] COHR: Derivative data saved (1807 records). [2025-09-18T22:49:48.335126] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-09-18T22:49:48.337153] [INFO ] [MAIN ] Derivative Progress: 419/2075 symbols completed. COHR took 1.2s. Estimated remaining: 10m 46s. Rate: 153.9 symbols/min [2025-09-18T22:49:48.352514] [DEBUG] [LOCAL ] COLD: Derivative data saved (1807 records). [2025-09-18T22:49:48.352578] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-09-18T22:49:48.356708] [INFO ] [MAIN ] Derivative Progress: 420/2075 symbols completed. COLD took 1.1s. Estimated remaining: 10m 44s. Rate: 154.2 symbols/min [2025-09-18T22:49:48.357203] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:48.357445] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:48.357663] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:48.392993] [DEBUG] [LOCAL ] COOK: Loaded 24332 existing records from primary storage. [2025-09-18T22:49:48.405448] [INFO ] [MAIN ] COOK: Loaded 24332 primary data records. [2025-09-18T22:49:48.520606] [DEBUG] [LOCAL ] CON: Loaded 39213 existing records from primary storage. [2025-09-18T22:49:48.543587] [INFO ] [MAIN ] CON: Loaded 39213 primary data records. [2025-09-18T22:49:48.572066] [DEBUG] [LOCAL ] COMP: Loaded 53771 existing records from primary storage. [2025-09-18T22:49:48.596999] [INFO ] [MAIN ] COMP: Loaded 53771 primary data records. [2025-09-18T22:49:49.375872] [DEBUG] [MAIN ] COOK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:49.377763] [INFO ] [MAIN ] COOK: Generated 1807 derivative records from 24332 primary records. [2025-09-18T22:49:49.379280] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-09-18T22:49:49.407845] [DEBUG] [MAIN ] CON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:49.409241] [INFO ] [MAIN ] CON: Generated 1807 derivative records from 39213 primary records. [2025-09-18T22:49:49.409662] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-09-18T22:49:49.430511] [DEBUG] [MAIN ] COMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:49.432609] [INFO ] [MAIN ] COMP: Generated 1807 derivative records from 53771 primary records. [2025-09-18T22:49:49.435971] [DEBUG] [LOCAL ] COOK: Derivative data saved (1807 records). [2025-09-18T22:49:49.436506] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-09-18T22:49:49.437197] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-09-18T22:49:49.439754] [INFO ] [MAIN ] Derivative Progress: 421/2075 symbols completed. COOK took 1.1s. Estimated remaining: 10m 46s. Rate: 153.6 symbols/min [2025-09-18T22:49:49.441054] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:49.454951] [DEBUG] [LOCAL ] CON: Derivative data saved (1807 records). [2025-09-18T22:49:49.455254] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-09-18T22:49:49.458055] [INFO ] [MAIN ] Derivative Progress: 422/2075 symbols completed. CON took 1.1s. Estimated remaining: 10m 44s. Rate: 153.9 symbols/min [2025-09-18T22:49:49.458812] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:49.462679] [DEBUG] [LOCAL ] COMP: Derivative data saved (1807 records). [2025-09-18T22:49:49.462850] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-09-18T22:49:49.465793] [INFO ] [MAIN ] Derivative Progress: 423/2075 symbols completed. COMP took 1.1s. Estimated remaining: 10m 42s. Rate: 154.3 symbols/min [2025-09-18T22:49:49.466078] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:49.534070] [DEBUG] [LOCAL ] COR: Loaded 47685 existing records from primary storage. [2025-09-18T22:49:49.535320] [INFO ] [MAIN ] COR: Loaded 47685 primary data records. [2025-09-18T22:49:49.649112] [DEBUG] [LOCAL ] COP: Loaded 54117 existing records from primary storage. [2025-09-18T22:49:49.654837] [INFO ] [MAIN ] COP: Loaded 54117 primary data records. [2025-09-18T22:49:49.677118] [DEBUG] [LOCAL ] COUR: Loaded 49223 existing records from primary storage. [2025-09-18T22:49:49.748007] [INFO ] [MAIN ] COUR: Loaded 49223 primary data records. [2025-09-18T22:49:50.535526] [DEBUG] [MAIN ] COR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:50.538390] [INFO ] [MAIN ] COR: Generated 1807 derivative records from 47685 primary records. [2025-09-18T22:49:50.539621] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-09-18T22:49:50.566967] [DEBUG] [MAIN ] COP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:50.568084] [INFO ] [MAIN ] COP: Generated 1807 derivative records from 54117 primary records. [2025-09-18T22:49:50.568626] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-09-18T22:49:50.602199] [DEBUG] [MAIN ] COUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:50.604326] [INFO ] [MAIN ] COUR: Generated 1807 derivative records from 49223 primary records. [2025-09-18T22:49:50.605444] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-09-18T22:49:50.605880] [DEBUG] [LOCAL ] COR: Derivative data saved (1807 records). [2025-09-18T22:49:50.607316] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-09-18T22:49:50.609777] [INFO ] [MAIN ] Derivative Progress: 424/2075 symbols completed. COR took 1.2s. Estimated remaining: 10m 45s. Rate: 153.6 symbols/min [2025-09-18T22:49:50.622211] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:50.627522] [DEBUG] [LOCAL ] COP: Derivative data saved (1807 records). [2025-09-18T22:49:50.627043] [DEBUG] [LOCAL ] COUR: Derivative data saved (1807 records). [2025-09-18T22:49:50.628003] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-09-18T22:49:50.630932] [INFO ] [MAIN ] Derivative Progress: 425/2075 symbols completed. COP took 1.2s. Estimated remaining: 10m 43s. Rate: 153.9 symbols/min [2025-09-18T22:49:50.631184] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-09-18T22:49:50.634534] [INFO ] [MAIN ] Derivative Progress: 426/2075 symbols completed. COUR took 1.2s. Estimated remaining: 10m 41s. Rate: 154.3 symbols/min [2025-09-18T22:49:50.634664] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:50.634975] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:50.682872] [DEBUG] [LOCAL ] CPAY: Loaded 31613 existing records from primary storage. [2025-09-18T22:49:50.691470] [INFO ] [MAIN ] CPAY: Loaded 31613 primary data records. [2025-09-18T22:49:50.823023] [DEBUG] [LOCAL ] CPA: Loaded 29299 existing records from primary storage. [2025-09-18T22:49:50.823726] [DEBUG] [LOCAL ] CP: Loaded 53681 existing records from primary storage. [2025-09-18T22:49:50.824325] [INFO ] [MAIN ] CP: Loaded 53681 primary data records. [2025-09-18T22:49:50.834844] [INFO ] [MAIN ] CPA: Loaded 29299 primary data records. [2025-09-18T22:49:51.693253] [DEBUG] [MAIN ] CPAY: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:49:51.694231] [INFO ] [MAIN ] CPAY: Generated 1806 derivative records from 31613 primary records. [2025-09-18T22:49:51.695064] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-09-18T22:49:51.726688] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1806 records). [2025-09-18T22:49:51.727373] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-09-18T22:49:51.731042] [INFO ] [MAIN ] Derivative Progress: 427/2075 symbols completed. CPAY took 1.1s. Estimated remaining: 10m 44s. Rate: 153.6 symbols/min [2025-09-18T22:49:51.731622] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:51.732267] [DEBUG] [MAIN ] CPA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:51.733486] [INFO ] [MAIN ] CPA: Generated 1807 derivative records from 29299 primary records. [2025-09-18T22:49:51.733754] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-09-18T22:49:51.763168] [DEBUG] [LOCAL ] CPA: Derivative data saved (1807 records). [2025-09-18T22:49:51.763358] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-09-18T22:49:51.759046] [DEBUG] [MAIN ] CP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:51.765775] [INFO ] [MAIN ] Derivative Progress: 428/2075 symbols completed. CPA took 1.1s. Estimated remaining: 10m 42s. Rate: 154.0 symbols/min [2025-09-18T22:49:51.767079] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:51.766999] [INFO ] [MAIN ] CP: Generated 1807 derivative records from 53681 primary records. [2025-09-18T22:49:51.771140] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-09-18T22:49:51.791189] [DEBUG] [LOCAL ] CPK: Loaded 13277 existing records from primary storage. [2025-09-18T22:49:51.792126] [INFO ] [MAIN ] CPK: Loaded 13277 primary data records. [2025-09-18T22:49:51.875229] [DEBUG] [LOCAL ] CP: Derivative data saved (1807 records). [2025-09-18T22:49:51.892675] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-09-18T22:49:51.912764] [INFO ] [MAIN ] Derivative Progress: 429/2075 symbols completed. CP took 1.3s. Estimated remaining: 10m 40s. Rate: 154.2 symbols/min [2025-09-18T22:49:51.913589] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:52.164975] [DEBUG] [LOCAL ] CPRI: Loaded 52972 existing records from primary storage. [2025-09-18T22:49:52.166010] [INFO ] [MAIN ] CPRI: Loaded 52972 primary data records. [2025-09-18T22:49:52.494262] [DEBUG] [LOCAL ] CPT: Loaded 44714 existing records from primary storage. [2025-09-18T22:49:52.495681] [INFO ] [MAIN ] CPT: Loaded 44714 primary data records. [2025-09-18T22:49:52.628113] [DEBUG] [MAIN ] CPK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:52.702067] [INFO ] [MAIN ] CPK: Generated 1807 derivative records from 13277 primary records. [2025-09-18T22:49:52.702303] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-09-18T22:49:52.840873] [DEBUG] [LOCAL ] CPK: Derivative data saved (1807 records). [2025-09-18T22:49:52.841751] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-09-18T22:49:52.845066] [INFO ] [MAIN ] Derivative Progress: 430/2075 symbols completed. CPK took 1.1s. Estimated remaining: 10m 42s. Rate: 153.7 symbols/min [2025-09-18T22:49:52.846049] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:52.862995] [DEBUG] [MAIN ] CPRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:52.863995] [INFO ] [MAIN ] CPRI: Generated 1807 derivative records from 52972 primary records. [2025-09-18T22:49:52.864621] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-09-18T22:49:52.882661] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1807 records). [2025-09-18T22:49:52.883003] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-09-18T22:49:52.885780] [INFO ] [MAIN ] Derivative Progress: 431/2075 symbols completed. CPRI took 1.1s. Estimated remaining: 10m 40s. Rate: 154.0 symbols/min [2025-09-18T22:49:52.891586] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:52.902332] [DEBUG] [LOCAL ] CQP: Loaded 20205 existing records from primary storage. [2025-09-18T22:49:52.902683] [INFO ] [MAIN ] CQP: Loaded 20205 primary data records. [2025-09-18T22:49:52.984343] [DEBUG] [MAIN ] CPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:53.003064] [INFO ] [MAIN ] CPT: Generated 1807 derivative records from 44714 primary records. [2025-09-18T22:49:53.010700] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-09-18T22:49:53.260767] [DEBUG] [LOCAL ] CPT: Derivative data saved (1807 records). [2025-09-18T22:49:53.261556] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-09-18T22:49:53.264933] [INFO ] [MAIN ] Derivative Progress: 432/2075 symbols completed. CPT took 1.4s. Estimated remaining: 10m 40s. Rate: 154.0 symbols/min [2025-09-18T22:49:53.266608] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:53.282899] [DEBUG] [LOCAL ] CRBG: Loaded 52724 existing records from primary storage. [2025-09-18T22:49:53.283568] [INFO ] [MAIN ] CRBG: Loaded 52724 primary data records. [2025-09-18T22:49:53.639455] [DEBUG] [LOCAL ] CRC: Loaded 44876 existing records from primary storage. [2025-09-18T22:49:53.640333] [DEBUG] [MAIN ] CQP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:53.641034] [INFO ] [MAIN ] CRC: Loaded 44876 primary data records. [2025-09-18T22:49:53.647337] [INFO ] [MAIN ] CQP: Generated 1807 derivative records from 20205 primary records. [2025-09-18T22:49:53.705719] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-09-18T22:49:53.801349] [DEBUG] [LOCAL ] CQP: Derivative data saved (1807 records). [2025-09-18T22:49:53.806917] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-09-18T22:49:53.809350] [INFO ] [MAIN ] Derivative Progress: 433/2075 symbols completed. CQP took 1.0s. Estimated remaining: 10m 40s. Rate: 153.9 symbols/min [2025-09-18T22:49:54.046814] [DEBUG] [MAIN ] CRBG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:54.047580] [INFO ] [MAIN ] CRBG: Generated 1807 derivative records from 52724 primary records. [2025-09-18T22:49:54.047767] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-09-18T22:49:54.067897] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1807 records). [2025-09-18T22:49:54.068305] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-09-18T22:49:54.070661] [INFO ] [MAIN ] Derivative Progress: 434/2075 symbols completed. CRBG took 1.2s. Estimated remaining: 10m 39s. Rate: 154.0 symbols/min [2025-09-18T22:49:54.088124] [DEBUG] [MAIN ] CRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:54.088703] [INFO ] [MAIN ] CRC: Generated 1807 derivative records from 44876 primary records. [2025-09-18T22:49:54.088766] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-09-18T22:49:54.104399] [DEBUG] [LOCAL ] CRC: Derivative data saved (1807 records). [2025-09-18T22:49:54.104501] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-09-18T22:49:54.106746] [INFO ] [MAIN ] Derivative Progress: 435/2075 symbols completed. CRC took 0.8s. Estimated remaining: 10m 38s. Rate: 154.3 symbols/min [2025-09-18T22:49:54.107217] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:54.107428] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:54.108188] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:54.203116] [DEBUG] [LOCAL ] CRI: Loaded 50352 existing records from primary storage. [2025-09-18T22:49:54.202310] [DEBUG] [LOCAL ] CRGY: Loaded 52911 existing records from primary storage. [2025-09-18T22:49:54.203863] [INFO ] [MAIN ] CRGY: Loaded 52911 primary data records. [2025-09-18T22:49:54.203792] [INFO ] [MAIN ] CRI: Loaded 50352 primary data records. [2025-09-18T22:49:54.328517] [DEBUG] [LOCAL ] CRK: Loaded 52520 existing records from primary storage. [2025-09-18T22:49:54.375997] [INFO ] [MAIN ] CRK: Loaded 52520 primary data records. [2025-09-18T22:49:55.200237] [DEBUG] [MAIN ] CRGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:55.203394] [INFO ] [MAIN ] CRGY: Generated 1807 derivative records from 52911 primary records. [2025-09-18T22:49:55.204305] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-09-18T22:49:55.228990] [DEBUG] [MAIN ] CRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:55.234827] [INFO ] [MAIN ] CRI: Generated 1807 derivative records from 50352 primary records. [2025-09-18T22:49:55.235423] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-09-18T22:49:55.263579] [DEBUG] [MAIN ] CRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:55.264993] [INFO ] [MAIN ] CRK: Generated 1807 derivative records from 52520 primary records. [2025-09-18T22:49:55.265607] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-09-18T22:49:55.281123] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1807 records). [2025-09-18T22:49:55.283998] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-09-18T22:49:55.288049] [INFO ] [MAIN ] Derivative Progress: 436/2075 symbols completed. CRGY took 1.2s. Estimated remaining: 10m 40s. Rate: 153.6 symbols/min [2025-09-18T22:49:55.285405] [DEBUG] [LOCAL ] CRK: Derivative data saved (1807 records). [2025-09-18T22:49:55.289194] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-09-18T22:49:55.289633] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:55.290160] [DEBUG] [LOCAL ] CRI: Derivative data saved (1807 records). [2025-09-18T22:49:55.293145] [INFO ] [MAIN ] Derivative Progress: 437/2075 symbols completed. CRK took 1.2s. Estimated remaining: 10m 38s. Rate: 154.0 symbols/min [2025-09-18T22:49:55.293341] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-09-18T22:49:55.293625] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:55.296619] [INFO ] [MAIN ] Derivative Progress: 438/2075 symbols completed. CRI took 1.2s. Estimated remaining: 10m 37s. Rate: 154.3 symbols/min [2025-09-18T22:49:55.297297] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:55.375730] [DEBUG] [LOCAL ] CRS: Loaded 43895 existing records from primary storage. [2025-09-18T22:49:55.376021] [INFO ] [MAIN ] CRS: Loaded 43895 primary data records. [2025-09-18T22:49:55.389337] [DEBUG] [LOCAL ] CRL: Loaded 43985 existing records from primary storage. [2025-09-18T22:49:55.438062] [INFO ] [MAIN ] CRL: Loaded 43985 primary data records. [2025-09-18T22:49:55.480301] [DEBUG] [LOCAL ] CRM: Loaded 54160 existing records from primary storage. [2025-09-18T22:49:55.541017] [INFO ] [MAIN ] CRM: Loaded 54160 primary data records. [2025-09-18T22:49:56.415064] [DEBUG] [MAIN ] CRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:56.418138] [INFO ] [MAIN ] CRS: Generated 1807 derivative records from 43895 primary records. [2025-09-18T22:49:56.419027] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-09-18T22:49:56.460234] [DEBUG] [MAIN ] CRL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:56.461222] [DEBUG] [MAIN ] CRM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:56.462447] [INFO ] [MAIN ] CRM: Generated 1807 derivative records from 54160 primary records. [2025-09-18T22:49:56.463003] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-09-18T22:49:56.463602] [INFO ] [MAIN ] CRL: Generated 1807 derivative records from 43985 primary records. [2025-09-18T22:49:56.465457] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-09-18T22:49:56.492108] [DEBUG] [LOCAL ] CRS: Derivative data saved (1807 records). [2025-09-18T22:49:56.494085] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-09-18T22:49:56.498454] [DEBUG] [LOCAL ] CRM: Derivative data saved (1807 records). [2025-09-18T22:49:56.498356] [INFO ] [MAIN ] Derivative Progress: 439/2075 symbols completed. CRS took 1.2s. Estimated remaining: 10m 39s. Rate: 153.6 symbols/min [2025-09-18T22:49:56.499545] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-09-18T22:49:56.503626] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:56.503522] [INFO ] [MAIN ] Derivative Progress: 440/2075 symbols completed. CRM took 1.2s. Estimated remaining: 10m 37s. Rate: 153.9 symbols/min [2025-09-18T22:49:56.505396] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:56.506674] [DEBUG] [LOCAL ] CRL: Derivative data saved (1807 records). [2025-09-18T22:49:56.506748] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-09-18T22:49:56.509442] [INFO ] [MAIN ] Derivative Progress: 441/2075 symbols completed. CRL took 1.2s. Estimated remaining: 10m 36s. Rate: 154.3 symbols/min [2025-09-18T22:49:56.510037] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:56.516108] [DEBUG] [LOCAL ] CRT: Loaded 4920 existing records from primary storage. [2025-09-18T22:49:56.516356] [INFO ] [MAIN ] CRT: Loaded 4920 primary data records. [2025-09-18T22:49:56.774148] [DEBUG] [LOCAL ] CSL: Loaded 31709 existing records from primary storage. [2025-09-18T22:49:56.828954] [DEBUG] [LOCAL ] CSAN: Loaded 42325 existing records from primary storage. [2025-09-18T22:49:56.866244] [INFO ] [MAIN ] CSL: Loaded 31709 primary data records. [2025-09-18T22:49:56.880300] [INFO ] [MAIN ] CSAN: Loaded 42325 primary data records. [2025-09-18T22:49:57.560943] [DEBUG] [MAIN ] CRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:57.563567] [INFO ] [MAIN ] CRT: Generated 1807 derivative records from 4920 primary records. [2025-09-18T22:49:57.563851] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-09-18T22:49:57.584752] [DEBUG] [LOCAL ] CRT: Derivative data saved (1807 records). [2025-09-18T22:49:57.585251] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-09-18T22:49:57.588871] [INFO ] [MAIN ] Derivative Progress: 442/2075 symbols completed. CRT took 1.1s. Estimated remaining: 10m 38s. Rate: 153.6 symbols/min [2025-09-18T22:49:57.591502] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:57.614755] [DEBUG] [MAIN ] CSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:57.616201] [INFO ] [MAIN ] CSL: Generated 1807 derivative records from 31709 primary records. [2025-09-18T22:49:57.628467] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-09-18T22:49:57.641378] [DEBUG] [MAIN ] CSAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:57.649841] [DEBUG] [LOCAL ] CSL: Derivative data saved (1807 records). [2025-09-18T22:49:57.656084] [INFO ] [MAIN ] CSAN: Generated 1807 derivative records from 42325 primary records. [2025-09-18T22:49:57.655148] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-09-18T22:49:57.658865] [INFO ] [MAIN ] Derivative Progress: 443/2075 symbols completed. CSL took 1.1s. Estimated remaining: 10m 36s. Rate: 153.9 symbols/min [2025-09-18T22:49:57.656526] [DEBUG] [LOCAL ] CSR: Loaded 12508 existing records from primary storage. [2025-09-18T22:49:57.659136] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:57.656608] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-09-18T22:49:57.659876] [INFO ] [MAIN ] CSR: Loaded 12508 primary data records. [2025-09-18T22:49:57.769309] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1807 records). [2025-09-18T22:49:57.794014] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-09-18T22:49:57.802932] [INFO ] [MAIN ] Derivative Progress: 444/2075 symbols completed. CSAN took 1.3s. Estimated remaining: 10m 35s. Rate: 154.1 symbols/min [2025-09-18T22:49:57.803363] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:58.053197] [DEBUG] [LOCAL ] CSTM: Loaded 48163 existing records from primary storage. [2025-09-18T22:49:58.053574] [INFO ] [MAIN ] CSTM: Loaded 48163 primary data records. [2025-09-18T22:49:58.109764] [DEBUG] [LOCAL ] CSV: Loaded 13238 existing records from primary storage. [2025-09-18T22:49:58.130493] [INFO ] [MAIN ] CSV: Loaded 13238 primary data records. [2025-09-18T22:49:58.757268] [DEBUG] [MAIN ] CSR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:58.758352] [INFO ] [MAIN ] CSR: Generated 1807 derivative records from 12508 primary records. [2025-09-18T22:49:58.759504] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-09-18T22:49:58.780962] [DEBUG] [LOCAL ] CSR: Derivative data saved (1807 records). [2025-09-18T22:49:58.781523] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-09-18T22:49:58.783668] [INFO ] [MAIN ] Derivative Progress: 445/2075 symbols completed. CSR took 1.2s. Estimated remaining: 10m 37s. Rate: 153.6 symbols/min [2025-09-18T22:49:58.784069] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:58.818423] [DEBUG] [MAIN ] CSV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:58.818806] [DEBUG] [MAIN ] CSTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:58.819725] [INFO ] [MAIN ] CSV: Generated 1807 derivative records from 13238 primary records. [2025-09-18T22:49:58.820713] [INFO ] [MAIN ] CSTM: Generated 1807 derivative records from 48163 primary records. [2025-09-18T22:49:58.824257] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-09-18T22:49:58.824092] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-09-18T22:49:58.824887] [DEBUG] [LOCAL ] CTBB: Loaded 7314 existing records from primary storage. [2025-09-18T22:49:58.825822] [INFO ] [MAIN ] CTBB: Loaded 7314 primary data records. [2025-09-18T22:49:58.951841] [DEBUG] [LOCAL ] CSV: Derivative data saved (1807 records). [2025-09-18T22:49:58.960031] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-09-18T22:49:58.976459] [INFO ] [MAIN ] Derivative Progress: 446/2075 symbols completed. CSV took 1.2s. Estimated remaining: 10m 36s. Rate: 153.8 symbols/min [2025-09-18T22:49:58.977191] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1807 records). [2025-09-18T22:49:58.977852] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:58.977979] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-09-18T22:49:58.990904] [INFO ] [MAIN ] Derivative Progress: 447/2075 symbols completed. CSTM took 1.3s. Estimated remaining: 10m 34s. Rate: 154.1 symbols/min [2025-09-18T22:49:59.006813] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:59.217246] [DEBUG] [LOCAL ] CTO: Loaded 28716 existing records from primary storage. [2025-09-18T22:49:59.217622] [INFO ] [MAIN ] CTO: Loaded 28716 primary data records. [2025-09-18T22:49:59.406909] [DEBUG] [LOCAL ] CTRA: Loaded 54039 existing records from primary storage. [2025-09-18T22:49:59.451054] [INFO ] [MAIN ] CTRA: Loaded 54039 primary data records. [2025-09-18T22:49:59.567337] [DEBUG] [MAIN ] CTBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:59.580678] [INFO ] [MAIN ] CTBB: Generated 1807 derivative records from 7314 primary records. [2025-09-18T22:49:59.580945] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-09-18T22:49:59.699332] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1807 records). [2025-09-18T22:49:59.705763] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-09-18T22:49:59.718204] [INFO ] [MAIN ] Derivative Progress: 448/2075 symbols completed. CTBB took 0.9s. Estimated remaining: 10m 35s. Rate: 153.8 symbols/min [2025-09-18T22:49:59.922706] [DEBUG] [MAIN ] CTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:59.923700] [INFO ] [MAIN ] CTO: Generated 1807 derivative records from 28716 primary records. [2025-09-18T22:49:59.923817] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-09-18T22:49:59.942620] [DEBUG] [LOCAL ] CTO: Derivative data saved (1807 records). [2025-09-18T22:49:59.942792] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-09-18T22:49:59.945180] [INFO ] [MAIN ] Derivative Progress: 449/2075 symbols completed. CTO took 1.0s. Estimated remaining: 10m 34s. Rate: 154.0 symbols/min [2025-09-18T22:49:59.961402] [DEBUG] [MAIN ] CTRA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:49:59.962104] [INFO ] [MAIN ] CTRA: Generated 1807 derivative records from 54039 primary records. [2025-09-18T22:49:59.962168] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-09-18T22:49:59.978431] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1807 records). [2025-09-18T22:49:59.978506] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-09-18T22:49:59.980664] [INFO ] [MAIN ] Derivative Progress: 450/2075 symbols completed. CTRA took 1.0s. Estimated remaining: 10m 32s. Rate: 154.3 symbols/min [2025-09-18T22:49:59.981422] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:59.981933] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:49:59.981764] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:00.009081] [DEBUG] [LOCAL ] CTS: Loaded 19514 existing records from primary storage. [2025-09-18T22:50:00.009417] [INFO ] [MAIN ] CTS: Loaded 19514 primary data records. [2025-09-18T22:50:00.215984] [DEBUG] [LOCAL ] CTRE: Loaded 49577 existing records from primary storage. [2025-09-18T22:50:00.194621] [DEBUG] [LOCAL ] CTRI: Loaded 37668 existing records from primary storage. [2025-09-18T22:50:00.216212] [INFO ] [MAIN ] CTRI: Loaded 37668 primary data records. [2025-09-18T22:50:00.221569] [INFO ] [MAIN ] CTRE: Loaded 49577 primary data records. [2025-09-18T22:50:01.134931] [DEBUG] [MAIN ] CTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:01.136490] [INFO ] [MAIN ] CTS: Generated 1807 derivative records from 19514 primary records. [2025-09-18T22:50:01.136932] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-09-18T22:50:01.157674] [DEBUG] [LOCAL ] CTS: Derivative data saved (1807 records). [2025-09-18T22:50:01.157961] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-09-18T22:50:01.161582] [INFO ] [MAIN ] Derivative Progress: 451/2075 symbols completed. CTS took 1.2s. Estimated remaining: 10m 34s. Rate: 153.6 symbols/min [2025-09-18T22:50:01.174721] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:01.178307] [DEBUG] [MAIN ] CTRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:01.179269] [INFO ] [MAIN ] CTRE: Generated 1807 derivative records from 49577 primary records. [2025-09-18T22:50:01.179474] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-09-18T22:50:01.205789] [DEBUG] [MAIN ] CTRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:01.209895] [INFO ] [MAIN ] CTRI: Generated 1807 derivative records from 37668 primary records. [2025-09-18T22:50:01.212029] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1807 records). [2025-09-18T22:50:01.211488] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-09-18T22:50:01.212161] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-09-18T22:50:01.216436] [INFO ] [MAIN ] Derivative Progress: 452/2075 symbols completed. CTRE took 1.2s. Estimated remaining: 10m 33s. Rate: 153.9 symbols/min [2025-09-18T22:50:01.236233] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:01.243799] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1807 records). [2025-09-18T22:50:01.244462] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-09-18T22:50:01.248054] [INFO ] [MAIN ] Derivative Progress: 453/2075 symbols completed. CTRI took 1.3s. Estimated remaining: 10m 31s. Rate: 154.2 symbols/min [2025-09-18T22:50:01.265216] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:01.307220] [DEBUG] [LOCAL ] CUBI: Loaded 27519 existing records from primary storage. [2025-09-18T22:50:01.307619] [INFO ] [MAIN ] CUBI: Loaded 27519 primary data records. [2025-09-18T22:50:01.320528] [DEBUG] [LOCAL ] CUBE: Loaded 51124 existing records from primary storage. [2025-09-18T22:50:01.353352] [INFO ] [MAIN ] CUBE: Loaded 51124 primary data records. [2025-09-18T22:50:01.726088] [DEBUG] [LOCAL ] CUK: Loaded 51410 existing records from primary storage. [2025-09-18T22:50:01.796058] [INFO ] [MAIN ] CUK: Loaded 51410 primary data records. [2025-09-18T22:50:02.437082] [DEBUG] [MAIN ] CUBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:02.439199] [INFO ] [MAIN ] CUBI: Generated 1807 derivative records from 27519 primary records. [2025-09-18T22:50:02.440407] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-09-18T22:50:02.470780] [DEBUG] [MAIN ] CUBE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:02.472795] [INFO ] [MAIN ] CUBE: Generated 1807 derivative records from 51124 primary records. [2025-09-18T22:50:02.473019] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-09-18T22:50:02.475087] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1807 records). [2025-09-18T22:50:02.475406] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-09-18T22:50:02.477929] [INFO ] [MAIN ] Derivative Progress: 454/2075 symbols completed. CUBI took 1.2s. Estimated remaining: 10m 34s. Rate: 153.5 symbols/min [2025-09-18T22:50:02.487753] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:02.515298] [DEBUG] [LOCAL ] CULP: Loaded 3147 existing records from primary storage. [2025-09-18T22:50:02.516484] [DEBUG] [MAIN ] CUK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:02.517627] [INFO ] [MAIN ] CULP: Loaded 3147 primary data records. [2025-09-18T22:50:02.517571] [INFO ] [MAIN ] CUK: Generated 1807 derivative records from 51410 primary records. [2025-09-18T22:50:02.539289] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-09-18T22:50:02.565244] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1807 records). [2025-09-18T22:50:02.620740] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-09-18T22:50:02.634226] [INFO ] [MAIN ] Derivative Progress: 455/2075 symbols completed. CUBE took 1.5s. Estimated remaining: 10m 33s. Rate: 153.7 symbols/min [2025-09-18T22:50:02.648402] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:02.711953] [DEBUG] [LOCAL ] CUK: Derivative data saved (1807 records). [2025-09-18T22:50:02.733383] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-09-18T22:50:02.855532] [INFO ] [MAIN ] Derivative Progress: 456/2075 symbols completed. CUK took 1.6s. Estimated remaining: 10m 32s. Rate: 153.8 symbols/min [2025-09-18T22:50:02.856888] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:02.904893] [DEBUG] [LOCAL ] CURB: Loaded 33297 existing records from primary storage. [2025-09-18T22:50:02.906632] [INFO ] [MAIN ] CURB: Loaded 33297 primary data records. [2025-09-18T22:50:02.907210] [DEBUG] [LOCAL ] CURV: Loaded 26800 existing records from primary storage. [2025-09-18T22:50:02.907710] [INFO ] [MAIN ] CURV: Loaded 26800 primary data records. [2025-09-18T22:50:03.093425] [DEBUG] [MAIN ] CULP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:03.128891] [INFO ] [MAIN ] CULP: Generated 1807 derivative records from 3147 primary records. [2025-09-18T22:50:03.138283] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-09-18T22:50:03.426079] [DEBUG] [LOCAL ] CULP: Derivative data saved (1807 records). [2025-09-18T22:50:03.427109] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-09-18T22:50:03.550325] [INFO ] [MAIN ] Derivative Progress: 457/2075 symbols completed. CULP took 1.1s. Estimated remaining: 10m 32s. Rate: 153.6 symbols/min [2025-09-18T22:50:03.551294] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:03.595706] [DEBUG] [MAIN ] CURV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:03.596006] [DEBUG] [MAIN ] CURB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:03.596891] [INFO ] [MAIN ] CURV: Generated 1807 derivative records from 26800 primary records. [2025-09-18T22:50:03.597491] [INFO ] [MAIN ] CURB: Generated 1807 derivative records from 33297 primary records. [2025-09-18T22:50:03.597607] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-09-18T22:50:03.597753] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-09-18T22:50:03.644244] [DEBUG] [LOCAL ] CURB: Derivative data saved (1807 records). [2025-09-18T22:50:03.645533] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-09-18T22:50:03.645431] [DEBUG] [LOCAL ] CURV: Derivative data saved (1807 records). [2025-09-18T22:50:03.645698] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-09-18T22:50:03.648545] [INFO ] [MAIN ] Derivative Progress: 458/2075 symbols completed. CURB took 1.0s. Estimated remaining: 10m 31s. Rate: 153.8 symbols/min [2025-09-18T22:50:03.653624] [INFO ] [MAIN ] Derivative Progress: 459/2075 symbols completed. CURV took 0.8s. Estimated remaining: 10m 29s. Rate: 154.1 symbols/min [2025-09-18T22:50:03.652808] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:03.669925] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:03.673907] [DEBUG] [LOCAL ] CVE: Loaded 53947 existing records from primary storage. [2025-09-18T22:50:03.674304] [INFO ] [MAIN ] CVE: Loaded 53947 primary data records. [2025-09-18T22:50:03.815170] [DEBUG] [LOCAL ] CVEO: Loaded 15698 existing records from primary storage. [2025-09-18T22:50:03.848034] [INFO ] [MAIN ] CVEO: Loaded 15698 primary data records. [2025-09-18T22:50:04.156498] [DEBUG] [LOCAL ] CVI: Loaded 46782 existing records from primary storage. [2025-09-18T22:50:04.173207] [INFO ] [MAIN ] CVI: Loaded 46782 primary data records. [2025-09-18T22:50:04.758820] [DEBUG] [MAIN ] CVE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:04.760003] [INFO ] [MAIN ] CVE: Generated 1807 derivative records from 53947 primary records. [2025-09-18T22:50:04.760194] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-09-18T22:50:04.780466] [DEBUG] [LOCAL ] CVE: Derivative data saved (1807 records). [2025-09-18T22:50:04.780836] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-09-18T22:50:04.784057] [INFO ] [MAIN ] Derivative Progress: 460/2075 symbols completed. CVE took 1.2s. Estimated remaining: 10m 31s. Rate: 153.5 symbols/min [2025-09-18T22:50:04.787987] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:04.802765] [DEBUG] [MAIN ] CVEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:04.803877] [INFO ] [MAIN ] CVEO: Generated 1807 derivative records from 15698 primary records. [2025-09-18T22:50:04.803971] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-09-18T22:50:04.827063] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1807 records). [2025-09-18T22:50:04.827489] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-09-18T22:50:04.830804] [INFO ] [MAIN ] Derivative Progress: 461/2075 symbols completed. CVEO took 1.2s. Estimated remaining: 10m 30s. Rate: 153.8 symbols/min [2025-09-18T22:50:04.832068] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:04.852803] [DEBUG] [MAIN ] CVI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:04.854420] [INFO ] [MAIN ] CVI: Generated 1807 derivative records from 46782 primary records. [2025-09-18T22:50:04.854555] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-09-18T22:50:04.853488] [DEBUG] [LOCAL ] CVLG: Loaded 15548 existing records from primary storage. [2025-09-18T22:50:04.855274] [INFO ] [MAIN ] CVLG: Loaded 15548 primary data records. [2025-09-18T22:50:05.037242] [DEBUG] [LOCAL ] CVI: Derivative data saved (1807 records). [2025-09-18T22:50:05.060148] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-09-18T22:50:05.063087] [INFO ] [MAIN ] Derivative Progress: 462/2075 symbols completed. CVI took 1.4s. Estimated remaining: 10m 29s. Rate: 153.9 symbols/min [2025-09-18T22:50:05.065040] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:05.231454] [DEBUG] [LOCAL ] CVNA: Loaded 53454 existing records from primary storage. [2025-09-18T22:50:05.231750] [INFO ] [MAIN ] CVNA: Loaded 53454 primary data records. [2025-09-18T22:50:05.587049] [DEBUG] [LOCAL ] CVX: Loaded 54150 existing records from primary storage. [2025-09-18T22:50:05.587360] [INFO ] [MAIN ] CVX: Loaded 54150 primary data records. [2025-09-18T22:50:05.733021] [DEBUG] [MAIN ] CVLG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:05.746039] [INFO ] [MAIN ] CVLG: Generated 1807 derivative records from 15548 primary records. [2025-09-18T22:50:05.746300] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-09-18T22:50:05.831588] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1807 records). [2025-09-18T22:50:05.853688] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-09-18T22:50:05.974047] [INFO ] [MAIN ] Derivative Progress: 463/2075 symbols completed. CVLG took 1.2s. Estimated remaining: 10m 30s. Rate: 153.5 symbols/min [2025-09-18T22:50:05.988106] [DEBUG] [MAIN ] CVNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:05.989685] [INFO ] [MAIN ] CVNA: Generated 1807 derivative records from 53454 primary records. [2025-09-18T22:50:05.989773] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-09-18T22:50:06.008738] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1807 records). [2025-09-18T22:50:06.009276] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-09-18T22:50:06.011788] [INFO ] [MAIN ] Derivative Progress: 464/2075 symbols completed. CVNA took 1.2s. Estimated remaining: 10m 29s. Rate: 153.8 symbols/min [2025-09-18T22:50:06.032270] [DEBUG] [MAIN ] CVX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:06.033019] [INFO ] [MAIN ] CVX: Generated 1807 derivative records from 54150 primary records. [2025-09-18T22:50:06.033081] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-09-18T22:50:06.049291] [DEBUG] [LOCAL ] CVX: Derivative data saved (1807 records). [2025-09-18T22:50:06.049352] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-09-18T22:50:06.051863] [INFO ] [MAIN ] Derivative Progress: 465/2075 symbols completed. CVX took 1.0s. Estimated remaining: 10m 27s. Rate: 154.1 symbols/min [2025-09-18T22:50:06.052536] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:06.052744] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:06.052463] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:06.135075] [DEBUG] [LOCAL ] CWEN: Loaded 45379 existing records from primary storage. [2025-09-18T22:50:06.135928] [DEBUG] [LOCAL ] CWK: Loaded 49789 existing records from primary storage. [2025-09-18T22:50:06.136087] [INFO ] [MAIN ] CWEN: Loaded 45379 primary data records. [2025-09-18T22:50:06.136387] [INFO ] [MAIN ] CWK: Loaded 49789 primary data records. [2025-09-18T22:50:06.209364] [DEBUG] [LOCAL ] CWH: Loaded 51794 existing records from primary storage. [2025-09-18T22:50:06.229764] [INFO ] [MAIN ] CWH: Loaded 51794 primary data records. [2025-09-18T22:50:07.151677] [DEBUG] [MAIN ] CWK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:07.155450] [INFO ] [MAIN ] CWK: Generated 1807 derivative records from 49789 primary records. [2025-09-18T22:50:07.155661] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-09-18T22:50:07.178617] [DEBUG] [MAIN ] CWEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:07.179554] [INFO ] [MAIN ] CWEN: Generated 1807 derivative records from 45379 primary records. [2025-09-18T22:50:07.183430] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-09-18T22:50:07.209583] [DEBUG] [MAIN ] CWH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:07.212169] [INFO ] [MAIN ] CWH: Generated 1807 derivative records from 51794 primary records. [2025-09-18T22:50:07.212836] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-09-18T22:50:07.225291] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1807 records). [2025-09-18T22:50:07.226674] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-09-18T22:50:07.231985] [INFO ] [MAIN ] Derivative Progress: 466/2075 symbols completed. CWEN took 1.2s. Estimated remaining: 10m 29s. Rate: 153.4 symbols/min [2025-09-18T22:50:07.234851] [DEBUG] [LOCAL ] CWK: Derivative data saved (1807 records). [2025-09-18T22:50:07.237075] [DEBUG] [LOCAL ] CWH: Derivative data saved (1807 records). [2025-09-18T22:50:07.236702] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-09-18T22:50:07.237237] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:07.239679] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-09-18T22:50:07.239507] [INFO ] [MAIN ] Derivative Progress: 467/2075 symbols completed. CWK took 1.2s. Estimated remaining: 10m 28s. Rate: 153.7 symbols/min [2025-09-18T22:50:07.240412] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:07.243583] [INFO ] [MAIN ] Derivative Progress: 468/2075 symbols completed. CWH took 1.2s. Estimated remaining: 10m 26s. Rate: 154.1 symbols/min [2025-09-18T22:50:07.244873] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:07.254311] [DEBUG] [LOCAL ] CXE: Loaded 7287 existing records from primary storage. [2025-09-18T22:50:07.254673] [INFO ] [MAIN ] CXE: Loaded 7287 primary data records. [2025-09-18T22:50:07.456559] [DEBUG] [LOCAL ] CWT: Loaded 28182 existing records from primary storage. [2025-09-18T22:50:07.476832] [INFO ] [MAIN ] CWT: Loaded 28182 primary data records. [2025-09-18T22:50:07.614842] [DEBUG] [LOCAL ] CXT: Loaded 31312 existing records from primary storage. [2025-09-18T22:50:07.641313] [INFO ] [MAIN ] CXT: Loaded 31312 primary data records. [2025-09-18T22:50:08.246198] [DEBUG] [MAIN ] CXE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:08.247223] [INFO ] [MAIN ] CXE: Generated 1807 derivative records from 7287 primary records. [2025-09-18T22:50:08.247415] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-09-18T22:50:08.266470] [DEBUG] [LOCAL ] CXE: Derivative data saved (1807 records). [2025-09-18T22:50:08.266748] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-09-18T22:50:08.271113] [INFO ] [MAIN ] Derivative Progress: 469/2075 symbols completed. CXE took 1.0s. Estimated remaining: 10m 28s. Rate: 153.5 symbols/min [2025-09-18T22:50:08.272211] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:08.286810] [DEBUG] [MAIN ] CWT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:08.289843] [INFO ] [MAIN ] CWT: Generated 1807 derivative records from 28182 primary records. [2025-09-18T22:50:08.289987] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-09-18T22:50:08.315912] [DEBUG] [MAIN ] CXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:08.318219] [INFO ] [MAIN ] CXT: Generated 1807 derivative records from 31312 primary records. [2025-09-18T22:50:08.318976] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-09-18T22:50:08.353485] [DEBUG] [LOCAL ] CXT: Derivative data saved (1807 records). [2025-09-18T22:50:08.354530] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-09-18T22:50:08.354402] [DEBUG] [LOCAL ] CWT: Derivative data saved (1807 records). [2025-09-18T22:50:08.357533] [INFO ] [MAIN ] Derivative Progress: 470/2075 symbols completed. CXT took 1.1s. Estimated remaining: 10m 26s. Rate: 153.8 symbols/min [2025-09-18T22:50:08.357753] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-09-18T22:50:08.360553] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:08.360684] [INFO ] [MAIN ] Derivative Progress: 471/2075 symbols completed. CWT took 1.1s. Estimated remaining: 10m 24s. Rate: 154.1 symbols/min [2025-09-18T22:50:08.361304] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:08.377020] [DEBUG] [LOCAL ] CXW: Loaded 44915 existing records from primary storage. [2025-09-18T22:50:08.377193] [INFO ] [MAIN ] CXW: Loaded 44915 primary data records. [2025-09-18T22:50:08.600927] [DEBUG] [LOCAL ] CYD: Loaded 27150 existing records from primary storage. [2025-09-18T22:50:08.601294] [INFO ] [MAIN ] CYD: Loaded 27150 primary data records. [2025-09-18T22:50:08.881971] [DEBUG] [LOCAL ] CYH: Loaded 48382 existing records from primary storage. [2025-09-18T22:50:08.882903] [INFO ] [MAIN ] CYH: Loaded 48382 primary data records. [2025-09-18T22:50:09.416045] [DEBUG] [MAIN ] CXW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:09.417550] [INFO ] [MAIN ] CXW: Generated 1807 derivative records from 44915 primary records. [2025-09-18T22:50:09.417754] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-09-18T22:50:09.452632] [DEBUG] [MAIN ] CYD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:09.453516] [INFO ] [MAIN ] CYD: Generated 1807 derivative records from 27150 primary records. [2025-09-18T22:50:09.452335] [DEBUG] [LOCAL ] CXW: Derivative data saved (1807 records). [2025-09-18T22:50:09.453821] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-09-18T22:50:09.453917] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-09-18T22:50:09.456938] [INFO ] [MAIN ] Derivative Progress: 472/2075 symbols completed. CXW took 1.2s. Estimated remaining: 10m 27s. Rate: 153.5 symbols/min [2025-09-18T22:50:09.457442] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:09.476329] [DEBUG] [LOCAL ] CYD: Derivative data saved (1807 records). [2025-09-18T22:50:09.476549] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-09-18T22:50:09.478537] [INFO ] [MAIN ] Derivative Progress: 473/2075 symbols completed. CYD took 1.1s. Estimated remaining: 10m 25s. Rate: 153.8 symbols/min [2025-09-18T22:50:09.479042] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:09.492012] [DEBUG] [MAIN ] CYH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:09.492702] [INFO ] [MAIN ] CYH: Generated 1807 derivative records from 48382 primary records. [2025-09-18T22:50:09.492872] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-09-18T22:50:09.510230] [DEBUG] [LOCAL ] CYH: Derivative data saved (1807 records). [2025-09-18T22:50:09.510380] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-09-18T22:50:09.513261] [INFO ] [MAIN ] Derivative Progress: 474/2075 symbols completed. CYH took 1.2s. Estimated remaining: 10m 23s. Rate: 154.1 symbols/min [2025-09-18T22:50:09.513533] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:09.565552] [DEBUG] [LOCAL ] D: Loaded 54037 existing records from primary storage. [2025-09-18T22:50:09.565864] [INFO ] [MAIN ] D: Loaded 54037 primary data records. [2025-09-18T22:50:09.696146] [DEBUG] [LOCAL ] DAL: Loaded 54143 existing records from primary storage. [2025-09-18T22:50:09.701910] [INFO ] [MAIN ] DAL: Loaded 54143 primary data records. [2025-09-18T22:50:10.003176] [DEBUG] [LOCAL ] DAN: Loaded 49394 existing records from primary storage. [2025-09-18T22:50:10.015185] [INFO ] [MAIN ] DAN: Loaded 49394 primary data records. [2025-09-18T22:50:10.595223] [DEBUG] [MAIN ] D: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:10.597056] [INFO ] [MAIN ] D: Generated 1807 derivative records from 54037 primary records. [2025-09-18T22:50:10.597338] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-09-18T22:50:10.614783] [DEBUG] [LOCAL ] D: Derivative data saved (1807 records). [2025-09-18T22:50:10.615661] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-09-18T22:50:10.619445] [INFO ] [MAIN ] Derivative Progress: 475/2075 symbols completed. D took 1.2s. Estimated remaining: 10m 25s. Rate: 153.5 symbols/min [2025-09-18T22:50:10.620404] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:10.634967] [DEBUG] [MAIN ] DAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:10.635783] [INFO ] [MAIN ] DAL: Generated 1807 derivative records from 54143 primary records. [2025-09-18T22:50:10.636019] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-09-18T22:50:10.658484] [DEBUG] [LOCAL ] DAL: Derivative data saved (1807 records). [2025-09-18T22:50:10.666860] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-09-18T22:50:10.669331] [INFO ] [MAIN ] Derivative Progress: 476/2075 symbols completed. DAL took 1.2s. Estimated remaining: 10m 24s. Rate: 153.8 symbols/min [2025-09-18T22:50:10.669722] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:10.670429] [DEBUG] [LOCAL ] DAO: Loaded 21693 existing records from primary storage. [2025-09-18T22:50:10.682847] [INFO ] [MAIN ] DAO: Loaded 21693 primary data records. [2025-09-18T22:50:10.703990] [DEBUG] [MAIN ] DAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:10.704969] [INFO ] [MAIN ] DAN: Generated 1807 derivative records from 49394 primary records. [2025-09-18T22:50:10.705148] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-09-18T22:50:10.803540] [DEBUG] [LOCAL ] DAN: Derivative data saved (1807 records). [2025-09-18T22:50:10.803759] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-09-18T22:50:10.806450] [INFO ] [MAIN ] Derivative Progress: 477/2075 symbols completed. DAN took 1.3s. Estimated remaining: 10m 23s. Rate: 154.0 symbols/min [2025-09-18T22:50:10.817748] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:11.053606] [DEBUG] [LOCAL ] DAR: Loaded 52223 existing records from primary storage. [2025-09-18T22:50:11.054457] [INFO ] [MAIN ] DAR: Loaded 52223 primary data records. [2025-09-18T22:50:11.138077] [DEBUG] [LOCAL ] DAVA: Loaded 40658 existing records from primary storage. [2025-09-18T22:50:11.154977] [INFO ] [MAIN ] DAVA: Loaded 40658 primary data records. [2025-09-18T22:50:11.369576] [DEBUG] [MAIN ] DAO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:11.394493] [INFO ] [MAIN ] DAO: Generated 1807 derivative records from 21693 primary records. [2025-09-18T22:50:11.459690] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-09-18T22:50:11.708106] [DEBUG] [LOCAL ] DAO: Derivative data saved (1807 records). [2025-09-18T22:50:11.708823] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-09-18T22:50:11.711015] [INFO ] [MAIN ] Derivative Progress: 478/2075 symbols completed. DAO took 1.1s. Estimated remaining: 10m 24s. Rate: 153.6 symbols/min [2025-09-18T22:50:11.733157] [DEBUG] [MAIN ] DAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:11.734010] [INFO ] [MAIN ] DAR: Generated 1807 derivative records from 52223 primary records. [2025-09-18T22:50:11.734158] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-09-18T22:50:11.764507] [DEBUG] [LOCAL ] DAR: Derivative data saved (1807 records). [2025-09-18T22:50:11.764972] [DEBUG] [MAIN ] DAVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:11.765135] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-09-18T22:50:11.768233] [INFO ] [MAIN ] Derivative Progress: 479/2075 symbols completed. DAR took 1.1s. Estimated remaining: 10m 22s. Rate: 153.9 symbols/min [2025-09-18T22:50:11.766015] [INFO ] [MAIN ] DAVA: Generated 1807 derivative records from 40658 primary records. [2025-09-18T22:50:11.768493] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-09-18T22:50:11.784672] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1807 records). [2025-09-18T22:50:11.784740] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-09-18T22:50:11.787416] [INFO ] [MAIN ] Derivative Progress: 480/2075 symbols completed. DAVA took 1.0s. Estimated remaining: 10m 21s. Rate: 154.2 symbols/min [2025-09-18T22:50:11.788024] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:11.787926] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:11.788234] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:11.800738] [DEBUG] [LOCAL ] DBL: Loaded 9122 existing records from primary storage. [2025-09-18T22:50:11.800939] [INFO ] [MAIN ] DBL: Loaded 9122 primary data records. [2025-09-18T22:50:12.171440] [DEBUG] [LOCAL ] DAY: Loaded 50388 existing records from primary storage. [2025-09-18T22:50:12.171744] [INFO ] [MAIN ] DAY: Loaded 50388 primary data records. [2025-09-18T22:50:12.172467] [DEBUG] [LOCAL ] DBRG: Loaded 50211 existing records from primary storage. [2025-09-18T22:50:12.193981] [INFO ] [MAIN ] DBRG: Loaded 50211 primary data records. [2025-09-18T22:50:12.864461] [DEBUG] [MAIN ] DBL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:12.865530] [INFO ] [MAIN ] DBL: Generated 1807 derivative records from 9122 primary records. [2025-09-18T22:50:12.865722] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-09-18T22:50:12.888674] [DEBUG] [LOCAL ] DBL: Derivative data saved (1807 records). [2025-09-18T22:50:12.889632] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-09-18T22:50:12.892113] [INFO ] [MAIN ] Derivative Progress: 481/2075 symbols completed. DBL took 1.1s. Estimated remaining: 10m 23s. Rate: 153.6 symbols/min [2025-09-18T22:50:12.893675] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:12.908164] [DEBUG] [MAIN ] DAY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:12.909010] [INFO ] [MAIN ] DAY: Generated 1807 derivative records from 50388 primary records. [2025-09-18T22:50:12.909229] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-09-18T22:50:12.932630] [DEBUG] [MAIN ] DBRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:12.936708] [INFO ] [MAIN ] DBRG: Generated 1807 derivative records from 50211 primary records. [2025-09-18T22:50:12.937035] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-09-18T22:50:12.957995] [DEBUG] [LOCAL ] DAY: Derivative data saved (1807 records). [2025-09-18T22:50:12.957913] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1807 records). [2025-09-18T22:50:12.958255] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-09-18T22:50:12.958344] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-09-18T22:50:12.961219] [INFO ] [MAIN ] Derivative Progress: 482/2075 symbols completed. DBRG took 1.2s. Estimated remaining: 10m 21s. Rate: 153.8 symbols/min [2025-09-18T22:50:12.963462] [INFO ] [MAIN ] Derivative Progress: 483/2075 symbols completed. DAY took 1.2s. Estimated remaining: 10m 20s. Rate: 154.2 symbols/min [2025-09-18T22:50:12.963407] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:12.964168] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:12.988926] [DEBUG] [LOCAL ] DCI: Loaded 38012 existing records from primary storage. [2025-09-18T22:50:12.989212] [INFO ] [MAIN ] DCI: Loaded 38012 primary data records. [2025-09-18T22:50:13.079780] [DEBUG] [LOCAL ] DCO: Loaded 13679 existing records from primary storage. [2025-09-18T22:50:13.102445] [INFO ] [MAIN ] DCO: Loaded 13679 primary data records. [2025-09-18T22:50:13.629291] [DEBUG] [LOCAL ] DD: Loaded 53183 existing records from primary storage. [2025-09-18T22:50:13.630163] [INFO ] [MAIN ] DD: Loaded 53183 primary data records. [2025-09-18T22:50:13.998198] [DEBUG] [MAIN ] DCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:13.999361] [INFO ] [MAIN ] DCI: Generated 1807 derivative records from 38012 primary records. [2025-09-18T22:50:13.999520] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-09-18T22:50:14.030499] [DEBUG] [LOCAL ] DCI: Derivative data saved (1807 records). [2025-09-18T22:50:14.051439] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-09-18T22:50:14.055361] [DEBUG] [MAIN ] DCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:14.054747] [INFO ] [MAIN ] Derivative Progress: 484/2075 symbols completed. DCI took 1.2s. Estimated remaining: 10m 22s. Rate: 153.6 symbols/min [2025-09-18T22:50:14.055890] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:14.057078] [INFO ] [MAIN ] DCO: Generated 1807 derivative records from 13679 primary records. [2025-09-18T22:50:14.057729] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-09-18T22:50:14.084747] [DEBUG] [LOCAL ] DCO: Derivative data saved (1807 records). [2025-09-18T22:50:14.085938] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-09-18T22:50:14.088534] [INFO ] [MAIN ] Derivative Progress: 485/2075 symbols completed. DCO took 1.1s. Estimated remaining: 10m 20s. Rate: 153.9 symbols/min [2025-09-18T22:50:14.089002] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:14.104051] [DEBUG] [MAIN ] DD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:50:14.104971] [INFO ] [MAIN ] DD: Generated 1806 derivative records from 53183 primary records. [2025-09-18T22:50:14.105232] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-09-18T22:50:14.137225] [DEBUG] [LOCAL ] DD: Derivative data saved (1806 records). [2025-09-18T22:50:14.137451] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-09-18T22:50:14.140568] [INFO ] [MAIN ] Derivative Progress: 486/2075 symbols completed. DD took 1.2s. Estimated remaining: 10m 18s. Rate: 154.2 symbols/min [2025-09-18T22:50:14.141069] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:14.167103] [DEBUG] [LOCAL ] DDD: Loaded 51205 existing records from primary storage. [2025-09-18T22:50:14.175233] [INFO ] [MAIN ] DDD: Loaded 51205 primary data records. [2025-09-18T22:50:14.215683] [DEBUG] [LOCAL ] DDS: Loaded 13611 existing records from primary storage. [2025-09-18T22:50:14.262306] [INFO ] [MAIN ] DDS: Loaded 13611 primary data records. [2025-09-18T22:50:14.312799] [DEBUG] [LOCAL ] DDL: Loaded 36628 existing records from primary storage. [2025-09-18T22:50:14.366840] [INFO ] [MAIN ] DDL: Loaded 36628 primary data records. [2025-09-18T22:50:15.198143] [DEBUG] [MAIN ] DDD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:15.200706] [INFO ] [MAIN ] DDD: Generated 1807 derivative records from 51205 primary records. [2025-09-18T22:50:15.201367] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-09-18T22:50:15.228707] [DEBUG] [MAIN ] DDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:15.229627] [INFO ] [MAIN ] DDS: Generated 1807 derivative records from 13611 primary records. [2025-09-18T22:50:15.232119] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-09-18T22:50:15.243370] [DEBUG] [LOCAL ] DDD: Derivative data saved (1807 records). [2025-09-18T22:50:15.243622] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-09-18T22:50:15.245771] [INFO ] [MAIN ] Derivative Progress: 487/2075 symbols completed. DDD took 1.2s. Estimated remaining: 10m 20s. Rate: 153.6 symbols/min [2025-09-18T22:50:15.257777] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:15.265161] [DEBUG] [LOCAL ] DDS: Derivative data saved (1807 records). [2025-09-18T22:50:15.265812] [DEBUG] [MAIN ] DDL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:15.265512] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-09-18T22:50:15.269126] [INFO ] [MAIN ] DDL: Generated 1807 derivative records from 36628 primary records. [2025-09-18T22:50:15.268177] [INFO ] [MAIN ] Derivative Progress: 488/2075 symbols completed. DDS took 1.1s. Estimated remaining: 10m 19s. Rate: 153.9 symbols/min [2025-09-18T22:50:15.269356] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-09-18T22:50:15.269611] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:15.281954] [DEBUG] [LOCAL ] DDT: Loaded 2096 existing records from primary storage. [2025-09-18T22:50:15.285046] [INFO ] [MAIN ] DDT: Loaded 2096 primary data records. [2025-09-18T22:50:15.409131] [DEBUG] [LOCAL ] DDL: Derivative data saved (1807 records). [2025-09-18T22:50:15.441229] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-09-18T22:50:15.468044] [INFO ] [MAIN ] Derivative Progress: 489/2075 symbols completed. DDL took 1.4s. Estimated remaining: 10m 18s. Rate: 154.0 symbols/min [2025-09-18T22:50:15.484042] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:15.620969] [DEBUG] [LOCAL ] DE: Loaded 48145 existing records from primary storage. [2025-09-18T22:50:15.621235] [INFO ] [MAIN ] DE: Loaded 48145 primary data records. [2025-09-18T22:50:15.829799] [DEBUG] [LOCAL ] DEA: Loaded 42080 existing records from primary storage. [2025-09-18T22:50:15.830587] [INFO ] [MAIN ] DEA: Loaded 42080 primary data records. [2025-09-18T22:50:16.036382] [DEBUG] [MAIN ] DDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:16.044998] [INFO ] [MAIN ] DDT: Generated 1807 derivative records from 2096 primary records. [2025-09-18T22:50:16.055758] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-09-18T22:50:16.145063] [DEBUG] [LOCAL ] DDT: Derivative data saved (1807 records). [2025-09-18T22:50:16.163000] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-09-18T22:50:16.166842] [INFO ] [MAIN ] Derivative Progress: 490/2075 symbols completed. DDT took 0.9s. Estimated remaining: 10m 18s. Rate: 153.8 symbols/min [2025-09-18T22:50:16.286159] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:16.310438] [DEBUG] [MAIN ] DE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:16.311507] [INFO ] [MAIN ] DE: Generated 1807 derivative records from 48145 primary records. [2025-09-18T22:50:16.311689] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-09-18T22:50:16.332735] [DEBUG] [LOCAL ] DE: Derivative data saved (1807 records). [2025-09-18T22:50:16.332926] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-09-18T22:50:16.335500] [INFO ] [MAIN ] Derivative Progress: 491/2075 symbols completed. DE took 1.1s. Estimated remaining: 10m 17s. Rate: 154.0 symbols/min [2025-09-18T22:50:16.335884] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:16.363252] [DEBUG] [MAIN ] DEA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:16.364148] [INFO ] [MAIN ] DEA: Generated 1807 derivative records from 42080 primary records. [2025-09-18T22:50:16.364213] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-09-18T22:50:16.395188] [DEBUG] [LOCAL ] DEA: Derivative data saved (1807 records). [2025-09-18T22:50:16.396467] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-09-18T22:50:16.398742] [INFO ] [MAIN ] Derivative Progress: 492/2075 symbols completed. DEA took 0.9s. Estimated remaining: 10m 16s. Rate: 154.2 symbols/min [2025-09-18T22:50:16.400210] [DEBUG] [LOCAL ] DECK: Loaded 53698 existing records from primary storage. [2025-09-18T22:50:16.399052] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:16.400564] [INFO ] [MAIN ] DECK: Loaded 53698 primary data records. [2025-09-18T22:50:16.742675] [DEBUG] [LOCAL ] DEI: Loaded 48891 existing records from primary storage. [2025-09-18T22:50:16.756572] [INFO ] [MAIN ] DEI: Loaded 48891 primary data records. [2025-09-18T22:50:16.972911] [DEBUG] [LOCAL ] DELL: Loaded 54126 existing records from primary storage. [2025-09-18T22:50:16.973203] [INFO ] [MAIN ] DELL: Loaded 54126 primary data records. [2025-09-18T22:50:17.414261] [DEBUG] [MAIN ] DECK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:17.415883] [INFO ] [MAIN ] DECK: Generated 1807 derivative records from 53698 primary records. [2025-09-18T22:50:17.416745] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-09-18T22:50:17.434244] [DEBUG] [LOCAL ] DECK: Derivative data saved (1807 records). [2025-09-18T22:50:17.434529] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-09-18T22:50:17.436676] [INFO ] [MAIN ] Derivative Progress: 493/2075 symbols completed. DECK took 1.2s. Estimated remaining: 10m 18s. Rate: 153.7 symbols/min [2025-09-18T22:50:17.453337] [DEBUG] [MAIN ] DEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:17.454257] [INFO ] [MAIN ] DEI: Generated 1807 derivative records from 48891 primary records. [2025-09-18T22:50:17.454422] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-09-18T22:50:17.470620] [DEBUG] [LOCAL ] DEI: Derivative data saved (1807 records). [2025-09-18T22:50:17.471396] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-09-18T22:50:17.473606] [INFO ] [MAIN ] Derivative Progress: 494/2075 symbols completed. DEI took 1.1s. Estimated remaining: 10m 16s. Rate: 154.0 symbols/min [2025-09-18T22:50:17.487495] [DEBUG] [MAIN ] DELL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:17.488058] [INFO ] [MAIN ] DELL: Generated 1807 derivative records from 54126 primary records. [2025-09-18T22:50:17.488120] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-09-18T22:50:17.507689] [DEBUG] [LOCAL ] DELL: Derivative data saved (1807 records). [2025-09-18T22:50:17.507801] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-09-18T22:50:17.510849] [INFO ] [MAIN ] Derivative Progress: 495/2075 symbols completed. DELL took 1.1s. Estimated remaining: 10m 15s. Rate: 154.3 symbols/min [2025-09-18T22:50:17.511636] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:17.511531] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:17.511455] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:17.543498] [DEBUG] [LOCAL ] DFIN: Loaded 23738 existing records from primary storage. [2025-09-18T22:50:17.543687] [INFO ] [MAIN ] DFIN: Loaded 23738 primary data records. [2025-09-18T22:50:17.668241] [DEBUG] [LOCAL ] DFH: Loaded 33349 existing records from primary storage. [2025-09-18T22:50:17.674133] [INFO ] [MAIN ] DFH: Loaded 33349 primary data records. [2025-09-18T22:50:17.970776] [DEBUG] [LOCAL ] DEO: Loaded 49348 existing records from primary storage. [2025-09-18T22:50:17.979547] [INFO ] [MAIN ] DEO: Loaded 49348 primary data records. [2025-09-18T22:50:18.499686] [DEBUG] [MAIN ] DFIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:18.500581] [INFO ] [MAIN ] DFIN: Generated 1807 derivative records from 23738 primary records. [2025-09-18T22:50:18.500876] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-09-18T22:50:18.517668] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1807 records). [2025-09-18T22:50:18.517939] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-09-18T22:50:18.519997] [INFO ] [MAIN ] Derivative Progress: 496/2075 symbols completed. DFIN took 1.0s. Estimated remaining: 10m 16s. Rate: 153.8 symbols/min [2025-09-18T22:50:18.520759] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:18.548858] [DEBUG] [MAIN ] DFH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:18.554304] [INFO ] [MAIN ] DFH: Generated 1807 derivative records from 33349 primary records. [2025-09-18T22:50:18.554798] [DEBUG] [MAIN ] DEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:18.555446] [INFO ] [MAIN ] DEO: Generated 1807 derivative records from 49348 primary records. [2025-09-18T22:50:18.554527] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-09-18T22:50:18.560328] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-09-18T22:50:18.572268] [DEBUG] [LOCAL ] DFP: Loaded 11867 existing records from primary storage. [2025-09-18T22:50:18.572592] [INFO ] [MAIN ] DFP: Loaded 11867 primary data records. [2025-09-18T22:50:18.692608] [DEBUG] [LOCAL ] DFH: Derivative data saved (1807 records). [2025-09-18T22:50:18.692957] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-09-18T22:50:18.696142] [INFO ] [MAIN ] Derivative Progress: 497/2075 symbols completed. DFH took 1.2s. Estimated remaining: 10m 15s. Rate: 153.9 symbols/min [2025-09-18T22:50:18.707221] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:18.707990] [DEBUG] [LOCAL ] DEO: Derivative data saved (1807 records). [2025-09-18T22:50:18.713569] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-09-18T22:50:18.721676] [INFO ] [MAIN ] Derivative Progress: 498/2075 symbols completed. DEO took 1.2s. Estimated remaining: 10m 14s. Rate: 154.2 symbols/min [2025-09-18T22:50:18.749422] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:18.976967] [DEBUG] [MAIN ] DFP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:18.978257] [INFO ] [MAIN ] DFP: Generated 1807 derivative records from 11867 primary records. [2025-09-18T22:50:18.978465] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-09-18T22:50:19.022717] [DEBUG] [LOCAL ] DFP: Derivative data saved (1807 records). [2025-09-18T22:50:19.023699] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-09-18T22:50:19.025955] [INFO ] [MAIN ] Derivative Progress: 499/2075 symbols completed. DFP took 0.5s. Estimated remaining: 10m 13s. Rate: 154.3 symbols/min [2025-09-18T22:50:19.027261] [DEBUG] [LOCAL ] DG: Loaded 53697 existing records from primary storage. [2025-09-18T22:50:19.027422] [INFO ] [MAIN ] DG: Loaded 53697 primary data records. [2025-09-18T22:50:19.027781] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:19.028892] [DEBUG] [LOCAL ] DGX: Loaded 45793 existing records from primary storage. [2025-09-18T22:50:19.034418] [INFO ] [MAIN ] DGX: Loaded 45793 primary data records. [2025-09-18T22:50:19.657259] [DEBUG] [LOCAL ] DHI: Loaded 53765 existing records from primary storage. [2025-09-18T22:50:19.658379] [INFO ] [MAIN ] DHI: Loaded 53765 primary data records. [2025-09-18T22:50:20.007435] [DEBUG] [MAIN ] DGX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:20.008800] [INFO ] [MAIN ] DGX: Generated 1807 derivative records from 45793 primary records. [2025-09-18T22:50:20.007818] [DEBUG] [MAIN ] DG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:20.009585] [INFO ] [MAIN ] DG: Generated 1807 derivative records from 53697 primary records. [2025-09-18T22:50:20.009758] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-09-18T22:50:20.010235] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-09-18T22:50:20.046367] [DEBUG] [LOCAL ] DGX: Derivative data saved (1807 records). [2025-09-18T22:50:20.047343] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-09-18T22:50:20.050251] [INFO ] [MAIN ] Derivative Progress: 500/2075 symbols completed. DGX took 1.3s. Estimated remaining: 10m 14s. Rate: 153.8 symbols/min [2025-09-18T22:50:20.051502] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:20.056775] [DEBUG] [LOCAL ] DG: Derivative data saved (1807 records). [2025-09-18T22:50:20.058687] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-09-18T22:50:20.062352] [INFO ] [MAIN ] Derivative Progress: 501/2075 symbols completed. DG took 1.4s. Estimated remaining: 10m 13s. Rate: 154.1 symbols/min [2025-09-18T22:50:20.062894] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:20.076179] [DEBUG] [MAIN ] DHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:20.076957] [INFO ] [MAIN ] DHI: Generated 1807 derivative records from 53765 primary records. [2025-09-18T22:50:20.077032] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-09-18T22:50:20.094535] [DEBUG] [LOCAL ] DHI: Derivative data saved (1807 records). [2025-09-18T22:50:20.094704] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-09-18T22:50:20.097577] [INFO ] [MAIN ] Derivative Progress: 502/2075 symbols completed. DHI took 1.1s. Estimated remaining: 10m 11s. Rate: 154.4 symbols/min [2025-09-18T22:50:20.097917] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:20.112976] [DEBUG] [LOCAL ] DHX: Loaded 13327 existing records from primary storage. [2025-09-18T22:50:20.113104] [INFO ] [MAIN ] DHX: Loaded 13327 primary data records. [2025-09-18T22:50:20.308244] [DEBUG] [LOCAL ] DHR: Loaded 53757 existing records from primary storage. [2025-09-18T22:50:20.318953] [INFO ] [MAIN ] DHR: Loaded 53757 primary data records. [2025-09-18T22:50:20.516361] [DEBUG] [LOCAL ] DHT: Loaded 48423 existing records from primary storage. [2025-09-18T22:50:20.534244] [INFO ] [MAIN ] DHT: Loaded 48423 primary data records. [2025-09-18T22:50:21.179929] [DEBUG] [MAIN ] DHX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:21.181620] [INFO ] [MAIN ] DHX: Generated 1807 derivative records from 13327 primary records. [2025-09-18T22:50:21.181912] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-09-18T22:50:21.199618] [DEBUG] [LOCAL ] DHX: Derivative data saved (1807 records). [2025-09-18T22:50:21.199869] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-09-18T22:50:21.202017] [INFO ] [MAIN ] Derivative Progress: 503/2075 symbols completed. DHX took 1.1s. Estimated remaining: 10m 13s. Rate: 153.8 symbols/min [2025-09-18T22:50:21.202837] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:21.226016] [DEBUG] [MAIN ] DHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:21.226841] [INFO ] [MAIN ] DHR: Generated 1807 derivative records from 53757 primary records. [2025-09-18T22:50:21.227065] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-09-18T22:50:21.244026] [DEBUG] [LOCAL ] DIAX: Loaded 12421 existing records from primary storage. [2025-09-18T22:50:21.251159] [DEBUG] [LOCAL ] DHR: Derivative data saved (1807 records). [2025-09-18T22:50:21.251433] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-09-18T22:50:21.251311] [INFO ] [MAIN ] DIAX: Loaded 12421 primary data records. [2025-09-18T22:50:21.261029] [INFO ] [MAIN ] Derivative Progress: 504/2075 symbols completed. DHR took 1.2s. Estimated remaining: 10m 12s. Rate: 154.1 symbols/min [2025-09-18T22:50:21.286769] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:21.297879] [DEBUG] [MAIN ] DHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:21.337793] [INFO ] [MAIN ] DHT: Generated 1807 derivative records from 48423 primary records. [2025-09-18T22:50:21.354997] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-09-18T22:50:21.417350] [DEBUG] [LOCAL ] DHT: Derivative data saved (1807 records). [2025-09-18T22:50:21.449586] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-09-18T22:50:21.452571] [INFO ] [MAIN ] Derivative Progress: 505/2075 symbols completed. DHT took 1.4s. Estimated remaining: 10m 11s. Rate: 154.2 symbols/min [2025-09-18T22:50:21.575144] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:21.632603] [DEBUG] [MAIN ] DIAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:21.633318] [INFO ] [MAIN ] DIAX: Generated 1807 derivative records from 12421 primary records. [2025-09-18T22:50:21.633485] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-09-18T22:50:21.649914] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1807 records). [2025-09-18T22:50:21.650117] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-09-18T22:50:21.652102] [INFO ] [MAIN ] Derivative Progress: 506/2075 symbols completed. DIAX took 0.4s. Estimated remaining: 10m 10s. Rate: 154.4 symbols/min [2025-09-18T22:50:21.652473] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:21.668967] [DEBUG] [LOCAL ] DINO: Loaded 53364 existing records from primary storage. [2025-09-18T22:50:21.682325] [INFO ] [MAIN ] DINO: Loaded 53364 primary data records. [2025-09-18T22:50:21.832718] [DEBUG] [LOCAL ] DIS: Loaded 54178 existing records from primary storage. [2025-09-18T22:50:21.847524] [INFO ] [MAIN ] DIS: Loaded 54178 primary data records. [2025-09-18T22:50:22.143484] [DEBUG] [LOCAL ] DK: Loaded 49841 existing records from primary storage. [2025-09-18T22:50:22.153988] [INFO ] [MAIN ] DK: Loaded 49841 primary data records. [2025-09-18T22:50:22.706023] [DEBUG] [MAIN ] DINO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:22.708233] [INFO ] [MAIN ] DINO: Generated 1807 derivative records from 53364 primary records. [2025-09-18T22:50:22.709450] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-09-18T22:50:22.739607] [DEBUG] [MAIN ] DIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:22.740849] [DEBUG] [LOCAL ] DINO: Derivative data saved (1807 records). [2025-09-18T22:50:22.741014] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-09-18T22:50:22.743009] [INFO ] [MAIN ] Derivative Progress: 507/2075 symbols completed. DINO took 1.5s. Estimated remaining: 10m 12s. Rate: 153.8 symbols/min [2025-09-18T22:50:22.743776] [INFO ] [MAIN ] DIS: Generated 1807 derivative records from 54178 primary records. [2025-09-18T22:50:22.744157] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-09-18T22:50:22.745018] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:22.761663] [DEBUG] [LOCAL ] DIS: Derivative data saved (1807 records). [2025-09-18T22:50:22.761949] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-09-18T22:50:22.764192] [INFO ] [MAIN ] Derivative Progress: 508/2075 symbols completed. DIS took 1.3s. Estimated remaining: 10m 10s. Rate: 154.1 symbols/min [2025-09-18T22:50:22.785357] [DEBUG] [MAIN ] DK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:22.786001] [INFO ] [MAIN ] DK: Generated 1807 derivative records from 49841 primary records. [2025-09-18T22:50:22.786128] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-09-18T22:50:22.808034] [DEBUG] [LOCAL ] DKL: Loaded 19651 existing records from primary storage. [2025-09-18T22:50:22.809022] [INFO ] [MAIN ] DKL: Loaded 19651 primary data records. [2025-09-18T22:50:22.841609] [DEBUG] [LOCAL ] DK: Derivative data saved (1807 records). [2025-09-18T22:50:22.866453] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-09-18T22:50:22.869923] [INFO ] [MAIN ] Derivative Progress: 509/2075 symbols completed. DK took 1.2s. Estimated remaining: 10m 9s. Rate: 154.3 symbols/min [2025-09-18T22:50:23.129259] [DEBUG] [MAIN ] DKL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:23.129926] [INFO ] [MAIN ] DKL: Generated 1807 derivative records from 19651 primary records. [2025-09-18T22:50:23.129991] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-09-18T22:50:23.145241] [DEBUG] [LOCAL ] DKL: Derivative data saved (1807 records). [2025-09-18T22:50:23.145306] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-09-18T22:50:23.147263] [INFO ] [MAIN ] Derivative Progress: 510/2075 symbols completed. DKL took 0.4s. Estimated remaining: 10m 8s. Rate: 154.4 symbols/min [2025-09-18T22:50:23.148413] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:23.149037] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:23.148231] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:23.157598] [DEBUG] [LOCAL ] DLNG: Loaded 6345 existing records from primary storage. [2025-09-18T22:50:23.157859] [INFO ] [MAIN ] DLNG: Loaded 6345 primary data records. [2025-09-18T22:50:23.353123] [DEBUG] [LOCAL ] DLB: Loaded 32524 existing records from primary storage. [2025-09-18T22:50:23.369062] [INFO ] [MAIN ] DLB: Loaded 32524 primary data records. [2025-09-18T22:50:23.616265] [DEBUG] [LOCAL ] DKS: Loaded 50351 existing records from primary storage. [2025-09-18T22:50:23.627511] [INFO ] [MAIN ] DKS: Loaded 50351 primary data records. [2025-09-18T22:50:24.174422] [DEBUG] [MAIN ] DLNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:24.177302] [INFO ] [MAIN ] DLNG: Generated 1807 derivative records from 6345 primary records. [2025-09-18T22:50:24.177568] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-09-18T22:50:24.210795] [DEBUG] [MAIN ] DLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:24.212617] [INFO ] [MAIN ] DLB: Generated 1807 derivative records from 32524 primary records. [2025-09-18T22:50:24.213228] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-09-18T22:50:24.215525] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1807 records). [2025-09-18T22:50:24.217140] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-09-18T22:50:24.220152] [INFO ] [MAIN ] Derivative Progress: 511/2075 symbols completed. DLNG took 1.1s. Estimated remaining: 10m 10s. Rate: 153.9 symbols/min [2025-09-18T22:50:24.221277] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:24.238916] [DEBUG] [LOCAL ] DLB: Derivative data saved (1807 records). [2025-09-18T22:50:24.239060] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-09-18T22:50:24.241217] [INFO ] [MAIN ] Derivative Progress: 512/2075 symbols completed. DLB took 1.1s. Estimated remaining: 10m 8s. Rate: 154.2 symbols/min [2025-09-18T22:50:24.242609] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:24.258620] [DEBUG] [MAIN ] DKS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:24.259469] [INFO ] [MAIN ] DKS: Generated 1807 derivative records from 50351 primary records. [2025-09-18T22:50:24.259727] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-09-18T22:50:24.290933] [DEBUG] [LOCAL ] DMB: Loaded 10199 existing records from primary storage. [2025-09-18T22:50:24.292318] [INFO ] [MAIN ] DMB: Loaded 10199 primary data records. [2025-09-18T22:50:24.325907] [DEBUG] [LOCAL ] DKS: Derivative data saved (1807 records). [2025-09-18T22:50:24.347194] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-09-18T22:50:24.378746] [INFO ] [MAIN ] Derivative Progress: 513/2075 symbols completed. DKS took 1.2s. Estimated remaining: 10m 7s. Rate: 154.4 symbols/min [2025-09-18T22:50:24.396104] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:24.411220] [DEBUG] [LOCAL ] DLX: Loaded 29538 existing records from primary storage. [2025-09-18T22:50:24.415434] [INFO ] [MAIN ] DLX: Loaded 29538 primary data records. [2025-09-18T22:50:25.045374] [DEBUG] [LOCAL ] DNOW: Loaded 43837 existing records from primary storage. [2025-09-18T22:50:25.047007] [INFO ] [MAIN ] DNOW: Loaded 43837 primary data records. [2025-09-18T22:50:25.384606] [DEBUG] [MAIN ] DMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:25.386294] [INFO ] [MAIN ] DMB: Generated 1807 derivative records from 10199 primary records. [2025-09-18T22:50:25.386671] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-09-18T22:50:25.407961] [DEBUG] [LOCAL ] DMB: Derivative data saved (1807 records). [2025-09-18T22:50:25.408411] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-09-18T22:50:25.411178] [INFO ] [MAIN ] Derivative Progress: 514/2075 symbols completed. DMB took 1.2s. Estimated remaining: 10m 9s. Rate: 153.9 symbols/min [2025-09-18T22:50:25.423500] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:25.425504] [DEBUG] [MAIN ] DLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:25.427149] [INFO ] [MAIN ] DLX: Generated 1807 derivative records from 29538 primary records. [2025-09-18T22:50:25.427440] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-09-18T22:50:25.448128] [DEBUG] [LOCAL ] DLX: Derivative data saved (1807 records). [2025-09-18T22:50:25.449148] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-09-18T22:50:25.451951] [INFO ] [MAIN ] Derivative Progress: 515/2075 symbols completed. DLX took 1.2s. Estimated remaining: 10m 7s. Rate: 154.1 symbols/min [2025-09-18T22:50:25.460732] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:25.474071] [DEBUG] [MAIN ] DNOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:25.474831] [INFO ] [MAIN ] DNOW: Generated 1807 derivative records from 43837 primary records. [2025-09-18T22:50:25.474963] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-09-18T22:50:25.499208] [DEBUG] [LOCAL ] DNP: Loaded 33722 existing records from primary storage. [2025-09-18T22:50:25.500166] [INFO ] [MAIN ] DNP: Loaded 33722 primary data records. [2025-09-18T22:50:25.589535] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1807 records). [2025-09-18T22:50:25.608900] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-09-18T22:50:25.615213] [INFO ] [MAIN ] Derivative Progress: 516/2075 symbols completed. DNOW took 1.2s. Estimated remaining: 10m 6s. Rate: 154.3 symbols/min [2025-09-18T22:50:25.615898] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:25.850754] [DEBUG] [LOCAL ] DOC: Loaded 53925 existing records from primary storage. [2025-09-18T22:50:25.851021] [INFO ] [MAIN ] DOC: Loaded 53925 primary data records. [2025-09-18T22:50:26.200463] [DEBUG] [LOCAL ] DOCN: Loaded 50790 existing records from primary storage. [2025-09-18T22:50:26.200750] [INFO ] [MAIN ] DOCN: Loaded 50790 primary data records. [2025-09-18T22:50:26.352993] [DEBUG] [MAIN ] DNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:26.454121] [INFO ] [MAIN ] DNP: Generated 1807 derivative records from 33722 primary records. [2025-09-18T22:50:26.526769] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-09-18T22:50:26.549895] [DEBUG] [LOCAL ] DNP: Derivative data saved (1807 records). [2025-09-18T22:50:26.550252] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-09-18T22:50:26.552571] [INFO ] [MAIN ] Derivative Progress: 517/2075 symbols completed. DNP took 1.1s. Estimated remaining: 10m 7s. Rate: 153.9 symbols/min [2025-09-18T22:50:26.553088] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:26.566510] [DEBUG] [MAIN ] DOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:26.568349] [INFO ] [MAIN ] DOC: Generated 1807 derivative records from 53925 primary records. [2025-09-18T22:50:26.568968] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-09-18T22:50:26.588780] [DEBUG] [LOCAL ] DOC: Derivative data saved (1807 records). [2025-09-18T22:50:26.589062] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-09-18T22:50:26.593160] [INFO ] [MAIN ] Derivative Progress: 518/2075 symbols completed. DOC took 1.1s. Estimated remaining: 10m 6s. Rate: 154.2 symbols/min [2025-09-18T22:50:26.593609] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:26.607347] [DEBUG] [MAIN ] DOCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:26.608187] [INFO ] [MAIN ] DOCN: Generated 1807 derivative records from 50790 primary records. [2025-09-18T22:50:26.608370] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-09-18T22:50:26.640876] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1807 records). [2025-09-18T22:50:26.641387] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-09-18T22:50:26.644056] [INFO ] [MAIN ] Derivative Progress: 519/2075 symbols completed. DOCN took 1.0s. Estimated remaining: 10m 5s. Rate: 154.4 symbols/min [2025-09-18T22:50:26.644571] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:26.696959] [DEBUG] [LOCAL ] DOLE: Loaded 38101 existing records from primary storage. [2025-09-18T22:50:26.697139] [DEBUG] [LOCAL ] DOCS: Loaded 51729 existing records from primary storage. [2025-09-18T22:50:26.697629] [INFO ] [MAIN ] DOCS: Loaded 51729 primary data records. [2025-09-18T22:50:26.697514] [INFO ] [MAIN ] DOLE: Loaded 38101 primary data records. [2025-09-18T22:50:27.020860] [DEBUG] [LOCAL ] DOUG: Loaded 35182 existing records from primary storage. [2025-09-18T22:50:27.144858] [INFO ] [MAIN ] DOUG: Loaded 35182 primary data records. [2025-09-18T22:50:28.038669] [DEBUG] [MAIN ] DOLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:28.041419] [INFO ] [MAIN ] DOLE: Generated 1807 derivative records from 38101 primary records. [2025-09-18T22:50:28.044512] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-09-18T22:50:28.060133] [DEBUG] [MAIN ] DOCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:28.061616] [INFO ] [MAIN ] DOCS: Generated 1807 derivative records from 51729 primary records. [2025-09-18T22:50:28.062254] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-09-18T22:50:28.099416] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1807 records). [2025-09-18T22:50:28.101341] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1807 records). [2025-09-18T22:50:28.103145] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-09-18T22:50:28.101418] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-09-18T22:50:28.105590] [INFO ] [MAIN ] Derivative Progress: 520/2075 symbols completed. DOLE took 1.5s. Estimated remaining: 10m 7s. Rate: 153.6 symbols/min [2025-09-18T22:50:28.109948] [INFO ] [MAIN ] Derivative Progress: 521/2075 symbols completed. DOCS took 1.6s. Estimated remaining: 10m 6s. Rate: 153.9 symbols/min [2025-09-18T22:50:28.110829] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:28.112788] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:28.127760] [DEBUG] [MAIN ] DOUG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:28.128578] [INFO ] [MAIN ] DOUG: Generated 1807 derivative records from 35182 primary records. [2025-09-18T22:50:28.128703] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-09-18T22:50:28.146071] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1807 records). [2025-09-18T22:50:28.146263] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-09-18T22:50:28.149502] [INFO ] [MAIN ] Derivative Progress: 522/2075 symbols completed. DOUG took 1.5s. Estimated remaining: 10m 4s. Rate: 154.2 symbols/min [2025-09-18T22:50:28.150007] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:28.219686] [DEBUG] [LOCAL ] DOV: Loaded 46188 existing records from primary storage. [2025-09-18T22:50:28.219876] [INFO ] [MAIN ] DOV: Loaded 46188 primary data records. [2025-09-18T22:50:28.360885] [DEBUG] [LOCAL ] DOW: Loaded 54123 existing records from primary storage. [2025-09-18T22:50:28.356771] [DEBUG] [LOCAL ] DQ: Loaded 43417 existing records from primary storage. [2025-09-18T22:50:28.361090] [INFO ] [MAIN ] DOW: Loaded 54123 primary data records. [2025-09-18T22:50:28.361201] [INFO ] [MAIN ] DQ: Loaded 43417 primary data records. [2025-09-18T22:50:29.261379] [DEBUG] [MAIN ] DOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:29.263618] [INFO ] [MAIN ] DOV: Generated 1807 derivative records from 46188 primary records. [2025-09-18T22:50:29.264751] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-09-18T22:50:29.288056] [DEBUG] [MAIN ] DQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:29.291491] [INFO ] [MAIN ] DQ: Generated 1807 derivative records from 43417 primary records. [2025-09-18T22:50:29.294664] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-09-18T22:50:29.297895] [DEBUG] [LOCAL ] DOV: Derivative data saved (1807 records). [2025-09-18T22:50:29.306209] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-09-18T22:50:29.308855] [INFO ] [MAIN ] Derivative Progress: 523/2075 symbols completed. DOV took 1.2s. Estimated remaining: 10m 6s. Rate: 153.6 symbols/min [2025-09-18T22:50:29.329607] [DEBUG] [LOCAL ] DQ: Derivative data saved (1807 records). [2025-09-18T22:50:29.329823] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-09-18T22:50:29.332414] [INFO ] [MAIN ] Derivative Progress: 524/2075 symbols completed. DQ took 1.2s. Estimated remaining: 10m 5s. Rate: 153.9 symbols/min [2025-09-18T22:50:29.330035] [DEBUG] [MAIN ] DOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:29.333323] [INFO ] [MAIN ] DOW: Generated 1807 derivative records from 54123 primary records. [2025-09-18T22:50:29.333438] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-09-18T22:50:29.349017] [DEBUG] [LOCAL ] DOW: Derivative data saved (1807 records). [2025-09-18T22:50:29.349087] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-09-18T22:50:29.352174] [INFO ] [MAIN ] Derivative Progress: 525/2075 symbols completed. DOW took 1.2s. Estimated remaining: 10m 3s. Rate: 154.1 symbols/min [2025-09-18T22:50:29.352910] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:29.352762] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:29.352854] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:29.357875] [DEBUG] [LOCAL ] DSMC: Loaded 2010 existing records from primary storage. [2025-09-18T22:50:29.358035] [INFO ] [MAIN ] DSMC: Loaded 2010 primary data records. [2025-09-18T22:50:29.469107] [DEBUG] [LOCAL ] DRLL: Loaded 10099 existing records from primary storage. [2025-09-18T22:50:29.474831] [INFO ] [MAIN ] DRLL: Loaded 10099 primary data records. [2025-09-18T22:50:30.011837] [DEBUG] [LOCAL ] DRH: Loaded 50816 existing records from primary storage. [2025-09-18T22:50:30.012194] [INFO ] [MAIN ] DRH: Loaded 50816 primary data records. [2025-09-18T22:50:30.336534] [DEBUG] [MAIN ] DSMC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:50:30.337505] [INFO ] [MAIN ] DSMC: Generated 1806 derivative records from 2010 primary records. [2025-09-18T22:50:30.337754] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-09-18T22:50:30.355758] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1806 records). [2025-09-18T22:50:30.357755] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-09-18T22:50:30.359870] [INFO ] [MAIN ] Derivative Progress: 526/2075 symbols completed. DSMC took 1.0s. Estimated remaining: 10m 5s. Rate: 153.7 symbols/min [2025-09-18T22:50:30.360231] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:30.374979] [DEBUG] [MAIN ] DRLL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:30.376209] [INFO ] [MAIN ] DRLL: Generated 1807 derivative records from 10099 primary records. [2025-09-18T22:50:30.376367] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-09-18T22:50:30.407704] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1807 records). [2025-09-18T22:50:30.409016] [DEBUG] [LOCAL ] DSU: Loaded 21836 existing records from primary storage. [2025-09-18T22:50:30.409160] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-09-18T22:50:30.411279] [INFO ] [MAIN ] Derivative Progress: 527/2075 symbols completed. DRLL took 1.1s. Estimated remaining: 10m 3s. Rate: 153.9 symbols/min [2025-09-18T22:50:30.411703] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:30.411397] [INFO ] [MAIN ] DSU: Loaded 21836 primary data records. [2025-09-18T22:50:30.436435] [DEBUG] [MAIN ] DRH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:30.457423] [INFO ] [MAIN ] DRH: Generated 1807 derivative records from 50816 primary records. [2025-09-18T22:50:30.457526] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-09-18T22:50:30.548762] [DEBUG] [LOCAL ] DRH: Derivative data saved (1807 records). [2025-09-18T22:50:30.554798] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-09-18T22:50:30.557557] [INFO ] [MAIN ] Derivative Progress: 528/2075 symbols completed. DRH took 1.2s. Estimated remaining: 10m 2s. Rate: 154.1 symbols/min [2025-09-18T22:50:30.568309] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:30.642195] [DEBUG] [LOCAL ] DSX: Loaded 24874 existing records from primary storage. [2025-09-18T22:50:30.646206] [INFO ] [MAIN ] DSX: Loaded 24874 primary data records. [2025-09-18T22:50:31.165041] [DEBUG] [LOCAL ] DT: Loaded 53342 existing records from primary storage. [2025-09-18T22:50:31.166357] [INFO ] [MAIN ] DT: Loaded 53342 primary data records. [2025-09-18T22:50:31.373497] [DEBUG] [MAIN ] DSU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:31.495032] [INFO ] [MAIN ] DSU: Generated 1807 derivative records from 21836 primary records. [2025-09-18T22:50:31.495618] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-09-18T22:50:31.518362] [DEBUG] [LOCAL ] DSU: Derivative data saved (1807 records). [2025-09-18T22:50:31.518599] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-09-18T22:50:31.520970] [INFO ] [MAIN ] Derivative Progress: 529/2075 symbols completed. DSU took 1.2s. Estimated remaining: 10m 4s. Rate: 153.7 symbols/min [2025-09-18T22:50:31.521316] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:31.536177] [DEBUG] [MAIN ] DSX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:31.538370] [INFO ] [MAIN ] DSX: Generated 1807 derivative records from 24874 primary records. [2025-09-18T22:50:31.538686] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-09-18T22:50:31.559704] [DEBUG] [LOCAL ] DSX: Derivative data saved (1807 records). [2025-09-18T22:50:31.560055] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-09-18T22:50:31.562522] [INFO ] [MAIN ] Derivative Progress: 530/2075 symbols completed. DSX took 1.2s. Estimated remaining: 10m 2s. Rate: 153.9 symbols/min [2025-09-18T22:50:31.562865] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:31.577108] [DEBUG] [MAIN ] DT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:31.577998] [INFO ] [MAIN ] DT: Generated 1807 derivative records from 53342 primary records. [2025-09-18T22:50:31.578130] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-09-18T22:50:31.599746] [DEBUG] [LOCAL ] DT: Derivative data saved (1807 records). [2025-09-18T22:50:31.599940] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-09-18T22:50:31.595519] [DEBUG] [LOCAL ] DTG: Loaded 5943 existing records from primary storage. [2025-09-18T22:50:31.602556] [INFO ] [MAIN ] Derivative Progress: 531/2075 symbols completed. DT took 1.0s. Estimated remaining: 10m 1s. Rate: 154.2 symbols/min [2025-09-18T22:50:31.602749] [INFO ] [MAIN ] DTG: Loaded 5943 primary data records. [2025-09-18T22:50:31.614068] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:31.749285] [DEBUG] [LOCAL ] DTE: Loaded 48330 existing records from primary storage. [2025-09-18T22:50:31.759985] [INFO ] [MAIN ] DTE: Loaded 48330 primary data records. [2025-09-18T22:50:32.168951] [DEBUG] [LOCAL ] DTM: Loaded 44984 existing records from primary storage. [2025-09-18T22:50:32.283981] [INFO ] [MAIN ] DTM: Loaded 44984 primary data records. [2025-09-18T22:50:32.647573] [DEBUG] [MAIN ] DTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:32.649342] [INFO ] [MAIN ] DTG: Generated 1807 derivative records from 5943 primary records. [2025-09-18T22:50:32.650608] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-09-18T22:50:32.683078] [DEBUG] [MAIN ] DTE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:32.684324] [INFO ] [MAIN ] DTE: Generated 1807 derivative records from 48330 primary records. [2025-09-18T22:50:32.685330] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-09-18T22:50:32.689105] [DEBUG] [LOCAL ] DTG: Derivative data saved (1807 records). [2025-09-18T22:50:32.689275] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-09-18T22:50:32.691867] [INFO ] [MAIN ] Derivative Progress: 532/2075 symbols completed. DTG took 1.1s. Estimated remaining: 10m 2s. Rate: 153.7 symbols/min [2025-09-18T22:50:32.692498] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:32.712952] [DEBUG] [LOCAL ] DTE: Derivative data saved (1807 records). [2025-09-18T22:50:32.716957] [DEBUG] [LOCAL ] DTW: Loaded 4957 existing records from primary storage. [2025-09-18T22:50:32.718602] [INFO ] [MAIN ] DTW: Loaded 4957 primary data records. [2025-09-18T22:50:32.730248] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-09-18T22:50:32.764988] [INFO ] [MAIN ] Derivative Progress: 533/2075 symbols completed. DTE took 1.2s. Estimated remaining: 10m 1s. Rate: 153.9 symbols/min [2025-09-18T22:50:32.810994] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:32.810864] [DEBUG] [MAIN ] DTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:32.835749] [INFO ] [MAIN ] DTM: Generated 1807 derivative records from 44984 primary records. [2025-09-18T22:50:32.839419] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-09-18T22:50:32.905266] [DEBUG] [LOCAL ] DTM: Derivative data saved (1807 records). [2025-09-18T22:50:32.930419] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-09-18T22:50:33.057137] [INFO ] [MAIN ] Derivative Progress: 534/2075 symbols completed. DTM took 1.4s. Estimated remaining: 10m 0s. Rate: 154.0 symbols/min [2025-09-18T22:50:33.058378] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:33.067908] [DEBUG] [LOCAL ] DUKB: Loaded 6483 existing records from primary storage. [2025-09-18T22:50:33.068481] [INFO ] [MAIN ] DUKB: Loaded 6483 primary data records. [2025-09-18T22:50:33.440099] [DEBUG] [LOCAL ] DUK: Loaded 53863 existing records from primary storage. [2025-09-18T22:50:33.442487] [INFO ] [MAIN ] DUK: Loaded 53863 primary data records. [2025-09-18T22:50:33.527421] [DEBUG] [MAIN ] DTW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:33.540771] [INFO ] [MAIN ] DTW: Generated 1807 derivative records from 4957 primary records. [2025-09-18T22:50:33.546162] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-09-18T22:50:33.664180] [DEBUG] [LOCAL ] DTW: Derivative data saved (1807 records). [2025-09-18T22:50:33.780534] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-09-18T22:50:33.782910] [INFO ] [MAIN ] Derivative Progress: 535/2075 symbols completed. DTW took 1.1s. Estimated remaining: 10m 1s. Rate: 153.7 symbols/min [2025-09-18T22:50:33.783497] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:33.802769] [DEBUG] [MAIN ] DUKB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:33.805233] [INFO ] [MAIN ] DUKB: Generated 1807 derivative records from 6483 primary records. [2025-09-18T22:50:33.805764] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-09-18T22:50:33.843795] [DEBUG] [MAIN ] DUK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:33.843109] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1807 records). [2025-09-18T22:50:33.844753] [INFO ] [MAIN ] DUK: Generated 1807 derivative records from 53863 primary records. [2025-09-18T22:50:33.859046] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-09-18T22:50:33.859244] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-09-18T22:50:33.862777] [INFO ] [MAIN ] Derivative Progress: 536/2075 symbols completed. DUKB took 0.8s. Estimated remaining: 9m 60s. Rate: 154.0 symbols/min [2025-09-18T22:50:33.874540] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:33.883419] [DEBUG] [LOCAL ] DUK: Derivative data saved (1807 records). [2025-09-18T22:50:33.883820] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-09-18T22:50:33.887621] [INFO ] [MAIN ] Derivative Progress: 537/2075 symbols completed. DUK took 1.1s. Estimated remaining: 9m 58s. Rate: 154.2 symbols/min [2025-09-18T22:50:33.904196] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:33.905420] [DEBUG] [LOCAL ] DV: Loaded 51678 existing records from primary storage. [2025-09-18T22:50:33.906022] [INFO ] [MAIN ] DV: Loaded 51678 primary data records. [2025-09-18T22:50:34.250571] [DEBUG] [LOCAL ] DVA: Loaded 42021 existing records from primary storage. [2025-09-18T22:50:34.275356] [INFO ] [MAIN ] DVA: Loaded 42021 primary data records. [2025-09-18T22:50:34.410349] [DEBUG] [LOCAL ] DVN: Loaded 54089 existing records from primary storage. [2025-09-18T22:50:34.410579] [INFO ] [MAIN ] DVN: Loaded 54089 primary data records. [2025-09-18T22:50:34.941223] [DEBUG] [MAIN ] DV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:34.943256] [INFO ] [MAIN ] DV: Generated 1807 derivative records from 51678 primary records. [2025-09-18T22:50:34.943502] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-09-18T22:50:34.969523] [DEBUG] [LOCAL ] DV: Derivative data saved (1807 records). [2025-09-18T22:50:34.969725] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-09-18T22:50:34.972065] [INFO ] [MAIN ] Derivative Progress: 538/2075 symbols completed. DV took 1.2s. Estimated remaining: 9m 60s. Rate: 153.7 symbols/min [2025-09-18T22:50:34.993447] [DEBUG] [MAIN ] DVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:34.994435] [INFO ] [MAIN ] DVA: Generated 1807 derivative records from 42021 primary records. [2025-09-18T22:50:34.994681] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-09-18T22:50:35.016174] [DEBUG] [LOCAL ] DVA: Derivative data saved (1807 records). [2025-09-18T22:50:35.029060] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-09-18T22:50:35.029941] [DEBUG] [MAIN ] DVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:35.032561] [INFO ] [MAIN ] Derivative Progress: 539/2075 symbols completed. DVA took 1.2s. Estimated remaining: 9m 59s. Rate: 154.0 symbols/min [2025-09-18T22:50:35.033707] [INFO ] [MAIN ] DVN: Generated 1807 derivative records from 54089 primary records. [2025-09-18T22:50:35.033900] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-09-18T22:50:35.050141] [DEBUG] [LOCAL ] DVN: Derivative data saved (1807 records). [2025-09-18T22:50:35.050287] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-09-18T22:50:35.053097] [INFO ] [MAIN ] Derivative Progress: 540/2075 symbols completed. DVN took 1.1s. Estimated remaining: 9m 57s. Rate: 154.2 symbols/min [2025-09-18T22:50:35.054046] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:35.054299] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:35.053981] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:35.139782] [DEBUG] [LOCAL ] DX: Loaded 52855 existing records from primary storage. [2025-09-18T22:50:35.138529] [DEBUG] [LOCAL ] DXYZ: Loaded 37029 existing records from primary storage. [2025-09-18T22:50:35.140074] [INFO ] [MAIN ] DX: Loaded 52855 primary data records. [2025-09-18T22:50:35.140350] [INFO ] [MAIN ] DXYZ: Loaded 37029 primary data records. [2025-09-18T22:50:35.339071] [DEBUG] [LOCAL ] DXC: Loaded 49827 existing records from primary storage. [2025-09-18T22:50:35.367614] [INFO ] [MAIN ] DXC: Loaded 49827 primary data records. [2025-09-18T22:50:36.164341] [DEBUG] [MAIN ] DX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:36.165585] [INFO ] [MAIN ] DX: Generated 1807 derivative records from 52855 primary records. [2025-09-18T22:50:36.165805] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-09-18T22:50:36.184758] [DEBUG] [LOCAL ] DX: Derivative data saved (1807 records). [2025-09-18T22:50:36.187169] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-09-18T22:50:36.192822] [INFO ] [MAIN ] Derivative Progress: 541/2075 symbols completed. DX took 1.1s. Estimated remaining: 9m 59s. Rate: 153.7 symbols/min [2025-09-18T22:50:36.193728] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:36.225399] [DEBUG] [MAIN ] DXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:36.226739] [INFO ] [MAIN ] DXC: Generated 1807 derivative records from 49827 primary records. [2025-09-18T22:50:36.227059] [DEBUG] [MAIN ] DXYZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:36.227174] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-09-18T22:50:36.228762] [INFO ] [MAIN ] DXYZ: Generated 1807 derivative records from 37029 primary records. [2025-09-18T22:50:36.228853] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-09-18T22:50:36.265801] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1807 records). [2025-09-18T22:50:36.266794] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-09-18T22:50:36.269184] [INFO ] [MAIN ] Derivative Progress: 542/2075 symbols completed. DXYZ took 1.2s. Estimated remaining: 9m 58s. Rate: 153.9 symbols/min [2025-09-18T22:50:36.271150] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:36.273032] [DEBUG] [LOCAL ] DXC: Derivative data saved (1807 records). [2025-09-18T22:50:36.273199] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-09-18T22:50:36.276540] [INFO ] [MAIN ] Derivative Progress: 543/2075 symbols completed. DXC took 1.2s. Estimated remaining: 9m 56s. Rate: 154.2 symbols/min [2025-09-18T22:50:36.277062] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:36.296535] [DEBUG] [LOCAL ] EAI: Loaded 4051 existing records from primary storage. [2025-09-18T22:50:36.296747] [INFO ] [MAIN ] EAI: Loaded 4051 primary data records. [2025-09-18T22:50:36.425848] [DEBUG] [LOCAL ] E: Loaded 33908 existing records from primary storage. [2025-09-18T22:50:36.467392] [INFO ] [MAIN ] E: Loaded 33908 primary data records. [2025-09-18T22:50:36.633858] [DEBUG] [LOCAL ] EAF: Loaded 44503 existing records from primary storage. [2025-09-18T22:50:36.682514] [INFO ] [MAIN ] EAF: Loaded 44503 primary data records. [2025-09-18T22:50:37.348810] [DEBUG] [MAIN ] EAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:37.350377] [INFO ] [MAIN ] EAI: Generated 1807 derivative records from 4051 primary records. [2025-09-18T22:50:37.350994] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-09-18T22:50:37.384054] [DEBUG] [MAIN ] E: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:37.385508] [INFO ] [MAIN ] E: Generated 1807 derivative records from 33908 primary records. [2025-09-18T22:50:37.386204] [DEBUG] [LOCAL ] EAI: Derivative data saved (1807 records). [2025-09-18T22:50:37.386304] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-09-18T22:50:37.386394] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-09-18T22:50:37.388571] [INFO ] [MAIN ] Derivative Progress: 544/2075 symbols completed. EAI took 1.1s. Estimated remaining: 9m 58s. Rate: 153.7 symbols/min [2025-09-18T22:50:37.390002] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:37.422327] [DEBUG] [MAIN ] EAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:37.423741] [INFO ] [MAIN ] EAF: Generated 1807 derivative records from 44503 primary records. [2025-09-18T22:50:37.423930] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-09-18T22:50:37.437959] [DEBUG] [LOCAL ] E: Derivative data saved (1807 records). [2025-09-18T22:50:37.441907] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-09-18T22:50:37.453863] [INFO ] [MAIN ] Derivative Progress: 545/2075 symbols completed. E took 1.3s. Estimated remaining: 9m 56s. Rate: 153.9 symbols/min [2025-09-18T22:50:37.457616] [DEBUG] [LOCAL ] EAF: Derivative data saved (1807 records). [2025-09-18T22:50:37.457828] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-09-18T22:50:37.460923] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:37.461070] [INFO ] [MAIN ] Derivative Progress: 546/2075 symbols completed. EAF took 1.2s. Estimated remaining: 9m 55s. Rate: 154.2 symbols/min [2025-09-18T22:50:37.461296] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:37.481701] [DEBUG] [LOCAL ] EARN: Loaded 30975 existing records from primary storage. [2025-09-18T22:50:37.482112] [INFO ] [MAIN ] EARN: Loaded 30975 primary data records. [2025-09-18T22:50:37.826408] [DEBUG] [LOCAL ] EB: Loaded 38499 existing records from primary storage. [2025-09-18T22:50:37.835935] [INFO ] [MAIN ] EB: Loaded 38499 primary data records. [2025-09-18T22:50:37.871084] [DEBUG] [LOCAL ] EAT: Loaded 50215 existing records from primary storage. [2025-09-18T22:50:37.895357] [INFO ] [MAIN ] EAT: Loaded 50215 primary data records. [2025-09-18T22:50:38.514592] [DEBUG] [MAIN ] EARN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:38.516686] [INFO ] [MAIN ] EARN: Generated 1807 derivative records from 30975 primary records. [2025-09-18T22:50:38.517139] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-09-18T22:50:38.535527] [DEBUG] [LOCAL ] EARN: Derivative data saved (1807 records). [2025-09-18T22:50:38.536298] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-09-18T22:50:38.538805] [INFO ] [MAIN ] Derivative Progress: 547/2075 symbols completed. EARN took 1.1s. Estimated remaining: 9m 57s. Rate: 153.7 symbols/min [2025-09-18T22:50:38.539629] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:38.558964] [DEBUG] [MAIN ] EAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:38.565521] [INFO ] [MAIN ] EAT: Generated 1807 derivative records from 50215 primary records. [2025-09-18T22:50:38.567432] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-09-18T22:50:38.596381] [DEBUG] [LOCAL ] EBF: Loaded 19811 existing records from primary storage. [2025-09-18T22:50:38.596739] [DEBUG] [MAIN ] EB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:38.600472] [INFO ] [MAIN ] EB: Generated 1807 derivative records from 38499 primary records. [2025-09-18T22:50:38.600845] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-09-18T22:50:38.600927] [INFO ] [MAIN ] EBF: Loaded 19811 primary data records. [2025-09-18T22:50:38.683015] [DEBUG] [LOCAL ] EB: Derivative data saved (1807 records). [2025-09-18T22:50:38.701454] [DEBUG] [LOCAL ] EAT: Derivative data saved (1807 records). [2025-09-18T22:50:38.701615] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-09-18T22:50:38.688830] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-09-18T22:50:38.709545] [INFO ] [MAIN ] Derivative Progress: 548/2075 symbols completed. EB took 1.2s. Estimated remaining: 9m 56s. Rate: 153.8 symbols/min [2025-09-18T22:50:38.729094] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:38.729268] [INFO ] [MAIN ] Derivative Progress: 549/2075 symbols completed. EAT took 1.3s. Estimated remaining: 9m 54s. Rate: 154.1 symbols/min [2025-09-18T22:50:38.729636] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:38.972528] [DEBUG] [LOCAL ] EBS: Loaded 47331 existing records from primary storage. [2025-09-18T22:50:38.973030] [INFO ] [MAIN ] EBS: Loaded 47331 primary data records. [2025-09-18T22:50:39.111426] [DEBUG] [LOCAL ] EC: Loaded 49826 existing records from primary storage. [2025-09-18T22:50:39.134890] [INFO ] [MAIN ] EC: Loaded 49826 primary data records. [2025-09-18T22:50:39.310130] [DEBUG] [MAIN ] EBF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:39.452896] [INFO ] [MAIN ] EBF: Generated 1807 derivative records from 19811 primary records. [2025-09-18T22:50:39.462850] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-09-18T22:50:39.583666] [DEBUG] [LOCAL ] EBF: Derivative data saved (1807 records). [2025-09-18T22:50:39.609699] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-09-18T22:50:39.753294] [INFO ] [MAIN ] Derivative Progress: 550/2075 symbols completed. EBF took 1.2s. Estimated remaining: 9m 55s. Rate: 153.7 symbols/min [2025-09-18T22:50:39.753908] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:39.789363] [DEBUG] [MAIN ] EBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:39.790326] [INFO ] [MAIN ] EBS: Generated 1807 derivative records from 47331 primary records. [2025-09-18T22:50:39.790567] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-09-18T22:50:39.817961] [DEBUG] [LOCAL ] EBS: Derivative data saved (1807 records). [2025-09-18T22:50:39.819582] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-09-18T22:50:39.821904] [INFO ] [MAIN ] Derivative Progress: 551/2075 symbols completed. EBS took 1.1s. Estimated remaining: 9m 54s. Rate: 153.9 symbols/min [2025-09-18T22:50:39.819318] [DEBUG] [LOCAL ] ECAT: Loaded 30165 existing records from primary storage. [2025-09-18T22:50:39.835096] [INFO ] [MAIN ] ECAT: Loaded 30165 primary data records. [2025-09-18T22:50:39.835370] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:39.837061] [DEBUG] [MAIN ] EC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:39.859475] [INFO ] [MAIN ] EC: Generated 1807 derivative records from 49826 primary records. [2025-09-18T22:50:39.876326] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-09-18T22:50:40.039460] [DEBUG] [LOCAL ] EC: Derivative data saved (1807 records). [2025-09-18T22:50:40.166872] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-09-18T22:50:40.183138] [INFO ] [MAIN ] Derivative Progress: 552/2075 symbols completed. EC took 1.5s. Estimated remaining: 9m 54s. Rate: 153.9 symbols/min [2025-09-18T22:50:40.195376] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:40.197953] [DEBUG] [LOCAL ] ECC: Loaded 43720 existing records from primary storage. [2025-09-18T22:50:40.198294] [INFO ] [MAIN ] ECC: Loaded 43720 primary data records. [2025-09-18T22:50:40.522167] [DEBUG] [LOCAL ] ECG: Loaded 34945 existing records from primary storage. [2025-09-18T22:50:40.522421] [INFO ] [MAIN ] ECG: Loaded 34945 primary data records. [2025-09-18T22:50:40.726043] [DEBUG] [MAIN ] ECAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:40.776467] [INFO ] [MAIN ] ECAT: Generated 1807 derivative records from 30165 primary records. [2025-09-18T22:50:40.834989] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-09-18T22:50:40.865843] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1807 records). [2025-09-18T22:50:40.866467] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-09-18T22:50:40.868907] [INFO ] [MAIN ] Derivative Progress: 553/2075 symbols completed. ECAT took 1.1s. Estimated remaining: 9m 54s. Rate: 153.7 symbols/min [2025-09-18T22:50:40.882256] [DEBUG] [MAIN ] ECC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:40.883240] [INFO ] [MAIN ] ECC: Generated 1807 derivative records from 43720 primary records. [2025-09-18T22:50:40.883843] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-09-18T22:50:40.900039] [DEBUG] [LOCAL ] ECC: Derivative data saved (1807 records). [2025-09-18T22:50:40.900201] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-09-18T22:50:40.902091] [INFO ] [MAIN ] Derivative Progress: 554/2075 symbols completed. ECC took 1.1s. Estimated remaining: 9m 53s. Rate: 153.9 symbols/min [2025-09-18T22:50:40.917421] [DEBUG] [MAIN ] ECG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:40.917974] [INFO ] [MAIN ] ECG: Generated 1807 derivative records from 34945 primary records. [2025-09-18T22:50:40.918034] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-09-18T22:50:40.933494] [DEBUG] [LOCAL ] ECG: Derivative data saved (1807 records). [2025-09-18T22:50:40.933557] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-09-18T22:50:40.936112] [INFO ] [MAIN ] Derivative Progress: 555/2075 symbols completed. ECG took 0.7s. Estimated remaining: 9m 51s. Rate: 154.2 symbols/min [2025-09-18T22:50:40.937043] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:40.937143] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:40.937227] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:40.964108] [DEBUG] [LOCAL ] ECO: Loaded 18799 existing records from primary storage. [2025-09-18T22:50:40.964277] [INFO ] [MAIN ] ECO: Loaded 18799 primary data records. [2025-09-18T22:50:41.188073] [DEBUG] [LOCAL ] ECVT: Loaded 43492 existing records from primary storage. [2025-09-18T22:50:41.296179] [INFO ] [MAIN ] ECVT: Loaded 43492 primary data records. [2025-09-18T22:50:41.343361] [DEBUG] [LOCAL ] ED: Loaded 53213 existing records from primary storage. [2025-09-18T22:50:41.369717] [INFO ] [MAIN ] ED: Loaded 53213 primary data records. [2025-09-18T22:50:42.022946] [DEBUG] [MAIN ] ECO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:42.024207] [INFO ] [MAIN ] ECO: Generated 1807 derivative records from 18799 primary records. [2025-09-18T22:50:42.024484] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-09-18T22:50:42.044323] [DEBUG] [LOCAL ] ECO: Derivative data saved (1807 records). [2025-09-18T22:50:42.044627] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-09-18T22:50:42.047152] [INFO ] [MAIN ] Derivative Progress: 556/2075 symbols completed. ECO took 1.1s. Estimated remaining: 9m 53s. Rate: 153.7 symbols/min [2025-09-18T22:50:42.047588] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:42.081467] [DEBUG] [MAIN ] ECVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:42.081109] [DEBUG] [MAIN ] ED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:42.082347] [INFO ] [MAIN ] ECVT: Generated 1807 derivative records from 43492 primary records. [2025-09-18T22:50:42.082475] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-09-18T22:50:42.083084] [INFO ] [MAIN ] ED: Generated 1807 derivative records from 53213 primary records. [2025-09-18T22:50:42.083892] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-09-18T22:50:42.128021] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1807 records). [2025-09-18T22:50:42.129674] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-09-18T22:50:42.133499] [DEBUG] [LOCAL ] EDD: Loaded 27486 existing records from primary storage. [2025-09-18T22:50:42.133889] [INFO ] [MAIN ] EDD: Loaded 27486 primary data records. [2025-09-18T22:50:42.132689] [INFO ] [MAIN ] Derivative Progress: 557/2075 symbols completed. ECVT took 1.2s. Estimated remaining: 9m 52s. Rate: 153.9 symbols/min [2025-09-18T22:50:42.139925] [DEBUG] [LOCAL ] ED: Derivative data saved (1807 records). [2025-09-18T22:50:42.146177] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:42.174806] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-09-18T22:50:42.197964] [INFO ] [MAIN ] Derivative Progress: 558/2075 symbols completed. ED took 1.3s. Estimated remaining: 9m 51s. Rate: 154.1 symbols/min [2025-09-18T22:50:42.219351] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:42.353889] [DEBUG] [LOCAL ] EDN: Loaded 17946 existing records from primary storage. [2025-09-18T22:50:42.481216] [INFO ] [MAIN ] EDN: Loaded 17946 primary data records. [2025-09-18T22:50:42.681665] [DEBUG] [LOCAL ] EDU: Loaded 45632 existing records from primary storage. [2025-09-18T22:50:42.804011] [INFO ] [MAIN ] EDU: Loaded 45632 primary data records. [2025-09-18T22:50:43.171832] [DEBUG] [MAIN ] EDD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:43.173269] [INFO ] [MAIN ] EDD: Generated 1807 derivative records from 27486 primary records. [2025-09-18T22:50:43.173459] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-09-18T22:50:43.194018] [DEBUG] [LOCAL ] EDD: Derivative data saved (1807 records). [2025-09-18T22:50:43.202236] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-09-18T22:50:43.204570] [INFO ] [MAIN ] Derivative Progress: 559/2075 symbols completed. EDD took 1.2s. Estimated remaining: 9m 52s. Rate: 153.7 symbols/min [2025-09-18T22:50:43.210273] [DEBUG] [MAIN ] EDN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:43.211434] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:43.211185] [INFO ] [MAIN ] EDN: Generated 1807 derivative records from 17946 primary records. [2025-09-18T22:50:43.212065] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-09-18T22:50:43.231273] [DEBUG] [LOCAL ] EDN: Derivative data saved (1807 records). [2025-09-18T22:50:43.231707] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-09-18T22:50:43.234252] [INFO ] [MAIN ] Derivative Progress: 560/2075 symbols completed. EDN took 1.1s. Estimated remaining: 9m 50s. Rate: 154.0 symbols/min [2025-09-18T22:50:43.235178] [INFO ] [MAIN ] EEA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:43.243001] [DEBUG] [LOCAL ] EEA: Loaded 2842 existing records from primary storage. [2025-09-18T22:50:43.256026] [INFO ] [MAIN ] EEA: Loaded 2842 primary data records. [2025-09-18T22:50:43.256341] [DEBUG] [MAIN ] EDU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:43.268784] [INFO ] [MAIN ] EDU: Generated 1807 derivative records from 45632 primary records. [2025-09-18T22:50:43.279102] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-09-18T22:50:43.441397] [DEBUG] [LOCAL ] EE: Loaded 32818 existing records from primary storage. [2025-09-18T22:50:43.477606] [DEBUG] [LOCAL ] EDU: Derivative data saved (1807 records). [2025-09-18T22:50:43.477851] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-09-18T22:50:43.480435] [INFO ] [MAIN ] Derivative Progress: 561/2075 symbols completed. EDU took 1.3s. Estimated remaining: 9m 50s. Rate: 154.1 symbols/min [2025-09-18T22:50:43.486719] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:43.477703] [INFO ] [MAIN ] EE: Loaded 32818 primary data records. [2025-09-18T22:50:43.836447] [DEBUG] [LOCAL ] EEX: Loaded 12439 existing records from primary storage. [2025-09-18T22:50:43.947520] [INFO ] [MAIN ] EEX: Loaded 12439 primary data records. [2025-09-18T22:50:44.279106] [DEBUG] [MAIN ] EEA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:44.279867] [INFO ] [MAIN ] EEA: Generated 1807 derivative records from 2842 primary records. [2025-09-18T22:50:44.280136] [DEBUG] [LOCAL ] EEA: Saving derivative data. [2025-09-18T22:50:44.296934] [DEBUG] [LOCAL ] EEA: Derivative data saved (1807 records). [2025-09-18T22:50:44.297588] [INFO ] [MAIN ] EEA: Successfully saved derivative data. [2025-09-18T22:50:44.299772] [INFO ] [MAIN ] Derivative Progress: 562/2075 symbols completed. EEA took 1.1s. Estimated remaining: 9m 50s. Rate: 153.8 symbols/min [2025-09-18T22:50:44.300330] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:44.324600] [DEBUG] [MAIN ] EE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:44.325692] [INFO ] [MAIN ] EE: Generated 1807 derivative records from 32818 primary records. [2025-09-18T22:50:44.325890] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-09-18T22:50:44.343128] [DEBUG] [LOCAL ] EE: Derivative data saved (1807 records). [2025-09-18T22:50:44.345068] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-09-18T22:50:44.348387] [INFO ] [MAIN ] Derivative Progress: 563/2075 symbols completed. EE took 1.1s. Estimated remaining: 9m 49s. Rate: 154.0 symbols/min [2025-09-18T22:50:44.349045] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:44.362339] [DEBUG] [MAIN ] EEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:44.363281] [INFO ] [MAIN ] EEX: Generated 1807 derivative records from 12439 primary records. [2025-09-18T22:50:44.363414] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-09-18T22:50:44.392416] [DEBUG] [LOCAL ] EEX: Derivative data saved (1807 records). [2025-09-18T22:50:44.392554] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-09-18T22:50:44.395152] [INFO ] [MAIN ] Derivative Progress: 564/2075 symbols completed. EEX took 0.9s. Estimated remaining: 9m 48s. Rate: 154.2 symbols/min [2025-09-18T22:50:44.395557] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:44.402234] [DEBUG] [LOCAL ] EFR: Loaded 14242 existing records from primary storage. [2025-09-18T22:50:44.402371] [INFO ] [MAIN ] EFR: Loaded 14242 primary data records. [2025-09-18T22:50:44.532591] [DEBUG] [LOCAL ] EFT: Loaded 12563 existing records from primary storage. [2025-09-18T22:50:44.519798] [DEBUG] [LOCAL ] EFC: Loaded 46603 existing records from primary storage. [2025-09-18T22:50:44.532800] [INFO ] [MAIN ] EFT: Loaded 12563 primary data records. [2025-09-18T22:50:44.536566] [INFO ] [MAIN ] EFC: Loaded 46603 primary data records. [2025-09-18T22:50:45.453933] [DEBUG] [MAIN ] EFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:45.455107] [INFO ] [MAIN ] EFR: Generated 1807 derivative records from 14242 primary records. [2025-09-18T22:50:45.461024] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-09-18T22:50:45.510032] [DEBUG] [MAIN ] EFT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:45.510379] [DEBUG] [MAIN ] EFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:45.509555] [DEBUG] [LOCAL ] EFR: Derivative data saved (1807 records). [2025-09-18T22:50:45.511238] [INFO ] [MAIN ] EFT: Generated 1807 derivative records from 12563 primary records. [2025-09-18T22:50:45.511352] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-09-18T22:50:45.511976] [INFO ] [MAIN ] EFC: Generated 1807 derivative records from 46603 primary records. [2025-09-18T22:50:45.513961] [INFO ] [MAIN ] Derivative Progress: 565/2075 symbols completed. EFR took 1.2s. Estimated remaining: 9m 49s. Rate: 153.7 symbols/min [2025-09-18T22:50:45.514184] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-09-18T22:50:45.514087] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-09-18T22:50:45.514997] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:45.545345] [DEBUG] [LOCAL ] EFT: Derivative data saved (1807 records). [2025-09-18T22:50:45.545948] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-09-18T22:50:45.549520] [INFO ] [MAIN ] Derivative Progress: 566/2075 symbols completed. EFT took 1.2s. Estimated remaining: 9m 48s. Rate: 154.0 symbols/min [2025-09-18T22:50:45.550104] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:45.553113] [DEBUG] [LOCAL ] EFC: Derivative data saved (1807 records). [2025-09-18T22:50:45.553214] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-09-18T22:50:45.555864] [INFO ] [MAIN ] Derivative Progress: 567/2075 symbols completed. EFC took 1.3s. Estimated remaining: 9m 47s. Rate: 154.2 symbols/min [2025-09-18T22:50:45.556249] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:45.613731] [DEBUG] [LOCAL ] EFXT: Loaded 29917 existing records from primary storage. [2025-09-18T22:50:45.614595] [DEBUG] [LOCAL ] EG: Loaded 29272 existing records from primary storage. [2025-09-18T22:50:45.614907] [INFO ] [MAIN ] EFXT: Loaded 29917 primary data records. [2025-09-18T22:50:45.614982] [INFO ] [MAIN ] EG: Loaded 29272 primary data records. [2025-09-18T22:50:45.833554] [DEBUG] [LOCAL ] EFX: Loaded 45372 existing records from primary storage. [2025-09-18T22:50:45.860694] [INFO ] [MAIN ] EFX: Loaded 45372 primary data records. [2025-09-18T22:50:46.619440] [DEBUG] [MAIN ] EFXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:46.633025] [INFO ] [MAIN ] EFXT: Generated 1807 derivative records from 29917 primary records. [2025-09-18T22:50:46.633545] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-09-18T22:50:46.633846] [DEBUG] [MAIN ] EG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:46.635510] [INFO ] [MAIN ] EG: Generated 1807 derivative records from 29272 primary records. [2025-09-18T22:50:46.635769] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-09-18T22:50:46.665531] [DEBUG] [LOCAL ] EG: Derivative data saved (1807 records). [2025-09-18T22:50:46.665873] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-09-18T22:50:46.668283] [INFO ] [MAIN ] Derivative Progress: 568/2075 symbols completed. EG took 1.1s. Estimated remaining: 9m 48s. Rate: 153.7 symbols/min [2025-09-18T22:50:46.674601] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1807 records). [2025-09-18T22:50:46.674813] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-09-18T22:50:46.676768] [INFO ] [MAIN ] Derivative Progress: 569/2075 symbols completed. EFXT took 1.1s. Estimated remaining: 9m 47s. Rate: 154.0 symbols/min [2025-09-18T22:50:46.689531] [DEBUG] [MAIN ] EFX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:46.690154] [INFO ] [MAIN ] EFX: Generated 1807 derivative records from 45372 primary records. [2025-09-18T22:50:46.690213] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-09-18T22:50:46.705699] [DEBUG] [LOCAL ] EFX: Derivative data saved (1807 records). [2025-09-18T22:50:46.705762] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-09-18T22:50:46.708892] [INFO ] [MAIN ] Derivative Progress: 570/2075 symbols completed. EFX took 1.2s. Estimated remaining: 9m 45s. Rate: 154.2 symbols/min [2025-09-18T22:50:46.709671] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:46.709743] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:46.709589] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:46.745690] [DEBUG] [LOCAL ] EGP: Loaded 31675 existing records from primary storage. [2025-09-18T22:50:46.745829] [INFO ] [MAIN ] EGP: Loaded 31675 primary data records. [2025-09-18T22:50:46.980759] [DEBUG] [LOCAL ] EGY: Loaded 42731 existing records from primary storage. [2025-09-18T22:50:46.980997] [INFO ] [MAIN ] EGY: Loaded 42731 primary data records. [2025-09-18T22:50:46.981707] [DEBUG] [LOCAL ] EGO: Loaded 51775 existing records from primary storage. [2025-09-18T22:50:47.089598] [INFO ] [MAIN ] EGO: Loaded 51775 primary data records. [2025-09-18T22:50:47.840089] [DEBUG] [MAIN ] EGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:47.841581] [INFO ] [MAIN ] EGP: Generated 1807 derivative records from 31675 primary records. [2025-09-18T22:50:47.842058] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-09-18T22:50:47.879141] [DEBUG] [LOCAL ] EGP: Derivative data saved (1807 records). [2025-09-18T22:50:47.879587] [DEBUG] [MAIN ] EGO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:47.879927] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-09-18T22:50:47.880607] [INFO ] [MAIN ] EGO: Generated 1807 derivative records from 51775 primary records. [2025-09-18T22:50:47.882536] [INFO ] [MAIN ] Derivative Progress: 571/2075 symbols completed. EGP took 1.2s. Estimated remaining: 9m 47s. Rate: 153.7 symbols/min [2025-09-18T22:50:47.883029] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:47.883083] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-09-18T22:50:47.914954] [DEBUG] [MAIN ] EGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:47.916321] [INFO ] [MAIN ] EGY: Generated 1807 derivative records from 42731 primary records. [2025-09-18T22:50:47.918454] [DEBUG] [LOCAL ] EGO: Derivative data saved (1807 records). [2025-09-18T22:50:47.926229] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-09-18T22:50:47.918249] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-09-18T22:50:47.928703] [INFO ] [MAIN ] Derivative Progress: 572/2075 symbols completed. EGO took 1.2s. Estimated remaining: 9m 46s. Rate: 153.9 symbols/min [2025-09-18T22:50:47.929128] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:47.954508] [DEBUG] [LOCAL ] EGY: Derivative data saved (1807 records). [2025-09-18T22:50:47.955880] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-09-18T22:50:47.959044] [INFO ] [MAIN ] Derivative Progress: 573/2075 symbols completed. EGY took 1.2s. Estimated remaining: 9m 44s. Rate: 154.2 symbols/min [2025-09-18T22:50:47.959362] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:47.960322] [DEBUG] [LOCAL ] EHAB: Loaded 30421 existing records from primary storage. [2025-09-18T22:50:47.960579] [INFO ] [MAIN ] EHAB: Loaded 30421 primary data records. [2025-09-18T22:50:48.154033] [DEBUG] [LOCAL ] EIC: Loaded 24772 existing records from primary storage. [2025-09-18T22:50:48.183948] [INFO ] [MAIN ] EIC: Loaded 24772 primary data records. [2025-09-18T22:50:48.351462] [DEBUG] [LOCAL ] EHC: Loaded 41881 existing records from primary storage. [2025-09-18T22:50:48.380512] [INFO ] [MAIN ] EHC: Loaded 41881 primary data records. [2025-09-18T22:50:48.978982] [DEBUG] [MAIN ] EHAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:48.981120] [INFO ] [MAIN ] EHAB: Generated 1807 derivative records from 30421 primary records. [2025-09-18T22:50:48.981469] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-09-18T22:50:49.001116] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1807 records). [2025-09-18T22:50:49.001230] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-09-18T22:50:49.003773] [INFO ] [MAIN ] Derivative Progress: 574/2075 symbols completed. EHAB took 1.1s. Estimated remaining: 9m 46s. Rate: 153.7 symbols/min [2025-09-18T22:50:49.004155] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:49.036437] [DEBUG] [MAIN ] EHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:49.037384] [INFO ] [MAIN ] EHC: Generated 1807 derivative records from 41881 primary records. [2025-09-18T22:50:49.037449] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-09-18T22:50:49.036180] [DEBUG] [MAIN ] EIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:49.046701] [INFO ] [MAIN ] EIC: Generated 1807 derivative records from 24772 primary records. [2025-09-18T22:50:49.050673] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-09-18T22:50:49.082861] [DEBUG] [LOCAL ] EIG: Loaded 20425 existing records from primary storage. [2025-09-18T22:50:49.083921] [DEBUG] [LOCAL ] EIC: Derivative data saved (1807 records). [2025-09-18T22:50:49.084628] [DEBUG] [LOCAL ] EHC: Derivative data saved (1807 records). [2025-09-18T22:50:49.084757] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-09-18T22:50:49.087375] [INFO ] [MAIN ] Derivative Progress: 575/2075 symbols completed. EIC took 1.1s. Estimated remaining: 9m 45s. Rate: 153.9 symbols/min [2025-09-18T22:50:49.087517] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-09-18T22:50:49.084881] [INFO ] [MAIN ] EIG: Loaded 20425 primary data records. [2025-09-18T22:50:49.087791] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:49.090563] [INFO ] [MAIN ] Derivative Progress: 576/2075 symbols completed. EHC took 1.2s. Estimated remaining: 9m 43s. Rate: 154.2 symbols/min [2025-09-18T22:50:49.096591] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:49.447322] [DEBUG] [LOCAL ] EIX: Loaded 53743 existing records from primary storage. [2025-09-18T22:50:49.447601] [INFO ] [MAIN ] EIX: Loaded 53743 primary data records. [2025-09-18T22:50:49.528086] [DEBUG] [LOCAL ] EL: Loaded 53826 existing records from primary storage. [2025-09-18T22:50:49.556360] [INFO ] [MAIN ] EL: Loaded 53826 primary data records. [2025-09-18T22:50:49.760095] [DEBUG] [MAIN ] EIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:49.787781] [INFO ] [MAIN ] EIG: Generated 1807 derivative records from 20425 primary records. [2025-09-18T22:50:49.792324] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-09-18T22:50:50.126696] [DEBUG] [LOCAL ] EIG: Derivative data saved (1807 records). [2025-09-18T22:50:50.172393] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-09-18T22:50:50.188991] [INFO ] [MAIN ] Derivative Progress: 577/2075 symbols completed. EIG took 1.2s. Estimated remaining: 9m 45s. Rate: 153.7 symbols/min [2025-09-18T22:50:50.189899] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:50.222063] [DEBUG] [MAIN ] EIX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:50.223853] [INFO ] [MAIN ] EIX: Generated 1807 derivative records from 53743 primary records. [2025-09-18T22:50:50.224089] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-09-18T22:50:50.237457] [DEBUG] [MAIN ] EL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:50.245713] [INFO ] [MAIN ] EL: Generated 1807 derivative records from 53826 primary records. [2025-09-18T22:50:50.246994] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-09-18T22:50:50.268058] [DEBUG] [LOCAL ] EIX: Derivative data saved (1807 records). [2025-09-18T22:50:50.268145] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-09-18T22:50:50.270393] [INFO ] [MAIN ] Derivative Progress: 578/2075 symbols completed. EIX took 1.2s. Estimated remaining: 9m 43s. Rate: 153.9 symbols/min [2025-09-18T22:50:50.271040] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:50.297464] [DEBUG] [LOCAL ] EL: Derivative data saved (1807 records). [2025-09-18T22:50:50.297358] [DEBUG] [LOCAL ] ELC: Loaded 3546 existing records from primary storage. [2025-09-18T22:50:50.312024] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-09-18T22:50:50.312257] [INFO ] [MAIN ] ELC: Loaded 3546 primary data records. [2025-09-18T22:50:50.334568] [DEBUG] [LOCAL ] ELAN: Loaded 53570 existing records from primary storage. [2025-09-18T22:50:50.347747] [INFO ] [MAIN ] ELAN: Loaded 53570 primary data records. [2025-09-18T22:50:50.337188] [INFO ] [MAIN ] Derivative Progress: 579/2075 symbols completed. EL took 1.2s. Estimated remaining: 9m 42s. Rate: 154.2 symbols/min [2025-09-18T22:50:50.366506] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:50.979076] [DEBUG] [LOCAL ] ELF: Loaded 52723 existing records from primary storage. [2025-09-18T22:50:50.979590] [INFO ] [MAIN ] ELF: Loaded 52723 primary data records. [2025-09-18T22:50:51.187895] [DEBUG] [MAIN ] ELC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:51.318234] [DEBUG] [MAIN ] ELAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:51.319779] [INFO ] [MAIN ] ELC: Generated 1807 derivative records from 3546 primary records. [2025-09-18T22:50:51.320925] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-09-18T22:50:51.320857] [INFO ] [MAIN ] ELAN: Generated 1807 derivative records from 53570 primary records. [2025-09-18T22:50:51.321916] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-09-18T22:50:51.352421] [DEBUG] [LOCAL ] ELC: Derivative data saved (1807 records). [2025-09-18T22:50:51.353975] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-09-18T22:50:51.357612] [INFO ] [MAIN ] Derivative Progress: 580/2075 symbols completed. ELC took 1.1s. Estimated remaining: 9m 44s. Rate: 153.7 symbols/min [2025-09-18T22:50:51.358123] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1807 records). [2025-09-18T22:50:51.358792] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:51.359079] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-09-18T22:50:51.362214] [INFO ] [MAIN ] Derivative Progress: 581/2075 symbols completed. ELAN took 1.2s. Estimated remaining: 9m 42s. Rate: 154.0 symbols/min [2025-09-18T22:50:51.363429] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:51.390304] [DEBUG] [MAIN ] ELF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:51.391193] [INFO ] [MAIN ] ELF: Generated 1807 derivative records from 52723 primary records. [2025-09-18T22:50:51.391325] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-09-18T22:50:51.415938] [DEBUG] [LOCAL ] ELP: Loaded 26172 existing records from primary storage. [2025-09-18T22:50:51.417773] [INFO ] [MAIN ] ELP: Loaded 26172 primary data records. [2025-09-18T22:50:51.418404] [DEBUG] [LOCAL ] ELF: Derivative data saved (1807 records). [2025-09-18T22:50:51.418689] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-09-18T22:50:51.432832] [INFO ] [MAIN ] Derivative Progress: 582/2075 symbols completed. ELF took 1.1s. Estimated remaining: 9m 41s. Rate: 154.2 symbols/min [2025-09-18T22:50:51.454919] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:51.570019] [DEBUG] [LOCAL ] ELS: Loaded 49743 existing records from primary storage. [2025-09-18T22:50:51.616793] [INFO ] [MAIN ] ELS: Loaded 49743 primary data records. [2025-09-18T22:50:52.159764] [DEBUG] [LOCAL ] ELV: Loaded 50849 existing records from primary storage. [2025-09-18T22:50:52.160860] [INFO ] [MAIN ] ELV: Loaded 50849 primary data records. [2025-09-18T22:50:52.502453] [DEBUG] [MAIN ] ELP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:52.503582] [INFO ] [MAIN ] ELP: Generated 1807 derivative records from 26172 primary records. [2025-09-18T22:50:52.503883] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-09-18T22:50:52.526012] [DEBUG] [LOCAL ] ELP: Derivative data saved (1807 records). [2025-09-18T22:50:52.527560] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-09-18T22:50:52.529868] [INFO ] [MAIN ] Derivative Progress: 583/2075 symbols completed. ELP took 1.2s. Estimated remaining: 9m 42s. Rate: 153.7 symbols/min [2025-09-18T22:50:52.543738] [DEBUG] [MAIN ] ELS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:52.544516] [INFO ] [MAIN ] ELS: Generated 1807 derivative records from 49743 primary records. [2025-09-18T22:50:52.544674] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-09-18T22:50:52.564766] [DEBUG] [LOCAL ] ELS: Derivative data saved (1807 records). [2025-09-18T22:50:52.577295] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-09-18T22:50:52.579720] [INFO ] [MAIN ] Derivative Progress: 584/2075 symbols completed. ELS took 1.2s. Estimated remaining: 9m 41s. Rate: 154.0 symbols/min [2025-09-18T22:50:52.577244] [DEBUG] [MAIN ] ELV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:52.580609] [INFO ] [MAIN ] ELV: Generated 1807 derivative records from 50849 primary records. [2025-09-18T22:50:52.580743] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-09-18T22:50:52.596171] [DEBUG] [LOCAL ] ELV: Derivative data saved (1807 records). [2025-09-18T22:50:52.596243] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-09-18T22:50:52.598671] [INFO ] [MAIN ] Derivative Progress: 585/2075 symbols completed. ELV took 1.2s. Estimated remaining: 9m 40s. Rate: 154.2 symbols/min [2025-09-18T22:50:52.599478] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:52.599569] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:52.599415] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:52.608091] [DEBUG] [LOCAL ] EMF: Loaded 3712 existing records from primary storage. [2025-09-18T22:50:52.608269] [INFO ] [MAIN ] EMF: Loaded 3712 primary data records. [2025-09-18T22:50:52.802967] [DEBUG] [LOCAL ] EMD: Loaded 21570 existing records from primary storage. [2025-09-18T22:50:52.803467] [DEBUG] [LOCAL ] EME: Loaded 32125 existing records from primary storage. [2025-09-18T22:50:52.825578] [INFO ] [MAIN ] EMD: Loaded 21570 primary data records. [2025-09-18T22:50:52.825677] [INFO ] [MAIN ] EME: Loaded 32125 primary data records. [2025-09-18T22:50:53.573473] [DEBUG] [MAIN ] EMF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:53.574353] [INFO ] [MAIN ] EMF: Generated 1807 derivative records from 3712 primary records. [2025-09-18T22:50:53.574490] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-09-18T22:50:53.591588] [DEBUG] [LOCAL ] EMF: Derivative data saved (1807 records). [2025-09-18T22:50:53.591914] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-09-18T22:50:53.593919] [INFO ] [MAIN ] Derivative Progress: 586/2075 symbols completed. EMF took 1.0s. Estimated remaining: 9m 41s. Rate: 153.8 symbols/min [2025-09-18T22:50:53.594282] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:53.632582] [DEBUG] [MAIN ] EME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:53.633201] [DEBUG] [MAIN ] EMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:53.634512] [INFO ] [MAIN ] EMD: Generated 1807 derivative records from 21570 primary records. [2025-09-18T22:50:53.635264] [INFO ] [MAIN ] EME: Generated 1807 derivative records from 32125 primary records. [2025-09-18T22:50:53.635370] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-09-18T22:50:53.636157] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-09-18T22:50:53.668185] [DEBUG] [LOCAL ] EME: Derivative data saved (1807 records). [2025-09-18T22:50:53.669170] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-09-18T22:50:53.671901] [INFO ] [MAIN ] Derivative Progress: 587/2075 symbols completed. EME took 1.1s. Estimated remaining: 9m 40s. Rate: 154.0 symbols/min [2025-09-18T22:50:53.672505] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:53.673428] [DEBUG] [LOCAL ] EMD: Derivative data saved (1807 records). [2025-09-18T22:50:53.674236] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-09-18T22:50:53.677720] [INFO ] [MAIN ] Derivative Progress: 588/2075 symbols completed. EMD took 1.1s. Estimated remaining: 9m 38s. Rate: 154.3 symbols/min [2025-09-18T22:50:53.678525] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:53.700091] [DEBUG] [LOCAL ] EMP: Loaded 3023 existing records from primary storage. [2025-09-18T22:50:53.700352] [INFO ] [MAIN ] EMP: Loaded 3023 primary data records. [2025-09-18T22:50:53.777852] [DEBUG] [LOCAL ] EMO: Loaded 12366 existing records from primary storage. [2025-09-18T22:50:53.801253] [INFO ] [MAIN ] EMO: Loaded 12366 primary data records. [2025-09-18T22:50:53.911134] [DEBUG] [LOCAL ] EMN: Loaded 50622 existing records from primary storage. [2025-09-18T22:50:53.926671] [INFO ] [MAIN ] EMN: Loaded 50622 primary data records. [2025-09-18T22:50:54.728367] [DEBUG] [MAIN ] EMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:54.733689] [DEBUG] [MAIN ] EMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:54.746288] [INFO ] [MAIN ] EMP: Generated 1807 derivative records from 3023 primary records. [2025-09-18T22:50:54.747187] [INFO ] [MAIN ] EMO: Generated 1807 derivative records from 12366 primary records. [2025-09-18T22:50:54.747491] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-09-18T22:50:54.747379] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-09-18T22:50:54.749036] [DEBUG] [MAIN ] EMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:54.750091] [INFO ] [MAIN ] EMN: Generated 1807 derivative records from 50622 primary records. [2025-09-18T22:50:54.757489] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-09-18T22:50:54.792079] [DEBUG] [LOCAL ] EMP: Derivative data saved (1807 records). [2025-09-18T22:50:54.792706] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-09-18T22:50:54.793509] [DEBUG] [LOCAL ] EMO: Derivative data saved (1807 records). [2025-09-18T22:50:54.796124] [INFO ] [MAIN ] Derivative Progress: 589/2075 symbols completed. EMP took 1.1s. Estimated remaining: 9m 40s. Rate: 153.8 symbols/min [2025-09-18T22:50:54.797966] [DEBUG] [LOCAL ] EMN: Derivative data saved (1807 records). [2025-09-18T22:50:54.798079] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:54.796614] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-09-18T22:50:54.801322] [INFO ] [MAIN ] Derivative Progress: 590/2075 symbols completed. EMO took 1.1s. Estimated remaining: 9m 38s. Rate: 154.0 symbols/min [2025-09-18T22:50:54.798281] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-09-18T22:50:54.801840] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:54.804598] [INFO ] [MAIN ] Derivative Progress: 591/2075 symbols completed. EMN took 1.2s. Estimated remaining: 9m 37s. Rate: 154.3 symbols/min [2025-09-18T22:50:54.805013] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:54.810606] [DEBUG] [LOCAL ] ENFY: Loaded 3075 existing records from primary storage. [2025-09-18T22:50:54.810762] [INFO ] [MAIN ] ENFY: Loaded 3075 primary data records. [2025-09-18T22:50:55.181405] [DEBUG] [LOCAL ] EMR: Loaded 53650 existing records from primary storage. [2025-09-18T22:50:55.183066] [INFO ] [MAIN ] EMR: Loaded 53650 primary data records. [2025-09-18T22:50:55.184012] [DEBUG] [LOCAL ] ENB: Loaded 53914 existing records from primary storage. [2025-09-18T22:50:55.189462] [INFO ] [MAIN ] ENB: Loaded 53914 primary data records. [2025-09-18T22:50:55.461346] [DEBUG] [MAIN ] ENFY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:55.486035] [INFO ] [MAIN ] ENFY: Generated 1807 derivative records from 3075 primary records. [2025-09-18T22:50:55.525149] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-09-18T22:50:55.876377] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1807 records). [2025-09-18T22:50:55.877350] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-09-18T22:50:55.880090] [INFO ] [MAIN ] Derivative Progress: 592/2075 symbols completed. ENFY took 1.1s. Estimated remaining: 9m 38s. Rate: 153.8 symbols/min [2025-09-18T22:50:55.881117] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:55.913713] [DEBUG] [MAIN ] ENB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:55.914600] [INFO ] [MAIN ] ENB: Generated 1807 derivative records from 53914 primary records. [2025-09-18T22:50:55.922386] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-09-18T22:50:55.928699] [DEBUG] [MAIN ] EMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:55.929439] [INFO ] [MAIN ] EMR: Generated 1807 derivative records from 53650 primary records. [2025-09-18T22:50:55.938190] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-09-18T22:50:55.980785] [DEBUG] [LOCAL ] ENIC: Loaded 37105 existing records from primary storage. [2025-09-18T22:50:55.979969] [DEBUG] [LOCAL ] EMR: Derivative data saved (1807 records). [2025-09-18T22:50:55.981291] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-09-18T22:50:55.983412] [INFO ] [MAIN ] Derivative Progress: 593/2075 symbols completed. EMR took 1.2s. Estimated remaining: 9m 37s. Rate: 154.0 symbols/min [2025-09-18T22:50:55.983757] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:55.981219] [INFO ] [MAIN ] ENIC: Loaded 37105 primary data records. [2025-09-18T22:50:55.984488] [DEBUG] [LOCAL ] ENB: Derivative data saved (1807 records). [2025-09-18T22:50:55.984917] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-09-18T22:50:56.009060] [INFO ] [MAIN ] Derivative Progress: 594/2075 symbols completed. ENB took 1.2s. Estimated remaining: 9m 36s. Rate: 154.3 symbols/min [2025-09-18T22:50:56.032957] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:56.075988] [DEBUG] [LOCAL ] ENO: Loaded 2006 existing records from primary storage. [2025-09-18T22:50:56.087527] [INFO ] [MAIN ] ENO: Loaded 2006 primary data records. [2025-09-18T22:50:56.612334] [DEBUG] [LOCAL ] ENOV: Loaded 45663 existing records from primary storage. [2025-09-18T22:50:56.626116] [INFO ] [MAIN ] ENOV: Loaded 45663 primary data records. [2025-09-18T22:50:56.957458] [DEBUG] [MAIN ] ENIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:56.958844] [INFO ] [MAIN ] ENIC: Generated 1807 derivative records from 37105 primary records. [2025-09-18T22:50:56.959039] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-09-18T22:50:56.991346] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1807 records). [2025-09-18T22:50:56.992136] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-09-18T22:50:56.994731] [INFO ] [MAIN ] Derivative Progress: 595/2075 symbols completed. ENIC took 1.1s. Estimated remaining: 9m 37s. Rate: 153.9 symbols/min [2025-09-18T22:50:56.991854] [DEBUG] [MAIN ] ENO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:56.995008] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:56.995991] [INFO ] [MAIN ] ENO: Generated 1807 derivative records from 2006 primary records. [2025-09-18T22:50:56.996098] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-09-18T22:50:57.012408] [DEBUG] [LOCAL ] ENO: Derivative data saved (1807 records). [2025-09-18T22:50:57.012529] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-09-18T22:50:57.014717] [INFO ] [MAIN ] Derivative Progress: 596/2075 symbols completed. ENO took 1.0s. Estimated remaining: 9m 36s. Rate: 154.1 symbols/min [2025-09-18T22:50:57.015403] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:57.034420] [DEBUG] [MAIN ] ENOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:57.035262] [INFO ] [MAIN ] ENOV: Generated 1807 derivative records from 45663 primary records. [2025-09-18T22:50:57.035377] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-09-18T22:50:57.079677] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1807 records). [2025-09-18T22:50:57.093309] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-09-18T22:50:57.095582] [INFO ] [MAIN ] Derivative Progress: 597/2075 symbols completed. ENOV took 1.1s. Estimated remaining: 9m 35s. Rate: 154.3 symbols/min [2025-09-18T22:50:57.096101] [DEBUG] [LOCAL ] ENS: Loaded 29560 existing records from primary storage. [2025-09-18T22:50:57.096360] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:57.096506] [INFO ] [MAIN ] ENS: Loaded 29560 primary data records. [2025-09-18T22:50:57.097745] [DEBUG] [LOCAL ] ENR: Loaded 42861 existing records from primary storage. [2025-09-18T22:50:57.119302] [INFO ] [MAIN ] ENR: Loaded 42861 primary data records. [2025-09-18T22:50:57.442607] [DEBUG] [LOCAL ] ENVA: Loaded 25959 existing records from primary storage. [2025-09-18T22:50:57.571606] [INFO ] [MAIN ] ENVA: Loaded 25959 primary data records. [2025-09-18T22:50:58.115384] [DEBUG] [MAIN ] ENR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:58.117135] [INFO ] [MAIN ] ENR: Generated 1807 derivative records from 42861 primary records. [2025-09-18T22:50:58.131580] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-09-18T22:50:58.133010] [DEBUG] [MAIN ] ENS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:58.133679] [INFO ] [MAIN ] ENS: Generated 1807 derivative records from 29560 primary records. [2025-09-18T22:50:58.133798] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-09-18T22:50:58.163133] [DEBUG] [LOCAL ] ENS: Derivative data saved (1807 records). [2025-09-18T22:50:58.163251] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-09-18T22:50:58.165638] [INFO ] [MAIN ] Derivative Progress: 598/2075 symbols completed. ENS took 1.2s. Estimated remaining: 9m 36s. Rate: 153.9 symbols/min [2025-09-18T22:50:58.169634] [DEBUG] [LOCAL ] ENR: Derivative data saved (1807 records). [2025-09-18T22:50:58.169814] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-09-18T22:50:58.171976] [INFO ] [MAIN ] Derivative Progress: 599/2075 symbols completed. ENR took 1.2s. Estimated remaining: 9m 35s. Rate: 154.1 symbols/min [2025-09-18T22:50:58.186777] [DEBUG] [MAIN ] ENVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:58.187298] [INFO ] [MAIN ] ENVA: Generated 1807 derivative records from 25959 primary records. [2025-09-18T22:50:58.187357] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-09-18T22:50:58.202716] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1807 records). [2025-09-18T22:50:58.202776] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-09-18T22:50:58.205552] [INFO ] [MAIN ] Derivative Progress: 600/2075 symbols completed. ENVA took 1.1s. Estimated remaining: 9m 33s. Rate: 154.4 symbols/min [2025-09-18T22:50:58.206296] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:58.206356] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:58.206143] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:58.225472] [DEBUG] [LOCAL ] EOD: Loaded 14253 existing records from primary storage. [2025-09-18T22:50:58.225636] [INFO ] [MAIN ] EOD: Loaded 14253 primary data records. [2025-09-18T22:50:58.273916] [DEBUG] [LOCAL ] EOI: Loaded 10796 existing records from primary storage. [2025-09-18T22:50:58.311775] [INFO ] [MAIN ] EOI: Loaded 10796 primary data records. [2025-09-18T22:50:58.868624] [DEBUG] [LOCAL ] EOG: Loaded 53731 existing records from primary storage. [2025-09-18T22:50:58.878244] [INFO ] [MAIN ] EOG: Loaded 53731 primary data records. [2025-09-18T22:50:59.219062] [DEBUG] [MAIN ] EOD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:59.220408] [INFO ] [MAIN ] EOD: Generated 1807 derivative records from 14253 primary records. [2025-09-18T22:50:59.220838] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-09-18T22:50:59.252944] [DEBUG] [MAIN ] EOI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:59.255516] [INFO ] [MAIN ] EOI: Generated 1807 derivative records from 10796 primary records. [2025-09-18T22:50:59.256543] [DEBUG] [LOCAL ] EOD: Derivative data saved (1807 records). [2025-09-18T22:50:59.256889] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-09-18T22:50:59.258926] [INFO ] [MAIN ] Derivative Progress: 601/2075 symbols completed. EOD took 1.1s. Estimated remaining: 9m 35s. Rate: 153.9 symbols/min [2025-09-18T22:50:59.256776] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-09-18T22:50:59.260361] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:59.279615] [DEBUG] [LOCAL ] EOI: Derivative data saved (1807 records). [2025-09-18T22:50:59.285278] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-09-18T22:50:59.287801] [INFO ] [MAIN ] Derivative Progress: 602/2075 symbols completed. EOI took 1.1s. Estimated remaining: 9m 33s. Rate: 154.2 symbols/min [2025-09-18T22:50:59.301050] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:50:59.301551] [DEBUG] [MAIN ] EOG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:50:59.307729] [DEBUG] [LOCAL ] EOS: Loaded 15700 existing records from primary storage. [2025-09-18T22:50:59.308534] [INFO ] [MAIN ] EOG: Generated 1807 derivative records from 53731 primary records. [2025-09-18T22:50:59.308835] [INFO ] [MAIN ] EOS: Loaded 15700 primary data records. [2025-09-18T22:50:59.308768] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-09-18T22:50:59.431396] [DEBUG] [LOCAL ] EOT: Loaded 6898 existing records from primary storage. [2025-09-18T22:50:59.450376] [INFO ] [MAIN ] EOT: Loaded 6898 primary data records. [2025-09-18T22:50:59.456076] [DEBUG] [LOCAL ] EOG: Derivative data saved (1807 records). [2025-09-18T22:50:59.467837] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-09-18T22:50:59.495880] [INFO ] [MAIN ] Derivative Progress: 603/2075 symbols completed. EOG took 1.3s. Estimated remaining: 9m 32s. Rate: 154.3 symbols/min [2025-09-18T22:50:59.600026] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:00.018939] [DEBUG] [LOCAL ] EPAC: Loaded 27231 existing records from primary storage. [2025-09-18T22:51:00.019622] [INFO ] [MAIN ] EPAC: Loaded 27231 primary data records. [2025-09-18T22:51:00.144109] [DEBUG] [MAIN ] EOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:00.150913] [INFO ] [MAIN ] EOS: Generated 1807 derivative records from 15700 primary records. [2025-09-18T22:51:00.168424] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-09-18T22:51:00.281973] [DEBUG] [MAIN ] EOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:00.383460] [INFO ] [MAIN ] EOT: Generated 1807 derivative records from 6898 primary records. [2025-09-18T22:51:00.384469] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-09-18T22:51:00.384606] [DEBUG] [LOCAL ] EOS: Derivative data saved (1807 records). [2025-09-18T22:51:00.385179] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-09-18T22:51:00.387467] [INFO ] [MAIN ] Derivative Progress: 604/2075 symbols completed. EOS took 1.1s. Estimated remaining: 9m 33s. Rate: 153.9 symbols/min [2025-09-18T22:51:00.387885] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:00.404756] [DEBUG] [LOCAL ] EOT: Derivative data saved (1807 records). [2025-09-18T22:51:00.405461] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-09-18T22:51:00.408160] [INFO ] [MAIN ] Derivative Progress: 605/2075 symbols completed. EOT took 1.1s. Estimated remaining: 9m 32s. Rate: 154.2 symbols/min [2025-09-18T22:51:00.408750] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:00.432885] [DEBUG] [MAIN ] EPAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:00.442896] [INFO ] [MAIN ] EPAC: Generated 1807 derivative records from 27231 primary records. [2025-09-18T22:51:00.443043] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-09-18T22:51:00.480351] [DEBUG] [LOCAL ] EPAM: Loaded 40056 existing records from primary storage. [2025-09-18T22:51:00.479171] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1807 records). [2025-09-18T22:51:00.480562] [INFO ] [MAIN ] EPAM: Loaded 40056 primary data records. [2025-09-18T22:51:00.480784] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-09-18T22:51:00.483639] [INFO ] [MAIN ] Derivative Progress: 606/2075 symbols completed. EPAC took 0.9s. Estimated remaining: 9m 31s. Rate: 154.4 symbols/min [2025-09-18T22:51:00.506234] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:00.567407] [DEBUG] [LOCAL ] EPC: Loaded 40244 existing records from primary storage. [2025-09-18T22:51:00.578952] [INFO ] [MAIN ] EPC: Loaded 40244 primary data records. [2025-09-18T22:51:01.142599] [DEBUG] [LOCAL ] EPD: Loaded 54006 existing records from primary storage. [2025-09-18T22:51:01.142936] [INFO ] [MAIN ] EPD: Loaded 54006 primary data records. [2025-09-18T22:51:01.461753] [DEBUG] [MAIN ] EPAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:01.463084] [INFO ] [MAIN ] EPAM: Generated 1807 derivative records from 40056 primary records. [2025-09-18T22:51:01.463417] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-09-18T22:51:01.484161] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1807 records). [2025-09-18T22:51:01.484574] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-09-18T22:51:01.499058] [INFO ] [MAIN ] Derivative Progress: 607/2075 symbols completed. EPAM took 1.1s. Estimated remaining: 9m 32s. Rate: 154.0 symbols/min [2025-09-18T22:51:01.499591] [DEBUG] [MAIN ] EPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:01.499876] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:01.500580] [INFO ] [MAIN ] EPC: Generated 1807 derivative records from 40244 primary records. [2025-09-18T22:51:01.502058] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-09-18T22:51:01.519630] [DEBUG] [LOCAL ] EPC: Derivative data saved (1807 records). [2025-09-18T22:51:01.519993] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-09-18T22:51:01.522574] [INFO ] [MAIN ] Derivative Progress: 608/2075 symbols completed. EPC took 1.1s. Estimated remaining: 9m 31s. Rate: 154.2 symbols/min [2025-09-18T22:51:01.523366] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:01.540877] [DEBUG] [MAIN ] EPD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:01.541821] [INFO ] [MAIN ] EPD: Generated 1807 derivative records from 54006 primary records. [2025-09-18T22:51:01.541945] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-09-18T22:51:01.582287] [DEBUG] [LOCAL ] EPD: Derivative data saved (1807 records). [2025-09-18T22:51:01.582464] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-09-18T22:51:01.583145] [DEBUG] [LOCAL ] EPR: Loaded 44723 existing records from primary storage. [2025-09-18T22:51:01.583296] [INFO ] [MAIN ] EPR: Loaded 44723 primary data records. [2025-09-18T22:51:01.586166] [INFO ] [MAIN ] Derivative Progress: 609/2075 symbols completed. EPD took 1.1s. Estimated remaining: 9m 30s. Rate: 154.4 symbols/min [2025-09-18T22:51:01.608064] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:01.763761] [DEBUG] [LOCAL ] EQBK: Loaded 10975 existing records from primary storage. [2025-09-18T22:51:01.854345] [DEBUG] [LOCAL ] EPRT: Loaded 49084 existing records from primary storage. [2025-09-18T22:51:01.796779] [INFO ] [MAIN ] EQBK: Loaded 10975 primary data records. [2025-09-18T22:51:01.948156] [INFO ] [MAIN ] EPRT: Loaded 49084 primary data records. [2025-09-18T22:51:02.641756] [DEBUG] [MAIN ] EPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:02.643159] [INFO ] [MAIN ] EPR: Generated 1807 derivative records from 44723 primary records. [2025-09-18T22:51:02.643326] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-09-18T22:51:02.663213] [DEBUG] [LOCAL ] EPR: Derivative data saved (1807 records). [2025-09-18T22:51:02.665180] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-09-18T22:51:02.668412] [INFO ] [MAIN ] Derivative Progress: 610/2075 symbols completed. EPR took 1.2s. Estimated remaining: 9m 31s. Rate: 154.0 symbols/min [2025-09-18T22:51:02.668828] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:02.682973] [DEBUG] [MAIN ] EQBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:02.683865] [INFO ] [MAIN ] EQBK: Generated 1807 derivative records from 10975 primary records. [2025-09-18T22:51:02.684029] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-09-18T22:51:02.700463] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1807 records). [2025-09-18T22:51:02.701494] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-09-18T22:51:02.704093] [INFO ] [MAIN ] Derivative Progress: 611/2075 symbols completed. EQBK took 1.1s. Estimated remaining: 9m 30s. Rate: 154.2 symbols/min [2025-09-18T22:51:02.706355] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:02.720623] [DEBUG] [MAIN ] EPRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:02.721413] [INFO ] [MAIN ] EPRT: Generated 1807 derivative records from 49084 primary records. [2025-09-18T22:51:02.721538] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-09-18T22:51:02.751954] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1807 records). [2025-09-18T22:51:02.752243] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-09-18T22:51:02.755221] [INFO ] [MAIN ] Derivative Progress: 612/2075 symbols completed. EPRT took 1.2s. Estimated remaining: 9m 28s. Rate: 154.4 symbols/min [2025-09-18T22:51:02.755798] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:02.774447] [DEBUG] [LOCAL ] EQH: Loaded 53057 existing records from primary storage. [2025-09-18T22:51:02.787805] [INFO ] [MAIN ] EQH: Loaded 53057 primary data records. [2025-09-18T22:51:02.927135] [DEBUG] [LOCAL ] EQNR: Loaded 53434 existing records from primary storage. [2025-09-18T22:51:02.950713] [INFO ] [MAIN ] EQNR: Loaded 53434 primary data records. [2025-09-18T22:51:03.424282] [DEBUG] [LOCAL ] EQR: Loaded 51751 existing records from primary storage. [2025-09-18T22:51:03.439853] [INFO ] [MAIN ] EQR: Loaded 51751 primary data records. [2025-09-18T22:51:03.837682] [DEBUG] [MAIN ] EQH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:03.838245] [DEBUG] [MAIN ] EQNR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:03.839056] [INFO ] [MAIN ] EQH: Generated 1807 derivative records from 53057 primary records. [2025-09-18T22:51:03.839178] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-09-18T22:51:03.839853] [INFO ] [MAIN ] EQNR: Generated 1807 derivative records from 53434 primary records. [2025-09-18T22:51:03.840264] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-09-18T22:51:03.871905] [DEBUG] [LOCAL ] EQH: Derivative data saved (1807 records). [2025-09-18T22:51:03.879133] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-09-18T22:51:03.882533] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1807 records). [2025-09-18T22:51:03.882859] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-09-18T22:51:03.881888] [INFO ] [MAIN ] Derivative Progress: 613/2075 symbols completed. EQH took 1.2s. Estimated remaining: 9m 30s. Rate: 154.0 symbols/min [2025-09-18T22:51:03.886953] [INFO ] [MAIN ] Derivative Progress: 614/2075 symbols completed. EQNR took 1.2s. Estimated remaining: 9m 28s. Rate: 154.2 symbols/min [2025-09-18T22:51:03.904528] [DEBUG] [MAIN ] EQR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:03.905267] [INFO ] [MAIN ] EQR: Generated 1807 derivative records from 51751 primary records. [2025-09-18T22:51:03.905328] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-09-18T22:51:03.920822] [DEBUG] [LOCAL ] EQR: Derivative data saved (1807 records). [2025-09-18T22:51:03.920885] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-09-18T22:51:03.923403] [INFO ] [MAIN ] Derivative Progress: 615/2075 symbols completed. EQR took 1.2s. Estimated remaining: 9m 27s. Rate: 154.4 symbols/min [2025-09-18T22:51:03.924085] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:03.923985] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:03.924235] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:03.930242] [DEBUG] [LOCAL ] EQV: Loaded 2930 existing records from primary storage. [2025-09-18T22:51:03.930435] [INFO ] [MAIN ] EQV: Loaded 2930 primary data records. [2025-09-18T22:51:04.297756] [DEBUG] [LOCAL ] EQT: Loaded 54072 existing records from primary storage. [2025-09-18T22:51:04.298243] [INFO ] [MAIN ] EQT: Loaded 54072 primary data records. [2025-09-18T22:51:04.298985] [DEBUG] [LOCAL ] ERJ: Loaded 51280 existing records from primary storage. [2025-09-18T22:51:04.299355] [INFO ] [MAIN ] ERJ: Loaded 51280 primary data records. [2025-09-18T22:51:04.929822] [DEBUG] [MAIN ] EQV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:04.942699] [INFO ] [MAIN ] EQV: Generated 1807 derivative records from 2930 primary records. [2025-09-18T22:51:04.942985] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-09-18T22:51:04.962842] [DEBUG] [LOCAL ] EQV: Derivative data saved (1807 records). [2025-09-18T22:51:04.963496] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-09-18T22:51:04.966074] [INFO ] [MAIN ] Derivative Progress: 616/2075 symbols completed. EQV took 1.0s. Estimated remaining: 9m 28s. Rate: 154.0 symbols/min [2025-09-18T22:51:04.966934] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:04.995011] [DEBUG] [MAIN ] ERJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:04.996072] [INFO ] [MAIN ] ERJ: Generated 1807 derivative records from 51280 primary records. [2025-09-18T22:51:05.009237] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-09-18T22:51:05.010134] [DEBUG] [MAIN ] EQT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:05.011313] [INFO ] [MAIN ] EQT: Generated 1807 derivative records from 54072 primary records. [2025-09-18T22:51:05.011615] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-09-18T22:51:05.050357] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1807 records). [2025-09-18T22:51:05.051085] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-09-18T22:51:05.053471] [INFO ] [MAIN ] Derivative Progress: 617/2075 symbols completed. ERJ took 1.1s. Estimated remaining: 9m 27s. Rate: 154.2 symbols/min [2025-09-18T22:51:05.054363] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:05.057504] [DEBUG] [LOCAL ] EQT: Derivative data saved (1807 records). [2025-09-18T22:51:05.069404] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-09-18T22:51:05.072132] [INFO ] [MAIN ] Derivative Progress: 618/2075 symbols completed. EQT took 1.1s. Estimated remaining: 9m 26s. Rate: 154.4 symbols/min [2025-09-18T22:51:05.073363] [DEBUG] [LOCAL ] ERO: Loaded 41425 existing records from primary storage. [2025-09-18T22:51:05.073548] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:05.073493] [INFO ] [MAIN ] ERO: Loaded 41425 primary data records. [2025-09-18T22:51:05.421815] [DEBUG] [LOCAL ] ESAB: Loaded 25833 existing records from primary storage. [2025-09-18T22:51:05.422546] [INFO ] [MAIN ] ESAB: Loaded 25833 primary data records. [2025-09-18T22:51:05.531898] [DEBUG] [LOCAL ] ES: Loaded 52905 existing records from primary storage. [2025-09-18T22:51:05.546836] [INFO ] [MAIN ] ES: Loaded 52905 primary data records. [2025-09-18T22:51:06.156284] [DEBUG] [MAIN ] ERO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:06.157625] [INFO ] [MAIN ] ERO: Generated 1807 derivative records from 41425 primary records. [2025-09-18T22:51:06.157743] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-09-18T22:51:06.177781] [DEBUG] [LOCAL ] ERO: Derivative data saved (1807 records). [2025-09-18T22:51:06.178277] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-09-18T22:51:06.180959] [INFO ] [MAIN ] Derivative Progress: 619/2075 symbols completed. ERO took 1.2s. Estimated remaining: 9m 27s. Rate: 154.0 symbols/min [2025-09-18T22:51:06.181843] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:06.200731] [DEBUG] [MAIN ] ESAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:06.201855] [INFO ] [MAIN ] ESAB: Generated 1807 derivative records from 25833 primary records. [2025-09-18T22:51:06.201953] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-09-18T22:51:06.231052] [DEBUG] [LOCAL ] ESE: Loaded 16775 existing records from primary storage. [2025-09-18T22:51:06.232245] [INFO ] [MAIN ] ESE: Loaded 16775 primary data records. [2025-09-18T22:51:06.278719] [DEBUG] [MAIN ] ES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:06.292227] [INFO ] [MAIN ] ES: Generated 1807 derivative records from 52905 primary records. [2025-09-18T22:51:06.305209] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-09-18T22:51:06.292874] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1807 records). [2025-09-18T22:51:06.337043] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-09-18T22:51:06.367465] [INFO ] [MAIN ] Derivative Progress: 620/2075 symbols completed. ESAB took 1.3s. Estimated remaining: 9m 26s. Rate: 154.1 symbols/min [2025-09-18T22:51:06.369014] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:06.568765] [DEBUG] [LOCAL ] ES: Derivative data saved (1807 records). [2025-09-18T22:51:06.569547] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-09-18T22:51:06.573179] [INFO ] [MAIN ] Derivative Progress: 621/2075 symbols completed. ES took 1.5s. Estimated remaining: 9m 26s. Rate: 154.2 symbols/min [2025-09-18T22:51:06.573557] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:06.627872] [DEBUG] [MAIN ] ESE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:06.629014] [INFO ] [MAIN ] ESE: Generated 1807 derivative records from 16775 primary records. [2025-09-18T22:51:06.642959] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-09-18T22:51:06.644671] [DEBUG] [LOCAL ] ESI: Loaded 51232 existing records from primary storage. [2025-09-18T22:51:06.645117] [INFO ] [MAIN ] ESI: Loaded 51232 primary data records. [2025-09-18T22:51:06.750916] [DEBUG] [LOCAL ] ESE: Derivative data saved (1807 records). [2025-09-18T22:51:06.756615] [DEBUG] [LOCAL ] ESNT: Loaded 39104 existing records from primary storage. [2025-09-18T22:51:06.775884] [INFO ] [MAIN ] ESNT: Loaded 39104 primary data records. [2025-09-18T22:51:06.780341] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-09-18T22:51:06.783225] [INFO ] [MAIN ] Derivative Progress: 622/2075 symbols completed. ESE took 0.6s. Estimated remaining: 9m 25s. Rate: 154.3 symbols/min [2025-09-18T22:51:06.794618] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:07.326079] [DEBUG] [LOCAL ] ESRT: Loaded 46741 existing records from primary storage. [2025-09-18T22:51:07.326661] [INFO ] [MAIN ] ESRT: Loaded 46741 primary data records. [2025-09-18T22:51:07.524060] [DEBUG] [MAIN ] ESI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:07.649989] [INFO ] [MAIN ] ESI: Generated 1807 derivative records from 51232 primary records. [2025-09-18T22:51:07.662731] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-09-18T22:51:07.663812] [DEBUG] [MAIN ] ESNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:07.665238] [INFO ] [MAIN ] ESNT: Generated 1807 derivative records from 39104 primary records. [2025-09-18T22:51:07.665843] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-09-18T22:51:07.701693] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1807 records). [2025-09-18T22:51:07.702322] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-09-18T22:51:07.704987] [INFO ] [MAIN ] Derivative Progress: 623/2075 symbols completed. ESNT took 1.1s. Estimated remaining: 9m 26s. Rate: 154.0 symbols/min [2025-09-18T22:51:07.705549] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:07.706754] [DEBUG] [LOCAL ] ESI: Derivative data saved (1807 records). [2025-09-18T22:51:07.707057] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-09-18T22:51:07.709499] [INFO ] [MAIN ] Derivative Progress: 624/2075 symbols completed. ESI took 1.3s. Estimated remaining: 9m 24s. Rate: 154.2 symbols/min [2025-09-18T22:51:07.710480] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:07.735775] [DEBUG] [MAIN ] ESRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:07.736886] [INFO ] [MAIN ] ESRT: Generated 1807 derivative records from 46741 primary records. [2025-09-18T22:51:07.737057] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-09-18T22:51:07.763383] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1807 records). [2025-09-18T22:51:07.763735] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-09-18T22:51:07.766872] [INFO ] [MAIN ] Derivative Progress: 625/2075 symbols completed. ESRT took 1.0s. Estimated remaining: 9m 23s. Rate: 154.5 symbols/min [2025-09-18T22:51:07.767966] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:07.778593] [DEBUG] [LOCAL ] ESS: Loaded 30329 existing records from primary storage. [2025-09-18T22:51:07.778788] [INFO ] [MAIN ] ESS: Loaded 30329 primary data records. [2025-09-18T22:51:08.004603] [DEBUG] [LOCAL ] ESTC: Loaded 50598 existing records from primary storage. [2025-09-18T22:51:08.016857] [INFO ] [MAIN ] ESTC: Loaded 50598 primary data records. [2025-09-18T22:51:08.354268] [DEBUG] [LOCAL ] ET: Loaded 54179 existing records from primary storage. [2025-09-18T22:51:08.370016] [INFO ] [MAIN ] ET: Loaded 54179 primary data records. [2025-09-18T22:51:08.877994] [DEBUG] [MAIN ] ESS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:08.879229] [INFO ] [MAIN ] ESS: Generated 1807 derivative records from 30329 primary records. [2025-09-18T22:51:08.879797] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-09-18T22:51:08.904969] [DEBUG] [LOCAL ] ESS: Derivative data saved (1807 records). [2025-09-18T22:51:08.907135] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-09-18T22:51:08.909534] [INFO ] [MAIN ] Derivative Progress: 626/2075 symbols completed. ESS took 1.2s. Estimated remaining: 9m 25s. Rate: 154.0 symbols/min [2025-09-18T22:51:08.910449] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:08.924284] [DEBUG] [MAIN ] ESTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:08.925265] [INFO ] [MAIN ] ESTC: Generated 1807 derivative records from 50598 primary records. [2025-09-18T22:51:08.925558] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-09-18T22:51:08.959836] [DEBUG] [MAIN ] ET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:08.961413] [INFO ] [MAIN ] ET: Generated 1807 derivative records from 54179 primary records. [2025-09-18T22:51:08.961764] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-09-18T22:51:08.963861] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1807 records). [2025-09-18T22:51:08.971813] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-09-18T22:51:08.974163] [INFO ] [MAIN ] Derivative Progress: 627/2075 symbols completed. ESTC took 1.3s. Estimated remaining: 9m 23s. Rate: 154.2 symbols/min [2025-09-18T22:51:08.985431] [DEBUG] [LOCAL ] ETB: Loaded 12286 existing records from primary storage. [2025-09-18T22:51:08.986708] [INFO ] [MAIN ] ETB: Loaded 12286 primary data records. [2025-09-18T22:51:08.986955] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:09.075745] [DEBUG] [LOCAL ] ET: Derivative data saved (1807 records). [2025-09-18T22:51:09.126485] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-09-18T22:51:09.141125] [INFO ] [MAIN ] Derivative Progress: 628/2075 symbols completed. ET took 1.4s. Estimated remaining: 9m 23s. Rate: 154.3 symbols/min [2025-09-18T22:51:09.331922] [DEBUG] [LOCAL ] ETD: Loaded 27603 existing records from primary storage. [2025-09-18T22:51:09.341215] [INFO ] [MAIN ] ETD: Loaded 27603 primary data records. [2025-09-18T22:51:09.695459] [DEBUG] [MAIN ] ETB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:09.696614] [INFO ] [MAIN ] ETB: Generated 1807 derivative records from 12286 primary records. [2025-09-18T22:51:09.696827] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-09-18T22:51:09.714726] [DEBUG] [LOCAL ] ETB: Derivative data saved (1807 records). [2025-09-18T22:51:09.715020] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-09-18T22:51:09.717116] [INFO ] [MAIN ] Derivative Progress: 629/2075 symbols completed. ETB took 0.8s. Estimated remaining: 9m 23s. Rate: 154.2 symbols/min [2025-09-18T22:51:09.733968] [DEBUG] [MAIN ] ETD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:09.734628] [INFO ] [MAIN ] ETD: Generated 1807 derivative records from 27603 primary records. [2025-09-18T22:51:09.734717] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-09-18T22:51:09.750990] [DEBUG] [LOCAL ] ETD: Derivative data saved (1807 records). [2025-09-18T22:51:09.751126] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-09-18T22:51:09.753785] [INFO ] [MAIN ] Derivative Progress: 630/2075 symbols completed. ETD took 0.8s. Estimated remaining: 9m 21s. Rate: 154.4 symbols/min [2025-09-18T22:51:09.754396] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:09.754483] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:09.755351] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:09.778163] [DEBUG] [LOCAL ] ETJ: Loaded 17115 existing records from primary storage. [2025-09-18T22:51:09.778397] [INFO ] [MAIN ] ETJ: Loaded 17115 primary data records. [2025-09-18T22:51:09.848366] [DEBUG] [LOCAL ] ETG: Loaded 17132 existing records from primary storage. [2025-09-18T22:51:09.888335] [INFO ] [MAIN ] ETG: Loaded 17132 primary data records. [2025-09-18T22:51:10.365996] [DEBUG] [LOCAL ] ETN: Loaded 53258 existing records from primary storage. [2025-09-18T22:51:10.366559] [INFO ] [MAIN ] ETN: Loaded 53258 primary data records. [2025-09-18T22:51:10.832902] [DEBUG] [MAIN ] ETJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:10.834834] [INFO ] [MAIN ] ETJ: Generated 1807 derivative records from 17115 primary records. [2025-09-18T22:51:10.834933] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-09-18T22:51:10.887544] [DEBUG] [MAIN ] ETG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:10.889506] [INFO ] [MAIN ] ETG: Generated 1807 derivative records from 17132 primary records. [2025-09-18T22:51:10.890933] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-09-18T22:51:10.893240] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1807 records). [2025-09-18T22:51:10.893598] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-09-18T22:51:10.903945] [INFO ] [MAIN ] Derivative Progress: 631/2075 symbols completed. ETJ took 1.1s. Estimated remaining: 9m 23s. Rate: 154.0 symbols/min [2025-09-18T22:51:10.911221] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:10.913066] [DEBUG] [LOCAL ] ETG: Derivative data saved (1807 records). [2025-09-18T22:51:10.913685] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-09-18T22:51:10.916857] [INFO ] [MAIN ] Derivative Progress: 632/2075 symbols completed. ETG took 1.2s. Estimated remaining: 9m 22s. Rate: 154.2 symbols/min [2025-09-18T22:51:10.918187] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:10.939781] [DEBUG] [MAIN ] ETN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:10.940056] [DEBUG] [LOCAL ] ETO: Loaded 6678 existing records from primary storage. [2025-09-18T22:51:10.941083] [INFO ] [MAIN ] ETN: Generated 1807 derivative records from 53258 primary records. [2025-09-18T22:51:10.941222] [INFO ] [MAIN ] ETO: Loaded 6678 primary data records. [2025-09-18T22:51:10.941371] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-09-18T22:51:11.071965] [DEBUG] [LOCAL ] ETN: Derivative data saved (1807 records). [2025-09-18T22:51:11.077732] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-09-18T22:51:11.091224] [INFO ] [MAIN ] Derivative Progress: 633/2075 symbols completed. ETN took 1.3s. Estimated remaining: 9m 21s. Rate: 154.3 symbols/min [2025-09-18T22:51:11.171226] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:11.311883] [DEBUG] [LOCAL ] ETR: Loaded 53626 existing records from primary storage. [2025-09-18T22:51:11.312310] [INFO ] [MAIN ] ETR: Loaded 53626 primary data records. [2025-09-18T22:51:11.434929] [DEBUG] [LOCAL ] ETV: Loaded 21803 existing records from primary storage. [2025-09-18T22:51:11.456811] [INFO ] [MAIN ] ETV: Loaded 21803 primary data records. [2025-09-18T22:51:11.822317] [DEBUG] [MAIN ] ETO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:11.844062] [INFO ] [MAIN ] ETO: Generated 1807 derivative records from 6678 primary records. [2025-09-18T22:51:11.982066] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-09-18T22:51:12.044963] [DEBUG] [LOCAL ] ETO: Derivative data saved (1807 records). [2025-09-18T22:51:12.045175] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-09-18T22:51:12.047480] [INFO ] [MAIN ] Derivative Progress: 634/2075 symbols completed. ETO took 1.1s. Estimated remaining: 9m 22s. Rate: 154.0 symbols/min [2025-09-18T22:51:12.048964] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:12.067511] [DEBUG] [MAIN ] ETR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:12.068557] [INFO ] [MAIN ] ETR: Generated 1807 derivative records from 53626 primary records. [2025-09-18T22:51:12.068755] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-09-18T22:51:12.093048] [DEBUG] [LOCAL ] ETR: Derivative data saved (1807 records). [2025-09-18T22:51:12.094373] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-09-18T22:51:12.098789] [INFO ] [MAIN ] Derivative Progress: 635/2075 symbols completed. ETR took 1.2s. Estimated remaining: 9m 20s. Rate: 154.2 symbols/min [2025-09-18T22:51:12.099254] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:12.113282] [DEBUG] [MAIN ] ETV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:12.121678] [INFO ] [MAIN ] ETV: Generated 1807 derivative records from 21803 primary records. [2025-09-18T22:51:12.122032] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-09-18T22:51:12.123231] [DEBUG] [LOCAL ] ETW: Loaded 25572 existing records from primary storage. [2025-09-18T22:51:12.123635] [INFO ] [MAIN ] ETW: Loaded 25572 primary data records. [2025-09-18T22:51:12.152491] [DEBUG] [LOCAL ] ETV: Derivative data saved (1807 records). [2025-09-18T22:51:12.183363] [DEBUG] [LOCAL ] ETX: Loaded 4940 existing records from primary storage. [2025-09-18T22:51:12.191174] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-09-18T22:51:12.204153] [INFO ] [MAIN ] ETX: Loaded 4940 primary data records. [2025-09-18T22:51:12.206758] [INFO ] [MAIN ] Derivative Progress: 636/2075 symbols completed. ETV took 1.0s. Estimated remaining: 9m 19s. Rate: 154.4 symbols/min [2025-09-18T22:51:12.326083] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:12.790328] [DEBUG] [LOCAL ] ETY: Loaded 23221 existing records from primary storage. [2025-09-18T22:51:12.791318] [INFO ] [MAIN ] ETY: Loaded 23221 primary data records. [2025-09-18T22:51:13.118063] [DEBUG] [MAIN ] ETW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:13.119485] [INFO ] [MAIN ] ETW: Generated 1807 derivative records from 25572 primary records. [2025-09-18T22:51:13.119719] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-09-18T22:51:13.154373] [DEBUG] [MAIN ] ETX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:13.156408] [DEBUG] [LOCAL ] ETW: Derivative data saved (1807 records). [2025-09-18T22:51:13.156548] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-09-18T22:51:13.159010] [INFO ] [MAIN ] Derivative Progress: 637/2075 symbols completed. ETW took 1.1s. Estimated remaining: 9m 20s. Rate: 154.0 symbols/min [2025-09-18T22:51:13.159963] [INFO ] [MAIN ] ETX: Generated 1807 derivative records from 4940 primary records. [2025-09-18T22:51:13.161208] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:13.161500] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-09-18T22:51:13.178943] [DEBUG] [LOCAL ] ETX: Derivative data saved (1807 records). [2025-09-18T22:51:13.179425] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-09-18T22:51:13.181974] [INFO ] [MAIN ] Derivative Progress: 638/2075 symbols completed. ETX took 1.1s. Estimated remaining: 9m 19s. Rate: 154.2 symbols/min [2025-09-18T22:51:13.182457] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:13.211026] [DEBUG] [LOCAL ] EVC: Loaded 20499 existing records from primary storage. [2025-09-18T22:51:13.211330] [DEBUG] [MAIN ] ETY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:13.212164] [INFO ] [MAIN ] ETY: Generated 1807 derivative records from 23221 primary records. [2025-09-18T22:51:13.212244] [INFO ] [MAIN ] EVC: Loaded 20499 primary data records. [2025-09-18T22:51:13.212302] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-09-18T22:51:13.434004] [DEBUG] [LOCAL ] EVEX: Loaded 29397 existing records from primary storage. [2025-09-18T22:51:13.551792] [INFO ] [MAIN ] EVEX: Loaded 29397 primary data records. [2025-09-18T22:51:13.553295] [DEBUG] [LOCAL ] ETY: Derivative data saved (1807 records). [2025-09-18T22:51:13.585356] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-09-18T22:51:13.603907] [INFO ] [MAIN ] Derivative Progress: 639/2075 symbols completed. ETY took 1.3s. Estimated remaining: 9m 19s. Rate: 154.2 symbols/min [2025-09-18T22:51:13.641610] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:13.762570] [DEBUG] [LOCAL ] EVF: Loaded 9156 existing records from primary storage. [2025-09-18T22:51:13.874130] [INFO ] [MAIN ] EVF: Loaded 9156 primary data records. [2025-09-18T22:51:14.140158] [DEBUG] [MAIN ] EVC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:14.141019] [INFO ] [MAIN ] EVC: Generated 1807 derivative records from 20499 primary records. [2025-09-18T22:51:14.242747] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-09-18T22:51:14.276797] [DEBUG] [LOCAL ] EVC: Derivative data saved (1807 records). [2025-09-18T22:51:14.277968] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-09-18T22:51:14.280383] [INFO ] [MAIN ] Derivative Progress: 640/2075 symbols completed. EVC took 1.1s. Estimated remaining: 9m 19s. Rate: 154.0 symbols/min [2025-09-18T22:51:14.280794] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:14.297964] [DEBUG] [MAIN ] EVEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:14.300390] [INFO ] [MAIN ] EVEX: Generated 1807 derivative records from 29397 primary records. [2025-09-18T22:51:14.300637] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-09-18T22:51:14.304308] [DEBUG] [LOCAL ] EVG: Loaded 5860 existing records from primary storage. [2025-09-18T22:51:14.304512] [INFO ] [MAIN ] EVG: Loaded 5860 primary data records. [2025-09-18T22:51:14.413872] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1807 records). [2025-09-18T22:51:14.425015] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-09-18T22:51:14.428054] [INFO ] [MAIN ] Derivative Progress: 641/2075 symbols completed. EVEX took 1.2s. Estimated remaining: 9m 18s. Rate: 154.2 symbols/min [2025-09-18T22:51:14.428330] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:14.635668] [DEBUG] [MAIN ] EVF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:14.646137] [INFO ] [MAIN ] EVF: Generated 1807 derivative records from 9156 primary records. [2025-09-18T22:51:14.646304] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-09-18T22:51:14.676135] [DEBUG] [LOCAL ] EVF: Derivative data saved (1807 records). [2025-09-18T22:51:14.676283] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-09-18T22:51:14.679138] [INFO ] [MAIN ] Derivative Progress: 642/2075 symbols completed. EVF took 1.0s. Estimated remaining: 9m 17s. Rate: 154.3 symbols/min [2025-09-18T22:51:14.680140] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:14.700692] [DEBUG] [LOCAL ] EVH: Loaded 49711 existing records from primary storage. [2025-09-18T22:51:14.701972] [INFO ] [MAIN ] EVH: Loaded 49711 primary data records. [2025-09-18T22:51:14.751901] [DEBUG] [LOCAL ] EVN: Loaded 11003 existing records from primary storage. [2025-09-18T22:51:14.774200] [INFO ] [MAIN ] EVN: Loaded 11003 primary data records. [2025-09-18T22:51:14.858333] [DEBUG] [MAIN ] EVG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:14.924618] [INFO ] [MAIN ] EVG: Generated 1807 derivative records from 5860 primary records. [2025-09-18T22:51:14.951801] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-09-18T22:51:15.352167] [DEBUG] [LOCAL ] EVG: Derivative data saved (1807 records). [2025-09-18T22:51:15.352898] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-09-18T22:51:15.356483] [INFO ] [MAIN ] Derivative Progress: 643/2075 symbols completed. EVG took 1.1s. Estimated remaining: 9m 18s. Rate: 154.1 symbols/min [2025-09-18T22:51:15.381027] [DEBUG] [MAIN ] EVH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:15.382566] [INFO ] [MAIN ] EVH: Generated 1807 derivative records from 49711 primary records. [2025-09-18T22:51:15.383390] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-09-18T22:51:15.408708] [DEBUG] [MAIN ] EVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:15.410104] [INFO ] [MAIN ] EVN: Generated 1807 derivative records from 11003 primary records. [2025-09-18T22:51:15.410397] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-09-18T22:51:15.426274] [DEBUG] [LOCAL ] EVH: Derivative data saved (1807 records). [2025-09-18T22:51:15.426575] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-09-18T22:51:15.428867] [INFO ] [MAIN ] Derivative Progress: 644/2075 symbols completed. EVH took 1.0s. Estimated remaining: 9m 17s. Rate: 154.3 symbols/min [2025-09-18T22:51:15.431881] [DEBUG] [LOCAL ] EVN: Derivative data saved (1807 records). [2025-09-18T22:51:15.431944] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-09-18T22:51:15.434988] [INFO ] [MAIN ] Derivative Progress: 645/2075 symbols completed. EVN took 0.8s. Estimated remaining: 9m 15s. Rate: 154.5 symbols/min [2025-09-18T22:51:15.435454] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:15.435662] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:15.436061] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:15.454452] [DEBUG] [LOCAL ] EVT: Loaded 17782 existing records from primary storage. [2025-09-18T22:51:15.454689] [INFO ] [MAIN ] EVT: Loaded 17782 primary data records. [2025-09-18T22:51:15.575260] [DEBUG] [LOCAL ] EVTC: Loaded 26890 existing records from primary storage. [2025-09-18T22:51:15.587369] [INFO ] [MAIN ] EVTC: Loaded 26890 primary data records. [2025-09-18T22:51:15.780024] [DEBUG] [LOCAL ] EVR: Loaded 36199 existing records from primary storage. [2025-09-18T22:51:15.797681] [INFO ] [MAIN ] EVR: Loaded 36199 primary data records. [2025-09-18T22:51:16.483774] [DEBUG] [MAIN ] EVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:16.484880] [INFO ] [MAIN ] EVT: Generated 1807 derivative records from 17782 primary records. [2025-09-18T22:51:16.485177] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-09-18T22:51:16.504036] [DEBUG] [LOCAL ] EVT: Derivative data saved (1807 records). [2025-09-18T22:51:16.517188] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-09-18T22:51:16.520200] [DEBUG] [MAIN ] EVTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:16.519788] [INFO ] [MAIN ] Derivative Progress: 646/2075 symbols completed. EVT took 1.1s. Estimated remaining: 9m 16s. Rate: 154.1 symbols/min [2025-09-18T22:51:16.521193] [INFO ] [MAIN ] EVTC: Generated 1807 derivative records from 26890 primary records. [2025-09-18T22:51:16.523061] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:16.523256] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-09-18T22:51:16.548930] [DEBUG] [MAIN ] EVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:16.550544] [INFO ] [MAIN ] EVR: Generated 1807 derivative records from 36199 primary records. [2025-09-18T22:51:16.554156] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-09-18T22:51:16.554568] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1807 records). [2025-09-18T22:51:16.554865] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-09-18T22:51:16.557790] [INFO ] [MAIN ] Derivative Progress: 647/2075 symbols completed. EVTC took 1.1s. Estimated remaining: 9m 15s. Rate: 154.3 symbols/min [2025-09-18T22:51:16.558688] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:16.587593] [DEBUG] [LOCAL ] EVR: Derivative data saved (1807 records). [2025-09-18T22:51:16.587877] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-09-18T22:51:16.590485] [INFO ] [MAIN ] Derivative Progress: 648/2075 symbols completed. EVR took 1.2s. Estimated remaining: 9m 14s. Rate: 154.5 symbols/min [2025-09-18T22:51:16.590991] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:16.603815] [DEBUG] [LOCAL ] EVTL: Loaded 36740 existing records from primary storage. [2025-09-18T22:51:16.604068] [INFO ] [MAIN ] EVTL: Loaded 36740 primary data records. [2025-09-18T22:51:16.711427] [DEBUG] [LOCAL ] EVTR: Loaded 23028 existing records from primary storage. [2025-09-18T22:51:16.719903] [INFO ] [MAIN ] EVTR: Loaded 23028 primary data records. [2025-09-18T22:51:17.275183] [DEBUG] [LOCAL ] EW: Loaded 53787 existing records from primary storage. [2025-09-18T22:51:17.275722] [INFO ] [MAIN ] EW: Loaded 53787 primary data records. [2025-09-18T22:51:17.630222] [DEBUG] [MAIN ] EVTL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:17.631549] [INFO ] [MAIN ] EVTL: Generated 1807 derivative records from 36740 primary records. [2025-09-18T22:51:17.632346] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-09-18T22:51:17.653262] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1807 records). [2025-09-18T22:51:17.653496] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-09-18T22:51:17.656296] [INFO ] [MAIN ] Derivative Progress: 649/2075 symbols completed. EVTL took 1.1s. Estimated remaining: 9m 15s. Rate: 154.1 symbols/min [2025-09-18T22:51:17.670285] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:17.670937] [DEBUG] [MAIN ] EVTR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:51:17.672595] [INFO ] [MAIN ] EVTR: Generated 1806 derivative records from 23028 primary records. [2025-09-18T22:51:17.672980] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-09-18T22:51:17.708304] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1806 records). [2025-09-18T22:51:17.708558] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-09-18T22:51:17.707949] [DEBUG] [MAIN ] EW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:17.709534] [INFO ] [MAIN ] EW: Generated 1807 derivative records from 53787 primary records. [2025-09-18T22:51:17.720679] [INFO ] [MAIN ] Derivative Progress: 650/2075 symbols completed. EVTR took 1.2s. Estimated remaining: 9m 14s. Rate: 154.3 symbols/min [2025-09-18T22:51:17.720842] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-09-18T22:51:17.722166] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:17.737956] [DEBUG] [LOCAL ] EW: Derivative data saved (1807 records). [2025-09-18T22:51:17.738783] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-09-18T22:51:17.741419] [INFO ] [MAIN ] Derivative Progress: 651/2075 symbols completed. EW took 1.2s. Estimated remaining: 9m 13s. Rate: 154.5 symbols/min [2025-09-18T22:51:17.751787] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:17.752437] [DEBUG] [LOCAL ] EXG: Loaded 35077 existing records from primary storage. [2025-09-18T22:51:17.753088] [INFO ] [MAIN ] EXG: Loaded 35077 primary data records. [2025-09-18T22:51:18.124464] [DEBUG] [LOCAL ] EXP: Loaded 30581 existing records from primary storage. [2025-09-18T22:51:18.139823] [INFO ] [MAIN ] EXP: Loaded 30581 primary data records. [2025-09-18T22:51:18.146149] [DEBUG] [LOCAL ] EXK: Loaded 53465 existing records from primary storage. [2025-09-18T22:51:18.163555] [INFO ] [MAIN ] EXK: Loaded 53465 primary data records. [2025-09-18T22:51:18.789848] [DEBUG] [MAIN ] EXG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:18.791257] [INFO ] [MAIN ] EXG: Generated 1807 derivative records from 35077 primary records. [2025-09-18T22:51:18.791692] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-09-18T22:51:18.810749] [DEBUG] [LOCAL ] EXG: Derivative data saved (1807 records). [2025-09-18T22:51:18.811043] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-09-18T22:51:18.813857] [INFO ] [MAIN ] Derivative Progress: 652/2075 symbols completed. EXG took 1.1s. Estimated remaining: 9m 14s. Rate: 154.1 symbols/min [2025-09-18T22:51:18.816466] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:18.848271] [DEBUG] [MAIN ] EXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:18.847944] [DEBUG] [MAIN ] EXK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:18.849181] [INFO ] [MAIN ] EXP: Generated 1807 derivative records from 30581 primary records. [2025-09-18T22:51:18.849859] [INFO ] [MAIN ] EXK: Generated 1807 derivative records from 53465 primary records. [2025-09-18T22:51:18.850005] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-09-18T22:51:18.850084] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-09-18T22:51:18.879084] [DEBUG] [LOCAL ] EXK: Derivative data saved (1807 records). [2025-09-18T22:51:18.879374] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-09-18T22:51:18.882395] [INFO ] [MAIN ] Derivative Progress: 653/2075 symbols completed. EXK took 1.2s. Estimated remaining: 9m 13s. Rate: 154.3 symbols/min [2025-09-18T22:51:18.883623] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:18.897210] [DEBUG] [LOCAL ] EXP: Derivative data saved (1807 records). [2025-09-18T22:51:18.897289] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-09-18T22:51:18.899475] [INFO ] [MAIN ] Derivative Progress: 654/2075 symbols completed. EXP took 1.1s. Estimated remaining: 9m 12s. Rate: 154.5 symbols/min [2025-09-18T22:51:18.899884] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:18.918159] [DEBUG] [LOCAL ] EXPD: Loaded 48569 existing records from primary storage. [2025-09-18T22:51:18.918458] [INFO ] [MAIN ] EXPD: Loaded 48569 primary data records. [2025-09-18T22:51:19.276995] [DEBUG] [LOCAL ] EXR: Loaded 45952 existing records from primary storage. [2025-09-18T22:51:19.277197] [INFO ] [MAIN ] EXR: Loaded 45952 primary data records. [2025-09-18T22:51:19.393558] [DEBUG] [LOCAL ] F: Loaded 54210 existing records from primary storage. [2025-09-18T22:51:19.407380] [INFO ] [MAIN ] F: Loaded 54210 primary data records. [2025-09-18T22:51:19.970300] [DEBUG] [MAIN ] EXPD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:20.046865] [INFO ] [MAIN ] EXPD: Generated 1807 derivative records from 48569 primary records. [2025-09-18T22:51:20.226873] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-09-18T22:51:20.270071] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1807 records). [2025-09-18T22:51:20.270886] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-09-18T22:51:20.273707] [INFO ] [MAIN ] Derivative Progress: 655/2075 symbols completed. EXPD took 1.5s. Estimated remaining: 9m 13s. Rate: 153.9 symbols/min [2025-09-18T22:51:20.275593] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:20.303611] [DEBUG] [MAIN ] EXR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:20.305196] [INFO ] [MAIN ] EXR: Generated 1807 derivative records from 45952 primary records. [2025-09-18T22:51:20.305567] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-09-18T22:51:20.344501] [DEBUG] [LOCAL ] EXR: Derivative data saved (1807 records). [2025-09-18T22:51:20.356751] [DEBUG] [MAIN ] F: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:20.357832] [INFO ] [MAIN ] F: Generated 1807 derivative records from 54210 primary records. [2025-09-18T22:51:20.357986] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-09-18T22:51:20.356197] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-09-18T22:51:20.360338] [INFO ] [MAIN ] Derivative Progress: 656/2075 symbols completed. EXR took 1.5s. Estimated remaining: 9m 12s. Rate: 154.1 symbols/min [2025-09-18T22:51:20.376503] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:20.401201] [DEBUG] [LOCAL ] FAF: Loaded 42390 existing records from primary storage. [2025-09-18T22:51:20.402339] [INFO ] [MAIN ] FAF: Loaded 42390 primary data records. [2025-09-18T22:51:20.403061] [DEBUG] [LOCAL ] F: Derivative data saved (1807 records). [2025-09-18T22:51:20.403256] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-09-18T22:51:20.407683] [INFO ] [MAIN ] Derivative Progress: 657/2075 symbols completed. F took 1.5s. Estimated remaining: 9m 11s. Rate: 154.3 symbols/min [2025-09-18T22:51:20.408395] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:20.643754] [DEBUG] [LOCAL ] FBK: Loaded 25471 existing records from primary storage. [2025-09-18T22:51:20.659874] [INFO ] [MAIN ] FBK: Loaded 25471 primary data records. [2025-09-18T22:51:20.932336] [DEBUG] [LOCAL ] FBIN: Loaded 50823 existing records from primary storage. [2025-09-18T22:51:20.948750] [INFO ] [MAIN ] FBIN: Loaded 50823 primary data records. [2025-09-18T22:51:21.542981] [DEBUG] [MAIN ] FAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:21.544054] [INFO ] [MAIN ] FAF: Generated 1807 derivative records from 42390 primary records. [2025-09-18T22:51:21.544382] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-09-18T22:51:21.565109] [DEBUG] [LOCAL ] FAF: Derivative data saved (1807 records). [2025-09-18T22:51:21.565510] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-09-18T22:51:21.567704] [INFO ] [MAIN ] Derivative Progress: 658/2075 symbols completed. FAF took 1.3s. Estimated remaining: 9m 13s. Rate: 153.9 symbols/min [2025-09-18T22:51:21.580792] [DEBUG] [MAIN ] FBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:21.581410] [INFO ] [MAIN ] FBK: Generated 1807 derivative records from 25471 primary records. [2025-09-18T22:51:21.581556] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-09-18T22:51:21.599947] [DEBUG] [LOCAL ] FBK: Derivative data saved (1807 records). [2025-09-18T22:51:21.600128] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-09-18T22:51:21.602481] [INFO ] [MAIN ] Derivative Progress: 659/2075 symbols completed. FBK took 1.2s. Estimated remaining: 9m 11s. Rate: 154.1 symbols/min [2025-09-18T22:51:21.614908] [DEBUG] [MAIN ] FBIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:21.615806] [INFO ] [MAIN ] FBIN: Generated 1807 derivative records from 50823 primary records. [2025-09-18T22:51:21.615877] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-09-18T22:51:21.630767] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1807 records). [2025-09-18T22:51:21.630830] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-09-18T22:51:21.633331] [INFO ] [MAIN ] Derivative Progress: 660/2075 symbols completed. FBIN took 1.3s. Estimated remaining: 9m 10s. Rate: 154.3 symbols/min [2025-09-18T22:51:21.634015] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:21.634309] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:21.634133] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:21.652750] [DEBUG] [LOCAL ] FC: Loaded 15561 existing records from primary storage. [2025-09-18T22:51:21.653737] [INFO ] [MAIN ] FC: Loaded 15561 primary data records. [2025-09-18T22:51:21.827396] [DEBUG] [LOCAL ] FBRT: Loaded 34575 existing records from primary storage. [2025-09-18T22:51:21.838712] [INFO ] [MAIN ] FBRT: Loaded 34575 primary data records. [2025-09-18T22:51:22.100914] [DEBUG] [LOCAL ] FBP: Loaded 46725 existing records from primary storage. [2025-09-18T22:51:22.132523] [INFO ] [MAIN ] FBP: Loaded 46725 primary data records. [2025-09-18T22:51:22.691083] [DEBUG] [MAIN ] FC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:22.692557] [INFO ] [MAIN ] FC: Generated 1807 derivative records from 15561 primary records. [2025-09-18T22:51:22.692687] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-09-18T22:51:22.711784] [DEBUG] [LOCAL ] FC: Derivative data saved (1807 records). [2025-09-18T22:51:22.713042] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-09-18T22:51:22.715313] [INFO ] [MAIN ] Derivative Progress: 661/2075 symbols completed. FC took 1.1s. Estimated remaining: 9m 11s. Rate: 153.9 symbols/min [2025-09-18T22:51:22.715805] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:22.733816] [DEBUG] [MAIN ] FBRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:22.735019] [INFO ] [MAIN ] FBRT: Generated 1807 derivative records from 34575 primary records. [2025-09-18T22:51:22.735316] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-09-18T22:51:22.756977] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1807 records). [2025-09-18T22:51:22.764808] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-09-18T22:51:22.767183] [INFO ] [MAIN ] Derivative Progress: 662/2075 symbols completed. FBRT took 1.1s. Estimated remaining: 9m 10s. Rate: 154.1 symbols/min [2025-09-18T22:51:22.767571] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:22.782962] [DEBUG] [MAIN ] FBP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:22.784713] [INFO ] [MAIN ] FBP: Generated 1807 derivative records from 46725 primary records. [2025-09-18T22:51:22.785038] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-09-18T22:51:22.811612] [DEBUG] [LOCAL ] FBP: Derivative data saved (1807 records). [2025-09-18T22:51:22.822872] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-09-18T22:51:22.825782] [INFO ] [MAIN ] Derivative Progress: 663/2075 symbols completed. FBP took 1.2s. Estimated remaining: 9m 9s. Rate: 154.3 symbols/min [2025-09-18T22:51:22.826961] [DEBUG] [LOCAL ] FCF: Loaded 40259 existing records from primary storage. [2025-09-18T22:51:22.827240] [INFO ] [MAIN ] FCF: Loaded 40259 primary data records. [2025-09-18T22:51:22.827476] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:22.906072] [DEBUG] [LOCAL ] FCN: Loaded 26543 existing records from primary storage. [2025-09-18T22:51:22.911502] [INFO ] [MAIN ] FCN: Loaded 26543 primary data records. [2025-09-18T22:51:23.350290] [DEBUG] [LOCAL ] FCPT: Loaded 37843 existing records from primary storage. [2025-09-18T22:51:23.374172] [INFO ] [MAIN ] FCPT: Loaded 37843 primary data records. [2025-09-18T22:51:23.819415] [DEBUG] [MAIN ] FCF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:23.821272] [INFO ] [MAIN ] FCF: Generated 1807 derivative records from 40259 primary records. [2025-09-18T22:51:23.821596] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-09-18T22:51:23.853615] [DEBUG] [MAIN ] FCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:23.855422] [INFO ] [MAIN ] FCN: Generated 1807 derivative records from 26543 primary records. [2025-09-18T22:51:23.855926] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-09-18T22:51:23.866501] [DEBUG] [LOCAL ] FCF: Derivative data saved (1807 records). [2025-09-18T22:51:23.866787] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-09-18T22:51:23.870150] [INFO ] [MAIN ] Derivative Progress: 664/2075 symbols completed. FCF took 1.2s. Estimated remaining: 9m 10s. Rate: 153.9 symbols/min [2025-09-18T22:51:23.873448] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:23.899693] [DEBUG] [LOCAL ] FCN: Derivative data saved (1807 records). [2025-09-18T22:51:23.900097] [DEBUG] [MAIN ] FCPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:23.900335] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-09-18T22:51:23.902505] [INFO ] [MAIN ] Derivative Progress: 665/2075 symbols completed. FCN took 1.1s. Estimated remaining: 9m 9s. Rate: 154.1 symbols/min [2025-09-18T22:51:23.903402] [INFO ] [MAIN ] FCPT: Generated 1807 derivative records from 37843 primary records. [2025-09-18T22:51:23.903706] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:23.904222] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-09-18T22:51:23.911191] [DEBUG] [LOCAL ] FCT: Loaded 14486 existing records from primary storage. [2025-09-18T22:51:23.922127] [INFO ] [MAIN ] FCT: Loaded 14486 primary data records. [2025-09-18T22:51:23.926719] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1807 records). [2025-09-18T22:51:23.926996] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-09-18T22:51:23.961504] [INFO ] [MAIN ] Derivative Progress: 666/2075 symbols completed. FCPT took 1.1s. Estimated remaining: 9m 8s. Rate: 154.3 symbols/min [2025-09-18T22:51:24.001426] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:24.295420] [DEBUG] [LOCAL ] FCX: Loaded 54090 existing records from primary storage. [2025-09-18T22:51:24.296353] [DEBUG] [LOCAL ] FDP: Loaded 30690 existing records from primary storage. [2025-09-18T22:51:24.297015] [INFO ] [MAIN ] FCX: Loaded 54090 primary data records. [2025-09-18T22:51:24.297293] [INFO ] [MAIN ] FDP: Loaded 30690 primary data records. [2025-09-18T22:51:25.031203] [DEBUG] [MAIN ] FCT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:25.032695] [INFO ] [MAIN ] FCT: Generated 1807 derivative records from 14486 primary records. [2025-09-18T22:51:25.034319] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-09-18T22:51:25.056071] [DEBUG] [LOCAL ] FCT: Derivative data saved (1807 records). [2025-09-18T22:51:25.056330] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-09-18T22:51:25.059307] [INFO ] [MAIN ] Derivative Progress: 667/2075 symbols completed. FCT took 1.2s. Estimated remaining: 9m 9s. Rate: 153.9 symbols/min [2025-09-18T22:51:25.060506] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:25.083576] [DEBUG] [MAIN ] FCX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:25.085221] [INFO ] [MAIN ] FCX: Generated 1807 derivative records from 54090 primary records. [2025-09-18T22:51:25.085404] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-09-18T22:51:25.106438] [DEBUG] [MAIN ] FDP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:25.118564] [INFO ] [MAIN ] FDP: Generated 1807 derivative records from 30690 primary records. [2025-09-18T22:51:25.118765] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-09-18T22:51:25.142783] [DEBUG] [LOCAL ] FCX: Derivative data saved (1807 records). [2025-09-18T22:51:25.147086] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-09-18T22:51:25.147028] [DEBUG] [LOCAL ] FDP: Derivative data saved (1807 records). [2025-09-18T22:51:25.149886] [INFO ] [MAIN ] Derivative Progress: 668/2075 symbols completed. FCX took 1.2s. Estimated remaining: 9m 8s. Rate: 154.1 symbols/min [2025-09-18T22:51:25.147672] [DEBUG] [LOCAL ] FDS: Loaded 25899 existing records from primary storage. [2025-09-18T22:51:25.150030] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-09-18T22:51:25.153002] [INFO ] [MAIN ] Derivative Progress: 669/2075 symbols completed. FDP took 1.2s. Estimated remaining: 9m 7s. Rate: 154.3 symbols/min [2025-09-18T22:51:25.150319] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:25.153693] [INFO ] [MAIN ] FDS: Loaded 25899 primary data records. [2025-09-18T22:51:25.153569] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:25.550434] [DEBUG] [LOCAL ] FDX: Loaded 51948 existing records from primary storage. [2025-09-18T22:51:25.551248] [DEBUG] [LOCAL ] FE: Loaded 53831 existing records from primary storage. [2025-09-18T22:51:25.551555] [INFO ] [MAIN ] FDX: Loaded 51948 primary data records. [2025-09-18T22:51:25.551626] [INFO ] [MAIN ] FE: Loaded 53831 primary data records. [2025-09-18T22:51:25.776793] [DEBUG] [MAIN ] FDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:25.791802] [INFO ] [MAIN ] FDS: Generated 1807 derivative records from 25899 primary records. [2025-09-18T22:51:25.807305] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-09-18T22:51:26.220781] [DEBUG] [LOCAL ] FDS: Derivative data saved (1807 records). [2025-09-18T22:51:26.221589] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-09-18T22:51:26.224164] [INFO ] [MAIN ] Derivative Progress: 670/2075 symbols completed. FDS took 1.2s. Estimated remaining: 9m 8s. Rate: 153.9 symbols/min [2025-09-18T22:51:26.225078] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:26.254483] [DEBUG] [MAIN ] FE: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:51:26.257283] [INFO ] [MAIN ] FE: Generated 1806 derivative records from 53831 primary records. [2025-09-18T22:51:26.257509] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-09-18T22:51:26.283696] [DEBUG] [MAIN ] FDX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:26.285078] [INFO ] [MAIN ] FDX: Generated 1807 derivative records from 51948 primary records. [2025-09-18T22:51:26.285767] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-09-18T22:51:26.318057] [DEBUG] [LOCAL ] FE: Derivative data saved (1806 records). [2025-09-18T22:51:26.318166] [DEBUG] [LOCAL ] FDX: Derivative data saved (1807 records). [2025-09-18T22:51:26.318434] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-09-18T22:51:26.318509] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-09-18T22:51:26.322677] [INFO ] [MAIN ] Derivative Progress: 671/2075 symbols completed. FE took 1.2s. Estimated remaining: 9m 7s. Rate: 154.1 symbols/min [2025-09-18T22:51:26.338837] [INFO ] [MAIN ] Derivative Progress: 672/2075 symbols completed. FDX took 1.2s. Estimated remaining: 9m 6s. Rate: 154.3 symbols/min [2025-09-18T22:51:26.338596] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:26.340533] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:26.341812] [DEBUG] [LOCAL ] FERG: Loaded 49429 existing records from primary storage. [2025-09-18T22:51:26.342385] [INFO ] [MAIN ] FERG: Loaded 49429 primary data records. [2025-09-18T22:51:26.487685] [DEBUG] [LOCAL ] FET: Loaded 12836 existing records from primary storage. [2025-09-18T22:51:26.499115] [INFO ] [MAIN ] FET: Loaded 12836 primary data records. [2025-09-18T22:51:26.669532] [DEBUG] [LOCAL ] FF: Loaded 26065 existing records from primary storage. [2025-09-18T22:51:26.681535] [INFO ] [MAIN ] FF: Loaded 26065 primary data records. [2025-09-18T22:51:27.451216] [DEBUG] [MAIN ] FERG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:27.452445] [INFO ] [MAIN ] FERG: Generated 1807 derivative records from 49429 primary records. [2025-09-18T22:51:27.452997] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-09-18T22:51:27.475046] [DEBUG] [LOCAL ] FERG: Derivative data saved (1807 records). [2025-09-18T22:51:27.477805] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-09-18T22:51:27.480063] [INFO ] [MAIN ] Derivative Progress: 673/2075 symbols completed. FERG took 1.3s. Estimated remaining: 9m 7s. Rate: 153.8 symbols/min [2025-09-18T22:51:27.506457] [DEBUG] [MAIN ] FET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:27.506858] [DEBUG] [MAIN ] FF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:27.507813] [INFO ] [MAIN ] FET: Generated 1807 derivative records from 12836 primary records. [2025-09-18T22:51:27.508723] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-09-18T22:51:27.508611] [INFO ] [MAIN ] FF: Generated 1807 derivative records from 26065 primary records. [2025-09-18T22:51:27.509544] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-09-18T22:51:27.537361] [DEBUG] [LOCAL ] FET: Derivative data saved (1807 records). [2025-09-18T22:51:27.537741] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-09-18T22:51:27.540001] [INFO ] [MAIN ] Derivative Progress: 674/2075 symbols completed. FET took 1.2s. Estimated remaining: 9m 6s. Rate: 154.0 symbols/min [2025-09-18T22:51:27.544036] [DEBUG] [LOCAL ] FF: Derivative data saved (1807 records). [2025-09-18T22:51:27.544186] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-09-18T22:51:27.547004] [INFO ] [MAIN ] Derivative Progress: 675/2075 symbols completed. FF took 1.2s. Estimated remaining: 9m 5s. Rate: 154.2 symbols/min [2025-09-18T22:51:27.547743] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:27.547810] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:27.547979] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:27.557947] [DEBUG] [LOCAL ] FFA: Loaded 5628 existing records from primary storage. [2025-09-18T22:51:27.558080] [INFO ] [MAIN ] FFA: Loaded 5628 primary data records. [2025-09-18T22:51:27.690184] [DEBUG] [LOCAL ] FFC: Loaded 16790 existing records from primary storage. [2025-09-18T22:51:27.701477] [INFO ] [MAIN ] FFC: Loaded 16790 primary data records. [2025-09-18T22:51:27.903332] [DEBUG] [LOCAL ] FFWM: Loaded 36552 existing records from primary storage. [2025-09-18T22:51:28.020938] [INFO ] [MAIN ] FFWM: Loaded 36552 primary data records. [2025-09-18T22:51:28.592595] [DEBUG] [MAIN ] FFA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:28.593914] [INFO ] [MAIN ] FFA: Generated 1807 derivative records from 5628 primary records. [2025-09-18T22:51:28.595827] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-09-18T22:51:28.629804] [DEBUG] [MAIN ] FFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:28.632627] [INFO ] [MAIN ] FFC: Generated 1807 derivative records from 16790 primary records. [2025-09-18T22:51:28.633037] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-09-18T22:51:28.655430] [DEBUG] [LOCAL ] FFA: Derivative data saved (1807 records). [2025-09-18T22:51:28.656131] [DEBUG] [LOCAL ] FFC: Derivative data saved (1807 records). [2025-09-18T22:51:28.658295] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-09-18T22:51:28.661865] [INFO ] [MAIN ] Derivative Progress: 676/2075 symbols completed. FFC took 1.1s. Estimated remaining: 9m 6s. Rate: 153.8 symbols/min [2025-09-18T22:51:28.659116] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-09-18T22:51:28.665116] [INFO ] [MAIN ] Derivative Progress: 677/2075 symbols completed. FFA took 1.1s. Estimated remaining: 9m 5s. Rate: 154.0 symbols/min [2025-09-18T22:51:28.664821] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:28.665621] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:28.679774] [DEBUG] [MAIN ] FFWM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:28.680957] [INFO ] [MAIN ] FFWM: Generated 1807 derivative records from 36552 primary records. [2025-09-18T22:51:28.681089] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-09-18T22:51:28.704110] [DEBUG] [LOCAL ] FGN: Loaded 4071 existing records from primary storage. [2025-09-18T22:51:28.703869] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1807 records). [2025-09-18T22:51:28.704272] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-09-18T22:51:28.704354] [INFO ] [MAIN ] FGN: Loaded 4071 primary data records. [2025-09-18T22:51:28.707025] [INFO ] [MAIN ] Derivative Progress: 678/2075 symbols completed. FFWM took 1.2s. Estimated remaining: 9m 3s. Rate: 154.3 symbols/min [2025-09-18T22:51:28.737277] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:28.826973] [DEBUG] [LOCAL ] FG: Loaded 22428 existing records from primary storage. [2025-09-18T22:51:28.839140] [INFO ] [MAIN ] FG: Loaded 22428 primary data records. [2025-09-18T22:51:29.277899] [DEBUG] [LOCAL ] FHI: Loaded 41135 existing records from primary storage. [2025-09-18T22:51:29.306270] [INFO ] [MAIN ] FHI: Loaded 41135 primary data records. [2025-09-18T22:51:29.803224] [DEBUG] [MAIN ] FGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:29.805709] [INFO ] [MAIN ] FGN: Generated 1807 derivative records from 4071 primary records. [2025-09-18T22:51:29.808822] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-09-18T22:51:29.839465] [DEBUG] [MAIN ] FG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:29.841347] [INFO ] [MAIN ] FG: Generated 1807 derivative records from 22428 primary records. [2025-09-18T22:51:29.843145] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-09-18T22:51:29.846438] [DEBUG] [LOCAL ] FGN: Derivative data saved (1807 records). [2025-09-18T22:51:29.857353] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-09-18T22:51:29.861932] [DEBUG] [LOCAL ] FG: Derivative data saved (1807 records). [2025-09-18T22:51:29.868796] [INFO ] [MAIN ] Derivative Progress: 679/2075 symbols completed. FGN took 1.2s. Estimated remaining: 9m 5s. Rate: 153.8 symbols/min [2025-09-18T22:51:29.871002] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:29.868691] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-09-18T22:51:29.874945] [INFO ] [MAIN ] Derivative Progress: 680/2075 symbols completed. FG took 1.2s. Estimated remaining: 9m 3s. Rate: 154.0 symbols/min [2025-09-18T22:51:29.875586] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:29.891123] [DEBUG] [MAIN ] FHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:29.892103] [INFO ] [MAIN ] FHI: Generated 1807 derivative records from 41135 primary records. [2025-09-18T22:51:29.892283] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-09-18T22:51:29.909109] [DEBUG] [LOCAL ] FHI: Derivative data saved (1807 records). [2025-09-18T22:51:29.909266] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-09-18T22:51:29.911777] [INFO ] [MAIN ] Derivative Progress: 681/2075 symbols completed. FHI took 1.2s. Estimated remaining: 9m 2s. Rate: 154.2 symbols/min [2025-09-18T22:51:29.912180] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:29.969362] [DEBUG] [LOCAL ] FICO: Loaded 20603 existing records from primary storage. [2025-09-18T22:51:29.969605] [INFO ] [MAIN ] FICO: Loaded 20603 primary data records. [2025-09-18T22:51:30.122945] [DEBUG] [LOCAL ] FHN: Loaded 53758 existing records from primary storage. [2025-09-18T22:51:30.124021] [DEBUG] [LOCAL ] FI: Loaded 53888 existing records from primary storage. [2025-09-18T22:51:30.124198] [INFO ] [MAIN ] FHN: Loaded 53758 primary data records. [2025-09-18T22:51:30.124270] [INFO ] [MAIN ] FI: Loaded 53888 primary data records. [2025-09-18T22:51:31.075327] [DEBUG] [MAIN ] FICO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:31.077404] [INFO ] [MAIN ] FICO: Generated 1807 derivative records from 20603 primary records. [2025-09-18T22:51:31.078153] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-09-18T22:51:31.099518] [DEBUG] [LOCAL ] FICO: Derivative data saved (1807 records). [2025-09-18T22:51:31.101046] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-09-18T22:51:31.103753] [INFO ] [MAIN ] Derivative Progress: 682/2075 symbols completed. FICO took 1.2s. Estimated remaining: 9m 4s. Rate: 153.8 symbols/min [2025-09-18T22:51:31.104595] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:31.129078] [DEBUG] [MAIN ] FHN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:31.131027] [INFO ] [MAIN ] FHN: Generated 1807 derivative records from 53758 primary records. [2025-09-18T22:51:31.131173] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-09-18T22:51:31.152694] [DEBUG] [MAIN ] FI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:31.154912] [INFO ] [MAIN ] FI: Generated 1807 derivative records from 53888 primary records. [2025-09-18T22:51:31.155127] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-09-18T22:51:31.172108] [DEBUG] [LOCAL ] FHN: Derivative data saved (1807 records). [2025-09-18T22:51:31.174906] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-09-18T22:51:31.178134] [INFO ] [MAIN ] Derivative Progress: 683/2075 symbols completed. FHN took 1.3s. Estimated remaining: 9m 3s. Rate: 153.9 symbols/min [2025-09-18T22:51:31.191858] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:31.193955] [DEBUG] [LOCAL ] FI: Derivative data saved (1807 records). [2025-09-18T22:51:31.194272] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-09-18T22:51:31.196853] [INFO ] [MAIN ] Derivative Progress: 684/2075 symbols completed. FI took 1.3s. Estimated remaining: 9m 1s. Rate: 154.2 symbols/min [2025-09-18T22:51:31.197174] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:31.217447] [DEBUG] [LOCAL ] FIGS: Loaded 49441 existing records from primary storage. [2025-09-18T22:51:31.221877] [INFO ] [MAIN ] FIGS: Loaded 49441 primary data records. [2025-09-18T22:51:31.221791] [DEBUG] [LOCAL ] FINS: Loaded 8252 existing records from primary storage. [2025-09-18T22:51:31.222002] [INFO ] [MAIN ] FINS: Loaded 8252 primary data records. [2025-09-18T22:51:31.601846] [DEBUG] [LOCAL ] FIHL: Loaded 40851 existing records from primary storage. [2025-09-18T22:51:31.625270] [INFO ] [MAIN ] FIHL: Loaded 40851 primary data records. [2025-09-18T22:51:32.258439] [DEBUG] [MAIN ] FINS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:32.259449] [INFO ] [MAIN ] FINS: Generated 1807 derivative records from 8252 primary records. [2025-09-18T22:51:32.258065] [DEBUG] [MAIN ] FIGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:32.260501] [INFO ] [MAIN ] FIGS: Generated 1807 derivative records from 49441 primary records. [2025-09-18T22:51:32.259788] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-09-18T22:51:32.261326] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-09-18T22:51:32.298089] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1807 records). [2025-09-18T22:51:32.296827] [DEBUG] [LOCAL ] FINS: Derivative data saved (1807 records). [2025-09-18T22:51:32.298331] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-09-18T22:51:32.298278] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-09-18T22:51:32.300397] [INFO ] [MAIN ] Derivative Progress: 685/2075 symbols completed. FIGS took 1.2s. Estimated remaining: 9m 2s. Rate: 153.7 symbols/min [2025-09-18T22:51:32.303171] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:32.303592] [INFO ] [MAIN ] Derivative Progress: 686/2075 symbols completed. FINS took 1.1s. Estimated remaining: 9m 1s. Rate: 154.0 symbols/min [2025-09-18T22:51:32.304276] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:32.321543] [DEBUG] [MAIN ] FIHL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:32.322320] [INFO ] [MAIN ] FIHL: Generated 1807 derivative records from 40851 primary records. [2025-09-18T22:51:32.322458] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-09-18T22:51:32.344302] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1807 records). [2025-09-18T22:51:32.344471] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-09-18T22:51:32.346910] [INFO ] [MAIN ] Derivative Progress: 687/2075 symbols completed. FIHL took 1.2s. Estimated remaining: 9m 0s. Rate: 154.2 symbols/min [2025-09-18T22:51:32.347381] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:32.391195] [DEBUG] [LOCAL ] FINV: Loaded 45289 existing records from primary storage. [2025-09-18T22:51:32.391448] [INFO ] [MAIN ] FINV: Loaded 45289 primary data records. [2025-09-18T22:51:32.534357] [DEBUG] [LOCAL ] FIX: Loaded 31219 existing records from primary storage. [2025-09-18T22:51:32.540375] [INFO ] [MAIN ] FIX: Loaded 31219 primary data records. [2025-09-18T22:51:32.551523] [DEBUG] [LOCAL ] FIS: Loaded 53758 existing records from primary storage. [2025-09-18T22:51:32.577823] [INFO ] [MAIN ] FIS: Loaded 53758 primary data records. [2025-09-18T22:51:33.445666] [DEBUG] [MAIN ] FINV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:33.446905] [INFO ] [MAIN ] FINV: Generated 1807 derivative records from 45289 primary records. [2025-09-18T22:51:33.447260] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-09-18T22:51:33.466960] [DEBUG] [LOCAL ] FINV: Derivative data saved (1807 records). [2025-09-18T22:51:33.467365] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-09-18T22:51:33.469361] [INFO ] [MAIN ] Derivative Progress: 688/2075 symbols completed. FINV took 1.2s. Estimated remaining: 9m 1s. Rate: 153.8 symbols/min [2025-09-18T22:51:33.482934] [DEBUG] [MAIN ] FIX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:33.484022] [INFO ] [MAIN ] FIX: Generated 1807 derivative records from 31219 primary records. [2025-09-18T22:51:33.484203] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-09-18T22:51:33.514844] [DEBUG] [MAIN ] FIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:33.516023] [INFO ] [MAIN ] FIS: Generated 1807 derivative records from 53758 primary records. [2025-09-18T22:51:33.516349] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-09-18T22:51:33.517730] [DEBUG] [LOCAL ] FIX: Derivative data saved (1807 records). [2025-09-18T22:51:33.518091] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-09-18T22:51:33.520760] [INFO ] [MAIN ] Derivative Progress: 689/2075 symbols completed. FIX took 1.2s. Estimated remaining: 9m 0s. Rate: 153.9 symbols/min [2025-09-18T22:51:33.535756] [DEBUG] [LOCAL ] FIS: Derivative data saved (1807 records). [2025-09-18T22:51:33.535849] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-09-18T22:51:33.538285] [INFO ] [MAIN ] Derivative Progress: 690/2075 symbols completed. FIS took 1.2s. Estimated remaining: 8m 59s. Rate: 154.2 symbols/min [2025-09-18T22:51:33.539374] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:33.539295] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:33.539167] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:33.550359] [DEBUG] [LOCAL ] FLC: Loaded 5787 existing records from primary storage. [2025-09-18T22:51:33.550565] [INFO ] [MAIN ] FLC: Loaded 5787 primary data records. [2025-09-18T22:51:33.782111] [DEBUG] [LOCAL ] FLNG: Loaded 34505 existing records from primary storage. [2025-09-18T22:51:33.901978] [INFO ] [MAIN ] FLNG: Loaded 34505 primary data records. [2025-09-18T22:51:34.001025] [DEBUG] [LOCAL ] FLG: Loaded 53725 existing records from primary storage. [2025-09-18T22:51:34.024819] [INFO ] [MAIN ] FLG: Loaded 53725 primary data records. [2025-09-18T22:51:34.552945] [DEBUG] [MAIN ] FLC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:34.554674] [INFO ] [MAIN ] FLC: Generated 1807 derivative records from 5787 primary records. [2025-09-18T22:51:34.555216] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-09-18T22:51:34.572082] [DEBUG] [LOCAL ] FLC: Derivative data saved (1807 records). [2025-09-18T22:51:34.572580] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-09-18T22:51:34.576378] [INFO ] [MAIN ] Derivative Progress: 691/2075 symbols completed. FLC took 1.0s. Estimated remaining: 8m 60s. Rate: 153.8 symbols/min [2025-09-18T22:51:34.576791] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:34.597359] [DEBUG] [MAIN ] FLNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:34.598220] [INFO ] [MAIN ] FLNG: Generated 1807 derivative records from 34505 primary records. [2025-09-18T22:51:34.598342] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-09-18T22:51:34.623444] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1807 records). [2025-09-18T22:51:34.623623] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-09-18T22:51:34.630880] [INFO ] [MAIN ] Derivative Progress: 692/2075 symbols completed. FLNG took 1.1s. Estimated remaining: 8m 59s. Rate: 154.0 symbols/min [2025-09-18T22:51:34.632702] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:34.647884] [DEBUG] [MAIN ] FLG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:34.648671] [INFO ] [MAIN ] FLG: Generated 1807 derivative records from 53725 primary records. [2025-09-18T22:51:34.648772] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-09-18T22:51:34.679468] [DEBUG] [LOCAL ] FLG: Derivative data saved (1807 records). [2025-09-18T22:51:34.679608] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-09-18T22:51:34.683788] [INFO ] [MAIN ] Derivative Progress: 693/2075 symbols completed. FLG took 1.1s. Estimated remaining: 8m 58s. Rate: 154.2 symbols/min [2025-09-18T22:51:34.684332] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:34.704592] [DEBUG] [LOCAL ] FLO: Loaded 52245 existing records from primary storage. [2025-09-18T22:51:34.704978] [INFO ] [MAIN ] FLO: Loaded 52245 primary data records. [2025-09-18T22:51:35.099807] [DEBUG] [LOCAL ] FLS: Loaded 50538 existing records from primary storage. [2025-09-18T22:51:35.100292] [INFO ] [MAIN ] FLS: Loaded 50538 primary data records. [2025-09-18T22:51:35.122828] [DEBUG] [LOCAL ] FLR: Loaded 53510 existing records from primary storage. [2025-09-18T22:51:35.138336] [INFO ] [MAIN ] FLR: Loaded 53510 primary data records. [2025-09-18T22:51:35.742108] [DEBUG] [MAIN ] FLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:35.743607] [INFO ] [MAIN ] FLO: Generated 1807 derivative records from 52245 primary records. [2025-09-18T22:51:35.743934] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-09-18T22:51:35.763259] [DEBUG] [LOCAL ] FLO: Derivative data saved (1807 records). [2025-09-18T22:51:35.764518] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-09-18T22:51:35.767355] [INFO ] [MAIN ] Derivative Progress: 694/2075 symbols completed. FLO took 1.2s. Estimated remaining: 8m 59s. Rate: 153.8 symbols/min [2025-09-18T22:51:35.768492] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:35.787057] [DEBUG] [MAIN ] FLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:35.787976] [INFO ] [MAIN ] FLS: Generated 1807 derivative records from 50538 primary records. [2025-09-18T22:51:35.788064] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-09-18T22:51:35.806900] [DEBUG] [LOCAL ] FLS: Derivative data saved (1807 records). [2025-09-18T22:51:35.807128] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-09-18T22:51:35.810520] [INFO ] [MAIN ] Derivative Progress: 695/2075 symbols completed. FLS took 1.1s. Estimated remaining: 8m 58s. Rate: 154.0 symbols/min [2025-09-18T22:51:35.811031] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:35.824113] [DEBUG] [MAIN ] FLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:35.824821] [INFO ] [MAIN ] FLR: Generated 1807 derivative records from 53510 primary records. [2025-09-18T22:51:35.824998] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-09-18T22:51:35.859164] [DEBUG] [LOCAL ] FLR: Derivative data saved (1807 records). [2025-09-18T22:51:35.859346] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-09-18T22:51:35.861923] [INFO ] [MAIN ] Derivative Progress: 696/2075 symbols completed. FLR took 1.2s. Estimated remaining: 8m 57s. Rate: 154.2 symbols/min [2025-09-18T22:51:35.862343] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:35.884583] [DEBUG] [LOCAL ] FLXR: Loaded 19746 existing records from primary storage. [2025-09-18T22:51:35.885584] [DEBUG] [LOCAL ] FLUT: Loaded 51391 existing records from primary storage. [2025-09-18T22:51:35.885763] [INFO ] [MAIN ] FLXR: Loaded 19746 primary data records. [2025-09-18T22:51:35.885844] [INFO ] [MAIN ] FLUT: Loaded 51391 primary data records. [2025-09-18T22:51:36.515938] [DEBUG] [LOCAL ] FMC: Loaded 52192 existing records from primary storage. [2025-09-18T22:51:36.517512] [INFO ] [MAIN ] FMC: Loaded 52192 primary data records. [2025-09-18T22:51:36.858982] [DEBUG] [MAIN ] FLUT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:36.868213] [INFO ] [MAIN ] FLUT: Generated 1807 derivative records from 51391 primary records. [2025-09-18T22:51:36.873148] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-09-18T22:51:36.873438] [DEBUG] [MAIN ] FLXR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:36.875380] [INFO ] [MAIN ] FLXR: Generated 1807 derivative records from 19746 primary records. [2025-09-18T22:51:36.875784] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-09-18T22:51:36.904338] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1807 records). [2025-09-18T22:51:36.908494] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-09-18T22:51:36.909024] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1807 records). [2025-09-18T22:51:36.909112] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-09-18T22:51:36.911177] [INFO ] [MAIN ] Derivative Progress: 697/2075 symbols completed. FLUT took 1.1s. Estimated remaining: 8m 58s. Rate: 153.8 symbols/min [2025-09-18T22:51:36.914379] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:36.914526] [INFO ] [MAIN ] Derivative Progress: 698/2075 symbols completed. FLXR took 1.1s. Estimated remaining: 8m 56s. Rate: 154.0 symbols/min [2025-09-18T22:51:36.915668] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:36.927496] [DEBUG] [LOCAL ] FMN: Loaded 6239 existing records from primary storage. [2025-09-18T22:51:36.927869] [INFO ] [MAIN ] FMN: Loaded 6239 primary data records. [2025-09-18T22:51:37.017349] [DEBUG] [MAIN ] FMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:37.041203] [INFO ] [MAIN ] FMC: Generated 1807 derivative records from 52192 primary records. [2025-09-18T22:51:37.048867] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-09-18T22:51:37.166538] [DEBUG] [LOCAL ] FMS: Loaded 30776 existing records from primary storage. [2025-09-18T22:51:37.166982] [INFO ] [MAIN ] FMS: Loaded 30776 primary data records. [2025-09-18T22:51:37.167634] [DEBUG] [LOCAL ] FMC: Derivative data saved (1807 records). [2025-09-18T22:51:37.338846] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-09-18T22:51:37.352757] [INFO ] [MAIN ] Derivative Progress: 699/2075 symbols completed. FMC took 1.5s. Estimated remaining: 8m 56s. Rate: 154.0 symbols/min [2025-09-18T22:51:37.384167] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:37.691617] [DEBUG] [MAIN ] FMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:37.693007] [INFO ] [MAIN ] FMN: Generated 1807 derivative records from 6239 primary records. [2025-09-18T22:51:37.693179] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-09-18T22:51:37.722456] [DEBUG] [LOCAL ] FMN: Derivative data saved (1807 records). [2025-09-18T22:51:37.722696] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-09-18T22:51:37.725316] [INFO ] [MAIN ] Derivative Progress: 700/2075 symbols completed. FMN took 0.8s. Estimated remaining: 8m 56s. Rate: 154.0 symbols/min [2025-09-18T22:51:37.727136] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:37.726908] [DEBUG] [LOCAL ] FMX: Loaded 41086 existing records from primary storage. [2025-09-18T22:51:37.727472] [INFO ] [MAIN ] FMX: Loaded 41086 primary data records. [2025-09-18T22:51:37.804563] [DEBUG] [LOCAL ] FMY: Loaded 1360 existing records from primary storage. [2025-09-18T22:51:37.823447] [INFO ] [MAIN ] FMY: Loaded 1360 primary data records. [2025-09-18T22:51:37.977134] [DEBUG] [MAIN ] FMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:38.041263] [INFO ] [MAIN ] FMS: Generated 1807 derivative records from 30776 primary records. [2025-09-18T22:51:38.048920] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-09-18T22:51:38.270113] [DEBUG] [LOCAL ] FMS: Derivative data saved (1807 records). [2025-09-18T22:51:38.270895] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-09-18T22:51:38.273919] [INFO ] [MAIN ] Derivative Progress: 701/2075 symbols completed. FMS took 1.4s. Estimated remaining: 8m 56s. Rate: 153.9 symbols/min [2025-09-18T22:51:38.381547] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:38.424015] [DEBUG] [MAIN ] FMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:38.424949] [INFO ] [MAIN ] FMX: Generated 1807 derivative records from 41086 primary records. [2025-09-18T22:51:38.425314] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-09-18T22:51:38.454740] [DEBUG] [LOCAL ] FMX: Derivative data saved (1807 records). [2025-09-18T22:51:38.473685] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-09-18T22:51:38.479208] [DEBUG] [LOCAL ] FN: Loaded 40044 existing records from primary storage. [2025-09-18T22:51:38.479736] [DEBUG] [MAIN ] FMY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:38.479874] [INFO ] [MAIN ] FN: Loaded 40044 primary data records. [2025-09-18T22:51:38.481893] [INFO ] [MAIN ] Derivative Progress: 702/2075 symbols completed. FMX took 1.1s. Estimated remaining: 8m 55s. Rate: 154.0 symbols/min [2025-09-18T22:51:38.482948] [INFO ] [MAIN ] FMY: Generated 1807 derivative records from 1360 primary records. [2025-09-18T22:51:38.494291] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-09-18T22:51:38.504591] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:38.574070] [DEBUG] [LOCAL ] FMY: Derivative data saved (1807 records). [2025-09-18T22:51:38.601735] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-09-18T22:51:38.604331] [INFO ] [MAIN ] Derivative Progress: 703/2075 symbols completed. FMY took 0.9s. Estimated remaining: 8m 54s. Rate: 154.2 symbols/min [2025-09-18T22:51:38.838127] [DEBUG] [LOCAL ] FNB: Loaded 52843 existing records from primary storage. [2025-09-18T22:51:38.838408] [INFO ] [MAIN ] FNB: Loaded 52843 primary data records. [2025-09-18T22:51:38.965702] [DEBUG] [MAIN ] FN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:38.976636] [INFO ] [MAIN ] FN: Generated 1807 derivative records from 40044 primary records. [2025-09-18T22:51:39.004001] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-09-18T22:51:39.232322] [DEBUG] [LOCAL ] FN: Derivative data saved (1807 records). [2025-09-18T22:51:39.232585] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-09-18T22:51:39.234680] [INFO ] [MAIN ] Derivative Progress: 704/2075 symbols completed. FN took 1.0s. Estimated remaining: 8m 54s. Rate: 154.0 symbols/min [2025-09-18T22:51:39.260519] [DEBUG] [MAIN ] FNB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:39.261204] [INFO ] [MAIN ] FNB: Generated 1807 derivative records from 52843 primary records. [2025-09-18T22:51:39.261268] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-09-18T22:51:39.278843] [DEBUG] [LOCAL ] FNB: Derivative data saved (1807 records). [2025-09-18T22:51:39.278917] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-09-18T22:51:39.281798] [INFO ] [MAIN ] Derivative Progress: 705/2075 symbols completed. FNB took 0.8s. Estimated remaining: 8m 53s. Rate: 154.2 symbols/min [2025-09-18T22:51:39.282862] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:39.282668] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:39.282788] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:39.364578] [DEBUG] [LOCAL ] FNV: Loaded 46795 existing records from primary storage. [2025-09-18T22:51:39.364839] [INFO ] [MAIN ] FNV: Loaded 46795 primary data records. [2025-09-18T22:51:39.488531] [DEBUG] [LOCAL ] FNF: Loaded 49675 existing records from primary storage. [2025-09-18T22:51:39.506769] [INFO ] [MAIN ] FNF: Loaded 49675 primary data records. [2025-09-18T22:51:39.520486] [DEBUG] [LOCAL ] FND: Loaded 52560 existing records from primary storage. [2025-09-18T22:51:39.547530] [INFO ] [MAIN ] FND: Loaded 52560 primary data records. [2025-09-18T22:51:40.383726] [DEBUG] [MAIN ] FNV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:40.384157] [DEBUG] [MAIN ] FNF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:40.385504] [INFO ] [MAIN ] FNV: Generated 1807 derivative records from 46795 primary records. [2025-09-18T22:51:40.387239] [INFO ] [MAIN ] FNF: Generated 1807 derivative records from 49675 primary records. [2025-09-18T22:51:40.388162] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-09-18T22:51:40.388226] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-09-18T22:51:40.432673] [DEBUG] [LOCAL ] FNF: Derivative data saved (1807 records). [2025-09-18T22:51:40.432953] [DEBUG] [MAIN ] FND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:40.435763] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-09-18T22:51:40.434701] [DEBUG] [LOCAL ] FNV: Derivative data saved (1807 records). [2025-09-18T22:51:40.435669] [INFO ] [MAIN ] FND: Generated 1807 derivative records from 52560 primary records. [2025-09-18T22:51:40.436024] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-09-18T22:51:40.436089] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-09-18T22:51:40.438433] [INFO ] [MAIN ] Derivative Progress: 706/2075 symbols completed. FNV took 1.2s. Estimated remaining: 8m 54s. Rate: 153.8 symbols/min [2025-09-18T22:51:40.441599] [INFO ] [MAIN ] Derivative Progress: 707/2075 symbols completed. FNF took 1.2s. Estimated remaining: 8m 53s. Rate: 154.0 symbols/min [2025-09-18T22:51:40.442000] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:40.442190] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:40.462476] [DEBUG] [LOCAL ] FND: Derivative data saved (1807 records). [2025-09-18T22:51:40.468503] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-09-18T22:51:40.471172] [INFO ] [MAIN ] Derivative Progress: 708/2075 symbols completed. FND took 1.2s. Estimated remaining: 8m 52s. Rate: 154.2 symbols/min [2025-09-18T22:51:40.471484] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:40.482374] [DEBUG] [LOCAL ] FOF: Loaded 8432 existing records from primary storage. [2025-09-18T22:51:40.482094] [DEBUG] [LOCAL ] FOA: Loaded 13267 existing records from primary storage. [2025-09-18T22:51:40.482697] [INFO ] [MAIN ] FOF: Loaded 8432 primary data records. [2025-09-18T22:51:40.482834] [INFO ] [MAIN ] FOA: Loaded 13267 primary data records. [2025-09-18T22:51:40.716004] [DEBUG] [LOCAL ] FOR: Loaded 20451 existing records from primary storage. [2025-09-18T22:51:40.753700] [INFO ] [MAIN ] FOR: Loaded 20451 primary data records. [2025-09-18T22:51:41.481734] [DEBUG] [MAIN ] FOA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:41.482921] [INFO ] [MAIN ] FOA: Generated 1807 derivative records from 13267 primary records. [2025-09-18T22:51:41.495927] [DEBUG] [MAIN ] FOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:41.496706] [INFO ] [MAIN ] FOF: Generated 1807 derivative records from 8432 primary records. [2025-09-18T22:51:41.494810] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-09-18T22:51:41.497801] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-09-18T22:51:41.526627] [DEBUG] [LOCAL ] FOA: Derivative data saved (1807 records). [2025-09-18T22:51:41.531743] [DEBUG] [LOCAL ] FOF: Derivative data saved (1807 records). [2025-09-18T22:51:41.529178] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-09-18T22:51:41.534043] [INFO ] [MAIN ] Derivative Progress: 709/2075 symbols completed. FOA took 1.1s. Estimated remaining: 8m 53s. Rate: 153.8 symbols/min [2025-09-18T22:51:41.531928] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-09-18T22:51:41.534468] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:41.536972] [INFO ] [MAIN ] Derivative Progress: 710/2075 symbols completed. FOF took 1.1s. Estimated remaining: 8m 52s. Rate: 154.0 symbols/min [2025-09-18T22:51:41.549595] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:41.551105] [DEBUG] [MAIN ] FOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:41.552311] [INFO ] [MAIN ] FOR: Generated 1807 derivative records from 20451 primary records. [2025-09-18T22:51:41.552616] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-09-18T22:51:41.568533] [DEBUG] [LOCAL ] FOR: Derivative data saved (1807 records). [2025-09-18T22:51:41.568952] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-09-18T22:51:41.571554] [INFO ] [MAIN ] Derivative Progress: 711/2075 symbols completed. FOR took 1.1s. Estimated remaining: 8m 51s. Rate: 154.2 symbols/min [2025-09-18T22:51:41.571871] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:41.587664] [DEBUG] [LOCAL ] FPF: Loaded 17789 existing records from primary storage. [2025-09-18T22:51:41.587953] [INFO ] [MAIN ] FPF: Loaded 17789 primary data records. [2025-09-18T22:51:41.721304] [DEBUG] [LOCAL ] FPH: Loaded 19970 existing records from primary storage. [2025-09-18T22:51:41.722406] [INFO ] [MAIN ] FPH: Loaded 19970 primary data records. [2025-09-18T22:51:42.006474] [DEBUG] [LOCAL ] FOUR: Loaded 49899 existing records from primary storage. [2025-09-18T22:51:42.018200] [INFO ] [MAIN ] FOUR: Loaded 49899 primary data records. [2025-09-18T22:51:42.569209] [DEBUG] [MAIN ] FPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:42.570924] [INFO ] [MAIN ] FPF: Generated 1807 derivative records from 17789 primary records. [2025-09-18T22:51:42.571136] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-09-18T22:51:42.590466] [DEBUG] [LOCAL ] FPF: Derivative data saved (1807 records). [2025-09-18T22:51:42.603056] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-09-18T22:51:42.605392] [INFO ] [MAIN ] Derivative Progress: 712/2075 symbols completed. FPF took 1.1s. Estimated remaining: 8m 51s. Rate: 153.9 symbols/min [2025-09-18T22:51:42.606503] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:42.606093] [DEBUG] [MAIN ] FPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:42.607383] [INFO ] [MAIN ] FPH: Generated 1807 derivative records from 19970 primary records. [2025-09-18T22:51:42.607823] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-09-18T22:51:42.626771] [DEBUG] [LOCAL ] FPH: Derivative data saved (1807 records). [2025-09-18T22:51:42.627194] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-09-18T22:51:42.629260] [INFO ] [MAIN ] Derivative Progress: 713/2075 symbols completed. FPH took 1.1s. Estimated remaining: 8m 50s. Rate: 154.1 symbols/min [2025-09-18T22:51:42.641900] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:42.642503] [DEBUG] [MAIN ] FOUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:42.643419] [INFO ] [MAIN ] FOUR: Generated 1807 derivative records from 49899 primary records. [2025-09-18T22:51:42.643609] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-09-18T22:51:42.660029] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1807 records). [2025-09-18T22:51:42.660201] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-09-18T22:51:42.662756] [INFO ] [MAIN ] Derivative Progress: 714/2075 symbols completed. FOUR took 1.1s. Estimated remaining: 8m 49s. Rate: 154.3 symbols/min [2025-09-18T22:51:42.671261] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:42.685208] [DEBUG] [LOCAL ] FPI: Loaded 31537 existing records from primary storage. [2025-09-18T22:51:42.689378] [INFO ] [MAIN ] FPI: Loaded 31537 primary data records. [2025-09-18T22:51:42.815326] [DEBUG] [LOCAL ] FRA: Loaded 14867 existing records from primary storage. [2025-09-18T22:51:42.821697] [INFO ] [MAIN ] FRA: Loaded 14867 primary data records. [2025-09-18T22:51:43.007788] [DEBUG] [LOCAL ] FR: Loaded 47153 existing records from primary storage. [2025-09-18T22:51:43.145965] [INFO ] [MAIN ] FR: Loaded 47153 primary data records. [2025-09-18T22:51:43.743094] [DEBUG] [MAIN ] FPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:43.743995] [INFO ] [MAIN ] FPI: Generated 1807 derivative records from 31537 primary records. [2025-09-18T22:51:43.744290] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-09-18T22:51:43.773233] [DEBUG] [LOCAL ] FPI: Derivative data saved (1807 records). [2025-09-18T22:51:43.777965] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-09-18T22:51:43.781230] [INFO ] [MAIN ] Derivative Progress: 715/2075 symbols completed. FPI took 1.2s. Estimated remaining: 8m 50s. Rate: 153.9 symbols/min [2025-09-18T22:51:43.779090] [DEBUG] [MAIN ] FRA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:43.782995] [INFO ] [MAIN ] FRA: Generated 1807 derivative records from 14867 primary records. [2025-09-18T22:51:43.782016] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:43.783172] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-09-18T22:51:43.804716] [DEBUG] [LOCAL ] FRA: Derivative data saved (1807 records). [2025-09-18T22:51:43.804939] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-09-18T22:51:43.807583] [INFO ] [MAIN ] Derivative Progress: 716/2075 symbols completed. FRA took 1.1s. Estimated remaining: 8m 49s. Rate: 154.1 symbols/min [2025-09-18T22:51:43.808088] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:43.828069] [DEBUG] [MAIN ] FR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:43.829043] [INFO ] [MAIN ] FR: Generated 1807 derivative records from 47153 primary records. [2025-09-18T22:51:43.829180] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-09-18T22:51:43.852918] [DEBUG] [LOCAL ] FRGE: Loaded 19155 existing records from primary storage. [2025-09-18T22:51:43.853145] [INFO ] [MAIN ] FRGE: Loaded 19155 primary data records. [2025-09-18T22:51:43.852515] [DEBUG] [LOCAL ] FR: Derivative data saved (1807 records). [2025-09-18T22:51:43.864667] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-09-18T22:51:43.892676] [INFO ] [MAIN ] Derivative Progress: 717/2075 symbols completed. FR took 1.3s. Estimated remaining: 8m 48s. Rate: 154.2 symbols/min [2025-09-18T22:51:43.932280] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:44.187168] [DEBUG] [LOCAL ] FRO: Loaded 52317 existing records from primary storage. [2025-09-18T22:51:44.188194] [INFO ] [MAIN ] FRO: Loaded 52317 primary data records. [2025-09-18T22:51:44.402424] [DEBUG] [LOCAL ] FRT: Loaded 42722 existing records from primary storage. [2025-09-18T22:51:44.525267] [INFO ] [MAIN ] FRT: Loaded 42722 primary data records. [2025-09-18T22:51:44.685903] [DEBUG] [MAIN ] FRGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:44.702907] [INFO ] [MAIN ] FRGE: Generated 1807 derivative records from 19155 primary records. [2025-09-18T22:51:44.751472] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-09-18T22:51:44.899112] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1807 records). [2025-09-18T22:51:44.900244] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-09-18T22:51:44.902786] [INFO ] [MAIN ] Derivative Progress: 718/2075 symbols completed. FRGE took 1.1s. Estimated remaining: 8m 49s. Rate: 153.9 symbols/min [2025-09-18T22:51:44.915822] [DEBUG] [MAIN ] FRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:44.916583] [INFO ] [MAIN ] FRO: Generated 1807 derivative records from 52317 primary records. [2025-09-18T22:51:44.916796] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-09-18T22:51:44.934469] [DEBUG] [LOCAL ] FRO: Derivative data saved (1807 records). [2025-09-18T22:51:44.934736] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-09-18T22:51:44.936966] [INFO ] [MAIN ] Derivative Progress: 719/2075 symbols completed. FRO took 1.1s. Estimated remaining: 8m 48s. Rate: 154.1 symbols/min [2025-09-18T22:51:44.954222] [DEBUG] [MAIN ] FRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:44.954882] [INFO ] [MAIN ] FRT: Generated 1807 derivative records from 42722 primary records. [2025-09-18T22:51:44.954944] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-09-18T22:51:44.970268] [DEBUG] [LOCAL ] FRT: Derivative data saved (1807 records). [2025-09-18T22:51:44.970332] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-09-18T22:51:44.972667] [INFO ] [MAIN ] Derivative Progress: 720/2075 symbols completed. FRT took 1.1s. Estimated remaining: 8m 47s. Rate: 154.3 symbols/min [2025-09-18T22:51:44.973424] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:44.973359] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:44.973537] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:45.025507] [DEBUG] [LOCAL ] FSCO: Loaded 37079 existing records from primary storage. [2025-09-18T22:51:45.036664] [INFO ] [MAIN ] FSCO: Loaded 37079 primary data records. [2025-09-18T22:51:45.182137] [DEBUG] [LOCAL ] FSLY: Loaded 51658 existing records from primary storage. [2025-09-18T22:51:45.189208] [INFO ] [MAIN ] FSLY: Loaded 51658 primary data records. [2025-09-18T22:51:45.217404] [DEBUG] [LOCAL ] FSK: Loaded 49724 existing records from primary storage. [2025-09-18T22:51:45.232560] [INFO ] [MAIN ] FSK: Loaded 49724 primary data records. [2025-09-18T22:51:46.072516] [DEBUG] [MAIN ] FSCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:46.074831] [INFO ] [MAIN ] FSCO: Generated 1807 derivative records from 37079 primary records. [2025-09-18T22:51:46.075041] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-09-18T22:51:46.096060] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1807 records). [2025-09-18T22:51:46.104032] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-09-18T22:51:46.110744] [INFO ] [MAIN ] Derivative Progress: 721/2075 symbols completed. FSCO took 1.1s. Estimated remaining: 8m 48s. Rate: 153.9 symbols/min [2025-09-18T22:51:46.111628] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:46.112038] [DEBUG] [MAIN ] FSLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:46.114215] [INFO ] [MAIN ] FSLY: Generated 1807 derivative records from 51658 primary records. [2025-09-18T22:51:46.114322] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-09-18T22:51:46.143836] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1807 records). [2025-09-18T22:51:46.144136] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-09-18T22:51:46.142547] [DEBUG] [MAIN ] FSK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:46.146738] [INFO ] [MAIN ] Derivative Progress: 722/2075 symbols completed. FSLY took 1.2s. Estimated remaining: 8m 47s. Rate: 154.1 symbols/min [2025-09-18T22:51:46.147755] [INFO ] [MAIN ] FSK: Generated 1807 derivative records from 49724 primary records. [2025-09-18T22:51:46.148247] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:46.148179] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-09-18T22:51:46.165812] [DEBUG] [LOCAL ] FSK: Derivative data saved (1807 records). [2025-09-18T22:51:46.165992] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-09-18T22:51:46.168446] [INFO ] [MAIN ] Derivative Progress: 723/2075 symbols completed. FSK took 1.2s. Estimated remaining: 8m 46s. Rate: 154.3 symbols/min [2025-09-18T22:51:46.168752] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:46.194611] [DEBUG] [LOCAL ] FT: Loaded 6372 existing records from primary storage. [2025-09-18T22:51:46.202150] [INFO ] [MAIN ] FT: Loaded 6372 primary data records. [2025-09-18T22:51:46.331882] [DEBUG] [LOCAL ] FSS: Loaded 35240 existing records from primary storage. [2025-09-18T22:51:46.338555] [DEBUG] [LOCAL ] FSM: Loaded 53671 existing records from primary storage. [2025-09-18T22:51:46.343778] [INFO ] [MAIN ] FSM: Loaded 53671 primary data records. [2025-09-18T22:51:46.354082] [INFO ] [MAIN ] FSS: Loaded 35240 primary data records. [2025-09-18T22:51:47.221003] [DEBUG] [MAIN ] FT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:47.222329] [INFO ] [MAIN ] FT: Generated 1807 derivative records from 6372 primary records. [2025-09-18T22:51:47.222526] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-09-18T22:51:47.239359] [DEBUG] [LOCAL ] FT: Derivative data saved (1807 records). [2025-09-18T22:51:47.239633] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-09-18T22:51:47.241722] [INFO ] [MAIN ] Derivative Progress: 724/2075 symbols completed. FT took 1.1s. Estimated remaining: 8m 47s. Rate: 153.9 symbols/min [2025-09-18T22:51:47.242082] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:47.260634] [DEBUG] [MAIN ] FSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:47.264244] [INFO ] [MAIN ] FSM: Generated 1807 derivative records from 53671 primary records. [2025-09-18T22:51:47.264375] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-09-18T22:51:47.277278] [DEBUG] [MAIN ] FSS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:47.278103] [INFO ] [MAIN ] FSS: Generated 1807 derivative records from 35240 primary records. [2025-09-18T22:51:47.289303] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-09-18T22:51:47.296742] [DEBUG] [LOCAL ] FTHY: Loaded 11796 existing records from primary storage. [2025-09-18T22:51:47.306242] [DEBUG] [LOCAL ] FSM: Derivative data saved (1807 records). [2025-09-18T22:51:47.308900] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-09-18T22:51:47.306344] [INFO ] [MAIN ] FTHY: Loaded 11796 primary data records. [2025-09-18T22:51:47.312668] [INFO ] [MAIN ] Derivative Progress: 725/2075 symbols completed. FSM took 1.2s. Estimated remaining: 8m 46s. Rate: 154.1 symbols/min [2025-09-18T22:51:47.335210] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:47.418766] [DEBUG] [LOCAL ] FSS: Derivative data saved (1807 records). [2025-09-18T22:51:47.422157] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-09-18T22:51:47.424851] [INFO ] [MAIN ] Derivative Progress: 726/2075 symbols completed. FSS took 1.3s. Estimated remaining: 8m 45s. Rate: 154.2 symbols/min [2025-09-18T22:51:47.452587] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:47.670385] [DEBUG] [LOCAL ] FTI: Loaded 53693 existing records from primary storage. [2025-09-18T22:51:47.670873] [INFO ] [MAIN ] FTI: Loaded 53693 primary data records. [2025-09-18T22:51:47.774437] [DEBUG] [LOCAL ] FTK: Loaded 32184 existing records from primary storage. [2025-09-18T22:51:47.788671] [INFO ] [MAIN ] FTK: Loaded 32184 primary data records. [2025-09-18T22:51:47.857131] [DEBUG] [MAIN ] FTHY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:47.891159] [INFO ] [MAIN ] FTHY: Generated 1807 derivative records from 11796 primary records. [2025-09-18T22:51:47.908832] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-09-18T22:51:48.337996] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1807 records). [2025-09-18T22:51:48.338626] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-09-18T22:51:48.341029] [INFO ] [MAIN ] Derivative Progress: 727/2075 symbols completed. FTHY took 1.1s. Estimated remaining: 8m 45s. Rate: 153.9 symbols/min [2025-09-18T22:51:48.342377] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:48.371231] [DEBUG] [MAIN ] FTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:48.384098] [INFO ] [MAIN ] FTI: Generated 1807 derivative records from 53693 primary records. [2025-09-18T22:51:48.384587] [DEBUG] [MAIN ] FTK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:48.384330] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-09-18T22:51:48.402959] [INFO ] [MAIN ] FTK: Generated 1807 derivative records from 32184 primary records. [2025-09-18T22:51:48.406591] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-09-18T22:51:48.411477] [DEBUG] [LOCAL ] FTI: Derivative data saved (1807 records). [2025-09-18T22:51:48.411582] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-09-18T22:51:48.413860] [INFO ] [MAIN ] Derivative Progress: 728/2075 symbols completed. FTI took 1.1s. Estimated remaining: 8m 44s. Rate: 154.1 symbols/min [2025-09-18T22:51:48.421740] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:48.430314] [DEBUG] [LOCAL ] FTK: Derivative data saved (1807 records). [2025-09-18T22:51:48.430504] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-09-18T22:51:48.443145] [INFO ] [MAIN ] Derivative Progress: 729/2075 symbols completed. FTK took 1.0s. Estimated remaining: 8m 43s. Rate: 154.3 symbols/min [2025-09-18T22:51:48.445130] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:48.446298] [DEBUG] [LOCAL ] FTS: Loaded 42466 existing records from primary storage. [2025-09-18T22:51:48.446757] [INFO ] [MAIN ] FTS: Loaded 42466 primary data records. [2025-09-18T22:51:48.532239] [DEBUG] [LOCAL ] FTWO: Loaded 1804 existing records from primary storage. [2025-09-18T22:51:48.554667] [INFO ] [MAIN ] FTWO: Loaded 1804 primary data records. [2025-09-18T22:51:48.971027] [DEBUG] [LOCAL ] FTV: Loaded 53286 existing records from primary storage. [2025-09-18T22:51:48.977700] [INFO ] [MAIN ] FTV: Loaded 53286 primary data records. [2025-09-18T22:51:49.482034] [DEBUG] [MAIN ] FTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:49.483626] [INFO ] [MAIN ] FTS: Generated 1807 derivative records from 42466 primary records. [2025-09-18T22:51:49.483936] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-09-18T22:51:49.501938] [DEBUG] [LOCAL ] FTS: Derivative data saved (1807 records). [2025-09-18T22:51:49.502148] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-09-18T22:51:49.505241] [INFO ] [MAIN ] Derivative Progress: 730/2075 symbols completed. FTS took 1.2s. Estimated remaining: 8m 44s. Rate: 153.9 symbols/min [2025-09-18T22:51:49.505858] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:49.523325] [DEBUG] [MAIN ] FTWO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:51:49.524345] [INFO ] [MAIN ] FTWO: Generated 1806 derivative records from 1804 primary records. [2025-09-18T22:51:49.524601] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-09-18T22:51:49.539336] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1806 records). [2025-09-18T22:51:49.539557] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-09-18T22:51:49.541854] [INFO ] [MAIN ] Derivative Progress: 731/2075 symbols completed. FTWO took 1.1s. Estimated remaining: 8m 43s. Rate: 154.1 symbols/min [2025-09-18T22:51:49.542347] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:49.558677] [DEBUG] [MAIN ] FTV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:49.559370] [INFO ] [MAIN ] FTV: Generated 1807 derivative records from 53286 primary records. [2025-09-18T22:51:49.559510] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-09-18T22:51:49.589884] [DEBUG] [LOCAL ] FTV: Derivative data saved (1807 records). [2025-09-18T22:51:49.590050] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-09-18T22:51:49.592671] [INFO ] [MAIN ] Derivative Progress: 732/2075 symbols completed. FTV took 1.2s. Estimated remaining: 8m 42s. Rate: 154.3 symbols/min [2025-09-18T22:51:49.593618] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:49.617446] [DEBUG] [LOCAL ] FUBO: Loaded 54089 existing records from primary storage. [2025-09-18T22:51:49.617713] [INFO ] [MAIN ] FUBO: Loaded 54089 primary data records. [2025-09-18T22:51:49.732218] [DEBUG] [LOCAL ] FUL: Loaded 33281 existing records from primary storage. [2025-09-18T22:51:49.758348] [INFO ] [MAIN ] FUL: Loaded 33281 primary data records. [2025-09-18T22:51:50.139973] [DEBUG] [LOCAL ] FUN: Loaded 51913 existing records from primary storage. [2025-09-18T22:51:50.141098] [INFO ] [MAIN ] FUN: Loaded 51913 primary data records. [2025-09-18T22:51:50.578829] [DEBUG] [MAIN ] FUBO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:50.579943] [INFO ] [MAIN ] FUBO: Generated 1807 derivative records from 54089 primary records. [2025-09-18T22:51:50.580048] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-09-18T22:51:50.600488] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1807 records). [2025-09-18T22:51:50.601410] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-09-18T22:51:50.603361] [INFO ] [MAIN ] Derivative Progress: 733/2075 symbols completed. FUBO took 1.1s. Estimated remaining: 8m 43s. Rate: 154.0 symbols/min [2025-09-18T22:51:50.618579] [DEBUG] [MAIN ] FUL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:50.619418] [INFO ] [MAIN ] FUL: Generated 1807 derivative records from 33281 primary records. [2025-09-18T22:51:50.619583] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-09-18T22:51:50.636863] [DEBUG] [LOCAL ] FUL: Derivative data saved (1807 records). [2025-09-18T22:51:50.636974] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-09-18T22:51:50.639311] [INFO ] [MAIN ] Derivative Progress: 734/2075 symbols completed. FUL took 1.1s. Estimated remaining: 8m 42s. Rate: 154.2 symbols/min [2025-09-18T22:51:50.654204] [DEBUG] [MAIN ] FUN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:50.654752] [INFO ] [MAIN ] FUN: Generated 1807 derivative records from 51913 primary records. [2025-09-18T22:51:50.654836] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-09-18T22:51:50.670595] [DEBUG] [LOCAL ] FUN: Derivative data saved (1807 records). [2025-09-18T22:51:50.670686] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-09-18T22:51:50.673251] [INFO ] [MAIN ] Derivative Progress: 735/2075 symbols completed. FUN took 1.1s. Estimated remaining: 8m 41s. Rate: 154.4 symbols/min [2025-09-18T22:51:50.674216] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:50.674110] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:50.674045] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:50.678666] [DEBUG] [LOCAL ] FXED: Loaded 1218 existing records from primary storage. [2025-09-18T22:51:50.678890] [INFO ] [MAIN ] FXED: Loaded 1218 primary data records. [2025-09-18T22:51:50.874310] [DEBUG] [LOCAL ] FVR: Loaded 22106 existing records from primary storage. [2025-09-18T22:51:50.897115] [INFO ] [MAIN ] FVR: Loaded 22106 primary data records. [2025-09-18T22:51:51.109768] [DEBUG] [LOCAL ] FVRR: Loaded 40480 existing records from primary storage. [2025-09-18T22:51:51.137146] [INFO ] [MAIN ] FVRR: Loaded 40480 primary data records. [2025-09-18T22:51:51.725336] [DEBUG] [MAIN ] FXED: Filtered 6966 bins outside market hours, 7764 incomplete bins [2025-09-18T22:51:51.727060] [INFO ] [MAIN ] FXED: Generated 1802 derivative records from 1218 primary records. [2025-09-18T22:51:51.727554] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-09-18T22:51:51.744637] [DEBUG] [LOCAL ] FXED: Derivative data saved (1802 records). [2025-09-18T22:51:51.745042] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-09-18T22:51:51.748097] [INFO ] [MAIN ] Derivative Progress: 736/2075 symbols completed. FXED took 1.1s. Estimated remaining: 8m 42s. Rate: 154.0 symbols/min [2025-09-18T22:51:51.748556] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:51.768803] [DEBUG] [MAIN ] FVR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:51:51.769803] [INFO ] [MAIN ] FVR: Generated 1806 derivative records from 22106 primary records. [2025-09-18T22:51:51.769931] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-09-18T22:51:51.787949] [DEBUG] [LOCAL ] FVR: Derivative data saved (1806 records). [2025-09-18T22:51:51.789900] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-09-18T22:51:51.792502] [INFO ] [MAIN ] Derivative Progress: 737/2075 symbols completed. FVR took 1.1s. Estimated remaining: 8m 41s. Rate: 154.2 symbols/min [2025-09-18T22:51:51.792892] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:51.807047] [DEBUG] [MAIN ] FVRR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:51.807884] [INFO ] [MAIN ] FVRR: Generated 1807 derivative records from 40480 primary records. [2025-09-18T22:51:51.808032] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-09-18T22:51:51.844102] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1807 records). [2025-09-18T22:51:51.859350] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-09-18T22:51:51.862262] [INFO ] [MAIN ] Derivative Progress: 738/2075 symbols completed. FVRR took 1.2s. Estimated remaining: 8m 40s. Rate: 154.4 symbols/min [2025-09-18T22:51:51.862700] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:51.864074] [DEBUG] [LOCAL ] G: Loaded 50126 existing records from primary storage. [2025-09-18T22:51:51.864687] [INFO ] [MAIN ] G: Loaded 50126 primary data records. [2025-09-18T22:51:51.953872] [DEBUG] [LOCAL ] GAB: Loaded 27996 existing records from primary storage. [2025-09-18T22:51:51.966978] [INFO ] [MAIN ] GAB: Loaded 27996 primary data records. [2025-09-18T22:51:51.996170] [DEBUG] [LOCAL ] GAM: Loaded 4390 existing records from primary storage. [2025-09-18T22:51:52.001417] [INFO ] [MAIN ] GAM: Loaded 4390 primary data records. [2025-09-18T22:51:52.853077] [DEBUG] [MAIN ] G: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:52.854307] [INFO ] [MAIN ] G: Generated 1807 derivative records from 50126 primary records. [2025-09-18T22:51:52.854726] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-09-18T22:51:52.876957] [DEBUG] [LOCAL ] G: Derivative data saved (1807 records). [2025-09-18T22:51:52.884976] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-09-18T22:51:52.904856] [INFO ] [MAIN ] Derivative Progress: 739/2075 symbols completed. G took 1.2s. Estimated remaining: 8m 41s. Rate: 154.0 symbols/min [2025-09-18T22:51:52.906320] [DEBUG] [MAIN ] GAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:52.906050] [DEBUG] [MAIN ] GAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:52.906740] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:52.908172] [INFO ] [MAIN ] GAB: Generated 1807 derivative records from 27996 primary records. [2025-09-18T22:51:52.907477] [INFO ] [MAIN ] GAM: Generated 1807 derivative records from 4390 primary records. [2025-09-18T22:51:52.908451] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-09-18T22:51:52.909044] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-09-18T22:51:52.940151] [DEBUG] [LOCAL ] GAB: Derivative data saved (1807 records). [2025-09-18T22:51:52.942900] [DEBUG] [LOCAL ] GAM: Derivative data saved (1807 records). [2025-09-18T22:51:52.942991] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-09-18T22:51:52.942286] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-09-18T22:51:52.945738] [INFO ] [MAIN ] Derivative Progress: 740/2075 symbols completed. GAB took 1.2s. Estimated remaining: 8m 40s. Rate: 154.2 symbols/min [2025-09-18T22:51:52.948894] [INFO ] [MAIN ] Derivative Progress: 741/2075 symbols completed. GAM took 1.1s. Estimated remaining: 8m 38s. Rate: 154.4 symbols/min [2025-09-18T22:51:52.948827] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:52.949318] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:52.971571] [DEBUG] [LOCAL ] GBAB: Loaded 13156 existing records from primary storage. [2025-09-18T22:51:52.971765] [INFO ] [MAIN ] GBAB: Loaded 13156 primary data records. [2025-09-18T22:51:53.065981] [DEBUG] [LOCAL ] GATX: Loaded 18177 existing records from primary storage. [2025-09-18T22:51:53.095300] [INFO ] [MAIN ] GATX: Loaded 18177 primary data records. [2025-09-18T22:51:53.214608] [DEBUG] [LOCAL ] GAP: Loaded 54045 existing records from primary storage. [2025-09-18T22:51:53.269998] [INFO ] [MAIN ] GAP: Loaded 54045 primary data records. [2025-09-18T22:51:54.003873] [DEBUG] [MAIN ] GBAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:54.004924] [INFO ] [MAIN ] GBAB: Generated 1807 derivative records from 13156 primary records. [2025-09-18T22:51:54.005163] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-09-18T22:51:54.037312] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1807 records). [2025-09-18T22:51:54.035695] [DEBUG] [MAIN ] GATX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:54.037487] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-09-18T22:51:54.039521] [INFO ] [MAIN ] Derivative Progress: 742/2075 symbols completed. GBAB took 1.1s. Estimated remaining: 8m 39s. Rate: 154.0 symbols/min [2025-09-18T22:51:54.040482] [INFO ] [MAIN ] GATX: Generated 1807 derivative records from 18177 primary records. [2025-09-18T22:51:54.041129] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-09-18T22:51:54.041215] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:54.061083] [DEBUG] [LOCAL ] GATX: Derivative data saved (1807 records). [2025-09-18T22:51:54.061446] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-09-18T22:51:54.063949] [INFO ] [MAIN ] Derivative Progress: 743/2075 symbols completed. GATX took 1.1s. Estimated remaining: 8m 38s. Rate: 154.2 symbols/min [2025-09-18T22:51:54.077079] [DEBUG] [MAIN ] GAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:54.077891] [INFO ] [MAIN ] GAP: Generated 1807 derivative records from 54045 primary records. [2025-09-18T22:51:54.076780] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:54.078378] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-09-18T22:51:54.095975] [DEBUG] [LOCAL ] GAP: Derivative data saved (1807 records). [2025-09-18T22:51:54.096272] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-09-18T22:51:54.098878] [INFO ] [MAIN ] Derivative Progress: 744/2075 symbols completed. GAP took 1.2s. Estimated remaining: 8m 37s. Rate: 154.4 symbols/min [2025-09-18T22:51:54.099205] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:54.138474] [DEBUG] [LOCAL ] GBCI: Loaded 40386 existing records from primary storage. [2025-09-18T22:51:54.148673] [INFO ] [MAIN ] GBCI: Loaded 40386 primary data records. [2025-09-18T22:51:54.192138] [DEBUG] [LOCAL ] GBTG: Loaded 41003 existing records from primary storage. [2025-09-18T22:51:54.232283] [INFO ] [MAIN ] GBTG: Loaded 41003 primary data records. [2025-09-18T22:51:54.341239] [DEBUG] [LOCAL ] GBX: Loaded 29724 existing records from primary storage. [2025-09-18T22:51:54.372684] [INFO ] [MAIN ] GBX: Loaded 29724 primary data records. [2025-09-18T22:51:55.198766] [DEBUG] [MAIN ] GBCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:55.199888] [INFO ] [MAIN ] GBCI: Generated 1807 derivative records from 40386 primary records. [2025-09-18T22:51:55.202697] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-09-18T22:51:55.234436] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1807 records). [2025-09-18T22:51:55.234701] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-09-18T22:51:55.236874] [INFO ] [MAIN ] Derivative Progress: 745/2075 symbols completed. GBCI took 1.2s. Estimated remaining: 8m 38s. Rate: 154.0 symbols/min [2025-09-18T22:51:55.238241] [DEBUG] [MAIN ] GBTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:55.238502] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:55.239577] [INFO ] [MAIN ] GBTG: Generated 1807 derivative records from 41003 primary records. [2025-09-18T22:51:55.240875] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-09-18T22:51:55.262622] [DEBUG] [MAIN ] GBX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:55.268363] [INFO ] [MAIN ] GBX: Generated 1807 derivative records from 29724 primary records. [2025-09-18T22:51:55.268769] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-09-18T22:51:55.286713] [DEBUG] [LOCAL ] GBX: Derivative data saved (1807 records). [2025-09-18T22:51:55.288231] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1807 records). [2025-09-18T22:51:55.288395] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-09-18T22:51:55.288477] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-09-18T22:51:55.291202] [INFO ] [MAIN ] Derivative Progress: 746/2075 symbols completed. GBX took 1.2s. Estimated remaining: 8m 37s. Rate: 154.2 symbols/min [2025-09-18T22:51:55.294979] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:55.294880] [INFO ] [MAIN ] Derivative Progress: 747/2075 symbols completed. GBTG took 1.2s. Estimated remaining: 8m 36s. Rate: 154.4 symbols/min [2025-09-18T22:51:55.295435] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:55.341600] [DEBUG] [LOCAL ] GCI: Loaded 44615 existing records from primary storage. [2025-09-18T22:51:55.349171] [INFO ] [MAIN ] GCI: Loaded 44615 primary data records. [2025-09-18T22:51:55.349064] [DEBUG] [LOCAL ] GCTS: Loaded 19626 existing records from primary storage. [2025-09-18T22:51:55.349516] [INFO ] [MAIN ] GCTS: Loaded 19626 primary data records. [2025-09-18T22:51:55.467077] [DEBUG] [LOCAL ] GCO: Loaded 26118 existing records from primary storage. [2025-09-18T22:51:55.487018] [INFO ] [MAIN ] GCO: Loaded 26118 primary data records. [2025-09-18T22:51:56.341285] [DEBUG] [MAIN ] GCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:56.344081] [INFO ] [MAIN ] GCI: Generated 1807 derivative records from 44615 primary records. [2025-09-18T22:51:56.345114] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-09-18T22:51:56.385186] [DEBUG] [MAIN ] GCTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:56.389384] [INFO ] [MAIN ] GCTS: Generated 1807 derivative records from 19626 primary records. [2025-09-18T22:51:56.389730] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-09-18T22:51:56.390047] [DEBUG] [MAIN ] GCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:56.391474] [DEBUG] [LOCAL ] GCI: Derivative data saved (1807 records). [2025-09-18T22:51:56.399817] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-09-18T22:51:56.402542] [INFO ] [MAIN ] Derivative Progress: 748/2075 symbols completed. GCI took 1.2s. Estimated remaining: 8m 37s. Rate: 154.0 symbols/min [2025-09-18T22:51:56.399678] [INFO ] [MAIN ] GCO: Generated 1807 derivative records from 26118 primary records. [2025-09-18T22:51:56.409197] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-09-18T22:51:56.410273] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1807 records). [2025-09-18T22:51:56.410372] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-09-18T22:51:56.413467] [INFO ] [MAIN ] Derivative Progress: 749/2075 symbols completed. GCTS took 1.1s. Estimated remaining: 8m 36s. Rate: 154.2 symbols/min [2025-09-18T22:51:56.429706] [DEBUG] [LOCAL ] GCO: Derivative data saved (1807 records). [2025-09-18T22:51:56.429775] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-09-18T22:51:56.432479] [INFO ] [MAIN ] Derivative Progress: 750/2075 symbols completed. GCO took 1.1s. Estimated remaining: 8m 35s. Rate: 154.4 symbols/min [2025-09-18T22:51:56.433138] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:56.433390] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:56.433283] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:56.445475] [DEBUG] [LOCAL ] GCV: Loaded 7097 existing records from primary storage. [2025-09-18T22:51:56.445633] [INFO ] [MAIN ] GCV: Loaded 7097 primary data records. [2025-09-18T22:51:56.792158] [DEBUG] [LOCAL ] GD: Loaded 47822 existing records from primary storage. [2025-09-18T22:51:56.792526] [INFO ] [MAIN ] GD: Loaded 47822 primary data records. [2025-09-18T22:51:56.862483] [DEBUG] [LOCAL ] GDDY: Loaded 50203 existing records from primary storage. [2025-09-18T22:51:56.877171] [INFO ] [MAIN ] GDDY: Loaded 50203 primary data records. [2025-09-18T22:51:57.494886] [DEBUG] [MAIN ] GCV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:57.498002] [INFO ] [MAIN ] GCV: Generated 1807 derivative records from 7097 primary records. [2025-09-18T22:51:57.498892] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-09-18T22:51:57.518684] [DEBUG] [LOCAL ] GCV: Derivative data saved (1807 records). [2025-09-18T22:51:57.520019] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-09-18T22:51:57.523272] [INFO ] [MAIN ] Derivative Progress: 751/2075 symbols completed. GCV took 1.1s. Estimated remaining: 8m 36s. Rate: 154.0 symbols/min [2025-09-18T22:51:57.524177] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:57.533877] [DEBUG] [LOCAL ] GDIV: Loaded 3803 existing records from primary storage. [2025-09-18T22:51:57.535978] [INFO ] [MAIN ] GDIV: Loaded 3803 primary data records. [2025-09-18T22:51:57.627369] [DEBUG] [MAIN ] GD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:57.641239] [INFO ] [MAIN ] GD: Generated 1807 derivative records from 47822 primary records. [2025-09-18T22:51:57.673768] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-09-18T22:51:57.659428] [DEBUG] [MAIN ] GDDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:57.675412] [INFO ] [MAIN ] GDDY: Generated 1807 derivative records from 50203 primary records. [2025-09-18T22:51:57.675537] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-09-18T22:51:57.901919] [DEBUG] [LOCAL ] GD: Derivative data saved (1807 records). [2025-09-18T22:51:57.903525] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-09-18T22:51:57.907005] [INFO ] [MAIN ] Derivative Progress: 752/2075 symbols completed. GD took 1.5s. Estimated remaining: 8m 35s. Rate: 154.0 symbols/min [2025-09-18T22:51:57.904880] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1807 records). [2025-09-18T22:51:57.907347] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-09-18T22:51:57.910287] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:57.910522] [INFO ] [MAIN ] Derivative Progress: 753/2075 symbols completed. GDDY took 1.5s. Estimated remaining: 8m 34s. Rate: 154.2 symbols/min [2025-09-18T22:51:57.911456] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:57.922138] [DEBUG] [LOCAL ] GDO: Loaded 6087 existing records from primary storage. [2025-09-18T22:51:57.922313] [INFO ] [MAIN ] GDO: Loaded 6087 primary data records. [2025-09-18T22:51:58.267966] [DEBUG] [LOCAL ] GDOT: Loaded 38970 existing records from primary storage. [2025-09-18T22:51:58.267048] [DEBUG] [MAIN ] GDIV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:51:58.268264] [INFO ] [MAIN ] GDOT: Loaded 38970 primary data records. [2025-09-18T22:51:58.269316] [INFO ] [MAIN ] GDIV: Generated 1806 derivative records from 3803 primary records. [2025-09-18T22:51:58.291072] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-09-18T22:51:58.475160] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1806 records). [2025-09-18T22:51:58.475344] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-09-18T22:51:58.478059] [INFO ] [MAIN ] Derivative Progress: 754/2075 symbols completed. GDIV took 1.0s. Estimated remaining: 8m 34s. Rate: 154.1 symbols/min [2025-09-18T22:51:58.599849] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:58.622184] [DEBUG] [MAIN ] GDO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:58.623394] [INFO ] [MAIN ] GDO: Generated 1807 derivative records from 6087 primary records. [2025-09-18T22:51:58.623701] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-09-18T22:51:58.652702] [DEBUG] [LOCAL ] GDO: Derivative data saved (1807 records). [2025-09-18T22:51:58.653294] [DEBUG] [LOCAL ] GDV: Loaded 20129 existing records from primary storage. [2025-09-18T22:51:58.653434] [INFO ] [MAIN ] GDV: Loaded 20129 primary data records. [2025-09-18T22:51:58.653614] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-09-18T22:51:58.656323] [INFO ] [MAIN ] Derivative Progress: 755/2075 symbols completed. GDO took 0.7s. Estimated remaining: 8m 33s. Rate: 154.3 symbols/min [2025-09-18T22:51:58.656819] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:58.868110] [DEBUG] [MAIN ] GDOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:58.995247] [INFO ] [MAIN ] GDOT: Generated 1807 derivative records from 38970 primary records. [2025-09-18T22:51:58.995438] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-09-18T22:51:59.029817] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1807 records). [2025-09-18T22:51:59.030430] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-09-18T22:51:59.033205] [INFO ] [MAIN ] Derivative Progress: 756/2075 symbols completed. GDOT took 1.1s. Estimated remaining: 8m 33s. Rate: 154.3 symbols/min [2025-09-18T22:51:59.034145] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:59.056299] [DEBUG] [LOCAL ] GE: Loaded 54103 existing records from primary storage. [2025-09-18T22:51:59.057029] [INFO ] [MAIN ] GE: Loaded 54103 primary data records. [2025-09-18T22:51:59.192717] [DEBUG] [LOCAL ] GEF: Loaded 20905 existing records from primary storage. [2025-09-18T22:51:59.204720] [INFO ] [MAIN ] GEF: Loaded 20905 primary data records. [2025-09-18T22:51:59.510336] [DEBUG] [MAIN ] GDV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:59.523082] [INFO ] [MAIN ] GDV: Generated 1807 derivative records from 20129 primary records. [2025-09-18T22:51:59.540798] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-09-18T22:51:59.637484] [DEBUG] [LOCAL ] GDV: Derivative data saved (1807 records). [2025-09-18T22:51:59.637869] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-09-18T22:51:59.757520] [INFO ] [MAIN ] Derivative Progress: 757/2075 symbols completed. GDV took 1.2s. Estimated remaining: 8m 33s. Rate: 154.1 symbols/min [2025-09-18T22:51:59.758628] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:59.783582] [DEBUG] [MAIN ] GE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:59.784459] [INFO ] [MAIN ] GE: Generated 1807 derivative records from 54103 primary records. [2025-09-18T22:51:59.784691] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-09-18T22:51:59.810553] [DEBUG] [LOCAL ] GE: Derivative data saved (1807 records). [2025-09-18T22:51:59.811318] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-09-18T22:51:59.813935] [INFO ] [MAIN ] Derivative Progress: 758/2075 symbols completed. GE took 1.2s. Estimated remaining: 8m 32s. Rate: 154.3 symbols/min [2025-09-18T22:51:59.815227] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:51:59.828781] [DEBUG] [LOCAL ] GEL: Loaded 34789 existing records from primary storage. [2025-09-18T22:51:59.829176] [INFO ] [MAIN ] GEL: Loaded 34789 primary data records. [2025-09-18T22:51:59.906381] [DEBUG] [MAIN ] GEF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:51:59.930067] [INFO ] [MAIN ] GEF: Generated 1807 derivative records from 20905 primary records. [2025-09-18T22:51:59.943423] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-09-18T22:52:00.057571] [DEBUG] [LOCAL ] GEF: Derivative data saved (1807 records). [2025-09-18T22:52:00.174064] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-09-18T22:52:00.176698] [INFO ] [MAIN ] Derivative Progress: 759/2075 symbols completed. GEF took 1.1s. Estimated remaining: 8m 32s. Rate: 154.3 symbols/min [2025-09-18T22:52:00.177165] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:00.196937] [DEBUG] [LOCAL ] GENI: Loaded 53304 existing records from primary storage. [2025-09-18T22:52:00.197435] [INFO ] [MAIN ] GENI: Loaded 53304 primary data records. [2025-09-18T22:52:00.540707] [DEBUG] [LOCAL ] GEO: Loaded 52604 existing records from primary storage. [2025-09-18T22:52:00.541846] [INFO ] [MAIN ] GEO: Loaded 52604 primary data records. [2025-09-18T22:52:00.667421] [DEBUG] [MAIN ] GEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:00.669143] [INFO ] [MAIN ] GEL: Generated 1807 derivative records from 34789 primary records. [2025-09-18T22:52:00.669687] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-09-18T22:52:00.889869] [DEBUG] [LOCAL ] GEL: Derivative data saved (1807 records). [2025-09-18T22:52:00.890086] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-09-18T22:52:00.892811] [INFO ] [MAIN ] Derivative Progress: 760/2075 symbols completed. GEL took 1.1s. Estimated remaining: 8m 32s. Rate: 154.1 symbols/min [2025-09-18T22:52:00.905367] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:00.906009] [DEBUG] [MAIN ] GENI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:00.906846] [INFO ] [MAIN ] GENI: Generated 1807 derivative records from 53304 primary records. [2025-09-18T22:52:00.907280] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-09-18T22:52:00.925575] [DEBUG] [LOCAL ] GENI: Derivative data saved (1807 records). [2025-09-18T22:52:00.925810] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-09-18T22:52:00.928619] [INFO ] [MAIN ] Derivative Progress: 761/2075 symbols completed. GENI took 1.1s. Estimated remaining: 8m 31s. Rate: 154.3 symbols/min [2025-09-18T22:52:00.929166] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:00.950880] [DEBUG] [MAIN ] GEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:00.951606] [INFO ] [MAIN ] GEO: Generated 1807 derivative records from 52604 primary records. [2025-09-18T22:52:00.951793] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-09-18T22:52:00.985776] [DEBUG] [LOCAL ] GEO: Derivative data saved (1807 records). [2025-09-18T22:52:00.985886] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-09-18T22:52:00.988317] [INFO ] [MAIN ] Derivative Progress: 762/2075 symbols completed. GEO took 0.8s. Estimated remaining: 8m 30s. Rate: 154.5 symbols/min [2025-09-18T22:52:00.989413] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:01.002355] [DEBUG] [LOCAL ] GES: Loaded 40812 existing records from primary storage. [2025-09-18T22:52:01.002555] [INFO ] [MAIN ] GES: Loaded 40812 primary data records. [2025-09-18T22:52:01.100073] [DEBUG] [LOCAL ] GETY: Loaded 36644 existing records from primary storage. [2025-09-18T22:52:01.113389] [INFO ] [MAIN ] GETY: Loaded 36644 primary data records. [2025-09-18T22:52:01.671317] [DEBUG] [LOCAL ] GEV: Loaded 53548 existing records from primary storage. [2025-09-18T22:52:01.679878] [INFO ] [MAIN ] GEV: Loaded 53548 primary data records. [2025-09-18T22:52:02.017811] [DEBUG] [MAIN ] GES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:02.019523] [INFO ] [MAIN ] GES: Generated 1807 derivative records from 40812 primary records. [2025-09-18T22:52:02.019762] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-09-18T22:52:02.041839] [DEBUG] [LOCAL ] GES: Derivative data saved (1807 records). [2025-09-18T22:52:02.054861] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-09-18T22:52:02.055338] [DEBUG] [MAIN ] GETY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:02.058439] [INFO ] [MAIN ] GETY: Generated 1807 derivative records from 36644 primary records. [2025-09-18T22:52:02.058686] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-09-18T22:52:02.057592] [INFO ] [MAIN ] Derivative Progress: 763/2075 symbols completed. GES took 1.2s. Estimated remaining: 8m 31s. Rate: 154.1 symbols/min [2025-09-18T22:52:02.077043] [DEBUG] [LOCAL ] GETY: Derivative data saved (1807 records). [2025-09-18T22:52:02.077861] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-09-18T22:52:02.080364] [INFO ] [MAIN ] Derivative Progress: 764/2075 symbols completed. GETY took 1.2s. Estimated remaining: 8m 30s. Rate: 154.3 symbols/min [2025-09-18T22:52:02.092873] [DEBUG] [MAIN ] GEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:02.093425] [INFO ] [MAIN ] GEV: Generated 1807 derivative records from 53548 primary records. [2025-09-18T22:52:02.093484] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-09-18T22:52:02.109091] [DEBUG] [LOCAL ] GEV: Derivative data saved (1807 records). [2025-09-18T22:52:02.109152] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-09-18T22:52:02.111381] [INFO ] [MAIN ] Derivative Progress: 765/2075 symbols completed. GEV took 1.1s. Estimated remaining: 8m 29s. Rate: 154.5 symbols/min [2025-09-18T22:52:02.112258] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:02.112331] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:02.112523] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:02.120012] [DEBUG] [LOCAL ] GF: Loaded 3516 existing records from primary storage. [2025-09-18T22:52:02.120236] [INFO ] [MAIN ] GF: Loaded 3516 primary data records. [2025-09-18T22:52:02.328177] [DEBUG] [LOCAL ] GFF: Loaded 31421 existing records from primary storage. [2025-09-18T22:52:02.460399] [INFO ] [MAIN ] GFF: Loaded 31421 primary data records. [2025-09-18T22:52:02.585798] [DEBUG] [LOCAL ] GFI: Loaded 53483 existing records from primary storage. [2025-09-18T22:52:02.625351] [INFO ] [MAIN ] GFI: Loaded 53483 primary data records. [2025-09-18T22:52:03.109870] [DEBUG] [MAIN ] GF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:03.111315] [INFO ] [MAIN ] GF: Generated 1807 derivative records from 3516 primary records. [2025-09-18T22:52:03.111550] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-09-18T22:52:03.128473] [DEBUG] [LOCAL ] GF: Derivative data saved (1807 records). [2025-09-18T22:52:03.130456] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-09-18T22:52:03.133417] [INFO ] [MAIN ] Derivative Progress: 766/2075 symbols completed. GF took 1.0s. Estimated remaining: 8m 30s. Rate: 154.2 symbols/min [2025-09-18T22:52:03.134086] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:03.148041] [DEBUG] [MAIN ] GFF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:03.149084] [INFO ] [MAIN ] GFF: Generated 1807 derivative records from 31421 primary records. [2025-09-18T22:52:03.149329] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-09-18T22:52:03.181855] [DEBUG] [LOCAL ] GFF: Derivative data saved (1807 records). [2025-09-18T22:52:03.181731] [DEBUG] [MAIN ] GFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:03.182006] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-09-18T22:52:03.185136] [INFO ] [MAIN ] Derivative Progress: 767/2075 symbols completed. GFF took 1.1s. Estimated remaining: 8m 29s. Rate: 154.3 symbols/min [2025-09-18T22:52:03.185368] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:03.182783] [INFO ] [MAIN ] GFI: Generated 1807 derivative records from 53483 primary records. [2025-09-18T22:52:03.185632] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-09-18T22:52:03.217607] [DEBUG] [LOCAL ] GFR: Loaded 8593 existing records from primary storage. [2025-09-18T22:52:03.218933] [INFO ] [MAIN ] GFR: Loaded 8593 primary data records. [2025-09-18T22:52:03.263721] [DEBUG] [LOCAL ] GFI: Derivative data saved (1807 records). [2025-09-18T22:52:03.284943] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-09-18T22:52:03.310221] [INFO ] [MAIN ] Derivative Progress: 768/2075 symbols completed. GFI took 1.2s. Estimated remaining: 8m 28s. Rate: 154.5 symbols/min [2025-09-18T22:52:03.324493] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:03.341630] [DEBUG] [LOCAL ] GFL: Loaded 48534 existing records from primary storage. [2025-09-18T22:52:03.342177] [INFO ] [MAIN ] GFL: Loaded 48534 primary data records. [2025-09-18T22:52:03.905810] [DEBUG] [LOCAL ] GGB: Loaded 51382 existing records from primary storage. [2025-09-18T22:52:03.908033] [INFO ] [MAIN ] GGB: Loaded 51382 primary data records. [2025-09-18T22:52:04.248601] [DEBUG] [MAIN ] GFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:04.250256] [INFO ] [MAIN ] GFR: Generated 1807 derivative records from 8593 primary records. [2025-09-18T22:52:04.250542] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-09-18T22:52:04.271555] [DEBUG] [LOCAL ] GFR: Derivative data saved (1807 records). [2025-09-18T22:52:04.291523] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-09-18T22:52:04.294320] [INFO ] [MAIN ] Derivative Progress: 769/2075 symbols completed. GFR took 1.1s. Estimated remaining: 8m 28s. Rate: 154.2 symbols/min [2025-09-18T22:52:04.292119] [DEBUG] [MAIN ] GFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:04.294695] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:04.297323] [INFO ] [MAIN ] GFL: Generated 1807 derivative records from 48534 primary records. [2025-09-18T22:52:04.298774] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-09-18T22:52:04.316332] [DEBUG] [LOCAL ] GFL: Derivative data saved (1807 records). [2025-09-18T22:52:04.316769] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-09-18T22:52:04.319344] [INFO ] [MAIN ] Derivative Progress: 770/2075 symbols completed. GFL took 1.2s. Estimated remaining: 8m 27s. Rate: 154.3 symbols/min [2025-09-18T22:52:04.319902] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:04.344212] [DEBUG] [MAIN ] GGB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:04.345250] [INFO ] [MAIN ] GGB: Generated 1807 derivative records from 51382 primary records. [2025-09-18T22:52:04.345437] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-09-18T22:52:04.360952] [DEBUG] [LOCAL ] GGT: Loaded 14214 existing records from primary storage. [2025-09-18T22:52:04.363820] [INFO ] [MAIN ] GGT: Loaded 14214 primary data records. [2025-09-18T22:52:04.441889] [DEBUG] [LOCAL ] GGB: Derivative data saved (1807 records). [2025-09-18T22:52:04.481698] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-09-18T22:52:04.515762] [INFO ] [MAIN ] Derivative Progress: 771/2075 symbols completed. GGB took 1.2s. Estimated remaining: 8m 27s. Rate: 154.4 symbols/min [2025-09-18T22:52:04.536710] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:04.536601] [DEBUG] [LOCAL ] GGG: Loaded 41430 existing records from primary storage. [2025-09-18T22:52:04.555410] [INFO ] [MAIN ] GGG: Loaded 41430 primary data records. [2025-09-18T22:52:04.749509] [DEBUG] [LOCAL ] GGZ: Loaded 2499 existing records from primary storage. [2025-09-18T22:52:04.771362] [INFO ] [MAIN ] GGZ: Loaded 2499 primary data records. [2025-09-18T22:52:05.362961] [DEBUG] [MAIN ] GGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:05.364023] [INFO ] [MAIN ] GGT: Generated 1807 derivative records from 14214 primary records. [2025-09-18T22:52:05.364211] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-09-18T22:52:05.398112] [DEBUG] [LOCAL ] GGT: Derivative data saved (1807 records). [2025-09-18T22:52:05.398515] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-09-18T22:52:05.398831] [DEBUG] [MAIN ] GGG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:05.401819] [INFO ] [MAIN ] GGG: Generated 1807 derivative records from 41430 primary records. [2025-09-18T22:52:05.400926] [INFO ] [MAIN ] Derivative Progress: 772/2075 symbols completed. GGT took 1.1s. Estimated remaining: 8m 27s. Rate: 154.2 symbols/min [2025-09-18T22:52:05.402246] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-09-18T22:52:05.402197] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:05.422213] [DEBUG] [LOCAL ] GGG: Derivative data saved (1807 records). [2025-09-18T22:52:05.424521] [DEBUG] [LOCAL ] GHC: Loaded 2622 existing records from primary storage. [2025-09-18T22:52:05.424711] [INFO ] [MAIN ] GHC: Loaded 2622 primary data records. [2025-09-18T22:52:05.443357] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-09-18T22:52:05.475404] [INFO ] [MAIN ] Derivative Progress: 773/2075 symbols completed. GGG took 1.2s. Estimated remaining: 8m 26s. Rate: 154.3 symbols/min [2025-09-18T22:52:05.482990] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:05.504159] [DEBUG] [MAIN ] GGZ: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:52:05.504949] [INFO ] [MAIN ] GGZ: Generated 1806 derivative records from 2499 primary records. [2025-09-18T22:52:05.505086] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-09-18T22:52:05.631472] [DEBUG] [LOCAL ] GHG: Loaded 3161 existing records from primary storage. [2025-09-18T22:52:05.636700] [INFO ] [MAIN ] GHG: Loaded 3161 primary data records. [2025-09-18T22:52:05.637038] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1806 records). [2025-09-18T22:52:05.651595] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-09-18T22:52:05.810577] [INFO ] [MAIN ] Derivative Progress: 774/2075 symbols completed. GGZ took 1.3s. Estimated remaining: 8m 26s. Rate: 154.4 symbols/min [2025-09-18T22:52:05.840542] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:05.956660] [DEBUG] [LOCAL ] GHI: Loaded 7029 existing records from primary storage. [2025-09-18T22:52:06.076340] [INFO ] [MAIN ] GHI: Loaded 7029 primary data records. [2025-09-18T22:52:06.260750] [DEBUG] [MAIN ] GHC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:52:06.283856] [INFO ] [MAIN ] GHC: Generated 1806 derivative records from 2622 primary records. [2025-09-18T22:52:06.314692] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-09-18T22:52:06.435041] [DEBUG] [LOCAL ] GHC: Derivative data saved (1806 records). [2025-09-18T22:52:06.440327] [DEBUG] [MAIN ] GHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:06.442491] [INFO ] [MAIN ] GHG: Generated 1807 derivative records from 3161 primary records. [2025-09-18T22:52:06.441823] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-09-18T22:52:06.444995] [INFO ] [MAIN ] Derivative Progress: 775/2075 symbols completed. GHC took 1.0s. Estimated remaining: 8m 26s. Rate: 154.2 symbols/min [2025-09-18T22:52:06.445575] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-09-18T22:52:06.445456] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:06.465482] [DEBUG] [LOCAL ] GHG: Derivative data saved (1807 records). [2025-09-18T22:52:06.468872] [DEBUG] [LOCAL ] GHLD: Loaded 4056 existing records from primary storage. [2025-09-18T22:52:06.465937] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-09-18T22:52:06.469307] [INFO ] [MAIN ] GHLD: Loaded 4056 primary data records. [2025-09-18T22:52:06.472049] [INFO ] [MAIN ] Derivative Progress: 776/2075 symbols completed. GHG took 1.0s. Estimated remaining: 8m 25s. Rate: 154.4 symbols/min [2025-09-18T22:52:06.489521] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:06.629510] [DEBUG] [MAIN ] GHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:06.639538] [DEBUG] [LOCAL ] GHM: Loaded 14400 existing records from primary storage. [2025-09-18T22:52:06.689482] [INFO ] [MAIN ] GHI: Generated 1807 derivative records from 7029 primary records. [2025-09-18T22:52:06.695807] [INFO ] [MAIN ] GHM: Loaded 14400 primary data records. [2025-09-18T22:52:06.695733] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-09-18T22:52:06.955724] [DEBUG] [LOCAL ] GHI: Derivative data saved (1807 records). [2025-09-18T22:52:06.961339] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-09-18T22:52:06.982415] [INFO ] [MAIN ] Derivative Progress: 777/2075 symbols completed. GHI took 1.1s. Estimated remaining: 8m 24s. Rate: 154.4 symbols/min [2025-09-18T22:52:07.020732] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:07.204512] [DEBUG] [MAIN ] GHLD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:07.212844] [DEBUG] [LOCAL ] GHY: Loaded 21293 existing records from primary storage. [2025-09-18T22:52:07.213733] [INFO ] [MAIN ] GHLD: Generated 1807 derivative records from 4056 primary records. [2025-09-18T22:52:07.213884] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-09-18T22:52:07.213829] [INFO ] [MAIN ] GHY: Loaded 21293 primary data records. [2025-09-18T22:52:07.334300] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1807 records). [2025-09-18T22:52:07.345508] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-09-18T22:52:07.348493] [INFO ] [MAIN ] Derivative Progress: 778/2075 symbols completed. GHLD took 0.9s. Estimated remaining: 8m 24s. Rate: 154.4 symbols/min [2025-09-18T22:52:07.398425] [DEBUG] [MAIN ] GHM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:07.427630] [INFO ] [MAIN ] GHM: Generated 1807 derivative records from 14400 primary records. [2025-09-18T22:52:07.427772] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-09-18T22:52:07.562854] [DEBUG] [LOCAL ] GHM: Derivative data saved (1807 records). [2025-09-18T22:52:07.563000] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-09-18T22:52:07.565558] [INFO ] [MAIN ] Derivative Progress: 779/2075 symbols completed. GHM took 1.1s. Estimated remaining: 8m 23s. Rate: 154.5 symbols/min [2025-09-18T22:52:07.587068] [DEBUG] [MAIN ] GHY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:07.587685] [INFO ] [MAIN ] GHY: Generated 1807 derivative records from 21293 primary records. [2025-09-18T22:52:07.587749] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-09-18T22:52:07.602854] [DEBUG] [LOCAL ] GHY: Derivative data saved (1807 records). [2025-09-18T22:52:07.602914] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-09-18T22:52:07.605536] [INFO ] [MAIN ] Derivative Progress: 780/2075 symbols completed. GHY took 0.6s. Estimated remaining: 8m 22s. Rate: 154.6 symbols/min [2025-09-18T22:52:07.606279] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:07.606162] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:07.606471] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:07.621730] [DEBUG] [LOCAL ] GIC: Loaded 13973 existing records from primary storage. [2025-09-18T22:52:07.621857] [INFO ] [MAIN ] GIC: Loaded 13973 primary data records. [2025-09-18T22:52:07.946421] [DEBUG] [LOCAL ] GIB: Loaded 32695 existing records from primary storage. [2025-09-18T22:52:07.958633] [INFO ] [MAIN ] GIB: Loaded 32695 primary data records. [2025-09-18T22:52:07.991045] [DEBUG] [LOCAL ] GIL: Loaded 43347 existing records from primary storage. [2025-09-18T22:52:08.004713] [INFO ] [MAIN ] GIL: Loaded 43347 primary data records. [2025-09-18T22:52:08.612634] [DEBUG] [MAIN ] GIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:08.614452] [INFO ] [MAIN ] GIC: Generated 1807 derivative records from 13973 primary records. [2025-09-18T22:52:08.615851] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-09-18T22:52:08.634489] [DEBUG] [LOCAL ] GIC: Derivative data saved (1807 records). [2025-09-18T22:52:08.636457] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-09-18T22:52:08.639744] [INFO ] [MAIN ] Derivative Progress: 781/2075 symbols completed. GIC took 1.0s. Estimated remaining: 8m 23s. Rate: 154.3 symbols/min [2025-09-18T22:52:08.640103] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:08.655088] [DEBUG] [MAIN ] GIB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:08.656214] [INFO ] [MAIN ] GIB: Generated 1807 derivative records from 32695 primary records. [2025-09-18T22:52:08.656635] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-09-18T22:52:08.691446] [DEBUG] [MAIN ] GIL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:08.692989] [INFO ] [MAIN ] GIL: Generated 1807 derivative records from 43347 primary records. [2025-09-18T22:52:08.692084] [DEBUG] [LOCAL ] GIB: Derivative data saved (1807 records). [2025-09-18T22:52:08.693133] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-09-18T22:52:08.693292] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-09-18T22:52:08.696471] [INFO ] [MAIN ] Derivative Progress: 782/2075 symbols completed. GIB took 1.1s. Estimated remaining: 8m 22s. Rate: 154.5 symbols/min [2025-09-18T22:52:08.697077] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:08.728680] [DEBUG] [LOCAL ] GIL: Derivative data saved (1807 records). [2025-09-18T22:52:08.728827] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-09-18T22:52:08.731787] [INFO ] [MAIN ] Derivative Progress: 783/2075 symbols completed. GIL took 1.1s. Estimated remaining: 8m 21s. Rate: 154.7 symbols/min [2025-09-18T22:52:08.732339] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:08.758366] [DEBUG] [LOCAL ] GIS: Loaded 54064 existing records from primary storage. [2025-09-18T22:52:08.758578] [INFO ] [MAIN ] GIS: Loaded 54064 primary data records. [2025-09-18T22:52:08.918359] [DEBUG] [LOCAL ] GKOS: Loaded 43478 existing records from primary storage. [2025-09-18T22:52:08.977382] [INFO ] [MAIN ] GKOS: Loaded 43478 primary data records. [2025-09-18T22:52:09.163670] [DEBUG] [LOCAL ] GL: Loaded 38494 existing records from primary storage. [2025-09-18T22:52:09.180968] [INFO ] [MAIN ] GL: Loaded 38494 primary data records. [2025-09-18T22:52:09.783759] [DEBUG] [MAIN ] GIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:09.785539] [INFO ] [MAIN ] GIS: Generated 1807 derivative records from 54064 primary records. [2025-09-18T22:52:09.785828] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-09-18T22:52:09.805998] [DEBUG] [LOCAL ] GIS: Derivative data saved (1807 records). [2025-09-18T22:52:09.819418] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-09-18T22:52:09.824061] [INFO ] [MAIN ] Derivative Progress: 784/2075 symbols completed. GIS took 1.2s. Estimated remaining: 8m 22s. Rate: 154.3 symbols/min [2025-09-18T22:52:09.819742] [DEBUG] [MAIN ] GL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:09.824527] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:09.825362] [INFO ] [MAIN ] GL: Generated 1807 derivative records from 38494 primary records. [2025-09-18T22:52:09.825571] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-09-18T22:52:09.850926] [DEBUG] [MAIN ] GKOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:09.855631] [DEBUG] [LOCAL ] GL: Derivative data saved (1807 records). [2025-09-18T22:52:09.855847] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-09-18T22:52:09.854397] [INFO ] [MAIN ] GKOS: Generated 1807 derivative records from 43478 primary records. [2025-09-18T22:52:09.858138] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-09-18T22:52:09.858080] [INFO ] [MAIN ] Derivative Progress: 785/2075 symbols completed. GL took 1.1s. Estimated remaining: 8m 21s. Rate: 154.5 symbols/min [2025-09-18T22:52:09.859088] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:09.879225] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1807 records). [2025-09-18T22:52:09.879443] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-09-18T22:52:09.882188] [INFO ] [MAIN ] Derivative Progress: 786/2075 symbols completed. GKOS took 1.2s. Estimated remaining: 8m 20s. Rate: 154.7 symbols/min [2025-09-18T22:52:09.882601] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:09.887235] [DEBUG] [LOCAL ] GLP: Loaded 9662 existing records from primary storage. [2025-09-18T22:52:09.887420] [INFO ] [MAIN ] GLP: Loaded 9662 primary data records. [2025-09-18T22:52:10.095751] [DEBUG] [LOCAL ] GLOB: Loaded 47525 existing records from primary storage. [2025-09-18T22:52:10.202224] [INFO ] [MAIN ] GLOB: Loaded 47525 primary data records. [2025-09-18T22:52:10.400818] [DEBUG] [LOCAL ] GLW: Loaded 54025 existing records from primary storage. [2025-09-18T22:52:10.407806] [INFO ] [MAIN ] GLW: Loaded 54025 primary data records. [2025-09-18T22:52:10.874118] [DEBUG] [MAIN ] GLP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:10.875390] [INFO ] [MAIN ] GLP: Generated 1807 derivative records from 9662 primary records. [2025-09-18T22:52:10.875523] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-09-18T22:52:10.893884] [DEBUG] [LOCAL ] GLP: Derivative data saved (1807 records). [2025-09-18T22:52:10.894695] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-09-18T22:52:10.897137] [INFO ] [MAIN ] Derivative Progress: 787/2075 symbols completed. GLP took 1.0s. Estimated remaining: 8m 21s. Rate: 154.4 symbols/min [2025-09-18T22:52:10.897574] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:10.917457] [DEBUG] [MAIN ] GLOB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:10.918268] [INFO ] [MAIN ] GLOB: Generated 1807 derivative records from 47525 primary records. [2025-09-18T22:52:10.918528] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-09-18T22:52:10.950128] [DEBUG] [MAIN ] GLW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:10.951573] [INFO ] [MAIN ] GLW: Generated 1807 derivative records from 54025 primary records. [2025-09-18T22:52:10.951703] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-09-18T22:52:10.952985] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1807 records). [2025-09-18T22:52:10.953161] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-09-18T22:52:10.955495] [INFO ] [MAIN ] Derivative Progress: 788/2075 symbols completed. GLOB took 1.1s. Estimated remaining: 8m 20s. Rate: 154.5 symbols/min [2025-09-18T22:52:10.955748] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:10.971728] [DEBUG] [LOCAL ] GLW: Derivative data saved (1807 records). [2025-09-18T22:52:10.985017] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-09-18T22:52:10.987904] [INFO ] [MAIN ] Derivative Progress: 789/2075 symbols completed. GLW took 1.1s. Estimated remaining: 8m 19s. Rate: 154.7 symbols/min [2025-09-18T22:52:10.988411] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:11.009604] [DEBUG] [LOCAL ] GM: Loaded 54118 existing records from primary storage. [2025-09-18T22:52:11.009926] [INFO ] [MAIN ] GM: Loaded 54118 primary data records. [2025-09-18T22:52:11.395984] [DEBUG] [LOCAL ] GME: Loaded 54149 existing records from primary storage. [2025-09-18T22:52:11.397095] [DEBUG] [LOCAL ] GMED: Loaded 48614 existing records from primary storage. [2025-09-18T22:52:11.397377] [INFO ] [MAIN ] GME: Loaded 54149 primary data records. [2025-09-18T22:52:11.397480] [INFO ] [MAIN ] GMED: Loaded 48614 primary data records. [2025-09-18T22:52:12.032444] [DEBUG] [MAIN ] GM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:12.033986] [INFO ] [MAIN ] GM: Generated 1807 derivative records from 54118 primary records. [2025-09-18T22:52:12.035250] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-09-18T22:52:12.054007] [DEBUG] [LOCAL ] GM: Derivative data saved (1807 records). [2025-09-18T22:52:12.054354] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-09-18T22:52:12.057023] [INFO ] [MAIN ] Derivative Progress: 790/2075 symbols completed. GM took 1.2s. Estimated remaining: 8m 19s. Rate: 154.4 symbols/min [2025-09-18T22:52:12.057818] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:12.079518] [DEBUG] [MAIN ] GME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:12.080429] [INFO ] [MAIN ] GME: Generated 1807 derivative records from 54149 primary records. [2025-09-18T22:52:12.080564] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-09-18T22:52:12.093769] [DEBUG] [MAIN ] GMED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:12.095020] [INFO ] [MAIN ] GMED: Generated 1807 derivative records from 48614 primary records. [2025-09-18T22:52:12.095116] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-09-18T22:52:12.127280] [DEBUG] [LOCAL ] GME: Derivative data saved (1807 records). [2025-09-18T22:52:12.131177] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-09-18T22:52:12.133977] [INFO ] [MAIN ] Derivative Progress: 791/2075 symbols completed. GME took 1.2s. Estimated remaining: 8m 19s. Rate: 154.5 symbols/min [2025-09-18T22:52:12.134772] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:12.150707] [DEBUG] [LOCAL ] GMED: Derivative data saved (1807 records). [2025-09-18T22:52:12.152171] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-09-18T22:52:12.155120] [INFO ] [MAIN ] Derivative Progress: 792/2075 symbols completed. GMED took 1.2s. Estimated remaining: 8m 18s. Rate: 154.7 symbols/min [2025-09-18T22:52:12.152781] [DEBUG] [LOCAL ] GMRE: Loaded 37946 existing records from primary storage. [2025-09-18T22:52:12.159286] [INFO ] [MAIN ] GMRE: Loaded 37946 primary data records. [2025-09-18T22:52:12.165272] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:12.231448] [DEBUG] [LOCAL ] GNE: Loaded 17483 existing records from primary storage. [2025-09-18T22:52:12.243592] [INFO ] [MAIN ] GNE: Loaded 17483 primary data records. [2025-09-18T22:52:12.815101] [DEBUG] [LOCAL ] GNK: Loaded 41207 existing records from primary storage. [2025-09-18T22:52:12.816171] [INFO ] [MAIN ] GNK: Loaded 41207 primary data records. [2025-09-18T22:52:13.195813] [DEBUG] [MAIN ] GMRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:13.196901] [INFO ] [MAIN ] GMRE: Generated 1807 derivative records from 37946 primary records. [2025-09-18T22:52:13.197940] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-09-18T22:52:13.232708] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1807 records). [2025-09-18T22:52:13.233380] [DEBUG] [MAIN ] GNE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:13.233471] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-09-18T22:52:13.236749] [INFO ] [MAIN ] Derivative Progress: 793/2075 symbols completed. GMRE took 1.2s. Estimated remaining: 8m 18s. Rate: 154.4 symbols/min [2025-09-18T22:52:13.234390] [INFO ] [MAIN ] GNE: Generated 1807 derivative records from 17483 primary records. [2025-09-18T22:52:13.238051] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-09-18T22:52:13.255214] [DEBUG] [LOCAL ] GNE: Derivative data saved (1807 records). [2025-09-18T22:52:13.255521] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-09-18T22:52:13.258052] [INFO ] [MAIN ] Derivative Progress: 794/2075 symbols completed. GNE took 1.1s. Estimated remaining: 8m 17s. Rate: 154.5 symbols/min [2025-09-18T22:52:13.272760] [DEBUG] [MAIN ] GNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:13.273283] [INFO ] [MAIN ] GNK: Generated 1807 derivative records from 41207 primary records. [2025-09-18T22:52:13.273342] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-09-18T22:52:13.289252] [DEBUG] [LOCAL ] GNK: Derivative data saved (1807 records). [2025-09-18T22:52:13.289318] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-09-18T22:52:13.291958] [INFO ] [MAIN ] Derivative Progress: 795/2075 symbols completed. GNK took 1.1s. Estimated remaining: 8m 16s. Rate: 154.7 symbols/min [2025-09-18T22:52:13.292766] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:13.292591] [INFO ] [MAIN ] GNTY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:13.292711] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:13.305594] [DEBUG] [LOCAL ] GNT: Loaded 7870 existing records from primary storage. [2025-09-18T22:52:13.305773] [INFO ] [MAIN ] GNT: Loaded 7870 primary data records. [2025-09-18T22:52:13.348522] [DEBUG] [LOCAL ] GNTY: Loaded 7043 existing records from primary storage. [2025-09-18T22:52:13.361841] [INFO ] [MAIN ] GNTY: Loaded 7043 primary data records. [2025-09-18T22:52:13.871629] [DEBUG] [LOCAL ] GNRC: Loaded 45443 existing records from primary storage. [2025-09-18T22:52:13.887740] [INFO ] [MAIN ] GNRC: Loaded 45443 primary data records. [2025-09-18T22:52:14.676472] [DEBUG] [MAIN ] GNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:14.677930] [INFO ] [MAIN ] GNT: Generated 1807 derivative records from 7870 primary records. [2025-09-18T22:52:14.678196] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-09-18T22:52:14.732198] [DEBUG] [MAIN ] GNTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:14.723749] [DEBUG] [LOCAL ] GNT: Derivative data saved (1807 records). [2025-09-18T22:52:14.735189] [INFO ] [MAIN ] GNTY: Generated 1807 derivative records from 7043 primary records. [2025-09-18T22:52:14.735456] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-09-18T22:52:14.738858] [DEBUG] [LOCAL ] GNTY: Saving derivative data. [2025-09-18T22:52:14.738710] [INFO ] [MAIN ] Derivative Progress: 796/2075 symbols completed. GNT took 1.4s. Estimated remaining: 8m 18s. Rate: 154.2 symbols/min [2025-09-18T22:52:14.741436] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:14.758755] [DEBUG] [LOCAL ] GNTY: Derivative data saved (1807 records). [2025-09-18T22:52:14.759998] [INFO ] [MAIN ] GNTY: Successfully saved derivative data. [2025-09-18T22:52:14.762556] [INFO ] [MAIN ] Derivative Progress: 797/2075 symbols completed. GNTY took 1.5s. Estimated remaining: 8m 17s. Rate: 154.4 symbols/min [2025-09-18T22:52:14.763523] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:14.790346] [DEBUG] [MAIN ] GNRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:14.791402] [INFO ] [MAIN ] GNRC: Generated 1807 derivative records from 45443 primary records. [2025-09-18T22:52:14.791607] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-09-18T22:52:14.826718] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1807 records). [2025-09-18T22:52:14.827038] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-09-18T22:52:14.830920] [INFO ] [MAIN ] Derivative Progress: 798/2075 symbols completed. GNRC took 1.5s. Estimated remaining: 8m 16s. Rate: 154.5 symbols/min [2025-09-18T22:52:14.831545] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:14.863696] [DEBUG] [LOCAL ] GOLF: Loaded 32291 existing records from primary storage. [2025-09-18T22:52:14.863983] [INFO ] [MAIN ] GOLF: Loaded 32291 primary data records. [2025-09-18T22:52:14.989526] [DEBUG] [LOCAL ] GNW: Loaded 51708 existing records from primary storage. [2025-09-18T22:52:15.003601] [INFO ] [MAIN ] GNW: Loaded 51708 primary data records. [2025-09-18T22:52:15.243229] [DEBUG] [LOCAL ] GOOS: Loaded 46206 existing records from primary storage. [2025-09-18T22:52:15.367794] [INFO ] [MAIN ] GOOS: Loaded 46206 primary data records. [2025-09-18T22:52:15.958178] [DEBUG] [MAIN ] GOLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:15.960079] [INFO ] [MAIN ] GOLF: Generated 1807 derivative records from 32291 primary records. [2025-09-18T22:52:15.961080] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-09-18T22:52:15.987632] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1807 records). [2025-09-18T22:52:15.992684] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-09-18T22:52:15.995264] [INFO ] [MAIN ] Derivative Progress: 799/2075 symbols completed. GOLF took 1.2s. Estimated remaining: 8m 17s. Rate: 154.1 symbols/min [2025-09-18T22:52:15.993106] [DEBUG] [MAIN ] GNW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:15.995710] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:15.996721] [INFO ] [MAIN ] GNW: Generated 1807 derivative records from 51708 primary records. [2025-09-18T22:52:15.996934] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-09-18T22:52:16.017172] [DEBUG] [LOCAL ] GNW: Derivative data saved (1807 records). [2025-09-18T22:52:16.017452] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-09-18T22:52:16.027764] [INFO ] [MAIN ] Derivative Progress: 800/2075 symbols completed. GNW took 1.3s. Estimated remaining: 8m 16s. Rate: 154.3 symbols/min [2025-09-18T22:52:16.033155] [DEBUG] [MAIN ] GOOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:16.034166] [INFO ] [MAIN ] GOOS: Generated 1807 derivative records from 46206 primary records. [2025-09-18T22:52:16.034328] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-09-18T22:52:16.033348] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:16.061922] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1807 records). [2025-09-18T22:52:16.062068] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-09-18T22:52:16.064902] [INFO ] [MAIN ] Derivative Progress: 801/2075 symbols completed. GOOS took 1.2s. Estimated remaining: 8m 15s. Rate: 154.5 symbols/min [2025-09-18T22:52:16.065348] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:16.080813] [DEBUG] [LOCAL ] GOTU: Loaded 39755 existing records from primary storage. [2025-09-18T22:52:16.080969] [INFO ] [MAIN ] GOTU: Loaded 39755 primary data records. [2025-09-18T22:52:16.181586] [DEBUG] [LOCAL ] GPI: Loaded 15301 existing records from primary storage. [2025-09-18T22:52:16.209474] [INFO ] [MAIN ] GPI: Loaded 15301 primary data records. [2025-09-18T22:52:16.543884] [DEBUG] [LOCAL ] GPC: Loaded 47187 existing records from primary storage. [2025-09-18T22:52:16.560431] [INFO ] [MAIN ] GPC: Loaded 47187 primary data records. [2025-09-18T22:52:17.092063] [DEBUG] [MAIN ] GOTU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:17.093379] [INFO ] [MAIN ] GOTU: Generated 1807 derivative records from 39755 primary records. [2025-09-18T22:52:17.093829] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-09-18T22:52:17.124823] [DEBUG] [MAIN ] GPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:17.126737] [INFO ] [MAIN ] GPI: Generated 1807 derivative records from 15301 primary records. [2025-09-18T22:52:17.126927] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-09-18T22:52:17.144038] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1807 records). [2025-09-18T22:52:17.144752] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-09-18T22:52:17.147674] [INFO ] [MAIN ] Derivative Progress: 802/2075 symbols completed. GOTU took 1.2s. Estimated remaining: 8m 15s. Rate: 154.1 symbols/min [2025-09-18T22:52:17.148693] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:17.149083] [DEBUG] [LOCAL ] GPI: Derivative data saved (1807 records). [2025-09-18T22:52:17.149383] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-09-18T22:52:17.152133] [INFO ] [MAIN ] Derivative Progress: 803/2075 symbols completed. GPI took 1.1s. Estimated remaining: 8m 14s. Rate: 154.3 symbols/min [2025-09-18T22:52:17.153177] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:17.160680] [DEBUG] [LOCAL ] GPJA: Loaded 4052 existing records from primary storage. [2025-09-18T22:52:17.160812] [INFO ] [MAIN ] GPJA: Loaded 4052 primary data records. [2025-09-18T22:52:17.211483] [DEBUG] [MAIN ] GPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:17.245446] [INFO ] [MAIN ] GPC: Generated 1807 derivative records from 47187 primary records. [2025-09-18T22:52:17.256796] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-09-18T22:52:17.512872] [DEBUG] [LOCAL ] GPC: Derivative data saved (1807 records). [2025-09-18T22:52:17.513019] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-09-18T22:52:17.515901] [INFO ] [MAIN ] Derivative Progress: 804/2075 symbols completed. GPC took 1.5s. Estimated remaining: 8m 14s. Rate: 154.4 symbols/min [2025-09-18T22:52:17.517218] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:17.541486] [DEBUG] [LOCAL ] GPK: Loaded 53057 existing records from primary storage. [2025-09-18T22:52:17.548633] [INFO ] [MAIN ] GPK: Loaded 53057 primary data records. [2025-09-18T22:52:17.631230] [DEBUG] [LOCAL ] GPMT: Loaded 27022 existing records from primary storage. [2025-09-18T22:52:17.650363] [INFO ] [MAIN ] GPMT: Loaded 27022 primary data records. [2025-09-18T22:52:17.787036] [DEBUG] [MAIN ] GPJA: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-09-18T22:52:17.886529] [INFO ] [MAIN ] GPJA: Generated 1805 derivative records from 4052 primary records. [2025-09-18T22:52:18.008745] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-09-18T22:52:18.271051] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1805 records). [2025-09-18T22:52:18.271406] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-09-18T22:52:18.273742] [INFO ] [MAIN ] Derivative Progress: 805/2075 symbols completed. GPJA took 1.1s. Estimated remaining: 8m 14s. Rate: 154.2 symbols/min [2025-09-18T22:52:18.276125] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:18.303361] [DEBUG] [MAIN ] GPK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:18.306276] [INFO ] [MAIN ] GPK: Generated 1807 derivative records from 53057 primary records. [2025-09-18T22:52:18.307317] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-09-18T22:52:18.329568] [DEBUG] [MAIN ] GPMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:18.333465] [INFO ] [MAIN ] GPMT: Generated 1807 derivative records from 27022 primary records. [2025-09-18T22:52:18.336011] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-09-18T22:52:18.338425] [DEBUG] [LOCAL ] GPK: Derivative data saved (1807 records). [2025-09-18T22:52:18.338527] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-09-18T22:52:18.341222] [INFO ] [MAIN ] Derivative Progress: 806/2075 symbols completed. GPK took 1.2s. Estimated remaining: 8m 13s. Rate: 154.3 symbols/min [2025-09-18T22:52:18.341926] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:18.370899] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1807 records). [2025-09-18T22:52:18.371132] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-09-18T22:52:18.373895] [INFO ] [MAIN ] Derivative Progress: 807/2075 symbols completed. GPMT took 0.9s. Estimated remaining: 8m 12s. Rate: 154.5 symbols/min [2025-09-18T22:52:18.374278] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:18.400861] [DEBUG] [LOCAL ] GPN: Loaded 52458 existing records from primary storage. [2025-09-18T22:52:18.401055] [INFO ] [MAIN ] GPN: Loaded 52458 primary data records. [2025-09-18T22:52:18.507081] [DEBUG] [LOCAL ] GPOR: Loaded 23255 existing records from primary storage. [2025-09-18T22:52:18.531683] [INFO ] [MAIN ] GPOR: Loaded 23255 primary data records. [2025-09-18T22:52:18.843681] [DEBUG] [LOCAL ] GPRK: Loaded 39501 existing records from primary storage. [2025-09-18T22:52:18.857555] [INFO ] [MAIN ] GPRK: Loaded 39501 primary data records. [2025-09-18T22:52:19.400225] [DEBUG] [MAIN ] GPN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:19.401035] [INFO ] [MAIN ] GPN: Generated 1807 derivative records from 52458 primary records. [2025-09-18T22:52:19.401691] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-09-18T22:52:19.427313] [DEBUG] [MAIN ] GPOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:19.433074] [INFO ] [MAIN ] GPOR: Generated 1807 derivative records from 23255 primary records. [2025-09-18T22:52:19.435113] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-09-18T22:52:19.437792] [DEBUG] [LOCAL ] GPN: Derivative data saved (1807 records). [2025-09-18T22:52:19.438112] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-09-18T22:52:19.440233] [INFO ] [MAIN ] Derivative Progress: 808/2075 symbols completed. GPN took 1.2s. Estimated remaining: 8m 13s. Rate: 154.2 symbols/min [2025-09-18T22:52:19.456747] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1807 records). [2025-09-18T22:52:19.458469] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-09-18T22:52:19.461265] [INFO ] [MAIN ] Derivative Progress: 809/2075 symbols completed. GPOR took 1.1s. Estimated remaining: 8m 12s. Rate: 154.4 symbols/min [2025-09-18T22:52:19.473877] [DEBUG] [MAIN ] GPRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:19.474510] [INFO ] [MAIN ] GPRK: Generated 1807 derivative records from 39501 primary records. [2025-09-18T22:52:19.474571] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-09-18T22:52:19.490149] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1807 records). [2025-09-18T22:52:19.490248] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-09-18T22:52:19.493079] [INFO ] [MAIN ] Derivative Progress: 810/2075 symbols completed. GPRK took 1.1s. Estimated remaining: 8m 11s. Rate: 154.5 symbols/min [2025-09-18T22:52:19.493674] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:19.494054] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:19.493829] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:19.507013] [DEBUG] [LOCAL ] GRC: Loaded 8903 existing records from primary storage. [2025-09-18T22:52:19.507142] [INFO ] [MAIN ] GRC: Loaded 8903 primary data records. [2025-09-18T22:52:19.624626] [DEBUG] [LOCAL ] GRDN: Loaded 19403 existing records from primary storage. [2025-09-18T22:52:19.631493] [INFO ] [MAIN ] GRDN: Loaded 19403 primary data records. [2025-09-18T22:52:19.673329] [DEBUG] [LOCAL ] GRBK: Loaded 27495 existing records from primary storage. [2025-09-18T22:52:19.683759] [INFO ] [MAIN ] GRBK: Loaded 27495 primary data records. [2025-09-18T22:52:20.538468] [DEBUG] [MAIN ] GRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:20.539537] [INFO ] [MAIN ] GRC: Generated 1807 derivative records from 8903 primary records. [2025-09-18T22:52:20.540008] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-09-18T22:52:20.559245] [DEBUG] [LOCAL ] GRC: Derivative data saved (1807 records). [2025-09-18T22:52:20.560488] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-09-18T22:52:20.563389] [INFO ] [MAIN ] Derivative Progress: 811/2075 symbols completed. GRC took 1.1s. Estimated remaining: 8m 12s. Rate: 154.2 symbols/min [2025-09-18T22:52:20.583926] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:20.589454] [DEBUG] [MAIN ] GRDN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:20.590623] [INFO ] [MAIN ] GRDN: Generated 1807 derivative records from 19403 primary records. [2025-09-18T22:52:20.589816] [DEBUG] [MAIN ] GRBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:20.591876] [INFO ] [MAIN ] GRBK: Generated 1807 derivative records from 27495 primary records. [2025-09-18T22:52:20.591106] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-09-18T22:52:20.592110] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-09-18T22:52:20.623288] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1807 records). [2025-09-18T22:52:20.624396] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-09-18T22:52:20.627130] [INFO ] [MAIN ] Derivative Progress: 812/2075 symbols completed. GRDN took 1.1s. Estimated remaining: 8m 11s. Rate: 154.4 symbols/min [2025-09-18T22:52:20.627688] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:20.629024] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1807 records). [2025-09-18T22:52:20.629111] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-09-18T22:52:20.631573] [INFO ] [MAIN ] Derivative Progress: 813/2075 symbols completed. GRBK took 1.1s. Estimated remaining: 8m 10s. Rate: 154.5 symbols/min [2025-09-18T22:52:20.631958] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:20.671678] [DEBUG] [LOCAL ] GRMN: Loaded 41972 existing records from primary storage. [2025-09-18T22:52:20.680463] [INFO ] [MAIN ] GRMN: Loaded 41972 primary data records. [2025-09-18T22:52:20.806866] [DEBUG] [LOCAL ] GRNT: Loaded 34239 existing records from primary storage. [2025-09-18T22:52:20.810920] [INFO ] [MAIN ] GRNT: Loaded 34239 primary data records. [2025-09-18T22:52:20.976985] [DEBUG] [LOCAL ] GRND: Loaded 50546 existing records from primary storage. [2025-09-18T22:52:21.051721] [INFO ] [MAIN ] GRND: Loaded 50546 primary data records. [2025-09-18T22:52:21.716032] [DEBUG] [MAIN ] GRMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:21.716852] [INFO ] [MAIN ] GRMN: Generated 1807 derivative records from 41972 primary records. [2025-09-18T22:52:21.717049] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-09-18T22:52:21.745304] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1807 records). [2025-09-18T22:52:21.750448] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-09-18T22:52:21.750773] [DEBUG] [MAIN ] GRNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:21.753740] [INFO ] [MAIN ] Derivative Progress: 814/2075 symbols completed. GRMN took 1.2s. Estimated remaining: 8m 11s. Rate: 154.2 symbols/min [2025-09-18T22:52:21.754565] [INFO ] [MAIN ] GRNT: Generated 1807 derivative records from 34239 primary records. [2025-09-18T22:52:21.754704] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-09-18T22:52:21.755773] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:21.785501] [DEBUG] [MAIN ] GRND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:21.786537] [INFO ] [MAIN ] GRND: Generated 1807 derivative records from 50546 primary records. [2025-09-18T22:52:21.786679] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-09-18T22:52:21.792970] [DEBUG] [LOCAL ] GROV: Loaded 9242 existing records from primary storage. [2025-09-18T22:52:21.793345] [INFO ] [MAIN ] GROV: Loaded 9242 primary data records. [2025-09-18T22:52:21.799209] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1807 records). [2025-09-18T22:52:21.805498] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-09-18T22:52:21.815516] [INFO ] [MAIN ] Derivative Progress: 815/2075 symbols completed. GRNT took 1.2s. Estimated remaining: 8m 10s. Rate: 154.3 symbols/min [2025-09-18T22:52:21.841511] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:21.928604] [DEBUG] [LOCAL ] GRX: Loaded 4423 existing records from primary storage. [2025-09-18T22:52:21.929681] [INFO ] [MAIN ] GRX: Loaded 4423 primary data records. [2025-09-18T22:52:21.929498] [DEBUG] [LOCAL ] GRND: Derivative data saved (1807 records). [2025-09-18T22:52:21.929795] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-09-18T22:52:21.978219] [INFO ] [MAIN ] Derivative Progress: 816/2075 symbols completed. GRND took 1.4s. Estimated remaining: 8m 9s. Rate: 154.5 symbols/min [2025-09-18T22:52:22.017449] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:22.491584] [DEBUG] [MAIN ] GROV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:22.492509] [INFO ] [MAIN ] GROV: Generated 1807 derivative records from 9242 primary records. [2025-09-18T22:52:22.492710] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-09-18T22:52:22.528348] [DEBUG] [LOCAL ] GS: Loaded 52557 existing records from primary storage. [2025-09-18T22:52:22.527211] [DEBUG] [LOCAL ] GROV: Derivative data saved (1807 records). [2025-09-18T22:52:22.528638] [INFO ] [MAIN ] GS: Loaded 52557 primary data records. [2025-09-18T22:52:22.528885] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-09-18T22:52:22.531160] [INFO ] [MAIN ] Derivative Progress: 817/2075 symbols completed. GROV took 0.8s. Estimated remaining: 8m 9s. Rate: 154.4 symbols/min [2025-09-18T22:52:22.565289] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:22.577886] [DEBUG] [MAIN ] GRX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:22.597397] [INFO ] [MAIN ] GRX: Generated 1807 derivative records from 4423 primary records. [2025-09-18T22:52:22.620033] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-09-18T22:52:22.753937] [DEBUG] [LOCAL ] GRX: Derivative data saved (1807 records). [2025-09-18T22:52:22.871804] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-09-18T22:52:22.889555] [INFO ] [MAIN ] Derivative Progress: 818/2075 symbols completed. GRX took 1.0s. Estimated remaining: 8m 9s. Rate: 154.4 symbols/min [2025-09-18T22:52:22.890117] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:22.907147] [DEBUG] [LOCAL ] GSBD: Loaded 39568 existing records from primary storage. [2025-09-18T22:52:22.907798] [INFO ] [MAIN ] GSBD: Loaded 39568 primary data records. [2025-09-18T22:52:23.280671] [DEBUG] [LOCAL ] GSK: Loaded 53892 existing records from primary storage. [2025-09-18T22:52:23.278832] [DEBUG] [MAIN ] GS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:23.281492] [INFO ] [MAIN ] GSK: Loaded 53892 primary data records. [2025-09-18T22:52:23.282543] [INFO ] [MAIN ] GS: Generated 1807 derivative records from 52557 primary records. [2025-09-18T22:52:23.282704] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-09-18T22:52:23.486699] [DEBUG] [LOCAL ] GS: Derivative data saved (1807 records). [2025-09-18T22:52:23.491131] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-09-18T22:52:23.495703] [INFO ] [MAIN ] Derivative Progress: 819/2075 symbols completed. GS took 1.5s. Estimated remaining: 8m 8s. Rate: 154.3 symbols/min [2025-09-18T22:52:23.498022] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:23.631294] [DEBUG] [MAIN ] GSBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:23.632163] [INFO ] [MAIN ] GSBD: Generated 1807 derivative records from 39568 primary records. [2025-09-18T22:52:23.632324] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-09-18T22:52:23.650256] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1807 records). [2025-09-18T22:52:23.650484] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-09-18T22:52:23.652847] [INFO ] [MAIN ] Derivative Progress: 820/2075 symbols completed. GSBD took 1.1s. Estimated remaining: 8m 8s. Rate: 154.4 symbols/min [2025-09-18T22:52:23.653235] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:23.685965] [DEBUG] [MAIN ] GSK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:23.686868] [INFO ] [MAIN ] GSK: Generated 1807 derivative records from 53892 primary records. [2025-09-18T22:52:23.687025] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-09-18T22:52:23.712149] [DEBUG] [LOCAL ] GSL: Loaded 34128 existing records from primary storage. [2025-09-18T22:52:23.712815] [INFO ] [MAIN ] GSL: Loaded 34128 primary data records. [2025-09-18T22:52:23.769160] [DEBUG] [LOCAL ] GSK: Derivative data saved (1807 records). [2025-09-18T22:52:23.798743] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-09-18T22:52:23.814352] [INFO ] [MAIN ] Derivative Progress: 821/2075 symbols completed. GSK took 0.9s. Estimated remaining: 8m 7s. Rate: 154.5 symbols/min [2025-09-18T22:52:23.830276] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:23.898104] [DEBUG] [LOCAL ] GTES: Loaded 51111 existing records from primary storage. [2025-09-18T22:52:23.926805] [INFO ] [MAIN ] GTES: Loaded 51111 primary data records. [2025-09-18T22:52:24.429006] [DEBUG] [LOCAL ] GTLS: Loaded 43542 existing records from primary storage. [2025-09-18T22:52:24.429502] [INFO ] [MAIN ] GTLS: Loaded 43542 primary data records. [2025-09-18T22:52:24.773553] [DEBUG] [MAIN ] GSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:24.774519] [INFO ] [MAIN ] GSL: Generated 1807 derivative records from 34128 primary records. [2025-09-18T22:52:24.774866] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-09-18T22:52:24.796090] [DEBUG] [LOCAL ] GSL: Derivative data saved (1807 records). [2025-09-18T22:52:24.796559] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-09-18T22:52:24.799052] [INFO ] [MAIN ] Derivative Progress: 822/2075 symbols completed. GSL took 1.3s. Estimated remaining: 8m 8s. Rate: 154.2 symbols/min [2025-09-18T22:52:24.799586] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:24.813466] [DEBUG] [MAIN ] GTES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:24.815797] [INFO ] [MAIN ] GTES: Generated 1807 derivative records from 51111 primary records. [2025-09-18T22:52:24.816059] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-09-18T22:52:24.833487] [DEBUG] [LOCAL ] GTES: Derivative data saved (1807 records). [2025-09-18T22:52:24.833818] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-09-18T22:52:24.836279] [INFO ] [MAIN ] Derivative Progress: 823/2075 symbols completed. GTES took 1.2s. Estimated remaining: 8m 7s. Rate: 154.4 symbols/min [2025-09-18T22:52:24.853832] [DEBUG] [MAIN ] GTLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:24.854637] [INFO ] [MAIN ] GTLS: Generated 1807 derivative records from 43542 primary records. [2025-09-18T22:52:24.854858] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-09-18T22:52:24.883007] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1807 records). [2025-09-18T22:52:24.883277] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-09-18T22:52:24.886088] [INFO ] [MAIN ] Derivative Progress: 824/2075 symbols completed. GTLS took 1.1s. Estimated remaining: 8m 6s. Rate: 154.5 symbols/min [2025-09-18T22:52:24.901067] [DEBUG] [LOCAL ] GTN: Loaded 46167 existing records from primary storage. [2025-09-18T22:52:24.901218] [INFO ] [MAIN ] GTN: Loaded 46167 primary data records. [2025-09-18T22:52:25.209076] [DEBUG] [MAIN ] GTN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:25.209740] [INFO ] [MAIN ] GTN: Generated 1807 derivative records from 46167 primary records. [2025-09-18T22:52:25.209806] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-09-18T22:52:25.224629] [DEBUG] [LOCAL ] GTN: Derivative data saved (1807 records). [2025-09-18T22:52:25.224721] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-09-18T22:52:25.226589] [INFO ] [MAIN ] Derivative Progress: 825/2075 symbols completed. GTN took 0.4s. Estimated remaining: 8m 5s. Rate: 154.6 symbols/min [2025-09-18T22:52:25.227435] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:25.227863] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:25.227182] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:25.254525] [DEBUG] [LOCAL ] GUG: Loaded 12397 existing records from primary storage. [2025-09-18T22:52:25.255014] [DEBUG] [LOCAL ] GUT: Loaded 15707 existing records from primary storage. [2025-09-18T22:52:25.255308] [INFO ] [MAIN ] GUT: Loaded 15707 primary data records. [2025-09-18T22:52:25.255230] [INFO ] [MAIN ] GUG: Loaded 12397 primary data records. [2025-09-18T22:52:25.475302] [DEBUG] [LOCAL ] GTY: Loaded 30629 existing records from primary storage. [2025-09-18T22:52:25.487197] [INFO ] [MAIN ] GTY: Loaded 30629 primary data records. [2025-09-18T22:52:26.277670] [DEBUG] [MAIN ] GUT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:26.280627] [INFO ] [MAIN ] GUT: Generated 1807 derivative records from 15707 primary records. [2025-09-18T22:52:26.280959] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-09-18T22:52:26.310053] [DEBUG] [MAIN ] GUG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:52:26.311531] [DEBUG] [LOCAL ] GUT: Derivative data saved (1807 records). [2025-09-18T22:52:26.312766] [INFO ] [MAIN ] GUG: Generated 1806 derivative records from 12397 primary records. [2025-09-18T22:52:26.312870] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-09-18T22:52:26.313003] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-09-18T22:52:26.315375] [INFO ] [MAIN ] Derivative Progress: 826/2075 symbols completed. GUT took 1.1s. Estimated remaining: 8m 6s. Rate: 154.2 symbols/min [2025-09-18T22:52:26.317225] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:26.349313] [DEBUG] [MAIN ] GTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:26.351018] [INFO ] [MAIN ] GTY: Generated 1807 derivative records from 30629 primary records. [2025-09-18T22:52:26.352180] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-09-18T22:52:26.352234] [DEBUG] [LOCAL ] GUG: Derivative data saved (1806 records). [2025-09-18T22:52:26.352345] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-09-18T22:52:26.355092] [INFO ] [MAIN ] Derivative Progress: 827/2075 symbols completed. GUG took 1.1s. Estimated remaining: 8m 5s. Rate: 154.4 symbols/min [2025-09-18T22:52:26.356229] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:26.373481] [DEBUG] [LOCAL ] GTY: Derivative data saved (1807 records). [2025-09-18T22:52:26.374053] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-09-18T22:52:26.377117] [INFO ] [MAIN ] Derivative Progress: 828/2075 symbols completed. GTY took 1.1s. Estimated remaining: 8m 4s. Rate: 154.6 symbols/min [2025-09-18T22:52:26.377464] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:26.403390] [DEBUG] [LOCAL ] GVA: Loaded 34379 existing records from primary storage. [2025-09-18T22:52:26.403732] [INFO ] [MAIN ] GVA: Loaded 34379 primary data records. [2025-09-18T22:52:26.541190] [DEBUG] [LOCAL ] GWW: Loaded 20219 existing records from primary storage. [2025-09-18T22:52:26.552607] [INFO ] [MAIN ] GWW: Loaded 20219 primary data records. [2025-09-18T22:52:26.553535] [DEBUG] [LOCAL ] GWRE: Loaded 41721 existing records from primary storage. [2025-09-18T22:52:26.564143] [INFO ] [MAIN ] GWRE: Loaded 41721 primary data records. [2025-09-18T22:52:27.421461] [DEBUG] [MAIN ] GVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:27.422276] [INFO ] [MAIN ] GVA: Generated 1807 derivative records from 34379 primary records. [2025-09-18T22:52:27.422470] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-09-18T22:52:27.440449] [DEBUG] [LOCAL ] GVA: Derivative data saved (1807 records). [2025-09-18T22:52:27.440726] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-09-18T22:52:27.442735] [INFO ] [MAIN ] Derivative Progress: 829/2075 symbols completed. GVA took 1.1s. Estimated remaining: 8m 5s. Rate: 154.3 symbols/min [2025-09-18T22:52:27.444504] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:27.460253] [DEBUG] [MAIN ] GWW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:27.461011] [INFO ] [MAIN ] GWW: Generated 1807 derivative records from 20219 primary records. [2025-09-18T22:52:27.461175] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-09-18T22:52:27.480182] [DEBUG] [LOCAL ] GWW: Derivative data saved (1807 records). [2025-09-18T22:52:27.480517] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-09-18T22:52:27.483160] [INFO ] [MAIN ] Derivative Progress: 830/2075 symbols completed. GWW took 1.1s. Estimated remaining: 8m 4s. Rate: 154.4 symbols/min [2025-09-18T22:52:27.491147] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:27.497037] [DEBUG] [MAIN ] GWRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:27.498040] [INFO ] [MAIN ] GWRE: Generated 1807 derivative records from 41721 primary records. [2025-09-18T22:52:27.498175] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-09-18T22:52:27.513265] [DEBUG] [LOCAL ] GYLD: Loaded 1538 existing records from primary storage. [2025-09-18T22:52:27.513430] [INFO ] [MAIN ] GYLD: Loaded 1538 primary data records. [2025-09-18T22:52:27.530553] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1807 records). [2025-09-18T22:52:27.556782] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-09-18T22:52:27.602263] [INFO ] [MAIN ] Derivative Progress: 831/2075 symbols completed. GWRE took 1.2s. Estimated remaining: 8m 3s. Rate: 154.5 symbols/min [2025-09-18T22:52:27.621797] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:27.688955] [DEBUG] [LOCAL ] GXO: Loaded 48164 existing records from primary storage. [2025-09-18T22:52:27.735522] [INFO ] [MAIN ] GXO: Loaded 48164 primary data records. [2025-09-18T22:52:28.221928] [DEBUG] [LOCAL ] H: Loaded 45362 existing records from primary storage. [2025-09-18T22:52:28.222526] [INFO ] [MAIN ] H: Loaded 45362 primary data records. [2025-09-18T22:52:28.399752] [DEBUG] [MAIN ] GYLD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:52:28.433213] [INFO ] [MAIN ] GYLD: Generated 1806 derivative records from 1538 primary records. [2025-09-18T22:52:28.542836] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-09-18T22:52:28.575418] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1806 records). [2025-09-18T22:52:28.576253] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-09-18T22:52:28.579892] [INFO ] [MAIN ] Derivative Progress: 832/2075 symbols completed. GYLD took 1.1s. Estimated remaining: 8m 3s. Rate: 154.3 symbols/min [2025-09-18T22:52:28.580602] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:28.599758] [DEBUG] [MAIN ] GXO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:28.600947] [INFO ] [MAIN ] GXO: Generated 1807 derivative records from 48164 primary records. [2025-09-18T22:52:28.601264] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-09-18T22:52:28.630362] [DEBUG] [LOCAL ] GXO: Derivative data saved (1807 records). [2025-09-18T22:52:28.630567] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-09-18T22:52:28.633230] [INFO ] [MAIN ] Derivative Progress: 833/2075 symbols completed. GXO took 1.2s. Estimated remaining: 8m 3s. Rate: 154.4 symbols/min [2025-09-18T22:52:28.633587] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:28.646736] [DEBUG] [MAIN ] H: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:28.647533] [INFO ] [MAIN ] H: Generated 1807 derivative records from 45362 primary records. [2025-09-18T22:52:28.647741] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-09-18T22:52:28.669817] [DEBUG] [LOCAL ] HAE: Loaded 39825 existing records from primary storage. [2025-09-18T22:52:28.672970] [INFO ] [MAIN ] HAE: Loaded 39825 primary data records. [2025-09-18T22:52:28.743065] [DEBUG] [LOCAL ] H: Derivative data saved (1807 records). [2025-09-18T22:52:28.748636] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-09-18T22:52:28.758020] [INFO ] [MAIN ] Derivative Progress: 834/2075 symbols completed. H took 1.1s. Estimated remaining: 8m 2s. Rate: 154.6 symbols/min [2025-09-18T22:52:28.774624] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:29.007146] [DEBUG] [LOCAL ] HAFN: Loaded 44198 existing records from primary storage. [2025-09-18T22:52:29.008065] [INFO ] [MAIN ] HAFN: Loaded 44198 primary data records. [2025-09-18T22:52:29.362688] [DEBUG] [LOCAL ] HAL: Loaded 54108 existing records from primary storage. [2025-09-18T22:52:29.363233] [INFO ] [MAIN ] HAL: Loaded 54108 primary data records. [2025-09-18T22:52:29.734597] [DEBUG] [MAIN ] HAE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:29.735607] [INFO ] [MAIN ] HAE: Generated 1807 derivative records from 39825 primary records. [2025-09-18T22:52:29.735834] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-09-18T22:52:29.757841] [DEBUG] [LOCAL ] HAE: Derivative data saved (1807 records). [2025-09-18T22:52:29.770735] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-09-18T22:52:29.772976] [INFO ] [MAIN ] Derivative Progress: 835/2075 symbols completed. HAE took 1.2s. Estimated remaining: 8m 2s. Rate: 154.3 symbols/min [2025-09-18T22:52:29.773403] [DEBUG] [MAIN ] HAFN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:29.773713] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:29.774523] [INFO ] [MAIN ] HAFN: Generated 1807 derivative records from 44198 primary records. [2025-09-18T22:52:29.774991] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-09-18T22:52:29.793363] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1807 records). [2025-09-18T22:52:29.793470] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-09-18T22:52:29.795953] [INFO ] [MAIN ] Derivative Progress: 836/2075 symbols completed. HAFN took 1.2s. Estimated remaining: 8m 1s. Rate: 154.4 symbols/min [2025-09-18T22:52:29.796444] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:29.813808] [DEBUG] [MAIN ] HAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:29.814599] [INFO ] [MAIN ] HAL: Generated 1807 derivative records from 54108 primary records. [2025-09-18T22:52:29.814747] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-09-18T22:52:29.843178] [DEBUG] [LOCAL ] HAL: Derivative data saved (1807 records). [2025-09-18T22:52:29.843329] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-09-18T22:52:29.845848] [INFO ] [MAIN ] Derivative Progress: 837/2075 symbols completed. HAL took 1.1s. Estimated remaining: 8m 1s. Rate: 154.6 symbols/min [2025-09-18T22:52:29.857082] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:29.871592] [DEBUG] [LOCAL ] HASI: Loaded 47604 existing records from primary storage. [2025-09-18T22:52:29.871880] [INFO ] [MAIN ] HASI: Loaded 47604 primary data records. [2025-09-18T22:52:29.996580] [DEBUG] [LOCAL ] HBB: Loaded 7008 existing records from primary storage. [2025-09-18T22:52:29.997483] [DEBUG] [LOCAL ] HAYW: Loaded 49112 existing records from primary storage. [2025-09-18T22:52:30.013725] [INFO ] [MAIN ] HBB: Loaded 7008 primary data records. [2025-09-18T22:52:30.003189] [INFO ] [MAIN ] HAYW: Loaded 49112 primary data records. [2025-09-18T22:52:30.846093] [DEBUG] [MAIN ] HASI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:30.847234] [INFO ] [MAIN ] HASI: Generated 1807 derivative records from 47604 primary records. [2025-09-18T22:52:30.847482] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-09-18T22:52:30.865587] [DEBUG] [LOCAL ] HASI: Derivative data saved (1807 records). [2025-09-18T22:52:30.866746] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-09-18T22:52:30.869786] [INFO ] [MAIN ] Derivative Progress: 838/2075 symbols completed. HASI took 1.1s. Estimated remaining: 8m 1s. Rate: 154.3 symbols/min [2025-09-18T22:52:30.888177] [DEBUG] [MAIN ] HBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:30.902339] [INFO ] [MAIN ] HBB: Generated 1807 derivative records from 7008 primary records. [2025-09-18T22:52:30.902428] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-09-18T22:52:30.901495] [DEBUG] [MAIN ] HAYW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:30.903995] [INFO ] [MAIN ] HAYW: Generated 1807 derivative records from 49112 primary records. [2025-09-18T22:52:30.904094] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-09-18T22:52:30.933418] [DEBUG] [LOCAL ] HBB: Derivative data saved (1807 records). [2025-09-18T22:52:30.933532] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-09-18T22:52:30.937554] [INFO ] [MAIN ] Derivative Progress: 839/2075 symbols completed. HBB took 1.1s. Estimated remaining: 8m 0s. Rate: 154.4 symbols/min [2025-09-18T22:52:30.939151] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1807 records). [2025-09-18T22:52:30.939230] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-09-18T22:52:30.941369] [INFO ] [MAIN ] Derivative Progress: 840/2075 symbols completed. HAYW took 1.1s. Estimated remaining: 7m 59s. Rate: 154.6 symbols/min [2025-09-18T22:52:30.941992] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:30.942218] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:30.942142] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:31.020590] [DEBUG] [LOCAL ] HBI: Loaded 53417 existing records from primary storage. [2025-09-18T22:52:31.020906] [INFO ] [MAIN ] HBI: Loaded 53417 primary data records. [2025-09-18T22:52:31.140240] [DEBUG] [LOCAL ] HBM: Loaded 53302 existing records from primary storage. [2025-09-18T22:52:31.156240] [INFO ] [MAIN ] HBM: Loaded 53302 primary data records. [2025-09-18T22:52:31.207705] [DEBUG] [LOCAL ] HCA: Loaded 47753 existing records from primary storage. [2025-09-18T22:52:31.254959] [INFO ] [MAIN ] HCA: Loaded 47753 primary data records. [2025-09-18T22:52:32.023872] [DEBUG] [MAIN ] HBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:32.024794] [INFO ] [MAIN ] HBI: Generated 1807 derivative records from 53417 primary records. [2025-09-18T22:52:32.025232] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-09-18T22:52:32.058225] [DEBUG] [MAIN ] HBM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:32.059156] [INFO ] [MAIN ] HBM: Generated 1807 derivative records from 53302 primary records. [2025-09-18T22:52:32.057942] [DEBUG] [LOCAL ] HBI: Derivative data saved (1807 records). [2025-09-18T22:52:32.059271] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-09-18T22:52:32.059616] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-09-18T22:52:32.062131] [INFO ] [MAIN ] Derivative Progress: 841/2075 symbols completed. HBI took 1.1s. Estimated remaining: 7m 60s. Rate: 154.3 symbols/min [2025-09-18T22:52:32.069875] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:32.081136] [DEBUG] [LOCAL ] HBM: Derivative data saved (1807 records). [2025-09-18T22:52:32.081380] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-09-18T22:52:32.083938] [INFO ] [MAIN ] Derivative Progress: 842/2075 symbols completed. HBM took 1.1s. Estimated remaining: 7m 59s. Rate: 154.4 symbols/min [2025-09-18T22:52:32.084341] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:32.097832] [DEBUG] [MAIN ] HCA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:32.098597] [INFO ] [MAIN ] HCA: Generated 1807 derivative records from 47753 primary records. [2025-09-18T22:52:32.098853] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-09-18T22:52:32.115633] [DEBUG] [LOCAL ] HCA: Derivative data saved (1807 records). [2025-09-18T22:52:32.115893] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-09-18T22:52:32.118348] [INFO ] [MAIN ] Derivative Progress: 843/2075 symbols completed. HCA took 1.2s. Estimated remaining: 7m 58s. Rate: 154.6 symbols/min [2025-09-18T22:52:32.122272] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:32.130108] [DEBUG] [LOCAL ] HCI: Loaded 14062 existing records from primary storage. [2025-09-18T22:52:32.130236] [INFO ] [MAIN ] HCI: Loaded 14062 primary data records. [2025-09-18T22:52:32.319782] [DEBUG] [LOCAL ] HCC: Loaded 45777 existing records from primary storage. [2025-09-18T22:52:32.337986] [INFO ] [MAIN ] HCC: Loaded 45777 primary data records. [2025-09-18T22:52:32.654150] [DEBUG] [LOCAL ] HD: Loaded 53908 existing records from primary storage. [2025-09-18T22:52:32.680242] [INFO ] [MAIN ] HD: Loaded 53908 primary data records. [2025-09-18T22:52:33.138019] [DEBUG] [MAIN ] HCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:33.138988] [INFO ] [MAIN ] HCI: Generated 1807 derivative records from 14062 primary records. [2025-09-18T22:52:33.139421] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-09-18T22:52:33.163270] [DEBUG] [LOCAL ] HCI: Derivative data saved (1807 records). [2025-09-18T22:52:33.163533] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-09-18T22:52:33.165583] [INFO ] [MAIN ] Derivative Progress: 844/2075 symbols completed. HCI took 1.1s. Estimated remaining: 7m 59s. Rate: 154.3 symbols/min [2025-09-18T22:52:33.174930] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:33.180188] [DEBUG] [MAIN ] HCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:33.181514] [INFO ] [MAIN ] HCC: Generated 1807 derivative records from 45777 primary records. [2025-09-18T22:52:33.181783] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-09-18T22:52:33.201381] [DEBUG] [LOCAL ] HCC: Derivative data saved (1807 records). [2025-09-18T22:52:33.202459] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-09-18T22:52:33.204499] [INFO ] [MAIN ] Derivative Progress: 845/2075 symbols completed. HCC took 1.1s. Estimated remaining: 7m 58s. Rate: 154.5 symbols/min [2025-09-18T22:52:33.205764] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:33.219875] [DEBUG] [MAIN ] HD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:33.220700] [INFO ] [MAIN ] HD: Generated 1807 derivative records from 53908 primary records. [2025-09-18T22:52:33.220865] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-09-18T22:52:33.237612] [DEBUG] [LOCAL ] HD: Derivative data saved (1807 records). [2025-09-18T22:52:33.237762] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-09-18T22:52:33.240847] [INFO ] [MAIN ] Derivative Progress: 846/2075 symbols completed. HD took 1.1s. Estimated remaining: 7m 57s. Rate: 154.6 symbols/min [2025-09-18T22:52:33.255040] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:33.276534] [DEBUG] [LOCAL ] HDB: Loaded 52320 existing records from primary storage. [2025-09-18T22:52:33.276844] [INFO ] [MAIN ] HDB: Loaded 52320 primary data records. [2025-09-18T22:52:33.436255] [DEBUG] [LOCAL ] HEI: Loaded 33217 existing records from primary storage. [2025-09-18T22:52:33.488236] [INFO ] [MAIN ] HEI: Loaded 33217 primary data records. [2025-09-18T22:52:33.653690] [DEBUG] [LOCAL ] HE: Loaded 49698 existing records from primary storage. [2025-09-18T22:52:33.682401] [INFO ] [MAIN ] HE: Loaded 49698 primary data records. [2025-09-18T22:52:34.285082] [DEBUG] [MAIN ] HDB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:34.287165] [INFO ] [MAIN ] HDB: Generated 1807 derivative records from 52320 primary records. [2025-09-18T22:52:34.287570] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-09-18T22:52:34.306605] [DEBUG] [LOCAL ] HDB: Derivative data saved (1807 records). [2025-09-18T22:52:34.306986] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-09-18T22:52:34.309086] [INFO ] [MAIN ] Derivative Progress: 847/2075 symbols completed. HDB took 1.1s. Estimated remaining: 7m 57s. Rate: 154.3 symbols/min [2025-09-18T22:52:34.309930] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:34.333860] [DEBUG] [MAIN ] HEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:34.333527] [DEBUG] [LOCAL ] HEQ: Loaded 6239 existing records from primary storage. [2025-09-18T22:52:34.334765] [INFO ] [MAIN ] HEI: Generated 1807 derivative records from 33217 primary records. [2025-09-18T22:52:34.347564] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-09-18T22:52:34.347365] [INFO ] [MAIN ] HEQ: Loaded 6239 primary data records. [2025-09-18T22:52:34.359248] [DEBUG] [MAIN ] HE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:34.370210] [INFO ] [MAIN ] HE: Generated 1807 derivative records from 49698 primary records. [2025-09-18T22:52:34.386985] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-09-18T22:52:34.470801] [DEBUG] [LOCAL ] HEI: Derivative data saved (1807 records). [2025-09-18T22:52:34.482716] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-09-18T22:52:34.488128] [INFO ] [MAIN ] Derivative Progress: 848/2075 symbols completed. HEI took 1.2s. Estimated remaining: 7m 57s. Rate: 154.4 symbols/min [2025-09-18T22:52:34.499598] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:34.682736] [DEBUG] [LOCAL ] HE: Derivative data saved (1807 records). [2025-09-18T22:52:34.696448] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-09-18T22:52:34.699496] [INFO ] [MAIN ] Derivative Progress: 849/2075 symbols completed. HE took 1.5s. Estimated remaining: 7m 56s. Rate: 154.5 symbols/min [2025-09-18T22:52:34.700504] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:34.731186] [DEBUG] [LOCAL ] HFRO: Loaded 17680 existing records from primary storage. [2025-09-18T22:52:34.731469] [INFO ] [MAIN ] HFRO: Loaded 17680 primary data records. [2025-09-18T22:52:34.855814] [DEBUG] [LOCAL ] HESM: Loaded 48477 existing records from primary storage. [2025-09-18T22:52:34.864037] [INFO ] [MAIN ] HESM: Loaded 48477 primary data records. [2025-09-18T22:52:34.885974] [DEBUG] [MAIN ] HEQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:34.912298] [INFO ] [MAIN ] HEQ: Generated 1807 derivative records from 6239 primary records. [2025-09-18T22:52:34.917535] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-09-18T22:52:35.194453] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1807 records). [2025-09-18T22:52:35.205574] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-09-18T22:52:35.207835] [INFO ] [MAIN ] Derivative Progress: 850/2075 symbols completed. HEQ took 0.9s. Estimated remaining: 7m 56s. Rate: 154.4 symbols/min [2025-09-18T22:52:35.244322] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:35.417249] [DEBUG] [LOCAL ] HGER: Loaded 12752 existing records from primary storage. [2025-09-18T22:52:35.419914] [INFO ] [MAIN ] HGER: Loaded 12752 primary data records. [2025-09-18T22:52:35.540349] [DEBUG] [MAIN ] HFRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:35.546901] [INFO ] [MAIN ] HFRO: Generated 1807 derivative records from 17680 primary records. [2025-09-18T22:52:35.557571] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-09-18T22:52:35.819077] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1807 records). [2025-09-18T22:52:35.819485] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-09-18T22:52:35.821596] [INFO ] [MAIN ] Derivative Progress: 851/2075 symbols completed. HFRO took 1.1s. Estimated remaining: 7m 56s. Rate: 154.3 symbols/min [2025-09-18T22:52:35.823223] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:35.843972] [DEBUG] [MAIN ] HESM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:35.844870] [INFO ] [MAIN ] HESM: Generated 1807 derivative records from 48477 primary records. [2025-09-18T22:52:35.845007] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-09-18T22:52:35.850331] [DEBUG] [LOCAL ] HGLB: Loaded 9804 existing records from primary storage. [2025-09-18T22:52:35.850437] [INFO ] [MAIN ] HGLB: Loaded 9804 primary data records. [2025-09-18T22:52:35.916018] [DEBUG] [LOCAL ] HESM: Derivative data saved (1807 records). [2025-09-18T22:52:35.941584] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-09-18T22:52:35.958419] [INFO ] [MAIN ] Derivative Progress: 852/2075 symbols completed. HESM took 1.5s. Estimated remaining: 7m 55s. Rate: 154.5 symbols/min [2025-09-18T22:52:35.974352] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:36.187258] [DEBUG] [LOCAL ] HGTY: Loaded 12987 existing records from primary storage. [2025-09-18T22:52:36.205689] [INFO ] [MAIN ] HGTY: Loaded 12987 primary data records. [2025-09-18T22:52:36.286507] [DEBUG] [MAIN ] HGER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:36.293074] [INFO ] [MAIN ] HGER: Generated 1807 derivative records from 12752 primary records. [2025-09-18T22:52:36.328783] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-09-18T22:52:36.543850] [DEBUG] [LOCAL ] HGER: Derivative data saved (1807 records). [2025-09-18T22:52:36.544148] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-09-18T22:52:36.546697] [INFO ] [MAIN ] Derivative Progress: 853/2075 symbols completed. HGER took 1.3s. Estimated remaining: 7m 55s. Rate: 154.4 symbols/min [2025-09-18T22:52:36.565851] [DEBUG] [MAIN ] HGLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:36.566954] [INFO ] [MAIN ] HGLB: Generated 1807 derivative records from 9804 primary records. [2025-09-18T22:52:36.567066] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-09-18T22:52:36.583762] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1807 records). [2025-09-18T22:52:36.583912] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-09-18T22:52:36.585980] [INFO ] [MAIN ] Derivative Progress: 854/2075 symbols completed. HGLB took 0.8s. Estimated remaining: 7m 54s. Rate: 154.5 symbols/min [2025-09-18T22:52:36.602857] [DEBUG] [MAIN ] HGTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:36.603396] [INFO ] [MAIN ] HGTY: Generated 1807 derivative records from 12987 primary records. [2025-09-18T22:52:36.603454] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-09-18T22:52:36.618325] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1807 records). [2025-09-18T22:52:36.618388] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-09-18T22:52:36.620521] [INFO ] [MAIN ] Derivative Progress: 855/2075 symbols completed. HGTY took 0.7s. Estimated remaining: 7m 53s. Rate: 154.7 symbols/min [2025-09-18T22:52:36.621030] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:36.621176] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:36.621767] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:36.673715] [DEBUG] [LOCAL ] HHH: Loaded 33111 existing records from primary storage. [2025-09-18T22:52:36.683833] [INFO ] [MAIN ] HHH: Loaded 33111 primary data records. [2025-09-18T22:52:36.728193] [DEBUG] [LOCAL ] HI: Loaded 35349 existing records from primary storage. [2025-09-18T22:52:36.781391] [INFO ] [MAIN ] HI: Loaded 35349 primary data records. [2025-09-18T22:52:36.787298] [DEBUG] [LOCAL ] HGV: Loaded 47467 existing records from primary storage. [2025-09-18T22:52:36.797721] [INFO ] [MAIN ] HGV: Loaded 47467 primary data records. [2025-09-18T22:52:37.715628] [DEBUG] [MAIN ] HHH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:37.716900] [INFO ] [MAIN ] HHH: Generated 1807 derivative records from 33111 primary records. [2025-09-18T22:52:37.717100] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-09-18T22:52:37.735086] [DEBUG] [LOCAL ] HHH: Derivative data saved (1807 records). [2025-09-18T22:52:37.736343] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-09-18T22:52:37.739088] [INFO ] [MAIN ] Derivative Progress: 856/2075 symbols completed. HHH took 1.1s. Estimated remaining: 7m 54s. Rate: 154.3 symbols/min [2025-09-18T22:52:37.739685] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:37.756424] [DEBUG] [MAIN ] HI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:37.757502] [INFO ] [MAIN ] HI: Generated 1807 derivative records from 35349 primary records. [2025-09-18T22:52:37.757705] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-09-18T22:52:37.783949] [DEBUG] [MAIN ] HGV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:37.785595] [INFO ] [MAIN ] HGV: Generated 1807 derivative records from 47467 primary records. [2025-09-18T22:52:37.785970] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-09-18T22:52:37.802810] [DEBUG] [LOCAL ] HI: Derivative data saved (1807 records). [2025-09-18T22:52:37.807030] [DEBUG] [LOCAL ] HGV: Derivative data saved (1807 records). [2025-09-18T22:52:37.805836] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-09-18T22:52:37.807171] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-09-18T22:52:37.809372] [INFO ] [MAIN ] Derivative Progress: 857/2075 symbols completed. HI took 1.2s. Estimated remaining: 7m 53s. Rate: 154.5 symbols/min [2025-09-18T22:52:37.812520] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:37.812700] [INFO ] [MAIN ] Derivative Progress: 858/2075 symbols completed. HGV took 1.2s. Estimated remaining: 7m 52s. Rate: 154.7 symbols/min [2025-09-18T22:52:37.813398] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:37.855791] [DEBUG] [LOCAL ] HIG: Loaded 51670 existing records from primary storage. [2025-09-18T22:52:37.856049] [INFO ] [MAIN ] HIG: Loaded 51670 primary data records. [2025-09-18T22:52:38.096068] [DEBUG] [LOCAL ] HII: Loaded 35965 existing records from primary storage. [2025-09-18T22:52:38.109019] [INFO ] [MAIN ] HII: Loaded 35965 primary data records. [2025-09-18T22:52:38.261525] [DEBUG] [LOCAL ] HIMS: Loaded 54207 existing records from primary storage. [2025-09-18T22:52:38.274839] [INFO ] [MAIN ] HIMS: Loaded 54207 primary data records. [2025-09-18T22:52:38.875525] [DEBUG] [MAIN ] HIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:38.877698] [INFO ] [MAIN ] HIG: Generated 1807 derivative records from 51670 primary records. [2025-09-18T22:52:38.878395] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-09-18T22:52:38.896867] [DEBUG] [LOCAL ] HIG: Derivative data saved (1807 records). [2025-09-18T22:52:38.897140] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-09-18T22:52:38.899384] [INFO ] [MAIN ] Derivative Progress: 859/2075 symbols completed. HIG took 1.2s. Estimated remaining: 7m 53s. Rate: 154.4 symbols/min [2025-09-18T22:52:38.899963] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:38.943403] [DEBUG] [MAIN ] HII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:38.943113] [DEBUG] [MAIN ] HIMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:38.944278] [INFO ] [MAIN ] HII: Generated 1807 derivative records from 35965 primary records. [2025-09-18T22:52:38.945111] [INFO ] [MAIN ] HIMS: Generated 1807 derivative records from 54207 primary records. [2025-09-18T22:52:38.944406] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-09-18T22:52:38.945268] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-09-18T22:52:38.977958] [DEBUG] [LOCAL ] HIO: Loaded 24268 existing records from primary storage. [2025-09-18T22:52:38.981713] [INFO ] [MAIN ] HIO: Loaded 24268 primary data records. [2025-09-18T22:52:38.988981] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1807 records). [2025-09-18T22:52:38.997064] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-09-18T22:52:39.011335] [INFO ] [MAIN ] Derivative Progress: 860/2075 symbols completed. HIMS took 1.2s. Estimated remaining: 7m 52s. Rate: 154.5 symbols/min [2025-09-18T22:52:39.028982] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:39.066161] [DEBUG] [LOCAL ] HII: Derivative data saved (1807 records). [2025-09-18T22:52:39.073797] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-09-18T22:52:39.086608] [INFO ] [MAIN ] Derivative Progress: 861/2075 symbols completed. HII took 1.3s. Estimated remaining: 7m 51s. Rate: 154.6 symbols/min [2025-09-18T22:52:39.107117] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:39.317513] [DEBUG] [LOCAL ] HIPO: Loaded 23127 existing records from primary storage. [2025-09-18T22:52:39.317769] [INFO ] [MAIN ] HIPO: Loaded 23127 primary data records. [2025-09-18T22:52:39.642851] [DEBUG] [LOCAL ] HIW: Loaded 45221 existing records from primary storage. [2025-09-18T22:52:39.651750] [INFO ] [MAIN ] HIW: Loaded 45221 primary data records. [2025-09-18T22:52:40.016333] [DEBUG] [MAIN ] HIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:40.017540] [INFO ] [MAIN ] HIO: Generated 1807 derivative records from 24268 primary records. [2025-09-18T22:52:40.017890] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-09-18T22:52:40.051730] [DEBUG] [MAIN ] HIPO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:40.052495] [INFO ] [MAIN ] HIPO: Generated 1807 derivative records from 23127 primary records. [2025-09-18T22:52:40.051413] [DEBUG] [LOCAL ] HIO: Derivative data saved (1807 records). [2025-09-18T22:52:40.052701] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-09-18T22:52:40.055399] [INFO ] [MAIN ] Derivative Progress: 862/2075 symbols completed. HIO took 1.2s. Estimated remaining: 7m 52s. Rate: 154.4 symbols/min [2025-09-18T22:52:40.052787] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-09-18T22:52:40.056895] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:40.073531] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1807 records). [2025-09-18T22:52:40.073776] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-09-18T22:52:40.076108] [INFO ] [MAIN ] Derivative Progress: 863/2075 symbols completed. HIPO took 1.1s. Estimated remaining: 7m 51s. Rate: 154.5 symbols/min [2025-09-18T22:52:40.076455] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:40.098891] [DEBUG] [MAIN ] HIW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:40.099715] [INFO ] [MAIN ] HIW: Generated 1807 derivative records from 45221 primary records. [2025-09-18T22:52:40.103784] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-09-18T22:52:40.111374] [DEBUG] [LOCAL ] HIX: Loaded 20398 existing records from primary storage. [2025-09-18T22:52:40.111533] [INFO ] [MAIN ] HIX: Loaded 20398 primary data records. [2025-09-18T22:52:40.186065] [DEBUG] [LOCAL ] HKD: Loaded 18070 existing records from primary storage. [2025-09-18T22:52:40.208776] [DEBUG] [LOCAL ] HIW: Derivative data saved (1807 records). [2025-09-18T22:52:40.213974] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-09-18T22:52:40.221965] [INFO ] [MAIN ] Derivative Progress: 864/2075 symbols completed. HIW took 1.1s. Estimated remaining: 7m 50s. Rate: 154.6 symbols/min [2025-09-18T22:52:40.222105] [INFO ] [MAIN ] HKD: Loaded 18070 primary data records. [2025-09-18T22:52:40.260067] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:40.773610] [DEBUG] [LOCAL ] HL: Loaded 54060 existing records from primary storage. [2025-09-18T22:52:40.775580] [INFO ] [MAIN ] HL: Loaded 54060 primary data records. [2025-09-18T22:52:40.832531] [DEBUG] [MAIN ] HIX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:40.866128] [INFO ] [MAIN ] HIX: Generated 1807 derivative records from 20398 primary records. [2025-09-18T22:52:40.871568] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-09-18T22:52:40.912942] [DEBUG] [LOCAL ] HIX: Derivative data saved (1807 records). [2025-09-18T22:52:40.913137] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-09-18T22:52:40.915230] [INFO ] [MAIN ] Derivative Progress: 865/2075 symbols completed. HIX took 0.9s. Estimated remaining: 7m 50s. Rate: 154.5 symbols/min [2025-09-18T22:52:40.926091] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:41.007954] [DEBUG] [MAIN ] HKD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:41.109905] [INFO ] [MAIN ] HKD: Generated 1807 derivative records from 18070 primary records. [2025-09-18T22:52:41.123105] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-09-18T22:52:41.141973] [DEBUG] [LOCAL ] HKD: Derivative data saved (1807 records). [2025-09-18T22:52:41.142535] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-09-18T22:52:41.145062] [INFO ] [MAIN ] Derivative Progress: 866/2075 symbols completed. HKD took 1.1s. Estimated remaining: 7m 49s. Rate: 154.6 symbols/min [2025-09-18T22:52:41.145467] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:41.178574] [DEBUG] [MAIN ] HL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:41.179546] [INFO ] [MAIN ] HL: Generated 1807 derivative records from 54060 primary records. [2025-09-18T22:52:41.179743] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-09-18T22:52:41.194278] [DEBUG] [LOCAL ] HLF: Loaded 49283 existing records from primary storage. [2025-09-18T22:52:41.201250] [INFO ] [MAIN ] HLF: Loaded 49283 primary data records. [2025-09-18T22:52:41.331599] [DEBUG] [LOCAL ] HLI: Loaded 31662 existing records from primary storage. [2025-09-18T22:52:41.332019] [DEBUG] [LOCAL ] HL: Derivative data saved (1807 records). [2025-09-18T22:52:41.332599] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-09-18T22:52:41.332236] [INFO ] [MAIN ] HLI: Loaded 31662 primary data records. [2025-09-18T22:52:41.361307] [INFO ] [MAIN ] Derivative Progress: 867/2075 symbols completed. HL took 1.1s. Estimated remaining: 7m 49s. Rate: 154.6 symbols/min [2025-09-18T22:52:41.494342] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:41.907304] [DEBUG] [LOCAL ] HLIO: Loaded 28359 existing records from primary storage. [2025-09-18T22:52:41.907520] [INFO ] [MAIN ] HLIO: Loaded 28359 primary data records. [2025-09-18T22:52:42.243009] [DEBUG] [MAIN ] HLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:42.244047] [INFO ] [MAIN ] HLF: Generated 1807 derivative records from 49283 primary records. [2025-09-18T22:52:42.244213] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-09-18T22:52:42.267301] [DEBUG] [LOCAL ] HLF: Derivative data saved (1807 records). [2025-09-18T22:52:42.267720] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-09-18T22:52:42.281784] [INFO ] [MAIN ] Derivative Progress: 868/2075 symbols completed. HLF took 1.4s. Estimated remaining: 7m 49s. Rate: 154.4 symbols/min [2025-09-18T22:52:42.282562] [DEBUG] [MAIN ] HLI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:42.284012] [INFO ] [MAIN ] HLI: Generated 1807 derivative records from 31662 primary records. [2025-09-18T22:52:42.284096] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-09-18T22:52:42.317408] [DEBUG] [LOCAL ] HLI: Derivative data saved (1807 records). [2025-09-18T22:52:42.317921] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-09-18T22:52:42.317798] [DEBUG] [MAIN ] HLIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:42.320345] [INFO ] [MAIN ] Derivative Progress: 869/2075 symbols completed. HLI took 1.2s. Estimated remaining: 7m 48s. Rate: 154.6 symbols/min [2025-09-18T22:52:42.321303] [INFO ] [MAIN ] HLIO: Generated 1807 derivative records from 28359 primary records. [2025-09-18T22:52:42.321531] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-09-18T22:52:42.338188] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1807 records). [2025-09-18T22:52:42.338289] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-09-18T22:52:42.341263] [INFO ] [MAIN ] Derivative Progress: 870/2075 symbols completed. HLIO took 0.9s. Estimated remaining: 7m 47s. Rate: 154.7 symbols/min [2025-09-18T22:52:42.341799] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:42.342072] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:42.342223] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:42.380790] [DEBUG] [LOCAL ] HLLY: Loaded 33420 existing records from primary storage. [2025-09-18T22:52:42.380949] [INFO ] [MAIN ] HLLY: Loaded 33420 primary data records. [2025-09-18T22:52:42.735073] [DEBUG] [LOCAL ] HLN: Loaded 53472 existing records from primary storage. [2025-09-18T22:52:42.736579] [DEBUG] [LOCAL ] HLT: Loaded 51154 existing records from primary storage. [2025-09-18T22:52:42.736785] [INFO ] [MAIN ] HLN: Loaded 53472 primary data records. [2025-09-18T22:52:42.737058] [INFO ] [MAIN ] HLT: Loaded 51154 primary data records. [2025-09-18T22:52:43.372996] [DEBUG] [MAIN ] HLLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:43.374363] [INFO ] [MAIN ] HLLY: Generated 1807 derivative records from 33420 primary records. [2025-09-18T22:52:43.374769] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-09-18T22:52:43.396300] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1807 records). [2025-09-18T22:52:43.396518] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-09-18T22:52:43.398868] [INFO ] [MAIN ] Derivative Progress: 871/2075 symbols completed. HLLY took 1.1s. Estimated remaining: 7m 48s. Rate: 154.4 symbols/min [2025-09-18T22:52:43.399448] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:43.430821] [DEBUG] [MAIN ] HLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:43.431427] [DEBUG] [MAIN ] HLN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:43.432209] [INFO ] [MAIN ] HLT: Generated 1807 derivative records from 51154 primary records. [2025-09-18T22:52:43.433113] [INFO ] [MAIN ] HLN: Generated 1807 derivative records from 53472 primary records. [2025-09-18T22:52:43.433283] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-09-18T22:52:43.433350] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-09-18T22:52:43.475564] [DEBUG] [LOCAL ] HLN: Derivative data saved (1807 records). [2025-09-18T22:52:43.475980] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-09-18T22:52:43.478182] [INFO ] [MAIN ] Derivative Progress: 872/2075 symbols completed. HLN took 1.1s. Estimated remaining: 7m 47s. Rate: 154.6 symbols/min [2025-09-18T22:52:43.479131] [DEBUG] [LOCAL ] HLT: Derivative data saved (1807 records). [2025-09-18T22:52:43.479542] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:43.479806] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-09-18T22:52:43.483764] [INFO ] [MAIN ] Derivative Progress: 873/2075 symbols completed. HLT took 1.1s. Estimated remaining: 7m 46s. Rate: 154.7 symbols/min [2025-09-18T22:52:43.484261] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:43.501434] [DEBUG] [LOCAL ] HLX: Loaded 48514 existing records from primary storage. [2025-09-18T22:52:43.501771] [INFO ] [MAIN ] HLX: Loaded 48514 primary data records. [2025-09-18T22:52:43.704804] [DEBUG] [LOCAL ] HMN: Loaded 23442 existing records from primary storage. [2025-09-18T22:52:43.849362] [INFO ] [MAIN ] HMN: Loaded 23442 primary data records. [2025-09-18T22:52:43.933393] [DEBUG] [LOCAL ] HMC: Loaded 47409 existing records from primary storage. [2025-09-18T22:52:43.948259] [INFO ] [MAIN ] HMC: Loaded 47409 primary data records. [2025-09-18T22:52:44.501441] [DEBUG] [MAIN ] HLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:44.502551] [INFO ] [MAIN ] HLX: Generated 1807 derivative records from 48514 primary records. [2025-09-18T22:52:44.502846] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-09-18T22:52:44.526253] [DEBUG] [LOCAL ] HLX: Derivative data saved (1807 records). [2025-09-18T22:52:44.526678] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-09-18T22:52:44.536705] [INFO ] [MAIN ] Derivative Progress: 874/2075 symbols completed. HLX took 1.1s. Estimated remaining: 7m 47s. Rate: 154.4 symbols/min [2025-09-18T22:52:44.542187] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:44.543200] [DEBUG] [MAIN ] HMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:44.544174] [INFO ] [MAIN ] HMN: Generated 1807 derivative records from 23442 primary records. [2025-09-18T22:52:44.544430] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-09-18T22:52:44.563694] [DEBUG] [LOCAL ] HMN: Derivative data saved (1807 records). [2025-09-18T22:52:44.576481] [DEBUG] [MAIN ] HMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:44.576220] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-09-18T22:52:44.577391] [INFO ] [MAIN ] HMC: Generated 1807 derivative records from 47409 primary records. [2025-09-18T22:52:44.579760] [INFO ] [MAIN ] Derivative Progress: 875/2075 symbols completed. HMN took 1.1s. Estimated remaining: 7m 46s. Rate: 154.6 symbols/min [2025-09-18T22:52:44.577530] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-09-18T22:52:44.580081] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:44.598070] [DEBUG] [LOCAL ] HMC: Derivative data saved (1807 records). [2025-09-18T22:52:44.598203] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-09-18T22:52:44.600952] [INFO ] [MAIN ] Derivative Progress: 876/2075 symbols completed. HMC took 1.1s. Estimated remaining: 7m 45s. Rate: 154.8 symbols/min [2025-09-18T22:52:44.601295] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:44.646355] [DEBUG] [LOCAL ] HMY: Loaded 53515 existing records from primary storage. [2025-09-18T22:52:44.646697] [INFO ] [MAIN ] HMY: Loaded 53515 primary data records. [2025-09-18T22:52:44.755415] [DEBUG] [LOCAL ] HNI: Loaded 29086 existing records from primary storage. [2025-09-18T22:52:44.771947] [INFO ] [MAIN ] HNI: Loaded 29086 primary data records. [2025-09-18T22:52:45.083733] [DEBUG] [LOCAL ] HOG: Loaded 51670 existing records from primary storage. [2025-09-18T22:52:45.095411] [INFO ] [MAIN ] HOG: Loaded 51670 primary data records. [2025-09-18T22:52:45.617722] [DEBUG] [MAIN ] HMY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:45.620146] [INFO ] [MAIN ] HMY: Generated 1807 derivative records from 53515 primary records. [2025-09-18T22:52:45.620364] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-09-18T22:52:45.646339] [DEBUG] [MAIN ] HNI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:45.647270] [INFO ] [MAIN ] HNI: Generated 1807 derivative records from 29086 primary records. [2025-09-18T22:52:45.648145] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-09-18T22:52:45.669680] [DEBUG] [LOCAL ] HMY: Derivative data saved (1807 records). [2025-09-18T22:52:45.670007] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-09-18T22:52:45.672234] [INFO ] [MAIN ] Derivative Progress: 877/2075 symbols completed. HMY took 1.1s. Estimated remaining: 7m 45s. Rate: 154.5 symbols/min [2025-09-18T22:52:45.680169] [DEBUG] [LOCAL ] HNI: Derivative data saved (1807 records). [2025-09-18T22:52:45.685233] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:45.685399] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-09-18T22:52:45.688258] [INFO ] [MAIN ] Derivative Progress: 878/2075 symbols completed. HNI took 1.1s. Estimated remaining: 7m 44s. Rate: 154.6 symbols/min [2025-09-18T22:52:45.685793] [DEBUG] [MAIN ] HOG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:45.689972] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:45.689863] [INFO ] [MAIN ] HOG: Generated 1807 derivative records from 51670 primary records. [2025-09-18T22:52:45.690307] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-09-18T22:52:45.710461] [DEBUG] [LOCAL ] HOG: Derivative data saved (1807 records). [2025-09-18T22:52:45.710717] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-09-18T22:52:45.713474] [INFO ] [MAIN ] Derivative Progress: 879/2075 symbols completed. HOG took 1.1s. Estimated remaining: 7m 44s. Rate: 154.8 symbols/min [2025-09-18T22:52:45.713942] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:45.739137] [DEBUG] [LOCAL ] HOV: Loaded 13888 existing records from primary storage. [2025-09-18T22:52:45.739341] [INFO ] [MAIN ] HOV: Loaded 13888 primary data records. [2025-09-18T22:52:45.868872] [DEBUG] [LOCAL ] HOMB: Loaded 44071 existing records from primary storage. [2025-09-18T22:52:45.895745] [INFO ] [MAIN ] HOMB: Loaded 44071 primary data records. [2025-09-18T22:52:45.976297] [DEBUG] [LOCAL ] HOUS: Loaded 44321 existing records from primary storage. [2025-09-18T22:52:45.998218] [INFO ] [MAIN ] HOUS: Loaded 44321 primary data records. [2025-09-18T22:52:46.732408] [DEBUG] [MAIN ] HOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:46.733425] [INFO ] [MAIN ] HOV: Generated 1807 derivative records from 13888 primary records. [2025-09-18T22:52:46.733530] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-09-18T22:52:46.764434] [DEBUG] [LOCAL ] HOV: Derivative data saved (1807 records). [2025-09-18T22:52:46.764772] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-09-18T22:52:46.766660] [INFO ] [MAIN ] Derivative Progress: 880/2075 symbols completed. HOV took 1.1s. Estimated remaining: 7m 44s. Rate: 154.5 symbols/min [2025-09-18T22:52:46.767902] [DEBUG] [MAIN ] HOMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:46.768136] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:46.769014] [INFO ] [MAIN ] HOMB: Generated 1807 derivative records from 44071 primary records. [2025-09-18T22:52:46.770230] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-09-18T22:52:46.799808] [DEBUG] [MAIN ] HOUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:46.800321] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1807 records). [2025-09-18T22:52:46.801173] [INFO ] [MAIN ] HOUS: Generated 1807 derivative records from 44321 primary records. [2025-09-18T22:52:46.801280] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-09-18T22:52:46.803674] [INFO ] [MAIN ] Derivative Progress: 881/2075 symbols completed. HOMB took 1.1s. Estimated remaining: 7m 43s. Rate: 154.6 symbols/min [2025-09-18T22:52:46.801362] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-09-18T22:52:46.804929] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:46.821190] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1807 records). [2025-09-18T22:52:46.821348] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-09-18T22:52:46.823990] [INFO ] [MAIN ] Derivative Progress: 882/2075 symbols completed. HOUS took 1.1s. Estimated remaining: 7m 42s. Rate: 154.8 symbols/min [2025-09-18T22:52:46.824366] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:46.847824] [DEBUG] [LOCAL ] HPF: Loaded 7301 existing records from primary storage. [2025-09-18T22:52:46.847954] [INFO ] [MAIN ] HPF: Loaded 7301 primary data records. [2025-09-18T22:52:47.022098] [DEBUG] [LOCAL ] HP: Loaded 52009 existing records from primary storage. [2025-09-18T22:52:47.175853] [INFO ] [MAIN ] HP: Loaded 52009 primary data records. [2025-09-18T22:52:47.202928] [DEBUG] [LOCAL ] HPE: Loaded 54087 existing records from primary storage. [2025-09-18T22:52:47.229264] [INFO ] [MAIN ] HPE: Loaded 54087 primary data records. [2025-09-18T22:52:47.865288] [DEBUG] [MAIN ] HPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:47.866677] [INFO ] [MAIN ] HPF: Generated 1807 derivative records from 7301 primary records. [2025-09-18T22:52:47.866779] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-09-18T22:52:47.884100] [DEBUG] [LOCAL ] HPF: Derivative data saved (1807 records). [2025-09-18T22:52:47.884499] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-09-18T22:52:47.886885] [INFO ] [MAIN ] Derivative Progress: 883/2075 symbols completed. HPF took 1.1s. Estimated remaining: 7m 43s. Rate: 154.5 symbols/min [2025-09-18T22:52:47.903077] [DEBUG] [MAIN ] HP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:47.903830] [INFO ] [MAIN ] HP: Generated 1807 derivative records from 52009 primary records. [2025-09-18T22:52:47.903971] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-09-18T22:52:47.931238] [DEBUG] [MAIN ] HPE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:47.932112] [INFO ] [MAIN ] HPE: Generated 1807 derivative records from 54087 primary records. [2025-09-18T22:52:47.932581] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-09-18T22:52:47.950986] [DEBUG] [LOCAL ] HPE: Derivative data saved (1807 records). [2025-09-18T22:52:47.951076] [DEBUG] [LOCAL ] HP: Derivative data saved (1807 records). [2025-09-18T22:52:47.951155] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-09-18T22:52:47.951241] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-09-18T22:52:47.953320] [INFO ] [MAIN ] Derivative Progress: 884/2075 symbols completed. HP took 1.2s. Estimated remaining: 7m 42s. Rate: 154.6 symbols/min [2025-09-18T22:52:47.956275] [INFO ] [MAIN ] Derivative Progress: 885/2075 symbols completed. HPE took 1.2s. Estimated remaining: 7m 41s. Rate: 154.8 symbols/min [2025-09-18T22:52:47.956824] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:47.957017] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:47.956980] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:47.970624] [DEBUG] [LOCAL ] HPI: Loaded 10086 existing records from primary storage. [2025-09-18T22:52:47.970788] [INFO ] [MAIN ] HPI: Loaded 10086 primary data records. [2025-09-18T22:52:48.333632] [DEBUG] [LOCAL ] HPP: Loaded 51117 existing records from primary storage. [2025-09-18T22:52:48.334484] [DEBUG] [LOCAL ] HPQ: Loaded 54059 existing records from primary storage. [2025-09-18T22:52:48.335523] [INFO ] [MAIN ] HPQ: Loaded 54059 primary data records. [2025-09-18T22:52:48.335177] [INFO ] [MAIN ] HPP: Loaded 51117 primary data records. [2025-09-18T22:52:48.949230] [DEBUG] [MAIN ] HPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:48.950865] [INFO ] [MAIN ] HPI: Generated 1807 derivative records from 10086 primary records. [2025-09-18T22:52:48.951160] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-09-18T22:52:48.972814] [DEBUG] [LOCAL ] HPI: Derivative data saved (1807 records). [2025-09-18T22:52:48.973214] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-09-18T22:52:48.975793] [INFO ] [MAIN ] Derivative Progress: 886/2075 symbols completed. HPI took 1.0s. Estimated remaining: 7m 42s. Rate: 154.5 symbols/min [2025-09-18T22:52:48.976435] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:49.002899] [DEBUG] [MAIN ] HPQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:49.011093] [INFO ] [MAIN ] HPQ: Generated 1807 derivative records from 54059 primary records. [2025-09-18T22:52:49.011528] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-09-18T22:52:49.011418] [DEBUG] [MAIN ] HPP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:49.012901] [INFO ] [MAIN ] HPP: Generated 1807 derivative records from 51117 primary records. [2025-09-18T22:52:49.013213] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-09-18T22:52:49.037327] [DEBUG] [LOCAL ] HPS: Loaded 10359 existing records from primary storage. [2025-09-18T22:52:49.041422] [INFO ] [MAIN ] HPS: Loaded 10359 primary data records. [2025-09-18T22:52:49.067291] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1807 records). [2025-09-18T22:52:49.081135] [DEBUG] [LOCAL ] HPP: Derivative data saved (1807 records). [2025-09-18T22:52:49.105940] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-09-18T22:52:49.106006] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-09-18T22:52:49.122531] [INFO ] [MAIN ] Derivative Progress: 887/2075 symbols completed. HPQ took 1.2s. Estimated remaining: 7m 41s. Rate: 154.6 symbols/min [2025-09-18T22:52:49.141682] [INFO ] [MAIN ] Derivative Progress: 888/2075 symbols completed. HPP took 1.2s. Estimated remaining: 7m 40s. Rate: 154.8 symbols/min [2025-09-18T22:52:49.148360] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:49.160241] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:49.379426] [DEBUG] [LOCAL ] HQH: Loaded 25114 existing records from primary storage. [2025-09-18T22:52:49.379734] [DEBUG] [LOCAL ] HQL: Loaded 16275 existing records from primary storage. [2025-09-18T22:52:49.379970] [INFO ] [MAIN ] HQH: Loaded 25114 primary data records. [2025-09-18T22:52:49.380029] [INFO ] [MAIN ] HQL: Loaded 16275 primary data records. [2025-09-18T22:52:50.055313] [DEBUG] [MAIN ] HPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:50.057036] [INFO ] [MAIN ] HPS: Generated 1807 derivative records from 10359 primary records. [2025-09-18T22:52:50.057224] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-09-18T22:52:50.080307] [DEBUG] [LOCAL ] HPS: Derivative data saved (1807 records). [2025-09-18T22:52:50.081589] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-09-18T22:52:50.083785] [INFO ] [MAIN ] Derivative Progress: 889/2075 symbols completed. HPS took 1.1s. Estimated remaining: 7m 40s. Rate: 154.6 symbols/min [2025-09-18T22:52:50.084339] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:50.102281] [DEBUG] [MAIN ] HQH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:50.103188] [INFO ] [MAIN ] HQH: Generated 1807 derivative records from 25114 primary records. [2025-09-18T22:52:50.103557] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-09-18T22:52:50.118979] [DEBUG] [MAIN ] HQL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:50.131505] [INFO ] [MAIN ] HQL: Generated 1807 derivative records from 16275 primary records. [2025-09-18T22:52:50.132197] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-09-18T22:52:50.151412] [DEBUG] [LOCAL ] HQL: Derivative data saved (1807 records). [2025-09-18T22:52:50.152275] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-09-18T22:52:50.155266] [INFO ] [MAIN ] Derivative Progress: 890/2075 symbols completed. HQL took 1.0s. Estimated remaining: 7m 40s. Rate: 154.7 symbols/min [2025-09-18T22:52:50.156424] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:50.157404] [DEBUG] [LOCAL ] HQH: Derivative data saved (1807 records). [2025-09-18T22:52:50.158010] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-09-18T22:52:50.160455] [INFO ] [MAIN ] Derivative Progress: 891/2075 symbols completed. HQH took 1.0s. Estimated remaining: 7m 39s. Rate: 154.9 symbols/min [2025-09-18T22:52:50.160859] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:50.209863] [DEBUG] [LOCAL ] HR: Loaded 52355 existing records from primary storage. [2025-09-18T22:52:50.210204] [INFO ] [MAIN ] HR: Loaded 52355 primary data records. [2025-09-18T22:52:50.339360] [DEBUG] [LOCAL ] HRI: Loaded 33522 existing records from primary storage. [2025-09-18T22:52:50.348744] [INFO ] [MAIN ] HRI: Loaded 33522 primary data records. [2025-09-18T22:52:50.480466] [DEBUG] [LOCAL ] HRB: Loaded 48974 existing records from primary storage. [2025-09-18T22:52:50.560356] [INFO ] [MAIN ] HRB: Loaded 48974 primary data records. [2025-09-18T22:52:51.247683] [DEBUG] [MAIN ] HR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:51.249688] [INFO ] [MAIN ] HR: Generated 1807 derivative records from 52355 primary records. [2025-09-18T22:52:51.252102] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-09-18T22:52:51.281229] [DEBUG] [MAIN ] HRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:51.283326] [INFO ] [MAIN ] HRI: Generated 1807 derivative records from 33522 primary records. [2025-09-18T22:52:51.283896] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-09-18T22:52:51.304277] [DEBUG] [LOCAL ] HRI: Derivative data saved (1807 records). [2025-09-18T22:52:51.302952] [DEBUG] [LOCAL ] HR: Derivative data saved (1807 records). [2025-09-18T22:52:51.304510] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-09-18T22:52:51.309931] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-09-18T22:52:51.309661] [INFO ] [MAIN ] Derivative Progress: 892/2075 symbols completed. HRI took 1.1s. Estimated remaining: 7m 39s. Rate: 154.5 symbols/min [2025-09-18T22:52:51.312387] [INFO ] [MAIN ] Derivative Progress: 893/2075 symbols completed. HR took 1.2s. Estimated remaining: 7m 38s. Rate: 154.7 symbols/min [2025-09-18T22:52:51.312519] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:51.320882] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:51.326376] [DEBUG] [MAIN ] HRB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:51.327317] [INFO ] [MAIN ] HRB: Generated 1807 derivative records from 48974 primary records. [2025-09-18T22:52:51.328018] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-09-18T22:52:51.344816] [DEBUG] [LOCAL ] HRB: Derivative data saved (1807 records). [2025-09-18T22:52:51.345896] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-09-18T22:52:51.348679] [INFO ] [MAIN ] Derivative Progress: 894/2075 symbols completed. HRB took 1.2s. Estimated remaining: 7m 38s. Rate: 154.9 symbols/min [2025-09-18T22:52:51.349150] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:51.374208] [DEBUG] [LOCAL ] HSHP: Loaded 15834 existing records from primary storage. [2025-09-18T22:52:51.374356] [INFO ] [MAIN ] HSHP: Loaded 15834 primary data records. [2025-09-18T22:52:51.506036] [DEBUG] [LOCAL ] HRTG: Loaded 32581 existing records from primary storage. [2025-09-18T22:52:51.506286] [INFO ] [MAIN ] HRTG: Loaded 32581 primary data records. [2025-09-18T22:52:51.697382] [DEBUG] [LOCAL ] HRL: Loaded 53469 existing records from primary storage. [2025-09-18T22:52:51.844042] [INFO ] [MAIN ] HRL: Loaded 53469 primary data records. [2025-09-18T22:52:52.403288] [DEBUG] [MAIN ] HSHP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:52.405037] [INFO ] [MAIN ] HSHP: Generated 1807 derivative records from 15834 primary records. [2025-09-18T22:52:52.405820] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-09-18T22:52:52.427000] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1807 records). [2025-09-18T22:52:52.427692] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-09-18T22:52:52.432177] [INFO ] [MAIN ] Derivative Progress: 895/2075 symbols completed. HSHP took 1.1s. Estimated remaining: 7m 38s. Rate: 154.6 symbols/min [2025-09-18T22:52:52.433613] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:52.448828] [DEBUG] [MAIN ] HRTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:52.450047] [INFO ] [MAIN ] HRTG: Generated 1807 derivative records from 32581 primary records. [2025-09-18T22:52:52.463088] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-09-18T22:52:52.463417] [DEBUG] [MAIN ] HRL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:52.465273] [INFO ] [MAIN ] HRL: Generated 1807 derivative records from 53469 primary records. [2025-09-18T22:52:52.465602] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-09-18T22:52:52.495558] [DEBUG] [LOCAL ] HRL: Derivative data saved (1807 records). [2025-09-18T22:52:52.496175] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-09-18T22:52:52.498979] [INFO ] [MAIN ] Derivative Progress: 896/2075 symbols completed. HRL took 1.2s. Estimated remaining: 7m 37s. Rate: 154.7 symbols/min [2025-09-18T22:52:52.500155] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:52.502427] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1807 records). [2025-09-18T22:52:52.502576] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-09-18T22:52:52.505283] [INFO ] [MAIN ] Derivative Progress: 897/2075 symbols completed. HRTG took 1.2s. Estimated remaining: 7m 36s. Rate: 154.9 symbols/min [2025-09-18T22:52:52.505710] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:52.536201] [DEBUG] [LOCAL ] HTD: Loaded 13557 existing records from primary storage. [2025-09-18T22:52:52.536378] [INFO ] [MAIN ] HTD: Loaded 13557 primary data records. [2025-09-18T22:52:52.658992] [DEBUG] [LOCAL ] HSY: Loaded 50876 existing records from primary storage. [2025-09-18T22:52:52.662604] [INFO ] [MAIN ] HSY: Loaded 50876 primary data records. [2025-09-18T22:52:53.060690] [DEBUG] [LOCAL ] HTGC: Loaded 48106 existing records from primary storage. [2025-09-18T22:52:53.071578] [INFO ] [MAIN ] HTGC: Loaded 48106 primary data records. [2025-09-18T22:52:53.619298] [DEBUG] [MAIN ] HTD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:53.620892] [INFO ] [MAIN ] HTD: Generated 1807 derivative records from 13557 primary records. [2025-09-18T22:52:53.621499] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-09-18T22:52:53.641554] [DEBUG] [LOCAL ] HTD: Derivative data saved (1807 records). [2025-09-18T22:52:53.643394] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-09-18T22:52:53.647849] [INFO ] [MAIN ] Derivative Progress: 898/2075 symbols completed. HTD took 1.1s. Estimated remaining: 7m 37s. Rate: 154.5 symbols/min [2025-09-18T22:52:53.662060] [DEBUG] [MAIN ] HSY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:53.662818] [INFO ] [MAIN ] HSY: Generated 1807 derivative records from 50876 primary records. [2025-09-18T22:52:53.663070] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-09-18T22:52:53.681887] [DEBUG] [LOCAL ] HSY: Derivative data saved (1807 records). [2025-09-18T22:52:53.682158] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-09-18T22:52:53.684478] [INFO ] [MAIN ] Derivative Progress: 899/2075 symbols completed. HSY took 1.3s. Estimated remaining: 7m 36s. Rate: 154.7 symbols/min [2025-09-18T22:52:53.697321] [DEBUG] [MAIN ] HTGC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:53.697958] [INFO ] [MAIN ] HTGC: Generated 1807 derivative records from 48106 primary records. [2025-09-18T22:52:53.698022] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-09-18T22:52:53.713939] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1807 records). [2025-09-18T22:52:53.714009] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-09-18T22:52:53.716586] [INFO ] [MAIN ] Derivative Progress: 900/2075 symbols completed. HTGC took 1.2s. Estimated remaining: 7m 35s. Rate: 154.8 symbols/min [2025-09-18T22:52:53.717509] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:53.717638] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:53.717741] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:53.794758] [DEBUG] [LOCAL ] HUBS: Loaded 40122 existing records from primary storage. [2025-09-18T22:52:53.796035] [DEBUG] [LOCAL ] HTH: Loaded 33114 existing records from primary storage. [2025-09-18T22:52:53.795464] [INFO ] [MAIN ] HUBS: Loaded 40122 primary data records. [2025-09-18T22:52:53.796362] [INFO ] [MAIN ] HTH: Loaded 33114 primary data records. [2025-09-18T22:52:53.973978] [DEBUG] [LOCAL ] HUBB: Loaded 37812 existing records from primary storage. [2025-09-18T22:52:53.998691] [INFO ] [MAIN ] HUBB: Loaded 37812 primary data records. [2025-09-18T22:52:54.881029] [DEBUG] [MAIN ] HUBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:54.882407] [INFO ] [MAIN ] HUBS: Generated 1807 derivative records from 40122 primary records. [2025-09-18T22:52:54.882896] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-09-18T22:52:54.905131] [DEBUG] [MAIN ] HTH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:54.913786] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1807 records). [2025-09-18T22:52:54.915163] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-09-18T22:52:54.914820] [INFO ] [MAIN ] HTH: Generated 1807 derivative records from 33114 primary records. [2025-09-18T22:52:54.917409] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-09-18T22:52:54.917202] [INFO ] [MAIN ] Derivative Progress: 901/2075 symbols completed. HUBS took 1.2s. Estimated remaining: 7m 36s. Rate: 154.5 symbols/min [2025-09-18T22:52:54.918559] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:54.936421] [DEBUG] [LOCAL ] HTH: Derivative data saved (1807 records). [2025-09-18T22:52:54.937570] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-09-18T22:52:54.940054] [INFO ] [MAIN ] Derivative Progress: 902/2075 symbols completed. HTH took 1.2s. Estimated remaining: 7m 35s. Rate: 154.6 symbols/min [2025-09-18T22:52:54.941168] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:54.955445] [DEBUG] [MAIN ] HUBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:54.956392] [INFO ] [MAIN ] HUBB: Generated 1807 derivative records from 37812 primary records. [2025-09-18T22:52:54.956509] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-09-18T22:52:54.976244] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1807 records). [2025-09-18T22:52:54.976520] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-09-18T22:52:54.979150] [INFO ] [MAIN ] Derivative Progress: 903/2075 symbols completed. HUBB took 1.3s. Estimated remaining: 7m 34s. Rate: 154.8 symbols/min [2025-09-18T22:52:54.979525] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:55.033502] [DEBUG] [LOCAL ] HUM: Loaded 49197 existing records from primary storage. [2025-09-18T22:52:55.033713] [INFO ] [MAIN ] HUM: Loaded 49197 primary data records. [2025-09-18T22:52:55.206058] [DEBUG] [LOCAL ] HUYA: Loaded 44714 existing records from primary storage. [2025-09-18T22:52:55.206940] [DEBUG] [LOCAL ] HUN: Loaded 53591 existing records from primary storage. [2025-09-18T22:52:55.207234] [INFO ] [MAIN ] HUYA: Loaded 44714 primary data records. [2025-09-18T22:52:55.230423] [INFO ] [MAIN ] HUN: Loaded 53591 primary data records. [2025-09-18T22:52:56.088114] [DEBUG] [MAIN ] HUM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:56.089113] [INFO ] [MAIN ] HUM: Generated 1807 derivative records from 49197 primary records. [2025-09-18T22:52:56.089292] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-09-18T22:52:56.107749] [DEBUG] [LOCAL ] HUM: Derivative data saved (1807 records). [2025-09-18T22:52:56.108780] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-09-18T22:52:56.111618] [INFO ] [MAIN ] Derivative Progress: 904/2075 symbols completed. HUM took 1.2s. Estimated remaining: 7m 35s. Rate: 154.5 symbols/min [2025-09-18T22:52:56.112008] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:56.128512] [DEBUG] [MAIN ] HUYA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:56.129444] [INFO ] [MAIN ] HUYA: Generated 1807 derivative records from 44714 primary records. [2025-09-18T22:52:56.129688] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-09-18T22:52:56.143009] [DEBUG] [MAIN ] HUN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:56.143930] [INFO ] [MAIN ] HUN: Generated 1807 derivative records from 53591 primary records. [2025-09-18T22:52:56.144206] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-09-18T22:52:56.180541] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1807 records). [2025-09-18T22:52:56.189192] [DEBUG] [LOCAL ] HVT: Loaded 16375 existing records from primary storage. [2025-09-18T22:52:56.187539] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-09-18T22:52:56.193101] [INFO ] [MAIN ] Derivative Progress: 905/2075 symbols completed. HUYA took 1.2s. Estimated remaining: 7m 34s. Rate: 154.6 symbols/min [2025-09-18T22:52:56.193222] [INFO ] [MAIN ] HVT: Loaded 16375 primary data records. [2025-09-18T22:52:56.194751] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:56.276741] [DEBUG] [LOCAL ] HUN: Derivative data saved (1807 records). [2025-09-18T22:52:56.304869] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-09-18T22:52:56.324200] [INFO ] [MAIN ] Derivative Progress: 906/2075 symbols completed. HUN took 1.4s. Estimated remaining: 7m 33s. Rate: 154.7 symbols/min [2025-09-18T22:52:56.382046] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:56.559024] [DEBUG] [LOCAL ] HWM: Loaded 53421 existing records from primary storage. [2025-09-18T22:52:56.559559] [INFO ] [MAIN ] HWM: Loaded 53421 primary data records. [2025-09-18T22:52:56.742328] [DEBUG] [LOCAL ] HXL: Loaded 46545 existing records from primary storage. [2025-09-18T22:52:56.776696] [INFO ] [MAIN ] HXL: Loaded 46545 primary data records. [2025-09-18T22:52:56.952753] [DEBUG] [MAIN ] HVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:56.999974] [INFO ] [MAIN ] HVT: Generated 1807 derivative records from 16375 primary records. [2025-09-18T22:52:57.024228] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-09-18T22:52:57.128684] [DEBUG] [LOCAL ] HVT: Derivative data saved (1807 records). [2025-09-18T22:52:57.178728] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-09-18T22:52:57.250893] [INFO ] [MAIN ] Derivative Progress: 907/2075 symbols completed. HVT took 1.1s. Estimated remaining: 7m 34s. Rate: 154.5 symbols/min [2025-09-18T22:52:57.252085] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:57.279314] [DEBUG] [LOCAL ] HY: Loaded 10522 existing records from primary storage. [2025-09-18T22:52:57.285561] [DEBUG] [MAIN ] HWM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:57.285160] [INFO ] [MAIN ] HY: Loaded 10522 primary data records. [2025-09-18T22:52:57.286591] [INFO ] [MAIN ] HWM: Generated 1807 derivative records from 53421 primary records. [2025-09-18T22:52:57.287047] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-09-18T22:52:57.415101] [DEBUG] [LOCAL ] HWM: Derivative data saved (1807 records). [2025-09-18T22:52:57.469162] [DEBUG] [MAIN ] HXL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:57.468807] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-09-18T22:52:57.511085] [INFO ] [MAIN ] HXL: Generated 1807 derivative records from 46545 primary records. [2025-09-18T22:52:57.511268] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-09-18T22:52:57.504716] [INFO ] [MAIN ] Derivative Progress: 908/2075 symbols completed. HWM took 1.3s. Estimated remaining: 7m 33s. Rate: 154.5 symbols/min [2025-09-18T22:52:57.633236] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:57.655839] [DEBUG] [LOCAL ] HXL: Derivative data saved (1807 records). [2025-09-18T22:52:57.660456] [DEBUG] [LOCAL ] HYI: Loaded 8946 existing records from primary storage. [2025-09-18T22:52:57.660240] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-09-18T22:52:57.663254] [INFO ] [MAIN ] Derivative Progress: 909/2075 symbols completed. HXL took 1.3s. Estimated remaining: 7m 32s. Rate: 154.6 symbols/min [2025-09-18T22:52:57.660709] [INFO ] [MAIN ] HYI: Loaded 8946 primary data records. [2025-09-18T22:52:57.664195] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:58.045569] [DEBUG] [LOCAL ] HYT: Loaded 33425 existing records from primary storage. [2025-09-18T22:52:58.044548] [DEBUG] [MAIN ] HY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:58.046697] [INFO ] [MAIN ] HY: Generated 1807 derivative records from 10522 primary records. [2025-09-18T22:52:58.045782] [INFO ] [MAIN ] HYT: Loaded 33425 primary data records. [2025-09-18T22:52:58.046795] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-09-18T22:52:58.168763] [DEBUG] [LOCAL ] HY: Derivative data saved (1807 records). [2025-09-18T22:52:58.172818] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-09-18T22:52:58.180362] [INFO ] [MAIN ] Derivative Progress: 910/2075 symbols completed. HY took 0.9s. Estimated remaining: 7m 32s. Rate: 154.6 symbols/min [2025-09-18T22:52:58.214927] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:58.377081] [DEBUG] [LOCAL ] HYTR: Loaded 3236 existing records from primary storage. [2025-09-18T22:52:58.377422] [INFO ] [MAIN ] HYTR: Loaded 3236 primary data records. [2025-09-18T22:52:58.703408] [DEBUG] [MAIN ] HYI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:58.714914] [INFO ] [MAIN ] HYI: Generated 1807 derivative records from 8946 primary records. [2025-09-18T22:52:58.715145] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-09-18T22:52:58.740004] [DEBUG] [LOCAL ] HYI: Derivative data saved (1807 records). [2025-09-18T22:52:58.740935] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-09-18T22:52:58.744022] [INFO ] [MAIN ] Derivative Progress: 911/2075 symbols completed. HYI took 1.1s. Estimated remaining: 7m 32s. Rate: 154.5 symbols/min [2025-09-18T22:52:58.744571] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:58.759981] [DEBUG] [MAIN ] HYT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:58.760799] [INFO ] [MAIN ] HYT: Generated 1807 derivative records from 33425 primary records. [2025-09-18T22:52:58.761149] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-09-18T22:52:58.778359] [DEBUG] [LOCAL ] HYT: Derivative data saved (1807 records). [2025-09-18T22:52:58.778764] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-09-18T22:52:58.783680] [INFO ] [MAIN ] Derivative Progress: 912/2075 symbols completed. HYT took 1.1s. Estimated remaining: 7m 31s. Rate: 154.7 symbols/min [2025-09-18T22:52:58.784000] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:58.807965] [DEBUG] [MAIN ] HYTR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:52:58.808230] [DEBUG] [LOCAL ] IAE: Loaded 5777 existing records from primary storage. [2025-09-18T22:52:58.816514] [INFO ] [MAIN ] IAE: Loaded 5777 primary data records. [2025-09-18T22:52:58.817479] [INFO ] [MAIN ] HYTR: Generated 1806 derivative records from 3236 primary records. [2025-09-18T22:52:58.822807] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-09-18T22:52:58.937565] [DEBUG] [LOCAL ] HZO: Loaded 29607 existing records from primary storage. [2025-09-18T22:52:58.950902] [INFO ] [MAIN ] HZO: Loaded 29607 primary data records. [2025-09-18T22:52:58.969354] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1806 records). [2025-09-18T22:52:59.018237] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-09-18T22:52:59.031252] [INFO ] [MAIN ] Derivative Progress: 913/2075 symbols completed. HYTR took 0.8s. Estimated remaining: 7m 31s. Rate: 154.7 symbols/min [2025-09-18T22:52:59.488824] [DEBUG] [MAIN ] IAE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:59.489729] [INFO ] [MAIN ] IAE: Generated 1807 derivative records from 5777 primary records. [2025-09-18T22:52:59.489919] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-09-18T22:52:59.505724] [DEBUG] [LOCAL ] IAE: Derivative data saved (1807 records). [2025-09-18T22:52:59.505845] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-09-18T22:52:59.507816] [INFO ] [MAIN ] Derivative Progress: 914/2075 symbols completed. IAE took 0.7s. Estimated remaining: 7m 30s. Rate: 154.7 symbols/min [2025-09-18T22:52:59.523206] [DEBUG] [MAIN ] HZO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:52:59.523919] [INFO ] [MAIN ] HZO: Generated 1807 derivative records from 29607 primary records. [2025-09-18T22:52:59.523981] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-09-18T22:52:59.539723] [DEBUG] [LOCAL ] HZO: Derivative data saved (1807 records). [2025-09-18T22:52:59.539833] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-09-18T22:52:59.542336] [INFO ] [MAIN ] Derivative Progress: 915/2075 symbols completed. HZO took 0.8s. Estimated remaining: 7m 29s. Rate: 154.8 symbols/min [2025-09-18T22:52:59.543452] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:59.543715] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:59.543939] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:52:59.635978] [DEBUG] [LOCAL ] IBN: Loaded 53316 existing records from primary storage. [2025-09-18T22:52:59.636212] [INFO ] [MAIN ] IBN: Loaded 53316 primary data records. [2025-09-18T22:52:59.744469] [DEBUG] [LOCAL ] IBM: Loaded 53999 existing records from primary storage. [2025-09-18T22:52:59.750925] [INFO ] [MAIN ] IBM: Loaded 53999 primary data records. [2025-09-18T22:52:59.774476] [DEBUG] [LOCAL ] IAG: Loaded 53823 existing records from primary storage. [2025-09-18T22:52:59.798239] [INFO ] [MAIN ] IAG: Loaded 53823 primary data records. [2025-09-18T22:53:00.684730] [DEBUG] [MAIN ] IBN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:00.685925] [INFO ] [MAIN ] IBN: Generated 1807 derivative records from 53316 primary records. [2025-09-18T22:53:00.686294] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-09-18T22:53:00.704470] [DEBUG] [LOCAL ] IBN: Derivative data saved (1807 records). [2025-09-18T22:53:00.704574] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-09-18T22:53:00.707306] [INFO ] [MAIN ] Derivative Progress: 916/2075 symbols completed. IBN took 1.2s. Estimated remaining: 7m 30s. Rate: 154.5 symbols/min [2025-09-18T22:53:00.710298] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:00.724895] [DEBUG] [MAIN ] IBM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:00.726003] [INFO ] [MAIN ] IBM: Generated 1807 derivative records from 53999 primary records. [2025-09-18T22:53:00.726189] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-09-18T22:53:00.739776] [DEBUG] [MAIN ] IAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:00.740891] [INFO ] [MAIN ] IAG: Generated 1807 derivative records from 53823 primary records. [2025-09-18T22:53:00.752246] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-09-18T22:53:00.757438] [DEBUG] [LOCAL ] IBM: Derivative data saved (1807 records). [2025-09-18T22:53:00.757864] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-09-18T22:53:00.769246] [INFO ] [MAIN ] Derivative Progress: 917/2075 symbols completed. IBM took 1.2s. Estimated remaining: 7m 29s. Rate: 154.6 symbols/min [2025-09-18T22:53:00.777972] [DEBUG] [LOCAL ] IAG: Derivative data saved (1807 records). [2025-09-18T22:53:00.778087] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:00.778460] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-09-18T22:53:00.781271] [INFO ] [MAIN ] Derivative Progress: 918/2075 symbols completed. IAG took 1.2s. Estimated remaining: 7m 28s. Rate: 154.8 symbols/min [2025-09-18T22:53:00.781603] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:00.803920] [DEBUG] [LOCAL ] IBP: Loaded 29731 existing records from primary storage. [2025-09-18T22:53:00.804139] [INFO ] [MAIN ] IBP: Loaded 29731 primary data records. [2025-09-18T22:53:00.975416] [DEBUG] [LOCAL ] IBTA: Loaded 38598 existing records from primary storage. [2025-09-18T22:53:00.999604] [INFO ] [MAIN ] IBTA: Loaded 38598 primary data records. [2025-09-18T22:53:01.318417] [DEBUG] [LOCAL ] ICE: Loaded 53416 existing records from primary storage. [2025-09-18T22:53:01.351849] [INFO ] [MAIN ] ICE: Loaded 53416 primary data records. [2025-09-18T22:53:01.837842] [DEBUG] [MAIN ] IBP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:01.838862] [INFO ] [MAIN ] IBP: Generated 1807 derivative records from 29731 primary records. [2025-09-18T22:53:01.839019] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-09-18T22:53:01.872211] [DEBUG] [LOCAL ] IBP: Derivative data saved (1807 records). [2025-09-18T22:53:01.870613] [DEBUG] [MAIN ] IBTA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:01.872434] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-09-18T22:53:01.874447] [INFO ] [MAIN ] Derivative Progress: 919/2075 symbols completed. IBP took 1.2s. Estimated remaining: 7m 29s. Rate: 154.5 symbols/min [2025-09-18T22:53:01.875548] [INFO ] [MAIN ] IBTA: Generated 1807 derivative records from 38598 primary records. [2025-09-18T22:53:01.875883] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-09-18T22:53:01.876389] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:01.896336] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1807 records). [2025-09-18T22:53:01.899069] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-09-18T22:53:01.901682] [INFO ] [MAIN ] Derivative Progress: 920/2075 symbols completed. IBTA took 1.1s. Estimated remaining: 7m 28s. Rate: 154.7 symbols/min [2025-09-18T22:53:01.903041] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:01.923736] [DEBUG] [MAIN ] ICE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:01.924838] [INFO ] [MAIN ] ICE: Generated 1807 derivative records from 53416 primary records. [2025-09-18T22:53:01.932050] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-09-18T22:53:01.950843] [DEBUG] [LOCAL ] ICE: Derivative data saved (1807 records). [2025-09-18T22:53:01.964401] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-09-18T22:53:01.967598] [INFO ] [MAIN ] Derivative Progress: 921/2075 symbols completed. ICE took 1.2s. Estimated remaining: 7m 27s. Rate: 154.8 symbols/min [2025-09-18T22:53:01.968226] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:01.987890] [DEBUG] [LOCAL ] ICL: Loaded 39304 existing records from primary storage. [2025-09-18T22:53:01.997537] [INFO ] [MAIN ] ICL: Loaded 39304 primary data records. [2025-09-18T22:53:02.061831] [DEBUG] [LOCAL ] IDE: Loaded 8414 existing records from primary storage. [2025-09-18T22:53:02.098404] [INFO ] [MAIN ] IDE: Loaded 8414 primary data records. [2025-09-18T22:53:02.141164] [DEBUG] [LOCAL ] IDA: Loaded 32258 existing records from primary storage. [2025-09-18T22:53:02.166509] [INFO ] [MAIN ] IDA: Loaded 32258 primary data records. [2025-09-18T22:53:03.004218] [DEBUG] [MAIN ] ICL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:03.005374] [INFO ] [MAIN ] ICL: Generated 1807 derivative records from 39304 primary records. [2025-09-18T22:53:03.005766] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-09-18T22:53:03.023941] [DEBUG] [LOCAL ] ICL: Derivative data saved (1807 records). [2025-09-18T22:53:03.027351] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-09-18T22:53:03.030570] [INFO ] [MAIN ] Derivative Progress: 922/2075 symbols completed. ICL took 1.2s. Estimated remaining: 7m 28s. Rate: 154.5 symbols/min [2025-09-18T22:53:03.039101] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:03.053340] [DEBUG] [MAIN ] IDA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:03.059698] [INFO ] [MAIN ] IDA: Generated 1807 derivative records from 32258 primary records. [2025-09-18T22:53:03.059840] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-09-18T22:53:03.058718] [DEBUG] [MAIN ] IDE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:03.061102] [INFO ] [MAIN ] IDE: Generated 1807 derivative records from 8414 primary records. [2025-09-18T22:53:03.061249] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-09-18T22:53:03.098293] [DEBUG] [LOCAL ] IDE: Derivative data saved (1807 records). [2025-09-18T22:53:03.103818] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-09-18T22:53:03.098441] [DEBUG] [LOCAL ] IDA: Derivative data saved (1807 records). [2025-09-18T22:53:03.106444] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-09-18T22:53:03.106297] [INFO ] [MAIN ] Derivative Progress: 923/2075 symbols completed. IDE took 1.1s. Estimated remaining: 7m 27s. Rate: 154.6 symbols/min [2025-09-18T22:53:03.110186] [INFO ] [MAIN ] Derivative Progress: 924/2075 symbols completed. IDA took 1.2s. Estimated remaining: 7m 26s. Rate: 154.8 symbols/min [2025-09-18T22:53:03.110852] [DEBUG] [LOCAL ] IDT: Loaded 17622 existing records from primary storage. [2025-09-18T22:53:03.110992] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:03.111081] [INFO ] [MAIN ] IDT: Loaded 17622 primary data records. [2025-09-18T22:53:03.111427] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:03.461031] [DEBUG] [LOCAL ] IEX: Loaded 38692 existing records from primary storage. [2025-09-18T22:53:03.462232] [INFO ] [MAIN ] IEX: Loaded 38692 primary data records. [2025-09-18T22:53:03.598840] [DEBUG] [LOCAL ] IFF: Loaded 51320 existing records from primary storage. [2025-09-18T22:53:03.604342] [INFO ] [MAIN ] IFF: Loaded 51320 primary data records. [2025-09-18T22:53:03.924898] [DEBUG] [MAIN ] IDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:03.968049] [INFO ] [MAIN ] IDT: Generated 1807 derivative records from 17622 primary records. [2025-09-18T22:53:04.001670] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-09-18T22:53:04.194239] [DEBUG] [LOCAL ] IDT: Derivative data saved (1807 records). [2025-09-18T22:53:04.195062] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-09-18T22:53:04.197302] [INFO ] [MAIN ] Derivative Progress: 925/2075 symbols completed. IDT took 1.2s. Estimated remaining: 7m 27s. Rate: 154.5 symbols/min [2025-09-18T22:53:04.198104] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:04.220972] [DEBUG] [MAIN ] IEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:04.221907] [INFO ] [MAIN ] IEX: Generated 1807 derivative records from 38692 primary records. [2025-09-18T22:53:04.222104] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-09-18T22:53:04.246165] [DEBUG] [LOCAL ] IEX: Derivative data saved (1807 records). [2025-09-18T22:53:04.253260] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-09-18T22:53:04.255819] [INFO ] [MAIN ] Derivative Progress: 926/2075 symbols completed. IEX took 1.1s. Estimated remaining: 7m 26s. Rate: 154.6 symbols/min [2025-09-18T22:53:04.253758] [DEBUG] [LOCAL ] IFN: Loaded 18440 existing records from primary storage. [2025-09-18T22:53:04.256195] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:04.264398] [INFO ] [MAIN ] IFN: Loaded 18440 primary data records. [2025-09-18T22:53:04.308014] [DEBUG] [MAIN ] IFF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:04.320885] [INFO ] [MAIN ] IFF: Generated 1807 derivative records from 51320 primary records. [2025-09-18T22:53:04.337561] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-09-18T22:53:04.404256] [DEBUG] [LOCAL ] IFF: Derivative data saved (1807 records). [2025-09-18T22:53:04.414678] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-09-18T22:53:04.423137] [INFO ] [MAIN ] Derivative Progress: 927/2075 symbols completed. IFF took 1.3s. Estimated remaining: 7m 25s. Rate: 154.7 symbols/min [2025-09-18T22:53:04.449943] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:04.611093] [DEBUG] [LOCAL ] IFS: Loaded 23167 existing records from primary storage. [2025-09-18T22:53:04.612191] [INFO ] [MAIN ] IFS: Loaded 23167 primary data records. [2025-09-18T22:53:04.730475] [DEBUG] [LOCAL ] IGA: Loaded 9786 existing records from primary storage. [2025-09-18T22:53:04.731498] [INFO ] [MAIN ] IGA: Loaded 9786 primary data records. [2025-09-18T22:53:05.246635] [DEBUG] [MAIN ] IFN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:05.247741] [INFO ] [MAIN ] IFN: Generated 1807 derivative records from 18440 primary records. [2025-09-18T22:53:05.247933] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-09-18T22:53:05.271404] [DEBUG] [LOCAL ] IFN: Derivative data saved (1807 records). [2025-09-18T22:53:05.271905] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-09-18T22:53:05.274078] [INFO ] [MAIN ] Derivative Progress: 928/2075 symbols completed. IFN took 1.1s. Estimated remaining: 7m 25s. Rate: 154.5 symbols/min [2025-09-18T22:53:05.298931] [DEBUG] [MAIN ] IFS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:05.301349] [INFO ] [MAIN ] IFS: Generated 1807 derivative records from 23167 primary records. [2025-09-18T22:53:05.301611] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-09-18T22:53:05.315118] [DEBUG] [MAIN ] IGA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:05.323087] [INFO ] [MAIN ] IGA: Generated 1807 derivative records from 9786 primary records. [2025-09-18T22:53:05.326918] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-09-18T22:53:05.331977] [DEBUG] [LOCAL ] IFS: Derivative data saved (1807 records). [2025-09-18T22:53:05.342692] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-09-18T22:53:05.346537] [DEBUG] [LOCAL ] IGA: Derivative data saved (1807 records). [2025-09-18T22:53:05.348743] [INFO ] [MAIN ] Derivative Progress: 929/2075 symbols completed. IFS took 1.1s. Estimated remaining: 7m 25s. Rate: 154.7 symbols/min [2025-09-18T22:53:05.348865] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-09-18T22:53:05.351432] [INFO ] [MAIN ] Derivative Progress: 930/2075 symbols completed. IGA took 0.9s. Estimated remaining: 7m 24s. Rate: 154.8 symbols/min [2025-09-18T22:53:05.352072] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:05.352016] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:05.352293] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:05.360940] [DEBUG] [LOCAL ] IGI: Loaded 3767 existing records from primary storage. [2025-09-18T22:53:05.361119] [INFO ] [MAIN ] IGI: Loaded 3767 primary data records. [2025-09-18T22:53:05.485916] [DEBUG] [LOCAL ] IGD: Loaded 19399 existing records from primary storage. [2025-09-18T22:53:05.513230] [INFO ] [MAIN ] IGD: Loaded 19399 primary data records. [2025-09-18T22:53:05.608355] [DEBUG] [LOCAL ] IGR: Loaded 30764 existing records from primary storage. [2025-09-18T22:53:05.643277] [INFO ] [MAIN ] IGR: Loaded 30764 primary data records. [2025-09-18T22:53:06.395280] [DEBUG] [MAIN ] IGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:06.396084] [INFO ] [MAIN ] IGI: Generated 1807 derivative records from 3767 primary records. [2025-09-18T22:53:06.396430] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-09-18T22:53:06.413743] [DEBUG] [LOCAL ] IGI: Derivative data saved (1807 records). [2025-09-18T22:53:06.414035] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-09-18T22:53:06.423600] [INFO ] [MAIN ] Derivative Progress: 931/2075 symbols completed. IGI took 1.1s. Estimated remaining: 7m 24s. Rate: 154.5 symbols/min [2025-09-18T22:53:06.429028] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:06.429523] [DEBUG] [MAIN ] IGD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:06.430885] [INFO ] [MAIN ] IGD: Generated 1807 derivative records from 19399 primary records. [2025-09-18T22:53:06.431064] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-09-18T22:53:06.466859] [DEBUG] [MAIN ] IGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:06.466538] [DEBUG] [LOCAL ] IGD: Derivative data saved (1807 records). [2025-09-18T22:53:06.467147] [DEBUG] [LOCAL ] IHD: Loaded 7264 existing records from primary storage. [2025-09-18T22:53:06.467800] [INFO ] [MAIN ] IGR: Generated 1807 derivative records from 30764 primary records. [2025-09-18T22:53:06.467954] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-09-18T22:53:06.470410] [INFO ] [MAIN ] Derivative Progress: 932/2075 symbols completed. IGD took 1.1s. Estimated remaining: 7m 23s. Rate: 154.7 symbols/min [2025-09-18T22:53:06.470884] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-09-18T22:53:06.471204] [INFO ] [MAIN ] IHD: Loaded 7264 primary data records. [2025-09-18T22:53:06.470706] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:06.557909] [DEBUG] [LOCAL ] IGR: Derivative data saved (1807 records). [2025-09-18T22:53:06.572748] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-09-18T22:53:06.587449] [INFO ] [MAIN ] Derivative Progress: 933/2075 symbols completed. IGR took 1.2s. Estimated remaining: 7m 23s. Rate: 154.8 symbols/min [2025-09-18T22:53:06.616852] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:06.727442] [DEBUG] [LOCAL ] IHG: Loaded 25038 existing records from primary storage. [2025-09-18T22:53:06.859193] [INFO ] [MAIN ] IHG: Loaded 25038 primary data records. [2025-09-18T22:53:07.114532] [DEBUG] [LOCAL ] IHS: Loaded 39355 existing records from primary storage. [2025-09-18T22:53:07.262760] [INFO ] [MAIN ] IHS: Loaded 39355 primary data records. [2025-09-18T22:53:07.335728] [DEBUG] [MAIN ] IHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:07.345476] [INFO ] [MAIN ] IHD: Generated 1807 derivative records from 7264 primary records. [2025-09-18T22:53:07.382380] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-09-18T22:53:07.506878] [DEBUG] [LOCAL ] IHD: Derivative data saved (1807 records). [2025-09-18T22:53:07.507113] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-09-18T22:53:07.510165] [INFO ] [MAIN ] Derivative Progress: 934/2075 symbols completed. IHD took 1.1s. Estimated remaining: 7m 23s. Rate: 154.6 symbols/min [2025-09-18T22:53:07.510853] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:07.582604] [DEBUG] [LOCAL ] IIF: Loaded 5865 existing records from primary storage. [2025-09-18T22:53:07.584217] [INFO ] [MAIN ] IIF: Loaded 5865 primary data records. [2025-09-18T22:53:07.774906] [DEBUG] [MAIN ] IHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:07.965327] [INFO ] [MAIN ] IHG: Generated 1807 derivative records from 25038 primary records. [2025-09-18T22:53:08.001726] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-09-18T22:53:08.166287] [DEBUG] [LOCAL ] IHG: Derivative data saved (1807 records). [2025-09-18T22:53:08.287794] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-09-18T22:53:08.304107] [INFO ] [MAIN ] Derivative Progress: 935/2075 symbols completed. IHG took 1.8s. Estimated remaining: 7m 23s. Rate: 154.4 symbols/min [2025-09-18T22:53:08.305228] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:08.325454] [DEBUG] [MAIN ] IHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:08.326390] [INFO ] [MAIN ] IHS: Generated 1807 derivative records from 39355 primary records. [2025-09-18T22:53:08.331142] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-09-18T22:53:08.349997] [DEBUG] [LOCAL ] IIIN: Loaded 17104 existing records from primary storage. [2025-09-18T22:53:08.351369] [INFO ] [MAIN ] IIIN: Loaded 17104 primary data records. [2025-09-18T22:53:08.464401] [DEBUG] [LOCAL ] IHS: Derivative data saved (1807 records). [2025-09-18T22:53:08.464841] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-09-18T22:53:08.467561] [INFO ] [MAIN ] Derivative Progress: 936/2075 symbols completed. IHS took 1.9s. Estimated remaining: 7m 22s. Rate: 154.5 symbols/min [2025-09-18T22:53:08.485923] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:08.537813] [DEBUG] [MAIN ] IIF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:08.560635] [INFO ] [MAIN ] IIF: Generated 1807 derivative records from 5865 primary records. [2025-09-18T22:53:08.560845] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-09-18T22:53:08.745976] [DEBUG] [LOCAL ] IIF: Derivative data saved (1807 records). [2025-09-18T22:53:08.753571] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-09-18T22:53:08.756594] [INFO ] [MAIN ] Derivative Progress: 937/2075 symbols completed. IIF took 1.2s. Estimated remaining: 7m 22s. Rate: 154.5 symbols/min [2025-09-18T22:53:08.753417] [DEBUG] [LOCAL ] IIM: Loaded 16071 existing records from primary storage. [2025-09-18T22:53:08.757558] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:08.757486] [INFO ] [MAIN ] IIM: Loaded 16071 primary data records. [2025-09-18T22:53:09.109123] [DEBUG] [LOCAL ] IIPR: Loaded 29843 existing records from primary storage. [2025-09-18T22:53:09.109469] [DEBUG] [MAIN ] IIIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:09.110455] [INFO ] [MAIN ] IIPR: Loaded 29843 primary data records. [2025-09-18T22:53:09.146447] [INFO ] [MAIN ] IIIN: Generated 1807 derivative records from 17104 primary records. [2025-09-18T22:53:09.174157] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-09-18T22:53:09.267571] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1807 records). [2025-09-18T22:53:09.301628] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-09-18T22:53:09.337161] [INFO ] [MAIN ] Derivative Progress: 938/2075 symbols completed. IIIN took 1.0s. Estimated remaining: 7m 22s. Rate: 154.5 symbols/min [2025-09-18T22:53:09.459108] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:09.478241] [DEBUG] [MAIN ] IIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:09.479758] [INFO ] [MAIN ] IIM: Generated 1807 derivative records from 16071 primary records. [2025-09-18T22:53:09.479933] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-09-18T22:53:09.510006] [DEBUG] [LOCAL ] IIM: Derivative data saved (1807 records). [2025-09-18T22:53:09.510112] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-09-18T22:53:09.512573] [INFO ] [MAIN ] Derivative Progress: 939/2075 symbols completed. IIM took 1.0s. Estimated remaining: 7m 21s. Rate: 154.6 symbols/min [2025-09-18T22:53:09.513364] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:09.544431] [DEBUG] [MAIN ] IIPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:09.544018] [DEBUG] [LOCAL ] IMAX: Loaded 43011 existing records from primary storage. [2025-09-18T22:53:09.545336] [INFO ] [MAIN ] IIPR: Generated 1807 derivative records from 29843 primary records. [2025-09-18T22:53:09.544582] [INFO ] [MAIN ] IMAX: Loaded 43011 primary data records. [2025-09-18T22:53:09.545558] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-09-18T22:53:09.776304] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1807 records). [2025-09-18T22:53:09.776487] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-09-18T22:53:09.896886] [INFO ] [MAIN ] Derivative Progress: 940/2075 symbols completed. IIPR took 1.1s. Estimated remaining: 7m 21s. Rate: 154.6 symbols/min [2025-09-18T22:53:09.898170] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:09.914891] [DEBUG] [LOCAL ] INFA: Loaded 50516 existing records from primary storage. [2025-09-18T22:53:09.915868] [INFO ] [MAIN ] INFA: Loaded 50516 primary data records. [2025-09-18T22:53:10.288216] [DEBUG] [LOCAL ] INFY: Loaded 53988 existing records from primary storage. [2025-09-18T22:53:10.289102] [INFO ] [MAIN ] INFY: Loaded 53988 primary data records. [2025-09-18T22:53:10.288995] [DEBUG] [MAIN ] IMAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:10.289992] [INFO ] [MAIN ] IMAX: Generated 1807 derivative records from 43011 primary records. [2025-09-18T22:53:10.291073] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-09-18T22:53:10.489704] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1807 records). [2025-09-18T22:53:10.636591] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-09-18T22:53:10.652481] [INFO ] [MAIN ] Derivative Progress: 941/2075 symbols completed. IMAX took 1.2s. Estimated remaining: 7m 21s. Rate: 154.4 symbols/min [2025-09-18T22:53:10.665405] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:10.666191] [DEBUG] [MAIN ] INFA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:10.667719] [INFO ] [MAIN ] INFA: Generated 1807 derivative records from 50516 primary records. [2025-09-18T22:53:10.667990] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-09-18T22:53:10.689294] [DEBUG] [LOCAL ] INFA: Derivative data saved (1807 records). [2025-09-18T22:53:10.689638] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-09-18T22:53:10.692031] [INFO ] [MAIN ] Derivative Progress: 942/2075 symbols completed. INFA took 1.2s. Estimated remaining: 7m 20s. Rate: 154.5 symbols/min [2025-09-18T22:53:10.692697] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:10.712211] [DEBUG] [MAIN ] INFY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:10.726492] [INFO ] [MAIN ] INFY: Generated 1807 derivative records from 53988 primary records. [2025-09-18T22:53:10.727148] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-09-18T22:53:10.764702] [DEBUG] [LOCAL ] ING: Loaded 51271 existing records from primary storage. [2025-09-18T22:53:10.766108] [INFO ] [MAIN ] ING: Loaded 51271 primary data records. [2025-09-18T22:53:10.777922] [DEBUG] [LOCAL ] INFY: Derivative data saved (1807 records). [2025-09-18T22:53:10.778037] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-09-18T22:53:10.832743] [INFO ] [MAIN ] Derivative Progress: 943/2075 symbols completed. INFY took 0.9s. Estimated remaining: 7m 19s. Rate: 154.7 symbols/min [2025-09-18T22:53:10.878418] [DEBUG] [LOCAL ] INGM: Loaded 29495 existing records from primary storage. [2025-09-18T22:53:10.881062] [INFO ] [MAIN ] INGM: Loaded 29495 primary data records. [2025-09-18T22:53:11.420803] [DEBUG] [MAIN ] ING: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:11.421775] [INFO ] [MAIN ] ING: Generated 1807 derivative records from 51271 primary records. [2025-09-18T22:53:11.421964] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-09-18T22:53:11.453114] [DEBUG] [MAIN ] INGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:11.452908] [DEBUG] [LOCAL ] ING: Derivative data saved (1807 records). [2025-09-18T22:53:11.453255] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-09-18T22:53:11.454003] [INFO ] [MAIN ] INGM: Generated 1807 derivative records from 29495 primary records. [2025-09-18T22:53:11.456923] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-09-18T22:53:11.456858] [INFO ] [MAIN ] Derivative Progress: 944/2075 symbols completed. ING took 0.8s. Estimated remaining: 7m 19s. Rate: 154.6 symbols/min [2025-09-18T22:53:11.472698] [DEBUG] [LOCAL ] INGM: Derivative data saved (1807 records). [2025-09-18T22:53:11.472760] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-09-18T22:53:11.475287] [INFO ] [MAIN ] Derivative Progress: 945/2075 symbols completed. INGM took 0.8s. Estimated remaining: 7m 18s. Rate: 154.7 symbols/min [2025-09-18T22:53:11.476018] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:11.475929] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:11.476062] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:11.533493] [DEBUG] [LOCAL ] INGR: Loaded 33638 existing records from primary storage. [2025-09-18T22:53:11.533835] [INFO ] [MAIN ] INGR: Loaded 33638 primary data records. [2025-09-18T22:53:11.623636] [DEBUG] [LOCAL ] INN: Loaded 42287 existing records from primary storage. [2025-09-18T22:53:11.628953] [INFO ] [MAIN ] INN: Loaded 42287 primary data records. [2025-09-18T22:53:11.646868] [DEBUG] [LOCAL ] INSP: Loaded 36882 existing records from primary storage. [2025-09-18T22:53:11.688276] [INFO ] [MAIN ] INSP: Loaded 36882 primary data records. [2025-09-18T22:53:12.582164] [DEBUG] [MAIN ] INGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:12.583254] [INFO ] [MAIN ] INGR: Generated 1807 derivative records from 33638 primary records. [2025-09-18T22:53:12.583554] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-09-18T22:53:12.623607] [DEBUG] [MAIN ] INN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:12.626156] [INFO ] [MAIN ] INN: Generated 1807 derivative records from 42287 primary records. [2025-09-18T22:53:12.626561] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-09-18T22:53:12.638934] [DEBUG] [LOCAL ] INGR: Derivative data saved (1807 records). [2025-09-18T22:53:12.639976] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-09-18T22:53:12.642089] [INFO ] [MAIN ] Derivative Progress: 946/2075 symbols completed. INGR took 1.2s. Estimated remaining: 7m 19s. Rate: 154.4 symbols/min [2025-09-18T22:53:12.646247] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:12.658610] [DEBUG] [LOCAL ] INN: Derivative data saved (1807 records). [2025-09-18T22:53:12.664110] [DEBUG] [MAIN ] INSP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:12.664305] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-09-18T22:53:12.667635] [INFO ] [MAIN ] INSP: Generated 1807 derivative records from 36882 primary records. [2025-09-18T22:53:12.666765] [INFO ] [MAIN ] Derivative Progress: 947/2075 symbols completed. INN took 1.2s. Estimated remaining: 7m 18s. Rate: 154.5 symbols/min [2025-09-18T22:53:12.668099] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:12.667786] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-09-18T22:53:12.685409] [DEBUG] [LOCAL ] INSP: Derivative data saved (1807 records). [2025-09-18T22:53:12.685739] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-09-18T22:53:12.687997] [INFO ] [MAIN ] Derivative Progress: 948/2075 symbols completed. INSP took 1.2s. Estimated remaining: 7m 17s. Rate: 154.7 symbols/min [2025-09-18T22:53:12.688346] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:12.740446] [DEBUG] [LOCAL ] INVX: Loaded 29524 existing records from primary storage. [2025-09-18T22:53:12.752852] [INFO ] [MAIN ] INVX: Loaded 29524 primary data records. [2025-09-18T22:53:12.775243] [DEBUG] [LOCAL ] INSW: Loaded 40985 existing records from primary storage. [2025-09-18T22:53:12.810708] [INFO ] [MAIN ] INSW: Loaded 40985 primary data records. [2025-09-18T22:53:12.883977] [DEBUG] [LOCAL ] INVH: Loaded 53529 existing records from primary storage. [2025-09-18T22:53:12.915797] [INFO ] [MAIN ] INVH: Loaded 53529 primary data records. [2025-09-18T22:53:13.724241] [DEBUG] [MAIN ] INVX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:13.725281] [INFO ] [MAIN ] INVX: Generated 1807 derivative records from 29524 primary records. [2025-09-18T22:53:13.725957] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-09-18T22:53:13.745710] [DEBUG] [LOCAL ] INVX: Derivative data saved (1807 records). [2025-09-18T22:53:13.748256] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-09-18T22:53:13.750448] [INFO ] [MAIN ] Derivative Progress: 949/2075 symbols completed. INVX took 1.1s. Estimated remaining: 7m 18s. Rate: 154.4 symbols/min [2025-09-18T22:53:13.750905] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:13.777964] [DEBUG] [MAIN ] INVH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:13.777571] [DEBUG] [MAIN ] INSW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:13.779795] [INFO ] [MAIN ] INSW: Generated 1807 derivative records from 40985 primary records. [2025-09-18T22:53:13.778920] [INFO ] [MAIN ] INVH: Generated 1807 derivative records from 53529 primary records. [2025-09-18T22:53:13.779966] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-09-18T22:53:13.780077] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-09-18T22:53:13.808248] [DEBUG] [LOCAL ] INVH: Derivative data saved (1807 records). [2025-09-18T22:53:13.808458] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-09-18T22:53:13.811407] [INFO ] [MAIN ] Derivative Progress: 950/2075 symbols completed. INVH took 1.1s. Estimated remaining: 7m 17s. Rate: 154.5 symbols/min [2025-09-18T22:53:13.812993] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:13.817021] [DEBUG] [LOCAL ] INSW: Derivative data saved (1807 records). [2025-09-18T22:53:13.817175] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-09-18T22:53:13.819606] [INFO ] [MAIN ] Derivative Progress: 951/2075 symbols completed. INSW took 1.2s. Estimated remaining: 7m 16s. Rate: 154.7 symbols/min [2025-09-18T22:53:13.819935] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:13.904371] [DEBUG] [LOCAL ] IONQ: Loaded 54178 existing records from primary storage. [2025-09-18T22:53:13.917681] [INFO ] [MAIN ] IONQ: Loaded 54178 primary data records. [2025-09-18T22:53:13.925900] [DEBUG] [LOCAL ] IOT: Loaded 53863 existing records from primary storage. [2025-09-18T22:53:13.936823] [INFO ] [MAIN ] IOT: Loaded 53863 primary data records. [2025-09-18T22:53:14.092006] [DEBUG] [LOCAL ] IP: Loaded 53719 existing records from primary storage. [2025-09-18T22:53:14.154507] [INFO ] [MAIN ] IP: Loaded 53719 primary data records. [2025-09-18T22:53:14.986125] [DEBUG] [MAIN ] IOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:14.987589] [INFO ] [MAIN ] IOT: Generated 1807 derivative records from 53863 primary records. [2025-09-18T22:53:14.988669] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-09-18T22:53:15.021738] [DEBUG] [MAIN ] IONQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:15.021296] [DEBUG] [LOCAL ] IOT: Derivative data saved (1807 records). [2025-09-18T22:53:15.022858] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-09-18T22:53:15.025024] [INFO ] [MAIN ] Derivative Progress: 952/2075 symbols completed. IOT took 1.2s. Estimated remaining: 7m 17s. Rate: 154.4 symbols/min [2025-09-18T22:53:15.022766] [INFO ] [MAIN ] IONQ: Generated 1807 derivative records from 54178 primary records. [2025-09-18T22:53:15.033112] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-09-18T22:53:15.038988] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:15.040199] [DEBUG] [MAIN ] IP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:15.041537] [INFO ] [MAIN ] IP: Generated 1807 derivative records from 53719 primary records. [2025-09-18T22:53:15.042135] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-09-18T22:53:15.072683] [DEBUG] [LOCAL ] IP: Derivative data saved (1807 records). [2025-09-18T22:53:15.073131] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-09-18T22:53:15.076311] [INFO ] [MAIN ] Derivative Progress: 953/2075 symbols completed. IP took 1.3s. Estimated remaining: 7m 16s. Rate: 154.5 symbols/min [2025-09-18T22:53:15.077268] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:15.080774] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1807 records). [2025-09-18T22:53:15.080873] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-09-18T22:53:15.083287] [INFO ] [MAIN ] Derivative Progress: 954/2075 symbols completed. IONQ took 1.3s. Estimated remaining: 7m 15s. Rate: 154.7 symbols/min [2025-09-18T22:53:15.083973] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:15.132499] [DEBUG] [LOCAL ] IPI: Loaded 21585 existing records from primary storage. [2025-09-18T22:53:15.132931] [DEBUG] [LOCAL ] IQI: Loaded 18112 existing records from primary storage. [2025-09-18T22:53:15.133368] [INFO ] [MAIN ] IQI: Loaded 18112 primary data records. [2025-09-18T22:53:15.133291] [INFO ] [MAIN ] IPI: Loaded 21585 primary data records. [2025-09-18T22:53:15.258872] [DEBUG] [LOCAL ] IPG: Loaded 53723 existing records from primary storage. [2025-09-18T22:53:15.291340] [INFO ] [MAIN ] IPG: Loaded 53723 primary data records. [2025-09-18T22:53:16.172577] [DEBUG] [MAIN ] IQI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:16.173553] [INFO ] [MAIN ] IQI: Generated 1807 derivative records from 18112 primary records. [2025-09-18T22:53:16.173801] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-09-18T22:53:16.223702] [DEBUG] [LOCAL ] IQI: Derivative data saved (1807 records). [2025-09-18T22:53:16.223578] [DEBUG] [MAIN ] IPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:16.224197] [DEBUG] [MAIN ] IPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:16.225363] [INFO ] [MAIN ] IPI: Generated 1807 derivative records from 21585 primary records. [2025-09-18T22:53:16.225435] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-09-18T22:53:16.226325] [INFO ] [MAIN ] IPG: Generated 1807 derivative records from 53723 primary records. [2025-09-18T22:53:16.226521] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-09-18T22:53:16.226624] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-09-18T22:53:16.237862] [INFO ] [MAIN ] Derivative Progress: 955/2075 symbols completed. IQI took 1.2s. Estimated remaining: 7m 15s. Rate: 154.3 symbols/min [2025-09-18T22:53:16.256912] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:16.262369] [DEBUG] [LOCAL ] IPI: Derivative data saved (1807 records). [2025-09-18T22:53:16.262826] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-09-18T22:53:16.266063] [INFO ] [MAIN ] Derivative Progress: 956/2075 symbols completed. IPI took 1.2s. Estimated remaining: 7m 15s. Rate: 154.5 symbols/min [2025-09-18T22:53:16.267568] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:16.268569] [DEBUG] [LOCAL ] IPG: Derivative data saved (1807 records). [2025-09-18T22:53:16.268923] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-09-18T22:53:16.271595] [INFO ] [MAIN ] Derivative Progress: 957/2075 symbols completed. IPG took 1.2s. Estimated remaining: 7m 14s. Rate: 154.7 symbols/min [2025-09-18T22:53:16.272601] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:16.343916] [DEBUG] [LOCAL ] IQV: Loaded 50871 existing records from primary storage. [2025-09-18T22:53:16.344152] [INFO ] [MAIN ] IQV: Loaded 50871 primary data records. [2025-09-18T22:53:16.485456] [DEBUG] [LOCAL ] IR: Loaded 53086 existing records from primary storage. [2025-09-18T22:53:16.486356] [DEBUG] [LOCAL ] IRM: Loaded 49920 existing records from primary storage. [2025-09-18T22:53:16.492323] [INFO ] [MAIN ] IRM: Loaded 49920 primary data records. [2025-09-18T22:53:16.486485] [INFO ] [MAIN ] IR: Loaded 53086 primary data records. [2025-09-18T22:53:17.431873] [DEBUG] [MAIN ] IQV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:17.432678] [INFO ] [MAIN ] IQV: Generated 1807 derivative records from 50871 primary records. [2025-09-18T22:53:17.433093] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-09-18T22:53:17.472304] [DEBUG] [LOCAL ] IQV: Derivative data saved (1807 records). [2025-09-18T22:53:17.470551] [DEBUG] [MAIN ] IRM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:17.472767] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-09-18T22:53:17.474672] [INFO ] [MAIN ] Derivative Progress: 958/2075 symbols completed. IQV took 1.2s. Estimated remaining: 7m 14s. Rate: 154.3 symbols/min [2025-09-18T22:53:17.475941] [INFO ] [MAIN ] IRM: Generated 1807 derivative records from 49920 primary records. [2025-09-18T22:53:17.488484] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-09-18T22:53:17.489958] [DEBUG] [MAIN ] IR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:17.490806] [INFO ] [MAIN ] IR: Generated 1807 derivative records from 53086 primary records. [2025-09-18T22:53:17.490896] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-09-18T22:53:17.520582] [DEBUG] [LOCAL ] IR: Derivative data saved (1807 records). [2025-09-18T22:53:17.521364] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-09-18T22:53:17.523578] [INFO ] [MAIN ] Derivative Progress: 959/2075 symbols completed. IR took 1.3s. Estimated remaining: 7m 14s. Rate: 154.5 symbols/min [2025-09-18T22:53:17.526258] [DEBUG] [LOCAL ] IRM: Derivative data saved (1807 records). [2025-09-18T22:53:17.526377] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-09-18T22:53:17.529831] [INFO ] [MAIN ] Derivative Progress: 960/2075 symbols completed. IRM took 1.3s. Estimated remaining: 7m 13s. Rate: 154.6 symbols/min [2025-09-18T22:53:17.530475] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:17.530787] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:17.530930] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:17.556901] [DEBUG] [LOCAL ] ISD: Loaded 15949 existing records from primary storage. [2025-09-18T22:53:17.557034] [INFO ] [MAIN ] ISD: Loaded 15949 primary data records. [2025-09-18T22:53:17.596598] [DEBUG] [LOCAL ] IRS: Loaded 21446 existing records from primary storage. [2025-09-18T22:53:17.609077] [INFO ] [MAIN ] IRS: Loaded 21446 primary data records. [2025-09-18T22:53:17.940019] [DEBUG] [LOCAL ] IRT: Loaded 50772 existing records from primary storage. [2025-09-18T22:53:17.967580] [INFO ] [MAIN ] IRT: Loaded 50772 primary data records. [2025-09-18T22:53:18.571115] [DEBUG] [MAIN ] ISD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:18.572018] [INFO ] [MAIN ] ISD: Generated 1807 derivative records from 15949 primary records. [2025-09-18T22:53:18.573081] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-09-18T22:53:18.591749] [DEBUG] [LOCAL ] ISD: Derivative data saved (1807 records). [2025-09-18T22:53:18.591937] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-09-18T22:53:18.593899] [INFO ] [MAIN ] Derivative Progress: 961/2075 symbols completed. ISD took 1.1s. Estimated remaining: 7m 13s. Rate: 154.3 symbols/min [2025-09-18T22:53:18.606826] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:18.607422] [DEBUG] [MAIN ] IRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:18.608522] [INFO ] [MAIN ] IRS: Generated 1807 derivative records from 21446 primary records. [2025-09-18T22:53:18.608798] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-09-18T22:53:18.642572] [DEBUG] [LOCAL ] IRS: Derivative data saved (1807 records). [2025-09-18T22:53:18.642911] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-09-18T22:53:18.643393] [DEBUG] [MAIN ] IRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:18.644207] [INFO ] [MAIN ] IRT: Generated 1807 derivative records from 50772 primary records. [2025-09-18T22:53:18.646534] [INFO ] [MAIN ] Derivative Progress: 962/2075 symbols completed. IRS took 1.1s. Estimated remaining: 7m 12s. Rate: 154.5 symbols/min [2025-09-18T22:53:18.646776] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-09-18T22:53:18.646981] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:18.676943] [DEBUG] [LOCAL ] IRT: Derivative data saved (1807 records). [2025-09-18T22:53:18.677698] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-09-18T22:53:18.680772] [INFO ] [MAIN ] Derivative Progress: 963/2075 symbols completed. IRT took 1.2s. Estimated remaining: 7m 12s. Rate: 154.6 symbols/min [2025-09-18T22:53:18.681292] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:18.694275] [DEBUG] [LOCAL ] IT: Loaded 41428 existing records from primary storage. [2025-09-18T22:53:18.702451] [INFO ] [MAIN ] IT: Loaded 41428 primary data records. [2025-09-18T22:53:18.817694] [DEBUG] [LOCAL ] ITGR: Loaded 31906 existing records from primary storage. [2025-09-18T22:53:18.818247] [INFO ] [MAIN ] ITGR: Loaded 31906 primary data records. [2025-09-18T22:53:19.018044] [DEBUG] [LOCAL ] ITT: Loaded 33669 existing records from primary storage. [2025-09-18T22:53:19.159230] [INFO ] [MAIN ] ITT: Loaded 33669 primary data records. [2025-09-18T22:53:19.719211] [DEBUG] [MAIN ] IT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:19.721483] [INFO ] [MAIN ] IT: Generated 1807 derivative records from 41428 primary records. [2025-09-18T22:53:19.722025] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-09-18T22:53:19.745511] [DEBUG] [MAIN ] ITGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:19.754072] [INFO ] [MAIN ] ITGR: Generated 1807 derivative records from 31906 primary records. [2025-09-18T22:53:19.756894] [DEBUG] [LOCAL ] IT: Derivative data saved (1807 records). [2025-09-18T22:53:19.757091] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-09-18T22:53:19.757428] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-09-18T22:53:19.762085] [INFO ] [MAIN ] Derivative Progress: 964/2075 symbols completed. IT took 1.2s. Estimated remaining: 7m 12s. Rate: 154.3 symbols/min [2025-09-18T22:53:19.762413] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:19.790759] [DEBUG] [MAIN ] ITT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:19.792210] [INFO ] [MAIN ] ITT: Generated 1807 derivative records from 33669 primary records. [2025-09-18T22:53:19.792952] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-09-18T22:53:19.810172] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1807 records). [2025-09-18T22:53:19.810763] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-09-18T22:53:19.814073] [INFO ] [MAIN ] Derivative Progress: 965/2075 symbols completed. ITGR took 1.2s. Estimated remaining: 7m 11s. Rate: 154.5 symbols/min [2025-09-18T22:53:19.814697] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:19.815931] [DEBUG] [LOCAL ] ITT: Derivative data saved (1807 records). [2025-09-18T22:53:19.816111] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-09-18T22:53:19.818678] [INFO ] [MAIN ] Derivative Progress: 966/2075 symbols completed. ITT took 1.1s. Estimated remaining: 7m 10s. Rate: 154.6 symbols/min [2025-09-18T22:53:19.819113] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:19.873830] [DEBUG] [LOCAL ] IVT: Loaded 31317 existing records from primary storage. [2025-09-18T22:53:19.873982] [INFO ] [MAIN ] IVT: Loaded 31317 primary data records. [2025-09-18T22:53:20.013338] [DEBUG] [LOCAL ] ITW: Loaded 46843 existing records from primary storage. [2025-09-18T22:53:20.019815] [INFO ] [MAIN ] ITW: Loaded 46843 primary data records. [2025-09-18T22:53:20.019729] [DEBUG] [LOCAL ] IVR: Loaded 48089 existing records from primary storage. [2025-09-18T22:53:20.094210] [INFO ] [MAIN ] IVR: Loaded 48089 primary data records. [2025-09-18T22:53:20.926979] [DEBUG] [MAIN ] IVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:20.928281] [INFO ] [MAIN ] IVT: Generated 1807 derivative records from 31317 primary records. [2025-09-18T22:53:20.928520] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-09-18T22:53:20.963099] [DEBUG] [LOCAL ] IVT: Derivative data saved (1807 records). [2025-09-18T22:53:20.964200] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-09-18T22:53:20.966460] [INFO ] [MAIN ] Derivative Progress: 967/2075 symbols completed. IVT took 1.1s. Estimated remaining: 7m 11s. Rate: 154.3 symbols/min [2025-09-18T22:53:20.964098] [DEBUG] [MAIN ] ITW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:20.968264] [INFO ] [MAIN ] ITW: Generated 1807 derivative records from 46843 primary records. [2025-09-18T22:53:20.968363] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-09-18T22:53:20.968552] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:20.999082] [DEBUG] [LOCAL ] ITW: Derivative data saved (1807 records). [2025-09-18T22:53:20.998089] [DEBUG] [MAIN ] IVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:20.999306] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-09-18T22:53:21.000150] [INFO ] [MAIN ] IVR: Generated 1807 derivative records from 48089 primary records. [2025-09-18T22:53:21.002610] [INFO ] [MAIN ] Derivative Progress: 968/2075 symbols completed. ITW took 1.2s. Estimated remaining: 7m 10s. Rate: 154.5 symbols/min [2025-09-18T22:53:21.003041] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:21.003100] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-09-18T22:53:21.020820] [DEBUG] [LOCAL ] IVR: Derivative data saved (1807 records). [2025-09-18T22:53:21.020958] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-09-18T22:53:21.023724] [INFO ] [MAIN ] Derivative Progress: 969/2075 symbols completed. IVR took 1.2s. Estimated remaining: 7m 9s. Rate: 154.6 symbols/min [2025-09-18T22:53:21.024181] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:21.046992] [DEBUG] [LOCAL ] IX: Loaded 23003 existing records from primary storage. [2025-09-18T22:53:21.047302] [INFO ] [MAIN ] IX: Loaded 23003 primary data records. [2025-09-18T22:53:21.275739] [DEBUG] [LOCAL ] IVZ: Loaded 53534 existing records from primary storage. [2025-09-18T22:53:21.276091] [INFO ] [MAIN ] IVZ: Loaded 53534 primary data records. [2025-09-18T22:53:21.508099] [DEBUG] [LOCAL ] J: Loaded 40914 existing records from primary storage. [2025-09-18T22:53:21.529209] [INFO ] [MAIN ] J: Loaded 40914 primary data records. [2025-09-18T22:53:22.074192] [DEBUG] [MAIN ] IX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:22.075790] [INFO ] [MAIN ] IX: Generated 1807 derivative records from 23003 primary records. [2025-09-18T22:53:22.076193] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-09-18T22:53:22.095111] [DEBUG] [LOCAL ] IX: Derivative data saved (1807 records). [2025-09-18T22:53:22.097348] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-09-18T22:53:22.099852] [INFO ] [MAIN ] Derivative Progress: 970/2075 symbols completed. IX took 1.1s. Estimated remaining: 7m 10s. Rate: 154.3 symbols/min [2025-09-18T22:53:22.100264] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:22.115092] [DEBUG] [MAIN ] IVZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:22.116273] [INFO ] [MAIN ] IVZ: Generated 1807 derivative records from 53534 primary records. [2025-09-18T22:53:22.116460] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-09-18T22:53:22.148882] [DEBUG] [MAIN ] J: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:22.150323] [INFO ] [MAIN ] J: Generated 1807 derivative records from 40914 primary records. [2025-09-18T22:53:22.152414] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1807 records). [2025-09-18T22:53:22.152527] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-09-18T22:53:22.154767] [INFO ] [MAIN ] Derivative Progress: 971/2075 symbols completed. IVZ took 1.2s. Estimated remaining: 7m 9s. Rate: 154.5 symbols/min [2025-09-18T22:53:22.154878] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-09-18T22:53:22.155781] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:22.173593] [DEBUG] [LOCAL ] J: Derivative data saved (1807 records). [2025-09-18T22:53:22.173836] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-09-18T22:53:22.176996] [INFO ] [MAIN ] Derivative Progress: 972/2075 symbols completed. J took 1.2s. Estimated remaining: 7m 8s. Rate: 154.6 symbols/min [2025-09-18T22:53:22.177302] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:22.208322] [DEBUG] [LOCAL ] JBGS: Loaded 42727 existing records from primary storage. [2025-09-18T22:53:22.208665] [INFO ] [MAIN ] JBGS: Loaded 42727 primary data records. [2025-09-18T22:53:22.428304] [DEBUG] [LOCAL ] JBI: Loaded 44548 existing records from primary storage. [2025-09-18T22:53:22.475045] [INFO ] [MAIN ] JBI: Loaded 44548 primary data records. [2025-09-18T22:53:22.547361] [DEBUG] [LOCAL ] JBL: Loaded 48738 existing records from primary storage. [2025-09-18T22:53:22.604480] [INFO ] [MAIN ] JBL: Loaded 48738 primary data records. [2025-09-18T22:53:23.330416] [DEBUG] [MAIN ] JBGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:23.331584] [INFO ] [MAIN ] JBGS: Generated 1807 derivative records from 42727 primary records. [2025-09-18T22:53:23.333632] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-09-18T22:53:23.355014] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1807 records). [2025-09-18T22:53:23.355334] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-09-18T22:53:23.357295] [INFO ] [MAIN ] Derivative Progress: 973/2075 symbols completed. JBGS took 1.3s. Estimated remaining: 7m 9s. Rate: 154.3 symbols/min [2025-09-18T22:53:23.375274] [DEBUG] [MAIN ] JBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:23.377311] [INFO ] [MAIN ] JBI: Generated 1807 derivative records from 44548 primary records. [2025-09-18T22:53:23.378291] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-09-18T22:53:23.399693] [DEBUG] [MAIN ] JBL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:23.404240] [INFO ] [MAIN ] JBL: Generated 1807 derivative records from 48738 primary records. [2025-09-18T22:53:23.405203] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-09-18T22:53:23.424270] [DEBUG] [LOCAL ] JBI: Derivative data saved (1807 records). [2025-09-18T22:53:23.424948] [DEBUG] [LOCAL ] JBL: Derivative data saved (1807 records). [2025-09-18T22:53:23.425065] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-09-18T22:53:23.425173] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-09-18T22:53:23.427860] [INFO ] [MAIN ] Derivative Progress: 974/2075 symbols completed. JBL took 1.3s. Estimated remaining: 7m 8s. Rate: 154.4 symbols/min [2025-09-18T22:53:23.430636] [INFO ] [MAIN ] Derivative Progress: 975/2075 symbols completed. JBI took 1.3s. Estimated remaining: 7m 7s. Rate: 154.6 symbols/min [2025-09-18T22:53:23.431216] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:23.431762] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:23.431995] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:23.442955] [DEBUG] [LOCAL ] JCE: Loaded 6445 existing records from primary storage. [2025-09-18T22:53:23.443090] [INFO ] [MAIN ] JCE: Loaded 6445 primary data records. [2025-09-18T22:53:23.583015] [DEBUG] [LOCAL ] JBND: Loaded 25327 existing records from primary storage. [2025-09-18T22:53:23.639845] [INFO ] [MAIN ] JBND: Loaded 25327 primary data records. [2025-09-18T22:53:23.915613] [DEBUG] [LOCAL ] JCI: Loaded 53940 existing records from primary storage. [2025-09-18T22:53:23.936467] [INFO ] [MAIN ] JCI: Loaded 53940 primary data records. [2025-09-18T22:53:24.471858] [DEBUG] [MAIN ] JCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:24.473025] [INFO ] [MAIN ] JCE: Generated 1807 derivative records from 6445 primary records. [2025-09-18T22:53:24.473253] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-09-18T22:53:24.496365] [DEBUG] [LOCAL ] JCE: Derivative data saved (1807 records). [2025-09-18T22:53:24.496863] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-09-18T22:53:24.499238] [INFO ] [MAIN ] Derivative Progress: 976/2075 symbols completed. JCE took 1.1s. Estimated remaining: 7m 7s. Rate: 154.3 symbols/min [2025-09-18T22:53:24.511804] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:24.512764] [DEBUG] [MAIN ] JBND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:24.513913] [INFO ] [MAIN ] JBND: Generated 1807 derivative records from 25327 primary records. [2025-09-18T22:53:24.515375] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-09-18T22:53:24.533555] [DEBUG] [LOCAL ] JBND: Derivative data saved (1807 records). [2025-09-18T22:53:24.534063] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-09-18T22:53:24.536326] [INFO ] [MAIN ] Derivative Progress: 977/2075 symbols completed. JBND took 1.1s. Estimated remaining: 7m 7s. Rate: 154.4 symbols/min [2025-09-18T22:53:24.536782] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:24.553829] [DEBUG] [MAIN ] JCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:24.554662] [INFO ] [MAIN ] JCI: Generated 1807 derivative records from 53940 primary records. [2025-09-18T22:53:24.554772] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-09-18T22:53:24.582849] [DEBUG] [LOCAL ] JCI: Derivative data saved (1807 records). [2025-09-18T22:53:24.583030] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-09-18T22:53:24.586097] [INFO ] [MAIN ] Derivative Progress: 978/2075 symbols completed. JCI took 1.2s. Estimated remaining: 7m 6s. Rate: 154.6 symbols/min [2025-09-18T22:53:24.586470] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:24.607081] [DEBUG] [LOCAL ] JEF: Loaded 50392 existing records from primary storage. [2025-09-18T22:53:24.607309] [INFO ] [MAIN ] JEF: Loaded 50392 primary data records. [2025-09-18T22:53:24.676966] [DEBUG] [LOCAL ] JEQ: Loaded 9046 existing records from primary storage. [2025-09-18T22:53:24.713849] [INFO ] [MAIN ] JEQ: Loaded 9046 primary data records. [2025-09-18T22:53:24.815761] [DEBUG] [LOCAL ] JELD: Loaded 46566 existing records from primary storage. [2025-09-18T22:53:24.855363] [INFO ] [MAIN ] JELD: Loaded 46566 primary data records. [2025-09-18T22:53:25.652197] [DEBUG] [MAIN ] JEF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:25.653172] [INFO ] [MAIN ] JEF: Generated 1807 derivative records from 50392 primary records. [2025-09-18T22:53:25.653490] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-09-18T22:53:25.673465] [DEBUG] [LOCAL ] JEF: Derivative data saved (1807 records). [2025-09-18T22:53:25.675348] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-09-18T22:53:25.691366] [INFO ] [MAIN ] Derivative Progress: 979/2075 symbols completed. JEF took 1.2s. Estimated remaining: 7m 6s. Rate: 154.3 symbols/min [2025-09-18T22:53:25.689256] [DEBUG] [MAIN ] JEQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:25.693123] [INFO ] [MAIN ] JEQ: Generated 1807 derivative records from 9046 primary records. [2025-09-18T22:53:25.695049] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-09-18T22:53:25.694294] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:25.725923] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1807 records). [2025-09-18T22:53:25.725008] [DEBUG] [MAIN ] JELD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:25.726052] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-09-18T22:53:25.726815] [INFO ] [MAIN ] JELD: Generated 1807 derivative records from 46566 primary records. [2025-09-18T22:53:25.729395] [INFO ] [MAIN ] Derivative Progress: 980/2075 symbols completed. JEQ took 1.1s. Estimated remaining: 7m 5s. Rate: 154.4 symbols/min [2025-09-18T22:53:25.729483] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-09-18T22:53:25.730682] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:25.751447] [DEBUG] [LOCAL ] JGH: Loaded 11091 existing records from primary storage. [2025-09-18T22:53:25.755314] [DEBUG] [LOCAL ] JELD: Derivative data saved (1807 records). [2025-09-18T22:53:25.754182] [INFO ] [MAIN ] JGH: Loaded 11091 primary data records. [2025-09-18T22:53:25.760689] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-09-18T22:53:25.763596] [INFO ] [MAIN ] Derivative Progress: 981/2075 symbols completed. JELD took 1.2s. Estimated remaining: 7m 5s. Rate: 154.6 symbols/min [2025-09-18T22:53:25.763890] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:25.879006] [DEBUG] [LOCAL ] JHI: Loaded 3809 existing records from primary storage. [2025-09-18T22:53:25.906583] [INFO ] [MAIN ] JHI: Loaded 3809 primary data records. [2025-09-18T22:53:26.221677] [DEBUG] [LOCAL ] JHG: Loaded 48523 existing records from primary storage. [2025-09-18T22:53:26.233363] [INFO ] [MAIN ] JHG: Loaded 48523 primary data records. [2025-09-18T22:53:26.785382] [DEBUG] [MAIN ] JGH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:26.786793] [INFO ] [MAIN ] JGH: Generated 1807 derivative records from 11091 primary records. [2025-09-18T22:53:26.787182] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-09-18T22:53:26.810831] [DEBUG] [LOCAL ] JGH: Derivative data saved (1807 records). [2025-09-18T22:53:26.811293] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-09-18T22:53:26.813476] [INFO ] [MAIN ] Derivative Progress: 982/2075 symbols completed. JGH took 1.1s. Estimated remaining: 7m 5s. Rate: 154.3 symbols/min [2025-09-18T22:53:26.813982] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:26.828892] [DEBUG] [MAIN ] JHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:26.830120] [INFO ] [MAIN ] JHI: Generated 1807 derivative records from 3809 primary records. [2025-09-18T22:53:26.831268] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-09-18T22:53:26.843160] [DEBUG] [LOCAL ] JHS: Loaded 2939 existing records from primary storage. [2025-09-18T22:53:26.850320] [INFO ] [MAIN ] JHS: Loaded 2939 primary data records. [2025-09-18T22:53:26.852053] [DEBUG] [LOCAL ] JHI: Derivative data saved (1807 records). [2025-09-18T22:53:26.852253] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-09-18T22:53:26.865846] [INFO ] [MAIN ] Derivative Progress: 983/2075 symbols completed. JHI took 1.1s. Estimated remaining: 7m 4s. Rate: 154.4 symbols/min [2025-09-18T22:53:26.885697] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:26.948552] [DEBUG] [MAIN ] JHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:26.954424] [INFO ] [MAIN ] JHG: Generated 1807 derivative records from 48523 primary records. [2025-09-18T22:53:26.954608] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-09-18T22:53:27.071840] [DEBUG] [LOCAL ] JHG: Derivative data saved (1807 records). [2025-09-18T22:53:27.198730] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-09-18T22:53:27.247164] [INFO ] [MAIN ] Derivative Progress: 984/2075 symbols completed. JHG took 1.5s. Estimated remaining: 7m 4s. Rate: 154.4 symbols/min [2025-09-18T22:53:27.247636] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:27.273223] [DEBUG] [LOCAL ] JHX: Loaded 49336 existing records from primary storage. [2025-09-18T22:53:27.273805] [INFO ] [MAIN ] JHX: Loaded 49336 primary data records. [2025-09-18T22:53:27.318116] [DEBUG] [LOCAL ] JILL: Loaded 16786 existing records from primary storage. [2025-09-18T22:53:27.347176] [INFO ] [MAIN ] JILL: Loaded 16786 primary data records. [2025-09-18T22:53:27.593634] [DEBUG] [MAIN ] JHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:27.772350] [INFO ] [MAIN ] JHS: Generated 1807 derivative records from 2939 primary records. [2025-09-18T22:53:27.901832] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-09-18T22:53:27.922203] [DEBUG] [LOCAL ] JHS: Derivative data saved (1807 records). [2025-09-18T22:53:27.922901] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-09-18T22:53:27.925316] [INFO ] [MAIN ] Derivative Progress: 985/2075 symbols completed. JHS took 1.1s. Estimated remaining: 7m 4s. Rate: 154.3 symbols/min [2025-09-18T22:53:27.927441] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:27.965421] [DEBUG] [MAIN ] JHX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:27.965706] [DEBUG] [MAIN ] JILL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:27.966559] [INFO ] [MAIN ] JHX: Generated 1807 derivative records from 49336 primary records. [2025-09-18T22:53:27.967192] [INFO ] [MAIN ] JILL: Generated 1807 derivative records from 16786 primary records. [2025-09-18T22:53:27.967369] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-09-18T22:53:27.967314] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-09-18T22:53:28.005811] [DEBUG] [LOCAL ] JILL: Derivative data saved (1807 records). [2025-09-18T22:53:28.006315] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-09-18T22:53:28.009445] [INFO ] [MAIN ] Derivative Progress: 986/2075 symbols completed. JILL took 0.8s. Estimated remaining: 7m 3s. Rate: 154.5 symbols/min [2025-09-18T22:53:28.011528] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:28.013384] [DEBUG] [LOCAL ] JHX: Derivative data saved (1807 records). [2025-09-18T22:53:28.013572] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-09-18T22:53:28.016372] [INFO ] [MAIN ] Derivative Progress: 987/2075 symbols completed. JHX took 1.1s. Estimated remaining: 7m 2s. Rate: 154.6 symbols/min [2025-09-18T22:53:28.016746] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:28.032739] [DEBUG] [LOCAL ] JKS: Loaded 40528 existing records from primary storage. [2025-09-18T22:53:28.033011] [INFO ] [MAIN ] JKS: Loaded 40528 primary data records. [2025-09-18T22:53:28.073877] [DEBUG] [LOCAL ] JLS: Loaded 4135 existing records from primary storage. [2025-09-18T22:53:28.074111] [INFO ] [MAIN ] JLS: Loaded 4135 primary data records. [2025-09-18T22:53:28.324726] [DEBUG] [LOCAL ] JLL: Loaded 32581 existing records from primary storage. [2025-09-18T22:53:28.375010] [INFO ] [MAIN ] JLL: Loaded 32581 primary data records. [2025-09-18T22:53:29.043740] [DEBUG] [MAIN ] JKS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:29.046814] [INFO ] [MAIN ] JKS: Generated 1807 derivative records from 40528 primary records. [2025-09-18T22:53:29.047035] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-09-18T22:53:29.073994] [DEBUG] [MAIN ] JLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:29.075542] [INFO ] [MAIN ] JLS: Generated 1807 derivative records from 4135 primary records. [2025-09-18T22:53:29.075797] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-09-18T22:53:29.086821] [DEBUG] [LOCAL ] JKS: Derivative data saved (1807 records). [2025-09-18T22:53:29.086940] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-09-18T22:53:29.091049] [INFO ] [MAIN ] Derivative Progress: 988/2075 symbols completed. JKS took 1.2s. Estimated remaining: 7m 3s. Rate: 154.3 symbols/min [2025-09-18T22:53:29.112542] [DEBUG] [MAIN ] JLL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:29.113308] [INFO ] [MAIN ] JLL: Generated 1807 derivative records from 32581 primary records. [2025-09-18T22:53:29.112610] [DEBUG] [LOCAL ] JLS: Derivative data saved (1807 records). [2025-09-18T22:53:29.113416] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-09-18T22:53:29.116005] [INFO ] [MAIN ] Derivative Progress: 989/2075 symbols completed. JLS took 1.1s. Estimated remaining: 7m 2s. Rate: 154.5 symbols/min [2025-09-18T22:53:29.113500] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-09-18T22:53:29.131585] [DEBUG] [LOCAL ] JLL: Derivative data saved (1807 records). [2025-09-18T22:53:29.131671] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-09-18T22:53:29.135393] [INFO ] [MAIN ] Derivative Progress: 990/2075 symbols completed. JLL took 1.1s. Estimated remaining: 7m 1s. Rate: 154.6 symbols/min [2025-09-18T22:53:29.135959] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:29.136238] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:29.136306] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:29.188959] [DEBUG] [LOCAL ] JMIA: Loaded 50812 existing records from primary storage. [2025-09-18T22:53:29.189277] [INFO ] [MAIN ] JMIA: Loaded 50812 primary data records. [2025-09-18T22:53:29.410470] [DEBUG] [LOCAL ] JOBY: Loaded 54188 existing records from primary storage. [2025-09-18T22:53:29.419765] [DEBUG] [LOCAL ] JNJ: Loaded 54143 existing records from primary storage. [2025-09-18T22:53:29.420352] [INFO ] [MAIN ] JOBY: Loaded 54188 primary data records. [2025-09-18T22:53:29.420486] [INFO ] [MAIN ] JNJ: Loaded 54143 primary data records. [2025-09-18T22:53:30.257676] [DEBUG] [MAIN ] JMIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:30.258557] [INFO ] [MAIN ] JMIA: Generated 1807 derivative records from 50812 primary records. [2025-09-18T22:53:30.258808] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-09-18T22:53:30.276232] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1807 records). [2025-09-18T22:53:30.277042] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-09-18T22:53:30.279180] [INFO ] [MAIN ] Derivative Progress: 991/2075 symbols completed. JMIA took 1.1s. Estimated remaining: 7m 1s. Rate: 154.3 symbols/min [2025-09-18T22:53:30.279827] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:30.296755] [DEBUG] [MAIN ] JOBY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:30.299008] [INFO ] [MAIN ] JOBY: Generated 1807 derivative records from 54188 primary records. [2025-09-18T22:53:30.299138] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-09-18T22:53:30.321452] [DEBUG] [MAIN ] JNJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:30.328279] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1807 records). [2025-09-18T22:53:30.328447] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-09-18T22:53:30.329140] [INFO ] [MAIN ] JNJ: Generated 1807 derivative records from 54143 primary records. [2025-09-18T22:53:30.331775] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-09-18T22:53:30.331614] [INFO ] [MAIN ] Derivative Progress: 992/2075 symbols completed. JOBY took 1.2s. Estimated remaining: 7m 1s. Rate: 154.5 symbols/min [2025-09-18T22:53:30.332139] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:30.366358] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1807 records). [2025-09-18T22:53:30.367162] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-09-18T22:53:30.370088] [INFO ] [MAIN ] Derivative Progress: 993/2075 symbols completed. JNJ took 1.2s. Estimated remaining: 6m 60s. Rate: 154.6 symbols/min [2025-09-18T22:53:30.366886] [DEBUG] [LOCAL ] JOE: Loaded 25031 existing records from primary storage. [2025-09-18T22:53:30.373882] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:30.374011] [INFO ] [MAIN ] JOE: Loaded 25031 primary data records. [2025-09-18T22:53:30.374518] [DEBUG] [LOCAL ] JOF: Loaded 7219 existing records from primary storage. [2025-09-18T22:53:30.379841] [INFO ] [MAIN ] JOF: Loaded 7219 primary data records. [2025-09-18T22:53:31.022461] [DEBUG] [LOCAL ] JPC: Loaded 37578 existing records from primary storage. [2025-09-18T22:53:31.022843] [INFO ] [MAIN ] JPC: Loaded 37578 primary data records. [2025-09-18T22:53:31.436774] [DEBUG] [MAIN ] JOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:31.437853] [INFO ] [MAIN ] JOF: Generated 1807 derivative records from 7219 primary records. [2025-09-18T22:53:31.438393] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-09-18T22:53:31.465566] [DEBUG] [MAIN ] JOE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:31.472637] [DEBUG] [LOCAL ] JOF: Derivative data saved (1807 records). [2025-09-18T22:53:31.472974] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-09-18T22:53:31.475510] [INFO ] [MAIN ] Derivative Progress: 994/2075 symbols completed. JOF took 1.1s. Estimated remaining: 7m 0s. Rate: 154.3 symbols/min [2025-09-18T22:53:31.471991] [INFO ] [MAIN ] JOE: Generated 1807 derivative records from 25031 primary records. [2025-09-18T22:53:31.476381] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-09-18T22:53:31.477254] [INFO ] [MAIN ] JPI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:31.503891] [DEBUG] [LOCAL ] JPI: Loaded 5496 existing records from primary storage. [2025-09-18T22:53:31.504747] [INFO ] [MAIN ] JPI: Loaded 5496 primary data records. [2025-09-18T22:53:31.504588] [DEBUG] [LOCAL ] JOE: Derivative data saved (1807 records). [2025-09-18T22:53:31.504905] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-09-18T22:53:31.506866] [INFO ] [MAIN ] Derivative Progress: 995/2075 symbols completed. JOE took 1.2s. Estimated remaining: 6m 60s. Rate: 154.5 symbols/min [2025-09-18T22:53:31.544894] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:31.630782] [DEBUG] [MAIN ] JPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:31.637112] [INFO ] [MAIN ] JPC: Generated 1807 derivative records from 37578 primary records. [2025-09-18T22:53:31.637301] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-09-18T22:53:31.857590] [DEBUG] [LOCAL ] JPC: Derivative data saved (1807 records). [2025-09-18T22:53:31.857826] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-09-18T22:53:31.860416] [INFO ] [MAIN ] Derivative Progress: 996/2075 symbols completed. JPC took 1.5s. Estimated remaining: 6m 59s. Rate: 154.5 symbols/min [2025-09-18T22:53:31.874910] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:31.913844] [DEBUG] [LOCAL ] JPM: Loaded 54184 existing records from primary storage. [2025-09-18T22:53:31.914198] [INFO ] [MAIN ] JPM: Loaded 54184 primary data records. [2025-09-18T22:53:31.972543] [DEBUG] [MAIN ] JPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:31.995365] [INFO ] [MAIN ] JPI: Generated 1807 derivative records from 5496 primary records. [2025-09-18T22:53:32.033520] [DEBUG] [LOCAL ] JPI: Saving derivative data. [2025-09-18T22:53:32.045684] [DEBUG] [LOCAL ] JQC: Loaded 34199 existing records from primary storage. [2025-09-18T22:53:32.045826] [INFO ] [MAIN ] JQC: Loaded 34199 primary data records. [2025-09-18T22:53:32.382794] [DEBUG] [LOCAL ] JPI: Derivative data saved (1807 records). [2025-09-18T22:53:32.383442] [INFO ] [MAIN ] JPI: Successfully saved derivative data. [2025-09-18T22:53:32.385911] [INFO ] [MAIN ] Derivative Progress: 997/2075 symbols completed. JPI took 0.9s. Estimated remaining: 6m 59s. Rate: 154.4 symbols/min [2025-09-18T22:53:32.386585] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:32.609829] [DEBUG] [LOCAL ] JRI: Loaded 15258 existing records from primary storage. [2025-09-18T22:53:32.610596] [INFO ] [MAIN ] JRI: Loaded 15258 primary data records. [2025-09-18T22:53:32.756236] [DEBUG] [MAIN ] JPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:32.773097] [INFO ] [MAIN ] JPM: Generated 1807 derivative records from 54184 primary records. [2025-09-18T22:53:32.832412] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-09-18T22:53:33.003845] [DEBUG] [MAIN ] JQC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:33.005400] [INFO ] [MAIN ] JQC: Generated 1807 derivative records from 34199 primary records. [2025-09-18T22:53:33.005918] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-09-18T22:53:33.009623] [DEBUG] [LOCAL ] JPM: Derivative data saved (1807 records). [2025-09-18T22:53:33.017099] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-09-18T22:53:33.019502] [INFO ] [MAIN ] Derivative Progress: 998/2075 symbols completed. JPM took 1.5s. Estimated remaining: 6m 59s. Rate: 154.3 symbols/min [2025-09-18T22:53:33.026123] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:33.030428] [DEBUG] [LOCAL ] JQC: Derivative data saved (1807 records). [2025-09-18T22:53:33.030735] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-09-18T22:53:33.033137] [INFO ] [MAIN ] Derivative Progress: 999/2075 symbols completed. JQC took 1.2s. Estimated remaining: 6m 58s. Rate: 154.5 symbols/min [2025-09-18T22:53:33.033556] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:33.048957] [DEBUG] [LOCAL ] JRS: Loaded 11157 existing records from primary storage. [2025-09-18T22:53:33.049295] [INFO ] [MAIN ] JRS: Loaded 11157 primary data records. [2025-09-18T22:53:33.111706] [DEBUG] [MAIN ] JRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:33.125675] [INFO ] [MAIN ] JRI: Generated 1807 derivative records from 15258 primary records. [2025-09-18T22:53:33.125871] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-09-18T22:53:33.218757] [DEBUG] [LOCAL ] JRI: Derivative data saved (1807 records). [2025-09-18T22:53:33.230089] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-09-18T22:53:33.248103] [INFO ] [MAIN ] Derivative Progress: 1000/2075 symbols completed. JRI took 0.9s. Estimated remaining: 6m 57s. Rate: 154.5 symbols/min [2025-09-18T22:53:33.282697] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:33.284057] [DEBUG] [LOCAL ] JXN: Loaded 46440 existing records from primary storage. [2025-09-18T22:53:33.308113] [INFO ] [MAIN ] JXN: Loaded 46440 primary data records. [2025-09-18T22:53:33.838058] [DEBUG] [LOCAL ] K: Loaded 50133 existing records from primary storage. [2025-09-18T22:53:33.839827] [INFO ] [MAIN ] K: Loaded 50133 primary data records. [2025-09-18T22:53:33.930281] [DEBUG] [MAIN ] JRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:33.969129] [INFO ] [MAIN ] JRS: Generated 1807 derivative records from 11157 primary records. [2025-09-18T22:53:33.969432] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-09-18T22:53:34.071369] [DEBUG] [LOCAL ] JRS: Derivative data saved (1807 records). [2025-09-18T22:53:34.101439] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-09-18T22:53:34.213313] [INFO ] [MAIN ] Derivative Progress: 1001/2075 symbols completed. JRS took 1.2s. Estimated remaining: 6m 58s. Rate: 154.3 symbols/min [2025-09-18T22:53:34.213929] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:34.229009] [DEBUG] [MAIN ] JXN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:34.230052] [INFO ] [MAIN ] JXN: Generated 1807 derivative records from 46440 primary records. [2025-09-18T22:53:34.230315] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-09-18T22:53:34.253055] [DEBUG] [LOCAL ] JXN: Derivative data saved (1807 records). [2025-09-18T22:53:34.253268] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-09-18T22:53:34.256064] [INFO ] [MAIN ] Derivative Progress: 1002/2075 symbols completed. JXN took 1.2s. Estimated remaining: 6m 57s. Rate: 154.4 symbols/min [2025-09-18T22:53:34.256500] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:34.263740] [DEBUG] [LOCAL ] KAI: Loaded 13769 existing records from primary storage. [2025-09-18T22:53:34.264229] [INFO ] [MAIN ] KAI: Loaded 13769 primary data records. [2025-09-18T22:53:34.613621] [DEBUG] [MAIN ] K: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:34.615881] [INFO ] [MAIN ] K: Generated 1807 derivative records from 50133 primary records. [2025-09-18T22:53:34.616155] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-09-18T22:53:34.636226] [DEBUG] [LOCAL ] K: Derivative data saved (1807 records). [2025-09-18T22:53:34.648591] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-09-18T22:53:34.651067] [INFO ] [MAIN ] Derivative Progress: 1003/2075 symbols completed. K took 1.4s. Estimated remaining: 6m 56s. Rate: 154.4 symbols/min [2025-09-18T22:53:34.652593] [DEBUG] [LOCAL ] KAR: Loaded 40396 existing records from primary storage. [2025-09-18T22:53:34.652808] [INFO ] [MAIN ] KAR: Loaded 40396 primary data records. [2025-09-18T22:53:34.981048] [DEBUG] [MAIN ] KAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:34.981809] [INFO ] [MAIN ] KAI: Generated 1807 derivative records from 13769 primary records. [2025-09-18T22:53:34.982028] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-09-18T22:53:35.001999] [DEBUG] [LOCAL ] KAI: Derivative data saved (1807 records). [2025-09-18T22:53:35.002302] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-09-18T22:53:35.004897] [INFO ] [MAIN ] Derivative Progress: 1004/2075 symbols completed. KAI took 0.8s. Estimated remaining: 6m 56s. Rate: 154.5 symbols/min [2025-09-18T22:53:35.024934] [DEBUG] [MAIN ] KAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:35.025557] [INFO ] [MAIN ] KAR: Generated 1807 derivative records from 40396 primary records. [2025-09-18T22:53:35.025617] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-09-18T22:53:35.041516] [DEBUG] [LOCAL ] KAR: Derivative data saved (1807 records). [2025-09-18T22:53:35.041596] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-09-18T22:53:35.043774] [INFO ] [MAIN ] Derivative Progress: 1005/2075 symbols completed. KAR took 0.8s. Estimated remaining: 6m 55s. Rate: 154.6 symbols/min [2025-09-18T22:53:35.044424] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:35.044607] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:35.044685] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:35.082745] [DEBUG] [LOCAL ] KBDC: Loaded 20772 existing records from primary storage. [2025-09-18T22:53:35.083172] [DEBUG] [LOCAL ] KB: Loaded 24589 existing records from primary storage. [2025-09-18T22:53:35.083332] [INFO ] [MAIN ] KBDC: Loaded 20772 primary data records. [2025-09-18T22:53:35.088629] [INFO ] [MAIN ] KB: Loaded 24589 primary data records. [2025-09-18T22:53:35.413596] [DEBUG] [LOCAL ] KBH: Loaded 49212 existing records from primary storage. [2025-09-18T22:53:35.427940] [INFO ] [MAIN ] KBH: Loaded 49212 primary data records. [2025-09-18T22:53:36.152042] [DEBUG] [MAIN ] KBDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:36.154894] [INFO ] [MAIN ] KBDC: Generated 1807 derivative records from 20772 primary records. [2025-09-18T22:53:36.155601] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-09-18T22:53:36.177857] [DEBUG] [MAIN ] KB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:36.183404] [INFO ] [MAIN ] KB: Generated 1807 derivative records from 24589 primary records. [2025-09-18T22:53:36.183563] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-09-18T22:53:36.196290] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1807 records). [2025-09-18T22:53:36.200927] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-09-18T22:53:36.206087] [INFO ] [MAIN ] Derivative Progress: 1006/2075 symbols completed. KBDC took 1.2s. Estimated remaining: 6m 56s. Rate: 154.3 symbols/min [2025-09-18T22:53:36.206965] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:36.208012] [DEBUG] [LOCAL ] KB: Derivative data saved (1807 records). [2025-09-18T22:53:36.208766] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-09-18T22:53:36.211261] [INFO ] [MAIN ] Derivative Progress: 1007/2075 symbols completed. KB took 1.2s. Estimated remaining: 6m 55s. Rate: 154.4 symbols/min [2025-09-18T22:53:36.211527] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:36.228494] [DEBUG] [MAIN ] KBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:36.229253] [INFO ] [MAIN ] KBH: Generated 1807 derivative records from 49212 primary records. [2025-09-18T22:53:36.229469] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-09-18T22:53:36.245556] [DEBUG] [LOCAL ] KBH: Derivative data saved (1807 records). [2025-09-18T22:53:36.245638] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-09-18T22:53:36.248075] [INFO ] [MAIN ] Derivative Progress: 1008/2075 symbols completed. KBH took 1.2s. Estimated remaining: 6m 54s. Rate: 154.6 symbols/min [2025-09-18T22:53:36.248366] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:36.255839] [DEBUG] [LOCAL ] KEN: Loaded 4756 existing records from primary storage. [2025-09-18T22:53:36.255977] [INFO ] [MAIN ] KEN: Loaded 4756 primary data records. [2025-09-18T22:53:36.475866] [DEBUG] [LOCAL ] KBR: Loaded 48678 existing records from primary storage. [2025-09-18T22:53:36.481688] [INFO ] [MAIN ] KBR: Loaded 48678 primary data records. [2025-09-18T22:53:36.676282] [DEBUG] [LOCAL ] KD: Loaded 52684 existing records from primary storage. [2025-09-18T22:53:36.698269] [INFO ] [MAIN ] KD: Loaded 52684 primary data records. [2025-09-18T22:53:37.279163] [DEBUG] [MAIN ] KEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:37.281179] [INFO ] [MAIN ] KEN: Generated 1807 derivative records from 4756 primary records. [2025-09-18T22:53:37.281310] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-09-18T22:53:37.303894] [DEBUG] [LOCAL ] KEN: Derivative data saved (1807 records). [2025-09-18T22:53:37.304236] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-09-18T22:53:37.307200] [INFO ] [MAIN ] Derivative Progress: 1009/2075 symbols completed. KEN took 1.1s. Estimated remaining: 6m 54s. Rate: 154.3 symbols/min [2025-09-18T22:53:37.321266] [DEBUG] [MAIN ] KBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:37.321607] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:37.323048] [INFO ] [MAIN ] KBR: Generated 1807 derivative records from 48678 primary records. [2025-09-18T22:53:37.323520] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-09-18T22:53:37.360671] [DEBUG] [MAIN ] KD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:37.359881] [DEBUG] [LOCAL ] KBR: Derivative data saved (1807 records). [2025-09-18T22:53:37.368791] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-09-18T22:53:37.369964] [INFO ] [MAIN ] KD: Generated 1807 derivative records from 52684 primary records. [2025-09-18T22:53:37.372510] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-09-18T22:53:37.372349] [INFO ] [MAIN ] Derivative Progress: 1010/2075 symbols completed. KBR took 1.2s. Estimated remaining: 6m 54s. Rate: 154.4 symbols/min [2025-09-18T22:53:37.387068] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:37.407420] [DEBUG] [LOCAL ] KEP: Loaded 30415 existing records from primary storage. [2025-09-18T22:53:37.408144] [INFO ] [MAIN ] KEP: Loaded 30415 primary data records. [2025-09-18T22:53:37.408078] [DEBUG] [LOCAL ] KD: Derivative data saved (1807 records). [2025-09-18T22:53:37.420131] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-09-18T22:53:37.469767] [INFO ] [MAIN ] Derivative Progress: 1011/2075 symbols completed. KD took 1.3s. Estimated remaining: 6m 53s. Rate: 154.6 symbols/min [2025-09-18T22:53:37.508962] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:37.779213] [DEBUG] [LOCAL ] KEX: Loaded 38096 existing records from primary storage. [2025-09-18T22:53:37.780297] [INFO ] [MAIN ] KEX: Loaded 38096 primary data records. [2025-09-18T22:53:37.996296] [DEBUG] [LOCAL ] KEYS: Loaded 43754 existing records from primary storage. [2025-09-18T22:53:38.103777] [INFO ] [MAIN ] KEYS: Loaded 43754 primary data records. [2025-09-18T22:53:38.441769] [DEBUG] [MAIN ] KEP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:38.442693] [INFO ] [MAIN ] KEP: Generated 1807 derivative records from 30415 primary records. [2025-09-18T22:53:38.442969] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-09-18T22:53:38.463192] [DEBUG] [LOCAL ] KEP: Derivative data saved (1807 records). [2025-09-18T22:53:38.464528] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-09-18T22:53:38.466553] [INFO ] [MAIN ] Derivative Progress: 1012/2075 symbols completed. KEP took 1.1s. Estimated remaining: 6m 53s. Rate: 154.3 symbols/min [2025-09-18T22:53:38.467755] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:38.481314] [DEBUG] [MAIN ] KEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:38.484139] [INFO ] [MAIN ] KEX: Generated 1807 derivative records from 38096 primary records. [2025-09-18T22:53:38.484706] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-09-18T22:53:38.495335] [DEBUG] [LOCAL ] KF: Loaded 2515 existing records from primary storage. [2025-09-18T22:53:38.499334] [INFO ] [MAIN ] KF: Loaded 2515 primary data records. [2025-09-18T22:53:38.626730] [DEBUG] [LOCAL ] KEX: Derivative data saved (1807 records). [2025-09-18T22:53:38.638247] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-09-18T22:53:38.666577] [INFO ] [MAIN ] Derivative Progress: 1013/2075 symbols completed. KEX took 1.3s. Estimated remaining: 6m 53s. Rate: 154.4 symbols/min [2025-09-18T22:53:38.697694] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:38.828500] [DEBUG] [MAIN ] KEYS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:38.829322] [INFO ] [MAIN ] KEYS: Generated 1807 derivative records from 43754 primary records. [2025-09-18T22:53:38.829427] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-09-18T22:53:38.853217] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1807 records). [2025-09-18T22:53:38.853434] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-09-18T22:53:38.856419] [INFO ] [MAIN ] Derivative Progress: 1014/2075 symbols completed. KEYS took 1.4s. Estimated remaining: 6m 52s. Rate: 154.5 symbols/min [2025-09-18T22:53:38.856954] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:38.864313] [DEBUG] [LOCAL ] KFRC: Loaded 19331 existing records from primary storage. [2025-09-18T22:53:38.864628] [INFO ] [MAIN ] KFRC: Loaded 19331 primary data records. [2025-09-18T22:53:38.960696] [DEBUG] [LOCAL ] KFS: Loaded 8191 existing records from primary storage. [2025-09-18T22:53:38.975204] [INFO ] [MAIN ] KFS: Loaded 8191 primary data records. [2025-09-18T22:53:39.312904] [DEBUG] [MAIN ] KF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:39.325968] [INFO ] [MAIN ] KF: Generated 1807 derivative records from 2515 primary records. [2025-09-18T22:53:39.338775] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-09-18T22:53:39.419057] [DEBUG] [LOCAL ] KF: Derivative data saved (1807 records). [2025-09-18T22:53:39.419212] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-09-18T22:53:39.422066] [INFO ] [MAIN ] Derivative Progress: 1015/2075 symbols completed. KF took 1.0s. Estimated remaining: 6m 52s. Rate: 154.4 symbols/min [2025-09-18T22:53:39.517182] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:39.610620] [DEBUG] [MAIN ] KFRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:39.611583] [INFO ] [MAIN ] KFRC: Generated 1807 derivative records from 19331 primary records. [2025-09-18T22:53:39.611788] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-09-18T22:53:39.638202] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1807 records). [2025-09-18T22:53:39.639981] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-09-18T22:53:39.642447] [INFO ] [MAIN ] Derivative Progress: 1016/2075 symbols completed. KFRC took 0.9s. Estimated remaining: 6m 51s. Rate: 154.5 symbols/min [2025-09-18T22:53:39.652013] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:39.666482] [DEBUG] [MAIN ] KFS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:39.666031] [DEBUG] [LOCAL ] KFY: Loaded 31051 existing records from primary storage. [2025-09-18T22:53:39.666617] [INFO ] [MAIN ] KFY: Loaded 31051 primary data records. [2025-09-18T22:53:39.667311] [INFO ] [MAIN ] KFS: Generated 1807 derivative records from 8191 primary records. [2025-09-18T22:53:39.667561] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-09-18T22:53:39.862722] [DEBUG] [LOCAL ] KFS: Derivative data saved (1807 records). [2025-09-18T22:53:39.977724] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-09-18T22:53:39.987696] [INFO ] [MAIN ] Derivative Progress: 1017/2075 symbols completed. KFS took 1.1s. Estimated remaining: 6m 51s. Rate: 154.5 symbols/min [2025-09-18T22:53:39.988138] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:40.031124] [DEBUG] [LOCAL ] KGC: Loaded 54089 existing records from primary storage. [2025-09-18T22:53:40.033118] [INFO ] [MAIN ] KGC: Loaded 54089 primary data records. [2025-09-18T22:53:40.123078] [DEBUG] [MAIN ] KFY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:40.160814] [INFO ] [MAIN ] KFY: Generated 1807 derivative records from 31051 primary records. [2025-09-18T22:53:40.164507] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-09-18T22:53:40.309807] [DEBUG] [LOCAL ] KFY: Derivative data saved (1807 records). [2025-09-18T22:53:40.393464] [DEBUG] [LOCAL ] KGS: Loaded 46132 existing records from primary storage. [2025-09-18T22:53:40.393871] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-09-18T22:53:40.397354] [INFO ] [MAIN ] KGS: Loaded 46132 primary data records. [2025-09-18T22:53:40.397202] [INFO ] [MAIN ] Derivative Progress: 1018/2075 symbols completed. KFY took 1.0s. Estimated remaining: 6m 51s. Rate: 154.5 symbols/min [2025-09-18T22:53:40.727675] [DEBUG] [MAIN ] KGC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:40.729436] [INFO ] [MAIN ] KGC: Generated 1807 derivative records from 54089 primary records. [2025-09-18T22:53:40.729530] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-09-18T22:53:40.749772] [DEBUG] [LOCAL ] KGC: Derivative data saved (1807 records). [2025-09-18T22:53:40.750013] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-09-18T22:53:40.752418] [INFO ] [MAIN ] Derivative Progress: 1019/2075 symbols completed. KGC took 1.1s. Estimated remaining: 6m 50s. Rate: 154.5 symbols/min [2025-09-18T22:53:40.769917] [DEBUG] [MAIN ] KGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:40.770568] [INFO ] [MAIN ] KGS: Generated 1807 derivative records from 46132 primary records. [2025-09-18T22:53:40.770629] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-09-18T22:53:40.786545] [DEBUG] [LOCAL ] KGS: Derivative data saved (1807 records). [2025-09-18T22:53:40.786627] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-09-18T22:53:40.789054] [INFO ] [MAIN ] Derivative Progress: 1020/2075 symbols completed. KGS took 0.8s. Estimated remaining: 6m 49s. Rate: 154.6 symbols/min [2025-09-18T22:53:40.789975] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:40.790176] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:40.789894] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:40.821556] [DEBUG] [LOCAL ] KIO: Loaded 21562 existing records from primary storage. [2025-09-18T22:53:40.821887] [INFO ] [MAIN ] KIO: Loaded 21562 primary data records. [2025-09-18T22:53:41.206092] [DEBUG] [LOCAL ] KKR: Loaded 53901 existing records from primary storage. [2025-09-18T22:53:41.207683] [INFO ] [MAIN ] KKR: Loaded 53901 primary data records. [2025-09-18T22:53:41.208557] [DEBUG] [LOCAL ] KIM: Loaded 53461 existing records from primary storage. [2025-09-18T22:53:41.220132] [INFO ] [MAIN ] KIM: Loaded 53461 primary data records. [2025-09-18T22:53:41.918609] [DEBUG] [MAIN ] KIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:41.920455] [INFO ] [MAIN ] KIO: Generated 1807 derivative records from 21562 primary records. [2025-09-18T22:53:41.920820] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-09-18T22:53:41.941731] [DEBUG] [LOCAL ] KIO: Derivative data saved (1807 records). [2025-09-18T22:53:41.942148] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-09-18T22:53:41.944613] [INFO ] [MAIN ] Derivative Progress: 1021/2075 symbols completed. KIO took 1.2s. Estimated remaining: 6m 50s. Rate: 154.3 symbols/min [2025-09-18T22:53:41.945430] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:41.955345] [DEBUG] [LOCAL ] KKRS: Loaded 5768 existing records from primary storage. [2025-09-18T22:53:41.960040] [INFO ] [MAIN ] KKRS: Loaded 5768 primary data records. [2025-09-18T22:53:42.017481] [DEBUG] [MAIN ] KKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:42.030518] [DEBUG] [MAIN ] KIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:42.070369] [INFO ] [MAIN ] KIM: Generated 1807 derivative records from 53461 primary records. [2025-09-18T22:53:42.069687] [INFO ] [MAIN ] KKR: Generated 1807 derivative records from 53901 primary records. [2025-09-18T22:53:42.075738] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-09-18T22:53:42.075807] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-09-18T22:53:42.322296] [DEBUG] [LOCAL ] KIM: Derivative data saved (1807 records). [2025-09-18T22:53:42.322576] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-09-18T22:53:42.321408] [DEBUG] [LOCAL ] KKR: Derivative data saved (1807 records). [2025-09-18T22:53:42.325072] [INFO ] [MAIN ] Derivative Progress: 1022/2075 symbols completed. KIM took 1.5s. Estimated remaining: 6m 49s. Rate: 154.3 symbols/min [2025-09-18T22:53:42.325197] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-09-18T22:53:42.325455] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:42.327686] [INFO ] [MAIN ] Derivative Progress: 1023/2075 symbols completed. KKR took 1.5s. Estimated remaining: 6m 49s. Rate: 154.5 symbols/min [2025-09-18T22:53:42.328601] [INFO ] [MAIN ] KLG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:42.362540] [DEBUG] [MAIN ] KKRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:42.363390] [INFO ] [MAIN ] KKRS: Generated 1807 derivative records from 5768 primary records. [2025-09-18T22:53:42.363502] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-09-18T22:53:42.387687] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1807 records). [2025-09-18T22:53:42.398154] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-09-18T22:53:42.401953] [DEBUG] [LOCAL ] KLC: Loaded 36441 existing records from primary storage. [2025-09-18T22:53:42.400673] [INFO ] [MAIN ] Derivative Progress: 1024/2075 symbols completed. KKRS took 0.5s. Estimated remaining: 6m 48s. Rate: 154.6 symbols/min [2025-09-18T22:53:42.402686] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:42.402590] [INFO ] [MAIN ] KLC: Loaded 36441 primary data records. [2025-09-18T22:53:42.480292] [DEBUG] [LOCAL ] KLG: Loaded 42255 existing records from primary storage. [2025-09-18T22:53:42.492720] [INFO ] [MAIN ] KLG: Loaded 42255 primary data records. [2025-09-18T22:53:43.066715] [DEBUG] [LOCAL ] KMI: Loaded 54083 existing records from primary storage. [2025-09-18T22:53:43.067970] [INFO ] [MAIN ] KMI: Loaded 54083 primary data records. [2025-09-18T22:53:43.289161] [DEBUG] [MAIN ] KLC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:43.409519] [INFO ] [MAIN ] KLC: Generated 1807 derivative records from 36441 primary records. [2025-09-18T22:53:43.418504] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-09-18T22:53:43.448535] [DEBUG] [LOCAL ] KLC: Derivative data saved (1807 records). [2025-09-18T22:53:43.448944] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-09-18T22:53:43.451207] [INFO ] [MAIN ] Derivative Progress: 1025/2075 symbols completed. KLC took 1.1s. Estimated remaining: 6m 48s. Rate: 154.3 symbols/min [2025-09-18T22:53:43.456668] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:43.457941] [DEBUG] [MAIN ] KLG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:43.459330] [INFO ] [MAIN ] KLG: Generated 1807 derivative records from 42255 primary records. [2025-09-18T22:53:43.459585] [DEBUG] [LOCAL ] KLG: Saving derivative data. [2025-09-18T22:53:43.479996] [DEBUG] [LOCAL ] KMPB: Loaded 3640 existing records from primary storage. [2025-09-18T22:53:43.480311] [INFO ] [MAIN ] KMPB: Loaded 3640 primary data records. [2025-09-18T22:53:43.577255] [DEBUG] [LOCAL ] KLG: Derivative data saved (1807 records). [2025-09-18T22:53:43.588547] [INFO ] [MAIN ] KLG: Successfully saved derivative data. [2025-09-18T22:53:43.591568] [INFO ] [MAIN ] Derivative Progress: 1026/2075 symbols completed. KLG took 1.3s. Estimated remaining: 6m 48s. Rate: 154.4 symbols/min [2025-09-18T22:53:43.603890] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:43.668669] [DEBUG] [MAIN ] KMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:43.691492] [INFO ] [MAIN ] KMI: Generated 1807 derivative records from 54083 primary records. [2025-09-18T22:53:43.846857] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-09-18T22:53:43.870143] [DEBUG] [LOCAL ] KMI: Derivative data saved (1807 records). [2025-09-18T22:53:43.870439] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-09-18T22:53:43.882356] [INFO ] [MAIN ] Derivative Progress: 1027/2075 symbols completed. KMI took 1.5s. Estimated remaining: 6m 47s. Rate: 154.5 symbols/min [2025-09-18T22:53:43.884548] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:43.917248] [DEBUG] [MAIN ] KMPB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:43.918737] [DEBUG] [LOCAL ] KMPR: Loaded 38088 existing records from primary storage. [2025-09-18T22:53:43.919715] [INFO ] [MAIN ] KMPB: Generated 1807 derivative records from 3640 primary records. [2025-09-18T22:53:43.919849] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-09-18T22:53:43.919937] [INFO ] [MAIN ] KMPR: Loaded 38088 primary data records. [2025-09-18T22:53:44.060232] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1807 records). [2025-09-18T22:53:44.076422] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-09-18T22:53:44.089164] [INFO ] [MAIN ] Derivative Progress: 1028/2075 symbols completed. KMPB took 0.6s. Estimated remaining: 6m 46s. Rate: 154.5 symbols/min [2025-09-18T22:53:44.149300] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:44.285122] [DEBUG] [LOCAL ] KMT: Loaded 43538 existing records from primary storage. [2025-09-18T22:53:44.285675] [INFO ] [MAIN ] KMT: Loaded 43538 primary data records. [2025-09-18T22:53:44.659275] [DEBUG] [LOCAL ] KMX: Loaded 53480 existing records from primary storage. [2025-09-18T22:53:44.659988] [INFO ] [MAIN ] KMX: Loaded 53480 primary data records. [2025-09-18T22:53:44.789114] [DEBUG] [MAIN ] KMPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:44.800456] [INFO ] [MAIN ] KMPR: Generated 1807 derivative records from 38088 primary records. [2025-09-18T22:53:44.810937] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-09-18T22:53:45.003450] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1807 records). [2025-09-18T22:53:45.003819] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-09-18T22:53:45.011877] [INFO ] [MAIN ] Derivative Progress: 1029/2075 symbols completed. KMPR took 1.4s. Estimated remaining: 6m 47s. Rate: 154.3 symbols/min [2025-09-18T22:53:45.023899] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:45.026088] [DEBUG] [MAIN ] KMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:45.027161] [INFO ] [MAIN ] KMT: Generated 1807 derivative records from 43538 primary records. [2025-09-18T22:53:45.027449] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-09-18T22:53:45.057138] [DEBUG] [LOCAL ] KMT: Derivative data saved (1807 records). [2025-09-18T22:53:45.057531] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-09-18T22:53:45.060360] [INFO ] [MAIN ] Derivative Progress: 1030/2075 symbols completed. KMT took 1.2s. Estimated remaining: 6m 46s. Rate: 154.5 symbols/min [2025-09-18T22:53:45.061123] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:45.088483] [DEBUG] [MAIN ] KMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:45.089560] [INFO ] [MAIN ] KMX: Generated 1807 derivative records from 53480 primary records. [2025-09-18T22:53:45.089736] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-09-18T22:53:45.107196] [DEBUG] [LOCAL ] KMX: Derivative data saved (1807 records). [2025-09-18T22:53:45.118932] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-09-18T22:53:45.121681] [INFO ] [MAIN ] Derivative Progress: 1031/2075 symbols completed. KMX took 1.0s. Estimated remaining: 6m 45s. Rate: 154.6 symbols/min [2025-09-18T22:53:45.123202] [DEBUG] [LOCAL ] KN: Loaded 39405 existing records from primary storage. [2025-09-18T22:53:45.123440] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:45.123627] [INFO ] [MAIN ] KN: Loaded 39405 primary data records. [2025-09-18T22:53:45.258239] [DEBUG] [LOCAL ] KNOP: Loaded 9985 existing records from primary storage. [2025-09-18T22:53:45.280272] [DEBUG] [LOCAL ] KNF: Loaded 36005 existing records from primary storage. [2025-09-18T22:53:45.280434] [INFO ] [MAIN ] KNF: Loaded 36005 primary data records. [2025-09-18T22:53:45.279471] [INFO ] [MAIN ] KNOP: Loaded 9985 primary data records. [2025-09-18T22:53:46.153586] [DEBUG] [MAIN ] KN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:46.155084] [INFO ] [MAIN ] KN: Generated 1807 derivative records from 39405 primary records. [2025-09-18T22:53:46.157740] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-09-18T22:53:46.188237] [DEBUG] [MAIN ] KNF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:46.203049] [DEBUG] [MAIN ] KNOP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:46.202189] [INFO ] [MAIN ] KNF: Generated 1807 derivative records from 36005 primary records. [2025-09-18T22:53:46.203726] [INFO ] [MAIN ] KNOP: Generated 1807 derivative records from 9985 primary records. [2025-09-18T22:53:46.206307] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-09-18T22:53:46.206765] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-09-18T22:53:46.210352] [DEBUG] [LOCAL ] KN: Derivative data saved (1807 records). [2025-09-18T22:53:46.217983] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-09-18T22:53:46.241423] [INFO ] [MAIN ] Derivative Progress: 1032/2075 symbols completed. KN took 1.2s. Estimated remaining: 6m 46s. Rate: 154.3 symbols/min [2025-09-18T22:53:46.244166] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1807 records). [2025-09-18T22:53:46.244515] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:46.244605] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-09-18T22:53:46.242343] [DEBUG] [LOCAL ] KNF: Derivative data saved (1807 records). [2025-09-18T22:53:46.245058] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-09-18T22:53:46.247953] [INFO ] [MAIN ] Derivative Progress: 1033/2075 symbols completed. KNOP took 1.1s. Estimated remaining: 6m 45s. Rate: 154.5 symbols/min [2025-09-18T22:53:46.250983] [INFO ] [MAIN ] Derivative Progress: 1034/2075 symbols completed. KNF took 1.2s. Estimated remaining: 6m 44s. Rate: 154.6 symbols/min [2025-09-18T22:53:46.278376] [DEBUG] [LOCAL ] KNSL: Loaded 18273 existing records from primary storage. [2025-09-18T22:53:46.278562] [INFO ] [MAIN ] KNSL: Loaded 18273 primary data records. [2025-09-18T22:53:46.613485] [DEBUG] [MAIN ] KNSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:46.614184] [INFO ] [MAIN ] KNSL: Generated 1807 derivative records from 18273 primary records. [2025-09-18T22:53:46.614249] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-09-18T22:53:46.634972] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1807 records). [2025-09-18T22:53:46.635158] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-09-18T22:53:46.637501] [INFO ] [MAIN ] Derivative Progress: 1035/2075 symbols completed. KNSL took 0.4s. Estimated remaining: 6m 44s. Rate: 154.6 symbols/min [2025-09-18T22:53:46.638326] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:46.638621] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:46.638873] [INFO ] [MAIN ] KO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:46.714470] [DEBUG] [LOCAL ] KNTK: Loaded 46485 existing records from primary storage. [2025-09-18T22:53:46.714693] [INFO ] [MAIN ] KNTK: Loaded 46485 primary data records. [2025-09-18T22:53:46.819489] [DEBUG] [LOCAL ] KNX: Loaded 52977 existing records from primary storage. [2025-09-18T22:53:46.853298] [INFO ] [MAIN ] KNX: Loaded 52977 primary data records. [2025-09-18T22:53:46.853158] [DEBUG] [LOCAL ] KO: Loaded 54208 existing records from primary storage. [2025-09-18T22:53:46.881871] [INFO ] [MAIN ] KO: Loaded 54208 primary data records. [2025-09-18T22:53:47.802777] [DEBUG] [MAIN ] KNTK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:47.804374] [INFO ] [MAIN ] KNTK: Generated 1807 derivative records from 46485 primary records. [2025-09-18T22:53:47.804571] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-09-18T22:53:47.840359] [DEBUG] [MAIN ] KNX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:47.842694] [INFO ] [MAIN ] KNX: Generated 1807 derivative records from 52977 primary records. [2025-09-18T22:53:47.841726] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1807 records). [2025-09-18T22:53:47.850690] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-09-18T22:53:47.856694] [DEBUG] [MAIN ] KO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:47.856020] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-09-18T22:53:47.857801] [INFO ] [MAIN ] KO: Generated 1807 derivative records from 54208 primary records. [2025-09-18T22:53:47.858138] [DEBUG] [LOCAL ] KO: Saving derivative data. [2025-09-18T22:53:47.860035] [INFO ] [MAIN ] Derivative Progress: 1036/2075 symbols completed. KNTK took 1.2s. Estimated remaining: 6m 44s. Rate: 154.3 symbols/min [2025-09-18T22:53:47.868015] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:47.892372] [DEBUG] [LOCAL ] KO: Derivative data saved (1807 records). [2025-09-18T22:53:47.894778] [DEBUG] [LOCAL ] KNX: Derivative data saved (1807 records). [2025-09-18T22:53:47.894967] [INFO ] [MAIN ] KO: Successfully saved derivative data. [2025-09-18T22:53:47.898961] [INFO ] [MAIN ] Derivative Progress: 1037/2075 symbols completed. KO took 1.3s. Estimated remaining: 6m 43s. Rate: 154.4 symbols/min [2025-09-18T22:53:47.899380] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:47.899136] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-09-18T22:53:47.902753] [INFO ] [MAIN ] Derivative Progress: 1038/2075 symbols completed. KNX took 1.3s. Estimated remaining: 6m 43s. Rate: 154.6 symbols/min [2025-09-18T22:53:47.903141] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:47.941889] [DEBUG] [LOCAL ] KOP: Loaded 18197 existing records from primary storage. [2025-09-18T22:53:47.942084] [INFO ] [MAIN ] KOP: Loaded 18197 primary data records. [2025-09-18T22:53:48.048858] [DEBUG] [LOCAL ] KOF: Loaded 26218 existing records from primary storage. [2025-09-18T22:53:48.061706] [INFO ] [MAIN ] KOF: Loaded 26218 primary data records. [2025-09-18T22:53:48.079222] [DEBUG] [LOCAL ] KODK: Loaded 43791 existing records from primary storage. [2025-09-18T22:53:48.129233] [INFO ] [MAIN ] KODK: Loaded 43791 primary data records. [2025-09-18T22:53:48.945606] [DEBUG] [MAIN ] KOP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:48.946744] [INFO ] [MAIN ] KOP: Generated 1807 derivative records from 18197 primary records. [2025-09-18T22:53:48.947048] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-09-18T22:53:48.968026] [DEBUG] [LOCAL ] KOP: Derivative data saved (1807 records). [2025-09-18T22:53:48.968308] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-09-18T22:53:48.982773] [INFO ] [MAIN ] Derivative Progress: 1039/2075 symbols completed. KOP took 1.1s. Estimated remaining: 6m 43s. Rate: 154.3 symbols/min [2025-09-18T22:53:48.983610] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:48.985103] [DEBUG] [MAIN ] KOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:48.987020] [INFO ] [MAIN ] KOF: Generated 1807 derivative records from 26218 primary records. [2025-09-18T22:53:48.987545] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-09-18T22:53:49.001406] [DEBUG] [LOCAL ] KORE: Loaded 1964 existing records from primary storage. [2025-09-18T22:53:49.019178] [INFO ] [MAIN ] KORE: Loaded 1964 primary data records. [2025-09-18T22:53:49.029325] [DEBUG] [LOCAL ] KOF: Derivative data saved (1807 records). [2025-09-18T22:53:49.027137] [DEBUG] [MAIN ] KODK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:49.057114] [INFO ] [MAIN ] KODK: Generated 1807 derivative records from 43791 primary records. [2025-09-18T22:53:49.070164] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-09-18T22:53:49.046026] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-09-18T22:53:49.110878] [INFO ] [MAIN ] Derivative Progress: 1040/2075 symbols completed. KOF took 1.2s. Estimated remaining: 6m 42s. Rate: 154.4 symbols/min [2025-09-18T22:53:49.146819] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:49.361389] [DEBUG] [LOCAL ] KODK: Derivative data saved (1807 records). [2025-09-18T22:53:49.362118] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-09-18T22:53:49.364818] [INFO ] [MAIN ] Derivative Progress: 1041/2075 symbols completed. KODK took 1.5s. Estimated remaining: 6m 42s. Rate: 154.5 symbols/min [2025-09-18T22:53:49.365949] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:49.406320] [DEBUG] [MAIN ] KORE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:49.407511] [INFO ] [MAIN ] KORE: Generated 1807 derivative records from 1964 primary records. [2025-09-18T22:53:49.407620] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-09-18T22:53:49.424990] [DEBUG] [LOCAL ] KOS: Loaded 53459 existing records from primary storage. [2025-09-18T22:53:49.436517] [INFO ] [MAIN ] KOS: Loaded 53459 primary data records. [2025-09-18T22:53:49.533396] [DEBUG] [LOCAL ] KORE: Derivative data saved (1807 records). [2025-09-18T22:53:49.564195] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-09-18T22:53:49.582152] [INFO ] [MAIN ] Derivative Progress: 1042/2075 symbols completed. KORE took 0.6s. Estimated remaining: 6m 41s. Rate: 154.5 symbols/min [2025-09-18T22:53:49.623883] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:49.599665] [DEBUG] [LOCAL ] KR: Loaded 54072 existing records from primary storage. [2025-09-18T22:53:49.624242] [INFO ] [MAIN ] KR: Loaded 54072 primary data records. [2025-09-18T22:53:50.163476] [DEBUG] [LOCAL ] KRC: Loaded 48795 existing records from primary storage. [2025-09-18T22:53:50.164168] [INFO ] [MAIN ] KRC: Loaded 48795 primary data records. [2025-09-18T22:53:50.395759] [DEBUG] [MAIN ] KOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:50.521595] [INFO ] [MAIN ] KOS: Generated 1807 derivative records from 53459 primary records. [2025-09-18T22:53:50.522379] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-09-18T22:53:50.543361] [DEBUG] [LOCAL ] KOS: Derivative data saved (1807 records). [2025-09-18T22:53:50.544134] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-09-18T22:53:50.559271] [INFO ] [MAIN ] Derivative Progress: 1043/2075 symbols completed. KOS took 1.4s. Estimated remaining: 6m 41s. Rate: 154.3 symbols/min [2025-09-18T22:53:50.561184] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:50.560487] [DEBUG] [MAIN ] KR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:50.562443] [INFO ] [MAIN ] KR: Generated 1807 derivative records from 54072 primary records. [2025-09-18T22:53:50.562903] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-09-18T22:53:50.583481] [DEBUG] [LOCAL ] KR: Derivative data saved (1807 records). [2025-09-18T22:53:50.583779] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-09-18T22:53:50.586322] [INFO ] [MAIN ] Derivative Progress: 1044/2075 symbols completed. KR took 1.2s. Estimated remaining: 6m 41s. Rate: 154.4 symbols/min [2025-09-18T22:53:50.586729] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:50.606305] [DEBUG] [MAIN ] KRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:50.616477] [INFO ] [MAIN ] KRC: Generated 1807 derivative records from 48795 primary records. [2025-09-18T22:53:50.616571] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-09-18T22:53:50.644111] [DEBUG] [LOCAL ] KRC: Derivative data saved (1807 records). [2025-09-18T22:53:50.646007] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-09-18T22:53:50.648585] [INFO ] [MAIN ] Derivative Progress: 1045/2075 symbols completed. KRC took 1.0s. Estimated remaining: 6m 40s. Rate: 154.6 symbols/min [2025-09-18T22:53:50.648999] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:50.650413] [DEBUG] [LOCAL ] KREF: Loaded 37241 existing records from primary storage. [2025-09-18T22:53:50.650763] [INFO ] [MAIN ] KREF: Loaded 37241 primary data records. [2025-09-18T22:53:50.885246] [DEBUG] [LOCAL ] KRO: Loaded 25967 existing records from primary storage. [2025-09-18T22:53:50.886755] [INFO ] [MAIN ] KRO: Loaded 25967 primary data records. [2025-09-18T22:53:50.886587] [DEBUG] [LOCAL ] KRG: Loaded 49537 existing records from primary storage. [2025-09-18T22:53:50.892206] [INFO ] [MAIN ] KRG: Loaded 49537 primary data records. [2025-09-18T22:53:51.655177] [DEBUG] [MAIN ] KREF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:51.656254] [INFO ] [MAIN ] KREF: Generated 1807 derivative records from 37241 primary records. [2025-09-18T22:53:51.656581] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-09-18T22:53:51.691143] [DEBUG] [LOCAL ] KREF: Derivative data saved (1807 records). [2025-09-18T22:53:51.691578] [DEBUG] [MAIN ] KRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:51.692494] [INFO ] [MAIN ] KRO: Generated 1807 derivative records from 25967 primary records. [2025-09-18T22:53:51.692599] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-09-18T22:53:51.692834] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-09-18T22:53:51.695191] [INFO ] [MAIN ] Derivative Progress: 1046/2075 symbols completed. KREF took 1.1s. Estimated remaining: 6m 40s. Rate: 154.3 symbols/min [2025-09-18T22:53:51.695860] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:51.713897] [DEBUG] [LOCAL ] KRO: Derivative data saved (1807 records). [2025-09-18T22:53:51.714174] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-09-18T22:53:51.717063] [INFO ] [MAIN ] Derivative Progress: 1047/2075 symbols completed. KRO took 1.1s. Estimated remaining: 6m 39s. Rate: 154.4 symbols/min [2025-09-18T22:53:51.725202] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:51.731281] [DEBUG] [MAIN ] KRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:51.731984] [INFO ] [MAIN ] KRG: Generated 1807 derivative records from 49537 primary records. [2025-09-18T22:53:51.732184] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-09-18T22:53:51.748689] [DEBUG] [LOCAL ] KRG: Derivative data saved (1807 records). [2025-09-18T22:53:51.748826] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-09-18T22:53:51.751441] [INFO ] [MAIN ] Derivative Progress: 1048/2075 symbols completed. KRG took 1.2s. Estimated remaining: 6m 39s. Rate: 154.6 symbols/min [2025-09-18T22:53:51.807951] [DEBUG] [LOCAL ] KRP: Loaded 38364 existing records from primary storage. [2025-09-18T22:53:51.808792] [INFO ] [MAIN ] KRP: Loaded 38364 primary data records. [2025-09-18T22:53:51.924755] [DEBUG] [LOCAL ] KSS: Loaded 54002 existing records from primary storage. [2025-09-18T22:53:51.927218] [INFO ] [MAIN ] KSS: Loaded 54002 primary data records. [2025-09-18T22:53:52.472727] [DEBUG] [MAIN ] KRP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:52.473502] [INFO ] [MAIN ] KRP: Generated 1807 derivative records from 38364 primary records. [2025-09-18T22:53:52.473686] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-09-18T22:53:52.492081] [DEBUG] [LOCAL ] KRP: Derivative data saved (1807 records). [2025-09-18T22:53:52.492312] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-09-18T22:53:52.494219] [INFO ] [MAIN ] Derivative Progress: 1049/2075 symbols completed. KRP took 0.8s. Estimated remaining: 6m 39s. Rate: 154.4 symbols/min [2025-09-18T22:53:52.506701] [DEBUG] [MAIN ] KSS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:52.507318] [INFO ] [MAIN ] KSS: Generated 1807 derivative records from 54002 primary records. [2025-09-18T22:53:52.507379] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-09-18T22:53:52.522661] [DEBUG] [LOCAL ] KSS: Derivative data saved (1807 records). [2025-09-18T22:53:52.522736] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-09-18T22:53:52.524764] [INFO ] [MAIN ] Derivative Progress: 1050/2075 symbols completed. KSS took 0.8s. Estimated remaining: 6m 38s. Rate: 154.6 symbols/min [2025-09-18T22:53:52.525435] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:52.525622] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:52.525954] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:52.541361] [DEBUG] [LOCAL ] KTF: Loaded 13268 existing records from primary storage. [2025-09-18T22:53:52.541494] [INFO ] [MAIN ] KTF: Loaded 13268 primary data records. [2025-09-18T22:53:52.770075] [DEBUG] [LOCAL ] KTB: Loaded 41629 existing records from primary storage. [2025-09-18T22:53:52.770407] [INFO ] [MAIN ] KTB: Loaded 41629 primary data records. [2025-09-18T22:53:52.915313] [DEBUG] [LOCAL ] KT: Loaded 46030 existing records from primary storage. [2025-09-18T22:53:52.940831] [INFO ] [MAIN ] KT: Loaded 46030 primary data records. [2025-09-18T22:53:53.544303] [DEBUG] [MAIN ] KTF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:53.546506] [INFO ] [MAIN ] KTF: Generated 1807 derivative records from 13268 primary records. [2025-09-18T22:53:53.546813] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-09-18T22:53:53.564092] [DEBUG] [LOCAL ] KTF: Derivative data saved (1807 records). [2025-09-18T22:53:53.564490] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-09-18T22:53:53.566755] [INFO ] [MAIN ] Derivative Progress: 1051/2075 symbols completed. KTF took 1.0s. Estimated remaining: 6m 38s. Rate: 154.3 symbols/min [2025-09-18T22:53:53.567019] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:53.583862] [DEBUG] [MAIN ] KTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:53.586944] [INFO ] [MAIN ] KTB: Generated 1807 derivative records from 41629 primary records. [2025-09-18T22:53:53.587148] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-09-18T22:53:53.611400] [DEBUG] [MAIN ] KT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:53.614993] [INFO ] [MAIN ] KT: Generated 1807 derivative records from 46030 primary records. [2025-09-18T22:53:53.615430] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-09-18T22:53:53.632129] [DEBUG] [LOCAL ] KTB: Derivative data saved (1807 records). [2025-09-18T22:53:53.634083] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-09-18T22:53:53.636134] [INFO ] [MAIN ] Derivative Progress: 1052/2075 symbols completed. KTB took 1.1s. Estimated remaining: 6m 37s. Rate: 154.5 symbols/min [2025-09-18T22:53:53.636508] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:53.639395] [DEBUG] [LOCAL ] KT: Derivative data saved (1807 records). [2025-09-18T22:53:53.639920] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-09-18T22:53:53.642686] [INFO ] [MAIN ] Derivative Progress: 1053/2075 symbols completed. KT took 1.1s. Estimated remaining: 6m 37s. Rate: 154.6 symbols/min [2025-09-18T22:53:53.643072] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:53.681682] [DEBUG] [LOCAL ] KVUE: Loaded 54057 existing records from primary storage. [2025-09-18T22:53:53.681909] [INFO ] [MAIN ] KVUE: Loaded 54057 primary data records. [2025-09-18T22:53:53.876807] [DEBUG] [LOCAL ] KVYO: Loaded 50181 existing records from primary storage. [2025-09-18T22:53:53.920272] [INFO ] [MAIN ] KVYO: Loaded 50181 primary data records. [2025-09-18T22:53:54.087324] [DEBUG] [LOCAL ] KW: Loaded 40949 existing records from primary storage. [2025-09-18T22:53:54.104291] [INFO ] [MAIN ] KW: Loaded 40949 primary data records. [2025-09-18T22:53:54.714364] [DEBUG] [MAIN ] KVUE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:54.716008] [INFO ] [MAIN ] KVUE: Generated 1807 derivative records from 54057 primary records. [2025-09-18T22:53:54.716805] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-09-18T22:53:54.738617] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1807 records). [2025-09-18T22:53:54.738897] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-09-18T22:53:54.741457] [INFO ] [MAIN ] Derivative Progress: 1054/2075 symbols completed. KVUE took 1.2s. Estimated remaining: 6m 37s. Rate: 154.3 symbols/min [2025-09-18T22:53:54.741933] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:54.755212] [DEBUG] [MAIN ] KVYO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:53:54.757293] [INFO ] [MAIN ] KVYO: Generated 1806 derivative records from 50181 primary records. [2025-09-18T22:53:54.757483] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-09-18T22:53:54.786358] [DEBUG] [MAIN ] KW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:54.791717] [INFO ] [MAIN ] KW: Generated 1807 derivative records from 40949 primary records. [2025-09-18T22:53:54.792224] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-09-18T22:53:54.795125] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1806 records). [2025-09-18T22:53:54.795784] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-09-18T22:53:54.798015] [INFO ] [MAIN ] Derivative Progress: 1055/2075 symbols completed. KVYO took 1.2s. Estimated remaining: 6m 36s. Rate: 154.5 symbols/min [2025-09-18T22:53:54.806845] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:54.820016] [DEBUG] [LOCAL ] KW: Derivative data saved (1807 records). [2025-09-18T22:53:54.820270] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-09-18T22:53:54.820586] [DEBUG] [LOCAL ] KWR: Loaded 17058 existing records from primary storage. [2025-09-18T22:53:54.823227] [INFO ] [MAIN ] Derivative Progress: 1056/2075 symbols completed. KW took 1.2s. Estimated remaining: 6m 35s. Rate: 154.6 symbols/min [2025-09-18T22:53:54.823676] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:54.823603] [INFO ] [MAIN ] KWR: Loaded 17058 primary data records. [2025-09-18T22:53:55.033729] [DEBUG] [LOCAL ] KYN: Loaded 30666 existing records from primary storage. [2025-09-18T22:53:55.034119] [INFO ] [MAIN ] KYN: Loaded 30666 primary data records. [2025-09-18T22:53:55.234536] [DEBUG] [LOCAL ] L: Loaded 41224 existing records from primary storage. [2025-09-18T22:53:55.253915] [INFO ] [MAIN ] L: Loaded 41224 primary data records. [2025-09-18T22:53:55.896671] [DEBUG] [MAIN ] KWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:55.899106] [INFO ] [MAIN ] KWR: Generated 1807 derivative records from 17058 primary records. [2025-09-18T22:53:55.899401] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-09-18T22:53:55.920571] [DEBUG] [LOCAL ] KWR: Derivative data saved (1807 records). [2025-09-18T22:53:55.921840] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-09-18T22:53:55.924435] [INFO ] [MAIN ] Derivative Progress: 1057/2075 symbols completed. KWR took 1.2s. Estimated remaining: 6m 36s. Rate: 154.3 symbols/min [2025-09-18T22:53:55.925158] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:55.945616] [DEBUG] [MAIN ] KYN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:55.946837] [INFO ] [MAIN ] KYN: Generated 1807 derivative records from 30666 primary records. [2025-09-18T22:53:55.947005] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-09-18T22:53:55.960536] [DEBUG] [MAIN ] L: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:55.970401] [INFO ] [MAIN ] L: Generated 1807 derivative records from 41224 primary records. [2025-09-18T22:53:55.975237] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-09-18T22:53:55.978490] [DEBUG] [LOCAL ] KYN: Derivative data saved (1807 records). [2025-09-18T22:53:55.978866] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-09-18T22:53:55.981193] [INFO ] [MAIN ] Derivative Progress: 1058/2075 symbols completed. KYN took 1.2s. Estimated remaining: 6m 35s. Rate: 154.5 symbols/min [2025-09-18T22:53:55.988995] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:55.997684] [DEBUG] [LOCAL ] L: Derivative data saved (1807 records). [2025-09-18T22:53:56.010883] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-09-18T22:53:56.013583] [INFO ] [MAIN ] Derivative Progress: 1059/2075 symbols completed. L took 1.2s. Estimated remaining: 6m 34s. Rate: 154.6 symbols/min [2025-09-18T22:53:56.014064] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:56.039230] [DEBUG] [LOCAL ] LAC: Loaded 52671 existing records from primary storage. [2025-09-18T22:53:56.039489] [INFO ] [MAIN ] LAC: Loaded 52671 primary data records. [2025-09-18T22:53:56.127612] [DEBUG] [LOCAL ] LAD: Loaded 24252 existing records from primary storage. [2025-09-18T22:53:56.152070] [INFO ] [MAIN ] LAD: Loaded 24252 primary data records. [2025-09-18T22:53:56.489418] [DEBUG] [LOCAL ] LADR: Loaded 38963 existing records from primary storage. [2025-09-18T22:53:56.495600] [INFO ] [MAIN ] LADR: Loaded 38963 primary data records. [2025-09-18T22:53:57.042631] [DEBUG] [MAIN ] LAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:57.046017] [INFO ] [MAIN ] LAC: Generated 1807 derivative records from 52671 primary records. [2025-09-18T22:53:57.046367] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-09-18T22:53:57.078863] [DEBUG] [LOCAL ] LAC: Derivative data saved (1807 records). [2025-09-18T22:53:57.079201] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-09-18T22:53:57.076565] [DEBUG] [MAIN ] LAD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:57.082379] [INFO ] [MAIN ] LAD: Generated 1807 derivative records from 24252 primary records. [2025-09-18T22:53:57.081425] [INFO ] [MAIN ] Derivative Progress: 1060/2075 symbols completed. LAC took 1.2s. Estimated remaining: 6m 35s. Rate: 154.3 symbols/min [2025-09-18T22:53:57.082741] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-09-18T22:53:57.091671] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:57.101932] [DEBUG] [LOCAL ] LAD: Derivative data saved (1807 records). [2025-09-18T22:53:57.102097] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-09-18T22:53:57.104885] [INFO ] [MAIN ] Derivative Progress: 1061/2075 symbols completed. LAD took 1.1s. Estimated remaining: 6m 34s. Rate: 154.5 symbols/min [2025-09-18T22:53:57.107776] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:57.107949] [DEBUG] [LOCAL ] LANV: Loaded 2666 existing records from primary storage. [2025-09-18T22:53:57.108374] [INFO ] [MAIN ] LANV: Loaded 2666 primary data records. [2025-09-18T22:53:57.232828] [DEBUG] [MAIN ] LADR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:57.242242] [DEBUG] [LOCAL ] LAW: Loaded 13988 existing records from primary storage. [2025-09-18T22:53:57.259164] [INFO ] [MAIN ] LADR: Generated 1807 derivative records from 38963 primary records. [2025-09-18T22:53:57.259318] [INFO ] [MAIN ] LAW: Loaded 13988 primary data records. [2025-09-18T22:53:57.264580] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-09-18T22:53:57.531901] [DEBUG] [LOCAL ] LADR: Derivative data saved (1807 records). [2025-09-18T22:53:57.546622] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-09-18T22:53:57.567969] [INFO ] [MAIN ] Derivative Progress: 1062/2075 symbols completed. LADR took 1.6s. Estimated remaining: 6m 34s. Rate: 154.4 symbols/min [2025-09-18T22:53:57.572529] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:57.820555] [DEBUG] [MAIN ] LANV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:53:57.821626] [INFO ] [MAIN ] LANV: Generated 1806 derivative records from 2666 primary records. [2025-09-18T22:53:57.821996] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-09-18T22:53:57.852512] [DEBUG] [LOCAL ] LANV: Derivative data saved (1806 records). [2025-09-18T22:53:57.853549] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-09-18T22:53:57.853364] [DEBUG] [LOCAL ] LAZ: Loaded 45782 existing records from primary storage. [2025-09-18T22:53:57.869105] [INFO ] [MAIN ] LAZ: Loaded 45782 primary data records. [2025-09-18T22:53:57.869444] [DEBUG] [MAIN ] LAW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:57.856003] [INFO ] [MAIN ] Derivative Progress: 1063/2075 symbols completed. LANV took 0.8s. Estimated remaining: 6m 33s. Rate: 154.5 symbols/min [2025-09-18T22:53:57.901970] [INFO ] [MAIN ] LAW: Generated 1807 derivative records from 13988 primary records. [2025-09-18T22:53:57.934704] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-09-18T22:53:58.027862] [DEBUG] [LOCAL ] LAW: Derivative data saved (1807 records). [2025-09-18T22:53:58.046555] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-09-18T22:53:58.063511] [INFO ] [MAIN ] Derivative Progress: 1064/2075 symbols completed. LAW took 1.0s. Estimated remaining: 6m 33s. Rate: 154.5 symbols/min [2025-09-18T22:53:58.260251] [DEBUG] [MAIN ] LAZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:58.260942] [INFO ] [MAIN ] LAZ: Generated 1807 derivative records from 45782 primary records. [2025-09-18T22:53:58.261010] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-09-18T22:53:58.276443] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1807 records). [2025-09-18T22:53:58.276504] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-09-18T22:53:58.278669] [INFO ] [MAIN ] Derivative Progress: 1065/2075 symbols completed. LAZ took 0.7s. Estimated remaining: 6m 32s. Rate: 154.6 symbols/min [2025-09-18T22:53:58.279209] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:58.279706] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:58.279521] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:58.329549] [DEBUG] [LOCAL ] LB: Loaded 38177 existing records from primary storage. [2025-09-18T22:53:58.329773] [INFO ] [MAIN ] LB: Loaded 38177 primary data records. [2025-09-18T22:53:58.505926] [DEBUG] [LOCAL ] LBRT: Loaded 53311 existing records from primary storage. [2025-09-18T22:53:58.511760] [DEBUG] [LOCAL ] LC: Loaded 48396 existing records from primary storage. [2025-09-18T22:53:58.525825] [INFO ] [MAIN ] LBRT: Loaded 53311 primary data records. [2025-09-18T22:53:58.534597] [INFO ] [MAIN ] LC: Loaded 48396 primary data records. [2025-09-18T22:53:59.321373] [DEBUG] [MAIN ] LB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:59.322510] [INFO ] [MAIN ] LB: Generated 1807 derivative records from 38177 primary records. [2025-09-18T22:53:59.322993] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-09-18T22:53:59.372591] [DEBUG] [MAIN ] LBRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:59.371739] [DEBUG] [LOCAL ] LB: Derivative data saved (1807 records). [2025-09-18T22:53:59.373630] [INFO ] [MAIN ] LBRT: Generated 1807 derivative records from 53311 primary records. [2025-09-18T22:53:59.374140] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-09-18T22:53:59.376143] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-09-18T22:53:59.376068] [INFO ] [MAIN ] Derivative Progress: 1066/2075 symbols completed. LB took 1.1s. Estimated remaining: 6m 32s. Rate: 154.3 symbols/min [2025-09-18T22:53:59.373997] [DEBUG] [MAIN ] LC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:53:59.377742] [INFO ] [MAIN ] LC: Generated 1807 derivative records from 48396 primary records. [2025-09-18T22:53:59.377834] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:59.378278] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-09-18T22:53:59.410566] [DEBUG] [LOCAL ] LC: Derivative data saved (1807 records). [2025-09-18T22:53:59.410913] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-09-18T22:53:59.414025] [INFO ] [MAIN ] Derivative Progress: 1067/2075 symbols completed. LC took 1.1s. Estimated remaining: 6m 32s. Rate: 154.5 symbols/min [2025-09-18T22:53:59.414569] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1807 records). [2025-09-18T22:53:59.414868] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:59.414991] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-09-18T22:53:59.417603] [INFO ] [MAIN ] Derivative Progress: 1068/2075 symbols completed. LBRT took 1.1s. Estimated remaining: 6m 31s. Rate: 154.6 symbols/min [2025-09-18T22:53:59.418162] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:53:59.440422] [DEBUG] [LOCAL ] LCII: Loaded 28969 existing records from primary storage. [2025-09-18T22:53:59.440636] [INFO ] [MAIN ] LCII: Loaded 28969 primary data records. [2025-09-18T22:53:59.791724] [DEBUG] [LOCAL ] LDI: Loaded 43745 existing records from primary storage. [2025-09-18T22:53:59.792487] [INFO ] [MAIN ] LDI: Loaded 43745 primary data records. [2025-09-18T22:53:59.875968] [DEBUG] [LOCAL ] LDOS: Loaded 46352 existing records from primary storage. [2025-09-18T22:53:59.899306] [INFO ] [MAIN ] LDOS: Loaded 46352 primary data records. [2025-09-18T22:54:00.482894] [DEBUG] [MAIN ] LCII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:00.484897] [INFO ] [MAIN ] LCII: Generated 1807 derivative records from 28969 primary records. [2025-09-18T22:54:00.485332] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-09-18T22:54:00.522456] [DEBUG] [MAIN ] LDI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:00.524153] [INFO ] [MAIN ] LDI: Generated 1807 derivative records from 43745 primary records. [2025-09-18T22:54:00.524878] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-09-18T22:54:00.524752] [DEBUG] [LOCAL ] LCII: Derivative data saved (1807 records). [2025-09-18T22:54:00.525769] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-09-18T22:54:00.535462] [INFO ] [MAIN ] Derivative Progress: 1069/2075 symbols completed. LCII took 1.2s. Estimated remaining: 6m 31s. Rate: 154.3 symbols/min [2025-09-18T22:54:00.542285] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:00.557611] [DEBUG] [MAIN ] LDOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:00.558604] [INFO ] [MAIN ] LDOS: Generated 1807 derivative records from 46352 primary records. [2025-09-18T22:54:00.558726] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-09-18T22:54:00.561542] [DEBUG] [LOCAL ] LDI: Derivative data saved (1807 records). [2025-09-18T22:54:00.568902] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-09-18T22:54:00.578376] [INFO ] [MAIN ] Derivative Progress: 1070/2075 symbols completed. LDI took 1.2s. Estimated remaining: 6m 30s. Rate: 154.5 symbols/min [2025-09-18T22:54:00.579095] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:00.588835] [DEBUG] [LOCAL ] LDP: Loaded 13295 existing records from primary storage. [2025-09-18T22:54:00.590997] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1807 records). [2025-09-18T22:54:00.591173] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-09-18T22:54:00.590522] [INFO ] [MAIN ] LDP: Loaded 13295 primary data records. [2025-09-18T22:54:00.593899] [INFO ] [MAIN ] Derivative Progress: 1071/2075 symbols completed. LDOS took 1.2s. Estimated remaining: 6m 30s. Rate: 154.6 symbols/min [2025-09-18T22:54:00.615447] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:00.935826] [DEBUG] [LOCAL ] LEA: Loaded 42219 existing records from primary storage. [2025-09-18T22:54:00.936221] [INFO ] [MAIN ] LEA: Loaded 42219 primary data records. [2025-09-18T22:54:01.066225] [DEBUG] [LOCAL ] LEG: Loaded 50752 existing records from primary storage. [2025-09-18T22:54:01.077090] [INFO ] [MAIN ] LEG: Loaded 50752 primary data records. [2025-09-18T22:54:01.634164] [DEBUG] [MAIN ] LDP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:01.636432] [INFO ] [MAIN ] LDP: Generated 1807 derivative records from 13295 primary records. [2025-09-18T22:54:01.637240] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-09-18T22:54:01.682288] [DEBUG] [LOCAL ] LDP: Derivative data saved (1807 records). [2025-09-18T22:54:01.683075] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-09-18T22:54:01.685801] [INFO ] [MAIN ] Derivative Progress: 1072/2075 symbols completed. LDP took 1.1s. Estimated remaining: 6m 30s. Rate: 154.4 symbols/min [2025-09-18T22:54:01.682892] [DEBUG] [MAIN ] LEA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:01.687259] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:01.687197] [INFO ] [MAIN ] LEA: Generated 1807 derivative records from 42219 primary records. [2025-09-18T22:54:01.687957] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-09-18T22:54:01.723671] [DEBUG] [MAIN ] LEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:01.724992] [DEBUG] [LOCAL ] LEA: Derivative data saved (1807 records). [2025-09-18T22:54:01.725133] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-09-18T22:54:01.729220] [INFO ] [MAIN ] LEG: Generated 1807 derivative records from 50752 primary records. [2025-09-18T22:54:01.729392] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-09-18T22:54:01.728066] [INFO ] [MAIN ] Derivative Progress: 1073/2075 symbols completed. LEA took 1.1s. Estimated remaining: 6m 29s. Rate: 154.5 symbols/min [2025-09-18T22:54:01.730080] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:01.747303] [DEBUG] [LOCAL ] LEG: Derivative data saved (1807 records). [2025-09-18T22:54:01.747559] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-09-18T22:54:01.750312] [INFO ] [MAIN ] Derivative Progress: 1074/2075 symbols completed. LEG took 1.1s. Estimated remaining: 6m 28s. Rate: 154.6 symbols/min [2025-09-18T22:54:01.750703] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:01.784125] [DEBUG] [LOCAL ] LEO: Loaded 17840 existing records from primary storage. [2025-09-18T22:54:01.784422] [INFO ] [MAIN ] LEO: Loaded 17840 primary data records. [2025-09-18T22:54:01.896445] [DEBUG] [LOCAL ] LEN: Loaded 53574 existing records from primary storage. [2025-09-18T22:54:01.929675] [INFO ] [MAIN ] LEN: Loaded 53574 primary data records. [2025-09-18T22:54:02.295976] [DEBUG] [LOCAL ] LEVI: Loaded 51868 existing records from primary storage. [2025-09-18T22:54:02.301495] [INFO ] [MAIN ] LEVI: Loaded 51868 primary data records. [2025-09-18T22:54:02.862821] [DEBUG] [MAIN ] LEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:02.863901] [INFO ] [MAIN ] LEO: Generated 1807 derivative records from 17840 primary records. [2025-09-18T22:54:02.864769] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-09-18T22:54:02.894558] [DEBUG] [LOCAL ] LEO: Derivative data saved (1807 records). [2025-09-18T22:54:02.900129] [DEBUG] [MAIN ] LEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:02.901039] [INFO ] [MAIN ] LEN: Generated 1807 derivative records from 53574 primary records. [2025-09-18T22:54:02.901334] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-09-18T22:54:02.901139] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-09-18T22:54:02.904283] [INFO ] [MAIN ] Derivative Progress: 1075/2075 symbols completed. LEO took 1.2s. Estimated remaining: 6m 29s. Rate: 154.3 symbols/min [2025-09-18T22:54:02.912321] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:02.935163] [DEBUG] [MAIN ] LEVI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:02.936721] [INFO ] [MAIN ] LEVI: Generated 1807 derivative records from 51868 primary records. [2025-09-18T22:54:02.937022] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-09-18T22:54:02.954951] [DEBUG] [LOCAL ] LEN: Derivative data saved (1807 records). [2025-09-18T22:54:02.956098] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-09-18T22:54:02.958676] [INFO ] [MAIN ] Derivative Progress: 1076/2075 symbols completed. LEN took 1.3s. Estimated remaining: 6m 28s. Rate: 154.5 symbols/min [2025-09-18T22:54:02.968735] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1807 records). [2025-09-18T22:54:02.969200] [DEBUG] [LOCAL ] LFT: Loaded 17989 existing records from primary storage. [2025-09-18T22:54:02.968873] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-09-18T22:54:02.968287] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:02.969372] [INFO ] [MAIN ] LFT: Loaded 17989 primary data records. [2025-09-18T22:54:02.972159] [INFO ] [MAIN ] Derivative Progress: 1077/2075 symbols completed. LEVI took 1.2s. Estimated remaining: 6m 27s. Rate: 154.6 symbols/min [2025-09-18T22:54:02.993687] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:03.088773] [DEBUG] [LOCAL ] LGI: Loaded 10235 existing records from primary storage. [2025-09-18T22:54:03.122858] [INFO ] [MAIN ] LGI: Loaded 10235 primary data records. [2025-09-18T22:54:03.494380] [DEBUG] [LOCAL ] LH: Loaded 39098 existing records from primary storage. [2025-09-18T22:54:03.618055] [INFO ] [MAIN ] LH: Loaded 39098 primary data records. [2025-09-18T22:54:03.948623] [DEBUG] [MAIN ] LFT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:03.949685] [INFO ] [MAIN ] LFT: Generated 1807 derivative records from 17989 primary records. [2025-09-18T22:54:03.949991] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-09-18T22:54:03.986153] [DEBUG] [LOCAL ] LFT: Derivative data saved (1807 records). [2025-09-18T22:54:03.986060] [DEBUG] [MAIN ] LGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:03.987133] [INFO ] [MAIN ] LGI: Generated 1807 derivative records from 10235 primary records. [2025-09-18T22:54:03.986427] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-09-18T22:54:03.987313] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-09-18T22:54:03.989174] [INFO ] [MAIN ] Derivative Progress: 1078/2075 symbols completed. LFT took 1.1s. Estimated remaining: 6m 28s. Rate: 154.4 symbols/min [2025-09-18T22:54:04.009121] [DEBUG] [LOCAL ] LGI: Derivative data saved (1807 records). [2025-09-18T22:54:04.010083] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-09-18T22:54:04.012976] [INFO ] [MAIN ] Derivative Progress: 1079/2075 symbols completed. LGI took 1.0s. Estimated remaining: 6m 27s. Rate: 154.5 symbols/min [2025-09-18T22:54:04.025660] [DEBUG] [MAIN ] LH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:04.026269] [INFO ] [MAIN ] LH: Generated 1807 derivative records from 39098 primary records. [2025-09-18T22:54:04.026332] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-09-18T22:54:04.042029] [DEBUG] [LOCAL ] LH: Derivative data saved (1807 records). [2025-09-18T22:54:04.042096] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-09-18T22:54:04.044629] [INFO ] [MAIN ] Derivative Progress: 1080/2075 symbols completed. LH took 1.1s. Estimated remaining: 6m 26s. Rate: 154.6 symbols/min [2025-09-18T22:54:04.045181] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:04.045705] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:04.045820] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:04.084508] [DEBUG] [LOCAL ] LII: Loaded 28933 existing records from primary storage. [2025-09-18T22:54:04.084744] [INFO ] [MAIN ] LII: Loaded 28933 primary data records. [2025-09-18T22:54:04.259099] [DEBUG] [LOCAL ] LION: Loaded 42669 existing records from primary storage. [2025-09-18T22:54:04.304430] [INFO ] [MAIN ] LION: Loaded 42669 primary data records. [2025-09-18T22:54:04.328397] [DEBUG] [LOCAL ] LHX: Loaded 49373 existing records from primary storage. [2025-09-18T22:54:04.328572] [INFO ] [MAIN ] LHX: Loaded 49373 primary data records. [2025-09-18T22:54:05.155108] [DEBUG] [MAIN ] LII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:05.156022] [INFO ] [MAIN ] LII: Generated 1807 derivative records from 28933 primary records. [2025-09-18T22:54:05.157344] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-09-18T22:54:05.179621] [DEBUG] [LOCAL ] LII: Derivative data saved (1807 records). [2025-09-18T22:54:05.179890] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-09-18T22:54:05.181990] [INFO ] [MAIN ] Derivative Progress: 1081/2075 symbols completed. LII took 1.1s. Estimated remaining: 6m 26s. Rate: 154.4 symbols/min [2025-09-18T22:54:05.194948] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:05.195281] [DEBUG] [MAIN ] LION: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:05.198996] [INFO ] [MAIN ] LION: Generated 1807 derivative records from 42669 primary records. [2025-09-18T22:54:05.199308] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-09-18T22:54:05.228946] [DEBUG] [LOCAL ] LION: Derivative data saved (1807 records). [2025-09-18T22:54:05.229293] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-09-18T22:54:05.232156] [INFO ] [MAIN ] Derivative Progress: 1082/2075 symbols completed. LION took 1.2s. Estimated remaining: 6m 26s. Rate: 154.5 symbols/min [2025-09-18T22:54:05.229611] [DEBUG] [MAIN ] LHX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:05.235790] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:05.235691] [DEBUG] [LOCAL ] LITB: Loaded 4298 existing records from primary storage. [2025-09-18T22:54:05.237087] [INFO ] [MAIN ] LHX: Generated 1807 derivative records from 49373 primary records. [2025-09-18T22:54:05.237317] [INFO ] [MAIN ] LITB: Loaded 4298 primary data records. [2025-09-18T22:54:05.237506] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-09-18T22:54:05.436109] [DEBUG] [LOCAL ] LHX: Derivative data saved (1807 records). [2025-09-18T22:54:05.442153] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-09-18T22:54:05.445067] [INFO ] [MAIN ] Derivative Progress: 1083/2075 symbols completed. LHX took 1.4s. Estimated remaining: 6m 25s. Rate: 154.5 symbols/min [2025-09-18T22:54:05.555577] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:05.602831] [DEBUG] [LOCAL ] LLY: Loaded 53688 existing records from primary storage. [2025-09-18T22:54:05.603627] [INFO ] [MAIN ] LLY: Loaded 53688 primary data records. [2025-09-18T22:54:05.839410] [DEBUG] [MAIN ] LITB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:05.956283] [INFO ] [MAIN ] LITB: Generated 1807 derivative records from 4298 primary records. [2025-09-18T22:54:05.965489] [DEBUG] [LOCAL ] LMND: Loaded 52260 existing records from primary storage. [2025-09-18T22:54:05.966486] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-09-18T22:54:05.966616] [INFO ] [MAIN ] LMND: Loaded 52260 primary data records. [2025-09-18T22:54:06.054767] [DEBUG] [LOCAL ] LITB: Derivative data saved (1807 records). [2025-09-18T22:54:06.061712] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-09-18T22:54:06.069484] [INFO ] [MAIN ] Derivative Progress: 1084/2075 symbols completed. LITB took 0.9s. Estimated remaining: 6m 25s. Rate: 154.5 symbols/min [2025-09-18T22:54:06.081172] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:06.357505] [DEBUG] [MAIN ] LLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:06.358542] [INFO ] [MAIN ] LLY: Generated 1807 derivative records from 53688 primary records. [2025-09-18T22:54:06.359213] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-09-18T22:54:06.405152] [DEBUG] [LOCAL ] LLY: Derivative data saved (1807 records). [2025-09-18T22:54:06.405517] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-09-18T22:54:06.408299] [INFO ] [MAIN ] Derivative Progress: 1085/2075 symbols completed. LLY took 1.2s. Estimated remaining: 6m 25s. Rate: 154.5 symbols/min [2025-09-18T22:54:06.410038] [DEBUG] [LOCAL ] LMT: Loaded 50362 existing records from primary storage. [2025-09-18T22:54:06.410405] [INFO ] [MAIN ] LMT: Loaded 50362 primary data records. [2025-09-18T22:54:06.410483] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:06.513950] [DEBUG] [MAIN ] LMND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:06.536186] [INFO ] [MAIN ] LMND: Generated 1807 derivative records from 52260 primary records. [2025-09-18T22:54:06.540094] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-09-18T22:54:06.643776] [DEBUG] [LOCAL ] LMND: Derivative data saved (1807 records). [2025-09-18T22:54:06.769566] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-09-18T22:54:06.785621] [INFO ] [MAIN ] Derivative Progress: 1086/2075 symbols completed. LMND took 1.2s. Estimated remaining: 6m 24s. Rate: 154.5 symbols/min [2025-09-18T22:54:06.786242] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:06.797203] [DEBUG] [LOCAL ] LND: Loaded 5231 existing records from primary storage. [2025-09-18T22:54:06.797930] [INFO ] [MAIN ] LND: Loaded 5231 primary data records. [2025-09-18T22:54:06.868697] [DEBUG] [LOCAL ] LNC: Loaded 52021 existing records from primary storage. [2025-09-18T22:54:06.884049] [INFO ] [MAIN ] LNC: Loaded 52021 primary data records. [2025-09-18T22:54:07.446727] [DEBUG] [MAIN ] LMT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:54:07.448739] [INFO ] [MAIN ] LMT: Generated 1806 derivative records from 50362 primary records. [2025-09-18T22:54:07.448907] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-09-18T22:54:07.470285] [DEBUG] [LOCAL ] LMT: Derivative data saved (1806 records). [2025-09-18T22:54:07.470792] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-09-18T22:54:07.473226] [INFO ] [MAIN ] Derivative Progress: 1087/2075 symbols completed. LMT took 1.4s. Estimated remaining: 6m 24s. Rate: 154.4 symbols/min [2025-09-18T22:54:07.474054] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:07.491586] [DEBUG] [MAIN ] LND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:07.492291] [INFO ] [MAIN ] LND: Generated 1807 derivative records from 5231 primary records. [2025-09-18T22:54:07.492635] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-09-18T22:54:07.510417] [DEBUG] [LOCAL ] LND: Derivative data saved (1807 records). [2025-09-18T22:54:07.510812] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-09-18T22:54:07.512815] [INFO ] [MAIN ] Derivative Progress: 1088/2075 symbols completed. LND took 0.7s. Estimated remaining: 6m 23s. Rate: 154.5 symbols/min [2025-09-18T22:54:07.513146] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:07.535187] [DEBUG] [MAIN ] LNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:07.536015] [INFO ] [MAIN ] LNC: Generated 1807 derivative records from 52021 primary records. [2025-09-18T22:54:07.536114] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-09-18T22:54:07.557147] [DEBUG] [LOCAL ] LNN: Loaded 11338 existing records from primary storage. [2025-09-18T22:54:07.557479] [INFO ] [MAIN ] LNN: Loaded 11338 primary data records. [2025-09-18T22:54:07.671881] [DEBUG] [LOCAL ] LNC: Derivative data saved (1807 records). [2025-09-18T22:54:07.683445] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-09-18T22:54:07.685957] [INFO ] [MAIN ] Derivative Progress: 1089/2075 symbols completed. LNC took 1.3s. Estimated remaining: 6m 23s. Rate: 154.6 symbols/min [2025-09-18T22:54:07.686288] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:07.742276] [DEBUG] [LOCAL ] LNG: Loaded 51931 existing records from primary storage. [2025-09-18T22:54:07.760428] [INFO ] [MAIN ] LNG: Loaded 51931 primary data records. [2025-09-18T22:54:08.298034] [DEBUG] [LOCAL ] LOAR: Loaded 41811 existing records from primary storage. [2025-09-18T22:54:08.299209] [INFO ] [MAIN ] LOAR: Loaded 41811 primary data records. [2025-09-18T22:54:08.635387] [DEBUG] [MAIN ] LNN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:08.636514] [INFO ] [MAIN ] LNN: Generated 1807 derivative records from 11338 primary records. [2025-09-18T22:54:08.636743] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-09-18T22:54:08.671410] [DEBUG] [MAIN ] LNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:08.673211] [INFO ] [MAIN ] LNG: Generated 1807 derivative records from 51931 primary records. [2025-09-18T22:54:08.673561] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-09-18T22:54:08.688995] [DEBUG] [LOCAL ] LNN: Derivative data saved (1807 records). [2025-09-18T22:54:08.689492] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-09-18T22:54:08.691879] [INFO ] [MAIN ] Derivative Progress: 1090/2075 symbols completed. LNN took 1.2s. Estimated remaining: 6m 23s. Rate: 154.4 symbols/min [2025-09-18T22:54:08.692810] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:08.699930] [DEBUG] [LOCAL ] LNG: Derivative data saved (1807 records). [2025-09-18T22:54:08.700178] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-09-18T22:54:08.702574] [INFO ] [MAIN ] Derivative Progress: 1091/2075 symbols completed. LNG took 1.2s. Estimated remaining: 6m 22s. Rate: 154.5 symbols/min [2025-09-18T22:54:08.705874] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:08.720846] [DEBUG] [MAIN ] LOAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:08.721758] [INFO ] [MAIN ] LOAR: Generated 1807 derivative records from 41811 primary records. [2025-09-18T22:54:08.724245] [DEBUG] [LOCAL ] LOCL: Loaded 3492 existing records from primary storage. [2025-09-18T22:54:08.725198] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-09-18T22:54:08.725271] [INFO ] [MAIN ] LOCL: Loaded 3492 primary data records. [2025-09-18T22:54:08.869822] [DEBUG] [LOCAL ] LOB: Loaded 27714 existing records from primary storage. [2025-09-18T22:54:08.869311] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1807 records). [2025-09-18T22:54:08.870007] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-09-18T22:54:08.870145] [INFO ] [MAIN ] LOB: Loaded 27714 primary data records. [2025-09-18T22:54:08.878238] [INFO ] [MAIN ] Derivative Progress: 1092/2075 symbols completed. LOAR took 1.2s. Estimated remaining: 6m 22s. Rate: 154.6 symbols/min [2025-09-18T22:54:08.910441] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:09.426341] [DEBUG] [LOCAL ] LOMA: Loaded 31637 existing records from primary storage. [2025-09-18T22:54:09.427855] [INFO ] [MAIN ] LOMA: Loaded 31637 primary data records. [2025-09-18T22:54:09.765013] [DEBUG] [MAIN ] LOCL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:09.765943] [INFO ] [MAIN ] LOCL: Generated 1807 derivative records from 3492 primary records. [2025-09-18T22:54:09.766145] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-09-18T22:54:09.782940] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1807 records). [2025-09-18T22:54:09.784222] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-09-18T22:54:09.799761] [INFO ] [MAIN ] Derivative Progress: 1093/2075 symbols completed. LOCL took 1.1s. Estimated remaining: 6m 22s. Rate: 154.4 symbols/min [2025-09-18T22:54:09.800554] [DEBUG] [MAIN ] LOB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:09.801774] [INFO ] [MAIN ] LOB: Generated 1807 derivative records from 27714 primary records. [2025-09-18T22:54:09.802000] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-09-18T22:54:09.819890] [DEBUG] [LOCAL ] LOB: Derivative data saved (1807 records). [2025-09-18T22:54:09.820049] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-09-18T22:54:09.822357] [INFO ] [MAIN ] Derivative Progress: 1094/2075 symbols completed. LOB took 1.1s. Estimated remaining: 6m 21s. Rate: 154.5 symbols/min [2025-09-18T22:54:09.840621] [DEBUG] [MAIN ] LOMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:09.841222] [INFO ] [MAIN ] LOMA: Generated 1807 derivative records from 31637 primary records. [2025-09-18T22:54:09.841286] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-09-18T22:54:09.857458] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1807 records). [2025-09-18T22:54:09.857522] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-09-18T22:54:09.860200] [INFO ] [MAIN ] Derivative Progress: 1095/2075 symbols completed. LOMA took 0.9s. Estimated remaining: 6m 20s. Rate: 154.6 symbols/min [2025-09-18T22:54:09.861062] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:09.861331] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:09.861230] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:09.890584] [DEBUG] [LOCAL ] LPL: Loaded 25276 existing records from primary storage. [2025-09-18T22:54:09.890911] [INFO ] [MAIN ] LPL: Loaded 25276 primary data records. [2025-09-18T22:54:10.076411] [DEBUG] [LOCAL ] LPG: Loaded 40699 existing records from primary storage. [2025-09-18T22:54:10.127002] [INFO ] [MAIN ] LPG: Loaded 40699 primary data records. [2025-09-18T22:54:10.320047] [DEBUG] [LOCAL ] LOW: Loaded 53348 existing records from primary storage. [2025-09-18T22:54:10.333768] [INFO ] [MAIN ] LOW: Loaded 53348 primary data records. [2025-09-18T22:54:10.921031] [DEBUG] [MAIN ] LPL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:10.922138] [INFO ] [MAIN ] LPL: Generated 1807 derivative records from 25276 primary records. [2025-09-18T22:54:10.922467] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-09-18T22:54:10.947187] [DEBUG] [LOCAL ] LPL: Derivative data saved (1807 records). [2025-09-18T22:54:10.954865] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-09-18T22:54:10.962010] [INFO ] [MAIN ] Derivative Progress: 1096/2075 symbols completed. LPL took 1.1s. Estimated remaining: 6m 21s. Rate: 154.4 symbols/min [2025-09-18T22:54:10.969899] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:10.962394] [DEBUG] [MAIN ] LPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:10.975860] [INFO ] [MAIN ] LPG: Generated 1807 derivative records from 40699 primary records. [2025-09-18T22:54:10.976315] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-09-18T22:54:10.976151] [DEBUG] [MAIN ] LOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:10.976957] [INFO ] [MAIN ] LOW: Generated 1807 derivative records from 53348 primary records. [2025-09-18T22:54:10.977365] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-09-18T22:54:11.004853] [DEBUG] [LOCAL ] LOW: Derivative data saved (1807 records). [2025-09-18T22:54:11.005591] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-09-18T22:54:11.008316] [INFO ] [MAIN ] Derivative Progress: 1097/2075 symbols completed. LOW took 1.1s. Estimated remaining: 6m 20s. Rate: 154.5 symbols/min [2025-09-18T22:54:11.009249] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:11.013213] [DEBUG] [LOCAL ] LPG: Derivative data saved (1807 records). [2025-09-18T22:54:11.013332] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-09-18T22:54:11.015571] [INFO ] [MAIN ] Derivative Progress: 1098/2075 symbols completed. LPG took 1.2s. Estimated remaining: 6m 19s. Rate: 154.6 symbols/min [2025-09-18T22:54:11.015947] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:11.045054] [DEBUG] [LOCAL ] LPX: Loaded 40075 existing records from primary storage. [2025-09-18T22:54:11.045295] [INFO ] [MAIN ] LPX: Loaded 40075 primary data records. [2025-09-18T22:54:11.207626] [DEBUG] [LOCAL ] LRN: Loaded 40443 existing records from primary storage. [2025-09-18T22:54:11.213405] [INFO ] [MAIN ] LRN: Loaded 40443 primary data records. [2025-09-18T22:54:11.467621] [DEBUG] [LOCAL ] LSPD: Loaded 43972 existing records from primary storage. [2025-09-18T22:54:11.496121] [INFO ] [MAIN ] LSPD: Loaded 43972 primary data records. [2025-09-18T22:54:12.090236] [DEBUG] [MAIN ] LPX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:12.091951] [INFO ] [MAIN ] LPX: Generated 1807 derivative records from 40075 primary records. [2025-09-18T22:54:12.092255] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-09-18T22:54:12.115458] [DEBUG] [LOCAL ] LPX: Derivative data saved (1807 records). [2025-09-18T22:54:12.115679] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-09-18T22:54:12.118002] [INFO ] [MAIN ] Derivative Progress: 1099/2075 symbols completed. LPX took 1.2s. Estimated remaining: 6m 19s. Rate: 154.4 symbols/min [2025-09-18T22:54:12.118488] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:12.132624] [DEBUG] [MAIN ] LRN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:12.133741] [INFO ] [MAIN ] LRN: Generated 1807 derivative records from 40443 primary records. [2025-09-18T22:54:12.133862] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-09-18T22:54:12.161924] [DEBUG] [LOCAL ] LRN: Derivative data saved (1807 records). [2025-09-18T22:54:12.170514] [DEBUG] [MAIN ] LSPD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:12.170628] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-09-18T22:54:12.172787] [INFO ] [MAIN ] Derivative Progress: 1100/2075 symbols completed. LRN took 1.2s. Estimated remaining: 6m 19s. Rate: 154.5 symbols/min [2025-09-18T22:54:12.173822] [INFO ] [MAIN ] LSPD: Generated 1807 derivative records from 43972 primary records. [2025-09-18T22:54:12.174182] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-09-18T22:54:12.174263] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:12.200076] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1807 records). [2025-09-18T22:54:12.200244] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-09-18T22:54:12.203091] [INFO ] [MAIN ] Derivative Progress: 1101/2075 symbols completed. LSPD took 1.2s. Estimated remaining: 6m 18s. Rate: 154.6 symbols/min [2025-09-18T22:54:12.211737] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:12.213967] [DEBUG] [LOCAL ] LTC: Loaded 30192 existing records from primary storage. [2025-09-18T22:54:12.214079] [INFO ] [MAIN ] LTC: Loaded 30192 primary data records. [2025-09-18T22:54:12.615152] [DEBUG] [LOCAL ] LTH: Loaded 52311 existing records from primary storage. [2025-09-18T22:54:12.615436] [INFO ] [MAIN ] LTH: Loaded 52311 primary data records. [2025-09-18T22:54:12.616043] [DEBUG] [LOCAL ] LTM: Loaded 35889 existing records from primary storage. [2025-09-18T22:54:12.622001] [INFO ] [MAIN ] LTM: Loaded 35889 primary data records. [2025-09-18T22:54:13.259382] [DEBUG] [MAIN ] LTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:13.261104] [INFO ] [MAIN ] LTC: Generated 1807 derivative records from 30192 primary records. [2025-09-18T22:54:13.261260] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-09-18T22:54:13.285047] [DEBUG] [LOCAL ] LTC: Derivative data saved (1807 records). [2025-09-18T22:54:13.285284] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-09-18T22:54:13.290634] [INFO ] [MAIN ] Derivative Progress: 1102/2075 symbols completed. LTC took 1.2s. Estimated remaining: 6m 18s. Rate: 154.4 symbols/min [2025-09-18T22:54:13.293254] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:13.310765] [DEBUG] [MAIN ] LTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:13.323370] [INFO ] [MAIN ] LTM: Generated 1807 derivative records from 35889 primary records. [2025-09-18T22:54:13.323708] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-09-18T22:54:13.324900] [DEBUG] [MAIN ] LTH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:13.325848] [INFO ] [MAIN ] LTH: Generated 1807 derivative records from 52311 primary records. [2025-09-18T22:54:13.326019] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-09-18T22:54:13.355753] [DEBUG] [LOCAL ] LTH: Derivative data saved (1807 records). [2025-09-18T22:54:13.356060] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-09-18T22:54:13.358379] [INFO ] [MAIN ] Derivative Progress: 1103/2075 symbols completed. LTH took 1.2s. Estimated remaining: 6m 17s. Rate: 154.5 symbols/min [2025-09-18T22:54:13.359396] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:13.361539] [DEBUG] [LOCAL ] LTM: Derivative data saved (1807 records). [2025-09-18T22:54:13.362856] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-09-18T22:54:13.365515] [INFO ] [MAIN ] Derivative Progress: 1104/2075 symbols completed. LTM took 1.2s. Estimated remaining: 6m 17s. Rate: 154.6 symbols/min [2025-09-18T22:54:13.366005] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:13.412488] [DEBUG] [LOCAL ] LU: Loaded 49316 existing records from primary storage. [2025-09-18T22:54:13.412777] [INFO ] [MAIN ] LU: Loaded 49316 primary data records. [2025-09-18T22:54:13.645761] [DEBUG] [LOCAL ] LUMN: Loaded 54024 existing records from primary storage. [2025-09-18T22:54:13.659889] [INFO ] [MAIN ] LUMN: Loaded 54024 primary data records. [2025-09-18T22:54:13.683403] [DEBUG] [LOCAL ] LUV: Loaded 54079 existing records from primary storage. [2025-09-18T22:54:13.794204] [INFO ] [MAIN ] LUV: Loaded 54079 primary data records. [2025-09-18T22:54:14.485722] [DEBUG] [MAIN ] LU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:14.486845] [INFO ] [MAIN ] LU: Generated 1807 derivative records from 49316 primary records. [2025-09-18T22:54:14.487039] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-09-18T22:54:14.508512] [DEBUG] [LOCAL ] LU: Derivative data saved (1807 records). [2025-09-18T22:54:14.510556] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-09-18T22:54:14.513418] [INFO ] [MAIN ] Derivative Progress: 1105/2075 symbols completed. LU took 1.2s. Estimated remaining: 6m 17s. Rate: 154.4 symbols/min [2025-09-18T22:54:14.514022] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:14.527699] [DEBUG] [MAIN ] LUMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:14.528706] [INFO ] [MAIN ] LUMN: Generated 1807 derivative records from 54024 primary records. [2025-09-18T22:54:14.528963] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-09-18T22:54:14.547232] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1807 records). [2025-09-18T22:54:14.547540] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-09-18T22:54:14.550087] [INFO ] [MAIN ] Derivative Progress: 1106/2075 symbols completed. LUMN took 1.2s. Estimated remaining: 6m 16s. Rate: 154.5 symbols/min [2025-09-18T22:54:14.550483] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:14.564326] [DEBUG] [MAIN ] LUV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:14.565171] [INFO ] [MAIN ] LUV: Generated 1807 derivative records from 54079 primary records. [2025-09-18T22:54:14.565233] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-09-18T22:54:14.591039] [DEBUG] [LOCAL ] LUV: Derivative data saved (1807 records). [2025-09-18T22:54:14.597195] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-09-18T22:54:14.597141] [DEBUG] [LOCAL ] LVWR: Loaded 17218 existing records from primary storage. [2025-09-18T22:54:14.600025] [INFO ] [MAIN ] Derivative Progress: 1107/2075 symbols completed. LUV took 1.2s. Estimated remaining: 6m 16s. Rate: 154.6 symbols/min [2025-09-18T22:54:14.600442] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:14.600347] [INFO ] [MAIN ] LVWR: Loaded 17218 primary data records. [2025-09-18T22:54:14.762315] [DEBUG] [LOCAL ] LVS: Loaded 53957 existing records from primary storage. [2025-09-18T22:54:14.815957] [INFO ] [MAIN ] LVS: Loaded 53957 primary data records. [2025-09-18T22:54:15.267422] [DEBUG] [LOCAL ] LW: Loaded 51681 existing records from primary storage. [2025-09-18T22:54:15.267953] [INFO ] [MAIN ] LW: Loaded 51681 primary data records. [2025-09-18T22:54:15.590440] [DEBUG] [MAIN ] LVWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:15.591468] [INFO ] [MAIN ] LVWR: Generated 1807 derivative records from 17218 primary records. [2025-09-18T22:54:15.591612] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-09-18T22:54:15.616834] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1807 records). [2025-09-18T22:54:15.617913] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-09-18T22:54:15.620708] [INFO ] [MAIN ] Derivative Progress: 1108/2075 symbols completed. LVWR took 1.1s. Estimated remaining: 6m 16s. Rate: 154.4 symbols/min [2025-09-18T22:54:15.634870] [DEBUG] [MAIN ] LVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:15.635863] [INFO ] [MAIN ] LVS: Generated 1807 derivative records from 53957 primary records. [2025-09-18T22:54:15.636068] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-09-18T22:54:15.654040] [DEBUG] [LOCAL ] LVS: Derivative data saved (1807 records). [2025-09-18T22:54:15.654336] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-09-18T22:54:15.656916] [INFO ] [MAIN ] Derivative Progress: 1109/2075 symbols completed. LVS took 1.1s. Estimated remaining: 6m 15s. Rate: 154.5 symbols/min [2025-09-18T22:54:15.671870] [DEBUG] [MAIN ] LW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:15.672407] [INFO ] [MAIN ] LW: Generated 1807 derivative records from 51681 primary records. [2025-09-18T22:54:15.672467] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-09-18T22:54:15.687725] [DEBUG] [LOCAL ] LW: Derivative data saved (1807 records). [2025-09-18T22:54:15.687803] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-09-18T22:54:15.690150] [INFO ] [MAIN ] Derivative Progress: 1110/2075 symbols completed. LW took 1.1s. Estimated remaining: 6m 14s. Rate: 154.6 symbols/min [2025-09-18T22:54:15.691098] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:15.690964] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:15.691391] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:15.712333] [DEBUG] [LOCAL ] LXFR: Loaded 17313 existing records from primary storage. [2025-09-18T22:54:15.712634] [INFO ] [MAIN ] LXFR: Loaded 17313 primary data records. [2025-09-18T22:54:15.888805] [DEBUG] [LOCAL ] LXU: Loaded 32513 existing records from primary storage. [2025-09-18T22:54:15.940091] [INFO ] [MAIN ] LXU: Loaded 32513 primary data records. [2025-09-18T22:54:16.124463] [DEBUG] [LOCAL ] LXP: Loaded 51004 existing records from primary storage. [2025-09-18T22:54:16.138739] [INFO ] [MAIN ] LXP: Loaded 51004 primary data records. [2025-09-18T22:54:16.794594] [DEBUG] [MAIN ] LXFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:16.797043] [INFO ] [MAIN ] LXFR: Generated 1807 derivative records from 17313 primary records. [2025-09-18T22:54:16.797320] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-09-18T22:54:16.836299] [DEBUG] [MAIN ] LXU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:16.821820] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1807 records). [2025-09-18T22:54:16.837191] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-09-18T22:54:16.840675] [INFO ] [MAIN ] LXU: Generated 1807 derivative records from 32513 primary records. [2025-09-18T22:54:16.841023] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-09-18T22:54:16.839584] [INFO ] [MAIN ] Derivative Progress: 1111/2075 symbols completed. LXFR took 1.1s. Estimated remaining: 6m 15s. Rate: 154.4 symbols/min [2025-09-18T22:54:16.867121] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:16.871040] [DEBUG] [MAIN ] LXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:16.873090] [INFO ] [MAIN ] LXP: Generated 1807 derivative records from 51004 primary records. [2025-09-18T22:54:16.872200] [DEBUG] [LOCAL ] LXU: Derivative data saved (1807 records). [2025-09-18T22:54:16.873589] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-09-18T22:54:16.874239] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-09-18T22:54:16.876701] [INFO ] [MAIN ] Derivative Progress: 1112/2075 symbols completed. LXU took 1.2s. Estimated remaining: 6m 14s. Rate: 154.5 symbols/min [2025-09-18T22:54:16.877371] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:16.899260] [DEBUG] [LOCAL ] LXP: Derivative data saved (1807 records). [2025-09-18T22:54:16.899407] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-09-18T22:54:16.902310] [INFO ] [MAIN ] Derivative Progress: 1113/2075 symbols completed. LXP took 1.2s. Estimated remaining: 6m 13s. Rate: 154.6 symbols/min [2025-09-18T22:54:16.902681] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:16.968956] [DEBUG] [LOCAL ] LYB: Loaded 53989 existing records from primary storage. [2025-09-18T22:54:16.969196] [INFO ] [MAIN ] LYB: Loaded 53989 primary data records. [2025-09-18T22:54:17.137436] [DEBUG] [LOCAL ] LYG: Loaded 53313 existing records from primary storage. [2025-09-18T22:54:17.148183] [INFO ] [MAIN ] LYG: Loaded 53313 primary data records. [2025-09-18T22:54:17.265579] [DEBUG] [LOCAL ] LYV: Loaded 51684 existing records from primary storage. [2025-09-18T22:54:17.271078] [INFO ] [MAIN ] LYV: Loaded 51684 primary data records. [2025-09-18T22:54:17.994287] [DEBUG] [MAIN ] LYB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:17.996339] [INFO ] [MAIN ] LYB: Generated 1807 derivative records from 53989 primary records. [2025-09-18T22:54:17.996767] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-09-18T22:54:18.019639] [DEBUG] [LOCAL ] LYB: Derivative data saved (1807 records). [2025-09-18T22:54:18.022454] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-09-18T22:54:18.026102] [INFO ] [MAIN ] Derivative Progress: 1114/2075 symbols completed. LYB took 1.2s. Estimated remaining: 6m 14s. Rate: 154.3 symbols/min [2025-09-18T22:54:18.052620] [DEBUG] [MAIN ] LYV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:18.026885] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:18.053789] [INFO ] [MAIN ] LYV: Generated 1807 derivative records from 51684 primary records. [2025-09-18T22:54:18.054105] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-09-18T22:54:18.055134] [DEBUG] [MAIN ] LYG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:18.056419] [INFO ] [MAIN ] LYG: Generated 1807 derivative records from 53313 primary records. [2025-09-18T22:54:18.056896] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-09-18T22:54:18.087491] [DEBUG] [LOCAL ] LYG: Derivative data saved (1807 records). [2025-09-18T22:54:18.087694] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-09-18T22:54:18.091957] [DEBUG] [LOCAL ] LYV: Derivative data saved (1807 records). [2025-09-18T22:54:18.090795] [INFO ] [MAIN ] Derivative Progress: 1115/2075 symbols completed. LYG took 1.2s. Estimated remaining: 6m 13s. Rate: 154.5 symbols/min [2025-09-18T22:54:18.092097] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-09-18T22:54:18.092454] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:18.094972] [INFO ] [MAIN ] Derivative Progress: 1116/2075 symbols completed. LYV took 1.2s. Estimated remaining: 6m 12s. Rate: 154.6 symbols/min [2025-09-18T22:54:18.095336] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:18.111074] [DEBUG] [LOCAL ] LZM: Loaded 13504 existing records from primary storage. [2025-09-18T22:54:18.111234] [INFO ] [MAIN ] LZM: Loaded 13504 primary data records. [2025-09-18T22:54:18.279361] [DEBUG] [LOCAL ] LZB: Loaded 35776 existing records from primary storage. [2025-09-18T22:54:18.316283] [INFO ] [MAIN ] LZB: Loaded 35776 primary data records. [2025-09-18T22:54:18.639290] [DEBUG] [LOCAL ] M: Loaded 53926 existing records from primary storage. [2025-09-18T22:54:18.642921] [INFO ] [MAIN ] M: Loaded 53926 primary data records. [2025-09-18T22:54:19.249535] [DEBUG] [MAIN ] LZM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:19.251411] [INFO ] [MAIN ] LZM: Generated 1807 derivative records from 13504 primary records. [2025-09-18T22:54:19.251734] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-09-18T22:54:19.343688] [DEBUG] [LOCAL ] LZM: Derivative data saved (1807 records). [2025-09-18T22:54:19.344198] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-09-18T22:54:19.473835] [INFO ] [MAIN ] Derivative Progress: 1117/2075 symbols completed. LZM took 1.4s. Estimated remaining: 6m 13s. Rate: 154.2 symbols/min [2025-09-18T22:54:19.498917] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:19.528785] [DEBUG] [MAIN ] LZB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:19.529689] [INFO ] [MAIN ] LZB: Generated 1807 derivative records from 35776 primary records. [2025-09-18T22:54:19.530293] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-09-18T22:54:19.551693] [DEBUG] [LOCAL ] LZB: Derivative data saved (1807 records). [2025-09-18T22:54:19.552171] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-09-18T22:54:19.555608] [INFO ] [MAIN ] Derivative Progress: 1118/2075 symbols completed. LZB took 1.5s. Estimated remaining: 6m 12s. Rate: 154.4 symbols/min [2025-09-18T22:54:19.556314] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:19.591847] [DEBUG] [MAIN ] M: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:19.593162] [INFO ] [MAIN ] M: Generated 1807 derivative records from 53926 primary records. [2025-09-18T22:54:19.593433] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-09-18T22:54:19.620772] [DEBUG] [LOCAL ] M: Derivative data saved (1807 records). [2025-09-18T22:54:19.622033] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-09-18T22:54:19.649860] [INFO ] [MAIN ] Derivative Progress: 1119/2075 symbols completed. M took 1.6s. Estimated remaining: 6m 11s. Rate: 154.5 symbols/min [2025-09-18T22:54:19.651521] [DEBUG] [LOCAL ] MA: Loaded 52979 existing records from primary storage. [2025-09-18T22:54:19.652031] [INFO ] [MAIN ] MA: Loaded 52979 primary data records. [2025-09-18T22:54:19.652226] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:19.813879] [DEBUG] [LOCAL ] MAA: Loaded 43351 existing records from primary storage. [2025-09-18T22:54:19.825161] [INFO ] [MAIN ] MAA: Loaded 43351 primary data records. [2025-09-18T22:54:20.195571] [DEBUG] [LOCAL ] MAC: Loaded 50122 existing records from primary storage. [2025-09-18T22:54:20.203619] [INFO ] [MAIN ] MAC: Loaded 50122 primary data records. [2025-09-18T22:54:20.693067] [DEBUG] [MAIN ] MA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:20.694923] [INFO ] [MAIN ] MA: Generated 1807 derivative records from 52979 primary records. [2025-09-18T22:54:20.695193] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-09-18T22:54:20.726442] [DEBUG] [MAIN ] MAA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:20.728091] [INFO ] [MAIN ] MAA: Generated 1807 derivative records from 43351 primary records. [2025-09-18T22:54:20.728425] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-09-18T22:54:20.739093] [DEBUG] [LOCAL ] MA: Derivative data saved (1807 records). [2025-09-18T22:54:20.740018] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-09-18T22:54:20.746618] [INFO ] [MAIN ] Derivative Progress: 1120/2075 symbols completed. MA took 1.2s. Estimated remaining: 6m 12s. Rate: 154.2 symbols/min [2025-09-18T22:54:20.747558] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:20.754521] [DEBUG] [LOCAL ] MAA: Derivative data saved (1807 records). [2025-09-18T22:54:20.754834] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-09-18T22:54:20.757222] [INFO ] [MAIN ] Derivative Progress: 1121/2075 symbols completed. MAA took 1.2s. Estimated remaining: 6m 11s. Rate: 154.3 symbols/min [2025-09-18T22:54:20.757804] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:20.771382] [DEBUG] [MAIN ] MAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:20.772069] [INFO ] [MAIN ] MAC: Generated 1807 derivative records from 50122 primary records. [2025-09-18T22:54:20.772229] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-09-18T22:54:20.791137] [DEBUG] [LOCAL ] MAC: Derivative data saved (1807 records). [2025-09-18T22:54:20.791418] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-09-18T22:54:20.794381] [INFO ] [MAIN ] Derivative Progress: 1122/2075 symbols completed. MAC took 1.1s. Estimated remaining: 6m 10s. Rate: 154.5 symbols/min [2025-09-18T22:54:20.794740] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:20.820813] [DEBUG] [LOCAL ] MAGN: Loaded 35283 existing records from primary storage. [2025-09-18T22:54:20.830383] [INFO ] [MAIN ] MAGN: Loaded 35283 primary data records. [2025-09-18T22:54:20.985128] [DEBUG] [LOCAL ] MAIN: Loaded 41760 existing records from primary storage. [2025-09-18T22:54:21.057786] [DEBUG] [LOCAL ] MAN: Loaded 44000 existing records from primary storage. [2025-09-18T22:54:21.026597] [INFO ] [MAIN ] MAIN: Loaded 41760 primary data records. [2025-09-18T22:54:21.114429] [INFO ] [MAIN ] MAN: Loaded 44000 primary data records. [2025-09-18T22:54:21.833201] [DEBUG] [MAIN ] MAGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:21.834506] [INFO ] [MAIN ] MAGN: Generated 1807 derivative records from 35283 primary records. [2025-09-18T22:54:21.834883] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-09-18T22:54:21.853369] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1807 records). [2025-09-18T22:54:21.853585] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-09-18T22:54:21.855744] [INFO ] [MAIN ] Derivative Progress: 1123/2075 symbols completed. MAGN took 1.1s. Estimated remaining: 6m 10s. Rate: 154.2 symbols/min [2025-09-18T22:54:21.885901] [DEBUG] [MAIN ] MAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:21.885728] [DEBUG] [MAIN ] MAIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:21.886603] [INFO ] [MAIN ] MAN: Generated 1807 derivative records from 44000 primary records. [2025-09-18T22:54:21.887205] [INFO ] [MAIN ] MAIN: Generated 1807 derivative records from 41760 primary records. [2025-09-18T22:54:21.887266] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-09-18T22:54:21.887954] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-09-18T22:54:21.914532] [DEBUG] [LOCAL ] MAN: Derivative data saved (1807 records). [2025-09-18T22:54:21.915068] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-09-18T22:54:21.918169] [INFO ] [MAIN ] Derivative Progress: 1124/2075 symbols completed. MAN took 1.1s. Estimated remaining: 6m 10s. Rate: 154.3 symbols/min [2025-09-18T22:54:21.921940] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1807 records). [2025-09-18T22:54:21.922002] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-09-18T22:54:21.924188] [INFO ] [MAIN ] Derivative Progress: 1125/2075 symbols completed. MAIN took 1.2s. Estimated remaining: 6m 9s. Rate: 154.5 symbols/min [2025-09-18T22:54:21.924663] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:21.924903] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:21.924787] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:21.969387] [DEBUG] [LOCAL ] MANU: Loaded 27429 existing records from primary storage. [2025-09-18T22:54:21.969630] [INFO ] [MAIN ] MANU: Loaded 27429 primary data records. [2025-09-18T22:54:22.097879] [DEBUG] [LOCAL ] MATV: Loaded 38185 existing records from primary storage. [2025-09-18T22:54:22.098119] [INFO ] [MAIN ] MATV: Loaded 38185 primary data records. [2025-09-18T22:54:22.408571] [DEBUG] [LOCAL ] MAS: Loaded 52753 existing records from primary storage. [2025-09-18T22:54:22.419727] [INFO ] [MAIN ] MAS: Loaded 52753 primary data records. [2025-09-18T22:54:22.991581] [DEBUG] [MAIN ] MANU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:22.994726] [INFO ] [MAIN ] MANU: Generated 1807 derivative records from 27429 primary records. [2025-09-18T22:54:22.995676] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-09-18T22:54:23.027748] [DEBUG] [LOCAL ] MANU: Derivative data saved (1807 records). [2025-09-18T22:54:23.022517] [DEBUG] [MAIN ] MATV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:23.028615] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-09-18T22:54:23.029373] [INFO ] [MAIN ] MATV: Generated 1807 derivative records from 38185 primary records. [2025-09-18T22:54:23.031742] [INFO ] [MAIN ] Derivative Progress: 1126/2075 symbols completed. MANU took 1.1s. Estimated remaining: 6m 9s. Rate: 154.2 symbols/min [2025-09-18T22:54:23.032153] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-09-18T22:54:23.032525] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:23.053760] [DEBUG] [MAIN ] MAS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:23.055735] [INFO ] [MAIN ] MAS: Generated 1807 derivative records from 52753 primary records. [2025-09-18T22:54:23.059782] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-09-18T22:54:23.078742] [DEBUG] [LOCAL ] MAS: Derivative data saved (1807 records). [2025-09-18T22:54:23.078933] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-09-18T22:54:23.082554] [INFO ] [MAIN ] Derivative Progress: 1127/2075 symbols completed. MAS took 1.2s. Estimated remaining: 6m 9s. Rate: 154.3 symbols/min [2025-09-18T22:54:23.083863] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:23.086669] [DEBUG] [LOCAL ] MATV: Derivative data saved (1807 records). [2025-09-18T22:54:23.086771] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-09-18T22:54:23.089447] [INFO ] [MAIN ] Derivative Progress: 1128/2075 symbols completed. MATV took 1.2s. Estimated remaining: 6m 8s. Rate: 154.5 symbols/min [2025-09-18T22:54:23.089962] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:23.126207] [DEBUG] [LOCAL ] MATX: Loaded 31817 existing records from primary storage. [2025-09-18T22:54:23.126889] [INFO ] [MAIN ] MATX: Loaded 31817 primary data records. [2025-09-18T22:54:23.212943] [DEBUG] [LOCAL ] MAX: Loaded 31388 existing records from primary storage. [2025-09-18T22:54:23.223519] [INFO ] [MAIN ] MAX: Loaded 31388 primary data records. [2025-09-18T22:54:23.580686] [DEBUG] [LOCAL ] MBC: Loaded 43429 existing records from primary storage. [2025-09-18T22:54:23.602885] [INFO ] [MAIN ] MBC: Loaded 43429 primary data records. [2025-09-18T22:54:24.129918] [DEBUG] [MAIN ] MATX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:24.130993] [INFO ] [MAIN ] MATX: Generated 1807 derivative records from 31817 primary records. [2025-09-18T22:54:24.131109] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-09-18T22:54:24.160869] [DEBUG] [LOCAL ] MATX: Derivative data saved (1807 records). [2025-09-18T22:54:24.166445] [DEBUG] [MAIN ] MAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:24.167487] [INFO ] [MAIN ] MAX: Generated 1807 derivative records from 31388 primary records. [2025-09-18T22:54:24.167883] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-09-18T22:54:24.170229] [INFO ] [MAIN ] Derivative Progress: 1129/2075 symbols completed. MATX took 1.1s. Estimated remaining: 6m 8s. Rate: 154.2 symbols/min [2025-09-18T22:54:24.170762] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:24.167606] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-09-18T22:54:24.213558] [DEBUG] [LOCAL ] MAX: Derivative data saved (1807 records). [2025-09-18T22:54:24.212936] [DEBUG] [MAIN ] MBC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:24.213709] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-09-18T22:54:24.217319] [INFO ] [MAIN ] MBC: Generated 1807 derivative records from 43429 primary records. [2025-09-18T22:54:24.217515] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-09-18T22:54:24.216214] [INFO ] [MAIN ] Derivative Progress: 1130/2075 symbols completed. MAX took 1.1s. Estimated remaining: 6m 7s. Rate: 154.4 symbols/min [2025-09-18T22:54:24.218128] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:24.227201] [DEBUG] [LOCAL ] MBI: Loaded 25241 existing records from primary storage. [2025-09-18T22:54:24.227328] [INFO ] [MAIN ] MBI: Loaded 25241 primary data records. [2025-09-18T22:54:24.385595] [DEBUG] [LOCAL ] MBC: Derivative data saved (1807 records). [2025-09-18T22:54:24.456939] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-09-18T22:54:24.467180] [INFO ] [MAIN ] Derivative Progress: 1131/2075 symbols completed. MBC took 1.4s. Estimated remaining: 6m 7s. Rate: 154.4 symbols/min [2025-09-18T22:54:24.581558] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:24.606010] [DEBUG] [LOCAL ] MC: Loaded 44790 existing records from primary storage. [2025-09-18T22:54:24.607679] [INFO ] [MAIN ] MC: Loaded 44790 primary data records. [2025-09-18T22:54:24.728455] [DEBUG] [LOCAL ] MCB: Loaded 11902 existing records from primary storage. [2025-09-18T22:54:24.763273] [INFO ] [MAIN ] MCB: Loaded 11902 primary data records. [2025-09-18T22:54:25.319393] [DEBUG] [MAIN ] MBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:25.321477] [INFO ] [MAIN ] MBI: Generated 1807 derivative records from 25241 primary records. [2025-09-18T22:54:25.321959] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-09-18T22:54:25.342798] [DEBUG] [LOCAL ] MBI: Derivative data saved (1807 records). [2025-09-18T22:54:25.342974] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-09-18T22:54:25.345591] [INFO ] [MAIN ] Derivative Progress: 1132/2075 symbols completed. MBI took 1.2s. Estimated remaining: 6m 7s. Rate: 154.2 symbols/min [2025-09-18T22:54:25.349102] [INFO ] [MAIN ] MCD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:25.364242] [DEBUG] [MAIN ] MC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:25.365164] [INFO ] [MAIN ] MC: Generated 1807 derivative records from 44790 primary records. [2025-09-18T22:54:25.365509] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-09-18T22:54:25.384571] [DEBUG] [LOCAL ] MC: Derivative data saved (1807 records). [2025-09-18T22:54:25.387029] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-09-18T22:54:25.389683] [INFO ] [MAIN ] Derivative Progress: 1133/2075 symbols completed. MC took 1.2s. Estimated remaining: 6m 6s. Rate: 154.4 symbols/min [2025-09-18T22:54:25.390195] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:25.410960] [DEBUG] [MAIN ] MCB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:25.414092] [INFO ] [MAIN ] MCB: Generated 1807 derivative records from 11902 primary records. [2025-09-18T22:54:25.414277] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-09-18T22:54:25.434918] [DEBUG] [LOCAL ] MCI: Loaded 6363 existing records from primary storage. [2025-09-18T22:54:25.435745] [INFO ] [MAIN ] MCI: Loaded 6363 primary data records. [2025-09-18T22:54:25.535847] [DEBUG] [LOCAL ] MCB: Derivative data saved (1807 records). [2025-09-18T22:54:25.565498] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-09-18T22:54:25.568583] [INFO ] [MAIN ] Derivative Progress: 1134/2075 symbols completed. MCB took 1.0s. Estimated remaining: 6m 6s. Rate: 154.4 symbols/min [2025-09-18T22:54:25.574553] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:25.651718] [DEBUG] [LOCAL ] MCD: Loaded 53857 existing records from primary storage. [2025-09-18T22:54:25.791582] [INFO ] [MAIN ] MCD: Loaded 53857 primary data records. [2025-09-18T22:54:26.134116] [DEBUG] [LOCAL ] MCK: Loaded 39841 existing records from primary storage. [2025-09-18T22:54:26.134473] [INFO ] [MAIN ] MCK: Loaded 39841 primary data records. [2025-09-18T22:54:26.348034] [DEBUG] [MAIN ] MCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:26.475458] [INFO ] [MAIN ] MCI: Generated 1807 derivative records from 6363 primary records. [2025-09-18T22:54:26.475733] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-09-18T22:54:26.497515] [DEBUG] [LOCAL ] MCI: Derivative data saved (1807 records). [2025-09-18T22:54:26.498812] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-09-18T22:54:26.501248] [INFO ] [MAIN ] Derivative Progress: 1135/2075 symbols completed. MCI took 1.1s. Estimated remaining: 6m 6s. Rate: 154.2 symbols/min [2025-09-18T22:54:26.509506] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:26.515710] [DEBUG] [MAIN ] MCD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:26.516913] [INFO ] [MAIN ] MCD: Generated 1807 derivative records from 53857 primary records. [2025-09-18T22:54:26.517217] [DEBUG] [LOCAL ] MCD: Saving derivative data. [2025-09-18T22:54:26.540596] [DEBUG] [LOCAL ] MCN: Loaded 8248 existing records from primary storage. [2025-09-18T22:54:26.541688] [INFO ] [MAIN ] MCN: Loaded 8248 primary data records. [2025-09-18T22:54:26.579523] [DEBUG] [LOCAL ] MCD: Derivative data saved (1807 records). [2025-09-18T22:54:26.607453] [INFO ] [MAIN ] MCD: Successfully saved derivative data. [2025-09-18T22:54:26.627505] [INFO ] [MAIN ] Derivative Progress: 1136/2075 symbols completed. MCD took 1.3s. Estimated remaining: 6m 5s. Rate: 154.3 symbols/min [2025-09-18T22:54:26.638348] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:26.875862] [DEBUG] [MAIN ] MCK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:26.876743] [INFO ] [MAIN ] MCK: Generated 1807 derivative records from 39841 primary records. [2025-09-18T22:54:26.877000] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-09-18T22:54:26.907989] [DEBUG] [LOCAL ] MCK: Derivative data saved (1807 records). [2025-09-18T22:54:26.908160] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-09-18T22:54:26.910768] [INFO ] [MAIN ] Derivative Progress: 1137/2075 symbols completed. MCK took 1.3s. Estimated remaining: 6m 5s. Rate: 154.4 symbols/min [2025-09-18T22:54:26.911307] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:26.925699] [DEBUG] [LOCAL ] MCO: Loaded 39958 existing records from primary storage. [2025-09-18T22:54:26.926215] [INFO ] [MAIN ] MCO: Loaded 39958 primary data records. [2025-09-18T22:54:27.020924] [DEBUG] [LOCAL ] MCR: Loaded 9016 existing records from primary storage. [2025-09-18T22:54:27.033109] [INFO ] [MAIN ] MCR: Loaded 9016 primary data records. [2025-09-18T22:54:27.100096] [DEBUG] [MAIN ] MCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:27.140800] [INFO ] [MAIN ] MCN: Generated 1807 derivative records from 8248 primary records. [2025-09-18T22:54:27.179294] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-09-18T22:54:27.628877] [DEBUG] [LOCAL ] MCN: Derivative data saved (1807 records). [2025-09-18T22:54:27.643316] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-09-18T22:54:27.646441] [INFO ] [MAIN ] Derivative Progress: 1138/2075 symbols completed. MCN took 1.1s. Estimated remaining: 6m 4s. Rate: 154.2 symbols/min [2025-09-18T22:54:27.669968] [DEBUG] [MAIN ] MCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:27.670775] [INFO ] [MAIN ] MCO: Generated 1807 derivative records from 39958 primary records. [2025-09-18T22:54:27.670922] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-09-18T22:54:27.700598] [DEBUG] [MAIN ] MCR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:27.701749] [INFO ] [MAIN ] MCR: Generated 1807 derivative records from 9016 primary records. [2025-09-18T22:54:27.702045] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-09-18T22:54:27.703398] [DEBUG] [LOCAL ] MCO: Derivative data saved (1807 records). [2025-09-18T22:54:27.703627] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-09-18T22:54:27.715776] [INFO ] [MAIN ] Derivative Progress: 1139/2075 symbols completed. MCO took 1.1s. Estimated remaining: 6m 4s. Rate: 154.4 symbols/min [2025-09-18T22:54:27.720069] [DEBUG] [LOCAL ] MCR: Derivative data saved (1807 records). [2025-09-18T22:54:27.720134] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-09-18T22:54:27.722695] [INFO ] [MAIN ] Derivative Progress: 1140/2075 symbols completed. MCR took 0.8s. Estimated remaining: 6m 3s. Rate: 154.5 symbols/min [2025-09-18T22:54:27.723154] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:27.723443] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:27.723309] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:27.757141] [DEBUG] [LOCAL ] MCS: Loaded 21651 existing records from primary storage. [2025-09-18T22:54:27.757407] [INFO ] [MAIN ] MCS: Loaded 21651 primary data records. [2025-09-18T22:54:27.879147] [DEBUG] [LOCAL ] MCY: Loaded 25816 existing records from primary storage. [2025-09-18T22:54:27.885000] [INFO ] [MAIN ] MCY: Loaded 25816 primary data records. [2025-09-18T22:54:27.996780] [DEBUG] [LOCAL ] MD: Loaded 39088 existing records from primary storage. [2025-09-18T22:54:28.058965] [INFO ] [MAIN ] MD: Loaded 39088 primary data records. [2025-09-18T22:54:28.760284] [DEBUG] [MAIN ] MCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:28.761767] [INFO ] [MAIN ] MCS: Generated 1807 derivative records from 21651 primary records. [2025-09-18T22:54:28.762951] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-09-18T22:54:28.794479] [DEBUG] [MAIN ] MCY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:28.796029] [INFO ] [MAIN ] MCY: Generated 1807 derivative records from 25816 primary records. [2025-09-18T22:54:28.796622] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-09-18T22:54:28.800483] [DEBUG] [LOCAL ] MCS: Derivative data saved (1807 records). [2025-09-18T22:54:28.808070] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-09-18T22:54:28.812074] [INFO ] [MAIN ] Derivative Progress: 1141/2075 symbols completed. MCS took 1.1s. Estimated remaining: 6m 3s. Rate: 154.2 symbols/min [2025-09-18T22:54:28.815946] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:28.839743] [DEBUG] [LOCAL ] MCY: Derivative data saved (1807 records). [2025-09-18T22:54:28.843371] [DEBUG] [MAIN ] MD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:28.843137] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-09-18T22:54:28.844313] [INFO ] [MAIN ] MD: Generated 1807 derivative records from 39088 primary records. [2025-09-18T22:54:28.844453] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-09-18T22:54:28.842810] [DEBUG] [LOCAL ] MDST: Loaded 5493 existing records from primary storage. [2025-09-18T22:54:28.848790] [INFO ] [MAIN ] Derivative Progress: 1142/2075 symbols completed. MCY took 1.1s. Estimated remaining: 6m 3s. Rate: 154.4 symbols/min [2025-09-18T22:54:28.845507] [INFO ] [MAIN ] MDST: Loaded 5493 primary data records. [2025-09-18T22:54:28.854730] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:28.992481] [DEBUG] [LOCAL ] MD: Derivative data saved (1807 records). [2025-09-18T22:54:29.030030] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-09-18T22:54:29.055467] [INFO ] [MAIN ] Derivative Progress: 1143/2075 symbols completed. MD took 1.3s. Estimated remaining: 6m 2s. Rate: 154.4 symbols/min [2025-09-18T22:54:29.191791] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:29.240098] [DEBUG] [LOCAL ] MDT: Loaded 54068 existing records from primary storage. [2025-09-18T22:54:29.240706] [INFO ] [MAIN ] MDT: Loaded 54068 primary data records. [2025-09-18T22:54:29.388471] [DEBUG] [MAIN ] MDST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:29.427394] [INFO ] [MAIN ] MDST: Generated 1807 derivative records from 5493 primary records. [2025-09-18T22:54:29.446703] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-09-18T22:54:29.592586] [DEBUG] [LOCAL ] MDU: Loaded 48211 existing records from primary storage. [2025-09-18T22:54:29.608706] [INFO ] [MAIN ] MDU: Loaded 48211 primary data records. [2025-09-18T22:54:29.741260] [DEBUG] [LOCAL ] MDST: Derivative data saved (1807 records). [2025-09-18T22:54:29.742077] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-09-18T22:54:29.760496] [INFO ] [MAIN ] Derivative Progress: 1144/2075 symbols completed. MDST took 0.9s. Estimated remaining: 6m 2s. Rate: 154.3 symbols/min [2025-09-18T22:54:29.802809] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:29.963843] [DEBUG] [LOCAL ] MDV: Loaded 8882 existing records from primary storage. [2025-09-18T22:54:29.964914] [INFO ] [MAIN ] MDV: Loaded 8882 primary data records. [2025-09-18T22:54:30.068502] [DEBUG] [MAIN ] MDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:30.086335] [INFO ] [MAIN ] MDT: Generated 1807 derivative records from 54068 primary records. [2025-09-18T22:54:30.086567] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-09-18T22:54:30.302730] [DEBUG] [LOCAL ] MDT: Derivative data saved (1807 records). [2025-09-18T22:54:30.303067] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-09-18T22:54:30.306841] [INFO ] [MAIN ] Derivative Progress: 1145/2075 symbols completed. MDT took 1.5s. Estimated remaining: 6m 2s. Rate: 154.3 symbols/min [2025-09-18T22:54:30.309602] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:30.325060] [DEBUG] [MAIN ] MDU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:30.326013] [INFO ] [MAIN ] MDU: Generated 1807 derivative records from 48211 primary records. [2025-09-18T22:54:30.326187] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-09-18T22:54:30.348374] [DEBUG] [LOCAL ] MDU: Derivative data saved (1807 records). [2025-09-18T22:54:30.348790] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-09-18T22:54:30.351049] [INFO ] [MAIN ] Derivative Progress: 1146/2075 symbols completed. MDU took 1.2s. Estimated remaining: 6m 1s. Rate: 154.4 symbols/min [2025-09-18T22:54:30.351444] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:30.358263] [DEBUG] [LOCAL ] MEC: Loaded 16794 existing records from primary storage. [2025-09-18T22:54:30.358759] [INFO ] [MAIN ] MEC: Loaded 16794 primary data records. [2025-09-18T22:54:30.567874] [DEBUG] [MAIN ] MDV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:30.567403] [DEBUG] [LOCAL ] MED: Loaded 22087 existing records from primary storage. [2025-09-18T22:54:30.568115] [INFO ] [MAIN ] MED: Loaded 22087 primary data records. [2025-09-18T22:54:30.617439] [INFO ] [MAIN ] MDV: Generated 1807 derivative records from 8882 primary records. [2025-09-18T22:54:30.742800] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-09-18T22:54:30.817096] [DEBUG] [LOCAL ] MDV: Derivative data saved (1807 records). [2025-09-18T22:54:30.838164] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-09-18T22:54:30.870833] [INFO ] [MAIN ] Derivative Progress: 1147/2075 symbols completed. MDV took 1.1s. Estimated remaining: 6m 1s. Rate: 154.3 symbols/min [2025-09-18T22:54:31.024703] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:31.089604] [DEBUG] [MAIN ] MEC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:31.099547] [INFO ] [MAIN ] MEC: Generated 1807 derivative records from 16794 primary records. [2025-09-18T22:54:31.099815] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-09-18T22:54:31.129970] [DEBUG] [LOCAL ] MEC: Derivative data saved (1807 records). [2025-09-18T22:54:31.130553] [DEBUG] [LOCAL ] MEG: Loaded 32409 existing records from primary storage. [2025-09-18T22:54:31.130794] [INFO ] [MAIN ] MEG: Loaded 32409 primary data records. [2025-09-18T22:54:31.130976] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-09-18T22:54:31.133392] [INFO ] [MAIN ] Derivative Progress: 1148/2075 symbols completed. MEC took 0.8s. Estimated remaining: 6m 0s. Rate: 154.4 symbols/min [2025-09-18T22:54:31.147341] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:31.268106] [DEBUG] [MAIN ] MED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:31.300579] [INFO ] [MAIN ] MED: Generated 1807 derivative records from 22087 primary records. [2025-09-18T22:54:31.324188] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-09-18T22:54:31.367323] [DEBUG] [LOCAL ] MEGI: Loaded 20737 existing records from primary storage. [2025-09-18T22:54:31.493342] [INFO ] [MAIN ] MEGI: Loaded 20737 primary data records. [2025-09-18T22:54:31.520926] [DEBUG] [LOCAL ] MED: Derivative data saved (1807 records). [2025-09-18T22:54:31.543873] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-09-18T22:54:31.571707] [INFO ] [MAIN ] Derivative Progress: 1149/2075 symbols completed. MED took 1.2s. Estimated remaining: 5m 60s. Rate: 154.4 symbols/min [2025-09-18T22:54:31.594374] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:31.913259] [DEBUG] [LOCAL ] MEI: Loaded 32951 existing records from primary storage. [2025-09-18T22:54:31.912102] [DEBUG] [MAIN ] MEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:31.914688] [INFO ] [MAIN ] MEG: Generated 1807 derivative records from 32409 primary records. [2025-09-18T22:54:31.915570] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-09-18T22:54:31.913610] [INFO ] [MAIN ] MEI: Loaded 32951 primary data records. [2025-09-18T22:54:32.126031] [DEBUG] [LOCAL ] MEG: Derivative data saved (1807 records). [2025-09-18T22:54:32.231614] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-09-18T22:54:32.250446] [INFO ] [MAIN ] Derivative Progress: 1150/2075 symbols completed. MEG took 1.4s. Estimated remaining: 5m 60s. Rate: 154.3 symbols/min [2025-09-18T22:54:32.254870] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:32.271520] [DEBUG] [MAIN ] MEGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:32.273218] [INFO ] [MAIN ] MEGI: Generated 1807 derivative records from 20737 primary records. [2025-09-18T22:54:32.273811] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-09-18T22:54:32.294358] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1807 records). [2025-09-18T22:54:32.294624] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-09-18T22:54:32.297219] [INFO ] [MAIN ] Derivative Progress: 1151/2075 symbols completed. MEGI took 1.1s. Estimated remaining: 5m 59s. Rate: 154.4 symbols/min [2025-09-18T22:54:32.297871] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:32.320863] [DEBUG] [MAIN ] MEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:32.321608] [INFO ] [MAIN ] MEI: Generated 1807 derivative records from 32951 primary records. [2025-09-18T22:54:32.321704] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-09-18T22:54:32.356677] [DEBUG] [LOCAL ] MEI: Derivative data saved (1807 records). [2025-09-18T22:54:32.356897] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-09-18T22:54:32.359865] [INFO ] [MAIN ] Derivative Progress: 1152/2075 symbols completed. MEI took 0.8s. Estimated remaining: 5m 58s. Rate: 154.5 symbols/min [2025-09-18T22:54:32.360403] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:32.391168] [DEBUG] [LOCAL ] MFAN: Loaded 4318 existing records from primary storage. [2025-09-18T22:54:32.392467] [INFO ] [MAIN ] MFAN: Loaded 4318 primary data records. [2025-09-18T22:54:32.407631] [DEBUG] [LOCAL ] MET: Loaded 53702 existing records from primary storage. [2025-09-18T22:54:32.439120] [INFO ] [MAIN ] MET: Loaded 53702 primary data records. [2025-09-18T22:54:32.493600] [DEBUG] [LOCAL ] MFA: Loaded 45505 existing records from primary storage. [2025-09-18T22:54:32.502519] [INFO ] [MAIN ] MFA: Loaded 45505 primary data records. [2025-09-18T22:54:33.432880] [DEBUG] [MAIN ] MFAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:33.434968] [INFO ] [MAIN ] MFAN: Generated 1807 derivative records from 4318 primary records. [2025-09-18T22:54:33.435182] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-09-18T22:54:33.454468] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1807 records). [2025-09-18T22:54:33.454827] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-09-18T22:54:33.457694] [INFO ] [MAIN ] Derivative Progress: 1153/2075 symbols completed. MFAN took 1.1s. Estimated remaining: 5m 59s. Rate: 154.3 symbols/min [2025-09-18T22:54:33.483574] [DEBUG] [MAIN ] MET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:33.483985] [DEBUG] [MAIN ] MFA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:33.484947] [INFO ] [MAIN ] MET: Generated 1807 derivative records from 53702 primary records. [2025-09-18T22:54:33.485857] [INFO ] [MAIN ] MFA: Generated 1807 derivative records from 45505 primary records. [2025-09-18T22:54:33.485964] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-09-18T22:54:33.486064] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-09-18T22:54:33.517954] [DEBUG] [LOCAL ] MET: Derivative data saved (1807 records). [2025-09-18T22:54:33.518495] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-09-18T22:54:33.524389] [INFO ] [MAIN ] Derivative Progress: 1154/2075 symbols completed. MET took 1.3s. Estimated remaining: 5m 58s. Rate: 154.4 symbols/min [2025-09-18T22:54:33.526147] [DEBUG] [LOCAL ] MFA: Derivative data saved (1807 records). [2025-09-18T22:54:33.526233] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-09-18T22:54:33.529262] [INFO ] [MAIN ] Derivative Progress: 1155/2075 symbols completed. MFA took 1.2s. Estimated remaining: 5m 57s. Rate: 154.5 symbols/min [2025-09-18T22:54:33.529844] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:33.530048] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:33.530479] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:33.540208] [DEBUG] [LOCAL ] MFAO: Loaded 3859 existing records from primary storage. [2025-09-18T22:54:33.540389] [INFO ] [MAIN ] MFAO: Loaded 3859 primary data records. [2025-09-18T22:54:33.889462] [DEBUG] [LOCAL ] MFG: Loaded 49327 existing records from primary storage. [2025-09-18T22:54:33.904082] [INFO ] [MAIN ] MFG: Loaded 49327 primary data records. [2025-09-18T22:54:33.905462] [DEBUG] [LOCAL ] MFC: Loaded 51764 existing records from primary storage. [2025-09-18T22:54:33.910947] [INFO ] [MAIN ] MFC: Loaded 51764 primary data records. [2025-09-18T22:54:34.547497] [DEBUG] [MAIN ] MFAO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:34.548995] [INFO ] [MAIN ] MFAO: Generated 1807 derivative records from 3859 primary records. [2025-09-18T22:54:34.549386] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-09-18T22:54:34.571481] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1807 records). [2025-09-18T22:54:34.572176] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-09-18T22:54:34.576731] [INFO ] [MAIN ] Derivative Progress: 1156/2075 symbols completed. MFAO took 1.0s. Estimated remaining: 5m 57s. Rate: 154.3 symbols/min [2025-09-18T22:54:34.579335] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:34.596263] [DEBUG] [MAIN ] MFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:34.597424] [INFO ] [MAIN ] MFG: Generated 1807 derivative records from 49327 primary records. [2025-09-18T22:54:34.597706] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-09-18T22:54:34.611903] [DEBUG] [MAIN ] MFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:34.627106] [INFO ] [MAIN ] MFC: Generated 1807 derivative records from 51764 primary records. [2025-09-18T22:54:34.631748] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-09-18T22:54:34.633538] [DEBUG] [LOCAL ] MFG: Derivative data saved (1807 records). [2025-09-18T22:54:34.641293] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-09-18T22:54:34.653393] [DEBUG] [LOCAL ] MFM: Loaded 14511 existing records from primary storage. [2025-09-18T22:54:34.647602] [INFO ] [MAIN ] Derivative Progress: 1157/2075 symbols completed. MFG took 1.1s. Estimated remaining: 5m 57s. Rate: 154.4 symbols/min [2025-09-18T22:54:34.656130] [INFO ] [MAIN ] MFM: Loaded 14511 primary data records. [2025-09-18T22:54:34.656952] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:34.734466] [DEBUG] [LOCAL ] MFC: Derivative data saved (1807 records). [2025-09-18T22:54:34.769936] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-09-18T22:54:34.785204] [INFO ] [MAIN ] Derivative Progress: 1158/2075 symbols completed. MFC took 1.3s. Estimated remaining: 5m 56s. Rate: 154.5 symbols/min [2025-09-18T22:54:34.817861] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:34.865265] [DEBUG] [LOCAL ] MG: Loaded 17012 existing records from primary storage. [2025-09-18T22:54:34.870472] [INFO ] [MAIN ] MG: Loaded 17012 primary data records. [2025-09-18T22:54:35.376870] [DEBUG] [MAIN ] MFM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:35.377546] [INFO ] [MAIN ] MFM: Generated 1807 derivative records from 14511 primary records. [2025-09-18T22:54:35.377763] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-09-18T22:54:35.411241] [DEBUG] [LOCAL ] MGA: Loaded 51050 existing records from primary storage. [2025-09-18T22:54:35.412126] [INFO ] [MAIN ] MGA: Loaded 51050 primary data records. [2025-09-18T22:54:35.487166] [DEBUG] [LOCAL ] MFM: Derivative data saved (1807 records). [2025-09-18T22:54:35.510604] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-09-18T22:54:35.526811] [INFO ] [MAIN ] Derivative Progress: 1159/2075 symbols completed. MFM took 0.9s. Estimated remaining: 5m 56s. Rate: 154.3 symbols/min [2025-09-18T22:54:35.569685] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:35.559295] [DEBUG] [MAIN ] MG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:35.593535] [INFO ] [MAIN ] MG: Generated 1807 derivative records from 17012 primary records. [2025-09-18T22:54:35.626756] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-09-18T22:54:35.772590] [DEBUG] [LOCAL ] MGF: Loaded 4177 existing records from primary storage. [2025-09-18T22:54:35.773866] [INFO ] [MAIN ] MGF: Loaded 4177 primary data records. [2025-09-18T22:54:35.850817] [DEBUG] [LOCAL ] MG: Derivative data saved (1807 records). [2025-09-18T22:54:35.870224] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-09-18T22:54:35.877994] [INFO ] [MAIN ] Derivative Progress: 1160/2075 symbols completed. MG took 1.2s. Estimated remaining: 5m 56s. Rate: 154.4 symbols/min [2025-09-18T22:54:35.901974] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:36.131069] [DEBUG] [LOCAL ] MGR: Loaded 5715 existing records from primary storage. [2025-09-18T22:54:36.131482] [INFO ] [MAIN ] MGR: Loaded 5715 primary data records. [2025-09-18T22:54:36.289904] [DEBUG] [MAIN ] MGA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:36.311379] [INFO ] [MAIN ] MGA: Generated 1807 derivative records from 51050 primary records. [2025-09-18T22:54:36.346097] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-09-18T22:54:36.512134] [DEBUG] [LOCAL ] MGA: Derivative data saved (1807 records). [2025-09-18T22:54:36.513366] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-09-18T22:54:36.514062] [DEBUG] [MAIN ] MGF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:36.516537] [INFO ] [MAIN ] Derivative Progress: 1161/2075 symbols completed. MGA took 1.7s. Estimated remaining: 5m 55s. Rate: 154.3 symbols/min [2025-09-18T22:54:36.518042] [INFO ] [MAIN ] MGF: Generated 1807 derivative records from 4177 primary records. [2025-09-18T22:54:36.518175] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:36.518262] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-09-18T22:54:36.536477] [DEBUG] [LOCAL ] MGF: Derivative data saved (1807 records). [2025-09-18T22:54:36.539873] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-09-18T22:54:36.539768] [DEBUG] [LOCAL ] MGRB: Loaded 4131 existing records from primary storage. [2025-09-18T22:54:36.542619] [INFO ] [MAIN ] Derivative Progress: 1162/2075 symbols completed. MGF took 1.0s. Estimated remaining: 5m 55s. Rate: 154.4 symbols/min [2025-09-18T22:54:36.542852] [INFO ] [MAIN ] MGRB: Loaded 4131 primary data records. [2025-09-18T22:54:36.548484] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:36.636173] [DEBUG] [LOCAL ] MGRD: Loaded 2262 existing records from primary storage. [2025-09-18T22:54:36.641616] [INFO ] [MAIN ] MGRD: Loaded 2262 primary data records. [2025-09-18T22:54:36.768072] [DEBUG] [MAIN ] MGR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:54:36.779349] [INFO ] [MAIN ] MGR: Generated 1806 derivative records from 5715 primary records. [2025-09-18T22:54:36.804933] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-09-18T22:54:37.210687] [DEBUG] [LOCAL ] MGR: Derivative data saved (1806 records). [2025-09-18T22:54:37.271991] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-09-18T22:54:37.275765] [INFO ] [MAIN ] Derivative Progress: 1163/2075 symbols completed. MGR took 1.4s. Estimated remaining: 5m 55s. Rate: 154.3 symbols/min [2025-09-18T22:54:37.276215] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:37.294766] [DEBUG] [LOCAL ] MGRE: Loaded 6622 existing records from primary storage. [2025-09-18T22:54:37.295555] [INFO ] [MAIN ] MGRE: Loaded 6622 primary data records. [2025-09-18T22:54:37.504719] [DEBUG] [MAIN ] MGRB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:37.621341] [INFO ] [MAIN ] MGRB: Generated 1807 derivative records from 4131 primary records. [2025-09-18T22:54:37.642505] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-09-18T22:54:37.643879] [DEBUG] [MAIN ] MGRD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:37.645283] [INFO ] [MAIN ] MGRD: Generated 1807 derivative records from 2262 primary records. [2025-09-18T22:54:37.646202] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-09-18T22:54:37.676711] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1807 records). [2025-09-18T22:54:37.677669] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-09-18T22:54:37.680742] [INFO ] [MAIN ] Derivative Progress: 1164/2075 symbols completed. MGRB took 1.2s. Estimated remaining: 5m 54s. Rate: 154.3 symbols/min [2025-09-18T22:54:37.681284] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:37.681404] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1807 records). [2025-09-18T22:54:37.681551] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-09-18T22:54:37.685602] [INFO ] [MAIN ] Derivative Progress: 1165/2075 symbols completed. MGRD took 1.1s. Estimated remaining: 5m 54s. Rate: 154.4 symbols/min [2025-09-18T22:54:37.686520] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:37.709626] [DEBUG] [MAIN ] MGRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:37.711245] [INFO ] [MAIN ] MGRE: Generated 1807 derivative records from 6622 primary records. [2025-09-18T22:54:37.716122] [DEBUG] [LOCAL ] MHD: Loaded 12367 existing records from primary storage. [2025-09-18T22:54:37.716200] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-09-18T22:54:37.716264] [INFO ] [MAIN ] MHD: Loaded 12367 primary data records. [2025-09-18T22:54:37.865128] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1807 records). [2025-09-18T22:54:37.904106] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-09-18T22:54:37.939674] [INFO ] [MAIN ] Derivative Progress: 1166/2075 symbols completed. MGRE took 0.7s. Estimated remaining: 5m 53s. Rate: 154.5 symbols/min [2025-09-18T22:54:38.058477] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:38.075577] [DEBUG] [LOCAL ] MGY: Loaded 52836 existing records from primary storage. [2025-09-18T22:54:38.075934] [INFO ] [MAIN ] MGY: Loaded 52836 primary data records. [2025-09-18T22:54:38.172539] [DEBUG] [LOCAL ] MHF: Loaded 8630 existing records from primary storage. [2025-09-18T22:54:38.200334] [INFO ] [MAIN ] MHF: Loaded 8630 primary data records. [2025-09-18T22:54:38.737249] [DEBUG] [MAIN ] MHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:38.738558] [INFO ] [MAIN ] MHD: Generated 1807 derivative records from 12367 primary records. [2025-09-18T22:54:38.738879] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-09-18T22:54:38.756844] [DEBUG] [LOCAL ] MHD: Derivative data saved (1807 records). [2025-09-18T22:54:38.756956] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-09-18T22:54:38.759105] [INFO ] [MAIN ] Derivative Progress: 1167/2075 symbols completed. MHD took 1.1s. Estimated remaining: 5m 53s. Rate: 154.3 symbols/min [2025-09-18T22:54:38.759578] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:38.778174] [DEBUG] [MAIN ] MGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:38.780563] [INFO ] [MAIN ] MGY: Generated 1807 derivative records from 52836 primary records. [2025-09-18T22:54:38.780737] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-09-18T22:54:38.806351] [DEBUG] [MAIN ] MHF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:38.807932] [INFO ] [MAIN ] MHF: Generated 1807 derivative records from 8630 primary records. [2025-09-18T22:54:38.808988] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-09-18T22:54:38.812836] [DEBUG] [LOCAL ] MGY: Derivative data saved (1807 records). [2025-09-18T22:54:38.813012] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-09-18T22:54:38.821540] [INFO ] [MAIN ] Derivative Progress: 1168/2075 symbols completed. MGY took 1.1s. Estimated remaining: 5m 52s. Rate: 154.4 symbols/min [2025-09-18T22:54:38.838824] [DEBUG] [LOCAL ] MHF: Derivative data saved (1807 records). [2025-09-18T22:54:38.838928] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-09-18T22:54:38.841814] [INFO ] [MAIN ] Derivative Progress: 1169/2075 symbols completed. MHF took 0.8s. Estimated remaining: 5m 52s. Rate: 154.5 symbols/min [2025-09-18T22:54:38.857256] [DEBUG] [LOCAL ] MHK: Loaded 42873 existing records from primary storage. [2025-09-18T22:54:38.857383] [INFO ] [MAIN ] MHK: Loaded 42873 primary data records. [2025-09-18T22:54:39.203390] [DEBUG] [MAIN ] MHK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:39.204057] [INFO ] [MAIN ] MHK: Generated 1807 derivative records from 42873 primary records. [2025-09-18T22:54:39.204123] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-09-18T22:54:39.219354] [DEBUG] [LOCAL ] MHK: Derivative data saved (1807 records). [2025-09-18T22:54:39.219419] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-09-18T22:54:39.221475] [INFO ] [MAIN ] Derivative Progress: 1170/2075 symbols completed. MHK took 0.5s. Estimated remaining: 5m 51s. Rate: 154.5 symbols/min [2025-09-18T22:54:39.222281] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:39.222141] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:39.222423] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:39.237151] [DEBUG] [LOCAL ] MHN: Loaded 7862 existing records from primary storage. [2025-09-18T22:54:39.237343] [INFO ] [MAIN ] MHN: Loaded 7862 primary data records. [2025-09-18T22:54:39.303079] [DEBUG] [LOCAL ] MIN: Loaded 13246 existing records from primary storage. [2025-09-18T22:54:39.320764] [INFO ] [MAIN ] MIN: Loaded 13246 primary data records. [2025-09-18T22:54:39.464237] [DEBUG] [LOCAL ] MHO: Loaded 24676 existing records from primary storage. [2025-09-18T22:54:39.485077] [INFO ] [MAIN ] MHO: Loaded 24676 primary data records. [2025-09-18T22:54:40.288433] [DEBUG] [MAIN ] MHN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:40.290350] [INFO ] [MAIN ] MHN: Generated 1807 derivative records from 7862 primary records. [2025-09-18T22:54:40.292406] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-09-18T22:54:40.320922] [DEBUG] [MAIN ] MIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:40.323120] [INFO ] [MAIN ] MIN: Generated 1807 derivative records from 13246 primary records. [2025-09-18T22:54:40.323791] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-09-18T22:54:40.339943] [DEBUG] [LOCAL ] MHN: Derivative data saved (1807 records). [2025-09-18T22:54:40.340974] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-09-18T22:54:40.343564] [INFO ] [MAIN ] Derivative Progress: 1171/2075 symbols completed. MHN took 1.1s. Estimated remaining: 5m 52s. Rate: 154.3 symbols/min [2025-09-18T22:54:40.344599] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:40.348280] [DEBUG] [LOCAL ] MIN: Derivative data saved (1807 records). [2025-09-18T22:54:40.349685] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-09-18T22:54:40.353113] [INFO ] [MAIN ] Derivative Progress: 1172/2075 symbols completed. MIN took 1.1s. Estimated remaining: 5m 51s. Rate: 154.4 symbols/min [2025-09-18T22:54:40.354203] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:40.369868] [DEBUG] [MAIN ] MHO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:40.370736] [INFO ] [MAIN ] MHO: Generated 1807 derivative records from 24676 primary records. [2025-09-18T22:54:40.373349] [DEBUG] [LOCAL ] MITP: Loaded 2399 existing records from primary storage. [2025-09-18T22:54:40.373507] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-09-18T22:54:40.373677] [INFO ] [MAIN ] MITP: Loaded 2399 primary data records. [2025-09-18T22:54:40.559182] [DEBUG] [LOCAL ] MHO: Derivative data saved (1807 records). [2025-09-18T22:54:40.593117] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-09-18T22:54:40.596288] [INFO ] [MAIN ] Derivative Progress: 1173/2075 symbols completed. MHO took 1.4s. Estimated remaining: 5m 50s. Rate: 154.5 symbols/min [2025-09-18T22:54:40.605387] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:40.616041] [DEBUG] [LOCAL ] MIR: Loaded 51163 existing records from primary storage. [2025-09-18T22:54:40.616893] [INFO ] [MAIN ] MIR: Loaded 51163 primary data records. [2025-09-18T22:54:40.948040] [DEBUG] [LOCAL ] MITT: Loaded 23196 existing records from primary storage. [2025-09-18T22:54:41.068911] [INFO ] [MAIN ] MITT: Loaded 23196 primary data records. [2025-09-18T22:54:41.449471] [DEBUG] [MAIN ] MITP: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:54:41.455872] [INFO ] [MAIN ] MITP: Generated 1806 derivative records from 2399 primary records. [2025-09-18T22:54:41.465055] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-09-18T22:54:41.481962] [DEBUG] [LOCAL ] MITP: Derivative data saved (1806 records). [2025-09-18T22:54:41.482971] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-09-18T22:54:41.485542] [INFO ] [MAIN ] Derivative Progress: 1174/2075 symbols completed. MITP took 1.1s. Estimated remaining: 5m 50s. Rate: 154.3 symbols/min [2025-09-18T22:54:41.487394] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:41.505271] [DEBUG] [MAIN ] MIR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:41.508056] [INFO ] [MAIN ] MIR: Generated 1807 derivative records from 51163 primary records. [2025-09-18T22:54:41.508280] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-09-18T22:54:41.525186] [DEBUG] [LOCAL ] MIY: Loaded 6085 existing records from primary storage. [2025-09-18T22:54:41.525525] [INFO ] [MAIN ] MIY: Loaded 6085 primary data records. [2025-09-18T22:54:41.566897] [DEBUG] [LOCAL ] MIR: Derivative data saved (1807 records). [2025-09-18T22:54:41.586347] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-09-18T22:54:41.589867] [INFO ] [MAIN ] Derivative Progress: 1175/2075 symbols completed. MIR took 1.2s. Estimated remaining: 5m 50s. Rate: 154.4 symbols/min [2025-09-18T22:54:41.635961] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:41.674353] [DEBUG] [MAIN ] MITT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:41.730587] [INFO ] [MAIN ] MITT: Generated 1807 derivative records from 23196 primary records. [2025-09-18T22:54:41.840912] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-09-18T22:54:41.874072] [DEBUG] [LOCAL ] MITT: Derivative data saved (1807 records). [2025-09-18T22:54:41.874415] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-09-18T22:54:41.877701] [INFO ] [MAIN ] Derivative Progress: 1176/2075 symbols completed. MITT took 1.3s. Estimated remaining: 5m 49s. Rate: 154.4 symbols/min [2025-09-18T22:54:41.878242] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:41.928043] [DEBUG] [MAIN ] MIY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:41.929340] [DEBUG] [LOCAL ] MKC: Loaded 52837 existing records from primary storage. [2025-09-18T22:54:41.930256] [INFO ] [MAIN ] MIY: Generated 1807 derivative records from 6085 primary records. [2025-09-18T22:54:41.930811] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-09-18T22:54:41.930929] [INFO ] [MAIN ] MKC: Loaded 52837 primary data records. [2025-09-18T22:54:42.077872] [DEBUG] [LOCAL ] MIY: Derivative data saved (1807 records). [2025-09-18T22:54:42.078248] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-09-18T22:54:42.101612] [INFO ] [MAIN ] Derivative Progress: 1177/2075 symbols completed. MIY took 0.6s. Estimated remaining: 5m 49s. Rate: 154.5 symbols/min [2025-09-18T22:54:42.135570] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:42.166106] [DEBUG] [LOCAL ] MLI: Loaded 44291 existing records from primary storage. [2025-09-18T22:54:42.166306] [INFO ] [MAIN ] MLI: Loaded 44291 primary data records. [2025-09-18T22:54:42.504039] [DEBUG] [LOCAL ] MLM: Loaded 31723 existing records from primary storage. [2025-09-18T22:54:42.628256] [INFO ] [MAIN ] MLM: Loaded 31723 primary data records. [2025-09-18T22:54:42.950136] [DEBUG] [MAIN ] MKC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:42.951083] [INFO ] [MAIN ] MKC: Generated 1807 derivative records from 52837 primary records. [2025-09-18T22:54:42.951434] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-09-18T22:54:42.973463] [DEBUG] [LOCAL ] MKC: Derivative data saved (1807 records). [2025-09-18T22:54:42.973839] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-09-18T22:54:42.983639] [INFO ] [MAIN ] Derivative Progress: 1178/2075 symbols completed. MKC took 1.4s. Estimated remaining: 5m 49s. Rate: 154.3 symbols/min [2025-09-18T22:54:42.988977] [DEBUG] [MAIN ] MLI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:42.989981] [INFO ] [MAIN ] MLI: Generated 1807 derivative records from 44291 primary records. [2025-09-18T22:54:42.990096] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:42.990244] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-09-18T22:54:43.008544] [DEBUG] [LOCAL ] MLI: Derivative data saved (1807 records). [2025-09-18T22:54:43.008751] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-09-18T22:54:43.011170] [INFO ] [MAIN ] Derivative Progress: 1179/2075 symbols completed. MLI took 1.1s. Estimated remaining: 5m 48s. Rate: 154.4 symbols/min [2025-09-18T22:54:43.011521] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:43.025756] [DEBUG] [LOCAL ] MLP: Loaded 3044 existing records from primary storage. [2025-09-18T22:54:43.045930] [DEBUG] [MAIN ] MLM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:43.045627] [INFO ] [MAIN ] MLP: Loaded 3044 primary data records. [2025-09-18T22:54:43.057796] [DEBUG] [LOCAL ] MLNK: Loaded 25971 existing records from primary storage. [2025-09-18T22:54:43.058493] [INFO ] [MAIN ] MLM: Generated 1807 derivative records from 31723 primary records. [2025-09-18T22:54:43.078461] [INFO ] [MAIN ] MLNK: Loaded 25971 primary data records. [2025-09-18T22:54:43.068223] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-09-18T22:54:43.363169] [DEBUG] [LOCAL ] MLM: Derivative data saved (1807 records). [2025-09-18T22:54:43.579197] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-09-18T22:54:43.697380] [INFO ] [MAIN ] Derivative Progress: 1180/2075 symbols completed. MLM took 1.6s. Estimated remaining: 5m 48s. Rate: 154.3 symbols/min [2025-09-18T22:54:43.712462] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:43.735360] [DEBUG] [LOCAL ] MLR: Loaded 13256 existing records from primary storage. [2025-09-18T22:54:43.736717] [INFO ] [MAIN ] MLR: Loaded 13256 primary data records. [2025-09-18T22:54:43.848548] [DEBUG] [MAIN ] MLP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:43.867940] [INFO ] [MAIN ] MLP: Generated 1807 derivative records from 3044 primary records. [2025-09-18T22:54:43.872981] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-09-18T22:54:43.883872] [DEBUG] [MAIN ] MLNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:43.914938] [INFO ] [MAIN ] MLNK: Generated 1807 derivative records from 25971 primary records. [2025-09-18T22:54:43.923714] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-09-18T22:54:44.097803] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1807 records). [2025-09-18T22:54:44.098808] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-09-18T22:54:44.101454] [INFO ] [MAIN ] Derivative Progress: 1181/2075 symbols completed. MLNK took 1.1s. Estimated remaining: 5m 48s. Rate: 154.3 symbols/min [2025-09-18T22:54:44.104155] [DEBUG] [LOCAL ] MLP: Derivative data saved (1807 records). [2025-09-18T22:54:44.104453] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-09-18T22:54:44.104545] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:44.106790] [INFO ] [MAIN ] Derivative Progress: 1182/2075 symbols completed. MLP took 1.1s. Estimated remaining: 5m 47s. Rate: 154.5 symbols/min [2025-09-18T22:54:44.108306] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:44.130457] [DEBUG] [LOCAL ] MMD: Loaded 11198 existing records from primary storage. [2025-09-18T22:54:44.130870] [INFO ] [MAIN ] MMD: Loaded 11198 primary data records. [2025-09-18T22:54:44.176217] [DEBUG] [MAIN ] MLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:44.206493] [DEBUG] [LOCAL ] MMI: Loaded 15493 existing records from primary storage. [2025-09-18T22:54:44.207264] [INFO ] [MAIN ] MLR: Generated 1807 derivative records from 13256 primary records. [2025-09-18T22:54:44.216901] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-09-18T22:54:44.216980] [INFO ] [MAIN ] MMI: Loaded 15493 primary data records. [2025-09-18T22:54:44.459034] [DEBUG] [LOCAL ] MLR: Derivative data saved (1807 records). [2025-09-18T22:54:44.593530] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-09-18T22:54:44.607799] [INFO ] [MAIN ] Derivative Progress: 1183/2075 symbols completed. MLR took 0.9s. Estimated remaining: 5m 47s. Rate: 154.4 symbols/min [2025-09-18T22:54:44.808503] [DEBUG] [MAIN ] MMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:44.809449] [INFO ] [MAIN ] MMD: Generated 1807 derivative records from 11198 primary records. [2025-09-18T22:54:44.809597] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-09-18T22:54:44.827811] [DEBUG] [LOCAL ] MMD: Derivative data saved (1807 records). [2025-09-18T22:54:44.839573] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-09-18T22:54:44.842081] [INFO ] [MAIN ] Derivative Progress: 1184/2075 symbols completed. MMD took 0.7s. Estimated remaining: 5m 46s. Rate: 154.5 symbols/min [2025-09-18T22:54:44.842394] [DEBUG] [MAIN ] MMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:44.843162] [INFO ] [MAIN ] MMI: Generated 1807 derivative records from 15493 primary records. [2025-09-18T22:54:44.843225] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-09-18T22:54:44.858572] [DEBUG] [LOCAL ] MMI: Derivative data saved (1807 records). [2025-09-18T22:54:44.858633] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-09-18T22:54:44.861201] [INFO ] [MAIN ] Derivative Progress: 1185/2075 symbols completed. MMI took 0.8s. Estimated remaining: 5m 45s. Rate: 154.6 symbols/min [2025-09-18T22:54:44.861757] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:44.861899] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:44.862029] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:44.881745] [DEBUG] [LOCAL ] MMT: Loaded 11565 existing records from primary storage. [2025-09-18T22:54:44.882185] [INFO ] [MAIN ] MMT: Loaded 11565 primary data records. [2025-09-18T22:54:44.926415] [DEBUG] [LOCAL ] MMU: Loaded 17176 existing records from primary storage. [2025-09-18T22:54:44.947061] [INFO ] [MAIN ] MMU: Loaded 17176 primary data records. [2025-09-18T22:54:45.202679] [DEBUG] [LOCAL ] MMS: Loaded 34432 existing records from primary storage. [2025-09-18T22:54:45.292951] [INFO ] [MAIN ] MMS: Loaded 34432 primary data records. [2025-09-18T22:54:45.898686] [DEBUG] [MAIN ] MMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:45.900628] [INFO ] [MAIN ] MMT: Generated 1807 derivative records from 11565 primary records. [2025-09-18T22:54:45.900758] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-09-18T22:54:45.927560] [DEBUG] [MAIN ] MMU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:45.929866] [INFO ] [MAIN ] MMU: Generated 1807 derivative records from 17176 primary records. [2025-09-18T22:54:45.930287] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-09-18T22:54:45.939926] [DEBUG] [LOCAL ] MMT: Derivative data saved (1807 records). [2025-09-18T22:54:45.943831] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-09-18T22:54:45.949179] [INFO ] [MAIN ] Derivative Progress: 1186/2075 symbols completed. MMT took 1.1s. Estimated remaining: 5m 46s. Rate: 154.4 symbols/min [2025-09-18T22:54:45.949894] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:45.950400] [DEBUG] [LOCAL ] MMU: Derivative data saved (1807 records). [2025-09-18T22:54:45.950917] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-09-18T22:54:45.953750] [INFO ] [MAIN ] Derivative Progress: 1187/2075 symbols completed. MMU took 1.1s. Estimated remaining: 5m 45s. Rate: 154.5 symbols/min [2025-09-18T22:54:45.954073] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:45.971534] [DEBUG] [MAIN ] MMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:45.972337] [INFO ] [MAIN ] MMS: Generated 1807 derivative records from 34432 primary records. [2025-09-18T22:54:45.972532] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-09-18T22:54:45.988524] [DEBUG] [LOCAL ] MMS: Derivative data saved (1807 records). [2025-09-18T22:54:45.994056] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-09-18T22:54:45.996907] [INFO ] [MAIN ] Derivative Progress: 1188/2075 symbols completed. MMS took 1.1s. Estimated remaining: 5m 44s. Rate: 154.6 symbols/min [2025-09-18T22:54:45.997259] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:46.008298] [DEBUG] [LOCAL ] MNR: Loaded 25053 existing records from primary storage. [2025-09-18T22:54:46.008583] [INFO ] [MAIN ] MNR: Loaded 25053 primary data records. [2025-09-18T22:54:46.204156] [DEBUG] [LOCAL ] MNSO: Loaded 44793 existing records from primary storage. [2025-09-18T22:54:46.206176] [INFO ] [MAIN ] MNSO: Loaded 44793 primary data records. [2025-09-18T22:54:46.425784] [DEBUG] [LOCAL ] MODG: Loaded 52004 existing records from primary storage. [2025-09-18T22:54:46.431585] [INFO ] [MAIN ] MODG: Loaded 52004 primary data records. [2025-09-18T22:54:47.046017] [DEBUG] [MAIN ] MNR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:47.047146] [INFO ] [MAIN ] MNR: Generated 1807 derivative records from 25053 primary records. [2025-09-18T22:54:47.047618] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-09-18T22:54:47.071101] [DEBUG] [LOCAL ] MNR: Derivative data saved (1807 records). [2025-09-18T22:54:47.071371] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-09-18T22:54:47.074232] [INFO ] [MAIN ] Derivative Progress: 1189/2075 symbols completed. MNR took 1.1s. Estimated remaining: 5m 44s. Rate: 154.4 symbols/min [2025-09-18T22:54:47.074478] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:47.092409] [DEBUG] [MAIN ] MNSO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:47.093327] [INFO ] [MAIN ] MNSO: Generated 1807 derivative records from 44793 primary records. [2025-09-18T22:54:47.093478] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-09-18T22:54:47.125470] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1807 records). [2025-09-18T22:54:47.125005] [DEBUG] [MAIN ] MODG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:47.126312] [INFO ] [MAIN ] MODG: Generated 1807 derivative records from 52004 primary records. [2025-09-18T22:54:47.126535] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-09-18T22:54:47.126473] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-09-18T22:54:47.129384] [INFO ] [MAIN ] Derivative Progress: 1190/2075 symbols completed. MNSO took 1.2s. Estimated remaining: 5m 44s. Rate: 154.5 symbols/min [2025-09-18T22:54:47.129640] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:47.154351] [DEBUG] [LOCAL ] MODG: Derivative data saved (1807 records). [2025-09-18T22:54:47.154532] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-09-18T22:54:47.157284] [INFO ] [MAIN ] Derivative Progress: 1191/2075 symbols completed. MODG took 1.2s. Estimated remaining: 5m 43s. Rate: 154.6 symbols/min [2025-09-18T22:54:47.157735] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:47.172290] [DEBUG] [LOCAL ] MOH: Loaded 42076 existing records from primary storage. [2025-09-18T22:54:47.172580] [INFO ] [MAIN ] MOH: Loaded 42076 primary data records. [2025-09-18T22:54:47.290397] [DEBUG] [LOCAL ] MOV: Loaded 22496 existing records from primary storage. [2025-09-18T22:54:47.311178] [INFO ] [MAIN ] MOV: Loaded 22496 primary data records. [2025-09-18T22:54:47.666263] [DEBUG] [LOCAL ] MOS: Loaded 53909 existing records from primary storage. [2025-09-18T22:54:47.705628] [INFO ] [MAIN ] MOS: Loaded 53909 primary data records. [2025-09-18T22:54:48.142598] [DEBUG] [MAIN ] MOH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:48.143891] [INFO ] [MAIN ] MOH: Generated 1807 derivative records from 42076 primary records. [2025-09-18T22:54:48.144078] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-09-18T22:54:48.177707] [DEBUG] [MAIN ] MOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:48.179063] [DEBUG] [LOCAL ] MOH: Derivative data saved (1807 records). [2025-09-18T22:54:48.179244] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-09-18T22:54:48.179944] [INFO ] [MAIN ] MOV: Generated 1807 derivative records from 22496 primary records. [2025-09-18T22:54:48.182560] [INFO ] [MAIN ] Derivative Progress: 1192/2075 symbols completed. MOH took 1.1s. Estimated remaining: 5m 43s. Rate: 154.4 symbols/min [2025-09-18T22:54:48.180183] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-09-18T22:54:48.182879] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:48.201300] [DEBUG] [LOCAL ] MOV: Derivative data saved (1807 records). [2025-09-18T22:54:48.201537] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-09-18T22:54:48.204749] [INFO ] [MAIN ] Derivative Progress: 1193/2075 symbols completed. MOV took 1.0s. Estimated remaining: 5m 42s. Rate: 154.5 symbols/min [2025-09-18T22:54:48.205988] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:48.210770] [DEBUG] [LOCAL ] MPA: Loaded 5277 existing records from primary storage. [2025-09-18T22:54:48.211111] [INFO ] [MAIN ] MPA: Loaded 5277 primary data records. [2025-09-18T22:54:48.266969] [DEBUG] [MAIN ] MOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:48.294060] [INFO ] [MAIN ] MOS: Generated 1807 derivative records from 53909 primary records. [2025-09-18T22:54:48.305480] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-09-18T22:54:48.561591] [DEBUG] [LOCAL ] MOS: Derivative data saved (1807 records). [2025-09-18T22:54:48.561890] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-09-18T22:54:48.564556] [INFO ] [MAIN ] Derivative Progress: 1194/2075 symbols completed. MOS took 1.4s. Estimated remaining: 5m 42s. Rate: 154.5 symbols/min [2025-09-18T22:54:48.565545] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:48.587636] [DEBUG] [LOCAL ] MPC: Loaded 52530 existing records from primary storage. [2025-09-18T22:54:48.587944] [INFO ] [MAIN ] MPC: Loaded 52530 primary data records. [2025-09-18T22:54:48.750566] [DEBUG] [MAIN ] MPA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:48.779327] [INFO ] [MAIN ] MPA: Generated 1807 derivative records from 5277 primary records. [2025-09-18T22:54:48.803183] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-09-18T22:54:48.953955] [DEBUG] [LOCAL ] MPLX: Loaded 51168 existing records from primary storage. [2025-09-18T22:54:48.956103] [INFO ] [MAIN ] MPLX: Loaded 51168 primary data records. [2025-09-18T22:54:48.957621] [DEBUG] [LOCAL ] MPA: Derivative data saved (1807 records). [2025-09-18T22:54:48.958127] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-09-18T22:54:48.960407] [INFO ] [MAIN ] Derivative Progress: 1195/2075 symbols completed. MPA took 0.8s. Estimated remaining: 5m 42s. Rate: 154.5 symbols/min [2025-09-18T22:54:48.965896] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:49.075731] [DEBUG] [LOCAL ] MPV: Loaded 5223 existing records from primary storage. [2025-09-18T22:54:49.091717] [INFO ] [MAIN ] MPV: Loaded 5223 primary data records. [2025-09-18T22:54:49.463046] [DEBUG] [MAIN ] MPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:49.519309] [INFO ] [MAIN ] MPC: Generated 1807 derivative records from 52530 primary records. [2025-09-18T22:54:49.519617] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-09-18T22:54:49.657325] [DEBUG] [LOCAL ] MPC: Derivative data saved (1807 records). [2025-09-18T22:54:49.657806] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-09-18T22:54:49.660276] [INFO ] [MAIN ] Derivative Progress: 1196/2075 symbols completed. MPC took 1.5s. Estimated remaining: 5m 42s. Rate: 154.4 symbols/min [2025-09-18T22:54:49.660939] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:49.679829] [DEBUG] [MAIN ] MPLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:49.680755] [INFO ] [MAIN ] MPLX: Generated 1807 derivative records from 51168 primary records. [2025-09-18T22:54:49.681002] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-09-18T22:54:49.712380] [DEBUG] [MAIN ] MPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:49.713845] [INFO ] [MAIN ] MPV: Generated 1807 derivative records from 5223 primary records. [2025-09-18T22:54:49.714008] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-09-18T22:54:49.715292] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1807 records). [2025-09-18T22:54:49.726430] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-09-18T22:54:49.729634] [DEBUG] [LOCAL ] MPV: Derivative data saved (1807 records). [2025-09-18T22:54:49.745313] [INFO ] [MAIN ] Derivative Progress: 1197/2075 symbols completed. MPLX took 1.2s. Estimated remaining: 5m 41s. Rate: 154.5 symbols/min [2025-09-18T22:54:49.745805] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:49.745448] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-09-18T22:54:49.749047] [INFO ] [MAIN ] Derivative Progress: 1198/2075 symbols completed. MPV took 0.8s. Estimated remaining: 5m 40s. Rate: 154.7 symbols/min [2025-09-18T22:54:49.756478] [DEBUG] [LOCAL ] MPX: Loaded 4318 existing records from primary storage. [2025-09-18T22:54:49.757355] [INFO ] [MAIN ] MPX: Loaded 4318 primary data records. [2025-09-18T22:54:49.877420] [DEBUG] [LOCAL ] MPW: Loaded 53890 existing records from primary storage. [2025-09-18T22:54:49.877611] [INFO ] [MAIN ] MPW: Loaded 53890 primary data records. [2025-09-18T22:54:50.423283] [DEBUG] [MAIN ] MPX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:50.425099] [INFO ] [MAIN ] MPX: Generated 1807 derivative records from 4318 primary records. [2025-09-18T22:54:50.426690] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-09-18T22:54:50.450711] [DEBUG] [MAIN ] MPW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:50.453127] [INFO ] [MAIN ] MPW: Generated 1807 derivative records from 53890 primary records. [2025-09-18T22:54:50.453434] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-09-18T22:54:50.463173] [DEBUG] [LOCAL ] MPX: Derivative data saved (1807 records). [2025-09-18T22:54:50.466677] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-09-18T22:54:50.468775] [INFO ] [MAIN ] Derivative Progress: 1199/2075 symbols completed. MPX took 0.7s. Estimated remaining: 5m 40s. Rate: 154.5 symbols/min [2025-09-18T22:54:50.473265] [DEBUG] [LOCAL ] MPW: Derivative data saved (1807 records). [2025-09-18T22:54:50.473336] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-09-18T22:54:50.475533] [INFO ] [MAIN ] Derivative Progress: 1200/2075 symbols completed. MPW took 0.8s. Estimated remaining: 5m 39s. Rate: 154.7 symbols/min [2025-09-18T22:54:50.476213] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:50.476256] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:50.476405] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:50.495945] [DEBUG] [LOCAL ] MQT: Loaded 8507 existing records from primary storage. [2025-09-18T22:54:50.496144] [INFO ] [MAIN ] MQT: Loaded 8507 primary data records. [2025-09-18T22:54:50.585801] [DEBUG] [LOCAL ] MQY: Loaded 16962 existing records from primary storage. [2025-09-18T22:54:50.603441] [INFO ] [MAIN ] MQY: Loaded 16962 primary data records. [2025-09-18T22:54:50.826730] [DEBUG] [LOCAL ] MRC: Loaded 37863 existing records from primary storage. [2025-09-18T22:54:50.826907] [INFO ] [MAIN ] MRC: Loaded 37863 primary data records. [2025-09-18T22:54:51.573188] [DEBUG] [MAIN ] MQT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:51.574394] [INFO ] [MAIN ] MQT: Generated 1807 derivative records from 8507 primary records. [2025-09-18T22:54:51.574615] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-09-18T22:54:51.606368] [DEBUG] [MAIN ] MQY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:51.608304] [INFO ] [MAIN ] MQY: Generated 1807 derivative records from 16962 primary records. [2025-09-18T22:54:51.609721] [DEBUG] [LOCAL ] MQT: Derivative data saved (1807 records). [2025-09-18T22:54:51.609871] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-09-18T22:54:51.612235] [INFO ] [MAIN ] Derivative Progress: 1201/2075 symbols completed. MQT took 1.1s. Estimated remaining: 5m 40s. Rate: 154.4 symbols/min [2025-09-18T22:54:51.609631] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-09-18T22:54:51.615136] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:51.641620] [DEBUG] [MAIN ] MRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:51.645524] [INFO ] [MAIN ] MRC: Generated 1807 derivative records from 37863 primary records. [2025-09-18T22:54:51.644724] [DEBUG] [LOCAL ] MQY: Derivative data saved (1807 records). [2025-09-18T22:54:51.646049] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-09-18T22:54:51.646177] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-09-18T22:54:51.649157] [INFO ] [MAIN ] Derivative Progress: 1202/2075 symbols completed. MQY took 1.2s. Estimated remaining: 5m 39s. Rate: 154.5 symbols/min [2025-09-18T22:54:51.649879] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:51.667521] [DEBUG] [LOCAL ] MRC: Derivative data saved (1807 records). [2025-09-18T22:54:51.667597] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-09-18T22:54:51.670012] [INFO ] [MAIN ] Derivative Progress: 1203/2075 symbols completed. MRC took 1.2s. Estimated remaining: 5m 38s. Rate: 154.7 symbols/min [2025-09-18T22:54:51.670523] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:51.685285] [DEBUG] [LOCAL ] MSB: Loaded 7972 existing records from primary storage. [2025-09-18T22:54:51.685425] [INFO ] [MAIN ] MSB: Loaded 7972 primary data records. [2025-09-18T22:54:51.755883] [DEBUG] [LOCAL ] MSA: Loaded 18855 existing records from primary storage. [2025-09-18T22:54:51.778262] [INFO ] [MAIN ] MSA: Loaded 18855 primary data records. [2025-09-18T22:54:52.044921] [DEBUG] [LOCAL ] MS: Loaded 54082 existing records from primary storage. [2025-09-18T22:54:52.065831] [INFO ] [MAIN ] MS: Loaded 54082 primary data records. [2025-09-18T22:54:52.728199] [DEBUG] [MAIN ] MSB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:52.731328] [INFO ] [MAIN ] MSB: Generated 1807 derivative records from 7972 primary records. [2025-09-18T22:54:52.731548] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-09-18T22:54:52.746864] [DEBUG] [MAIN ] MSA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:52.759432] [INFO ] [MAIN ] MSA: Generated 1807 derivative records from 18855 primary records. [2025-09-18T22:54:52.761227] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-09-18T22:54:52.777731] [DEBUG] [LOCAL ] MSB: Derivative data saved (1807 records). [2025-09-18T22:54:52.781074] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-09-18T22:54:52.783586] [INFO ] [MAIN ] Derivative Progress: 1204/2075 symbols completed. MSB took 1.1s. Estimated remaining: 5m 38s. Rate: 154.4 symbols/min [2025-09-18T22:54:52.786395] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:52.801585] [DEBUG] [LOCAL ] MSA: Derivative data saved (1807 records). [2025-09-18T22:54:52.801996] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-09-18T22:54:52.804915] [INFO ] [MAIN ] Derivative Progress: 1205/2075 symbols completed. MSA took 1.2s. Estimated remaining: 5m 38s. Rate: 154.5 symbols/min [2025-09-18T22:54:52.802284] [DEBUG] [MAIN ] MS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:52.806036] [INFO ] [MAIN ] MS: Generated 1807 derivative records from 54082 primary records. [2025-09-18T22:54:52.806145] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-09-18T22:54:52.807332] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:52.829114] [DEBUG] [LOCAL ] MS: Derivative data saved (1807 records). [2025-09-18T22:54:52.829340] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-09-18T22:54:52.831788] [INFO ] [MAIN ] Derivative Progress: 1206/2075 symbols completed. MS took 1.2s. Estimated remaining: 5m 37s. Rate: 154.7 symbols/min [2025-09-18T22:54:52.832251] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:52.839639] [DEBUG] [LOCAL ] MSD: Loaded 15767 existing records from primary storage. [2025-09-18T22:54:52.839797] [INFO ] [MAIN ] MSD: Loaded 15767 primary data records. [2025-09-18T22:54:53.209900] [DEBUG] [LOCAL ] MSCI: Loaded 35155 existing records from primary storage. [2025-09-18T22:54:53.220091] [INFO ] [MAIN ] MSCI: Loaded 35155 primary data records. [2025-09-18T22:54:53.267026] [DEBUG] [LOCAL ] MSDL: Loaded 38441 existing records from primary storage. [2025-09-18T22:54:53.280845] [INFO ] [MAIN ] MSDL: Loaded 38441 primary data records. [2025-09-18T22:54:53.926885] [DEBUG] [MAIN ] MSD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:53.929201] [INFO ] [MAIN ] MSD: Generated 1807 derivative records from 15767 primary records. [2025-09-18T22:54:53.930177] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-09-18T22:54:53.961985] [DEBUG] [LOCAL ] MSD: Derivative data saved (1807 records). [2025-09-18T22:54:53.968457] [DEBUG] [MAIN ] MSCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:53.968921] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-09-18T22:54:53.969700] [INFO ] [MAIN ] MSCI: Generated 1807 derivative records from 35155 primary records. [2025-09-18T22:54:53.972315] [INFO ] [MAIN ] Derivative Progress: 1207/2075 symbols completed. MSD took 1.2s. Estimated remaining: 5m 37s. Rate: 154.4 symbols/min [2025-09-18T22:54:53.972591] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-09-18T22:54:53.973510] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:54.013356] [DEBUG] [MAIN ] MSDL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:54.015250] [INFO ] [MAIN ] MSDL: Generated 1807 derivative records from 38441 primary records. [2025-09-18T22:54:54.015826] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-09-18T22:54:54.026978] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1807 records). [2025-09-18T22:54:54.031705] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-09-18T22:54:54.042595] [INFO ] [MAIN ] Derivative Progress: 1208/2075 symbols completed. MSCI took 1.3s. Estimated remaining: 5m 37s. Rate: 154.5 symbols/min [2025-09-18T22:54:54.043625] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:54.058042] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1807 records). [2025-09-18T22:54:54.058218] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-09-18T22:54:54.061393] [INFO ] [MAIN ] Derivative Progress: 1209/2075 symbols completed. MSDL took 1.2s. Estimated remaining: 5m 36s. Rate: 154.6 symbols/min [2025-09-18T22:54:54.062403] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:54.062290] [DEBUG] [LOCAL ] MSGE: Loaded 27326 existing records from primary storage. [2025-09-18T22:54:54.062972] [INFO ] [MAIN ] MSGE: Loaded 27326 primary data records. [2025-09-18T22:54:54.170726] [DEBUG] [LOCAL ] MSGS: Loaded 16933 existing records from primary storage. [2025-09-18T22:54:54.182985] [INFO ] [MAIN ] MSGS: Loaded 16933 primary data records. [2025-09-18T22:54:54.570705] [DEBUG] [LOCAL ] MSI: Loaded 40955 existing records from primary storage. [2025-09-18T22:54:54.584633] [INFO ] [MAIN ] MSI: Loaded 40955 primary data records. [2025-09-18T22:54:55.090115] [DEBUG] [MAIN ] MSGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:55.092347] [INFO ] [MAIN ] MSGE: Generated 1807 derivative records from 27326 primary records. [2025-09-18T22:54:55.093113] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-09-18T22:54:55.131498] [DEBUG] [MAIN ] MSGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:55.133241] [INFO ] [MAIN ] MSGS: Generated 1807 derivative records from 16933 primary records. [2025-09-18T22:54:55.133782] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-09-18T22:54:55.133866] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1807 records). [2025-09-18T22:54:55.135111] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-09-18T22:54:55.137568] [INFO ] [MAIN ] Derivative Progress: 1210/2075 symbols completed. MSGE took 1.2s. Estimated remaining: 5m 36s. Rate: 154.4 symbols/min [2025-09-18T22:54:55.145787] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:55.155903] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1807 records). [2025-09-18T22:54:55.156235] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-09-18T22:54:55.159197] [INFO ] [MAIN ] Derivative Progress: 1211/2075 symbols completed. MSGS took 1.1s. Estimated remaining: 5m 35s. Rate: 154.5 symbols/min [2025-09-18T22:54:55.159815] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:55.178387] [DEBUG] [MAIN ] MSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:55.179499] [INFO ] [MAIN ] MSI: Generated 1807 derivative records from 40955 primary records. [2025-09-18T22:54:55.179680] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-09-18T22:54:55.202992] [DEBUG] [LOCAL ] MSI: Derivative data saved (1807 records). [2025-09-18T22:54:55.212041] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-09-18T22:54:55.214831] [INFO ] [MAIN ] Derivative Progress: 1212/2075 symbols completed. MSI took 1.2s. Estimated remaining: 5m 35s. Rate: 154.6 symbols/min [2025-09-18T22:54:55.215352] [INFO ] [MAIN ] MTAL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:55.245755] [DEBUG] [LOCAL ] MSM: Loaded 35589 existing records from primary storage. [2025-09-18T22:54:55.246039] [INFO ] [MAIN ] MSM: Loaded 35589 primary data records. [2025-09-18T22:54:55.390758] [DEBUG] [LOCAL ] MT: Loaded 51235 existing records from primary storage. [2025-09-18T22:54:55.408188] [INFO ] [MAIN ] MT: Loaded 51235 primary data records. [2025-09-18T22:54:55.730866] [DEBUG] [LOCAL ] MTAL: Loaded 36390 existing records from primary storage. [2025-09-18T22:54:55.758952] [INFO ] [MAIN ] MTAL: Loaded 36390 primary data records. [2025-09-18T22:54:56.316479] [DEBUG] [MAIN ] MSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:56.321570] [INFO ] [MAIN ] MSM: Generated 1807 derivative records from 35589 primary records. [2025-09-18T22:54:56.321896] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-09-18T22:54:56.348511] [DEBUG] [MAIN ] MT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:56.349393] [INFO ] [MAIN ] MT: Generated 1807 derivative records from 51235 primary records. [2025-09-18T22:54:56.351704] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-09-18T22:54:56.354636] [DEBUG] [LOCAL ] MSM: Derivative data saved (1807 records). [2025-09-18T22:54:56.356444] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-09-18T22:54:56.372279] [INFO ] [MAIN ] Derivative Progress: 1213/2075 symbols completed. MSM took 1.2s. Estimated remaining: 5m 35s. Rate: 154.4 symbols/min [2025-09-18T22:54:56.388625] [DEBUG] [MAIN ] MTAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:56.390304] [INFO ] [MAIN ] MTAL: Generated 1807 derivative records from 36390 primary records. [2025-09-18T22:54:56.390576] [DEBUG] [LOCAL ] MTAL: Saving derivative data. [2025-09-18T22:54:56.391594] [DEBUG] [LOCAL ] MT: Derivative data saved (1807 records). [2025-09-18T22:54:56.392013] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-09-18T22:54:56.394787] [INFO ] [MAIN ] Derivative Progress: 1214/2075 symbols completed. MT took 1.2s. Estimated remaining: 5m 34s. Rate: 154.5 symbols/min [2025-09-18T22:54:56.411970] [DEBUG] [LOCAL ] MTAL: Derivative data saved (1807 records). [2025-09-18T22:54:56.412129] [INFO ] [MAIN ] MTAL: Successfully saved derivative data. [2025-09-18T22:54:56.414689] [INFO ] [MAIN ] Derivative Progress: 1215/2075 symbols completed. MTAL took 1.2s. Estimated remaining: 5m 34s. Rate: 154.6 symbols/min [2025-09-18T22:54:56.416124] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:56.415884] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:56.415987] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:56.443683] [DEBUG] [LOCAL ] MTD: Loaded 15446 existing records from primary storage. [2025-09-18T22:54:56.443852] [INFO ] [MAIN ] MTD: Loaded 15446 primary data records. [2025-09-18T22:54:56.799393] [DEBUG] [LOCAL ] MTDR: Loaded 51956 existing records from primary storage. [2025-09-18T22:54:56.812904] [INFO ] [MAIN ] MTDR: Loaded 51956 primary data records. [2025-09-18T22:54:56.814928] [DEBUG] [LOCAL ] MTB: Loaded 47605 existing records from primary storage. [2025-09-18T22:54:56.837138] [INFO ] [MAIN ] MTB: Loaded 47605 primary data records. [2025-09-18T22:54:57.525358] [DEBUG] [MAIN ] MTD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:57.526749] [INFO ] [MAIN ] MTD: Generated 1807 derivative records from 15446 primary records. [2025-09-18T22:54:57.527100] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-09-18T22:54:57.561136] [DEBUG] [LOCAL ] MTD: Derivative data saved (1807 records). [2025-09-18T22:54:57.562033] [DEBUG] [MAIN ] MTDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:57.562845] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-09-18T22:54:57.565829] [INFO ] [MAIN ] Derivative Progress: 1216/2075 symbols completed. MTD took 1.2s. Estimated remaining: 5m 34s. Rate: 154.4 symbols/min [2025-09-18T22:54:57.562769] [INFO ] [MAIN ] MTDR: Generated 1807 derivative records from 51956 primary records. [2025-09-18T22:54:57.565997] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-09-18T22:54:57.567255] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:57.600225] [DEBUG] [MAIN ] MTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:57.602136] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1807 records). [2025-09-18T22:54:57.601960] [INFO ] [MAIN ] MTB: Generated 1807 derivative records from 47605 primary records. [2025-09-18T22:54:57.602238] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-09-18T22:54:57.602624] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-09-18T22:54:57.605147] [INFO ] [MAIN ] Derivative Progress: 1217/2075 symbols completed. MTDR took 1.2s. Estimated remaining: 5m 33s. Rate: 154.5 symbols/min [2025-09-18T22:54:57.605742] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:57.625880] [DEBUG] [LOCAL ] MTB: Derivative data saved (1807 records). [2025-09-18T22:54:57.626157] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-09-18T22:54:57.628877] [INFO ] [MAIN ] Derivative Progress: 1218/2075 symbols completed. MTB took 1.2s. Estimated remaining: 5m 33s. Rate: 154.6 symbols/min [2025-09-18T22:54:57.629302] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:57.694928] [DEBUG] [LOCAL ] MTG: Loaded 51744 existing records from primary storage. [2025-09-18T22:54:57.695258] [INFO ] [MAIN ] MTG: Loaded 51744 primary data records. [2025-09-18T22:54:57.693687] [DEBUG] [LOCAL ] MTH: Loaded 44331 existing records from primary storage. [2025-09-18T22:54:57.695475] [INFO ] [MAIN ] MTH: Loaded 44331 primary data records. [2025-09-18T22:54:57.926592] [DEBUG] [LOCAL ] MTN: Loaded 39301 existing records from primary storage. [2025-09-18T22:54:57.937952] [INFO ] [MAIN ] MTN: Loaded 39301 primary data records. [2025-09-18T22:54:58.671283] [DEBUG] [MAIN ] MTH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:58.673115] [INFO ] [MAIN ] MTH: Generated 1807 derivative records from 44331 primary records. [2025-09-18T22:54:58.674249] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-09-18T22:54:58.695875] [DEBUG] [MAIN ] MTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:58.701230] [INFO ] [MAIN ] MTG: Generated 1807 derivative records from 51744 primary records. [2025-09-18T22:54:58.701594] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-09-18T22:54:58.722359] [DEBUG] [LOCAL ] MTG: Derivative data saved (1807 records). [2025-09-18T22:54:58.723536] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-09-18T22:54:58.727221] [INFO ] [MAIN ] Derivative Progress: 1219/2075 symbols completed. MTG took 1.2s. Estimated remaining: 5m 33s. Rate: 154.4 symbols/min [2025-09-18T22:54:58.727904] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:58.729275] [DEBUG] [LOCAL ] MTH: Derivative data saved (1807 records). [2025-09-18T22:54:58.742467] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-09-18T22:54:58.742812] [DEBUG] [MAIN ] MTN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:58.743755] [INFO ] [MAIN ] MTN: Generated 1807 derivative records from 39301 primary records. [2025-09-18T22:54:58.746195] [INFO ] [MAIN ] Derivative Progress: 1220/2075 symbols completed. MTH took 1.1s. Estimated remaining: 5m 32s. Rate: 154.5 symbols/min [2025-09-18T22:54:58.746723] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:58.746803] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-09-18T22:54:58.764582] [DEBUG] [LOCAL ] MTN: Derivative data saved (1807 records). [2025-09-18T22:54:58.764848] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-09-18T22:54:58.767488] [INFO ] [MAIN ] Derivative Progress: 1221/2075 symbols completed. MTN took 1.1s. Estimated remaining: 5m 31s. Rate: 154.6 symbols/min [2025-09-18T22:54:58.767982] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:58.781568] [DEBUG] [LOCAL ] MTRN: Loaded 18110 existing records from primary storage. [2025-09-18T22:54:58.781916] [INFO ] [MAIN ] MTRN: Loaded 18110 primary data records. [2025-09-18T22:54:58.904110] [DEBUG] [LOCAL ] MTUS: Loaded 29230 existing records from primary storage. [2025-09-18T22:54:58.916675] [INFO ] [MAIN ] MTUS: Loaded 29230 primary data records. [2025-09-18T22:54:59.086551] [DEBUG] [LOCAL ] MTW: Loaded 26862 existing records from primary storage. [2025-09-18T22:54:59.228546] [INFO ] [MAIN ] MTW: Loaded 26862 primary data records. [2025-09-18T22:54:59.871261] [DEBUG] [MAIN ] MTRN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:59.872260] [INFO ] [MAIN ] MTRN: Generated 1807 derivative records from 18110 primary records. [2025-09-18T22:54:59.872440] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-09-18T22:54:59.898549] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1807 records). [2025-09-18T22:54:59.899757] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-09-18T22:54:59.902471] [INFO ] [MAIN ] Derivative Progress: 1222/2075 symbols completed. MTRN took 1.2s. Estimated remaining: 5m 32s. Rate: 154.4 symbols/min [2025-09-18T22:54:59.917330] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:59.917717] [DEBUG] [MAIN ] MTUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:59.931627] [DEBUG] [MAIN ] MTW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:54:59.934492] [INFO ] [MAIN ] MTW: Generated 1807 derivative records from 26862 primary records. [2025-09-18T22:54:59.934723] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-09-18T22:54:59.933490] [INFO ] [MAIN ] MTUS: Generated 1807 derivative records from 29230 primary records. [2025-09-18T22:54:59.935676] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-09-18T22:54:59.968283] [DEBUG] [LOCAL ] MTW: Derivative data saved (1807 records). [2025-09-18T22:54:59.969408] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-09-18T22:54:59.973510] [INFO ] [MAIN ] Derivative Progress: 1223/2075 symbols completed. MTW took 1.2s. Estimated remaining: 5m 31s. Rate: 154.5 symbols/min [2025-09-18T22:54:59.979997] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:59.981754] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1807 records). [2025-09-18T22:54:59.982083] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-09-18T22:54:59.985061] [INFO ] [MAIN ] Derivative Progress: 1224/2075 symbols completed. MTUS took 1.2s. Estimated remaining: 5m 30s. Rate: 154.6 symbols/min [2025-09-18T22:54:59.985511] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:54:59.994046] [DEBUG] [LOCAL ] MTX: Loaded 23011 existing records from primary storage. [2025-09-18T22:54:59.994286] [INFO ] [MAIN ] MTX: Loaded 23011 primary data records. [2025-09-18T22:55:00.111107] [DEBUG] [LOCAL ] MUA: Loaded 12502 existing records from primary storage. [2025-09-18T22:55:00.132771] [INFO ] [MAIN ] MUA: Loaded 12502 primary data records. [2025-09-18T22:55:00.475018] [DEBUG] [LOCAL ] MTZ: Loaded 43951 existing records from primary storage. [2025-09-18T22:55:00.504335] [INFO ] [MAIN ] MTZ: Loaded 43951 primary data records. [2025-09-18T22:55:00.984518] [DEBUG] [MAIN ] MTX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:00.986935] [INFO ] [MAIN ] MTX: Generated 1807 derivative records from 23011 primary records. [2025-09-18T22:55:00.987051] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-09-18T22:55:01.021812] [DEBUG] [MAIN ] MUA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:01.023930] [INFO ] [MAIN ] MUA: Generated 1807 derivative records from 12502 primary records. [2025-09-18T22:55:01.023150] [DEBUG] [LOCAL ] MTX: Derivative data saved (1807 records). [2025-09-18T22:55:01.024328] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-09-18T22:55:01.027330] [INFO ] [MAIN ] Derivative Progress: 1225/2075 symbols completed. MTX took 1.1s. Estimated remaining: 5m 30s. Rate: 154.4 symbols/min [2025-09-18T22:55:01.024427] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-09-18T22:55:01.028718] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:01.047712] [DEBUG] [LOCAL ] MUA: Derivative data saved (1807 records). [2025-09-18T22:55:01.048742] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-09-18T22:55:01.052118] [INFO ] [MAIN ] Derivative Progress: 1226/2075 symbols completed. MUA took 1.1s. Estimated remaining: 5m 30s. Rate: 154.5 symbols/min [2025-09-18T22:55:01.053605] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:01.075097] [DEBUG] [MAIN ] MTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:01.085075] [INFO ] [MAIN ] MTZ: Generated 1807 derivative records from 43951 primary records. [2025-09-18T22:55:01.085364] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-09-18T22:55:01.118845] [DEBUG] [LOCAL ] MUE: Loaded 12020 existing records from primary storage. [2025-09-18T22:55:01.121461] [INFO ] [MAIN ] MUE: Loaded 12020 primary data records. [2025-09-18T22:55:01.128906] [DEBUG] [LOCAL ] MUC: Loaded 20267 existing records from primary storage. [2025-09-18T22:55:01.164457] [INFO ] [MAIN ] MUC: Loaded 20267 primary data records. [2025-09-18T22:55:01.299780] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1807 records). [2025-09-18T22:55:01.349705] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-09-18T22:55:01.408611] [INFO ] [MAIN ] Derivative Progress: 1227/2075 symbols completed. MTZ took 1.4s. Estimated remaining: 5m 29s. Rate: 154.5 symbols/min [2025-09-18T22:55:01.477820] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:01.967095] [DEBUG] [MAIN ] MUE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:01.970313] [INFO ] [MAIN ] MUE: Generated 1807 derivative records from 12020 primary records. [2025-09-18T22:55:01.970780] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-09-18T22:55:02.004631] [DEBUG] [LOCAL ] MUE: Derivative data saved (1807 records). [2025-09-18T22:55:02.004925] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-09-18T22:55:02.007494] [INFO ] [MAIN ] Derivative Progress: 1228/2075 symbols completed. MUE took 1.0s. Estimated remaining: 5m 29s. Rate: 154.5 symbols/min [2025-09-18T22:55:02.009202] [DEBUG] [LOCAL ] MUFG: Loaded 53032 existing records from primary storage. [2025-09-18T22:55:02.010234] [INFO ] [MAIN ] MUFG: Loaded 53032 primary data records. [2025-09-18T22:55:02.164954] [DEBUG] [MAIN ] MUC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:02.181176] [INFO ] [MAIN ] MUC: Generated 1807 derivative records from 20267 primary records. [2025-09-18T22:55:02.194371] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-09-18T22:55:02.382222] [DEBUG] [LOCAL ] MUC: Derivative data saved (1807 records). [2025-09-18T22:55:02.382508] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-09-18T22:55:02.385538] [INFO ] [MAIN ] Derivative Progress: 1229/2075 symbols completed. MUC took 1.4s. Estimated remaining: 5m 29s. Rate: 154.5 symbols/min [2025-09-18T22:55:02.409874] [DEBUG] [MAIN ] MUFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:02.410558] [INFO ] [MAIN ] MUFG: Generated 1807 derivative records from 53032 primary records. [2025-09-18T22:55:02.410622] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-09-18T22:55:02.428316] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1807 records). [2025-09-18T22:55:02.428412] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-09-18T22:55:02.430670] [INFO ] [MAIN ] Derivative Progress: 1230/2075 symbols completed. MUFG took 1.0s. Estimated remaining: 5m 28s. Rate: 154.6 symbols/min [2025-09-18T22:55:02.431446] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:02.431689] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:02.431833] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:02.450149] [DEBUG] [LOCAL ] MUJ: Loaded 13307 existing records from primary storage. [2025-09-18T22:55:02.450385] [INFO ] [MAIN ] MUJ: Loaded 13307 primary data records. [2025-09-18T22:55:02.604218] [DEBUG] [LOCAL ] MUSA: Loaded 25316 existing records from primary storage. [2025-09-18T22:55:02.605041] [INFO ] [MAIN ] MUSA: Loaded 25316 primary data records. [2025-09-18T22:55:02.925171] [DEBUG] [LOCAL ] MUR: Loaded 53332 existing records from primary storage. [2025-09-18T22:55:02.944039] [INFO ] [MAIN ] MUR: Loaded 53332 primary data records. [2025-09-18T22:55:03.510200] [DEBUG] [MAIN ] MUJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:03.511819] [INFO ] [MAIN ] MUJ: Generated 1807 derivative records from 13307 primary records. [2025-09-18T22:55:03.511956] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-09-18T22:55:03.547332] [DEBUG] [MAIN ] MUSA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:03.546599] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1807 records). [2025-09-18T22:55:03.547700] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-09-18T22:55:03.550040] [INFO ] [MAIN ] Derivative Progress: 1231/2075 symbols completed. MUJ took 1.1s. Estimated remaining: 5m 28s. Rate: 154.3 symbols/min [2025-09-18T22:55:03.550966] [INFO ] [MAIN ] MUSA: Generated 1807 derivative records from 25316 primary records. [2025-09-18T22:55:03.551816] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-09-18T22:55:03.551879] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:03.585863] [DEBUG] [MAIN ] MUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:03.589436] [INFO ] [MAIN ] MUR: Generated 1807 derivative records from 53332 primary records. [2025-09-18T22:55:03.590351] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-09-18T22:55:03.592286] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1807 records). [2025-09-18T22:55:03.592405] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-09-18T22:55:03.595269] [INFO ] [MAIN ] Derivative Progress: 1232/2075 symbols completed. MUSA took 1.2s. Estimated remaining: 5m 27s. Rate: 154.4 symbols/min [2025-09-18T22:55:03.607463] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:03.624401] [DEBUG] [LOCAL ] MUR: Derivative data saved (1807 records). [2025-09-18T22:55:03.624571] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-09-18T22:55:03.627181] [INFO ] [MAIN ] Derivative Progress: 1233/2075 symbols completed. MUR took 1.2s. Estimated remaining: 5m 27s. Rate: 154.6 symbols/min [2025-09-18T22:55:03.631177] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:03.638314] [DEBUG] [LOCAL ] MVF: Loaded 13036 existing records from primary storage. [2025-09-18T22:55:03.638540] [INFO ] [MAIN ] MVF: Loaded 13036 primary data records. [2025-09-18T22:55:03.732216] [DEBUG] [LOCAL ] MVO: Loaded 9152 existing records from primary storage. [2025-09-18T22:55:03.773067] [DEBUG] [LOCAL ] MUX: Loaded 42565 existing records from primary storage. [2025-09-18T22:55:03.767770] [INFO ] [MAIN ] MVO: Loaded 9152 primary data records. [2025-09-18T22:55:03.804357] [INFO ] [MAIN ] MUX: Loaded 42565 primary data records. [2025-09-18T22:55:04.669051] [DEBUG] [MAIN ] MVF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:04.670055] [INFO ] [MAIN ] MVF: Generated 1807 derivative records from 13036 primary records. [2025-09-18T22:55:04.670235] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-09-18T22:55:04.717486] [DEBUG] [LOCAL ] MVF: Derivative data saved (1807 records). [2025-09-18T22:55:04.717414] [DEBUG] [MAIN ] MUX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:04.717839] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-09-18T22:55:04.718586] [INFO ] [MAIN ] MUX: Generated 1807 derivative records from 42565 primary records. [2025-09-18T22:55:04.718999] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-09-18T22:55:04.718947] [DEBUG] [MAIN ] MVO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:04.720388] [INFO ] [MAIN ] MVO: Generated 1807 derivative records from 9152 primary records. [2025-09-18T22:55:04.722832] [INFO ] [MAIN ] Derivative Progress: 1234/2075 symbols completed. MVF took 1.1s. Estimated remaining: 5m 27s. Rate: 154.3 symbols/min [2025-09-18T22:55:04.730556] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-09-18T22:55:04.730795] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:04.752587] [DEBUG] [LOCAL ] MVO: Derivative data saved (1807 records). [2025-09-18T22:55:04.753265] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-09-18T22:55:04.759170] [INFO ] [MAIN ] Derivative Progress: 1235/2075 symbols completed. MVO took 1.1s. Estimated remaining: 5m 26s. Rate: 154.4 symbols/min [2025-09-18T22:55:04.760588] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:04.761446] [DEBUG] [LOCAL ] MUX: Derivative data saved (1807 records). [2025-09-18T22:55:04.761677] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-09-18T22:55:04.764442] [INFO ] [MAIN ] Derivative Progress: 1236/2075 symbols completed. MUX took 1.2s. Estimated remaining: 5m 26s. Rate: 154.6 symbols/min [2025-09-18T22:55:04.769506] [DEBUG] [LOCAL ] MVT: Loaded 10161 existing records from primary storage. [2025-09-18T22:55:04.769816] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:04.769631] [INFO ] [MAIN ] MVT: Loaded 10161 primary data records. [2025-09-18T22:55:05.090389] [DEBUG] [LOCAL ] MX: Loaded 23141 existing records from primary storage. [2025-09-18T22:55:05.100790] [INFO ] [MAIN ] MX: Loaded 23141 primary data records. [2025-09-18T22:55:05.213633] [DEBUG] [LOCAL ] MWA: Loaded 47595 existing records from primary storage. [2025-09-18T22:55:05.225093] [INFO ] [MAIN ] MWA: Loaded 47595 primary data records. [2025-09-18T22:55:05.803250] [DEBUG] [MAIN ] MVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:05.805056] [INFO ] [MAIN ] MVT: Generated 1807 derivative records from 10161 primary records. [2025-09-18T22:55:05.805297] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-09-18T22:55:05.829276] [DEBUG] [LOCAL ] MVT: Derivative data saved (1807 records). [2025-09-18T22:55:05.830052] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-09-18T22:55:05.832388] [INFO ] [MAIN ] Derivative Progress: 1237/2075 symbols completed. MVT took 1.1s. Estimated remaining: 5m 26s. Rate: 154.4 symbols/min [2025-09-18T22:55:05.834159] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:05.851385] [DEBUG] [MAIN ] MX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:05.854008] [INFO ] [MAIN ] MX: Generated 1807 derivative records from 23141 primary records. [2025-09-18T22:55:05.854458] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-09-18T22:55:05.866896] [DEBUG] [LOCAL ] MXF: Loaded 6134 existing records from primary storage. [2025-09-18T22:55:05.867992] [INFO ] [MAIN ] MXF: Loaded 6134 primary data records. [2025-09-18T22:55:05.946441] [DEBUG] [LOCAL ] MX: Derivative data saved (1807 records). [2025-09-18T22:55:05.968013] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-09-18T22:55:05.986861] [INFO ] [MAIN ] Derivative Progress: 1238/2075 symbols completed. MX took 1.2s. Estimated remaining: 5m 25s. Rate: 154.4 symbols/min [2025-09-18T22:55:05.998917] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:05.987130] [DEBUG] [MAIN ] MWA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:06.000307] [INFO ] [MAIN ] MWA: Generated 1807 derivative records from 47595 primary records. [2025-09-18T22:55:06.000881] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-09-18T22:55:06.231430] [DEBUG] [LOCAL ] MYD: Loaded 13935 existing records from primary storage. [2025-09-18T22:55:06.233681] [DEBUG] [LOCAL ] MWA: Derivative data saved (1807 records). [2025-09-18T22:55:06.234084] [INFO ] [MAIN ] MYD: Loaded 13935 primary data records. [2025-09-18T22:55:06.234227] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-09-18T22:55:06.238059] [INFO ] [MAIN ] Derivative Progress: 1239/2075 symbols completed. MWA took 1.5s. Estimated remaining: 5m 25s. Rate: 154.5 symbols/min [2025-09-18T22:55:06.272072] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:06.572549] [DEBUG] [LOCAL ] MYE: Loaded 25748 existing records from primary storage. [2025-09-18T22:55:06.574313] [INFO ] [MAIN ] MYE: Loaded 25748 primary data records. [2025-09-18T22:55:06.697940] [DEBUG] [MAIN ] MXF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:06.709610] [INFO ] [MAIN ] MXF: Generated 1807 derivative records from 6134 primary records. [2025-09-18T22:55:06.741029] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-09-18T22:55:06.923088] [DEBUG] [LOCAL ] MXF: Derivative data saved (1807 records). [2025-09-18T22:55:06.923692] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-09-18T22:55:06.926214] [INFO ] [MAIN ] Derivative Progress: 1240/2075 symbols completed. MXF took 1.1s. Estimated remaining: 5m 25s. Rate: 154.4 symbols/min [2025-09-18T22:55:06.926917] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:06.940679] [DEBUG] [MAIN ] MYD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:06.941467] [INFO ] [MAIN ] MYD: Generated 1807 derivative records from 13935 primary records. [2025-09-18T22:55:06.941718] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-09-18T22:55:06.960559] [DEBUG] [LOCAL ] MYD: Derivative data saved (1807 records). [2025-09-18T22:55:06.961007] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-09-18T22:55:06.963580] [INFO ] [MAIN ] Derivative Progress: 1241/2075 symbols completed. MYD took 1.0s. Estimated remaining: 5m 24s. Rate: 154.5 symbols/min [2025-09-18T22:55:06.969267] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:06.982168] [DEBUG] [LOCAL ] MYI: Loaded 19575 existing records from primary storage. [2025-09-18T22:55:06.985290] [INFO ] [MAIN ] MYI: Loaded 19575 primary data records. [2025-09-18T22:55:07.033678] [DEBUG] [MAIN ] MYE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:07.063751] [INFO ] [MAIN ] MYE: Generated 1807 derivative records from 25748 primary records. [2025-09-18T22:55:07.096411] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-09-18T22:55:07.110537] [DEBUG] [LOCAL ] MYN: Loaded 10499 existing records from primary storage. [2025-09-18T22:55:07.119340] [INFO ] [MAIN ] MYN: Loaded 10499 primary data records. [2025-09-18T22:55:07.313171] [DEBUG] [LOCAL ] MYE: Derivative data saved (1807 records). [2025-09-18T22:55:07.359405] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-09-18T22:55:07.485401] [INFO ] [MAIN ] Derivative Progress: 1242/2075 symbols completed. MYE took 1.2s. Estimated remaining: 5m 24s. Rate: 154.4 symbols/min [2025-09-18T22:55:07.536448] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:07.762228] [DEBUG] [MAIN ] MYI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:07.763343] [INFO ] [MAIN ] MYI: Generated 1807 derivative records from 19575 primary records. [2025-09-18T22:55:07.763683] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-09-18T22:55:07.794425] [DEBUG] [LOCAL ] NABL: Loaded 40697 existing records from primary storage. [2025-09-18T22:55:07.795053] [INFO ] [MAIN ] NABL: Loaded 40697 primary data records. [2025-09-18T22:55:07.842106] [DEBUG] [MAIN ] MYN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:07.861463] [INFO ] [MAIN ] MYN: Generated 1807 derivative records from 10499 primary records. [2025-09-18T22:55:07.869731] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-09-18T22:55:07.848182] [DEBUG] [LOCAL ] MYI: Derivative data saved (1807 records). [2025-09-18T22:55:07.884245] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-09-18T22:55:07.933868] [INFO ] [MAIN ] Derivative Progress: 1243/2075 symbols completed. MYI took 1.0s. Estimated remaining: 5m 23s. Rate: 154.4 symbols/min [2025-09-18T22:55:08.016611] [DEBUG] [LOCAL ] MYN: Derivative data saved (1807 records). [2025-09-18T22:55:08.119783] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-09-18T22:55:08.136417] [INFO ] [MAIN ] Derivative Progress: 1244/2075 symbols completed. MYN took 1.2s. Estimated remaining: 5m 23s. Rate: 154.5 symbols/min [2025-09-18T22:55:08.161838] [DEBUG] [MAIN ] NABL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:08.162451] [INFO ] [MAIN ] NABL: Generated 1807 derivative records from 40697 primary records. [2025-09-18T22:55:08.162510] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-09-18T22:55:08.177836] [DEBUG] [LOCAL ] NABL: Derivative data saved (1807 records). [2025-09-18T22:55:08.177903] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-09-18T22:55:08.180006] [INFO ] [MAIN ] Derivative Progress: 1245/2075 symbols completed. NABL took 0.7s. Estimated remaining: 5m 22s. Rate: 154.6 symbols/min [2025-09-18T22:55:08.181015] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:08.181134] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:08.180719] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:08.196391] [DEBUG] [LOCAL ] NAN: Loaded 9175 existing records from primary storage. [2025-09-18T22:55:08.196639] [INFO ] [MAIN ] NAN: Loaded 9175 primary data records. [2025-09-18T22:55:08.369428] [DEBUG] [LOCAL ] NAC: Loaded 25000 existing records from primary storage. [2025-09-18T22:55:08.516294] [INFO ] [MAIN ] NAC: Loaded 25000 primary data records. [2025-09-18T22:55:08.571541] [DEBUG] [LOCAL ] NAD: Loaded 34426 existing records from primary storage. [2025-09-18T22:55:08.613081] [INFO ] [MAIN ] NAD: Loaded 34426 primary data records. [2025-09-18T22:55:09.200328] [DEBUG] [MAIN ] NAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:09.203267] [INFO ] [MAIN ] NAN: Generated 1807 derivative records from 9175 primary records. [2025-09-18T22:55:09.203375] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-09-18T22:55:09.223799] [DEBUG] [LOCAL ] NAN: Derivative data saved (1807 records). [2025-09-18T22:55:09.224131] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-09-18T22:55:09.226684] [INFO ] [MAIN ] Derivative Progress: 1246/2075 symbols completed. NAN took 1.0s. Estimated remaining: 5m 22s. Rate: 154.4 symbols/min [2025-09-18T22:55:09.227094] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:09.244705] [DEBUG] [MAIN ] NAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:09.245539] [INFO ] [MAIN ] NAC: Generated 1807 derivative records from 25000 primary records. [2025-09-18T22:55:09.245833] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-09-18T22:55:09.265181] [DEBUG] [LOCAL ] NAC: Derivative data saved (1807 records). [2025-09-18T22:55:09.265431] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-09-18T22:55:09.267753] [INFO ] [MAIN ] Derivative Progress: 1247/2075 symbols completed. NAC took 1.1s. Estimated remaining: 5m 22s. Rate: 154.5 symbols/min [2025-09-18T22:55:09.268293] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:09.281868] [DEBUG] [MAIN ] NAD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:09.282718] [INFO ] [MAIN ] NAD: Generated 1807 derivative records from 34426 primary records. [2025-09-18T22:55:09.282938] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-09-18T22:55:09.299637] [DEBUG] [LOCAL ] NAD: Derivative data saved (1807 records). [2025-09-18T22:55:09.299895] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-09-18T22:55:09.302671] [INFO ] [MAIN ] Derivative Progress: 1248/2075 symbols completed. NAD took 1.1s. Estimated remaining: 5m 21s. Rate: 154.6 symbols/min [2025-09-18T22:55:09.313543] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:09.325853] [DEBUG] [LOCAL ] NAZ: Loaded 2749 existing records from primary storage. [2025-09-18T22:55:09.326027] [INFO ] [MAIN ] NAZ: Loaded 2749 primary data records. [2025-09-18T22:55:09.429774] [DEBUG] [LOCAL ] NAT: Loaded 49532 existing records from primary storage. [2025-09-18T22:55:09.464417] [INFO ] [MAIN ] NAT: Loaded 49532 primary data records. [2025-09-18T22:55:09.464303] [DEBUG] [LOCAL ] NATL: Loaded 33165 existing records from primary storage. [2025-09-18T22:55:09.464733] [INFO ] [MAIN ] NATL: Loaded 33165 primary data records. [2025-09-18T22:55:10.354824] [DEBUG] [MAIN ] NAZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:10.355581] [INFO ] [MAIN ] NAZ: Generated 1807 derivative records from 2749 primary records. [2025-09-18T22:55:10.355879] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-09-18T22:55:10.373171] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1807 records). [2025-09-18T22:55:10.374982] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-09-18T22:55:10.377400] [INFO ] [MAIN ] Derivative Progress: 1249/2075 symbols completed. NAZ took 1.1s. Estimated remaining: 5m 21s. Rate: 154.4 symbols/min [2025-09-18T22:55:10.378779] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:10.392429] [DEBUG] [MAIN ] NATL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:10.400745] [INFO ] [MAIN ] NATL: Generated 1807 derivative records from 33165 primary records. [2025-09-18T22:55:10.405635] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-09-18T22:55:10.405966] [DEBUG] [MAIN ] NAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:10.407001] [INFO ] [MAIN ] NAT: Generated 1807 derivative records from 49532 primary records. [2025-09-18T22:55:10.409720] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-09-18T22:55:10.438793] [DEBUG] [LOCAL ] NBB: Loaded 8992 existing records from primary storage. [2025-09-18T22:55:10.441217] [INFO ] [MAIN ] NBB: Loaded 8992 primary data records. [2025-09-18T22:55:10.476010] [DEBUG] [LOCAL ] NATL: Derivative data saved (1807 records). [2025-09-18T22:55:10.481692] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-09-18T22:55:10.484971] [INFO ] [MAIN ] Derivative Progress: 1250/2075 symbols completed. NATL took 1.2s. Estimated remaining: 5m 20s. Rate: 154.5 symbols/min [2025-09-18T22:55:10.491012] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:10.496223] [DEBUG] [LOCAL ] NAT: Derivative data saved (1807 records). [2025-09-18T22:55:10.527317] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-09-18T22:55:10.554102] [INFO ] [MAIN ] Derivative Progress: 1251/2075 symbols completed. NAT took 1.3s. Estimated remaining: 5m 20s. Rate: 154.6 symbols/min [2025-09-18T22:55:10.569581] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:10.769089] [DEBUG] [LOCAL ] NBHC: Loaded 23207 existing records from primary storage. [2025-09-18T22:55:10.769294] [INFO ] [MAIN ] NBHC: Loaded 23207 primary data records. [2025-09-18T22:55:10.994257] [DEBUG] [LOCAL ] NBR: Loaded 35282 existing records from primary storage. [2025-09-18T22:55:11.135235] [INFO ] [MAIN ] NBR: Loaded 35282 primary data records. [2025-09-18T22:55:11.366101] [DEBUG] [MAIN ] NBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:11.416607] [INFO ] [MAIN ] NBB: Generated 1807 derivative records from 8992 primary records. [2025-09-18T22:55:11.434944] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-09-18T22:55:11.718269] [DEBUG] [MAIN ] NBHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:11.722169] [INFO ] [MAIN ] NBHC: Generated 1807 derivative records from 23207 primary records. [2025-09-18T22:55:11.724049] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-09-18T22:55:11.748163] [DEBUG] [LOCAL ] NBB: Derivative data saved (1807 records). [2025-09-18T22:55:11.750763] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-09-18T22:55:11.759004] [INFO ] [MAIN ] Derivative Progress: 1252/2075 symbols completed. NBB took 1.4s. Estimated remaining: 5m 20s. Rate: 154.3 symbols/min [2025-09-18T22:55:11.760109] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1807 records). [2025-09-18T22:55:11.760337] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-09-18T22:55:11.761229] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:11.766241] [INFO ] [MAIN ] Derivative Progress: 1253/2075 symbols completed. NBHC took 1.3s. Estimated remaining: 5m 19s. Rate: 154.4 symbols/min [2025-09-18T22:55:11.767995] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:11.775676] [DEBUG] [LOCAL ] NC: Loaded 1936 existing records from primary storage. [2025-09-18T22:55:11.776196] [INFO ] [MAIN ] NC: Loaded 1936 primary data records. [2025-09-18T22:55:11.939460] [DEBUG] [LOCAL ] NBXG: Loaded 23058 existing records from primary storage. [2025-09-18T22:55:11.990807] [DEBUG] [MAIN ] NBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:11.995250] [INFO ] [MAIN ] NBR: Generated 1807 derivative records from 35282 primary records. [2025-09-18T22:55:11.993811] [INFO ] [MAIN ] NBXG: Loaded 23058 primary data records. [2025-09-18T22:55:12.005994] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-09-18T22:55:12.449323] [DEBUG] [LOCAL ] NBR: Derivative data saved (1807 records). [2025-09-18T22:55:12.487481] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-09-18T22:55:12.516631] [INFO ] [MAIN ] Derivative Progress: 1254/2075 symbols completed. NBR took 2.0s. Estimated remaining: 5m 19s. Rate: 154.3 symbols/min [2025-09-18T22:55:12.517601] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:12.664219] [DEBUG] [LOCAL ] NCA: Loaded 10087 existing records from primary storage. [2025-09-18T22:55:12.664953] [INFO ] [MAIN ] NCA: Loaded 10087 primary data records. [2025-09-18T22:55:12.712774] [DEBUG] [MAIN ] NC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:12.739731] [INFO ] [MAIN ] NC: Generated 1807 derivative records from 1936 primary records. [2025-09-18T22:55:12.773869] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-09-18T22:55:13.016030] [DEBUG] [LOCAL ] NC: Derivative data saved (1807 records). [2025-09-18T22:55:13.016986] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-09-18T22:55:13.019330] [INFO ] [MAIN ] Derivative Progress: 1255/2075 symbols completed. NC took 1.3s. Estimated remaining: 5m 19s. Rate: 154.3 symbols/min [2025-09-18T22:55:13.019910] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:13.034385] [DEBUG] [MAIN ] NBXG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:13.036766] [INFO ] [MAIN ] NBXG: Generated 1807 derivative records from 23058 primary records. [2025-09-18T22:55:13.037489] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-09-18T22:55:13.066889] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1807 records). [2025-09-18T22:55:13.075223] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-09-18T22:55:13.075105] [DEBUG] [LOCAL ] NCDL: Loaded 22014 existing records from primary storage. [2025-09-18T22:55:13.078014] [INFO ] [MAIN ] NCDL: Loaded 22014 primary data records. [2025-09-18T22:55:13.077912] [INFO ] [MAIN ] Derivative Progress: 1256/2075 symbols completed. NBXG took 1.3s. Estimated remaining: 5m 18s. Rate: 154.4 symbols/min [2025-09-18T22:55:13.127462] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:13.170032] [DEBUG] [MAIN ] NCA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:13.197789] [INFO ] [MAIN ] NCA: Generated 1807 derivative records from 10087 primary records. [2025-09-18T22:55:13.198067] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-09-18T22:55:13.268225] [DEBUG] [LOCAL ] NCV: Loaded 13525 existing records from primary storage. [2025-09-18T22:55:13.294775] [INFO ] [MAIN ] NCV: Loaded 13525 primary data records. [2025-09-18T22:55:13.457801] [DEBUG] [LOCAL ] NCA: Derivative data saved (1807 records). [2025-09-18T22:55:13.494518] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-09-18T22:55:13.517081] [INFO ] [MAIN ] Derivative Progress: 1257/2075 symbols completed. NCA took 1.0s. Estimated remaining: 5m 18s. Rate: 154.4 symbols/min [2025-09-18T22:55:13.539051] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:13.750443] [DEBUG] [LOCAL ] NCZ: Loaded 11855 existing records from primary storage. [2025-09-18T22:55:13.750666] [INFO ] [MAIN ] NCZ: Loaded 11855 primary data records. [2025-09-18T22:55:13.906971] [DEBUG] [MAIN ] NCDL: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:55:13.968708] [INFO ] [MAIN ] NCDL: Generated 1806 derivative records from 22014 primary records. [2025-09-18T22:55:14.132380] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-09-18T22:55:14.163566] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1806 records). [2025-09-18T22:55:14.176996] [DEBUG] [MAIN ] NCV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:14.171630] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-09-18T22:55:14.179265] [INFO ] [MAIN ] Derivative Progress: 1258/2075 symbols completed. NCDL took 1.2s. Estimated remaining: 5m 18s. Rate: 154.3 symbols/min [2025-09-18T22:55:14.180474] [INFO ] [MAIN ] NCV: Generated 1807 derivative records from 13525 primary records. [2025-09-18T22:55:14.181746] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-09-18T22:55:14.199307] [DEBUG] [LOCAL ] NCV: Derivative data saved (1807 records). [2025-09-18T22:55:14.199423] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-09-18T22:55:14.202088] [INFO ] [MAIN ] Derivative Progress: 1259/2075 symbols completed. NCV took 1.1s. Estimated remaining: 5m 17s. Rate: 154.4 symbols/min [2025-09-18T22:55:14.219291] [DEBUG] [MAIN ] NCZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:14.220111] [INFO ] [MAIN ] NCZ: Generated 1807 derivative records from 11855 primary records. [2025-09-18T22:55:14.220189] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-09-18T22:55:14.240516] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1807 records). [2025-09-18T22:55:14.240680] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-09-18T22:55:14.243762] [INFO ] [MAIN ] Derivative Progress: 1260/2075 symbols completed. NCZ took 0.7s. Estimated remaining: 5m 16s. Rate: 154.5 symbols/min [2025-09-18T22:55:14.244460] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:14.244512] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:14.245331] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:14.263415] [DEBUG] [LOCAL ] NDMO: Loaded 16619 existing records from primary storage. [2025-09-18T22:55:14.263585] [INFO ] [MAIN ] NDMO: Loaded 16619 primary data records. [2025-09-18T22:55:14.405332] [DEBUG] [LOCAL ] NEA: Loaded 35699 existing records from primary storage. [2025-09-18T22:55:14.435356] [INFO ] [MAIN ] NEA: Loaded 35699 primary data records. [2025-09-18T22:55:14.754706] [DEBUG] [LOCAL ] NE: Loaded 52783 existing records from primary storage. [2025-09-18T22:55:14.755612] [INFO ] [MAIN ] NE: Loaded 52783 primary data records. [2025-09-18T22:55:15.298191] [DEBUG] [MAIN ] NDMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:15.299281] [INFO ] [MAIN ] NDMO: Generated 1807 derivative records from 16619 primary records. [2025-09-18T22:55:15.299546] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-09-18T22:55:15.330389] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1807 records). [2025-09-18T22:55:15.337579] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-09-18T22:55:15.340160] [INFO ] [MAIN ] Derivative Progress: 1261/2075 symbols completed. NDMO took 1.1s. Estimated remaining: 5m 17s. Rate: 154.3 symbols/min [2025-09-18T22:55:15.340603] [DEBUG] [MAIN ] NEA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:15.340996] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:15.341850] [INFO ] [MAIN ] NEA: Generated 1807 derivative records from 35699 primary records. [2025-09-18T22:55:15.341988] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-09-18T22:55:15.364151] [DEBUG] [MAIN ] NE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:15.368818] [INFO ] [MAIN ] NE: Generated 1807 derivative records from 52783 primary records. [2025-09-18T22:55:15.369195] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-09-18T22:55:15.394685] [DEBUG] [LOCAL ] NE: Derivative data saved (1807 records). [2025-09-18T22:55:15.394911] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-09-18T22:55:15.397896] [INFO ] [MAIN ] Derivative Progress: 1262/2075 symbols completed. NE took 1.2s. Estimated remaining: 5m 16s. Rate: 154.4 symbols/min [2025-09-18T22:55:15.394556] [DEBUG] [LOCAL ] NEA: Derivative data saved (1807 records). [2025-09-18T22:55:15.398101] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-09-18T22:55:15.401206] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:15.401261] [INFO ] [MAIN ] Derivative Progress: 1263/2075 symbols completed. NEA took 1.2s. Estimated remaining: 5m 15s. Rate: 154.5 symbols/min [2025-09-18T22:55:15.402174] [INFO ] [MAIN ] NEUE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:15.407155] [DEBUG] [LOCAL ] NEUE: Loaded 2262 existing records from primary storage. [2025-09-18T22:55:15.407277] [INFO ] [MAIN ] NEUE: Loaded 2262 primary data records. [2025-09-18T22:55:15.536880] [DEBUG] [LOCAL ] NEU: Loaded 8172 existing records from primary storage. [2025-09-18T22:55:15.550254] [INFO ] [MAIN ] NEU: Loaded 8172 primary data records. [2025-09-18T22:55:15.659378] [DEBUG] [LOCAL ] NET: Loaded 53481 existing records from primary storage. [2025-09-18T22:55:15.814294] [INFO ] [MAIN ] NET: Loaded 53481 primary data records. [2025-09-18T22:55:16.471175] [DEBUG] [MAIN ] NEUE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:16.472346] [INFO ] [MAIN ] NEUE: Generated 1807 derivative records from 2262 primary records. [2025-09-18T22:55:16.472761] [DEBUG] [LOCAL ] NEUE: Saving derivative data. [2025-09-18T22:55:16.505055] [DEBUG] [LOCAL ] NEUE: Derivative data saved (1807 records). [2025-09-18T22:55:16.505555] [INFO ] [MAIN ] NEUE: Successfully saved derivative data. [2025-09-18T22:55:16.505948] [DEBUG] [MAIN ] NEU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:16.509248] [INFO ] [MAIN ] Derivative Progress: 1264/2075 symbols completed. NEUE took 1.1s. Estimated remaining: 5m 15s. Rate: 154.3 symbols/min [2025-09-18T22:55:16.510440] [INFO ] [MAIN ] NEU: Generated 1807 derivative records from 8172 primary records. [2025-09-18T22:55:16.510905] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-09-18T22:55:16.511853] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:16.542814] [DEBUG] [MAIN ] NET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:16.544011] [INFO ] [MAIN ] NET: Generated 1807 derivative records from 53481 primary records. [2025-09-18T22:55:16.544190] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-09-18T22:55:16.548135] [DEBUG] [LOCAL ] NEU: Derivative data saved (1807 records). [2025-09-18T22:55:16.548634] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-09-18T22:55:16.548050] [DEBUG] [LOCAL ] NEXA: Loaded 4023 existing records from primary storage. [2025-09-18T22:55:16.551878] [INFO ] [MAIN ] Derivative Progress: 1265/2075 symbols completed. NEU took 1.2s. Estimated remaining: 5m 15s. Rate: 154.4 symbols/min [2025-09-18T22:55:16.551958] [INFO ] [MAIN ] NEXA: Loaded 4023 primary data records. [2025-09-18T22:55:16.576692] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:16.719948] [DEBUG] [LOCAL ] NET: Derivative data saved (1807 records). [2025-09-18T22:55:16.769323] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-09-18T22:55:16.772487] [INFO ] [MAIN ] Derivative Progress: 1266/2075 symbols completed. NET took 1.4s. Estimated remaining: 5m 14s. Rate: 154.5 symbols/min [2025-09-18T22:55:16.889074] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:16.902952] [DEBUG] [LOCAL ] NFG: Loaded 39072 existing records from primary storage. [2025-09-18T22:55:16.903506] [INFO ] [MAIN ] NFG: Loaded 39072 primary data records. [2025-09-18T22:55:17.069398] [DEBUG] [LOCAL ] NFJ: Loaded 20587 existing records from primary storage. [2025-09-18T22:55:17.089936] [INFO ] [MAIN ] NFJ: Loaded 20587 primary data records. [2025-09-18T22:55:17.444207] [DEBUG] [MAIN ] NEXA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:17.514524] [INFO ] [MAIN ] NEXA: Generated 1807 derivative records from 4023 primary records. [2025-09-18T22:55:17.569209] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-09-18T22:55:17.588477] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1807 records). [2025-09-18T22:55:17.589759] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-09-18T22:55:17.593099] [INFO ] [MAIN ] Derivative Progress: 1267/2075 symbols completed. NEXA took 1.1s. Estimated remaining: 5m 14s. Rate: 154.3 symbols/min [2025-09-18T22:55:17.593692] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:17.614113] [DEBUG] [MAIN ] NFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:17.615124] [INFO ] [MAIN ] NFG: Generated 1807 derivative records from 39072 primary records. [2025-09-18T22:55:17.615224] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-09-18T22:55:17.635920] [DEBUG] [LOCAL ] NFG: Derivative data saved (1807 records). [2025-09-18T22:55:17.636056] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-09-18T22:55:17.639527] [INFO ] [MAIN ] Derivative Progress: 1268/2075 symbols completed. NFG took 1.1s. Estimated remaining: 5m 14s. Rate: 154.4 symbols/min [2025-09-18T22:55:17.640086] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:17.653228] [DEBUG] [MAIN ] NFJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:17.653961] [INFO ] [MAIN ] NFJ: Generated 1807 derivative records from 20587 primary records. [2025-09-18T22:55:17.654582] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-09-18T22:55:17.682394] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1807 records). [2025-09-18T22:55:17.682563] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-09-18T22:55:17.685540] [INFO ] [MAIN ] Derivative Progress: 1269/2075 symbols completed. NFJ took 0.8s. Estimated remaining: 5m 13s. Rate: 154.5 symbols/min [2025-09-18T22:55:17.687168] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:17.715100] [DEBUG] [LOCAL ] NGG: Loaded 46495 existing records from primary storage. [2025-09-18T22:55:17.715449] [INFO ] [MAIN ] NGG: Loaded 46495 primary data records. [2025-09-18T22:55:17.834314] [DEBUG] [LOCAL ] NGS: Loaded 11842 existing records from primary storage. [2025-09-18T22:55:17.834547] [INFO ] [MAIN ] NGS: Loaded 11842 primary data records. [2025-09-18T22:55:17.835102] [DEBUG] [LOCAL ] NGL: Loaded 30690 existing records from primary storage. [2025-09-18T22:55:17.859680] [INFO ] [MAIN ] NGL: Loaded 30690 primary data records. [2025-09-18T22:55:18.775866] [DEBUG] [MAIN ] NGG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:18.776948] [INFO ] [MAIN ] NGG: Generated 1807 derivative records from 46495 primary records. [2025-09-18T22:55:18.777248] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-09-18T22:55:18.823734] [DEBUG] [MAIN ] NGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:18.826088] [INFO ] [MAIN ] NGS: Generated 1807 derivative records from 11842 primary records. [2025-09-18T22:55:18.824569] [DEBUG] [MAIN ] NGL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:18.828134] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-09-18T22:55:18.828068] [INFO ] [MAIN ] NGL: Generated 1807 derivative records from 30690 primary records. [2025-09-18T22:55:18.828465] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-09-18T22:55:18.828910] [DEBUG] [LOCAL ] NGG: Derivative data saved (1807 records). [2025-09-18T22:55:18.830435] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-09-18T22:55:18.833331] [INFO ] [MAIN ] Derivative Progress: 1270/2075 symbols completed. NGG took 1.2s. Estimated remaining: 5m 13s. Rate: 154.3 symbols/min [2025-09-18T22:55:18.845031] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:18.869495] [DEBUG] [LOCAL ] NGS: Derivative data saved (1807 records). [2025-09-18T22:55:18.870069] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-09-18T22:55:18.873226] [INFO ] [MAIN ] Derivative Progress: 1271/2075 symbols completed. NGS took 1.2s. Estimated remaining: 5m 12s. Rate: 154.4 symbols/min [2025-09-18T22:55:18.874203] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:18.878673] [DEBUG] [LOCAL ] NGL: Derivative data saved (1807 records). [2025-09-18T22:55:18.878822] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-09-18T22:55:18.881718] [INFO ] [MAIN ] Derivative Progress: 1272/2075 symbols completed. NGL took 1.2s. Estimated remaining: 5m 12s. Rate: 154.5 symbols/min [2025-09-18T22:55:18.881999] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:18.914850] [DEBUG] [LOCAL ] NGVC: Loaded 22615 existing records from primary storage. [2025-09-18T22:55:18.915051] [INFO ] [MAIN ] NGVC: Loaded 22615 primary data records. [2025-09-18T22:55:18.915590] [DEBUG] [LOCAL ] NGVT: Loaded 24732 existing records from primary storage. [2025-09-18T22:55:18.953275] [INFO ] [MAIN ] NGVT: Loaded 24732 primary data records. [2025-09-18T22:55:19.100267] [DEBUG] [LOCAL ] NHI: Loaded 22340 existing records from primary storage. [2025-09-18T22:55:19.112808] [INFO ] [MAIN ] NHI: Loaded 22340 primary data records. [2025-09-18T22:55:19.957190] [DEBUG] [MAIN ] NGVC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:19.960114] [INFO ] [MAIN ] NGVC: Generated 1807 derivative records from 22615 primary records. [2025-09-18T22:55:19.960224] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-09-18T22:55:19.961331] [DEBUG] [MAIN ] NGVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:19.962744] [INFO ] [MAIN ] NGVT: Generated 1807 derivative records from 24732 primary records. [2025-09-18T22:55:19.963473] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-09-18T22:55:19.985957] [DEBUG] [MAIN ] NHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:19.990032] [INFO ] [MAIN ] NHI: Generated 1807 derivative records from 22340 primary records. [2025-09-18T22:55:20.006141] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-09-18T22:55:20.006495] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1807 records). [2025-09-18T22:55:20.007845] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-09-18T22:55:20.010540] [INFO ] [MAIN ] Derivative Progress: 1273/2075 symbols completed. NGVC took 1.2s. Estimated remaining: 5m 12s. Rate: 154.3 symbols/min [2025-09-18T22:55:20.028807] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1807 records). [2025-09-18T22:55:20.029445] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-09-18T22:55:20.031681] [INFO ] [MAIN ] Derivative Progress: 1274/2075 symbols completed. NGVT took 1.2s. Estimated remaining: 5m 11s. Rate: 154.4 symbols/min [2025-09-18T22:55:20.034111] [DEBUG] [LOCAL ] NHI: Derivative data saved (1807 records). [2025-09-18T22:55:20.034182] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-09-18T22:55:20.036950] [INFO ] [MAIN ] Derivative Progress: 1275/2075 symbols completed. NHI took 1.2s. Estimated remaining: 5m 11s. Rate: 154.5 symbols/min [2025-09-18T22:55:20.037549] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:20.037696] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:20.037600] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:20.055634] [DEBUG] [LOCAL ] NIM: Loaded 4167 existing records from primary storage. [2025-09-18T22:55:20.056186] [INFO ] [MAIN ] NIM: Loaded 4167 primary data records. [2025-09-18T22:55:20.073160] [DEBUG] [LOCAL ] NIE: Loaded 11760 existing records from primary storage. [2025-09-18T22:55:20.087971] [DEBUG] [LOCAL ] NIC: Loaded 9008 existing records from primary storage. [2025-09-18T22:55:20.122819] [INFO ] [MAIN ] NIC: Loaded 9008 primary data records. [2025-09-18T22:55:20.122702] [INFO ] [MAIN ] NIE: Loaded 11760 primary data records. [2025-09-18T22:55:21.130335] [DEBUG] [MAIN ] NIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:21.130616] [DEBUG] [MAIN ] NIE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:21.129800] [DEBUG] [MAIN ] NIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:21.131452] [INFO ] [MAIN ] NIM: Generated 1807 derivative records from 4167 primary records. [2025-09-18T22:55:21.131566] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-09-18T22:55:21.133534] [INFO ] [MAIN ] NIC: Generated 1807 derivative records from 9008 primary records. [2025-09-18T22:55:21.132229] [INFO ] [MAIN ] NIE: Generated 1807 derivative records from 11760 primary records. [2025-09-18T22:55:21.133855] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-09-18T22:55:21.140671] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-09-18T22:55:21.177357] [DEBUG] [LOCAL ] NIC: Derivative data saved (1807 records). [2025-09-18T22:55:21.178609] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-09-18T22:55:21.182859] [DEBUG] [LOCAL ] NIM: Derivative data saved (1807 records). [2025-09-18T22:55:21.183296] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-09-18T22:55:21.182278] [INFO ] [MAIN ] Derivative Progress: 1276/2075 symbols completed. NIC took 1.1s. Estimated remaining: 5m 11s. Rate: 154.3 symbols/min [2025-09-18T22:55:21.187433] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:21.188577] [INFO ] [MAIN ] Derivative Progress: 1277/2075 symbols completed. NIM took 1.1s. Estimated remaining: 5m 10s. Rate: 154.4 symbols/min [2025-09-18T22:55:21.189503] [DEBUG] [LOCAL ] NIE: Derivative data saved (1807 records). [2025-09-18T22:55:21.189594] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-09-18T22:55:21.192754] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:21.192906] [INFO ] [MAIN ] Derivative Progress: 1278/2075 symbols completed. NIE took 1.2s. Estimated remaining: 5m 9s. Rate: 154.5 symbols/min [2025-09-18T22:55:21.193208] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:21.210016] [DEBUG] [LOCAL ] NKX: Loaded 13718 existing records from primary storage. [2025-09-18T22:55:21.210158] [INFO ] [MAIN ] NKX: Loaded 13718 primary data records. [2025-09-18T22:55:21.360780] [DEBUG] [LOCAL ] NINE: Loaded 29234 existing records from primary storage. [2025-09-18T22:55:21.372598] [INFO ] [MAIN ] NINE: Loaded 29234 primary data records. [2025-09-18T22:55:21.520161] [DEBUG] [LOCAL ] NJR: Loaded 38276 existing records from primary storage. [2025-09-18T22:55:21.677307] [INFO ] [MAIN ] NJR: Loaded 38276 primary data records. [2025-09-18T22:55:22.324897] [DEBUG] [MAIN ] NKX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:22.326014] [INFO ] [MAIN ] NKX: Generated 1807 derivative records from 13718 primary records. [2025-09-18T22:55:22.326235] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-09-18T22:55:22.367230] [DEBUG] [MAIN ] NINE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:22.368432] [DEBUG] [LOCAL ] NKX: Derivative data saved (1807 records). [2025-09-18T22:55:22.369577] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-09-18T22:55:22.374250] [INFO ] [MAIN ] Derivative Progress: 1279/2075 symbols completed. NKX took 1.2s. Estimated remaining: 5m 10s. Rate: 154.3 symbols/min [2025-09-18T22:55:22.369335] [INFO ] [MAIN ] NINE: Generated 1807 derivative records from 29234 primary records. [2025-09-18T22:55:22.374747] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:22.375418] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-09-18T22:55:22.404854] [DEBUG] [MAIN ] NJR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:22.406297] [INFO ] [MAIN ] NJR: Generated 1807 derivative records from 38276 primary records. [2025-09-18T22:55:22.406736] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-09-18T22:55:22.429454] [DEBUG] [LOCAL ] NLOP: Loaded 11885 existing records from primary storage. [2025-09-18T22:55:22.430618] [INFO ] [MAIN ] NLOP: Loaded 11885 primary data records. [2025-09-18T22:55:22.492282] [DEBUG] [LOCAL ] NINE: Derivative data saved (1807 records). [2025-09-18T22:55:22.519483] [DEBUG] [LOCAL ] NJR: Derivative data saved (1807 records). [2025-09-18T22:55:22.519677] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-09-18T22:55:22.525050] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-09-18T22:55:22.546828] [INFO ] [MAIN ] Derivative Progress: 1280/2075 symbols completed. NJR took 1.4s. Estimated remaining: 5m 9s. Rate: 154.4 symbols/min [2025-09-18T22:55:22.552235] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:22.552107] [INFO ] [MAIN ] Derivative Progress: 1281/2075 symbols completed. NINE took 1.4s. Estimated remaining: 5m 8s. Rate: 154.5 symbols/min [2025-09-18T22:55:22.563368] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:22.761168] [DEBUG] [LOCAL ] NMAI: Loaded 13349 existing records from primary storage. [2025-09-18T22:55:22.761996] [INFO ] [MAIN ] NMAI: Loaded 13349 primary data records. [2025-09-18T22:55:23.114846] [DEBUG] [LOCAL ] NLY: Loaded 53971 existing records from primary storage. [2025-09-18T22:55:23.116449] [INFO ] [MAIN ] NLY: Loaded 53971 primary data records. [2025-09-18T22:55:23.235498] [DEBUG] [MAIN ] NLOP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:23.239957] [INFO ] [MAIN ] NLOP: Generated 1807 derivative records from 11885 primary records. [2025-09-18T22:55:23.240180] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-09-18T22:55:23.337374] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1807 records). [2025-09-18T22:55:23.337519] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-09-18T22:55:23.452206] [INFO ] [MAIN ] Derivative Progress: 1282/2075 symbols completed. NLOP took 1.1s. Estimated remaining: 5m 8s. Rate: 154.3 symbols/min [2025-09-18T22:55:23.462101] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:23.480939] [DEBUG] [MAIN ] NMAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:23.482069] [INFO ] [MAIN ] NMAI: Generated 1807 derivative records from 13349 primary records. [2025-09-18T22:55:23.482462] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-09-18T22:55:23.505831] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1807 records). [2025-09-18T22:55:23.506932] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-09-18T22:55:23.515737] [INFO ] [MAIN ] Derivative Progress: 1283/2075 symbols completed. NMAI took 1.0s. Estimated remaining: 5m 8s. Rate: 154.4 symbols/min [2025-09-18T22:55:23.516132] [DEBUG] [LOCAL ] NMCO: Loaded 16585 existing records from primary storage. [2025-09-18T22:55:23.516914] [INFO ] [MAIN ] NMCO: Loaded 16585 primary data records. [2025-09-18T22:55:23.516670] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:23.631355] [DEBUG] [LOCAL ] NMG: Loaded 7492 existing records from primary storage. [2025-09-18T22:55:23.637103] [INFO ] [MAIN ] NMG: Loaded 7492 primary data records. [2025-09-18T22:55:23.971973] [DEBUG] [MAIN ] NLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:23.983416] [INFO ] [MAIN ] NLY: Generated 1807 derivative records from 53971 primary records. [2025-09-18T22:55:23.989315] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-09-18T22:55:24.190671] [DEBUG] [LOCAL ] NLY: Derivative data saved (1807 records). [2025-09-18T22:55:24.190839] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-09-18T22:55:24.193431] [INFO ] [MAIN ] Derivative Progress: 1284/2075 symbols completed. NLY took 1.6s. Estimated remaining: 5m 8s. Rate: 154.3 symbols/min [2025-09-18T22:55:24.193825] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:24.203579] [DEBUG] [LOCAL ] NMI: Loaded 4138 existing records from primary storage. [2025-09-18T22:55:24.204946] [INFO ] [MAIN ] NMI: Loaded 4138 primary data records. [2025-09-18T22:55:24.323054] [DEBUG] [MAIN ] NMCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:24.348035] [INFO ] [MAIN ] NMCO: Generated 1807 derivative records from 16585 primary records. [2025-09-18T22:55:24.348967] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-09-18T22:55:24.348904] [DEBUG] [MAIN ] NMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:24.376562] [INFO ] [MAIN ] NMG: Generated 1807 derivative records from 7492 primary records. [2025-09-18T22:55:24.376718] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-09-18T22:55:24.657759] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1807 records). [2025-09-18T22:55:24.658469] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-09-18T22:55:24.661363] [INFO ] [MAIN ] Derivative Progress: 1285/2075 symbols completed. NMCO took 1.2s. Estimated remaining: 5m 7s. Rate: 154.3 symbols/min [2025-09-18T22:55:24.662166] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:24.663709] [DEBUG] [LOCAL ] NMG: Derivative data saved (1807 records). [2025-09-18T22:55:24.664211] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-09-18T22:55:24.667673] [INFO ] [MAIN ] Derivative Progress: 1286/2075 symbols completed. NMG took 1.2s. Estimated remaining: 5m 7s. Rate: 154.4 symbols/min [2025-09-18T22:55:24.668579] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:24.686298] [DEBUG] [LOCAL ] NMM: Loaded 14426 existing records from primary storage. [2025-09-18T22:55:24.686453] [INFO ] [MAIN ] NMM: Loaded 14426 primary data records. [2025-09-18T22:55:24.733305] [DEBUG] [MAIN ] NMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:24.777796] [INFO ] [MAIN ] NMI: Generated 1807 derivative records from 4138 primary records. [2025-09-18T22:55:24.795712] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-09-18T22:55:24.869041] [DEBUG] [LOCAL ] NMR: Loaded 35528 existing records from primary storage. [2025-09-18T22:55:24.921324] [INFO ] [MAIN ] NMR: Loaded 35528 primary data records. [2025-09-18T22:55:25.042913] [DEBUG] [LOCAL ] NMI: Derivative data saved (1807 records). [2025-09-18T22:55:25.043083] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-09-18T22:55:25.057173] [INFO ] [MAIN ] Derivative Progress: 1287/2075 symbols completed. NMI took 0.9s. Estimated remaining: 5m 6s. Rate: 154.4 symbols/min [2025-09-18T22:55:25.086394] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:25.148301] [DEBUG] [LOCAL ] NMS: Loaded 2887 existing records from primary storage. [2025-09-18T22:55:25.165956] [INFO ] [MAIN ] NMS: Loaded 2887 primary data records. [2025-09-18T22:55:25.701581] [DEBUG] [MAIN ] NMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:25.702461] [INFO ] [MAIN ] NMM: Generated 1807 derivative records from 14426 primary records. [2025-09-18T22:55:25.703759] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-09-18T22:55:25.738111] [DEBUG] [MAIN ] NMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:25.740224] [INFO ] [MAIN ] NMR: Generated 1807 derivative records from 35528 primary records. [2025-09-18T22:55:25.741534] [DEBUG] [LOCAL ] NMM: Derivative data saved (1807 records). [2025-09-18T22:55:25.741840] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-09-18T22:55:25.741726] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-09-18T22:55:25.744671] [INFO ] [MAIN ] Derivative Progress: 1288/2075 symbols completed. NMM took 1.1s. Estimated remaining: 5m 6s. Rate: 154.3 symbols/min [2025-09-18T22:55:25.770903] [DEBUG] [MAIN ] NMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:25.773501] [INFO ] [MAIN ] NMS: Generated 1807 derivative records from 2887 primary records. [2025-09-18T22:55:25.773841] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-09-18T22:55:25.774682] [DEBUG] [LOCAL ] NMR: Derivative data saved (1807 records). [2025-09-18T22:55:25.775184] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-09-18T22:55:25.778136] [INFO ] [MAIN ] Derivative Progress: 1289/2075 symbols completed. NMR took 1.1s. Estimated remaining: 5m 5s. Rate: 154.4 symbols/min [2025-09-18T22:55:25.792030] [DEBUG] [LOCAL ] NMS: Derivative data saved (1807 records). [2025-09-18T22:55:25.792101] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-09-18T22:55:25.794932] [INFO ] [MAIN ] Derivative Progress: 1290/2075 symbols completed. NMS took 0.7s. Estimated remaining: 5m 5s. Rate: 154.5 symbols/min [2025-09-18T22:55:25.795968] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:25.796089] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:25.795886] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:25.806903] [DEBUG] [LOCAL ] NMT: Loaded 2839 existing records from primary storage. [2025-09-18T22:55:25.807059] [INFO ] [MAIN ] NMT: Loaded 2839 primary data records. [2025-09-18T22:55:25.867579] [DEBUG] [LOCAL ] NNI: Loaded 9909 existing records from primary storage. [2025-09-18T22:55:25.914343] [INFO ] [MAIN ] NNI: Loaded 9909 primary data records. [2025-09-18T22:55:25.995450] [DEBUG] [LOCAL ] NMZ: Loaded 21608 existing records from primary storage. [2025-09-18T22:55:26.017197] [INFO ] [MAIN ] NMZ: Loaded 21608 primary data records. [2025-09-18T22:55:26.841138] [DEBUG] [MAIN ] NNI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:26.842520] [INFO ] [MAIN ] NNI: Generated 1807 derivative records from 9909 primary records. [2025-09-18T22:55:26.841616] [DEBUG] [MAIN ] NMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:26.842624] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-09-18T22:55:26.844634] [INFO ] [MAIN ] NMT: Generated 1807 derivative records from 2839 primary records. [2025-09-18T22:55:26.845366] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-09-18T22:55:26.892196] [DEBUG] [MAIN ] NMZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:26.894540] [INFO ] [MAIN ] NMZ: Generated 1807 derivative records from 21608 primary records. [2025-09-18T22:55:26.893756] [DEBUG] [LOCAL ] NMT: Derivative data saved (1807 records). [2025-09-18T22:55:26.895525] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-09-18T22:55:26.895457] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-09-18T22:55:26.895694] [DEBUG] [LOCAL ] NNI: Derivative data saved (1807 records). [2025-09-18T22:55:26.898452] [INFO ] [MAIN ] Derivative Progress: 1291/2075 symbols completed. NMT took 1.1s. Estimated remaining: 5m 5s. Rate: 154.3 symbols/min [2025-09-18T22:55:26.898702] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-09-18T22:55:26.902849] [INFO ] [MAIN ] Derivative Progress: 1292/2075 symbols completed. NNI took 1.1s. Estimated remaining: 5m 4s. Rate: 154.4 symbols/min [2025-09-18T22:55:26.900200] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:26.911943] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:26.920151] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1807 records). [2025-09-18T22:55:26.920262] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-09-18T22:55:26.923281] [INFO ] [MAIN ] Derivative Progress: 1293/2075 symbols completed. NMZ took 1.1s. Estimated remaining: 5m 4s. Rate: 154.6 symbols/min [2025-09-18T22:55:26.925373] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:26.929518] [DEBUG] [LOCAL ] NNY: Loaded 5753 existing records from primary storage. [2025-09-18T22:55:26.929783] [INFO ] [MAIN ] NNY: Loaded 5753 primary data records. [2025-09-18T22:55:27.124601] [DEBUG] [LOCAL ] NOA: Loaded 16596 existing records from primary storage. [2025-09-18T22:55:27.143052] [INFO ] [MAIN ] NOA: Loaded 16596 primary data records. [2025-09-18T22:55:27.407856] [DEBUG] [LOCAL ] NNN: Loaded 48812 existing records from primary storage. [2025-09-18T22:55:27.408679] [INFO ] [MAIN ] NNN: Loaded 48812 primary data records. [2025-09-18T22:55:27.955919] [DEBUG] [MAIN ] NNY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:27.956756] [INFO ] [MAIN ] NNY: Generated 1807 derivative records from 5753 primary records. [2025-09-18T22:55:27.957083] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-09-18T22:55:27.990834] [DEBUG] [MAIN ] NOA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:27.993035] [INFO ] [MAIN ] NOA: Generated 1807 derivative records from 16596 primary records. [2025-09-18T22:55:27.993282] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-09-18T22:55:27.992077] [DEBUG] [LOCAL ] NNY: Derivative data saved (1807 records). [2025-09-18T22:55:27.993511] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-09-18T22:55:27.996856] [INFO ] [MAIN ] Derivative Progress: 1294/2075 symbols completed. NNY took 1.1s. Estimated remaining: 5m 4s. Rate: 154.3 symbols/min [2025-09-18T22:55:27.997901] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:28.030362] [DEBUG] [MAIN ] NNN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:28.031149] [DEBUG] [LOCAL ] NOA: Derivative data saved (1807 records). [2025-09-18T22:55:28.031897] [INFO ] [MAIN ] NNN: Generated 1807 derivative records from 48812 primary records. [2025-09-18T22:55:28.032158] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-09-18T22:55:28.032300] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-09-18T22:55:28.040213] [INFO ] [MAIN ] Derivative Progress: 1295/2075 symbols completed. NOA took 1.1s. Estimated remaining: 5m 3s. Rate: 154.5 symbols/min [2025-09-18T22:55:28.041349] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:28.063819] [DEBUG] [LOCAL ] NOAH: Loaded 20179 existing records from primary storage. [2025-09-18T22:55:28.064922] [INFO ] [MAIN ] NOAH: Loaded 20179 primary data records. [2025-09-18T22:55:28.066244] [DEBUG] [LOCAL ] NNN: Derivative data saved (1807 records). [2025-09-18T22:55:28.081887] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-09-18T22:55:28.090607] [INFO ] [MAIN ] Derivative Progress: 1296/2075 symbols completed. NNN took 1.2s. Estimated remaining: 5m 2s. Rate: 154.6 symbols/min [2025-09-18T22:55:28.106581] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:28.418755] [DEBUG] [LOCAL ] NOC: Loaded 43208 existing records from primary storage. [2025-09-18T22:55:28.447012] [INFO ] [MAIN ] NOC: Loaded 43208 primary data records. [2025-09-18T22:55:28.593227] [DEBUG] [LOCAL ] NOG: Loaded 51549 existing records from primary storage. [2025-09-18T22:55:28.599394] [INFO ] [MAIN ] NOG: Loaded 51549 primary data records. [2025-09-18T22:55:29.119679] [DEBUG] [MAIN ] NOAH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:29.121232] [INFO ] [MAIN ] NOAH: Generated 1807 derivative records from 20179 primary records. [2025-09-18T22:55:29.121608] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-09-18T22:55:29.159471] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1807 records). [2025-09-18T22:55:29.159376] [DEBUG] [MAIN ] NOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:29.159915] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-09-18T22:55:29.160723] [INFO ] [MAIN ] NOC: Generated 1807 derivative records from 43208 primary records. [2025-09-18T22:55:29.163519] [INFO ] [MAIN ] Derivative Progress: 1297/2075 symbols completed. NOAH took 1.2s. Estimated remaining: 5m 2s. Rate: 154.3 symbols/min [2025-09-18T22:55:29.163891] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-09-18T22:55:29.164111] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:29.194007] [DEBUG] [MAIN ] NOG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:29.195459] [INFO ] [MAIN ] NOG: Generated 1807 derivative records from 51549 primary records. [2025-09-18T22:55:29.195880] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-09-18T22:55:29.210231] [DEBUG] [LOCAL ] NOC: Derivative data saved (1807 records). [2025-09-18T22:55:29.210454] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-09-18T22:55:29.213265] [INFO ] [MAIN ] Derivative Progress: 1298/2075 symbols completed. NOC took 1.2s. Estimated remaining: 5m 2s. Rate: 154.5 symbols/min [2025-09-18T22:55:29.214474] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:29.219634] [DEBUG] [LOCAL ] NOG: Derivative data saved (1807 records). [2025-09-18T22:55:29.219734] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-09-18T22:55:29.222579] [INFO ] [MAIN ] Derivative Progress: 1299/2075 symbols completed. NOG took 1.1s. Estimated remaining: 5m 1s. Rate: 154.6 symbols/min [2025-09-18T22:55:29.223097] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:29.264452] [DEBUG] [LOCAL ] NOK: Loaded 54011 existing records from primary storage. [2025-09-18T22:55:29.264689] [INFO ] [MAIN ] NOK: Loaded 54011 primary data records. [2025-09-18T22:55:29.454639] [DEBUG] [LOCAL ] NOMD: Loaded 41837 existing records from primary storage. [2025-09-18T22:55:29.472321] [INFO ] [MAIN ] NOMD: Loaded 41837 primary data records. [2025-09-18T22:55:29.464682] [DEBUG] [LOCAL ] NOTE: Loaded 43675 existing records from primary storage. [2025-09-18T22:55:29.502057] [INFO ] [MAIN ] NOTE: Loaded 43675 primary data records. [2025-09-18T22:55:30.290219] [DEBUG] [MAIN ] NOK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:30.291420] [INFO ] [MAIN ] NOK: Generated 1807 derivative records from 54011 primary records. [2025-09-18T22:55:30.291847] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-09-18T22:55:30.325490] [DEBUG] [MAIN ] NOTE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:30.326948] [INFO ] [MAIN ] NOTE: Generated 1807 derivative records from 43675 primary records. [2025-09-18T22:55:30.327421] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-09-18T22:55:30.329733] [DEBUG] [LOCAL ] NOK: Derivative data saved (1807 records). [2025-09-18T22:55:30.335854] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-09-18T22:55:30.339130] [INFO ] [MAIN ] Derivative Progress: 1300/2075 symbols completed. NOK took 1.2s. Estimated remaining: 5m 1s. Rate: 154.3 symbols/min [2025-09-18T22:55:30.342527] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:30.363328] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1807 records). [2025-09-18T22:55:30.363779] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-09-18T22:55:30.364102] [DEBUG] [MAIN ] NOMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:30.366843] [INFO ] [MAIN ] Derivative Progress: 1301/2075 symbols completed. NOTE took 1.1s. Estimated remaining: 5m 1s. Rate: 154.5 symbols/min [2025-09-18T22:55:30.367843] [INFO ] [MAIN ] NOMD: Generated 1807 derivative records from 41837 primary records. [2025-09-18T22:55:30.368119] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:30.368245] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-09-18T22:55:30.393608] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1807 records). [2025-09-18T22:55:30.393878] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-09-18T22:55:30.396828] [INFO ] [MAIN ] Derivative Progress: 1302/2075 symbols completed. NOMD took 1.2s. Estimated remaining: 5m 0s. Rate: 154.6 symbols/min [2025-09-18T22:55:30.397352] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:30.405470] [DEBUG] [LOCAL ] NPCT: Loaded 17118 existing records from primary storage. [2025-09-18T22:55:30.405609] [INFO ] [MAIN ] NPCT: Loaded 17118 primary data records. [2025-09-18T22:55:30.531119] [DEBUG] [LOCAL ] NPFD: Loaded 9855 existing records from primary storage. [2025-09-18T22:55:30.542089] [INFO ] [MAIN ] NPFD: Loaded 9855 primary data records. [2025-09-18T22:55:30.855871] [DEBUG] [LOCAL ] NOV: Loaded 53579 existing records from primary storage. [2025-09-18T22:55:30.886613] [INFO ] [MAIN ] NOV: Loaded 53579 primary data records. [2025-09-18T22:55:31.428539] [DEBUG] [MAIN ] NPCT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:31.430138] [INFO ] [MAIN ] NPCT: Generated 1807 derivative records from 17118 primary records. [2025-09-18T22:55:31.430600] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-09-18T22:55:31.461405] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1807 records). [2025-09-18T22:55:31.466743] [DEBUG] [MAIN ] NPFD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:31.467694] [INFO ] [MAIN ] NPFD: Generated 1807 derivative records from 9855 primary records. [2025-09-18T22:55:31.466969] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-09-18T22:55:31.467793] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-09-18T22:55:31.471275] [INFO ] [MAIN ] Derivative Progress: 1303/2075 symbols completed. NPCT took 1.1s. Estimated remaining: 5m 0s. Rate: 154.4 symbols/min [2025-09-18T22:55:31.488459] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1807 records). [2025-09-18T22:55:31.489497] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-09-18T22:55:31.492012] [INFO ] [MAIN ] Derivative Progress: 1304/2075 symbols completed. NPFD took 1.1s. Estimated remaining: 4m 59s. Rate: 154.5 symbols/min [2025-09-18T22:55:31.506509] [DEBUG] [MAIN ] NOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:31.507246] [INFO ] [MAIN ] NOV: Generated 1807 derivative records from 53579 primary records. [2025-09-18T22:55:31.507311] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-09-18T22:55:31.525049] [DEBUG] [LOCAL ] NOV: Derivative data saved (1807 records). [2025-09-18T22:55:31.525151] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-09-18T22:55:31.528303] [INFO ] [MAIN ] Derivative Progress: 1305/2075 symbols completed. NOV took 1.2s. Estimated remaining: 4m 59s. Rate: 154.6 symbols/min [2025-09-18T22:55:31.528908] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:31.529117] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:31.529293] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:31.539910] [DEBUG] [LOCAL ] NPV: Loaded 4999 existing records from primary storage. [2025-09-18T22:55:31.540026] [INFO ] [MAIN ] NPV: Loaded 4999 primary data records. [2025-09-18T22:55:31.588153] [DEBUG] [LOCAL ] NPK: Loaded 8234 existing records from primary storage. [2025-09-18T22:55:31.602741] [INFO ] [MAIN ] NPK: Loaded 8234 primary data records. [2025-09-18T22:55:31.669257] [DEBUG] [LOCAL ] NPO: Loaded 12975 existing records from primary storage. [2025-09-18T22:55:31.669403] [INFO ] [MAIN ] NPO: Loaded 12975 primary data records. [2025-09-18T22:55:32.573549] [DEBUG] [MAIN ] NPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:32.574514] [INFO ] [MAIN ] NPV: Generated 1807 derivative records from 4999 primary records. [2025-09-18T22:55:32.574862] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-09-18T22:55:32.605271] [DEBUG] [MAIN ] NPK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:32.607111] [INFO ] [MAIN ] NPK: Generated 1807 derivative records from 8234 primary records. [2025-09-18T22:55:32.608677] [DEBUG] [LOCAL ] NPV: Derivative data saved (1807 records). [2025-09-18T22:55:32.608306] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-09-18T22:55:32.609502] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-09-18T22:55:32.613288] [INFO ] [MAIN ] Derivative Progress: 1306/2075 symbols completed. NPV took 1.1s. Estimated remaining: 4m 59s. Rate: 154.4 symbols/min [2025-09-18T22:55:32.613961] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:32.639115] [DEBUG] [MAIN ] NPO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:32.640522] [INFO ] [MAIN ] NPO: Generated 1807 derivative records from 12975 primary records. [2025-09-18T22:55:32.641205] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-09-18T22:55:32.657512] [DEBUG] [LOCAL ] NPK: Derivative data saved (1807 records). [2025-09-18T22:55:32.658096] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-09-18T22:55:32.661047] [INFO ] [MAIN ] Derivative Progress: 1307/2075 symbols completed. NPK took 1.1s. Estimated remaining: 4m 58s. Rate: 154.5 symbols/min [2025-09-18T22:55:32.662717] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:32.665575] [DEBUG] [LOCAL ] NPO: Derivative data saved (1807 records). [2025-09-18T22:55:32.665725] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-09-18T22:55:32.668774] [INFO ] [MAIN ] Derivative Progress: 1308/2075 symbols completed. NPO took 1.1s. Estimated remaining: 4m 58s. Rate: 154.6 symbols/min [2025-09-18T22:55:32.669154] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:32.688000] [DEBUG] [LOCAL ] NQP: Loaded 9232 existing records from primary storage. [2025-09-18T22:55:32.688151] [INFO ] [MAIN ] NQP: Loaded 9232 primary data records. [2025-09-18T22:55:32.826540] [DEBUG] [LOCAL ] NPWR: Loaded 43291 existing records from primary storage. [2025-09-18T22:55:32.837030] [INFO ] [MAIN ] NPWR: Loaded 43291 primary data records. [2025-09-18T22:55:32.978754] [DEBUG] [LOCAL ] NRDY: Loaded 33506 existing records from primary storage. [2025-09-18T22:55:33.015698] [INFO ] [MAIN ] NRDY: Loaded 33506 primary data records. [2025-09-18T22:55:33.658912] [DEBUG] [MAIN ] NQP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:33.659985] [INFO ] [MAIN ] NQP: Generated 1807 derivative records from 9232 primary records. [2025-09-18T22:55:33.662748] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-09-18T22:55:33.689638] [DEBUG] [MAIN ] NPWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:33.693047] [INFO ] [MAIN ] NPWR: Generated 1807 derivative records from 43291 primary records. [2025-09-18T22:55:33.693608] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-09-18T22:55:33.720247] [DEBUG] [MAIN ] NRDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:33.721521] [INFO ] [MAIN ] NRDY: Generated 1807 derivative records from 33506 primary records. [2025-09-18T22:55:33.722307] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-09-18T22:55:33.724858] [DEBUG] [LOCAL ] NQP: Derivative data saved (1807 records). [2025-09-18T22:55:33.732701] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-09-18T22:55:33.739504] [INFO ] [MAIN ] Derivative Progress: 1309/2075 symbols completed. NQP took 1.1s. Estimated remaining: 4m 58s. Rate: 154.4 symbols/min [2025-09-18T22:55:33.740623] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:33.747695] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1807 records). [2025-09-18T22:55:33.748449] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-09-18T22:55:33.748307] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1807 records). [2025-09-18T22:55:33.751458] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-09-18T22:55:33.751384] [INFO ] [MAIN ] Derivative Progress: 1310/2075 symbols completed. NPWR took 1.1s. Estimated remaining: 4m 57s. Rate: 154.5 symbols/min [2025-09-18T22:55:33.751852] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:33.755023] [INFO ] [MAIN ] Derivative Progress: 1311/2075 symbols completed. NRDY took 1.1s. Estimated remaining: 4m 56s. Rate: 154.6 symbols/min [2025-09-18T22:55:33.757548] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:33.763029] [DEBUG] [LOCAL ] NREF: Loaded 7841 existing records from primary storage. [2025-09-18T22:55:33.763148] [INFO ] [MAIN ] NREF: Loaded 7841 primary data records. [2025-09-18T22:55:33.949789] [DEBUG] [LOCAL ] NRK: Loaded 19672 existing records from primary storage. [2025-09-18T22:55:33.971469] [INFO ] [MAIN ] NRK: Loaded 19672 primary data records. [2025-09-18T22:55:34.201771] [DEBUG] [LOCAL ] NRGV: Loaded 43067 existing records from primary storage. [2025-09-18T22:55:34.216979] [INFO ] [MAIN ] NRGV: Loaded 43067 primary data records. [2025-09-18T22:55:34.766928] [DEBUG] [MAIN ] NREF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:34.768086] [INFO ] [MAIN ] NREF: Generated 1807 derivative records from 7841 primary records. [2025-09-18T22:55:34.768192] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-09-18T22:55:34.801273] [DEBUG] [MAIN ] NRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:34.801883] [DEBUG] [LOCAL ] NREF: Derivative data saved (1807 records). [2025-09-18T22:55:34.801995] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-09-18T22:55:34.802712] [INFO ] [MAIN ] NRK: Generated 1807 derivative records from 19672 primary records. [2025-09-18T22:55:34.806095] [INFO ] [MAIN ] Derivative Progress: 1312/2075 symbols completed. NREF took 1.1s. Estimated remaining: 4m 56s. Rate: 154.4 symbols/min [2025-09-18T22:55:34.807292] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-09-18T22:55:34.806402] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:34.834921] [DEBUG] [MAIN ] NRGV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:34.836692] [INFO ] [MAIN ] NRGV: Generated 1807 derivative records from 43067 primary records. [2025-09-18T22:55:34.837265] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-09-18T22:55:34.841075] [DEBUG] [LOCAL ] NRP: Loaded 4191 existing records from primary storage. [2025-09-18T22:55:34.841740] [INFO ] [MAIN ] NRP: Loaded 4191 primary data records. [2025-09-18T22:55:34.899999] [DEBUG] [LOCAL ] NRK: Derivative data saved (1807 records). [2025-09-18T22:55:34.917867] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-09-18T22:55:34.929543] [INFO ] [MAIN ] Derivative Progress: 1313/2075 symbols completed. NRK took 1.2s. Estimated remaining: 4m 56s. Rate: 154.5 symbols/min [2025-09-18T22:55:34.935342] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:34.999812] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1807 records). [2025-09-18T22:55:34.989144] [DEBUG] [LOCAL ] NRT: Loaded 4960 existing records from primary storage. [2025-09-18T22:55:35.036799] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-09-18T22:55:35.036913] [INFO ] [MAIN ] NRT: Loaded 4960 primary data records. [2025-09-18T22:55:35.039773] [INFO ] [MAIN ] Derivative Progress: 1314/2075 symbols completed. NRGV took 1.3s. Estimated remaining: 4m 55s. Rate: 154.6 symbols/min [2025-09-18T22:55:35.068743] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:35.276869] [DEBUG] [LOCAL ] NRUC: Loaded 3157 existing records from primary storage. [2025-09-18T22:55:35.277470] [INFO ] [MAIN ] NRUC: Loaded 3157 primary data records. [2025-09-18T22:55:35.818088] [DEBUG] [MAIN ] NRP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:35.819059] [INFO ] [MAIN ] NRP: Generated 1807 derivative records from 4191 primary records. [2025-09-18T22:55:35.819350] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-09-18T22:55:35.836228] [DEBUG] [LOCAL ] NRP: Derivative data saved (1807 records). [2025-09-18T22:55:35.836625] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-09-18T22:55:35.838949] [INFO ] [MAIN ] Derivative Progress: 1315/2075 symbols completed. NRP took 1.0s. Estimated remaining: 4m 55s. Rate: 154.4 symbols/min [2025-09-18T22:55:35.840665] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:35.855942] [DEBUG] [MAIN ] NRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:35.856695] [INFO ] [MAIN ] NRT: Generated 1807 derivative records from 4960 primary records. [2025-09-18T22:55:35.856854] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-09-18T22:55:35.885064] [DEBUG] [MAIN ] NRUC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:35.886795] [INFO ] [MAIN ] NRUC: Generated 1807 derivative records from 3157 primary records. [2025-09-18T22:55:35.886926] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-09-18T22:55:35.899608] [DEBUG] [LOCAL ] NRT: Derivative data saved (1807 records). [2025-09-18T22:55:35.899733] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-09-18T22:55:35.902779] [INFO ] [MAIN ] Derivative Progress: 1316/2075 symbols completed. NRT took 1.0s. Estimated remaining: 4m 55s. Rate: 154.5 symbols/min [2025-09-18T22:55:35.903707] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:35.917912] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1807 records). [2025-09-18T22:55:35.918087] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-09-18T22:55:35.921099] [INFO ] [MAIN ] Derivative Progress: 1317/2075 symbols completed. NRUC took 0.9s. Estimated remaining: 4m 54s. Rate: 154.7 symbols/min [2025-09-18T22:55:35.921441] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:35.936285] [DEBUG] [LOCAL ] NSA: Loaded 45170 existing records from primary storage. [2025-09-18T22:55:35.936428] [INFO ] [MAIN ] NSA: Loaded 45170 primary data records. [2025-09-18T22:55:36.062110] [DEBUG] [LOCAL ] NTB: Loaded 21077 existing records from primary storage. [2025-09-18T22:55:36.067860] [INFO ] [MAIN ] NTB: Loaded 21077 primary data records. [2025-09-18T22:55:36.201851] [DEBUG] [LOCAL ] NSP: Loaded 35194 existing records from primary storage. [2025-09-18T22:55:36.355464] [INFO ] [MAIN ] NSP: Loaded 35194 primary data records. [2025-09-18T22:55:36.930896] [DEBUG] [MAIN ] NSA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:36.931895] [INFO ] [MAIN ] NSA: Generated 1807 derivative records from 45170 primary records. [2025-09-18T22:55:36.932002] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-09-18T22:55:36.963862] [DEBUG] [MAIN ] NTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:36.965373] [INFO ] [MAIN ] NTB: Generated 1807 derivative records from 21077 primary records. [2025-09-18T22:55:36.965990] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-09-18T22:55:36.966447] [DEBUG] [LOCAL ] NSA: Derivative data saved (1807 records). [2025-09-18T22:55:36.966827] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-09-18T22:55:36.969125] [INFO ] [MAIN ] Derivative Progress: 1318/2075 symbols completed. NSA took 1.1s. Estimated remaining: 4m 54s. Rate: 154.5 symbols/min [2025-09-18T22:55:36.996368] [DEBUG] [MAIN ] NSP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:36.997510] [INFO ] [MAIN ] NSP: Generated 1807 derivative records from 35194 primary records. [2025-09-18T22:55:36.997783] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-09-18T22:55:37.012147] [DEBUG] [LOCAL ] NTB: Derivative data saved (1807 records). [2025-09-18T22:55:37.012484] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-09-18T22:55:37.015561] [INFO ] [MAIN ] Derivative Progress: 1319/2075 symbols completed. NTB took 1.1s. Estimated remaining: 4m 53s. Rate: 154.6 symbols/min [2025-09-18T22:55:37.019108] [DEBUG] [LOCAL ] NSP: Derivative data saved (1807 records). [2025-09-18T22:55:37.019171] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-09-18T22:55:37.021913] [INFO ] [MAIN ] Derivative Progress: 1320/2075 symbols completed. NSP took 1.1s. Estimated remaining: 4m 53s. Rate: 154.7 symbols/min [2025-09-18T22:55:37.022418] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:37.022504] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:37.023115] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:37.098707] [DEBUG] [LOCAL ] NTST: Loaded 43718 existing records from primary storage. [2025-09-18T22:55:37.099348] [INFO ] [MAIN ] NTST: Loaded 43718 primary data records. [2025-09-18T22:55:37.235474] [DEBUG] [LOCAL ] NU: Loaded 54136 existing records from primary storage. [2025-09-18T22:55:37.240262] [INFO ] [MAIN ] NU: Loaded 54136 primary data records. [2025-09-18T22:55:37.236115] [DEBUG] [LOCAL ] NTR: Loaded 53012 existing records from primary storage. [2025-09-18T22:55:37.240510] [INFO ] [MAIN ] NTR: Loaded 53012 primary data records. [2025-09-18T22:55:38.088881] [DEBUG] [MAIN ] NTST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:38.091380] [INFO ] [MAIN ] NTST: Generated 1807 derivative records from 43718 primary records. [2025-09-18T22:55:38.092277] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-09-18T22:55:38.121723] [DEBUG] [MAIN ] NU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:38.123008] [INFO ] [MAIN ] NU: Generated 1807 derivative records from 54136 primary records. [2025-09-18T22:55:38.123115] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-09-18T22:55:38.146728] [DEBUG] [LOCAL ] NTST: Derivative data saved (1807 records). [2025-09-18T22:55:38.146842] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-09-18T22:55:38.151154] [INFO ] [MAIN ] Derivative Progress: 1321/2075 symbols completed. NTST took 1.1s. Estimated remaining: 4m 53s. Rate: 154.5 symbols/min [2025-09-18T22:55:38.151876] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:38.151567] [DEBUG] [MAIN ] NTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:38.154487] [INFO ] [MAIN ] NTR: Generated 1807 derivative records from 53012 primary records. [2025-09-18T22:55:38.155051] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-09-18T22:55:38.173017] [DEBUG] [LOCAL ] NU: Derivative data saved (1807 records). [2025-09-18T22:55:38.173381] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-09-18T22:55:38.176230] [INFO ] [MAIN ] Derivative Progress: 1322/2075 symbols completed. NU took 1.2s. Estimated remaining: 4m 52s. Rate: 154.6 symbols/min [2025-09-18T22:55:38.176743] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:38.180154] [DEBUG] [LOCAL ] NTR: Derivative data saved (1807 records). [2025-09-18T22:55:38.180290] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-09-18T22:55:38.183212] [INFO ] [MAIN ] Derivative Progress: 1323/2075 symbols completed. NTR took 1.2s. Estimated remaining: 4m 52s. Rate: 154.7 symbols/min [2025-09-18T22:55:38.183618] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:38.220922] [DEBUG] [LOCAL ] NUV: Loaded 23212 existing records from primary storage. [2025-09-18T22:55:38.220484] [DEBUG] [LOCAL ] NUS: Loaded 36678 existing records from primary storage. [2025-09-18T22:55:38.221143] [INFO ] [MAIN ] NUS: Loaded 36678 primary data records. [2025-09-18T22:55:38.221082] [INFO ] [MAIN ] NUV: Loaded 23212 primary data records. [2025-09-18T22:55:38.772972] [DEBUG] [LOCAL ] NUVB: Loaded 51568 existing records from primary storage. [2025-09-18T22:55:38.773332] [INFO ] [MAIN ] NUVB: Loaded 51568 primary data records. [2025-09-18T22:55:39.229795] [DEBUG] [MAIN ] NUV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:39.231221] [INFO ] [MAIN ] NUV: Generated 1807 derivative records from 23212 primary records. [2025-09-18T22:55:39.231406] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-09-18T22:55:39.257623] [DEBUG] [MAIN ] NUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:39.261521] [INFO ] [MAIN ] NUS: Generated 1807 derivative records from 36678 primary records. [2025-09-18T22:55:39.264064] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-09-18T22:55:39.279618] [DEBUG] [LOCAL ] NUV: Derivative data saved (1807 records). [2025-09-18T22:55:39.279775] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-09-18T22:55:39.282214] [INFO ] [MAIN ] Derivative Progress: 1324/2075 symbols completed. NUV took 1.1s. Estimated remaining: 4m 52s. Rate: 154.5 symbols/min [2025-09-18T22:55:39.283057] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:39.290082] [DEBUG] [LOCAL ] NUS: Derivative data saved (1807 records). [2025-09-18T22:55:39.292128] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-09-18T22:55:39.307208] [INFO ] [MAIN ] Derivative Progress: 1325/2075 symbols completed. NUS took 1.2s. Estimated remaining: 4m 51s. Rate: 154.6 symbols/min [2025-09-18T22:55:39.307634] [DEBUG] [MAIN ] NUVB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:39.311774] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:39.312070] [DEBUG] [LOCAL ] NUW: Loaded 7549 existing records from primary storage. [2025-09-18T22:55:39.312234] [INFO ] [MAIN ] NUW: Loaded 7549 primary data records. [2025-09-18T22:55:39.318455] [INFO ] [MAIN ] NUVB: Generated 1807 derivative records from 51568 primary records. [2025-09-18T22:55:39.352037] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-09-18T22:55:39.636217] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1807 records). [2025-09-18T22:55:39.636354] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-09-18T22:55:39.652892] [INFO ] [MAIN ] Derivative Progress: 1326/2075 symbols completed. NUVB took 1.5s. Estimated remaining: 4m 51s. Rate: 154.6 symbols/min [2025-09-18T22:55:39.653906] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:39.666370] [DEBUG] [LOCAL ] NVG: Loaded 27443 existing records from primary storage. [2025-09-18T22:55:39.666960] [INFO ] [MAIN ] NVG: Loaded 27443 primary data records. [2025-09-18T22:55:39.865775] [DEBUG] [LOCAL ] NVGS: Loaded 31523 existing records from primary storage. [2025-09-18T22:55:39.976150] [INFO ] [MAIN ] NVGS: Loaded 31523 primary data records. [2025-09-18T22:55:40.115754] [DEBUG] [MAIN ] NUW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:40.120382] [INFO ] [MAIN ] NUW: Generated 1807 derivative records from 7549 primary records. [2025-09-18T22:55:40.136697] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-09-18T22:55:40.408262] [DEBUG] [LOCAL ] NUW: Derivative data saved (1807 records). [2025-09-18T22:55:40.409299] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-09-18T22:55:40.411367] [INFO ] [MAIN ] Derivative Progress: 1327/2075 symbols completed. NUW took 1.1s. Estimated remaining: 4m 51s. Rate: 154.5 symbols/min [2025-09-18T22:55:40.411824] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:40.428437] [DEBUG] [MAIN ] NVG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:40.429974] [INFO ] [MAIN ] NVG: Generated 1807 derivative records from 27443 primary records. [2025-09-18T22:55:40.430102] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-09-18T22:55:40.451824] [DEBUG] [LOCAL ] NVG: Derivative data saved (1807 records). [2025-09-18T22:55:40.451966] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-09-18T22:55:40.454494] [INFO ] [MAIN ] Derivative Progress: 1328/2075 symbols completed. NVG took 1.1s. Estimated remaining: 4m 50s. Rate: 154.6 symbols/min [2025-09-18T22:55:40.455083] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:40.474568] [DEBUG] [MAIN ] NVGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:40.489215] [INFO ] [MAIN ] NVGS: Generated 1807 derivative records from 31523 primary records. [2025-09-18T22:55:40.489514] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-09-18T22:55:40.530979] [DEBUG] [LOCAL ] NVR: Loaded 19706 existing records from primary storage. [2025-09-18T22:55:40.532887] [INFO ] [MAIN ] NVR: Loaded 19706 primary data records. [2025-09-18T22:55:40.534350] [DEBUG] [LOCAL ] NVO: Loaded 54174 existing records from primary storage. [2025-09-18T22:55:40.545803] [INFO ] [MAIN ] NVO: Loaded 54174 primary data records. [2025-09-18T22:55:40.556087] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1807 records). [2025-09-18T22:55:40.587093] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-09-18T22:55:40.610661] [INFO ] [MAIN ] Derivative Progress: 1329/2075 symbols completed. NVGS took 1.0s. Estimated remaining: 4m 49s. Rate: 154.6 symbols/min [2025-09-18T22:55:40.647950] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:41.180011] [DEBUG] [LOCAL ] NVRI: Loaded 39272 existing records from primary storage. [2025-09-18T22:55:41.181664] [INFO ] [MAIN ] NVRI: Loaded 39272 primary data records. [2025-09-18T22:55:41.527133] [DEBUG] [MAIN ] NVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:41.531020] [INFO ] [MAIN ] NVR: Generated 1807 derivative records from 19706 primary records. [2025-09-18T22:55:41.546773] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-09-18T22:55:41.547115] [DEBUG] [MAIN ] NVO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:41.549004] [INFO ] [MAIN ] NVO: Generated 1807 derivative records from 54174 primary records. [2025-09-18T22:55:41.549670] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-09-18T22:55:41.585863] [DEBUG] [LOCAL ] NVO: Derivative data saved (1807 records). [2025-09-18T22:55:41.586609] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-09-18T22:55:41.597189] [INFO ] [MAIN ] Derivative Progress: 1330/2075 symbols completed. NVO took 1.2s. Estimated remaining: 4m 49s. Rate: 154.5 symbols/min [2025-09-18T22:55:41.602806] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:41.602122] [DEBUG] [LOCAL ] NVR: Derivative data saved (1807 records). [2025-09-18T22:55:41.602983] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-09-18T22:55:41.603406] [DEBUG] [MAIN ] NVRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:41.605998] [INFO ] [MAIN ] Derivative Progress: 1331/2075 symbols completed. NVR took 1.2s. Estimated remaining: 4m 49s. Rate: 154.6 symbols/min [2025-09-18T22:55:41.607033] [INFO ] [MAIN ] NVRI: Generated 1807 derivative records from 39272 primary records. [2025-09-18T22:55:41.607239] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-09-18T22:55:41.607451] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:41.626415] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1807 records). [2025-09-18T22:55:41.626557] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-09-18T22:55:41.629273] [INFO ] [MAIN ] Derivative Progress: 1332/2075 symbols completed. NVRI took 1.0s. Estimated remaining: 4m 48s. Rate: 154.7 symbols/min [2025-09-18T22:55:41.629585] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:41.715519] [DEBUG] [LOCAL ] NVST: Loaded 52081 existing records from primary storage. [2025-09-18T22:55:41.716961] [DEBUG] [LOCAL ] NVS: Loaded 52098 existing records from primary storage. [2025-09-18T22:55:41.717233] [INFO ] [MAIN ] NVST: Loaded 52081 primary data records. [2025-09-18T22:55:41.717934] [INFO ] [MAIN ] NVS: Loaded 52098 primary data records. [2025-09-18T22:55:41.792578] [DEBUG] [LOCAL ] NVT: Loaded 52007 existing records from primary storage. [2025-09-18T22:55:41.861134] [INFO ] [MAIN ] NVT: Loaded 52007 primary data records. [2025-09-18T22:55:42.767879] [DEBUG] [MAIN ] NVST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:42.781471] [INFO ] [MAIN ] NVST: Generated 1807 derivative records from 52081 primary records. [2025-09-18T22:55:42.782019] [DEBUG] [MAIN ] NVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:42.782168] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-09-18T22:55:42.783284] [INFO ] [MAIN ] NVS: Generated 1807 derivative records from 52098 primary records. [2025-09-18T22:55:42.784043] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-09-18T22:55:42.827423] [DEBUG] [MAIN ] NVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:42.829765] [INFO ] [MAIN ] NVT: Generated 1807 derivative records from 52007 primary records. [2025-09-18T22:55:42.830130] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-09-18T22:55:42.830524] [DEBUG] [LOCAL ] NVST: Derivative data saved (1807 records). [2025-09-18T22:55:42.831499] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-09-18T22:55:42.834044] [INFO ] [MAIN ] Derivative Progress: 1333/2075 symbols completed. NVST took 1.2s. Estimated remaining: 4m 48s. Rate: 154.4 symbols/min [2025-09-18T22:55:42.849267] [DEBUG] [LOCAL ] NVS: Derivative data saved (1807 records). [2025-09-18T22:55:42.849830] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-09-18T22:55:42.851679] [INFO ] [MAIN ] Derivative Progress: 1334/2075 symbols completed. NVS took 1.2s. Estimated remaining: 4m 48s. Rate: 154.6 symbols/min [2025-09-18T22:55:42.854486] [DEBUG] [LOCAL ] NVT: Derivative data saved (1807 records). [2025-09-18T22:55:42.854560] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-09-18T22:55:42.857741] [INFO ] [MAIN ] Derivative Progress: 1335/2075 symbols completed. NVT took 1.2s. Estimated remaining: 4m 47s. Rate: 154.7 symbols/min [2025-09-18T22:55:42.858360] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:42.858487] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:42.858572] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:42.903627] [DEBUG] [LOCAL ] NWN: Loaded 27211 existing records from primary storage. [2025-09-18T22:55:42.903882] [INFO ] [MAIN ] NWN: Loaded 27211 primary data records. [2025-09-18T22:55:43.017436] [DEBUG] [LOCAL ] NX: Loaded 33687 existing records from primary storage. [2025-09-18T22:55:43.035469] [INFO ] [MAIN ] NX: Loaded 33687 primary data records. [2025-09-18T22:55:43.174992] [DEBUG] [LOCAL ] NWG: Loaded 52059 existing records from primary storage. [2025-09-18T22:55:43.222321] [INFO ] [MAIN ] NWG: Loaded 52059 primary data records. [2025-09-18T22:55:43.884950] [DEBUG] [MAIN ] NWN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:43.885779] [INFO ] [MAIN ] NWN: Generated 1807 derivative records from 27211 primary records. [2025-09-18T22:55:43.885880] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-09-18T22:55:43.919146] [DEBUG] [LOCAL ] NWN: Derivative data saved (1807 records). [2025-09-18T22:55:43.919761] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-09-18T22:55:43.920071] [DEBUG] [MAIN ] NX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:43.921887] [INFO ] [MAIN ] Derivative Progress: 1336/2075 symbols completed. NWN took 1.1s. Estimated remaining: 4m 47s. Rate: 154.5 symbols/min [2025-09-18T22:55:43.935041] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:43.930220] [INFO ] [MAIN ] NX: Generated 1807 derivative records from 33687 primary records. [2025-09-18T22:55:43.935738] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-09-18T22:55:43.936009] [DEBUG] [MAIN ] NWG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:43.937566] [INFO ] [MAIN ] NWG: Generated 1807 derivative records from 52059 primary records. [2025-09-18T22:55:43.937697] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-09-18T22:55:43.965470] [DEBUG] [LOCAL ] NXC: Loaded 4197 existing records from primary storage. [2025-09-18T22:55:43.966270] [INFO ] [MAIN ] NXC: Loaded 4197 primary data records. [2025-09-18T22:55:44.052247] [DEBUG] [LOCAL ] NX: Derivative data saved (1807 records). [2025-09-18T22:55:44.057487] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-09-18T22:55:44.066222] [INFO ] [MAIN ] Derivative Progress: 1337/2075 symbols completed. NX took 1.2s. Estimated remaining: 4m 47s. Rate: 154.5 symbols/min [2025-09-18T22:55:44.066727] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:44.079074] [DEBUG] [LOCAL ] NWG: Derivative data saved (1807 records). [2025-09-18T22:55:44.084980] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-09-18T22:55:44.087794] [INFO ] [MAIN ] Derivative Progress: 1338/2075 symbols completed. NWG took 1.2s. Estimated remaining: 4m 46s. Rate: 154.7 symbols/min [2025-09-18T22:55:44.122396] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:44.287909] [DEBUG] [LOCAL ] NXDT: Loaded 16690 existing records from primary storage. [2025-09-18T22:55:44.288574] [INFO ] [MAIN ] NXDT: Loaded 16690 primary data records. [2025-09-18T22:55:44.664188] [DEBUG] [LOCAL ] NXE: Loaded 53370 existing records from primary storage. [2025-09-18T22:55:44.664626] [INFO ] [MAIN ] NXE: Loaded 53370 primary data records. [2025-09-18T22:55:44.774939] [DEBUG] [MAIN ] NXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:44.786559] [INFO ] [MAIN ] NXC: Generated 1807 derivative records from 4197 primary records. [2025-09-18T22:55:44.786689] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-09-18T22:55:45.001716] [DEBUG] [LOCAL ] NXC: Derivative data saved (1807 records). [2025-09-18T22:55:45.002176] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-09-18T22:55:45.004305] [INFO ] [MAIN ] Derivative Progress: 1339/2075 symbols completed. NXC took 1.1s. Estimated remaining: 4m 46s. Rate: 154.5 symbols/min [2025-09-18T22:55:45.004878] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:45.027257] [DEBUG] [MAIN ] NXDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:45.029155] [INFO ] [MAIN ] NXDT: Generated 1807 derivative records from 16690 primary records. [2025-09-18T22:55:45.029347] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-09-18T22:55:45.041514] [DEBUG] [LOCAL ] NXG: Loaded 10679 existing records from primary storage. [2025-09-18T22:55:45.042750] [INFO ] [MAIN ] NXG: Loaded 10679 primary data records. [2025-09-18T22:55:45.159418] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1807 records). [2025-09-18T22:55:45.160464] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-09-18T22:55:45.163657] [INFO ] [MAIN ] Derivative Progress: 1340/2075 symbols completed. NXDT took 1.1s. Estimated remaining: 4m 45s. Rate: 154.6 symbols/min [2025-09-18T22:55:45.164018] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:45.235912] [DEBUG] [MAIN ] NXE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:45.256404] [INFO ] [MAIN ] NXE: Generated 1807 derivative records from 53370 primary records. [2025-09-18T22:55:45.359964] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-09-18T22:55:45.398599] [DEBUG] [LOCAL ] NXJ: Loaded 15048 existing records from primary storage. [2025-09-18T22:55:45.400012] [INFO ] [MAIN ] NXJ: Loaded 15048 primary data records. [2025-09-18T22:55:45.447480] [DEBUG] [LOCAL ] NXE: Derivative data saved (1807 records). [2025-09-18T22:55:45.474222] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-09-18T22:55:45.482161] [INFO ] [MAIN ] Derivative Progress: 1341/2075 symbols completed. NXE took 1.4s. Estimated remaining: 4m 45s. Rate: 154.6 symbols/min [2025-09-18T22:55:45.507285] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:45.543301] [DEBUG] [LOCAL ] NXN: Loaded 2344 existing records from primary storage. [2025-09-18T22:55:45.548739] [INFO ] [MAIN ] NXN: Loaded 2344 primary data records. [2025-09-18T22:55:45.936621] [DEBUG] [MAIN ] NXG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:45.967372] [INFO ] [MAIN ] NXG: Generated 1807 derivative records from 10679 primary records. [2025-09-18T22:55:45.972003] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-09-18T22:55:46.114300] [DEBUG] [LOCAL ] NXG: Derivative data saved (1807 records). [2025-09-18T22:55:46.115064] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-09-18T22:55:46.117754] [INFO ] [MAIN ] Derivative Progress: 1342/2075 symbols completed. NXG took 1.1s. Estimated remaining: 4m 45s. Rate: 154.5 symbols/min [2025-09-18T22:55:46.118290] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:46.138363] [DEBUG] [MAIN ] NXJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:46.142482] [INFO ] [MAIN ] NXJ: Generated 1807 derivative records from 15048 primary records. [2025-09-18T22:55:46.142617] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-09-18T22:55:46.159605] [DEBUG] [LOCAL ] NXP: Loaded 12338 existing records from primary storage. [2025-09-18T22:55:46.162751] [INFO ] [MAIN ] NXP: Loaded 12338 primary data records. [2025-09-18T22:55:46.233147] [DEBUG] [MAIN ] NXN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:46.248703] [INFO ] [MAIN ] NXN: Generated 1807 derivative records from 2344 primary records. [2025-09-18T22:55:46.249369] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-09-18T22:55:46.300627] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1807 records). [2025-09-18T22:55:46.317067] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-09-18T22:55:46.346884] [DEBUG] [LOCAL ] NXN: Derivative data saved (1807 records). [2025-09-18T22:55:46.346445] [INFO ] [MAIN ] Derivative Progress: 1343/2075 symbols completed. NXJ took 1.2s. Estimated remaining: 4m 44s. Rate: 154.6 symbols/min [2025-09-18T22:55:46.387444] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:46.355986] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-09-18T22:55:46.391086] [INFO ] [MAIN ] Derivative Progress: 1344/2075 symbols completed. NXN took 0.9s. Estimated remaining: 4m 44s. Rate: 154.7 symbols/min [2025-09-18T22:55:46.483321] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:46.570089] [DEBUG] [LOCAL ] NXRT: Loaded 19066 existing records from primary storage. [2025-09-18T22:55:46.570683] [INFO ] [MAIN ] NXRT: Loaded 19066 primary data records. [2025-09-18T22:55:46.777631] [DEBUG] [MAIN ] NXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:46.809353] [INFO ] [MAIN ] NXP: Generated 1807 derivative records from 12338 primary records. [2025-09-18T22:55:46.818406] [DEBUG] [LOCAL ] NYT: Loaded 50408 existing records from primary storage. [2025-09-18T22:55:46.817710] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-09-18T22:55:46.941352] [INFO ] [MAIN ] NYT: Loaded 50408 primary data records. [2025-09-18T22:55:47.086110] [DEBUG] [LOCAL ] NXP: Derivative data saved (1807 records). [2025-09-18T22:55:47.110551] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-09-18T22:55:47.122265] [INFO ] [MAIN ] Derivative Progress: 1345/2075 symbols completed. NXP took 1.0s. Estimated remaining: 4m 43s. Rate: 154.6 symbols/min [2025-09-18T22:55:47.153530] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:47.292858] [DEBUG] [MAIN ] NXRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:47.294251] [INFO ] [MAIN ] NXRT: Generated 1807 derivative records from 19066 primary records. [2025-09-18T22:55:47.295151] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-09-18T22:55:47.330490] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1807 records). [2025-09-18T22:55:47.332001] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-09-18T22:55:47.334165] [INFO ] [MAIN ] Derivative Progress: 1346/2075 symbols completed. NXRT took 1.0s. Estimated remaining: 4m 43s. Rate: 154.6 symbols/min [2025-09-18T22:55:47.331897] [DEBUG] [LOCAL ] NZF: Loaded 29501 existing records from primary storage. [2025-09-18T22:55:47.335390] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:47.335951] [INFO ] [MAIN ] NZF: Loaded 29501 primary data records. [2025-09-18T22:55:47.369929] [DEBUG] [MAIN ] NYT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:47.392914] [INFO ] [MAIN ] NYT: Generated 1807 derivative records from 50408 primary records. [2025-09-18T22:55:47.404952] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-09-18T22:55:47.670037] [DEBUG] [LOCAL ] NYT: Derivative data saved (1807 records). [2025-09-18T22:55:47.683287] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-09-18T22:55:47.686476] [INFO ] [MAIN ] Derivative Progress: 1347/2075 symbols completed. NYT took 1.3s. Estimated remaining: 4m 43s. Rate: 154.6 symbols/min [2025-09-18T22:55:47.687021] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:47.713365] [DEBUG] [LOCAL ] OBDC: Loaded 52021 existing records from primary storage. [2025-09-18T22:55:47.714012] [INFO ] [MAIN ] OBDC: Loaded 52021 primary data records. [2025-09-18T22:55:47.790563] [DEBUG] [LOCAL ] OBK: Loaded 16369 existing records from primary storage. [2025-09-18T22:55:47.808435] [INFO ] [MAIN ] OBK: Loaded 16369 primary data records. [2025-09-18T22:55:47.924319] [DEBUG] [MAIN ] NZF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:47.998327] [INFO ] [MAIN ] NZF: Generated 1807 derivative records from 29501 primary records. [2025-09-18T22:55:48.015236] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-09-18T22:55:48.416107] [DEBUG] [LOCAL ] NZF: Derivative data saved (1807 records). [2025-09-18T22:55:48.416584] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-09-18T22:55:48.418806] [INFO ] [MAIN ] Derivative Progress: 1348/2075 symbols completed. NZF took 1.3s. Estimated remaining: 4m 42s. Rate: 154.5 symbols/min [2025-09-18T22:55:48.439835] [DEBUG] [MAIN ] OBDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:48.440606] [INFO ] [MAIN ] OBDC: Generated 1807 derivative records from 52021 primary records. [2025-09-18T22:55:48.440780] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-09-18T22:55:48.470181] [DEBUG] [MAIN ] OBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:48.471487] [INFO ] [MAIN ] OBK: Generated 1807 derivative records from 16369 primary records. [2025-09-18T22:55:48.471835] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-09-18T22:55:48.482691] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1807 records). [2025-09-18T22:55:48.485304] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-09-18T22:55:48.487364] [INFO ] [MAIN ] Derivative Progress: 1349/2075 symbols completed. OBDC took 1.2s. Estimated remaining: 4m 42s. Rate: 154.6 symbols/min [2025-09-18T22:55:48.492116] [DEBUG] [LOCAL ] OBK: Derivative data saved (1807 records). [2025-09-18T22:55:48.492180] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-09-18T22:55:48.494788] [INFO ] [MAIN ] Derivative Progress: 1350/2075 symbols completed. OBK took 0.8s. Estimated remaining: 4m 41s. Rate: 154.7 symbols/min [2025-09-18T22:55:48.495393] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:48.496060] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:48.495635] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:48.509685] [DEBUG] [LOCAL ] ODC: Loaded 8577 existing records from primary storage. [2025-09-18T22:55:48.513337] [DEBUG] [LOCAL ] OCFT: Loaded 9485 existing records from primary storage. [2025-09-18T22:55:48.513443] [INFO ] [MAIN ] ODC: Loaded 8577 primary data records. [2025-09-18T22:55:48.524735] [INFO ] [MAIN ] OCFT: Loaded 9485 primary data records. [2025-09-18T22:55:49.020777] [DEBUG] [LOCAL ] OC: Loaded 45202 existing records from primary storage. [2025-09-18T22:55:49.024238] [INFO ] [MAIN ] OC: Loaded 45202 primary data records. [2025-09-18T22:55:49.476795] [DEBUG] [MAIN ] ODC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:49.478104] [INFO ] [MAIN ] ODC: Generated 1807 derivative records from 8577 primary records. [2025-09-18T22:55:49.478407] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-09-18T22:55:49.505105] [DEBUG] [MAIN ] OCFT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:49.506893] [INFO ] [MAIN ] OCFT: Generated 1807 derivative records from 9485 primary records. [2025-09-18T22:55:49.507106] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-09-18T22:55:49.525674] [DEBUG] [LOCAL ] ODC: Derivative data saved (1807 records). [2025-09-18T22:55:49.526421] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-09-18T22:55:49.529369] [INFO ] [MAIN ] Derivative Progress: 1351/2075 symbols completed. ODC took 1.0s. Estimated remaining: 4m 41s. Rate: 154.5 symbols/min [2025-09-18T22:55:49.529724] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:49.544986] [DEBUG] [MAIN ] OC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:49.547029] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1807 records). [2025-09-18T22:55:49.546568] [INFO ] [MAIN ] OC: Generated 1807 derivative records from 45202 primary records. [2025-09-18T22:55:49.547239] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-09-18T22:55:49.547345] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-09-18T22:55:49.549478] [INFO ] [MAIN ] Derivative Progress: 1352/2075 symbols completed. OCFT took 1.1s. Estimated remaining: 4m 41s. Rate: 154.6 symbols/min [2025-09-18T22:55:49.550514] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:49.572585] [DEBUG] [LOCAL ] OC: Derivative data saved (1807 records). [2025-09-18T22:55:49.572801] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-09-18T22:55:49.575406] [INFO ] [MAIN ] Derivative Progress: 1353/2075 symbols completed. OC took 1.1s. Estimated remaining: 4m 40s. Rate: 154.7 symbols/min [2025-09-18T22:55:49.575858] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:49.594022] [DEBUG] [LOCAL ] ODV: Loaded 25045 existing records from primary storage. [2025-09-18T22:55:49.594361] [INFO ] [MAIN ] ODV: Loaded 25045 primary data records. [2025-09-18T22:55:49.647007] [DEBUG] [LOCAL ] OFG: Loaded 22555 existing records from primary storage. [2025-09-18T22:55:49.685863] [INFO ] [MAIN ] OFG: Loaded 22555 primary data records. [2025-09-18T22:55:50.129992] [DEBUG] [LOCAL ] OGE: Loaded 47015 existing records from primary storage. [2025-09-18T22:55:50.148136] [INFO ] [MAIN ] OGE: Loaded 47015 primary data records. [2025-09-18T22:55:50.650665] [DEBUG] [MAIN ] ODV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:50.663075] [DEBUG] [MAIN ] OFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:50.663883] [INFO ] [MAIN ] ODV: Generated 1807 derivative records from 25045 primary records. [2025-09-18T22:55:50.664570] [INFO ] [MAIN ] OFG: Generated 1807 derivative records from 22555 primary records. [2025-09-18T22:55:50.665060] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-09-18T22:55:50.665132] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-09-18T22:55:50.698709] [DEBUG] [LOCAL ] ODV: Derivative data saved (1807 records). [2025-09-18T22:55:50.699102] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-09-18T22:55:50.702359] [INFO ] [MAIN ] Derivative Progress: 1354/2075 symbols completed. ODV took 1.2s. Estimated remaining: 4m 40s. Rate: 154.5 symbols/min [2025-09-18T22:55:50.702869] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:50.703203] [DEBUG] [LOCAL ] OFG: Derivative data saved (1807 records). [2025-09-18T22:55:50.703431] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-09-18T22:55:50.706409] [INFO ] [MAIN ] Derivative Progress: 1355/2075 symbols completed. OFG took 1.2s. Estimated remaining: 4m 39s. Rate: 154.6 symbols/min [2025-09-18T22:55:50.707722] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:50.721670] [DEBUG] [MAIN ] OGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:50.722425] [INFO ] [MAIN ] OGE: Generated 1807 derivative records from 47015 primary records. [2025-09-18T22:55:50.722527] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-09-18T22:55:50.743497] [DEBUG] [LOCAL ] OGE: Derivative data saved (1807 records). [2025-09-18T22:55:50.743674] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-09-18T22:55:50.746575] [INFO ] [MAIN ] Derivative Progress: 1356/2075 symbols completed. OGE took 1.2s. Estimated remaining: 4m 39s. Rate: 154.7 symbols/min [2025-09-18T22:55:50.746919] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:50.772114] [DEBUG] [LOCAL ] OGS: Loaded 34167 existing records from primary storage. [2025-09-18T22:55:50.784885] [INFO ] [MAIN ] OGS: Loaded 34167 primary data records. [2025-09-18T22:55:50.926784] [DEBUG] [LOCAL ] OGN: Loaded 53519 existing records from primary storage. [2025-09-18T22:55:50.937350] [INFO ] [MAIN ] OGN: Loaded 53519 primary data records. [2025-09-18T22:55:51.036102] [DEBUG] [LOCAL ] OHI: Loaded 52527 existing records from primary storage. [2025-09-18T22:55:51.069632] [INFO ] [MAIN ] OHI: Loaded 52527 primary data records. [2025-09-18T22:55:51.794873] [DEBUG] [MAIN ] OGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:51.797539] [INFO ] [MAIN ] OGS: Generated 1807 derivative records from 34167 primary records. [2025-09-18T22:55:51.798052] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-09-18T22:55:51.831112] [DEBUG] [MAIN ] OGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:51.832617] [INFO ] [MAIN ] OGN: Generated 1807 derivative records from 53519 primary records. [2025-09-18T22:55:51.833580] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-09-18T22:55:51.851156] [DEBUG] [LOCAL ] OGS: Derivative data saved (1807 records). [2025-09-18T22:55:51.851307] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-09-18T22:55:51.853774] [INFO ] [MAIN ] Derivative Progress: 1357/2075 symbols completed. OGS took 1.1s. Estimated remaining: 4m 39s. Rate: 154.5 symbols/min [2025-09-18T22:55:51.855790] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:51.879953] [DEBUG] [MAIN ] OHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:51.880092] [DEBUG] [LOCAL ] OGN: Derivative data saved (1807 records). [2025-09-18T22:55:51.881380] [INFO ] [MAIN ] OHI: Generated 1807 derivative records from 52527 primary records. [2025-09-18T22:55:51.881565] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-09-18T22:55:51.884430] [INFO ] [MAIN ] Derivative Progress: 1358/2075 symbols completed. OGN took 1.2s. Estimated remaining: 4m 38s. Rate: 154.6 symbols/min [2025-09-18T22:55:51.884961] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:51.884681] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-09-18T22:55:51.907281] [DEBUG] [LOCAL ] OHI: Derivative data saved (1807 records). [2025-09-18T22:55:51.907567] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-09-18T22:55:51.910216] [INFO ] [MAIN ] Derivative Progress: 1359/2075 symbols completed. OHI took 1.2s. Estimated remaining: 4m 38s. Rate: 154.7 symbols/min [2025-09-18T22:55:51.910556] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:51.916375] [DEBUG] [LOCAL ] OIA: Loaded 13868 existing records from primary storage. [2025-09-18T22:55:51.916715] [INFO ] [MAIN ] OIA: Loaded 13868 primary data records. [2025-09-18T22:55:52.112419] [DEBUG] [LOCAL ] OI: Loaded 47781 existing records from primary storage. [2025-09-18T22:55:52.257995] [INFO ] [MAIN ] OI: Loaded 47781 primary data records. [2025-09-18T22:55:52.384918] [DEBUG] [LOCAL ] OII: Loaded 43473 existing records from primary storage. [2025-09-18T22:55:52.396635] [INFO ] [MAIN ] OII: Loaded 43473 primary data records. [2025-09-18T22:55:52.961843] [DEBUG] [MAIN ] OIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:52.962738] [INFO ] [MAIN ] OIA: Generated 1807 derivative records from 13868 primary records. [2025-09-18T22:55:52.962864] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-09-18T22:55:52.984430] [DEBUG] [LOCAL ] OIA: Derivative data saved (1807 records). [2025-09-18T22:55:52.985271] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-09-18T22:55:52.987485] [INFO ] [MAIN ] Derivative Progress: 1360/2075 symbols completed. OIA took 1.1s. Estimated remaining: 4m 38s. Rate: 154.5 symbols/min [2025-09-18T22:55:52.988056] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:53.006908] [DEBUG] [MAIN ] OI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:53.007626] [INFO ] [MAIN ] OI: Generated 1807 derivative records from 47781 primary records. [2025-09-18T22:55:53.012124] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-09-18T22:55:53.037795] [DEBUG] [MAIN ] OII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:53.039528] [INFO ] [MAIN ] OII: Generated 1807 derivative records from 43473 primary records. [2025-09-18T22:55:53.040790] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-09-18T22:55:53.060665] [DEBUG] [LOCAL ] OI: Derivative data saved (1807 records). [2025-09-18T22:55:53.064181] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-09-18T22:55:53.068228] [INFO ] [MAIN ] Derivative Progress: 1361/2075 symbols completed. OI took 1.2s. Estimated remaining: 4m 37s. Rate: 154.6 symbols/min [2025-09-18T22:55:53.068804] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:53.084970] [DEBUG] [LOCAL ] OII: Derivative data saved (1807 records). [2025-09-18T22:55:53.085418] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-09-18T22:55:53.085093] [DEBUG] [LOCAL ] OIS: Loaded 41276 existing records from primary storage. [2025-09-18T22:55:53.088268] [INFO ] [MAIN ] OIS: Loaded 41276 primary data records. [2025-09-18T22:55:53.088127] [INFO ] [MAIN ] Derivative Progress: 1362/2075 symbols completed. OII took 1.2s. Estimated remaining: 4m 36s. Rate: 154.7 symbols/min [2025-09-18T22:55:53.088551] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:53.435810] [DEBUG] [LOCAL ] OKE: Loaded 53926 existing records from primary storage. [2025-09-18T22:55:53.436764] [INFO ] [MAIN ] OKE: Loaded 53926 primary data records. [2025-09-18T22:55:53.559178] [DEBUG] [LOCAL ] OLN: Loaded 52099 existing records from primary storage. [2025-09-18T22:55:53.560403] [INFO ] [MAIN ] OLN: Loaded 52099 primary data records. [2025-09-18T22:55:54.102796] [DEBUG] [MAIN ] OIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:54.104639] [INFO ] [MAIN ] OIS: Generated 1807 derivative records from 41276 primary records. [2025-09-18T22:55:54.104852] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-09-18T22:55:54.126772] [DEBUG] [LOCAL ] OIS: Derivative data saved (1807 records). [2025-09-18T22:55:54.129690] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-09-18T22:55:54.132103] [INFO ] [MAIN ] Derivative Progress: 1363/2075 symbols completed. OIS took 1.1s. Estimated remaining: 4m 36s. Rate: 154.6 symbols/min [2025-09-18T22:55:54.149932] [DEBUG] [MAIN ] OKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:54.151244] [INFO ] [MAIN ] OKE: Generated 1807 derivative records from 53926 primary records. [2025-09-18T22:55:54.151368] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-09-18T22:55:54.182911] [DEBUG] [MAIN ] OLN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:54.184592] [DEBUG] [LOCAL ] OKE: Derivative data saved (1807 records). [2025-09-18T22:55:54.184302] [INFO ] [MAIN ] OLN: Generated 1807 derivative records from 52099 primary records. [2025-09-18T22:55:54.184755] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-09-18T22:55:54.184834] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-09-18T22:55:54.186943] [INFO ] [MAIN ] Derivative Progress: 1364/2075 symbols completed. OKE took 1.1s. Estimated remaining: 4m 36s. Rate: 154.6 symbols/min [2025-09-18T22:55:54.204148] [DEBUG] [LOCAL ] OLN: Derivative data saved (1807 records). [2025-09-18T22:55:54.204287] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-09-18T22:55:54.207113] [INFO ] [MAIN ] Derivative Progress: 1365/2075 symbols completed. OLN took 1.1s. Estimated remaining: 4m 35s. Rate: 154.8 symbols/min [2025-09-18T22:55:54.208095] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:54.208019] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:54.207789] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:54.223584] [DEBUG] [LOCAL ] OLP: Loaded 9715 existing records from primary storage. [2025-09-18T22:55:54.223790] [INFO ] [MAIN ] OLP: Loaded 9715 primary data records. [2025-09-18T22:55:54.624974] [DEBUG] [LOCAL ] OMC: Loaded 53682 existing records from primary storage. [2025-09-18T22:55:54.625501] [INFO ] [MAIN ] OMC: Loaded 53682 primary data records. [2025-09-18T22:55:54.681401] [DEBUG] [LOCAL ] OMF: Loaded 46657 existing records from primary storage. [2025-09-18T22:55:54.690008] [INFO ] [MAIN ] OMF: Loaded 46657 primary data records. [2025-09-18T22:55:55.273213] [DEBUG] [MAIN ] OLP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:55.275483] [INFO ] [MAIN ] OLP: Generated 1807 derivative records from 9715 primary records. [2025-09-18T22:55:55.276358] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-09-18T22:55:55.297921] [DEBUG] [LOCAL ] OLP: Derivative data saved (1807 records). [2025-09-18T22:55:55.298226] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-09-18T22:55:55.300834] [INFO ] [MAIN ] Derivative Progress: 1366/2075 symbols completed. OLP took 1.1s. Estimated remaining: 4m 35s. Rate: 154.5 symbols/min [2025-09-18T22:55:55.301353] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:55.318811] [DEBUG] [MAIN ] OMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:55.319691] [INFO ] [MAIN ] OMC: Generated 1807 derivative records from 53682 primary records. [2025-09-18T22:55:55.319823] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-09-18T22:55:55.338557] [DEBUG] [LOCAL ] OMC: Derivative data saved (1807 records). [2025-09-18T22:55:55.338856] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-09-18T22:55:55.340937] [INFO ] [MAIN ] Derivative Progress: 1367/2075 symbols completed. OMC took 1.1s. Estimated remaining: 4m 35s. Rate: 154.7 symbols/min [2025-09-18T22:55:55.341410] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:55.354674] [DEBUG] [MAIN ] OMF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:55.355451] [INFO ] [MAIN ] OMF: Generated 1807 derivative records from 46657 primary records. [2025-09-18T22:55:55.355741] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-09-18T22:55:55.383699] [DEBUG] [LOCAL ] OMF: Derivative data saved (1807 records). [2025-09-18T22:55:55.387203] [DEBUG] [LOCAL ] ONIT: Loaded 7870 existing records from primary storage. [2025-09-18T22:55:55.387557] [INFO ] [MAIN ] ONIT: Loaded 7870 primary data records. [2025-09-18T22:55:55.387437] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-09-18T22:55:55.402965] [INFO ] [MAIN ] Derivative Progress: 1368/2075 symbols completed. OMF took 1.2s. Estimated remaining: 4m 34s. Rate: 154.7 symbols/min [2025-09-18T22:55:55.440922] [DEBUG] [LOCAL ] OMI: Loaded 46242 existing records from primary storage. [2025-09-18T22:55:55.475485] [INFO ] [MAIN ] OMI: Loaded 46242 primary data records. [2025-09-18T22:55:55.482632] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:56.026657] [DEBUG] [LOCAL ] ONL: Loaded 32442 existing records from primary storage. [2025-09-18T22:55:56.032166] [INFO ] [MAIN ] ONL: Loaded 32442 primary data records. [2025-09-18T22:55:56.433534] [DEBUG] [MAIN ] ONIT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:55:56.435223] [INFO ] [MAIN ] ONIT: Generated 1806 derivative records from 7870 primary records. [2025-09-18T22:55:56.436144] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-09-18T22:55:56.456226] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1806 records). [2025-09-18T22:55:56.456430] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-09-18T22:55:56.459411] [INFO ] [MAIN ] Derivative Progress: 1369/2075 symbols completed. ONIT took 1.1s. Estimated remaining: 4m 34s. Rate: 154.6 symbols/min [2025-09-18T22:55:56.460273] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:56.475112] [DEBUG] [MAIN ] OMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:56.475968] [INFO ] [MAIN ] OMI: Generated 1807 derivative records from 46242 primary records. [2025-09-18T22:55:56.476410] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-09-18T22:55:56.512001] [DEBUG] [LOCAL ] OMI: Derivative data saved (1807 records). [2025-09-18T22:55:56.513005] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-09-18T22:55:56.515970] [INFO ] [MAIN ] Derivative Progress: 1370/2075 symbols completed. OMI took 1.2s. Estimated remaining: 4m 34s. Rate: 154.6 symbols/min [2025-09-18T22:55:56.516409] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:56.517167] [DEBUG] [MAIN ] ONL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:56.518815] [INFO ] [MAIN ] ONL: Generated 1807 derivative records from 32442 primary records. [2025-09-18T22:55:56.519040] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-09-18T22:55:56.537362] [DEBUG] [LOCAL ] ONL: Derivative data saved (1807 records). [2025-09-18T22:55:56.537551] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-09-18T22:55:56.540307] [INFO ] [MAIN ] Derivative Progress: 1371/2075 symbols completed. ONL took 1.1s. Estimated remaining: 4m 33s. Rate: 154.8 symbols/min [2025-09-18T22:55:56.540772] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:56.570591] [DEBUG] [LOCAL ] ONTF: Loaded 23257 existing records from primary storage. [2025-09-18T22:55:56.570814] [INFO ] [MAIN ] ONTF: Loaded 23257 primary data records. [2025-09-18T22:55:56.696485] [DEBUG] [LOCAL ] ONON: Loaded 54003 existing records from primary storage. [2025-09-18T22:55:56.702742] [INFO ] [MAIN ] ONON: Loaded 54003 primary data records. [2025-09-18T22:55:57.050702] [DEBUG] [LOCAL ] ONTO: Loaded 46859 existing records from primary storage. [2025-09-18T22:55:57.073463] [INFO ] [MAIN ] ONTO: Loaded 46859 primary data records. [2025-09-18T22:55:57.574212] [DEBUG] [MAIN ] ONON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:57.576123] [INFO ] [MAIN ] ONON: Generated 1807 derivative records from 54003 primary records. [2025-09-18T22:55:57.576289] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-09-18T22:55:57.591593] [DEBUG] [MAIN ] ONTF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:57.603958] [INFO ] [MAIN ] ONTF: Generated 1807 derivative records from 23257 primary records. [2025-09-18T22:55:57.604091] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-09-18T22:55:57.629154] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1807 records). [2025-09-18T22:55:57.629037] [DEBUG] [LOCAL ] ONON: Derivative data saved (1807 records). [2025-09-18T22:55:57.630148] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-09-18T22:55:57.632785] [INFO ] [MAIN ] Derivative Progress: 1372/2075 symbols completed. ONON took 1.2s. Estimated remaining: 4m 33s. Rate: 154.5 symbols/min [2025-09-18T22:55:57.630500] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-09-18T22:55:57.642962] [INFO ] [MAIN ] Derivative Progress: 1373/2075 symbols completed. ONTF took 1.1s. Estimated remaining: 4m 32s. Rate: 154.7 symbols/min [2025-09-18T22:55:57.648224] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:57.648436] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:57.649956] [DEBUG] [MAIN ] ONTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:57.651518] [INFO ] [MAIN ] ONTO: Generated 1807 derivative records from 46859 primary records. [2025-09-18T22:55:57.651592] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-09-18T22:55:57.670109] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1807 records). [2025-09-18T22:55:57.670247] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-09-18T22:55:57.677663] [INFO ] [MAIN ] Derivative Progress: 1374/2075 symbols completed. ONTO took 1.1s. Estimated remaining: 4m 32s. Rate: 154.8 symbols/min [2025-09-18T22:55:57.682524] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:57.691560] [DEBUG] [LOCAL ] OOMA: Loaded 19339 existing records from primary storage. [2025-09-18T22:55:57.691733] [INFO ] [MAIN ] OOMA: Loaded 19339 primary data records. [2025-09-18T22:55:57.731373] [DEBUG] [LOCAL ] OPAD: Loaded 19002 existing records from primary storage. [2025-09-18T22:55:57.737065] [INFO ] [MAIN ] OPAD: Loaded 19002 primary data records. [2025-09-18T22:55:58.056938] [DEBUG] [LOCAL ] OPFI: Loaded 47184 existing records from primary storage. [2025-09-18T22:55:58.129403] [INFO ] [MAIN ] OPFI: Loaded 47184 primary data records. [2025-09-18T22:55:58.781576] [DEBUG] [MAIN ] OOMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:58.781267] [DEBUG] [MAIN ] OPAD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:58.782483] [INFO ] [MAIN ] OOMA: Generated 1807 derivative records from 19339 primary records. [2025-09-18T22:55:58.782592] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-09-18T22:55:58.783195] [INFO ] [MAIN ] OPAD: Generated 1807 derivative records from 19002 primary records. [2025-09-18T22:55:58.784055] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-09-18T22:55:58.815477] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1807 records). [2025-09-18T22:55:58.816235] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1807 records). [2025-09-18T22:55:58.816496] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-09-18T22:55:58.816435] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-09-18T22:55:58.818866] [INFO ] [MAIN ] Derivative Progress: 1375/2075 symbols completed. OOMA took 1.2s. Estimated remaining: 4m 32s. Rate: 154.5 symbols/min [2025-09-18T22:55:58.821332] [INFO ] [MAIN ] Derivative Progress: 1376/2075 symbols completed. OPAD took 1.2s. Estimated remaining: 4m 31s. Rate: 154.7 symbols/min [2025-09-18T22:55:58.821273] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:58.822599] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:58.843764] [DEBUG] [MAIN ] OPFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:58.844819] [INFO ] [MAIN ] OPFI: Generated 1807 derivative records from 47184 primary records. [2025-09-18T22:55:58.844998] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-09-18T22:55:58.862320] [DEBUG] [LOCAL ] OPP: Loaded 11864 existing records from primary storage. [2025-09-18T22:55:58.862948] [INFO ] [MAIN ] OPP: Loaded 11864 primary data records. [2025-09-18T22:55:58.984840] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1807 records). [2025-09-18T22:55:58.985023] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-09-18T22:55:58.988073] [INFO ] [MAIN ] Derivative Progress: 1377/2075 symbols completed. OPFI took 1.3s. Estimated remaining: 4m 31s. Rate: 154.7 symbols/min [2025-09-18T22:55:59.009478] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:59.198512] [DEBUG] [LOCAL ] OR: Loaded 46253 existing records from primary storage. [2025-09-18T22:55:59.199590] [INFO ] [MAIN ] OR: Loaded 46253 primary data records. [2025-09-18T22:55:59.541943] [DEBUG] [LOCAL ] ORC: Loaded 52643 existing records from primary storage. [2025-09-18T22:55:59.542467] [INFO ] [MAIN ] ORC: Loaded 52643 primary data records. [2025-09-18T22:55:59.621527] [DEBUG] [MAIN ] OPP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:59.639280] [INFO ] [MAIN ] OPP: Generated 1807 derivative records from 11864 primary records. [2025-09-18T22:55:59.639390] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-09-18T22:55:59.867262] [DEBUG] [LOCAL ] OPP: Derivative data saved (1807 records). [2025-09-18T22:55:59.881511] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-09-18T22:55:59.884268] [INFO ] [MAIN ] Derivative Progress: 1378/2075 symbols completed. OPP took 1.1s. Estimated remaining: 4m 31s. Rate: 154.6 symbols/min [2025-09-18T22:55:59.901710] [DEBUG] [MAIN ] OR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:59.902671] [INFO ] [MAIN ] OR: Generated 1807 derivative records from 46253 primary records. [2025-09-18T22:55:59.902839] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-09-18T22:55:59.921191] [DEBUG] [LOCAL ] OR: Derivative data saved (1807 records). [2025-09-18T22:55:59.921421] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-09-18T22:55:59.925324] [INFO ] [MAIN ] Derivative Progress: 1379/2075 symbols completed. OR took 1.1s. Estimated remaining: 4m 30s. Rate: 154.7 symbols/min [2025-09-18T22:55:59.938598] [DEBUG] [MAIN ] ORC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:55:59.939182] [INFO ] [MAIN ] ORC: Generated 1807 derivative records from 52643 primary records. [2025-09-18T22:55:59.939246] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-09-18T22:55:59.954202] [DEBUG] [LOCAL ] ORC: Derivative data saved (1807 records). [2025-09-18T22:55:59.954267] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-09-18T22:55:59.956387] [INFO ] [MAIN ] Derivative Progress: 1380/2075 symbols completed. ORC took 1.0s. Estimated remaining: 4m 29s. Rate: 154.8 symbols/min [2025-09-18T22:55:59.957091] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:59.957163] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:59.957678] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:55:59.989832] [DEBUG] [LOCAL ] ORN: Loaded 32121 existing records from primary storage. [2025-09-18T22:55:59.989973] [INFO ] [MAIN ] ORN: Loaded 32121 primary data records. [2025-09-18T22:56:00.232863] [DEBUG] [LOCAL ] OTIS: Loaded 53104 existing records from primary storage. [2025-09-18T22:56:00.238378] [INFO ] [MAIN ] OTIS: Loaded 53104 primary data records. [2025-09-18T22:56:00.413458] [DEBUG] [LOCAL ] OSCR: Loaded 54085 existing records from primary storage. [2025-09-18T22:56:00.442253] [INFO ] [MAIN ] OSCR: Loaded 54085 primary data records. [2025-09-18T22:56:01.088512] [DEBUG] [MAIN ] ORN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:01.090000] [INFO ] [MAIN ] ORN: Generated 1807 derivative records from 32121 primary records. [2025-09-18T22:56:01.090291] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-09-18T22:56:01.141571] [DEBUG] [LOCAL ] ORN: Derivative data saved (1807 records). [2025-09-18T22:56:01.141058] [DEBUG] [MAIN ] OSCR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:01.141472] [DEBUG] [MAIN ] OTIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:01.143379] [INFO ] [MAIN ] OSCR: Generated 1807 derivative records from 54085 primary records. [2025-09-18T22:56:01.141768] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-09-18T22:56:01.143723] [INFO ] [MAIN ] OTIS: Generated 1807 derivative records from 53104 primary records. [2025-09-18T22:56:01.146309] [INFO ] [MAIN ] Derivative Progress: 1381/2075 symbols completed. ORN took 1.2s. Estimated remaining: 4m 29s. Rate: 154.5 symbols/min [2025-09-18T22:56:01.143801] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-09-18T22:56:01.146775] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:01.146885] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-09-18T22:56:01.177833] [DEBUG] [LOCAL ] OTIS: Derivative data saved (1807 records). [2025-09-18T22:56:01.177983] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-09-18T22:56:01.180516] [INFO ] [MAIN ] Derivative Progress: 1382/2075 symbols completed. OTIS took 1.2s. Estimated remaining: 4m 29s. Rate: 154.6 symbols/min [2025-09-18T22:56:01.181625] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:01.188157] [DEBUG] [LOCAL ] OSCR: Derivative data saved (1807 records). [2025-09-18T22:56:01.188294] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-09-18T22:56:01.190868] [INFO ] [MAIN ] Derivative Progress: 1383/2075 symbols completed. OSCR took 1.2s. Estimated remaining: 4m 28s. Rate: 154.8 symbols/min [2025-09-18T22:56:01.191315] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:01.247629] [DEBUG] [LOCAL ] OUT: Loaded 48633 existing records from primary storage. [2025-09-18T22:56:01.248004] [INFO ] [MAIN ] OUT: Loaded 48633 primary data records. [2025-09-18T22:56:01.413126] [DEBUG] [LOCAL ] OWL: Loaded 53946 existing records from primary storage. [2025-09-18T22:56:01.424619] [DEBUG] [LOCAL ] OVV: Loaded 53906 existing records from primary storage. [2025-09-18T22:56:01.450917] [INFO ] [MAIN ] OVV: Loaded 53906 primary data records. [2025-09-18T22:56:01.460304] [INFO ] [MAIN ] OWL: Loaded 53946 primary data records. [2025-09-18T22:56:02.261828] [DEBUG] [MAIN ] OUT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:02.262876] [INFO ] [MAIN ] OUT: Generated 1807 derivative records from 48633 primary records. [2025-09-18T22:56:02.263789] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-09-18T22:56:02.281775] [DEBUG] [LOCAL ] OUT: Derivative data saved (1807 records). [2025-09-18T22:56:02.283460] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-09-18T22:56:02.286357] [INFO ] [MAIN ] Derivative Progress: 1384/2075 symbols completed. OUT took 1.1s. Estimated remaining: 4m 28s. Rate: 154.5 symbols/min [2025-09-18T22:56:02.286762] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:02.301886] [DEBUG] [MAIN ] OVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:02.310496] [INFO ] [MAIN ] OVV: Generated 1807 derivative records from 53906 primary records. [2025-09-18T22:56:02.314715] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-09-18T22:56:02.316509] [DEBUG] [MAIN ] OWL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:02.330128] [INFO ] [MAIN ] OWL: Generated 1807 derivative records from 53946 primary records. [2025-09-18T22:56:02.330268] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-09-18T22:56:02.344102] [DEBUG] [LOCAL ] OWLT: Loaded 8877 existing records from primary storage. [2025-09-18T22:56:02.348536] [INFO ] [MAIN ] OWLT: Loaded 8877 primary data records. [2025-09-18T22:56:02.364725] [DEBUG] [LOCAL ] OWL: Derivative data saved (1807 records). [2025-09-18T22:56:02.374707] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-09-18T22:56:02.377525] [INFO ] [MAIN ] Derivative Progress: 1385/2075 symbols completed. OWL took 1.2s. Estimated remaining: 4m 28s. Rate: 154.6 symbols/min [2025-09-18T22:56:02.389327] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:02.443889] [DEBUG] [LOCAL ] OVV: Derivative data saved (1807 records). [2025-09-18T22:56:02.456341] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-09-18T22:56:02.470753] [INFO ] [MAIN ] Derivative Progress: 1386/2075 symbols completed. OVV took 1.3s. Estimated remaining: 4m 27s. Rate: 154.7 symbols/min [2025-09-18T22:56:02.476833] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:02.729563] [DEBUG] [LOCAL ] OXM: Loaded 33885 existing records from primary storage. [2025-09-18T22:56:02.729931] [INFO ] [MAIN ] OXM: Loaded 33885 primary data records. [2025-09-18T22:56:02.966431] [DEBUG] [LOCAL ] PAAS: Loaded 53993 existing records from primary storage. [2025-09-18T22:56:03.092465] [INFO ] [MAIN ] PAAS: Loaded 53993 primary data records. [2025-09-18T22:56:03.205619] [DEBUG] [MAIN ] OWLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:03.214762] [INFO ] [MAIN ] OWLT: Generated 1807 derivative records from 8877 primary records. [2025-09-18T22:56:03.214923] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-09-18T22:56:03.317158] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1807 records). [2025-09-18T22:56:03.317735] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-09-18T22:56:03.320002] [INFO ] [MAIN ] Derivative Progress: 1387/2075 symbols completed. OWLT took 1.0s. Estimated remaining: 4m 27s. Rate: 154.6 symbols/min [2025-09-18T22:56:03.456835] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:03.483352] [DEBUG] [MAIN ] OXM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:03.485264] [INFO ] [MAIN ] OXM: Generated 1807 derivative records from 33885 primary records. [2025-09-18T22:56:03.490895] [DEBUG] [LOCAL ] PAC: Loaded 11748 existing records from primary storage. [2025-09-18T22:56:03.491043] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-09-18T22:56:03.492036] [INFO ] [MAIN ] PAC: Loaded 11748 primary data records. [2025-09-18T22:56:03.620698] [DEBUG] [LOCAL ] OXM: Derivative data saved (1807 records). [2025-09-18T22:56:03.627078] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-09-18T22:56:03.645834] [INFO ] [MAIN ] Derivative Progress: 1388/2075 symbols completed. OXM took 1.3s. Estimated remaining: 4m 27s. Rate: 154.6 symbols/min [2025-09-18T22:56:03.665934] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:03.928107] [DEBUG] [MAIN ] PAAS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:03.930041] [INFO ] [MAIN ] PAAS: Generated 1807 derivative records from 53993 primary records. [2025-09-18T22:56:03.931273] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-09-18T22:56:03.972246] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1807 records). [2025-09-18T22:56:03.972600] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-09-18T22:56:03.975971] [INFO ] [MAIN ] Derivative Progress: 1389/2075 symbols completed. PAAS took 1.5s. Estimated remaining: 4m 26s. Rate: 154.6 symbols/min [2025-09-18T22:56:03.978282] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:03.993785] [DEBUG] [LOCAL ] PACK: Loaded 32286 existing records from primary storage. [2025-09-18T22:56:03.994490] [INFO ] [MAIN ] PACK: Loaded 32286 primary data records. [2025-09-18T22:56:04.194867] [DEBUG] [LOCAL ] PACS: Loaded 34096 existing records from primary storage. [2025-09-18T22:56:04.222477] [INFO ] [MAIN ] PACS: Loaded 34096 primary data records. [2025-09-18T22:56:04.237148] [DEBUG] [MAIN ] PAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:04.297041] [INFO ] [MAIN ] PAC: Generated 1807 derivative records from 11748 primary records. [2025-09-18T22:56:04.333737] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-09-18T22:56:04.782158] [DEBUG] [LOCAL ] PAC: Derivative data saved (1807 records). [2025-09-18T22:56:04.806709] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-09-18T22:56:04.944991] [INFO ] [MAIN ] Derivative Progress: 1390/2075 symbols completed. PAC took 1.5s. Estimated remaining: 4m 26s. Rate: 154.5 symbols/min [2025-09-18T22:56:04.960810] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:05.001753] [DEBUG] [MAIN ] PACK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:05.003680] [DEBUG] [LOCAL ] PAG: Loaded 22228 existing records from primary storage. [2025-09-18T22:56:05.005755] [INFO ] [MAIN ] PAG: Loaded 22228 primary data records. [2025-09-18T22:56:05.005633] [INFO ] [MAIN ] PACK: Generated 1807 derivative records from 32286 primary records. [2025-09-18T22:56:05.044185] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-09-18T22:56:05.133527] [DEBUG] [MAIN ] PACS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:05.145120] [INFO ] [MAIN ] PACS: Generated 1807 derivative records from 34096 primary records. [2025-09-18T22:56:05.149392] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-09-18T22:56:05.154617] [DEBUG] [LOCAL ] PACK: Derivative data saved (1807 records). [2025-09-18T22:56:05.160997] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-09-18T22:56:05.181207] [INFO ] [MAIN ] Derivative Progress: 1391/2075 symbols completed. PACK took 1.5s. Estimated remaining: 4m 26s. Rate: 154.5 symbols/min [2025-09-18T22:56:05.220671] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:05.223006] [DEBUG] [LOCAL ] PACS: Derivative data saved (1807 records). [2025-09-18T22:56:05.223139] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-09-18T22:56:05.225963] [INFO ] [MAIN ] Derivative Progress: 1392/2075 symbols completed. PACS took 1.2s. Estimated remaining: 4m 25s. Rate: 154.6 symbols/min [2025-09-18T22:56:05.256805] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:05.412034] [DEBUG] [LOCAL ] PAI: Loaded 2759 existing records from primary storage. [2025-09-18T22:56:05.412205] [INFO ] [MAIN ] PAI: Loaded 2759 primary data records. [2025-09-18T22:56:05.762775] [DEBUG] [LOCAL ] PAGS: Loaded 53067 existing records from primary storage. [2025-09-18T22:56:05.764082] [INFO ] [MAIN ] PAGS: Loaded 53067 primary data records. [2025-09-18T22:56:05.976818] [DEBUG] [MAIN ] PAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:05.977872] [INFO ] [MAIN ] PAG: Generated 1807 derivative records from 22228 primary records. [2025-09-18T22:56:06.080942] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-09-18T22:56:06.118191] [DEBUG] [LOCAL ] PAG: Derivative data saved (1807 records). [2025-09-18T22:56:06.118503] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-09-18T22:56:06.120920] [INFO ] [MAIN ] Derivative Progress: 1393/2075 symbols completed. PAG took 1.2s. Estimated remaining: 4m 25s. Rate: 154.5 symbols/min [2025-09-18T22:56:06.134054] [DEBUG] [MAIN ] PAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:06.134769] [INFO ] [MAIN ] PAI: Generated 1807 derivative records from 2759 primary records. [2025-09-18T22:56:06.134899] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-09-18T22:56:06.150751] [DEBUG] [LOCAL ] PAI: Derivative data saved (1807 records). [2025-09-18T22:56:06.150945] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-09-18T22:56:06.153464] [INFO ] [MAIN ] Derivative Progress: 1394/2075 symbols completed. PAI took 0.9s. Estimated remaining: 4m 24s. Rate: 154.6 symbols/min [2025-09-18T22:56:06.170234] [DEBUG] [MAIN ] PAGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:06.170958] [INFO ] [MAIN ] PAGS: Generated 1807 derivative records from 53067 primary records. [2025-09-18T22:56:06.171022] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-09-18T22:56:06.187758] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1807 records). [2025-09-18T22:56:06.187917] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-09-18T22:56:06.190619] [INFO ] [MAIN ] Derivative Progress: 1395/2075 symbols completed. PAGS took 1.0s. Estimated remaining: 4m 24s. Rate: 154.7 symbols/min [2025-09-18T22:56:06.191417] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:06.191524] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:06.191779] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:06.225271] [DEBUG] [LOCAL ] PAM: Loaded 27742 existing records from primary storage. [2025-09-18T22:56:06.235036] [INFO ] [MAIN ] PAM: Loaded 27742 primary data records. [2025-09-18T22:56:06.371600] [DEBUG] [LOCAL ] PAR: Loaded 32810 existing records from primary storage. [2025-09-18T22:56:06.372181] [INFO ] [MAIN ] PAR: Loaded 32810 primary data records. [2025-09-18T22:56:06.389124] [DEBUG] [LOCAL ] PARR: Loaded 48806 existing records from primary storage. [2025-09-18T22:56:06.409932] [INFO ] [MAIN ] PARR: Loaded 48806 primary data records. [2025-09-18T22:56:07.284603] [DEBUG] [MAIN ] PAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:07.286221] [INFO ] [MAIN ] PAM: Generated 1807 derivative records from 27742 primary records. [2025-09-18T22:56:07.286967] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-09-18T22:56:07.308020] [DEBUG] [LOCAL ] PAM: Derivative data saved (1807 records). [2025-09-18T22:56:07.308289] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-09-18T22:56:07.310392] [INFO ] [MAIN ] Derivative Progress: 1396/2075 symbols completed. PAM took 1.1s. Estimated remaining: 4m 24s. Rate: 154.4 symbols/min [2025-09-18T22:56:07.318488] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:07.324912] [DEBUG] [MAIN ] PAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:07.326939] [INFO ] [MAIN ] PAR: Generated 1807 derivative records from 32810 primary records. [2025-09-18T22:56:07.328524] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-09-18T22:56:07.355149] [DEBUG] [MAIN ] PARR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:07.356853] [INFO ] [MAIN ] PARR: Generated 1807 derivative records from 48806 primary records. [2025-09-18T22:56:07.357238] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-09-18T22:56:07.377043] [DEBUG] [LOCAL ] PAR: Derivative data saved (1807 records). [2025-09-18T22:56:07.377268] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-09-18T22:56:07.376000] [DEBUG] [LOCAL ] PARR: Derivative data saved (1807 records). [2025-09-18T22:56:07.379638] [INFO ] [MAIN ] Derivative Progress: 1397/2075 symbols completed. PAR took 1.2s. Estimated remaining: 4m 23s. Rate: 154.5 symbols/min [2025-09-18T22:56:07.380004] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-09-18T22:56:07.380064] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:07.382976] [INFO ] [MAIN ] Derivative Progress: 1398/2075 symbols completed. PARR took 1.2s. Estimated remaining: 4m 23s. Rate: 154.6 symbols/min [2025-09-18T22:56:07.383503] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:07.434056] [DEBUG] [LOCAL ] PAXS: Loaded 21314 existing records from primary storage. [2025-09-18T22:56:07.435341] [DEBUG] [LOCAL ] PATH: Loaded 54068 existing records from primary storage. [2025-09-18T22:56:07.445036] [INFO ] [MAIN ] PATH: Loaded 54068 primary data records. [2025-09-18T22:56:07.444907] [INFO ] [MAIN ] PAXS: Loaded 21314 primary data records. [2025-09-18T22:56:07.727314] [DEBUG] [LOCAL ] PAY: Loaded 38465 existing records from primary storage. [2025-09-18T22:56:07.756197] [INFO ] [MAIN ] PAY: Loaded 38465 primary data records. [2025-09-18T22:56:08.464514] [DEBUG] [MAIN ] PAXS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:08.466005] [INFO ] [MAIN ] PAXS: Generated 1807 derivative records from 21314 primary records. [2025-09-18T22:56:08.466581] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-09-18T22:56:08.500677] [DEBUG] [MAIN ] PATH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:08.502223] [INFO ] [MAIN ] PATH: Generated 1807 derivative records from 54068 primary records. [2025-09-18T22:56:08.502976] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-09-18T22:56:08.515885] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1807 records). [2025-09-18T22:56:08.521822] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-09-18T22:56:08.526622] [INFO ] [MAIN ] Derivative Progress: 1399/2075 symbols completed. PAXS took 1.1s. Estimated remaining: 4m 23s. Rate: 154.4 symbols/min [2025-09-18T22:56:08.528274] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:08.527975] [DEBUG] [LOCAL ] PATH: Derivative data saved (1807 records). [2025-09-18T22:56:08.541259] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-09-18T22:56:08.544324] [INFO ] [MAIN ] Derivative Progress: 1400/2075 symbols completed. PATH took 1.2s. Estimated remaining: 4m 22s. Rate: 154.5 symbols/min [2025-09-18T22:56:08.545143] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:08.544909] [DEBUG] [MAIN ] PAY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:08.546323] [INFO ] [MAIN ] PAY: Generated 1807 derivative records from 38465 primary records. [2025-09-18T22:56:08.546740] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-09-18T22:56:08.564735] [DEBUG] [LOCAL ] PAY: Derivative data saved (1807 records). [2025-09-18T22:56:08.564950] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-09-18T22:56:08.567423] [INFO ] [MAIN ] Derivative Progress: 1401/2075 symbols completed. PAY took 1.2s. Estimated remaining: 4m 22s. Rate: 154.6 symbols/min [2025-09-18T22:56:08.567866] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:08.605138] [DEBUG] [LOCAL ] PAYC: Loaded 36694 existing records from primary storage. [2025-09-18T22:56:08.605356] [INFO ] [MAIN ] PAYC: Loaded 36694 primary data records. [2025-09-18T22:56:08.735490] [DEBUG] [LOCAL ] PB: Loaded 41696 existing records from primary storage. [2025-09-18T22:56:08.746440] [INFO ] [MAIN ] PB: Loaded 41696 primary data records. [2025-09-18T22:56:09.056242] [DEBUG] [LOCAL ] PBA: Loaded 49392 existing records from primary storage. [2025-09-18T22:56:09.068472] [INFO ] [MAIN ] PBA: Loaded 49392 primary data records. [2025-09-18T22:56:09.663955] [DEBUG] [MAIN ] PAYC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:09.665756] [INFO ] [MAIN ] PAYC: Generated 1807 derivative records from 36694 primary records. [2025-09-18T22:56:09.665868] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-09-18T22:56:09.687799] [DEBUG] [LOCAL ] PAYC: Derivative data saved (1807 records). [2025-09-18T22:56:09.688273] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-09-18T22:56:09.690542] [INFO ] [MAIN ] Derivative Progress: 1402/2075 symbols completed. PAYC took 1.2s. Estimated remaining: 4m 21s. Rate: 154.4 symbols/min [2025-09-18T22:56:09.691216] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:09.705784] [DEBUG] [MAIN ] PB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:09.707274] [INFO ] [MAIN ] PB: Generated 1807 derivative records from 41696 primary records. [2025-09-18T22:56:09.707597] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-09-18T22:56:09.738522] [DEBUG] [MAIN ] PBA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:09.739882] [INFO ] [MAIN ] PBA: Generated 1807 derivative records from 49392 primary records. [2025-09-18T22:56:09.740047] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-09-18T22:56:09.742381] [DEBUG] [LOCAL ] PB: Derivative data saved (1807 records). [2025-09-18T22:56:09.742561] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-09-18T22:56:09.746063] [INFO ] [MAIN ] Derivative Progress: 1403/2075 symbols completed. PB took 1.2s. Estimated remaining: 4m 21s. Rate: 154.5 symbols/min [2025-09-18T22:56:09.753703] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:09.763154] [DEBUG] [LOCAL ] PBA: Derivative data saved (1807 records). [2025-09-18T22:56:09.763394] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-09-18T22:56:09.765997] [INFO ] [MAIN ] Derivative Progress: 1404/2075 symbols completed. PBA took 1.2s. Estimated remaining: 4m 20s. Rate: 154.6 symbols/min [2025-09-18T22:56:09.766407] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:09.814223] [DEBUG] [LOCAL ] PBF: Loaded 53482 existing records from primary storage. [2025-09-18T22:56:09.814534] [INFO ] [MAIN ] PBF: Loaded 53482 primary data records. [2025-09-18T22:56:09.899401] [DEBUG] [LOCAL ] PBH: Loaded 31667 existing records from primary storage. [2025-09-18T22:56:09.935576] [INFO ] [MAIN ] PBH: Loaded 31667 primary data records. [2025-09-18T22:56:10.160563] [DEBUG] [LOCAL ] PBI: Loaded 50493 existing records from primary storage. [2025-09-18T22:56:10.308938] [INFO ] [MAIN ] PBI: Loaded 50493 primary data records. [2025-09-18T22:56:10.846360] [DEBUG] [MAIN ] PBF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:10.847320] [INFO ] [MAIN ] PBF: Generated 1807 derivative records from 53482 primary records. [2025-09-18T22:56:10.847629] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-09-18T22:56:10.866504] [DEBUG] [LOCAL ] PBF: Derivative data saved (1807 records). [2025-09-18T22:56:10.866932] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-09-18T22:56:10.869044] [INFO ] [MAIN ] Derivative Progress: 1405/2075 symbols completed. PBF took 1.2s. Estimated remaining: 4m 20s. Rate: 154.4 symbols/min [2025-09-18T22:56:10.869850] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:10.889928] [DEBUG] [MAIN ] PBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:10.890978] [INFO ] [MAIN ] PBH: Generated 1807 derivative records from 31667 primary records. [2025-09-18T22:56:10.891219] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-09-18T22:56:10.924421] [DEBUG] [MAIN ] PBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:10.926172] [INFO ] [MAIN ] PBI: Generated 1807 derivative records from 50493 primary records. [2025-09-18T22:56:10.926733] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-09-18T22:56:10.945533] [DEBUG] [LOCAL ] PBI: Derivative data saved (1807 records). [2025-09-18T22:56:10.941371] [DEBUG] [LOCAL ] PBH: Derivative data saved (1807 records). [2025-09-18T22:56:10.945674] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-09-18T22:56:10.945869] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-09-18T22:56:10.948430] [INFO ] [MAIN ] Derivative Progress: 1406/2075 symbols completed. PBH took 1.2s. Estimated remaining: 4m 20s. Rate: 154.5 symbols/min [2025-09-18T22:56:10.965843] [INFO ] [MAIN ] Derivative Progress: 1407/2075 symbols completed. PBI took 1.2s. Estimated remaining: 4m 19s. Rate: 154.6 symbols/min [2025-09-18T22:56:10.966060] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:10.966630] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:10.978139] [DEBUG] [LOCAL ] PCF: Loaded 8788 existing records from primary storage. [2025-09-18T22:56:10.979101] [INFO ] [MAIN ] PCF: Loaded 8788 primary data records. [2025-09-18T22:56:11.053851] [DEBUG] [LOCAL ] PBR: Loaded 54104 existing records from primary storage. [2025-09-18T22:56:11.074613] [INFO ] [MAIN ] PBR: Loaded 54104 primary data records. [2025-09-18T22:56:11.107978] [DEBUG] [LOCAL ] PBT: Loaded 17706 existing records from primary storage. [2025-09-18T22:56:11.216090] [INFO ] [MAIN ] PBT: Loaded 17706 primary data records. [2025-09-18T22:56:12.020847] [DEBUG] [MAIN ] PCF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:12.021583] [INFO ] [MAIN ] PCF: Generated 1807 derivative records from 8788 primary records. [2025-09-18T22:56:12.021788] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-09-18T22:56:12.040597] [DEBUG] [LOCAL ] PCF: Derivative data saved (1807 records). [2025-09-18T22:56:12.041526] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-09-18T22:56:12.056879] [DEBUG] [MAIN ] PBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:12.056473] [INFO ] [MAIN ] Derivative Progress: 1408/2075 symbols completed. PCF took 1.1s. Estimated remaining: 4m 19s. Rate: 154.4 symbols/min [2025-09-18T22:56:12.057891] [INFO ] [MAIN ] PBR: Generated 1807 derivative records from 54104 primary records. [2025-09-18T22:56:12.065482] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-09-18T22:56:12.071126] [DEBUG] [MAIN ] PBT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:12.082693] [INFO ] [MAIN ] PBT: Generated 1807 derivative records from 17706 primary records. [2025-09-18T22:56:12.083165] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-09-18T22:56:12.099160] [DEBUG] [LOCAL ] PBR: Derivative data saved (1807 records). [2025-09-18T22:56:12.099460] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-09-18T22:56:12.102334] [INFO ] [MAIN ] Derivative Progress: 1409/2075 symbols completed. PBR took 1.2s. Estimated remaining: 4m 19s. Rate: 154.5 symbols/min [2025-09-18T22:56:12.105629] [DEBUG] [LOCAL ] PBT: Derivative data saved (1807 records). [2025-09-18T22:56:12.105721] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-09-18T22:56:12.108257] [INFO ] [MAIN ] Derivative Progress: 1410/2075 symbols completed. PBT took 1.2s. Estimated remaining: 4m 18s. Rate: 154.6 symbols/min [2025-09-18T22:56:12.108827] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:12.108871] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:12.109046] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:12.118990] [DEBUG] [LOCAL ] PCM: Loaded 6869 existing records from primary storage. [2025-09-18T22:56:12.119199] [INFO ] [MAIN ] PCM: Loaded 6869 primary data records. [2025-09-18T22:56:12.210528] [DEBUG] [LOCAL ] PCQ: Loaded 12179 existing records from primary storage. [2025-09-18T22:56:12.232265] [INFO ] [MAIN ] PCQ: Loaded 12179 primary data records. [2025-09-18T22:56:12.556994] [DEBUG] [LOCAL ] PCOR: Loaded 48499 existing records from primary storage. [2025-09-18T22:56:12.568536] [INFO ] [MAIN ] PCOR: Loaded 48499 primary data records. [2025-09-18T22:56:13.093817] [DEBUG] [MAIN ] PCM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:13.094952] [INFO ] [MAIN ] PCM: Generated 1807 derivative records from 6869 primary records. [2025-09-18T22:56:13.095217] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-09-18T22:56:13.112116] [DEBUG] [LOCAL ] PCM: Derivative data saved (1807 records). [2025-09-18T22:56:13.113337] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-09-18T22:56:13.116567] [INFO ] [MAIN ] Derivative Progress: 1411/2075 symbols completed. PCM took 1.0s. Estimated remaining: 4m 18s. Rate: 154.5 symbols/min [2025-09-18T22:56:13.118473] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:13.133481] [DEBUG] [MAIN ] PCQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:13.134331] [INFO ] [MAIN ] PCQ: Generated 1807 derivative records from 12179 primary records. [2025-09-18T22:56:13.134498] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-09-18T22:56:13.164097] [DEBUG] [MAIN ] PCOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:13.165480] [INFO ] [MAIN ] PCOR: Generated 1807 derivative records from 48499 primary records. [2025-09-18T22:56:13.171267] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-09-18T22:56:13.172937] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1807 records). [2025-09-18T22:56:13.173803] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-09-18T22:56:13.176399] [INFO ] [MAIN ] Derivative Progress: 1412/2075 symbols completed. PCQ took 1.1s. Estimated remaining: 4m 17s. Rate: 154.5 symbols/min [2025-09-18T22:56:13.184150] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:13.192984] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1807 records). [2025-09-18T22:56:13.203143] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-09-18T22:56:13.205989] [INFO ] [MAIN ] Derivative Progress: 1413/2075 symbols completed. PCOR took 1.1s. Estimated remaining: 4m 17s. Rate: 154.6 symbols/min [2025-09-18T22:56:13.206541] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:13.227424] [DEBUG] [LOCAL ] PD: Loaded 48098 existing records from primary storage. [2025-09-18T22:56:13.227752] [INFO ] [MAIN ] PD: Loaded 48098 primary data records. [2025-09-18T22:56:13.604857] [DEBUG] [LOCAL ] PDM: Loaded 40156 existing records from primary storage. [2025-09-18T22:56:13.605755] [INFO ] [MAIN ] PDM: Loaded 40156 primary data records. [2025-09-18T22:56:13.617886] [DEBUG] [LOCAL ] PDI: Loaded 50645 existing records from primary storage. [2025-09-18T22:56:13.650180] [INFO ] [MAIN ] PDI: Loaded 50645 primary data records. [2025-09-18T22:56:14.232088] [DEBUG] [MAIN ] PD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:14.234335] [INFO ] [MAIN ] PD: Generated 1807 derivative records from 48098 primary records. [2025-09-18T22:56:14.234604] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-09-18T22:56:14.254409] [DEBUG] [LOCAL ] PD: Derivative data saved (1807 records). [2025-09-18T22:56:14.255500] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-09-18T22:56:14.258172] [INFO ] [MAIN ] Derivative Progress: 1414/2075 symbols completed. PD took 1.1s. Estimated remaining: 4m 17s. Rate: 154.5 symbols/min [2025-09-18T22:56:14.259749] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:14.275456] [DEBUG] [MAIN ] PDM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:14.276982] [INFO ] [MAIN ] PDM: Generated 1807 derivative records from 40156 primary records. [2025-09-18T22:56:14.277201] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-09-18T22:56:14.297420] [DEBUG] [MAIN ] PDI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:14.302158] [INFO ] [MAIN ] PDI: Generated 1807 derivative records from 50645 primary records. [2025-09-18T22:56:14.303418] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-09-18T22:56:14.322139] [DEBUG] [LOCAL ] PDM: Derivative data saved (1807 records). [2025-09-18T22:56:14.322884] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-09-18T22:56:14.325339] [INFO ] [MAIN ] Derivative Progress: 1415/2075 symbols completed. PDM took 1.1s. Estimated remaining: 4m 16s. Rate: 154.5 symbols/min [2025-09-18T22:56:14.333463] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:14.337170] [DEBUG] [LOCAL ] PDI: Derivative data saved (1807 records). [2025-09-18T22:56:14.337317] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-09-18T22:56:14.340130] [INFO ] [MAIN ] Derivative Progress: 1416/2075 symbols completed. PDI took 1.2s. Estimated remaining: 4m 16s. Rate: 154.7 symbols/min [2025-09-18T22:56:14.340684] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:14.352807] [DEBUG] [LOCAL ] PDO: Loaded 32133 existing records from primary storage. [2025-09-18T22:56:14.353045] [INFO ] [MAIN ] PDO: Loaded 32133 primary data records. [2025-09-18T22:56:14.461458] [DEBUG] [LOCAL ] PDS: Loaded 18817 existing records from primary storage. [2025-09-18T22:56:14.475782] [DEBUG] [LOCAL ] PDT: Loaded 17689 existing records from primary storage. [2025-09-18T22:56:14.479333] [INFO ] [MAIN ] PDT: Loaded 17689 primary data records. [2025-09-18T22:56:14.479265] [INFO ] [MAIN ] PDS: Loaded 18817 primary data records. [2025-09-18T22:56:15.363135] [DEBUG] [MAIN ] PDO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:15.364560] [INFO ] [MAIN ] PDO: Generated 1807 derivative records from 32133 primary records. [2025-09-18T22:56:15.364962] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-09-18T22:56:15.386256] [DEBUG] [LOCAL ] PDO: Derivative data saved (1807 records). [2025-09-18T22:56:15.386502] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-09-18T22:56:15.402778] [INFO ] [MAIN ] Derivative Progress: 1417/2075 symbols completed. PDO took 1.1s. Estimated remaining: 4m 16s. Rate: 154.5 symbols/min [2025-09-18T22:56:15.404245] [DEBUG] [MAIN ] PDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:15.405597] [INFO ] [MAIN ] PDT: Generated 1807 derivative records from 17689 primary records. [2025-09-18T22:56:15.406069] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-09-18T22:56:15.404560] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:15.425953] [DEBUG] [LOCAL ] PDT: Derivative data saved (1807 records). [2025-09-18T22:56:15.438488] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-09-18T22:56:15.441700] [INFO ] [MAIN ] Derivative Progress: 1418/2075 symbols completed. PDT took 1.1s. Estimated remaining: 4m 15s. Rate: 154.6 symbols/min [2025-09-18T22:56:15.438816] [DEBUG] [MAIN ] PDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:15.446365] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:15.447215] [INFO ] [MAIN ] PDS: Generated 1807 derivative records from 18817 primary records. [2025-09-18T22:56:15.447791] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-09-18T22:56:15.462396] [DEBUG] [LOCAL ] PDX: Loaded 14620 existing records from primary storage. [2025-09-18T22:56:15.469479] [DEBUG] [LOCAL ] PDS: Derivative data saved (1807 records). [2025-09-18T22:56:15.468609] [INFO ] [MAIN ] PDX: Loaded 14620 primary data records. [2025-09-18T22:56:15.469603] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-09-18T22:56:15.472565] [INFO ] [MAIN ] Derivative Progress: 1419/2075 symbols completed. PDS took 1.1s. Estimated remaining: 4m 14s. Rate: 154.7 symbols/min [2025-09-18T22:56:15.472987] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:15.817882] [DEBUG] [LOCAL ] PEN: Loaded 30969 existing records from primary storage. [2025-09-18T22:56:15.818210] [INFO ] [MAIN ] PEN: Loaded 30969 primary data records. [2025-09-18T22:56:15.904493] [DEBUG] [LOCAL ] PEB: Loaded 51110 existing records from primary storage. [2025-09-18T22:56:15.921875] [INFO ] [MAIN ] PEB: Loaded 51110 primary data records. [2025-09-18T22:56:16.476001] [DEBUG] [MAIN ] PDX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:16.477002] [INFO ] [MAIN ] PDX: Generated 1807 derivative records from 14620 primary records. [2025-09-18T22:56:16.477215] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-09-18T22:56:16.499575] [DEBUG] [LOCAL ] PDX: Derivative data saved (1807 records). [2025-09-18T22:56:16.499876] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-09-18T22:56:16.502569] [INFO ] [MAIN ] Derivative Progress: 1420/2075 symbols completed. PDX took 1.1s. Estimated remaining: 4m 14s. Rate: 154.5 symbols/min [2025-09-18T22:56:16.516778] [DEBUG] [MAIN ] PEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:16.516330] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:16.517691] [INFO ] [MAIN ] PEN: Generated 1807 derivative records from 30969 primary records. [2025-09-18T22:56:16.518101] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-09-18T22:56:16.537170] [DEBUG] [LOCAL ] PEN: Derivative data saved (1807 records). [2025-09-18T22:56:16.537466] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-09-18T22:56:16.542079] [INFO ] [MAIN ] Derivative Progress: 1421/2075 symbols completed. PEN took 1.1s. Estimated remaining: 4m 14s. Rate: 154.6 symbols/min [2025-09-18T22:56:16.555464] [DEBUG] [MAIN ] PEB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:16.555034] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:16.560335] [INFO ] [MAIN ] PEB: Generated 1807 derivative records from 51110 primary records. [2025-09-18T22:56:16.560751] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-09-18T22:56:16.560988] [DEBUG] [LOCAL ] PEO: Loaded 10954 existing records from primary storage. [2025-09-18T22:56:16.561364] [INFO ] [MAIN ] PEO: Loaded 10954 primary data records. [2025-09-18T22:56:16.669877] [DEBUG] [LOCAL ] PEB: Derivative data saved (1807 records). [2025-09-18T22:56:16.680084] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-09-18T22:56:16.690461] [INFO ] [MAIN ] Derivative Progress: 1422/2075 symbols completed. PEB took 1.2s. Estimated remaining: 4m 13s. Rate: 154.6 symbols/min [2025-09-18T22:56:16.694605] [DEBUG] [LOCAL ] PERF: Loaded 14196 existing records from primary storage. [2025-09-18T22:56:16.694889] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:16.695628] [INFO ] [MAIN ] PERF: Loaded 14196 primary data records. [2025-09-18T22:56:16.998612] [DEBUG] [LOCAL ] PFD: Loaded 5191 existing records from primary storage. [2025-09-18T22:56:17.010228] [INFO ] [MAIN ] PFD: Loaded 5191 primary data records. [2025-09-18T22:56:17.574836] [DEBUG] [MAIN ] PEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:17.575991] [INFO ] [MAIN ] PEO: Generated 1807 derivative records from 10954 primary records. [2025-09-18T22:56:17.576131] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-09-18T22:56:17.597083] [DEBUG] [LOCAL ] PEO: Derivative data saved (1807 records). [2025-09-18T22:56:17.597983] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-09-18T22:56:17.600521] [INFO ] [MAIN ] Derivative Progress: 1423/2075 symbols completed. PEO took 1.1s. Estimated remaining: 4m 13s. Rate: 154.5 symbols/min [2025-09-18T22:56:17.613982] [DEBUG] [MAIN ] PERF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:17.615448] [INFO ] [MAIN ] PERF: Generated 1807 derivative records from 14196 primary records. [2025-09-18T22:56:17.616276] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-09-18T22:56:17.640930] [DEBUG] [MAIN ] PFD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:17.642032] [INFO ] [MAIN ] PFD: Generated 1807 derivative records from 5191 primary records. [2025-09-18T22:56:17.642114] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-09-18T22:56:17.657725] [DEBUG] [LOCAL ] PERF: Derivative data saved (1807 records). [2025-09-18T22:56:17.659677] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-09-18T22:56:17.663022] [INFO ] [MAIN ] Derivative Progress: 1424/2075 symbols completed. PERF took 1.1s. Estimated remaining: 4m 13s. Rate: 154.6 symbols/min [2025-09-18T22:56:17.660329] [DEBUG] [LOCAL ] PFD: Derivative data saved (1807 records). [2025-09-18T22:56:17.663292] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-09-18T22:56:17.665837] [INFO ] [MAIN ] Derivative Progress: 1425/2075 symbols completed. PFD took 1.0s. Estimated remaining: 4m 12s. Rate: 154.7 symbols/min [2025-09-18T22:56:17.666369] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:17.666420] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:17.666811] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:17.680694] [DEBUG] [LOCAL ] PFH: Loaded 6987 existing records from primary storage. [2025-09-18T22:56:17.680888] [INFO ] [MAIN ] PFH: Loaded 6987 primary data records. [2025-09-18T22:56:17.752366] [DEBUG] [LOCAL ] PFL: Loaded 13911 existing records from primary storage. [2025-09-18T22:56:17.764588] [INFO ] [MAIN ] PFL: Loaded 13911 primary data records. [2025-09-18T22:56:18.195099] [DEBUG] [LOCAL ] PFGC: Loaded 47366 existing records from primary storage. [2025-09-18T22:56:18.304784] [INFO ] [MAIN ] PFGC: Loaded 47366 primary data records. [2025-09-18T22:56:18.656225] [DEBUG] [MAIN ] PFH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:18.659210] [INFO ] [MAIN ] PFH: Generated 1807 derivative records from 6987 primary records. [2025-09-18T22:56:18.659320] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-09-18T22:56:18.687451] [DEBUG] [MAIN ] PFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:18.689587] [INFO ] [MAIN ] PFL: Generated 1807 derivative records from 13911 primary records. [2025-09-18T22:56:18.691153] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-09-18T22:56:18.709584] [DEBUG] [LOCAL ] PFH: Derivative data saved (1807 records). [2025-09-18T22:56:18.710909] [DEBUG] [LOCAL ] PFL: Derivative data saved (1807 records). [2025-09-18T22:56:18.711055] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-09-18T22:56:18.714964] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-09-18T22:56:18.714777] [INFO ] [MAIN ] Derivative Progress: 1426/2075 symbols completed. PFL took 1.0s. Estimated remaining: 4m 12s. Rate: 154.5 symbols/min [2025-09-18T22:56:18.718491] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:18.718571] [INFO ] [MAIN ] Derivative Progress: 1427/2075 symbols completed. PFH took 1.1s. Estimated remaining: 4m 11s. Rate: 154.6 symbols/min [2025-09-18T22:56:18.719388] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:18.736676] [DEBUG] [MAIN ] PFGC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:18.737509] [INFO ] [MAIN ] PFGC: Generated 1807 derivative records from 47366 primary records. [2025-09-18T22:56:18.737688] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-09-18T22:56:18.768367] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1807 records). [2025-09-18T22:56:18.769092] [DEBUG] [LOCAL ] PFN: Loaded 21879 existing records from primary storage. [2025-09-18T22:56:18.768556] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-09-18T22:56:18.771906] [INFO ] [MAIN ] Derivative Progress: 1428/2075 symbols completed. PFGC took 1.1s. Estimated remaining: 4m 11s. Rate: 154.7 symbols/min [2025-09-18T22:56:18.772002] [INFO ] [MAIN ] PFN: Loaded 21879 primary data records. [2025-09-18T22:56:18.772491] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:18.944042] [DEBUG] [LOCAL ] PFLT: Loaded 43987 existing records from primary storage. [2025-09-18T22:56:18.943037] [DEBUG] [LOCAL ] PFO: Loaded 5887 existing records from primary storage. [2025-09-18T22:56:18.954480] [INFO ] [MAIN ] PFLT: Loaded 43987 primary data records. [2025-09-18T22:56:18.991500] [INFO ] [MAIN ] PFO: Loaded 5887 primary data records. [2025-09-18T22:56:19.842413] [DEBUG] [MAIN ] PFN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:19.844288] [INFO ] [MAIN ] PFN: Generated 1807 derivative records from 21879 primary records. [2025-09-18T22:56:19.844461] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-09-18T22:56:19.878551] [DEBUG] [MAIN ] PFO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:19.873465] [DEBUG] [LOCAL ] PFN: Derivative data saved (1807 records). [2025-09-18T22:56:19.881182] [INFO ] [MAIN ] PFO: Generated 1807 derivative records from 5887 primary records. [2025-09-18T22:56:19.881364] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-09-18T22:56:19.882277] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-09-18T22:56:19.903315] [INFO ] [MAIN ] Derivative Progress: 1429/2075 symbols completed. PFN took 1.2s. Estimated remaining: 4m 11s. Rate: 154.5 symbols/min [2025-09-18T22:56:19.903962] [DEBUG] [MAIN ] PFLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:19.904227] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:19.908872] [INFO ] [MAIN ] PFLT: Generated 1807 derivative records from 43987 primary records. [2025-09-18T22:56:19.910358] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-09-18T22:56:19.930301] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1807 records). [2025-09-18T22:56:19.931080] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-09-18T22:56:19.933843] [INFO ] [MAIN ] Derivative Progress: 1430/2075 symbols completed. PFLT took 1.2s. Estimated remaining: 4m 10s. Rate: 154.6 symbols/min [2025-09-18T22:56:19.934510] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:19.935187] [DEBUG] [LOCAL ] PFO: Derivative data saved (1807 records). [2025-09-18T22:56:19.935493] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-09-18T22:56:19.938820] [INFO ] [MAIN ] Derivative Progress: 1431/2075 symbols completed. PFO took 1.2s. Estimated remaining: 4m 10s. Rate: 154.7 symbols/min [2025-09-18T22:56:19.939255] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:19.952576] [DEBUG] [LOCAL ] PGP: Loaded 5456 existing records from primary storage. [2025-09-18T22:56:19.952784] [INFO ] [MAIN ] PGP: Loaded 5456 primary data records. [2025-09-18T22:56:20.188089] [DEBUG] [LOCAL ] PFS: Loaded 36094 existing records from primary storage. [2025-09-18T22:56:20.195479] [DEBUG] [LOCAL ] PFSI: Loaded 29042 existing records from primary storage. [2025-09-18T22:56:20.310289] [INFO ] [MAIN ] PFS: Loaded 36094 primary data records. [2025-09-18T22:56:20.319745] [INFO ] [MAIN ] PFSI: Loaded 29042 primary data records. [2025-09-18T22:56:20.968387] [DEBUG] [MAIN ] PGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:20.969369] [INFO ] [MAIN ] PGP: Generated 1807 derivative records from 5456 primary records. [2025-09-18T22:56:20.969764] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-09-18T22:56:20.987634] [DEBUG] [LOCAL ] PGP: Derivative data saved (1807 records). [2025-09-18T22:56:20.987977] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-09-18T22:56:20.990275] [INFO ] [MAIN ] Derivative Progress: 1432/2075 symbols completed. PGP took 1.1s. Estimated remaining: 4m 10s. Rate: 154.5 symbols/min [2025-09-18T22:56:20.993481] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:21.009623] [DEBUG] [MAIN ] PFS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:21.010592] [INFO ] [MAIN ] PFS: Generated 1807 derivative records from 36094 primary records. [2025-09-18T22:56:21.010784] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-09-18T22:56:21.041738] [DEBUG] [MAIN ] PFSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:21.043198] [INFO ] [MAIN ] PFSI: Generated 1807 derivative records from 29042 primary records. [2025-09-18T22:56:21.044017] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-09-18T22:56:21.070314] [DEBUG] [LOCAL ] PFS: Derivative data saved (1807 records). [2025-09-18T22:56:21.071540] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-09-18T22:56:21.074960] [INFO ] [MAIN ] Derivative Progress: 1433/2075 symbols completed. PFS took 1.2s. Estimated remaining: 4m 9s. Rate: 154.6 symbols/min [2025-09-18T22:56:21.075903] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:21.077531] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1807 records). [2025-09-18T22:56:21.077601] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-09-18T22:56:21.080635] [INFO ] [MAIN ] Derivative Progress: 1434/2075 symbols completed. PFSI took 1.1s. Estimated remaining: 4m 9s. Rate: 154.7 symbols/min [2025-09-18T22:56:21.081153] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:21.098247] [DEBUG] [LOCAL ] PGRE: Loaded 46532 existing records from primary storage. [2025-09-18T22:56:21.101596] [DEBUG] [LOCAL ] PGZ: Loaded 5462 existing records from primary storage. [2025-09-18T22:56:21.101377] [INFO ] [MAIN ] PGRE: Loaded 46532 primary data records. [2025-09-18T22:56:21.101764] [INFO ] [MAIN ] PGZ: Loaded 5462 primary data records. [2025-09-18T22:56:21.769308] [DEBUG] [LOCAL ] PH: Loaded 39699 existing records from primary storage. [2025-09-18T22:56:21.769683] [INFO ] [MAIN ] PH: Loaded 39699 primary data records. [2025-09-18T22:56:22.113077] [DEBUG] [MAIN ] PGRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:22.121945] [INFO ] [MAIN ] PGRE: Generated 1807 derivative records from 46532 primary records. [2025-09-18T22:56:22.127284] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-09-18T22:56:22.128906] [DEBUG] [MAIN ] PGZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:22.144073] [INFO ] [MAIN ] PGZ: Generated 1807 derivative records from 5462 primary records. [2025-09-18T22:56:22.145091] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1807 records). [2025-09-18T22:56:22.145232] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-09-18T22:56:22.146088] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-09-18T22:56:22.149149] [INFO ] [MAIN ] Derivative Progress: 1435/2075 symbols completed. PGRE took 1.2s. Estimated remaining: 4m 8s. Rate: 154.5 symbols/min [2025-09-18T22:56:22.157055] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:22.170346] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1807 records). [2025-09-18T22:56:22.171409] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-09-18T22:56:22.177531] [INFO ] [MAIN ] Derivative Progress: 1436/2075 symbols completed. PGZ took 1.1s. Estimated remaining: 4m 8s. Rate: 154.6 symbols/min [2025-09-18T22:56:22.190737] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:22.178050] [DEBUG] [LOCAL ] PHD: Loaded 9688 existing records from primary storage. [2025-09-18T22:56:22.191443] [DEBUG] [MAIN ] PH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:22.191712] [INFO ] [MAIN ] PHD: Loaded 9688 primary data records. [2025-09-18T22:56:22.192398] [INFO ] [MAIN ] PH: Generated 1807 derivative records from 39699 primary records. [2025-09-18T22:56:22.214030] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-09-18T22:56:22.388153] [DEBUG] [LOCAL ] PH: Derivative data saved (1807 records). [2025-09-18T22:56:22.403029] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-09-18T22:56:22.405801] [INFO ] [MAIN ] Derivative Progress: 1437/2075 symbols completed. PH took 1.3s. Estimated remaining: 4m 7s. Rate: 154.7 symbols/min [2025-09-18T22:56:22.524011] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:22.542722] [DEBUG] [LOCAL ] PHG: Loaded 46651 existing records from primary storage. [2025-09-18T22:56:22.546629] [INFO ] [MAIN ] PHG: Loaded 46651 primary data records. [2025-09-18T22:56:22.608098] [DEBUG] [LOCAL ] PHI: Loaded 15023 existing records from primary storage. [2025-09-18T22:56:22.632600] [INFO ] [MAIN ] PHI: Loaded 15023 primary data records. [2025-09-18T22:56:23.068342] [DEBUG] [MAIN ] PHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:23.074384] [INFO ] [MAIN ] PHD: Generated 1807 derivative records from 9688 primary records. [2025-09-18T22:56:23.242756] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-09-18T22:56:23.272965] [DEBUG] [LOCAL ] PHD: Derivative data saved (1807 records). [2025-09-18T22:56:23.273525] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-09-18T22:56:23.276322] [INFO ] [MAIN ] Derivative Progress: 1438/2075 symbols completed. PHD took 1.1s. Estimated remaining: 4m 7s. Rate: 154.5 symbols/min [2025-09-18T22:56:23.303118] [DEBUG] [MAIN ] PHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:23.304003] [INFO ] [MAIN ] PHG: Generated 1807 derivative records from 46651 primary records. [2025-09-18T22:56:23.304143] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-09-18T22:56:23.317293] [DEBUG] [MAIN ] PHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:23.318309] [INFO ] [MAIN ] PHI: Generated 1807 derivative records from 15023 primary records. [2025-09-18T22:56:23.318562] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-09-18T22:56:23.348388] [DEBUG] [LOCAL ] PHG: Derivative data saved (1807 records). [2025-09-18T22:56:23.348749] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-09-18T22:56:23.351514] [INFO ] [MAIN ] Derivative Progress: 1439/2075 symbols completed. PHG took 1.2s. Estimated remaining: 4m 7s. Rate: 154.6 symbols/min [2025-09-18T22:56:23.351627] [DEBUG] [LOCAL ] PHI: Derivative data saved (1807 records). [2025-09-18T22:56:23.351887] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-09-18T22:56:23.354737] [INFO ] [MAIN ] Derivative Progress: 1440/2075 symbols completed. PHI took 0.8s. Estimated remaining: 4m 6s. Rate: 154.7 symbols/min [2025-09-18T22:56:23.355553] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:23.355342] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:23.355435] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:23.396802] [DEBUG] [LOCAL ] PHK: Loaded 26933 existing records from primary storage. [2025-09-18T22:56:23.407126] [INFO ] [MAIN ] PHK: Loaded 26933 primary data records. [2025-09-18T22:56:23.427737] [DEBUG] [LOCAL ] PHR: Loaded 37429 existing records from primary storage. [2025-09-18T22:56:23.453017] [INFO ] [MAIN ] PHR: Loaded 37429 primary data records. [2025-09-18T22:56:23.642601] [DEBUG] [LOCAL ] PHIN: Loaded 33825 existing records from primary storage. [2025-09-18T22:56:23.661386] [INFO ] [MAIN ] PHIN: Loaded 33825 primary data records. [2025-09-18T22:56:24.392237] [DEBUG] [MAIN ] PHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:24.394053] [INFO ] [MAIN ] PHR: Generated 1807 derivative records from 37429 primary records. [2025-09-18T22:56:24.401679] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-09-18T22:56:24.408412] [DEBUG] [MAIN ] PHK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:24.416607] [INFO ] [MAIN ] PHK: Generated 1807 derivative records from 26933 primary records. [2025-09-18T22:56:24.420808] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-09-18T22:56:24.440597] [DEBUG] [LOCAL ] PHK: Derivative data saved (1807 records). [2025-09-18T22:56:24.441529] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-09-18T22:56:24.443972] [INFO ] [MAIN ] Derivative Progress: 1441/2075 symbols completed. PHK took 1.1s. Estimated remaining: 4m 6s. Rate: 154.5 symbols/min [2025-09-18T22:56:24.444580] [INFO ] [MAIN ] PHT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:24.446260] [DEBUG] [LOCAL ] PHR: Derivative data saved (1807 records). [2025-09-18T22:56:24.446971] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-09-18T22:56:24.449709] [INFO ] [MAIN ] Derivative Progress: 1442/2075 symbols completed. PHR took 1.1s. Estimated remaining: 4m 6s. Rate: 154.6 symbols/min [2025-09-18T22:56:24.452101] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:24.467075] [DEBUG] [MAIN ] PHIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:24.468036] [INFO ] [MAIN ] PHIN: Generated 1807 derivative records from 33825 primary records. [2025-09-18T22:56:24.468322] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-09-18T22:56:24.496579] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1807 records). [2025-09-18T22:56:24.497295] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-09-18T22:56:24.497194] [DEBUG] [LOCAL ] PHT: Loaded 15406 existing records from primary storage. [2025-09-18T22:56:24.500280] [INFO ] [MAIN ] Derivative Progress: 1443/2075 symbols completed. PHIN took 1.1s. Estimated remaining: 4m 5s. Rate: 154.7 symbols/min [2025-09-18T22:56:24.500628] [INFO ] [MAIN ] PHT: Loaded 15406 primary data records. [2025-09-18T22:56:24.500998] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:24.609292] [DEBUG] [LOCAL ] PIM: Loaded 4811 existing records from primary storage. [2025-09-18T22:56:24.627011] [INFO ] [MAIN ] PIM: Loaded 4811 primary data records. [2025-09-18T22:56:24.827728] [DEBUG] [LOCAL ] PII: Loaded 49751 existing records from primary storage. [2025-09-18T22:56:24.891723] [INFO ] [MAIN ] PII: Loaded 49751 primary data records. [2025-09-18T22:56:25.568546] [DEBUG] [MAIN ] PHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:25.570367] [INFO ] [MAIN ] PHT: Generated 1807 derivative records from 15406 primary records. [2025-09-18T22:56:25.570750] [DEBUG] [LOCAL ] PHT: Saving derivative data. [2025-09-18T22:56:25.590920] [DEBUG] [LOCAL ] PHT: Derivative data saved (1807 records). [2025-09-18T22:56:25.591233] [INFO ] [MAIN ] PHT: Successfully saved derivative data. [2025-09-18T22:56:25.593669] [INFO ] [MAIN ] Derivative Progress: 1444/2075 symbols completed. PHT took 1.1s. Estimated remaining: 4m 5s. Rate: 154.5 symbols/min [2025-09-18T22:56:25.594271] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:25.608342] [DEBUG] [MAIN ] PIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:25.609361] [INFO ] [MAIN ] PIM: Generated 1807 derivative records from 4811 primary records. [2025-09-18T22:56:25.609633] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-09-18T22:56:25.630854] [DEBUG] [LOCAL ] PIM: Derivative data saved (1807 records). [2025-09-18T22:56:25.631084] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-09-18T22:56:25.633961] [INFO ] [MAIN ] Derivative Progress: 1445/2075 symbols completed. PIM took 1.1s. Estimated remaining: 4m 4s. Rate: 154.6 symbols/min [2025-09-18T22:56:25.634419] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:25.653041] [DEBUG] [LOCAL ] PINE: Loaded 14351 existing records from primary storage. [2025-09-18T22:56:25.653246] [INFO ] [MAIN ] PINE: Loaded 14351 primary data records. [2025-09-18T22:56:25.653590] [DEBUG] [MAIN ] PII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:25.654489] [INFO ] [MAIN ] PII: Generated 1807 derivative records from 49751 primary records. [2025-09-18T22:56:25.654685] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-09-18T22:56:25.846450] [DEBUG] [LOCAL ] PII: Derivative data saved (1807 records). [2025-09-18T22:56:25.886759] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-09-18T22:56:26.008295] [INFO ] [MAIN ] Derivative Progress: 1446/2075 symbols completed. PII took 1.6s. Estimated remaining: 4m 4s. Rate: 154.6 symbols/min [2025-09-18T22:56:26.024384] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:26.043673] [DEBUG] [LOCAL ] PINS: Loaded 54083 existing records from primary storage. [2025-09-18T22:56:26.044729] [INFO ] [MAIN ] PINS: Loaded 54083 primary data records. [2025-09-18T22:56:26.165506] [DEBUG] [LOCAL ] PIPR: Loaded 15563 existing records from primary storage. [2025-09-18T22:56:26.165852] [INFO ] [MAIN ] PIPR: Loaded 15563 primary data records. [2025-09-18T22:56:26.708564] [DEBUG] [MAIN ] PINE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:26.709678] [INFO ] [MAIN ] PINE: Generated 1807 derivative records from 14351 primary records. [2025-09-18T22:56:26.710325] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-09-18T22:56:26.736863] [DEBUG] [LOCAL ] PINE: Derivative data saved (1807 records). [2025-09-18T22:56:26.737841] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-09-18T22:56:26.740726] [INFO ] [MAIN ] Derivative Progress: 1447/2075 symbols completed. PINE took 1.1s. Estimated remaining: 4m 4s. Rate: 154.6 symbols/min [2025-09-18T22:56:26.753585] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:26.754793] [DEBUG] [MAIN ] PINS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:26.756152] [INFO ] [MAIN ] PINS: Generated 1807 derivative records from 54083 primary records. [2025-09-18T22:56:26.756739] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-09-18T22:56:26.776078] [DEBUG] [LOCAL ] PINS: Derivative data saved (1807 records). [2025-09-18T22:56:26.776224] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-09-18T22:56:26.779038] [INFO ] [MAIN ] Derivative Progress: 1448/2075 symbols completed. PINS took 1.1s. Estimated remaining: 4m 3s. Rate: 154.6 symbols/min [2025-09-18T22:56:26.779506] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:26.792709] [DEBUG] [MAIN ] PIPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:26.793458] [INFO ] [MAIN ] PIPR: Generated 1807 derivative records from 15563 primary records. [2025-09-18T22:56:26.793721] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-09-18T22:56:26.823748] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1807 records). [2025-09-18T22:56:26.823412] [DEBUG] [LOCAL ] PJT: Loaded 23067 existing records from primary storage. [2025-09-18T22:56:26.823948] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-09-18T22:56:26.823881] [INFO ] [MAIN ] PJT: Loaded 23067 primary data records. [2025-09-18T22:56:26.827019] [INFO ] [MAIN ] Derivative Progress: 1449/2075 symbols completed. PIPR took 0.8s. Estimated remaining: 4m 3s. Rate: 154.7 symbols/min [2025-09-18T22:56:26.838237] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:26.974017] [DEBUG] [LOCAL ] PKE: Loaded 12430 existing records from primary storage. [2025-09-18T22:56:27.028873] [INFO ] [MAIN ] PKE: Loaded 12430 primary data records. [2025-09-18T22:56:27.049094] [DEBUG] [LOCAL ] PK: Loaded 53288 existing records from primary storage. [2025-09-18T22:56:27.177227] [INFO ] [MAIN ] PK: Loaded 53288 primary data records. [2025-09-18T22:56:27.892590] [DEBUG] [MAIN ] PJT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:27.894140] [INFO ] [MAIN ] PJT: Generated 1807 derivative records from 23067 primary records. [2025-09-18T22:56:27.894583] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-09-18T22:56:27.918338] [DEBUG] [LOCAL ] PJT: Derivative data saved (1807 records). [2025-09-18T22:56:27.919044] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-09-18T22:56:27.923529] [INFO ] [MAIN ] Derivative Progress: 1450/2075 symbols completed. PJT took 1.2s. Estimated remaining: 4m 3s. Rate: 154.5 symbols/min [2025-09-18T22:56:27.925062] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:27.939903] [DEBUG] [MAIN ] PK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:27.940920] [INFO ] [MAIN ] PK: Generated 1807 derivative records from 53288 primary records. [2025-09-18T22:56:27.941429] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-09-18T22:56:27.963912] [DEBUG] [MAIN ] PKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:27.964732] [INFO ] [MAIN ] PKE: Generated 1807 derivative records from 12430 primary records. [2025-09-18T22:56:27.967598] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-09-18T22:56:27.985364] [DEBUG] [LOCAL ] PK: Derivative data saved (1807 records). [2025-09-18T22:56:27.985796] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-09-18T22:56:27.989798] [INFO ] [MAIN ] Derivative Progress: 1451/2075 symbols completed. PK took 1.2s. Estimated remaining: 4m 2s. Rate: 154.6 symbols/min [2025-09-18T22:56:27.990902] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:27.994324] [DEBUG] [LOCAL ] PKE: Derivative data saved (1807 records). [2025-09-18T22:56:27.994447] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-09-18T22:56:27.997327] [INFO ] [MAIN ] Derivative Progress: 1452/2075 symbols completed. PKE took 1.2s. Estimated remaining: 4m 2s. Rate: 154.7 symbols/min [2025-09-18T22:56:28.007187] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:28.037501] [DEBUG] [LOCAL ] PKST: Loaded 19749 existing records from primary storage. [2025-09-18T22:56:28.044677] [INFO ] [MAIN ] PKST: Loaded 19749 primary data records. [2025-09-18T22:56:28.044483] [DEBUG] [LOCAL ] PKG: Loaded 39766 existing records from primary storage. [2025-09-18T22:56:28.050392] [INFO ] [MAIN ] PKG: Loaded 39766 primary data records. [2025-09-18T22:56:28.227818] [DEBUG] [LOCAL ] PKX: Loaded 25600 existing records from primary storage. [2025-09-18T22:56:28.248554] [INFO ] [MAIN ] PKX: Loaded 25600 primary data records. [2025-09-18T22:56:29.096287] [DEBUG] [MAIN ] PKG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:29.097734] [DEBUG] [MAIN ] PKST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:29.099889] [INFO ] [MAIN ] PKST: Generated 1807 derivative records from 19749 primary records. [2025-09-18T22:56:29.098875] [INFO ] [MAIN ] PKG: Generated 1807 derivative records from 39766 primary records. [2025-09-18T22:56:29.100210] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-09-18T22:56:29.100011] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-09-18T22:56:29.145092] [DEBUG] [MAIN ] PKX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:29.147456] [INFO ] [MAIN ] PKX: Generated 1807 derivative records from 25600 primary records. [2025-09-18T22:56:29.148092] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-09-18T22:56:29.159995] [DEBUG] [LOCAL ] PKG: Derivative data saved (1807 records). [2025-09-18T22:56:29.160442] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-09-18T22:56:29.164492] [DEBUG] [LOCAL ] PKST: Derivative data saved (1807 records). [2025-09-18T22:56:29.167719] [INFO ] [MAIN ] Derivative Progress: 1453/2075 symbols completed. PKG took 1.2s. Estimated remaining: 4m 2s. Rate: 154.5 symbols/min [2025-09-18T22:56:29.168696] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-09-18T22:56:29.171271] [INFO ] [MAIN ] Derivative Progress: 1454/2075 symbols completed. PKST took 1.2s. Estimated remaining: 4m 1s. Rate: 154.6 symbols/min [2025-09-18T22:56:29.174892] [DEBUG] [LOCAL ] PKX: Derivative data saved (1807 records). [2025-09-18T22:56:29.175000] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-09-18T22:56:29.178117] [INFO ] [MAIN ] Derivative Progress: 1455/2075 symbols completed. PKX took 1.2s. Estimated remaining: 4m 0s. Rate: 154.7 symbols/min [2025-09-18T22:56:29.178952] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:29.178736] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:29.179032] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:29.245499] [DEBUG] [LOCAL ] PLNT: Loaded 48948 existing records from primary storage. [2025-09-18T22:56:29.259539] [INFO ] [MAIN ] PLNT: Loaded 48948 primary data records. [2025-09-18T22:56:29.444197] [DEBUG] [LOCAL ] PL: Loaded 53494 existing records from primary storage. [2025-09-18T22:56:29.460432] [DEBUG] [LOCAL ] PLD: Loaded 53876 existing records from primary storage. [2025-09-18T22:56:29.474919] [INFO ] [MAIN ] PL: Loaded 53494 primary data records. [2025-09-18T22:56:29.516112] [INFO ] [MAIN ] PLD: Loaded 53876 primary data records. [2025-09-18T22:56:30.333941] [DEBUG] [MAIN ] PLNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:30.336594] [INFO ] [MAIN ] PLNT: Generated 1807 derivative records from 48948 primary records. [2025-09-18T22:56:30.337159] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-09-18T22:56:30.356934] [DEBUG] [LOCAL ] PLNT: Derivative data saved (1807 records). [2025-09-18T22:56:30.357593] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-09-18T22:56:30.360756] [INFO ] [MAIN ] Derivative Progress: 1456/2075 symbols completed. PLNT took 1.2s. Estimated remaining: 4m 0s. Rate: 154.5 symbols/min [2025-09-18T22:56:30.362299] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:30.379779] [DEBUG] [MAIN ] PL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:30.394352] [INFO ] [MAIN ] PL: Generated 1807 derivative records from 53494 primary records. [2025-09-18T22:56:30.394632] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-09-18T22:56:30.395840] [DEBUG] [MAIN ] PLD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:30.397027] [INFO ] [MAIN ] PLD: Generated 1807 derivative records from 53876 primary records. [2025-09-18T22:56:30.397419] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-09-18T22:56:30.427618] [DEBUG] [LOCAL ] PL: Derivative data saved (1807 records). [2025-09-18T22:56:30.429601] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-09-18T22:56:30.437762] [INFO ] [MAIN ] Derivative Progress: 1457/2075 symbols completed. PL took 1.3s. Estimated remaining: 3m 60s. Rate: 154.6 symbols/min [2025-09-18T22:56:30.438197] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:30.451621] [DEBUG] [LOCAL ] PLD: Derivative data saved (1807 records). [2025-09-18T22:56:30.453457] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-09-18T22:56:30.456569] [INFO ] [MAIN ] Derivative Progress: 1458/2075 symbols completed. PLD took 1.3s. Estimated remaining: 3m 59s. Rate: 154.7 symbols/min [2025-09-18T22:56:30.456984] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:30.453355] [DEBUG] [LOCAL ] PLOW: Loaded 20914 existing records from primary storage. [2025-09-18T22:56:30.457295] [INFO ] [MAIN ] PLOW: Loaded 20914 primary data records. [2025-09-18T22:56:30.651033] [DEBUG] [LOCAL ] PML: Loaded 20510 existing records from primary storage. [2025-09-18T22:56:30.684930] [INFO ] [MAIN ] PML: Loaded 20510 primary data records. [2025-09-18T22:56:30.803935] [DEBUG] [LOCAL ] PLYM: Loaded 33320 existing records from primary storage. [2025-09-18T22:56:30.831024] [INFO ] [MAIN ] PLYM: Loaded 33320 primary data records. [2025-09-18T22:56:31.478712] [DEBUG] [MAIN ] PLOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:31.480101] [INFO ] [MAIN ] PLOW: Generated 1807 derivative records from 20914 primary records. [2025-09-18T22:56:31.480541] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-09-18T22:56:31.497997] [DEBUG] [LOCAL ] PLOW: Derivative data saved (1807 records). [2025-09-18T22:56:31.498110] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-09-18T22:56:31.500962] [INFO ] [MAIN ] Derivative Progress: 1459/2075 symbols completed. PLOW took 1.1s. Estimated remaining: 3m 59s. Rate: 154.5 symbols/min [2025-09-18T22:56:31.502012] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:31.521311] [DEBUG] [MAIN ] PML: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:31.522313] [INFO ] [MAIN ] PML: Generated 1807 derivative records from 20510 primary records. [2025-09-18T22:56:31.525044] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-09-18T22:56:31.545771] [DEBUG] [MAIN ] PLYM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:31.551105] [INFO ] [MAIN ] PLYM: Generated 1807 derivative records from 33320 primary records. [2025-09-18T22:56:31.551827] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-09-18T22:56:31.556722] [DEBUG] [LOCAL ] PMM: Loaded 10814 existing records from primary storage. [2025-09-18T22:56:31.559151] [INFO ] [MAIN ] PMM: Loaded 10814 primary data records. [2025-09-18T22:56:31.610580] [DEBUG] [LOCAL ] PML: Derivative data saved (1807 records). [2025-09-18T22:56:31.624506] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1807 records). [2025-09-18T22:56:31.637101] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-09-18T22:56:31.624610] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-09-18T22:56:31.639883] [INFO ] [MAIN ] Derivative Progress: 1460/2075 symbols completed. PLYM took 1.2s. Estimated remaining: 3m 59s. Rate: 154.6 symbols/min [2025-09-18T22:56:31.643251] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:31.643394] [INFO ] [MAIN ] Derivative Progress: 1461/2075 symbols completed. PML took 1.2s. Estimated remaining: 3m 58s. Rate: 154.7 symbols/min [2025-09-18T22:56:31.643991] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:31.752968] [DEBUG] [LOCAL ] PMO: Loaded 10785 existing records from primary storage. [2025-09-18T22:56:31.910069] [INFO ] [MAIN ] PMO: Loaded 10785 primary data records. [2025-09-18T22:56:32.154633] [DEBUG] [LOCAL ] PMT: Loaded 40647 existing records from primary storage. [2025-09-18T22:56:32.278137] [INFO ] [MAIN ] PMT: Loaded 40647 primary data records. [2025-09-18T22:56:32.485202] [DEBUG] [MAIN ] PMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:32.485982] [INFO ] [MAIN ] PMM: Generated 1807 derivative records from 10814 primary records. [2025-09-18T22:56:32.486163] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-09-18T22:56:32.626728] [DEBUG] [LOCAL ] PMM: Derivative data saved (1807 records). [2025-09-18T22:56:32.628081] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-09-18T22:56:32.631209] [INFO ] [MAIN ] Derivative Progress: 1462/2075 symbols completed. PMM took 1.1s. Estimated remaining: 3m 58s. Rate: 154.5 symbols/min [2025-09-18T22:56:32.632425] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:32.648420] [DEBUG] [MAIN ] PMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:32.649477] [INFO ] [MAIN ] PMO: Generated 1807 derivative records from 10785 primary records. [2025-09-18T22:56:32.649784] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-09-18T22:56:32.671914] [DEBUG] [LOCAL ] PMO: Derivative data saved (1807 records). [2025-09-18T22:56:32.671249] [DEBUG] [LOCAL ] PNI: Loaded 6842 existing records from primary storage. [2025-09-18T22:56:32.672100] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-09-18T22:56:32.672149] [INFO ] [MAIN ] PNI: Loaded 6842 primary data records. [2025-09-18T22:56:32.675010] [INFO ] [MAIN ] Derivative Progress: 1463/2075 symbols completed. PMO took 1.0s. Estimated remaining: 3m 57s. Rate: 154.6 symbols/min [2025-09-18T22:56:32.680711] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:32.865318] [DEBUG] [MAIN ] PMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:32.988132] [INFO ] [MAIN ] PMT: Generated 1807 derivative records from 40647 primary records. [2025-09-18T22:56:33.011918] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-09-18T22:56:33.013724] [DEBUG] [LOCAL ] PNNT: Loaded 33225 existing records from primary storage. [2025-09-18T22:56:33.013913] [INFO ] [MAIN ] PNNT: Loaded 33225 primary data records. [2025-09-18T22:56:33.101806] [DEBUG] [LOCAL ] PMT: Derivative data saved (1807 records). [2025-09-18T22:56:33.120267] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-09-18T22:56:33.128812] [INFO ] [MAIN ] Derivative Progress: 1464/2075 symbols completed. PMT took 1.5s. Estimated remaining: 3m 57s. Rate: 154.6 symbols/min [2025-09-18T22:56:33.136855] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:33.359486] [DEBUG] [MAIN ] PNI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:33.360694] [INFO ] [MAIN ] PNI: Generated 1807 derivative records from 6842 primary records. [2025-09-18T22:56:33.360813] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-09-18T22:56:33.386503] [DEBUG] [LOCAL ] PNI: Derivative data saved (1807 records). [2025-09-18T22:56:33.386804] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-09-18T22:56:33.388954] [INFO ] [MAIN ] Derivative Progress: 1465/2075 symbols completed. PNI took 0.8s. Estimated remaining: 3m 57s. Rate: 154.6 symbols/min [2025-09-18T22:56:33.389559] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:33.408150] [DEBUG] [LOCAL ] PNW: Loaded 46459 existing records from primary storage. [2025-09-18T22:56:33.408419] [INFO ] [MAIN ] PNW: Loaded 46459 primary data records. [2025-09-18T22:56:33.476418] [DEBUG] [MAIN ] PNNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:33.492585] [INFO ] [MAIN ] PNNT: Generated 1807 derivative records from 33225 primary records. [2025-09-18T22:56:33.503572] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-09-18T22:56:33.821873] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1807 records). [2025-09-18T22:56:33.821149] [DEBUG] [LOCAL ] POR: Loaded 47313 existing records from primary storage. [2025-09-18T22:56:33.822095] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-09-18T22:56:33.822850] [INFO ] [MAIN ] POR: Loaded 47313 primary data records. [2025-09-18T22:56:33.837943] [INFO ] [MAIN ] Derivative Progress: 1466/2075 symbols completed. PNNT took 1.2s. Estimated remaining: 3m 56s. Rate: 154.6 symbols/min [2025-09-18T22:56:33.856849] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:34.156918] [DEBUG] [MAIN ] PNW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:34.158996] [INFO ] [MAIN ] PNW: Generated 1807 derivative records from 46459 primary records. [2025-09-18T22:56:34.159559] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-09-18T22:56:34.179691] [DEBUG] [LOCAL ] POST: Loaded 39219 existing records from primary storage. [2025-09-18T22:56:34.179944] [INFO ] [MAIN ] POST: Loaded 39219 primary data records. [2025-09-18T22:56:34.199259] [DEBUG] [LOCAL ] PNW: Derivative data saved (1807 records). [2025-09-18T22:56:34.225244] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-09-18T22:56:34.256842] [INFO ] [MAIN ] Derivative Progress: 1467/2075 symbols completed. PNW took 1.1s. Estimated remaining: 3m 56s. Rate: 154.6 symbols/min [2025-09-18T22:56:34.280250] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:34.511926] [DEBUG] [MAIN ] POR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:34.513586] [INFO ] [MAIN ] POR: Generated 1807 derivative records from 47313 primary records. [2025-09-18T22:56:34.514112] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-09-18T22:56:34.531031] [DEBUG] [LOCAL ] POR: Derivative data saved (1807 records). [2025-09-18T22:56:34.531198] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-09-18T22:56:34.533598] [INFO ] [MAIN ] Derivative Progress: 1468/2075 symbols completed. POR took 1.1s. Estimated remaining: 3m 56s. Rate: 154.6 symbols/min [2025-09-18T22:56:34.566360] [DEBUG] [MAIN ] POST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:34.567053] [INFO ] [MAIN ] POST: Generated 1807 derivative records from 39219 primary records. [2025-09-18T22:56:34.567120] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-09-18T22:56:34.594422] [DEBUG] [LOCAL ] PPG: Loaded 51114 existing records from primary storage. [2025-09-18T22:56:34.594781] [INFO ] [MAIN ] PPG: Loaded 51114 primary data records. [2025-09-18T22:56:34.701745] [DEBUG] [LOCAL ] POST: Derivative data saved (1807 records). [2025-09-18T22:56:34.702107] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-09-18T22:56:34.704251] [INFO ] [MAIN ] Derivative Progress: 1469/2075 symbols completed. POST took 0.9s. Estimated remaining: 3m 55s. Rate: 154.7 symbols/min [2025-09-18T22:56:34.913736] [DEBUG] [MAIN ] PPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:34.914353] [INFO ] [MAIN ] PPG: Generated 1807 derivative records from 51114 primary records. [2025-09-18T22:56:34.914416] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-09-18T22:56:34.929697] [DEBUG] [LOCAL ] PPG: Derivative data saved (1807 records). [2025-09-18T22:56:34.929789] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-09-18T22:56:34.931920] [INFO ] [MAIN ] Derivative Progress: 1470/2075 symbols completed. PPG took 0.7s. Estimated remaining: 3m 55s. Rate: 154.8 symbols/min [2025-09-18T22:56:34.932994] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:34.933136] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:34.932812] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:34.954523] [DEBUG] [LOCAL ] PPT: Loaded 20464 existing records from primary storage. [2025-09-18T22:56:34.954893] [INFO ] [MAIN ] PPT: Loaded 20464 primary data records. [2025-09-18T22:56:35.077771] [DEBUG] [LOCAL ] PRA: Loaded 34928 existing records from primary storage. [2025-09-18T22:56:35.105864] [INFO ] [MAIN ] PRA: Loaded 34928 primary data records. [2025-09-18T22:56:35.406393] [DEBUG] [LOCAL ] PR: Loaded 53999 existing records from primary storage. [2025-09-18T22:56:35.407146] [INFO ] [MAIN ] PR: Loaded 53999 primary data records. [2025-09-18T22:56:36.020934] [DEBUG] [MAIN ] PPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:36.022958] [INFO ] [MAIN ] PPT: Generated 1807 derivative records from 20464 primary records. [2025-09-18T22:56:36.023737] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-09-18T22:56:36.042367] [DEBUG] [LOCAL ] PPT: Derivative data saved (1807 records). [2025-09-18T22:56:36.042893] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-09-18T22:56:36.045993] [INFO ] [MAIN ] Derivative Progress: 1471/2075 symbols completed. PPT took 1.1s. Estimated remaining: 3m 54s. Rate: 154.6 symbols/min [2025-09-18T22:56:36.046380] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:36.063574] [DEBUG] [MAIN ] PRA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:36.064371] [INFO ] [MAIN ] PRA: Generated 1807 derivative records from 34928 primary records. [2025-09-18T22:56:36.064494] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-09-18T22:56:36.081620] [DEBUG] [LOCAL ] PRA: Derivative data saved (1807 records). [2025-09-18T22:56:36.081925] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-09-18T22:56:36.085914] [INFO ] [MAIN ] Derivative Progress: 1472/2075 symbols completed. PRA took 1.2s. Estimated remaining: 3m 54s. Rate: 154.6 symbols/min [2025-09-18T22:56:36.087168] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:36.106368] [DEBUG] [MAIN ] PR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:36.107218] [INFO ] [MAIN ] PR: Generated 1807 derivative records from 53999 primary records. [2025-09-18T22:56:36.107382] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-09-18T22:56:36.144597] [DEBUG] [LOCAL ] PRG: Loaded 30738 existing records from primary storage. [2025-09-18T22:56:36.145313] [INFO ] [MAIN ] PRG: Loaded 30738 primary data records. [2025-09-18T22:56:36.158447] [DEBUG] [LOCAL ] PR: Derivative data saved (1807 records). [2025-09-18T22:56:36.167990] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-09-18T22:56:36.180995] [INFO ] [MAIN ] Derivative Progress: 1473/2075 symbols completed. PR took 1.2s. Estimated remaining: 3m 53s. Rate: 154.7 symbols/min [2025-09-18T22:56:36.186603] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:36.340112] [DEBUG] [LOCAL ] PRH: Loaded 4994 existing records from primary storage. [2025-09-18T22:56:36.359710] [INFO ] [MAIN ] PRH: Loaded 4994 primary data records. [2025-09-18T22:56:36.387919] [DEBUG] [LOCAL ] PRGO: Loaded 47312 existing records from primary storage. [2025-09-18T22:56:36.403741] [INFO ] [MAIN ] PRGO: Loaded 47312 primary data records. [2025-09-18T22:56:37.145598] [DEBUG] [MAIN ] PRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:37.146711] [INFO ] [MAIN ] PRG: Generated 1807 derivative records from 30738 primary records. [2025-09-18T22:56:37.146948] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-09-18T22:56:37.168811] [DEBUG] [LOCAL ] PRG: Derivative data saved (1807 records). [2025-09-18T22:56:37.169318] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-09-18T22:56:37.171887] [INFO ] [MAIN ] Derivative Progress: 1474/2075 symbols completed. PRG took 1.1s. Estimated remaining: 3m 53s. Rate: 154.6 symbols/min [2025-09-18T22:56:37.172580] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:37.186485] [DEBUG] [MAIN ] PRH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:37.187749] [INFO ] [MAIN ] PRH: Generated 1807 derivative records from 4994 primary records. [2025-09-18T22:56:37.187955] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-09-18T22:56:37.225780] [DEBUG] [MAIN ] PRGO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:37.232933] [DEBUG] [LOCAL ] PRH: Derivative data saved (1807 records). [2025-09-18T22:56:37.233507] [DEBUG] [LOCAL ] PRI: Loaded 18546 existing records from primary storage. [2025-09-18T22:56:37.234430] [INFO ] [MAIN ] PRGO: Generated 1807 derivative records from 47312 primary records. [2025-09-18T22:56:37.234531] [INFO ] [MAIN ] PRI: Loaded 18546 primary data records. [2025-09-18T22:56:37.234752] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-09-18T22:56:37.233098] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-09-18T22:56:37.259938] [INFO ] [MAIN ] Derivative Progress: 1475/2075 symbols completed. PRH took 1.1s. Estimated remaining: 3m 53s. Rate: 154.6 symbols/min [2025-09-18T22:56:37.284551] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:37.370392] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1807 records). [2025-09-18T22:56:37.392743] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-09-18T22:56:37.425774] [INFO ] [MAIN ] Derivative Progress: 1476/2075 symbols completed. PRGO took 1.3s. Estimated remaining: 3m 52s. Rate: 154.7 symbols/min [2025-09-18T22:56:37.446128] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:37.636396] [DEBUG] [LOCAL ] PRIM: Loaded 44891 existing records from primary storage. [2025-09-18T22:56:37.638236] [INFO ] [MAIN ] PRIM: Loaded 44891 primary data records. [2025-09-18T22:56:37.901960] [DEBUG] [LOCAL ] PRKS: Loaded 43039 existing records from primary storage. [2025-09-18T22:56:38.024350] [INFO ] [MAIN ] PRKS: Loaded 43039 primary data records. [2025-09-18T22:56:38.176575] [DEBUG] [MAIN ] PRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:38.199252] [INFO ] [MAIN ] PRI: Generated 1807 derivative records from 18546 primary records. [2025-09-18T22:56:38.223536] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-09-18T22:56:38.415540] [DEBUG] [LOCAL ] PRI: Derivative data saved (1807 records). [2025-09-18T22:56:38.415774] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-09-18T22:56:38.418371] [INFO ] [MAIN ] Derivative Progress: 1477/2075 symbols completed. PRI took 1.2s. Estimated remaining: 3m 52s. Rate: 154.5 symbols/min [2025-09-18T22:56:38.419421] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:38.446541] [DEBUG] [MAIN ] PRIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:38.448015] [INFO ] [MAIN ] PRIM: Generated 1807 derivative records from 44891 primary records. [2025-09-18T22:56:38.448189] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-09-18T22:56:38.469692] [DEBUG] [LOCAL ] PRLB: Loaded 21046 existing records from primary storage. [2025-09-18T22:56:38.470512] [INFO ] [MAIN ] PRLB: Loaded 21046 primary data records. [2025-09-18T22:56:38.584454] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1807 records). [2025-09-18T22:56:38.585549] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-09-18T22:56:38.588316] [INFO ] [MAIN ] Derivative Progress: 1478/2075 symbols completed. PRIM took 1.3s. Estimated remaining: 3m 52s. Rate: 154.6 symbols/min [2025-09-18T22:56:38.589013] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:38.644158] [DEBUG] [MAIN ] PRKS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:38.679400] [INFO ] [MAIN ] PRKS: Generated 1807 derivative records from 43039 primary records. [2025-09-18T22:56:38.684764] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-09-18T22:56:38.825342] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1807 records). [2025-09-18T22:56:38.825787] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-09-18T22:56:38.828894] [INFO ] [MAIN ] Derivative Progress: 1479/2075 symbols completed. PRKS took 1.4s. Estimated remaining: 3m 51s. Rate: 154.6 symbols/min [2025-09-18T22:56:38.829589] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:38.878533] [DEBUG] [LOCAL ] PRM: Loaded 45037 existing records from primary storage. [2025-09-18T22:56:38.879025] [DEBUG] [MAIN ] PRLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:38.879257] [INFO ] [MAIN ] PRM: Loaded 45037 primary data records. [2025-09-18T22:56:38.880103] [INFO ] [MAIN ] PRLB: Generated 1807 derivative records from 21046 primary records. [2025-09-18T22:56:38.891904] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-09-18T22:56:39.100018] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1807 records). [2025-09-18T22:56:39.118772] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-09-18T22:56:39.228840] [DEBUG] [LOCAL ] PRMB: Loaded 53517 existing records from primary storage. [2025-09-18T22:56:39.240404] [INFO ] [MAIN ] PRMB: Loaded 53517 primary data records. [2025-09-18T22:56:39.239714] [INFO ] [MAIN ] Derivative Progress: 1480/2075 symbols completed. PRLB took 0.8s. Estimated remaining: 3m 51s. Rate: 154.6 symbols/min [2025-09-18T22:56:39.246279] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:39.601321] [DEBUG] [LOCAL ] PRO: Loaded 37513 existing records from primary storage. [2025-09-18T22:56:39.601909] [INFO ] [MAIN ] PRO: Loaded 37513 primary data records. [2025-09-18T22:56:39.768500] [DEBUG] [MAIN ] PRM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:39.787915] [INFO ] [MAIN ] PRM: Generated 1807 derivative records from 45037 primary records. [2025-09-18T22:56:39.810830] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-09-18T22:56:39.999807] [DEBUG] [LOCAL ] PRM: Derivative data saved (1807 records). [2025-09-18T22:56:40.000065] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-09-18T22:56:40.002921] [INFO ] [MAIN ] Derivative Progress: 1481/2075 symbols completed. PRM took 1.4s. Estimated remaining: 3m 51s. Rate: 154.5 symbols/min [2025-09-18T22:56:40.012014] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:40.018395] [DEBUG] [MAIN ] PRMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:40.019557] [INFO ] [MAIN ] PRMB: Generated 1807 derivative records from 53517 primary records. [2025-09-18T22:56:40.019838] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-09-18T22:56:40.040550] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1807 records). [2025-09-18T22:56:40.040876] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-09-18T22:56:40.043330] [INFO ] [MAIN ] Derivative Progress: 1482/2075 symbols completed. PRMB took 1.2s. Estimated remaining: 3m 50s. Rate: 154.6 symbols/min [2025-09-18T22:56:40.046952] [DEBUG] [LOCAL ] PRT: Loaded 5448 existing records from primary storage. [2025-09-18T22:56:40.047214] [INFO ] [MAIN ] PRT: Loaded 5448 primary data records. [2025-09-18T22:56:40.047517] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:40.308279] [DEBUG] [MAIN ] PRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:40.364587] [INFO ] [MAIN ] PRO: Generated 1807 derivative records from 37513 primary records. [2025-09-18T22:56:40.364883] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-09-18T22:56:40.396884] [DEBUG] [LOCAL ] PRO: Derivative data saved (1807 records). [2025-09-18T22:56:40.397176] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-09-18T22:56:40.399908] [INFO ] [MAIN ] Derivative Progress: 1483/2075 symbols completed. PRO took 1.2s. Estimated remaining: 3m 50s. Rate: 154.6 symbols/min [2025-09-18T22:56:40.423941] [DEBUG] [LOCAL ] PRU: Loaded 51940 existing records from primary storage. [2025-09-18T22:56:40.436382] [DEBUG] [MAIN ] PRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:40.437178] [INFO ] [MAIN ] PRT: Generated 1807 derivative records from 5448 primary records. [2025-09-18T22:56:40.436510] [INFO ] [MAIN ] PRU: Loaded 51940 primary data records. [2025-09-18T22:56:40.437368] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-09-18T22:56:40.631401] [DEBUG] [LOCAL ] PRT: Derivative data saved (1807 records). [2025-09-18T22:56:40.631552] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-09-18T22:56:40.738105] [INFO ] [MAIN ] Derivative Progress: 1484/2075 symbols completed. PRT took 0.7s. Estimated remaining: 3m 49s. Rate: 154.6 symbols/min [2025-09-18T22:56:40.776778] [DEBUG] [MAIN ] PRU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:40.777421] [INFO ] [MAIN ] PRU: Generated 1807 derivative records from 51940 primary records. [2025-09-18T22:56:40.777488] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-09-18T22:56:40.792887] [DEBUG] [LOCAL ] PRU: Derivative data saved (1807 records). [2025-09-18T22:56:40.792952] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-09-18T22:56:40.795441] [INFO ] [MAIN ] Derivative Progress: 1485/2075 symbols completed. PRU took 0.7s. Estimated remaining: 3m 49s. Rate: 154.7 symbols/min [2025-09-18T22:56:40.796178] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:40.796948] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:40.796712] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:40.807234] [DEBUG] [LOCAL ] PSBD: Loaded 6865 existing records from primary storage. [2025-09-18T22:56:40.809470] [INFO ] [MAIN ] PSBD: Loaded 6865 primary data records. [2025-09-18T22:56:40.870906] [DEBUG] [LOCAL ] PSF: Loaded 6784 existing records from primary storage. [2025-09-18T22:56:40.894076] [INFO ] [MAIN ] PSF: Loaded 6784 primary data records. [2025-09-18T22:56:41.280408] [DEBUG] [LOCAL ] PSA: Loaded 42229 existing records from primary storage. [2025-09-18T22:56:41.309943] [INFO ] [MAIN ] PSA: Loaded 42229 primary data records. [2025-09-18T22:56:41.885740] [DEBUG] [MAIN ] PSBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:41.887175] [INFO ] [MAIN ] PSBD: Generated 1807 derivative records from 6865 primary records. [2025-09-18T22:56:41.888427] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-09-18T22:56:41.916161] [DEBUG] [MAIN ] PSF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:41.920228] [INFO ] [MAIN ] PSF: Generated 1807 derivative records from 6784 primary records. [2025-09-18T22:56:41.920879] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-09-18T22:56:41.926419] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1807 records). [2025-09-18T22:56:41.933900] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-09-18T22:56:41.936615] [INFO ] [MAIN ] Derivative Progress: 1486/2075 symbols completed. PSBD took 1.1s. Estimated remaining: 3m 49s. Rate: 154.5 symbols/min [2025-09-18T22:56:41.942144] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:41.951877] [DEBUG] [LOCAL ] PSF: Derivative data saved (1807 records). [2025-09-18T22:56:41.960045] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-09-18T22:56:41.967240] [INFO ] [MAIN ] Derivative Progress: 1487/2075 symbols completed. PSF took 1.2s. Estimated remaining: 3m 48s. Rate: 154.6 symbols/min [2025-09-18T22:56:41.967692] [DEBUG] [MAIN ] PSA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:41.967897] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:41.968750] [INFO ] [MAIN ] PSA: Generated 1807 derivative records from 42229 primary records. [2025-09-18T22:56:41.969063] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-09-18T22:56:41.994926] [DEBUG] [LOCAL ] PSA: Derivative data saved (1807 records). [2025-09-18T22:56:41.995108] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-09-18T22:56:41.997659] [INFO ] [MAIN ] Derivative Progress: 1488/2075 symbols completed. PSA took 1.2s. Estimated remaining: 3m 48s. Rate: 154.7 symbols/min [2025-09-18T22:56:41.997963] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:42.011466] [DEBUG] [LOCAL ] PSFE: Loaded 31087 existing records from primary storage. [2025-09-18T22:56:42.011714] [INFO ] [MAIN ] PSFE: Loaded 31087 primary data records. [2025-09-18T22:56:42.203968] [DEBUG] [LOCAL ] PSN: Loaded 46785 existing records from primary storage. [2025-09-18T22:56:42.226171] [INFO ] [MAIN ] PSN: Loaded 46785 primary data records. [2025-09-18T22:56:42.424320] [DEBUG] [LOCAL ] PSO: Loaded 38132 existing records from primary storage. [2025-09-18T22:56:42.431407] [INFO ] [MAIN ] PSO: Loaded 38132 primary data records. [2025-09-18T22:56:42.996415] [DEBUG] [MAIN ] PSFE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:42.997579] [INFO ] [MAIN ] PSFE: Generated 1807 derivative records from 31087 primary records. [2025-09-18T22:56:42.997963] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-09-18T22:56:43.032361] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1807 records). [2025-09-18T22:56:43.032779] [DEBUG] [MAIN ] PSN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:43.034309] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-09-18T22:56:43.037266] [INFO ] [MAIN ] Derivative Progress: 1489/2075 symbols completed. PSFE took 1.1s. Estimated remaining: 3m 47s. Rate: 154.6 symbols/min [2025-09-18T22:56:43.037559] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:43.038496] [INFO ] [MAIN ] PSN: Generated 1807 derivative records from 46785 primary records. [2025-09-18T22:56:43.039034] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-09-18T22:56:43.067999] [DEBUG] [LOCAL ] PSN: Derivative data saved (1807 records). [2025-09-18T22:56:43.067910] [DEBUG] [MAIN ] PSO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:43.068172] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-09-18T22:56:43.068887] [INFO ] [MAIN ] PSO: Generated 1807 derivative records from 38132 primary records. [2025-09-18T22:56:43.071331] [INFO ] [MAIN ] Derivative Progress: 1490/2075 symbols completed. PSN took 1.1s. Estimated remaining: 3m 47s. Rate: 154.6 symbols/min [2025-09-18T22:56:43.071664] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:43.071949] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-09-18T22:56:43.102304] [DEBUG] [LOCAL ] PSO: Derivative data saved (1807 records). [2025-09-18T22:56:43.102459] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-09-18T22:56:43.104754] [INFO ] [MAIN ] Derivative Progress: 1491/2075 symbols completed. PSO took 1.1s. Estimated remaining: 3m 46s. Rate: 154.7 symbols/min [2025-09-18T22:56:43.105145] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:43.117899] [DEBUG] [LOCAL ] PSQH: Loaded 34746 existing records from primary storage. [2025-09-18T22:56:43.118129] [INFO ] [MAIN ] PSQH: Loaded 34746 primary data records. [2025-09-18T22:56:43.273938] [DEBUG] [LOCAL ] PSTL: Loaded 20779 existing records from primary storage. [2025-09-18T22:56:43.296047] [INFO ] [MAIN ] PSTL: Loaded 20779 primary data records. [2025-09-18T22:56:43.542709] [DEBUG] [LOCAL ] PSTG: Loaded 53241 existing records from primary storage. [2025-09-18T22:56:43.561053] [INFO ] [MAIN ] PSTG: Loaded 53241 primary data records. [2025-09-18T22:56:44.145485] [DEBUG] [MAIN ] PSQH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:44.146972] [INFO ] [MAIN ] PSQH: Generated 1807 derivative records from 34746 primary records. [2025-09-18T22:56:44.147276] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-09-18T22:56:44.165182] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1807 records). [2025-09-18T22:56:44.166272] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-09-18T22:56:44.168838] [INFO ] [MAIN ] Derivative Progress: 1492/2075 symbols completed. PSQH took 1.1s. Estimated remaining: 3m 46s. Rate: 154.6 symbols/min [2025-09-18T22:56:44.169527] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:44.187469] [DEBUG] [MAIN ] PSTL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:44.188317] [INFO ] [MAIN ] PSTL: Generated 1807 derivative records from 20779 primary records. [2025-09-18T22:56:44.190591] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-09-18T22:56:44.210291] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1807 records). [2025-09-18T22:56:44.227368] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-09-18T22:56:44.229963] [INFO ] [MAIN ] Derivative Progress: 1493/2075 symbols completed. PSTL took 1.1s. Estimated remaining: 3m 46s. Rate: 154.6 symbols/min [2025-09-18T22:56:44.227738] [DEBUG] [MAIN ] PSTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:44.230222] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:44.231383] [INFO ] [MAIN ] PSTG: Generated 1807 derivative records from 53241 primary records. [2025-09-18T22:56:44.232147] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-09-18T22:56:44.252495] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1807 records). [2025-09-18T22:56:44.252741] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-09-18T22:56:44.255285] [INFO ] [MAIN ] Derivative Progress: 1494/2075 symbols completed. PSTG took 1.2s. Estimated remaining: 3m 45s. Rate: 154.7 symbols/min [2025-09-18T22:56:44.255719] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:44.282285] [DEBUG] [LOCAL ] PTA: Loaded 15157 existing records from primary storage. [2025-09-18T22:56:44.282425] [INFO ] [MAIN ] PTA: Loaded 15157 primary data records. [2025-09-18T22:56:44.404251] [DEBUG] [LOCAL ] PSX: Loaded 53519 existing records from primary storage. [2025-09-18T22:56:44.404549] [INFO ] [MAIN ] PSX: Loaded 53519 primary data records. [2025-09-18T22:56:44.749803] [DEBUG] [LOCAL ] PTY: Loaded 37652 existing records from primary storage. [2025-09-18T22:56:44.797173] [INFO ] [MAIN ] PTY: Loaded 37652 primary data records. [2025-09-18T22:56:45.248072] [DEBUG] [MAIN ] PTA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:45.250175] [INFO ] [MAIN ] PTA: Generated 1807 derivative records from 15157 primary records. [2025-09-18T22:56:45.250778] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-09-18T22:56:45.269890] [DEBUG] [LOCAL ] PTA: Derivative data saved (1807 records). [2025-09-18T22:56:45.271021] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-09-18T22:56:45.273268] [INFO ] [MAIN ] Derivative Progress: 1495/2075 symbols completed. PTA took 1.0s. Estimated remaining: 3m 45s. Rate: 154.6 symbols/min [2025-09-18T22:56:45.274136] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:45.287562] [DEBUG] [MAIN ] PSX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:45.289478] [INFO ] [MAIN ] PSX: Generated 1807 derivative records from 53519 primary records. [2025-09-18T22:56:45.289632] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-09-18T22:56:45.310491] [DEBUG] [LOCAL ] PSX: Derivative data saved (1807 records). [2025-09-18T22:56:45.311343] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-09-18T22:56:45.314285] [INFO ] [MAIN ] Derivative Progress: 1496/2075 symbols completed. PSX took 1.1s. Estimated remaining: 3m 45s. Rate: 154.7 symbols/min [2025-09-18T22:56:45.314915] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:45.328235] [DEBUG] [MAIN ] PTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:45.329091] [INFO ] [MAIN ] PTY: Generated 1807 derivative records from 37652 primary records. [2025-09-18T22:56:45.329214] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-09-18T22:56:45.355464] [DEBUG] [LOCAL ] PTY: Derivative data saved (1807 records). [2025-09-18T22:56:45.355617] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-09-18T22:56:45.358125] [INFO ] [MAIN ] Derivative Progress: 1497/2075 symbols completed. PTY took 1.1s. Estimated remaining: 3m 44s. Rate: 154.8 symbols/min [2025-09-18T22:56:45.359234] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:45.372816] [DEBUG] [LOCAL ] PUK: Loaded 45398 existing records from primary storage. [2025-09-18T22:56:45.373057] [INFO ] [MAIN ] PUK: Loaded 45398 primary data records. [2025-09-18T22:56:45.712942] [DEBUG] [LOCAL ] PUMP: Loaded 49869 existing records from primary storage. [2025-09-18T22:56:45.713187] [INFO ] [MAIN ] PUMP: Loaded 49869 primary data records. [2025-09-18T22:56:45.841944] [DEBUG] [LOCAL ] PVH: Loaded 50759 existing records from primary storage. [2025-09-18T22:56:45.842126] [INFO ] [MAIN ] PVH: Loaded 50759 primary data records. [2025-09-18T22:56:46.403627] [DEBUG] [MAIN ] PUK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:46.404678] [INFO ] [MAIN ] PUK: Generated 1807 derivative records from 45398 primary records. [2025-09-18T22:56:46.404846] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-09-18T22:56:46.429292] [DEBUG] [LOCAL ] PUK: Derivative data saved (1807 records). [2025-09-18T22:56:46.429802] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-09-18T22:56:46.432186] [INFO ] [MAIN ] Derivative Progress: 1498/2075 symbols completed. PUK took 1.2s. Estimated remaining: 3m 44s. Rate: 154.6 symbols/min [2025-09-18T22:56:46.449537] [DEBUG] [MAIN ] PUMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:46.450406] [INFO ] [MAIN ] PUMP: Generated 1807 derivative records from 49869 primary records. [2025-09-18T22:56:46.450485] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-09-18T22:56:46.480373] [DEBUG] [LOCAL ] PUMP: Derivative data saved (1807 records). [2025-09-18T22:56:46.479388] [DEBUG] [MAIN ] PVH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:46.480505] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-09-18T22:56:46.483227] [INFO ] [MAIN ] Derivative Progress: 1499/2075 symbols completed. PUMP took 1.2s. Estimated remaining: 3m 43s. Rate: 154.7 symbols/min [2025-09-18T22:56:46.481210] [INFO ] [MAIN ] PVH: Generated 1807 derivative records from 50759 primary records. [2025-09-18T22:56:46.483436] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-09-18T22:56:46.498980] [DEBUG] [LOCAL ] PVH: Derivative data saved (1807 records). [2025-09-18T22:56:46.499046] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-09-18T22:56:46.501698] [INFO ] [MAIN ] Derivative Progress: 1500/2075 symbols completed. PVH took 1.1s. Estimated remaining: 3m 43s. Rate: 154.8 symbols/min [2025-09-18T22:56:46.502602] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:46.503020] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:46.503141] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:46.511305] [DEBUG] [LOCAL ] PVL: Loaded 4742 existing records from primary storage. [2025-09-18T22:56:46.511495] [INFO ] [MAIN ] PVL: Loaded 4742 primary data records. [2025-09-18T22:56:46.741010] [DEBUG] [LOCAL ] PX: Loaded 35019 existing records from primary storage. [2025-09-18T22:56:46.741970] [INFO ] [MAIN ] PX: Loaded 35019 primary data records. [2025-09-18T22:56:46.946316] [DEBUG] [LOCAL ] PWR: Loaded 47954 existing records from primary storage. [2025-09-18T22:56:46.962488] [INFO ] [MAIN ] PWR: Loaded 47954 primary data records. [2025-09-18T22:56:47.567845] [DEBUG] [MAIN ] PVL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:47.569130] [INFO ] [MAIN ] PVL: Generated 1807 derivative records from 4742 primary records. [2025-09-18T22:56:47.569637] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-09-18T22:56:47.590117] [DEBUG] [LOCAL ] PVL: Derivative data saved (1807 records). [2025-09-18T22:56:47.590301] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-09-18T22:56:47.592524] [INFO ] [MAIN ] Derivative Progress: 1501/2075 symbols completed. PVL took 1.1s. Estimated remaining: 3m 43s. Rate: 154.6 symbols/min [2025-09-18T22:56:47.593532] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:47.614403] [DEBUG] [MAIN ] PX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:47.627483] [INFO ] [MAIN ] PX: Generated 1807 derivative records from 35019 primary records. [2025-09-18T22:56:47.627707] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-09-18T22:56:47.628616] [DEBUG] [MAIN ] PWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:47.629940] [INFO ] [MAIN ] PWR: Generated 1807 derivative records from 47954 primary records. [2025-09-18T22:56:47.630108] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-09-18T22:56:47.662639] [DEBUG] [LOCAL ] PX: Derivative data saved (1807 records). [2025-09-18T22:56:47.665609] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-09-18T22:56:47.672246] [INFO ] [MAIN ] Derivative Progress: 1502/2075 symbols completed. PX took 1.2s. Estimated remaining: 3m 42s. Rate: 154.7 symbols/min [2025-09-18T22:56:47.672799] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:47.672383] [DEBUG] [LOCAL ] PWR: Derivative data saved (1807 records). [2025-09-18T22:56:47.673026] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-09-18T22:56:47.675859] [INFO ] [MAIN ] Derivative Progress: 1503/2075 symbols completed. PWR took 1.2s. Estimated remaining: 3m 42s. Rate: 154.8 symbols/min [2025-09-18T22:56:47.685499] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:47.687702] [DEBUG] [LOCAL ] QD: Loaded 28239 existing records from primary storage. [2025-09-18T22:56:47.687938] [INFO ] [MAIN ] QD: Loaded 28239 primary data records. [2025-09-18T22:56:48.066796] [DEBUG] [LOCAL ] QGEN: Loaded 49545 existing records from primary storage. [2025-09-18T22:56:48.067074] [INFO ] [MAIN ] QGEN: Loaded 49545 primary data records. [2025-09-18T22:56:48.120383] [DEBUG] [LOCAL ] QS: Loaded 54132 existing records from primary storage. [2025-09-18T22:56:48.133702] [INFO ] [MAIN ] QS: Loaded 54132 primary data records. [2025-09-18T22:56:48.730467] [DEBUG] [MAIN ] QD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:48.732411] [INFO ] [MAIN ] QD: Generated 1807 derivative records from 28239 primary records. [2025-09-18T22:56:48.732844] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-09-18T22:56:48.753321] [DEBUG] [LOCAL ] QD: Derivative data saved (1807 records). [2025-09-18T22:56:48.753700] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-09-18T22:56:48.756063] [INFO ] [MAIN ] Derivative Progress: 1504/2075 symbols completed. QD took 1.2s. Estimated remaining: 3m 42s. Rate: 154.6 symbols/min [2025-09-18T22:56:48.757061] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:48.775073] [DEBUG] [MAIN ] QGEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:48.776106] [INFO ] [MAIN ] QGEN: Generated 1807 derivative records from 49545 primary records. [2025-09-18T22:56:48.776422] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-09-18T22:56:48.798089] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1807 records). [2025-09-18T22:56:48.810892] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-09-18T22:56:48.811194] [DEBUG] [MAIN ] QS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:48.814876] [INFO ] [MAIN ] QS: Generated 1807 derivative records from 54132 primary records. [2025-09-18T22:56:48.813838] [INFO ] [MAIN ] Derivative Progress: 1505/2075 symbols completed. QGEN took 1.1s. Estimated remaining: 3m 41s. Rate: 154.7 symbols/min [2025-09-18T22:56:48.814982] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-09-18T22:56:48.815800] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:48.846893] [DEBUG] [LOCAL ] QS: Derivative data saved (1807 records). [2025-09-18T22:56:48.847030] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-09-18T22:56:48.849782] [INFO ] [MAIN ] Derivative Progress: 1506/2075 symbols completed. QS took 1.2s. Estimated remaining: 3m 41s. Rate: 154.8 symbols/min [2025-09-18T22:56:48.850275] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:48.869085] [DEBUG] [LOCAL ] QSR: Loaded 52780 existing records from primary storage. [2025-09-18T22:56:48.869313] [INFO ] [MAIN ] QSR: Loaded 52780 primary data records. [2025-09-18T22:56:48.997017] [DEBUG] [LOCAL ] QUAD: Loaded 24380 existing records from primary storage. [2025-09-18T22:56:49.008552] [INFO ] [MAIN ] QUAD: Loaded 24380 primary data records. [2025-09-18T22:56:49.041483] [DEBUG] [LOCAL ] QTWO: Loaded 39386 existing records from primary storage. [2025-09-18T22:56:49.061491] [INFO ] [MAIN ] QTWO: Loaded 39386 primary data records. [2025-09-18T22:56:49.937791] [DEBUG] [MAIN ] QSR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:49.939074] [INFO ] [MAIN ] QSR: Generated 1807 derivative records from 52780 primary records. [2025-09-18T22:56:49.951721] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-09-18T22:56:49.952047] [DEBUG] [MAIN ] QUAD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:49.963713] [INFO ] [MAIN ] QUAD: Generated 1807 derivative records from 24380 primary records. [2025-09-18T22:56:49.968679] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-09-18T22:56:49.999100] [DEBUG] [MAIN ] QTWO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:50.004076] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1807 records). [2025-09-18T22:56:50.003160] [INFO ] [MAIN ] QTWO: Generated 1807 derivative records from 39386 primary records. [2025-09-18T22:56:50.004195] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-09-18T22:56:50.004281] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-09-18T22:56:50.002052] [DEBUG] [LOCAL ] QSR: Derivative data saved (1807 records). [2025-09-18T22:56:50.005265] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-09-18T22:56:50.007587] [INFO ] [MAIN ] Derivative Progress: 1507/2075 symbols completed. QUAD took 1.2s. Estimated remaining: 3m 41s. Rate: 154.6 symbols/min [2025-09-18T22:56:50.017448] [INFO ] [MAIN ] Derivative Progress: 1508/2075 symbols completed. QSR took 1.3s. Estimated remaining: 3m 40s. Rate: 154.7 symbols/min [2025-09-18T22:56:50.017360] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:50.023417] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:50.028888] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1807 records). [2025-09-18T22:56:50.029064] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-09-18T22:56:50.031938] [INFO ] [MAIN ] Derivative Progress: 1509/2075 symbols completed. QTWO took 1.2s. Estimated remaining: 3m 39s. Rate: 154.8 symbols/min [2025-09-18T22:56:50.037419] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:50.037693] [DEBUG] [LOCAL ] QVCD: Loaded 4676 existing records from primary storage. [2025-09-18T22:56:50.038072] [INFO ] [MAIN ] QVCD: Loaded 4676 primary data records. [2025-09-18T22:56:50.079365] [DEBUG] [LOCAL ] QVCC: Loaded 9166 existing records from primary storage. [2025-09-18T22:56:50.120531] [INFO ] [MAIN ] QVCC: Loaded 9166 primary data records. [2025-09-18T22:56:50.687953] [DEBUG] [LOCAL ] QXO: Loaded 53532 existing records from primary storage. [2025-09-18T22:56:50.689280] [INFO ] [MAIN ] QXO: Loaded 53532 primary data records. [2025-09-18T22:56:51.033105] [DEBUG] [MAIN ] QVCD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:51.034339] [INFO ] [MAIN ] QVCD: Generated 1807 derivative records from 4676 primary records. [2025-09-18T22:56:51.034591] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-09-18T22:56:51.056438] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1807 records). [2025-09-18T22:56:51.056833] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-09-18T22:56:51.071720] [INFO ] [MAIN ] Derivative Progress: 1510/2075 symbols completed. QVCD took 1.1s. Estimated remaining: 3m 39s. Rate: 154.6 symbols/min [2025-09-18T22:56:51.073734] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:51.073999] [DEBUG] [MAIN ] QVCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:51.075305] [INFO ] [MAIN ] QVCC: Generated 1807 derivative records from 9166 primary records. [2025-09-18T22:56:51.075953] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-09-18T22:56:51.091915] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1807 records). [2025-09-18T22:56:51.092211] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-09-18T22:56:51.094463] [INFO ] [MAIN ] Derivative Progress: 1511/2075 symbols completed. QVCC took 1.1s. Estimated remaining: 3m 39s. Rate: 154.7 symbols/min [2025-09-18T22:56:51.095018] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:51.123182] [DEBUG] [MAIN ] QXO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:51.124277] [INFO ] [MAIN ] QXO: Generated 1807 derivative records from 53532 primary records. [2025-09-18T22:56:51.124463] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-09-18T22:56:51.153089] [DEBUG] [LOCAL ] R: Loaded 30064 existing records from primary storage. [2025-09-18T22:56:51.160573] [INFO ] [MAIN ] R: Loaded 30064 primary data records. [2025-09-18T22:56:51.163573] [DEBUG] [LOCAL ] RA: Loaded 21939 existing records from primary storage. [2025-09-18T22:56:51.169360] [INFO ] [MAIN ] RA: Loaded 21939 primary data records. [2025-09-18T22:56:51.223997] [DEBUG] [LOCAL ] QXO: Derivative data saved (1807 records). [2025-09-18T22:56:51.259016] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-09-18T22:56:51.300160] [INFO ] [MAIN ] Derivative Progress: 1512/2075 symbols completed. QXO took 1.3s. Estimated remaining: 3m 38s. Rate: 154.7 symbols/min [2025-09-18T22:56:51.341105] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:51.833072] [DEBUG] [LOCAL ] RACE: Loaded 33413 existing records from primary storage. [2025-09-18T22:56:51.833612] [INFO ] [MAIN ] RACE: Loaded 33413 primary data records. [2025-09-18T22:56:52.042057] [DEBUG] [MAIN ] R: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:52.189557] [INFO ] [MAIN ] R: Generated 1807 derivative records from 30064 primary records. [2025-09-18T22:56:52.216205] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-09-18T22:56:52.216863] [DEBUG] [MAIN ] RA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:52.218387] [INFO ] [MAIN ] RA: Generated 1807 derivative records from 21939 primary records. [2025-09-18T22:56:52.218502] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-09-18T22:56:52.248285] [DEBUG] [LOCAL ] RA: Derivative data saved (1807 records). [2025-09-18T22:56:52.249482] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-09-18T22:56:52.251897] [INFO ] [MAIN ] Derivative Progress: 1513/2075 symbols completed. RA took 1.2s. Estimated remaining: 3m 38s. Rate: 154.6 symbols/min [2025-09-18T22:56:52.256846] [DEBUG] [LOCAL ] R: Derivative data saved (1807 records). [2025-09-18T22:56:52.257135] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-09-18T22:56:52.259229] [INFO ] [MAIN ] Derivative Progress: 1514/2075 symbols completed. R took 1.2s. Estimated remaining: 3m 38s. Rate: 154.7 symbols/min [2025-09-18T22:56:52.277506] [DEBUG] [MAIN ] RACE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:52.278102] [INFO ] [MAIN ] RACE: Generated 1807 derivative records from 33413 primary records. [2025-09-18T22:56:52.278164] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-09-18T22:56:52.293400] [DEBUG] [LOCAL ] RACE: Derivative data saved (1807 records). [2025-09-18T22:56:52.293465] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-09-18T22:56:52.296101] [INFO ] [MAIN ] Derivative Progress: 1515/2075 symbols completed. RACE took 1.0s. Estimated remaining: 3m 37s. Rate: 154.8 symbols/min [2025-09-18T22:56:52.296732] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:52.296777] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:52.296932] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:52.316754] [DEBUG] [LOCAL ] RBC: Loaded 15135 existing records from primary storage. [2025-09-18T22:56:52.316891] [INFO ] [MAIN ] RBC: Loaded 15135 primary data records. [2025-09-18T22:56:52.648989] [DEBUG] [LOCAL ] RAMP: Loaded 37978 existing records from primary storage. [2025-09-18T22:56:52.662126] [INFO ] [MAIN ] RAMP: Loaded 37978 primary data records. [2025-09-18T22:56:52.684094] [DEBUG] [LOCAL ] RBA: Loaded 46441 existing records from primary storage. [2025-09-18T22:56:52.707268] [INFO ] [MAIN ] RBA: Loaded 46441 primary data records. [2025-09-18T22:56:53.315206] [DEBUG] [MAIN ] RBC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:53.316319] [INFO ] [MAIN ] RBC: Generated 1807 derivative records from 15135 primary records. [2025-09-18T22:56:53.316793] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-09-18T22:56:53.336395] [DEBUG] [LOCAL ] RBC: Derivative data saved (1807 records). [2025-09-18T22:56:53.336927] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-09-18T22:56:53.339987] [INFO ] [MAIN ] Derivative Progress: 1516/2075 symbols completed. RBC took 1.0s. Estimated remaining: 3m 37s. Rate: 154.6 symbols/min [2025-09-18T22:56:53.341344] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:53.360578] [DEBUG] [MAIN ] RAMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:53.362516] [INFO ] [MAIN ] RAMP: Generated 1807 derivative records from 37978 primary records. [2025-09-18T22:56:53.362740] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-09-18T22:56:53.376769] [DEBUG] [MAIN ] RBA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:53.377591] [INFO ] [MAIN ] RBA: Generated 1807 derivative records from 46441 primary records. [2025-09-18T22:56:53.377981] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-09-18T22:56:53.411253] [DEBUG] [LOCAL ] RBA: Derivative data saved (1807 records). [2025-09-18T22:56:53.424384] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1807 records). [2025-09-18T22:56:53.424710] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-09-18T22:56:53.424848] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-09-18T22:56:53.426846] [INFO ] [MAIN ] Derivative Progress: 1517/2075 symbols completed. RAMP took 1.1s. Estimated remaining: 3m 36s. Rate: 154.7 symbols/min [2025-09-18T22:56:53.429876] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:53.430042] [INFO ] [MAIN ] Derivative Progress: 1518/2075 symbols completed. RBA took 1.1s. Estimated remaining: 3m 36s. Rate: 154.8 symbols/min [2025-09-18T22:56:53.430256] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:53.451515] [DEBUG] [LOCAL ] RBLX: Loaded 54112 existing records from primary storage. [2025-09-18T22:56:53.454684] [INFO ] [MAIN ] RBLX: Loaded 54112 primary data records. [2025-09-18T22:56:53.454601] [DEBUG] [LOCAL ] RBOT: Loaded 5141 existing records from primary storage. [2025-09-18T22:56:53.454978] [INFO ] [MAIN ] RBOT: Loaded 5141 primary data records. [2025-09-18T22:56:54.141229] [DEBUG] [LOCAL ] RBRK: Loaded 53461 existing records from primary storage. [2025-09-18T22:56:54.142120] [INFO ] [MAIN ] RBRK: Loaded 53461 primary data records. [2025-09-18T22:56:54.518996] [DEBUG] [MAIN ] RBLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:54.520275] [INFO ] [MAIN ] RBLX: Generated 1807 derivative records from 54112 primary records. [2025-09-18T22:56:54.520474] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-09-18T22:56:54.520765] [DEBUG] [MAIN ] RBOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:54.522802] [INFO ] [MAIN ] RBOT: Generated 1807 derivative records from 5141 primary records. [2025-09-18T22:56:54.523140] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-09-18T22:56:54.540121] [DEBUG] [LOCAL ] RBLX: Derivative data saved (1807 records). [2025-09-18T22:56:54.540438] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-09-18T22:56:54.542554] [INFO ] [MAIN ] Derivative Progress: 1519/2075 symbols completed. RBLX took 1.2s. Estimated remaining: 3m 36s. Rate: 154.6 symbols/min [2025-09-18T22:56:54.548990] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:54.574087] [DEBUG] [MAIN ] RBRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:54.574464] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1807 records). [2025-09-18T22:56:54.575264] [INFO ] [MAIN ] RBRK: Generated 1807 derivative records from 53461 primary records. [2025-09-18T22:56:54.575479] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-09-18T22:56:54.575587] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-09-18T22:56:54.578817] [INFO ] [MAIN ] Derivative Progress: 1520/2075 symbols completed. RBOT took 1.1s. Estimated remaining: 3m 35s. Rate: 154.7 symbols/min [2025-09-18T22:56:54.586517] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:54.595765] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1807 records). [2025-09-18T22:56:54.595966] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-09-18T22:56:54.598466] [INFO ] [MAIN ] Derivative Progress: 1521/2075 symbols completed. RBRK took 1.2s. Estimated remaining: 3m 35s. Rate: 154.8 symbols/min [2025-09-18T22:56:54.598842] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:54.622450] [DEBUG] [LOCAL ] RCS: Loaded 11657 existing records from primary storage. [2025-09-18T22:56:54.622763] [INFO ] [MAIN ] RCS: Loaded 11657 primary data records. [2025-09-18T22:56:54.706494] [DEBUG] [LOCAL ] RC: Loaded 49495 existing records from primary storage. [2025-09-18T22:56:54.729241] [INFO ] [MAIN ] RC: Loaded 49495 primary data records. [2025-09-18T22:56:54.922758] [DEBUG] [LOCAL ] RCI: Loaded 49208 existing records from primary storage. [2025-09-18T22:56:54.992776] [INFO ] [MAIN ] RCI: Loaded 49208 primary data records. [2025-09-18T22:56:55.607303] [DEBUG] [MAIN ] RCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:55.608286] [INFO ] [MAIN ] RCS: Generated 1807 derivative records from 11657 primary records. [2025-09-18T22:56:55.609328] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-09-18T22:56:55.638251] [DEBUG] [MAIN ] RC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:55.639166] [INFO ] [MAIN ] RC: Generated 1807 derivative records from 49495 primary records. [2025-09-18T22:56:55.639415] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-09-18T22:56:55.658502] [DEBUG] [LOCAL ] RCS: Derivative data saved (1807 records). [2025-09-18T22:56:55.659700] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-09-18T22:56:55.659570] [DEBUG] [LOCAL ] RC: Derivative data saved (1807 records). [2025-09-18T22:56:55.659861] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-09-18T22:56:55.661952] [INFO ] [MAIN ] Derivative Progress: 1522/2075 symbols completed. RCS took 1.1s. Estimated remaining: 3m 35s. Rate: 154.6 symbols/min [2025-09-18T22:56:55.663110] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:55.666175] [INFO ] [MAIN ] Derivative Progress: 1523/2075 symbols completed. RC took 1.1s. Estimated remaining: 3m 34s. Rate: 154.7 symbols/min [2025-09-18T22:56:55.667177] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:55.680675] [DEBUG] [MAIN ] RCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:55.681504] [INFO ] [MAIN ] RCI: Generated 1807 derivative records from 49208 primary records. [2025-09-18T22:56:55.681686] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-09-18T22:56:55.698897] [DEBUG] [LOCAL ] RCI: Derivative data saved (1807 records). [2025-09-18T22:56:55.698964] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-09-18T22:56:55.701566] [INFO ] [MAIN ] Derivative Progress: 1524/2075 symbols completed. RCI took 1.1s. Estimated remaining: 3m 34s. Rate: 154.8 symbols/min [2025-09-18T22:56:55.701897] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:55.750538] [DEBUG] [LOCAL ] RCUS: Loaded 43205 existing records from primary storage. [2025-09-18T22:56:55.750809] [INFO ] [MAIN ] RCUS: Loaded 43205 primary data records. [2025-09-18T22:56:55.884274] [DEBUG] [LOCAL ] RDDT: Loaded 54174 existing records from primary storage. [2025-09-18T22:56:55.911859] [INFO ] [MAIN ] RDDT: Loaded 54174 primary data records. [2025-09-18T22:56:55.949456] [DEBUG] [LOCAL ] RDN: Loaded 45529 existing records from primary storage. [2025-09-18T22:56:55.997194] [INFO ] [MAIN ] RDN: Loaded 45529 primary data records. [2025-09-18T22:56:56.775691] [DEBUG] [MAIN ] RCUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:56.777014] [INFO ] [MAIN ] RCUS: Generated 1807 derivative records from 43205 primary records. [2025-09-18T22:56:56.777211] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-09-18T22:56:56.794522] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1807 records). [2025-09-18T22:56:56.794660] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-09-18T22:56:56.797014] [INFO ] [MAIN ] Derivative Progress: 1525/2075 symbols completed. RCUS took 1.1s. Estimated remaining: 3m 33s. Rate: 154.6 symbols/min [2025-09-18T22:56:56.800426] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:56.817117] [DEBUG] [MAIN ] RDN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:56.818312] [INFO ] [MAIN ] RDN: Generated 1807 derivative records from 45529 primary records. [2025-09-18T22:56:56.830874] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-09-18T22:56:56.831403] [DEBUG] [MAIN ] RDDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:56.833286] [INFO ] [MAIN ] RDDT: Generated 1807 derivative records from 54174 primary records. [2025-09-18T22:56:56.833398] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-09-18T22:56:56.866395] [DEBUG] [LOCAL ] RDN: Derivative data saved (1807 records). [2025-09-18T22:56:56.880013] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-09-18T22:56:56.882487] [INFO ] [MAIN ] Derivative Progress: 1526/2075 symbols completed. RDN took 1.2s. Estimated remaining: 3m 33s. Rate: 154.7 symbols/min [2025-09-18T22:56:56.879877] [DEBUG] [LOCAL ] RDDT: Derivative data saved (1807 records). [2025-09-18T22:56:56.882827] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-09-18T22:56:56.885838] [INFO ] [MAIN ] Derivative Progress: 1527/2075 symbols completed. RDDT took 1.2s. Estimated remaining: 3m 32s. Rate: 154.8 symbols/min [2025-09-18T22:56:56.886284] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:56.885955] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:56.905955] [DEBUG] [LOCAL ] RDW: Loaded 52378 existing records from primary storage. [2025-09-18T22:56:56.906316] [INFO ] [MAIN ] RDW: Loaded 52378 primary data records. [2025-09-18T22:56:57.256984] [DEBUG] [LOCAL ] RELX: Loaded 48209 existing records from primary storage. [2025-09-18T22:56:57.258777] [INFO ] [MAIN ] RELX: Loaded 48209 primary data records. [2025-09-18T22:56:57.259815] [DEBUG] [LOCAL ] RDY: Loaded 47286 existing records from primary storage. [2025-09-18T22:56:57.280825] [INFO ] [MAIN ] RDY: Loaded 47286 primary data records. [2025-09-18T22:56:58.059921] [DEBUG] [MAIN ] RDW: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:56:58.061410] [INFO ] [MAIN ] RDW: Generated 1806 derivative records from 52378 primary records. [2025-09-18T22:56:58.061825] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-09-18T22:56:58.093544] [DEBUG] [LOCAL ] RDW: Derivative data saved (1806 records). [2025-09-18T22:56:58.093948] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-09-18T22:56:58.097217] [INFO ] [MAIN ] Derivative Progress: 1528/2075 symbols completed. RDW took 1.3s. Estimated remaining: 3m 32s. Rate: 154.6 symbols/min [2025-09-18T22:56:58.124167] [DEBUG] [MAIN ] RELX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:58.125413] [INFO ] [MAIN ] RELX: Generated 1807 derivative records from 48209 primary records. [2025-09-18T22:56:58.140114] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-09-18T22:56:58.140008] [DEBUG] [MAIN ] RDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:58.142202] [INFO ] [MAIN ] RDY: Generated 1807 derivative records from 47286 primary records. [2025-09-18T22:56:58.142566] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-09-18T22:56:58.162601] [DEBUG] [LOCAL ] RELX: Derivative data saved (1807 records). [2025-09-18T22:56:58.173154] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-09-18T22:56:58.179939] [INFO ] [MAIN ] Derivative Progress: 1529/2075 symbols completed. RELX took 1.3s. Estimated remaining: 3m 32s. Rate: 154.7 symbols/min [2025-09-18T22:56:58.187212] [DEBUG] [LOCAL ] RDY: Derivative data saved (1807 records). [2025-09-18T22:56:58.187383] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-09-18T22:56:58.191117] [INFO ] [MAIN ] Derivative Progress: 1530/2075 symbols completed. RDY took 1.3s. Estimated remaining: 3m 31s. Rate: 154.8 symbols/min [2025-09-18T22:56:58.192281] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:58.192121] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:58.193306] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:58.215752] [DEBUG] [LOCAL ] REX: Loaded 13927 existing records from primary storage. [2025-09-18T22:56:58.216051] [INFO ] [MAIN ] REX: Loaded 13927 primary data records. [2025-09-18T22:56:58.418998] [DEBUG] [LOCAL ] RERE: Loaded 41126 existing records from primary storage. [2025-09-18T22:56:58.435811] [INFO ] [MAIN ] RERE: Loaded 41126 primary data records. [2025-09-18T22:56:58.510451] [DEBUG] [LOCAL ] RES: Loaded 47909 existing records from primary storage. [2025-09-18T22:56:58.596382] [INFO ] [MAIN ] RES: Loaded 47909 primary data records. [2025-09-18T22:56:59.441425] [DEBUG] [MAIN ] REX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:59.442937] [INFO ] [MAIN ] REX: Generated 1807 derivative records from 13927 primary records. [2025-09-18T22:56:59.443219] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-09-18T22:56:59.476072] [DEBUG] [MAIN ] RERE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:59.477370] [INFO ] [MAIN ] RERE: Generated 1807 derivative records from 41126 primary records. [2025-09-18T22:56:59.477952] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-09-18T22:56:59.480260] [DEBUG] [LOCAL ] REX: Derivative data saved (1807 records). [2025-09-18T22:56:59.491684] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-09-18T22:56:59.493745] [INFO ] [MAIN ] Derivative Progress: 1531/2075 symbols completed. REX took 1.3s. Estimated remaining: 3m 31s. Rate: 154.5 symbols/min [2025-09-18T22:56:59.496599] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:59.500233] [DEBUG] [LOCAL ] RERE: Derivative data saved (1807 records). [2025-09-18T22:56:59.500468] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-09-18T22:56:59.503089] [INFO ] [MAIN ] Derivative Progress: 1532/2075 symbols completed. RERE took 1.3s. Estimated remaining: 3m 31s. Rate: 154.6 symbols/min [2025-09-18T22:56:59.503397] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:59.519919] [DEBUG] [MAIN ] RES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:56:59.520616] [INFO ] [MAIN ] RES: Generated 1807 derivative records from 47909 primary records. [2025-09-18T22:56:59.520847] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-09-18T22:56:59.536965] [DEBUG] [LOCAL ] RES: Derivative data saved (1807 records). [2025-09-18T22:56:59.537035] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-09-18T22:56:59.539724] [INFO ] [MAIN ] Derivative Progress: 1533/2075 symbols completed. RES took 1.3s. Estimated remaining: 3m 30s. Rate: 154.7 symbols/min [2025-09-18T22:56:59.540055] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:56:59.603104] [DEBUG] [LOCAL ] REXR: Loaded 52409 existing records from primary storage. [2025-09-18T22:56:59.614608] [INFO ] [MAIN ] REXR: Loaded 52409 primary data records. [2025-09-18T22:56:59.667782] [DEBUG] [LOCAL ] REZI: Loaded 47178 existing records from primary storage. [2025-09-18T22:56:59.707400] [INFO ] [MAIN ] REZI: Loaded 47178 primary data records. [2025-09-18T22:56:59.779269] [DEBUG] [LOCAL ] RF: Loaded 54020 existing records from primary storage. [2025-09-18T22:56:59.799214] [INFO ] [MAIN ] RF: Loaded 54020 primary data records. [2025-09-18T22:57:00.710199] [DEBUG] [MAIN ] REXR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:00.711957] [INFO ] [MAIN ] REXR: Generated 1807 derivative records from 52409 primary records. [2025-09-18T22:57:00.712099] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-09-18T22:57:00.740088] [DEBUG] [MAIN ] REZI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:00.741451] [INFO ] [MAIN ] REZI: Generated 1807 derivative records from 47178 primary records. [2025-09-18T22:57:00.741777] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-09-18T22:57:00.761183] [DEBUG] [LOCAL ] REZI: Derivative data saved (1807 records). [2025-09-18T22:57:00.763146] [DEBUG] [LOCAL ] REXR: Derivative data saved (1807 records). [2025-09-18T22:57:00.764432] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-09-18T22:57:00.764158] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-09-18T22:57:00.767124] [INFO ] [MAIN ] Derivative Progress: 1534/2075 symbols completed. REZI took 1.3s. Estimated remaining: 3m 30s. Rate: 154.5 symbols/min [2025-09-18T22:57:00.781904] [INFO ] [MAIN ] Derivative Progress: 1535/2075 symbols completed. REXR took 1.3s. Estimated remaining: 3m 30s. Rate: 154.6 symbols/min [2025-09-18T22:57:00.782399] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:00.782037] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:00.782775] [DEBUG] [MAIN ] RF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:00.784528] [INFO ] [MAIN ] RF: Generated 1807 derivative records from 54020 primary records. [2025-09-18T22:57:00.784740] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-09-18T22:57:00.810844] [DEBUG] [LOCAL ] RFI: Loaded 10613 existing records from primary storage. [2025-09-18T22:57:00.815155] [DEBUG] [LOCAL ] RF: Derivative data saved (1807 records). [2025-09-18T22:57:00.815476] [DEBUG] [LOCAL ] RFL: Loaded 10653 existing records from primary storage. [2025-09-18T22:57:00.815589] [INFO ] [MAIN ] RFL: Loaded 10653 primary data records. [2025-09-18T22:57:00.815733] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-09-18T22:57:00.818350] [INFO ] [MAIN ] Derivative Progress: 1536/2075 symbols completed. RF took 1.3s. Estimated remaining: 3m 29s. Rate: 154.7 symbols/min [2025-09-18T22:57:00.818450] [INFO ] [MAIN ] RFI: Loaded 10613 primary data records. [2025-09-18T22:57:00.823910] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:01.004080] [DEBUG] [LOCAL ] RFM: Loaded 4093 existing records from primary storage. [2025-09-18T22:57:01.031867] [INFO ] [MAIN ] RFM: Loaded 4093 primary data records. [2025-09-18T22:57:01.813005] [DEBUG] [MAIN ] RFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:01.826785] [INFO ] [MAIN ] RFI: Generated 1807 derivative records from 10613 primary records. [2025-09-18T22:57:01.827234] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-09-18T22:57:01.827781] [DEBUG] [MAIN ] RFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:01.829531] [INFO ] [MAIN ] RFL: Generated 1807 derivative records from 10653 primary records. [2025-09-18T22:57:01.836930] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-09-18T22:57:01.871137] [DEBUG] [MAIN ] RFM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:01.873021] [INFO ] [MAIN ] RFM: Generated 1807 derivative records from 4093 primary records. [2025-09-18T22:57:01.873566] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-09-18T22:57:01.875998] [DEBUG] [LOCAL ] RFI: Derivative data saved (1807 records). [2025-09-18T22:57:01.876723] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-09-18T22:57:01.878813] [INFO ] [MAIN ] Derivative Progress: 1537/2075 symbols completed. RFI took 1.1s. Estimated remaining: 3m 29s. Rate: 154.5 symbols/min [2025-09-18T22:57:01.889958] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:01.891940] [DEBUG] [LOCAL ] RFL: Derivative data saved (1807 records). [2025-09-18T22:57:01.892120] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-09-18T22:57:01.894694] [INFO ] [MAIN ] Derivative Progress: 1538/2075 symbols completed. RFL took 1.1s. Estimated remaining: 3m 28s. Rate: 154.6 symbols/min [2025-09-18T22:57:01.895746] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:01.910405] [DEBUG] [LOCAL ] RFMZ: Loaded 8561 existing records from primary storage. [2025-09-18T22:57:01.909983] [DEBUG] [LOCAL ] RFM: Derivative data saved (1807 records). [2025-09-18T22:57:01.910710] [INFO ] [MAIN ] RFMZ: Loaded 8561 primary data records. [2025-09-18T22:57:01.910593] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-09-18T22:57:01.928834] [INFO ] [MAIN ] Derivative Progress: 1539/2075 symbols completed. RFM took 1.1s. Estimated remaining: 3m 28s. Rate: 154.7 symbols/min [2025-09-18T22:57:01.957099] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:02.143589] [DEBUG] [LOCAL ] RGR: Loaded 20255 existing records from primary storage. [2025-09-18T22:57:02.144725] [INFO ] [MAIN ] RGR: Loaded 20255 primary data records. [2025-09-18T22:57:02.144625] [DEBUG] [LOCAL ] RGA: Loaded 30484 existing records from primary storage. [2025-09-18T22:57:02.265574] [INFO ] [MAIN ] RGA: Loaded 30484 primary data records. [2025-09-18T22:57:02.940974] [DEBUG] [MAIN ] RFMZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:02.942254] [INFO ] [MAIN ] RFMZ: Generated 1807 derivative records from 8561 primary records. [2025-09-18T22:57:02.942369] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-09-18T22:57:02.962549] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1807 records). [2025-09-18T22:57:02.962891] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-09-18T22:57:02.965051] [INFO ] [MAIN ] Derivative Progress: 1540/2075 symbols completed. RFMZ took 1.1s. Estimated remaining: 3m 28s. Rate: 154.5 symbols/min [2025-09-18T22:57:02.968584] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:02.995327] [DEBUG] [MAIN ] RGA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:02.996933] [INFO ] [MAIN ] RGA: Generated 1807 derivative records from 30484 primary records. [2025-09-18T22:57:02.997172] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-09-18T22:57:02.997400] [DEBUG] [MAIN ] RGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:02.998088] [INFO ] [MAIN ] RGR: Generated 1807 derivative records from 20255 primary records. [2025-09-18T22:57:02.998185] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-09-18T22:57:03.001898] [DEBUG] [LOCAL ] RGT: Loaded 2936 existing records from primary storage. [2025-09-18T22:57:03.009475] [INFO ] [MAIN ] RGT: Loaded 2936 primary data records. [2025-09-18T22:57:03.143979] [DEBUG] [LOCAL ] RGR: Derivative data saved (1807 records). [2025-09-18T22:57:03.155267] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-09-18T22:57:03.155209] [DEBUG] [LOCAL ] RGA: Derivative data saved (1807 records). [2025-09-18T22:57:03.162210] [INFO ] [MAIN ] Derivative Progress: 1541/2075 symbols completed. RGR took 1.2s. Estimated remaining: 3m 27s. Rate: 154.6 symbols/min [2025-09-18T22:57:03.191685] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-09-18T22:57:03.185581] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:03.212289] [INFO ] [MAIN ] Derivative Progress: 1542/2075 symbols completed. RGA took 1.3s. Estimated remaining: 3m 27s. Rate: 154.7 symbols/min [2025-09-18T22:57:03.218074] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:03.365679] [DEBUG] [MAIN ] RGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:03.366425] [INFO ] [MAIN ] RGT: Generated 1807 derivative records from 2936 primary records. [2025-09-18T22:57:03.366579] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-09-18T22:57:03.401047] [DEBUG] [LOCAL ] RGT: Derivative data saved (1807 records). [2025-09-18T22:57:03.401192] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-09-18T22:57:03.403635] [INFO ] [MAIN ] Derivative Progress: 1543/2075 symbols completed. RGT took 0.4s. Estimated remaining: 3m 26s. Rate: 154.7 symbols/min [2025-09-18T22:57:03.431534] [DEBUG] [LOCAL ] RHI: Loaded 49598 existing records from primary storage. [2025-09-18T22:57:03.431734] [INFO ] [MAIN ] RHI: Loaded 49598 primary data records. [2025-09-18T22:57:03.432518] [DEBUG] [LOCAL ] RH: Loaded 48119 existing records from primary storage. [2025-09-18T22:57:03.478345] [INFO ] [MAIN ] RH: Loaded 48119 primary data records. [2025-09-18T22:57:04.068473] [DEBUG] [MAIN ] RHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:04.069489] [INFO ] [MAIN ] RHI: Generated 1807 derivative records from 49598 primary records. [2025-09-18T22:57:04.068828] [DEBUG] [MAIN ] RH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:04.070115] [INFO ] [MAIN ] RH: Generated 1807 derivative records from 48119 primary records. [2025-09-18T22:57:04.070193] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-09-18T22:57:04.070249] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-09-18T22:57:04.100812] [DEBUG] [LOCAL ] RH: Derivative data saved (1807 records). [2025-09-18T22:57:04.101280] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-09-18T22:57:04.103909] [DEBUG] [LOCAL ] RHI: Derivative data saved (1807 records). [2025-09-18T22:57:04.104002] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-09-18T22:57:04.103619] [INFO ] [MAIN ] Derivative Progress: 1544/2075 symbols completed. RH took 0.9s. Estimated remaining: 3m 26s. Rate: 154.6 symbols/min [2025-09-18T22:57:04.106138] [INFO ] [MAIN ] Derivative Progress: 1545/2075 symbols completed. RHI took 0.9s. Estimated remaining: 3m 26s. Rate: 154.7 symbols/min [2025-09-18T22:57:04.106565] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:04.106784] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:04.106875] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:04.160064] [DEBUG] [LOCAL ] RHP: Loaded 42071 existing records from primary storage. [2025-09-18T22:57:04.160216] [INFO ] [MAIN ] RHP: Loaded 42071 primary data records. [2025-09-18T22:57:04.333718] [DEBUG] [LOCAL ] RIO: Loaded 53789 existing records from primary storage. [2025-09-18T22:57:04.316930] [DEBUG] [LOCAL ] RIG: Loaded 54062 existing records from primary storage. [2025-09-18T22:57:04.344236] [INFO ] [MAIN ] RIG: Loaded 54062 primary data records. [2025-09-18T22:57:04.349475] [INFO ] [MAIN ] RIO: Loaded 53789 primary data records. [2025-09-18T22:57:05.192762] [DEBUG] [MAIN ] RHP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:05.193745] [INFO ] [MAIN ] RHP: Generated 1807 derivative records from 42071 primary records. [2025-09-18T22:57:05.193952] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-09-18T22:57:05.216313] [DEBUG] [LOCAL ] RHP: Derivative data saved (1807 records). [2025-09-18T22:57:05.224133] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-09-18T22:57:05.231168] [INFO ] [MAIN ] Derivative Progress: 1546/2075 symbols completed. RHP took 1.1s. Estimated remaining: 3m 25s. Rate: 154.5 symbols/min [2025-09-18T22:57:05.229339] [DEBUG] [MAIN ] RIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:05.239372] [INFO ] [MAIN ] RIO: Generated 1807 derivative records from 53789 primary records. [2025-09-18T22:57:05.243801] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-09-18T22:57:05.244900] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:05.245526] [DEBUG] [MAIN ] RIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:05.246730] [INFO ] [MAIN ] RIG: Generated 1807 derivative records from 54062 primary records. [2025-09-18T22:57:05.257690] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-09-18T22:57:05.277235] [DEBUG] [LOCAL ] RIO: Derivative data saved (1807 records). [2025-09-18T22:57:05.277891] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-09-18T22:57:05.280891] [INFO ] [MAIN ] Derivative Progress: 1547/2075 symbols completed. RIO took 1.2s. Estimated remaining: 3m 25s. Rate: 154.6 symbols/min [2025-09-18T22:57:05.281490] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:05.282265] [DEBUG] [LOCAL ] RIG: Derivative data saved (1807 records). [2025-09-18T22:57:05.282465] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-09-18T22:57:05.285249] [INFO ] [MAIN ] Derivative Progress: 1548/2075 symbols completed. RIG took 1.2s. Estimated remaining: 3m 24s. Rate: 154.7 symbols/min [2025-09-18T22:57:05.285921] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:05.310993] [DEBUG] [LOCAL ] RIV: Loaded 11782 existing records from primary storage. [2025-09-18T22:57:05.311126] [INFO ] [MAIN ] RIV: Loaded 11782 primary data records. [2025-09-18T22:57:05.430816] [DEBUG] [LOCAL ] RITM: Loaded 53187 existing records from primary storage. [2025-09-18T22:57:05.431336] [INFO ] [MAIN ] RITM: Loaded 53187 primary data records. [2025-09-18T22:57:05.778061] [DEBUG] [LOCAL ] RJF: Loaded 47500 existing records from primary storage. [2025-09-18T22:57:05.796368] [INFO ] [MAIN ] RJF: Loaded 47500 primary data records. [2025-09-18T22:57:06.286441] [DEBUG] [MAIN ] RIV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:06.287677] [INFO ] [MAIN ] RIV: Generated 1807 derivative records from 11782 primary records. [2025-09-18T22:57:06.287776] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-09-18T22:57:06.318889] [DEBUG] [MAIN ] RITM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:06.320530] [INFO ] [MAIN ] RITM: Generated 1807 derivative records from 53187 primary records. [2025-09-18T22:57:06.320977] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-09-18T22:57:06.330580] [DEBUG] [LOCAL ] RIV: Derivative data saved (1807 records). [2025-09-18T22:57:06.334851] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-09-18T22:57:06.337026] [INFO ] [MAIN ] Derivative Progress: 1549/2075 symbols completed. RIV took 1.1s. Estimated remaining: 3m 24s. Rate: 154.6 symbols/min [2025-09-18T22:57:06.337506] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:06.357534] [DEBUG] [MAIN ] RJF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:06.358863] [INFO ] [MAIN ] RJF: Generated 1807 derivative records from 47500 primary records. [2025-09-18T22:57:06.358099] [DEBUG] [LOCAL ] RITM: Derivative data saved (1807 records). [2025-09-18T22:57:06.359016] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-09-18T22:57:06.359091] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-09-18T22:57:06.361666] [INFO ] [MAIN ] Derivative Progress: 1550/2075 symbols completed. RITM took 1.1s. Estimated remaining: 3m 24s. Rate: 154.6 symbols/min [2025-09-18T22:57:06.362318] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:06.379823] [DEBUG] [LOCAL ] RJF: Derivative data saved (1807 records). [2025-09-18T22:57:06.380028] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-09-18T22:57:06.382781] [INFO ] [MAIN ] Derivative Progress: 1551/2075 symbols completed. RJF took 1.1s. Estimated remaining: 3m 23s. Rate: 154.7 symbols/min [2025-09-18T22:57:06.383181] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:06.448319] [DEBUG] [LOCAL ] RKT: Loaded 54110 existing records from primary storage. [2025-09-18T22:57:06.449567] [INFO ] [MAIN ] RKT: Loaded 54110 primary data records. [2025-09-18T22:57:06.455669] [DEBUG] [LOCAL ] RL: Loaded 42280 existing records from primary storage. [2025-09-18T22:57:06.473066] [INFO ] [MAIN ] RL: Loaded 42280 primary data records. [2025-09-18T22:57:06.656496] [DEBUG] [LOCAL ] RLI: Loaded 33515 existing records from primary storage. [2025-09-18T22:57:06.670184] [INFO ] [MAIN ] RLI: Loaded 33515 primary data records. [2025-09-18T22:57:07.474386] [DEBUG] [MAIN ] RKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:07.479594] [INFO ] [MAIN ] RKT: Generated 1807 derivative records from 54110 primary records. [2025-09-18T22:57:07.480895] [DEBUG] [MAIN ] RL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:07.480549] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-09-18T22:57:07.481729] [INFO ] [MAIN ] RL: Generated 1807 derivative records from 42280 primary records. [2025-09-18T22:57:07.482014] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-09-18T22:57:07.530470] [DEBUG] [MAIN ] RLI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:07.532157] [INFO ] [MAIN ] RLI: Generated 1807 derivative records from 33515 primary records. [2025-09-18T22:57:07.533101] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-09-18T22:57:07.535988] [DEBUG] [LOCAL ] RKT: Derivative data saved (1807 records). [2025-09-18T22:57:07.545100] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-09-18T22:57:07.551011] [INFO ] [MAIN ] Derivative Progress: 1552/2075 symbols completed. RKT took 1.2s. Estimated remaining: 3m 23s. Rate: 154.5 symbols/min [2025-09-18T22:57:07.551199] [DEBUG] [LOCAL ] RL: Derivative data saved (1807 records). [2025-09-18T22:57:07.551870] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-09-18T22:57:07.554389] [INFO ] [MAIN ] Derivative Progress: 1553/2075 symbols completed. RL took 1.2s. Estimated remaining: 3m 23s. Rate: 154.6 symbols/min [2025-09-18T22:57:07.551458] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:07.555945] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:07.562134] [DEBUG] [LOCAL ] RLI: Derivative data saved (1807 records). [2025-09-18T22:57:07.564835] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-09-18T22:57:07.568028] [INFO ] [MAIN ] Derivative Progress: 1554/2075 symbols completed. RLI took 1.2s. Estimated remaining: 3m 22s. Rate: 154.7 symbols/min [2025-09-18T22:57:07.568491] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:07.575043] [DEBUG] [LOCAL ] RLTY: Loaded 11372 existing records from primary storage. [2025-09-18T22:57:07.575166] [INFO ] [MAIN ] RLTY: Loaded 11372 primary data records. [2025-09-18T22:57:07.964862] [DEBUG] [LOCAL ] RLJ: Loaded 48681 existing records from primary storage. [2025-09-18T22:57:07.965513] [INFO ] [MAIN ] RLJ: Loaded 48681 primary data records. [2025-09-18T22:57:08.031237] [DEBUG] [LOCAL ] RLX: Loaded 48504 existing records from primary storage. [2025-09-18T22:57:08.040047] [INFO ] [MAIN ] RLX: Loaded 48504 primary data records. [2025-09-18T22:57:08.689109] [DEBUG] [MAIN ] RLTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:08.691620] [INFO ] [MAIN ] RLTY: Generated 1807 derivative records from 11372 primary records. [2025-09-18T22:57:08.692678] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-09-18T22:57:08.712406] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1807 records). [2025-09-18T22:57:08.712854] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-09-18T22:57:08.715157] [INFO ] [MAIN ] Derivative Progress: 1555/2075 symbols completed. RLTY took 1.2s. Estimated remaining: 3m 22s. Rate: 154.5 symbols/min [2025-09-18T22:57:08.715593] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:08.736472] [DEBUG] [MAIN ] RLJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:08.737292] [INFO ] [MAIN ] RLJ: Generated 1807 derivative records from 48681 primary records. [2025-09-18T22:57:08.737410] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-09-18T22:57:08.750573] [DEBUG] [LOCAL ] RM: Loaded 7801 existing records from primary storage. [2025-09-18T22:57:08.756512] [INFO ] [MAIN ] RM: Loaded 7801 primary data records. [2025-09-18T22:57:08.813383] [DEBUG] [MAIN ] RLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:08.822736] [INFO ] [MAIN ] RLX: Generated 1807 derivative records from 48504 primary records. [2025-09-18T22:57:08.823301] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-09-18T22:57:08.829699] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1807 records). [2025-09-18T22:57:08.869148] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-09-18T22:57:08.871232] [INFO ] [MAIN ] Derivative Progress: 1556/2075 symbols completed. RLJ took 1.3s. Estimated remaining: 3m 21s. Rate: 154.6 symbols/min [2025-09-18T22:57:08.882801] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:09.011959] [DEBUG] [LOCAL ] RLX: Derivative data saved (1807 records). [2025-09-18T22:57:09.135928] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-09-18T22:57:09.139271] [INFO ] [MAIN ] Derivative Progress: 1557/2075 symbols completed. RLX took 1.6s. Estimated remaining: 3m 21s. Rate: 154.6 symbols/min [2025-09-18T22:57:09.146385] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:09.147240] [DEBUG] [LOCAL ] RMAX: Loaded 21953 existing records from primary storage. [2025-09-18T22:57:09.147904] [INFO ] [MAIN ] RMAX: Loaded 21953 primary data records. [2025-09-18T22:57:09.495542] [DEBUG] [LOCAL ] RMD: Loaded 42846 existing records from primary storage. [2025-09-18T22:57:09.497377] [DEBUG] [MAIN ] RM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:09.497571] [INFO ] [MAIN ] RMD: Loaded 42846 primary data records. [2025-09-18T22:57:09.498743] [INFO ] [MAIN ] RM: Generated 1807 derivative records from 7801 primary records. [2025-09-18T22:57:09.498944] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-09-18T22:57:09.663335] [DEBUG] [LOCAL ] RM: Derivative data saved (1807 records). [2025-09-18T22:57:09.703892] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-09-18T22:57:09.832758] [INFO ] [MAIN ] Derivative Progress: 1558/2075 symbols completed. RM took 1.1s. Estimated remaining: 3m 21s. Rate: 154.6 symbols/min [2025-09-18T22:57:09.842478] [DEBUG] [MAIN ] RMAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:09.843536] [INFO ] [MAIN ] RMAX: Generated 1807 derivative records from 21953 primary records. [2025-09-18T22:57:09.843719] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-09-18T22:57:09.862355] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1807 records). [2025-09-18T22:57:09.863370] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-09-18T22:57:09.866229] [INFO ] [MAIN ] Derivative Progress: 1559/2075 symbols completed. RMAX took 1.0s. Estimated remaining: 3m 20s. Rate: 154.6 symbols/min [2025-09-18T22:57:09.884555] [DEBUG] [MAIN ] RMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:09.885174] [INFO ] [MAIN ] RMD: Generated 1807 derivative records from 42846 primary records. [2025-09-18T22:57:09.885238] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-09-18T22:57:09.901029] [DEBUG] [LOCAL ] RMD: Derivative data saved (1807 records). [2025-09-18T22:57:09.901094] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-09-18T22:57:09.903395] [INFO ] [MAIN ] Derivative Progress: 1560/2075 symbols completed. RMD took 0.8s. Estimated remaining: 3m 20s. Rate: 154.7 symbols/min [2025-09-18T22:57:09.904184] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:09.904280] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:09.904908] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:09.912980] [DEBUG] [LOCAL ] RMI: Loaded 4657 existing records from primary storage. [2025-09-18T22:57:09.915693] [INFO ] [MAIN ] RMI: Loaded 4657 primary data records. [2025-09-18T22:57:09.915578] [DEBUG] [LOCAL ] RMMZ: Loaded 4843 existing records from primary storage. [2025-09-18T22:57:09.948753] [INFO ] [MAIN ] RMMZ: Loaded 4843 primary data records. [2025-09-18T22:57:10.040444] [DEBUG] [LOCAL ] RMM: Loaded 10271 existing records from primary storage. [2025-09-18T22:57:10.071593] [INFO ] [MAIN ] RMM: Loaded 10271 primary data records. [2025-09-18T22:57:10.916260] [DEBUG] [MAIN ] RMMZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:10.930365] [INFO ] [MAIN ] RMMZ: Generated 1807 derivative records from 4843 primary records. [2025-09-18T22:57:10.931766] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-09-18T22:57:10.933049] [DEBUG] [MAIN ] RMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:10.933931] [INFO ] [MAIN ] RMI: Generated 1807 derivative records from 4657 primary records. [2025-09-18T22:57:10.944903] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-09-18T22:57:10.965450] [DEBUG] [MAIN ] RMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:10.970373] [INFO ] [MAIN ] RMM: Generated 1807 derivative records from 10271 primary records. [2025-09-18T22:57:10.971164] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-09-18T22:57:10.987540] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1807 records). [2025-09-18T22:57:10.987906] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-09-18T22:57:10.990548] [INFO ] [MAIN ] Derivative Progress: 1561/2075 symbols completed. RMMZ took 1.1s. Estimated remaining: 3m 20s. Rate: 154.6 symbols/min [2025-09-18T22:57:10.991314] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:10.996230] [DEBUG] [LOCAL ] RMI: Derivative data saved (1807 records). [2025-09-18T22:57:10.997471] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-09-18T22:57:10.997356] [DEBUG] [LOCAL ] RMM: Derivative data saved (1807 records). [2025-09-18T22:57:10.997585] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-09-18T22:57:11.000355] [INFO ] [MAIN ] Derivative Progress: 1562/2075 symbols completed. RMI took 1.1s. Estimated remaining: 3m 19s. Rate: 154.6 symbols/min [2025-09-18T22:57:11.003294] [INFO ] [MAIN ] Derivative Progress: 1563/2075 symbols completed. RMM took 1.1s. Estimated remaining: 3m 19s. Rate: 154.7 symbols/min [2025-09-18T22:57:11.003676] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:11.003393] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:11.018582] [DEBUG] [LOCAL ] RMT: Loaded 17886 existing records from primary storage. [2025-09-18T22:57:11.018906] [INFO ] [MAIN ] RMT: Loaded 17886 primary data records. [2025-09-18T22:57:11.122772] [DEBUG] [LOCAL ] RNGR: Loaded 20620 existing records from primary storage. [2025-09-18T22:57:11.134017] [INFO ] [MAIN ] RNGR: Loaded 20620 primary data records. [2025-09-18T22:57:11.549408] [DEBUG] [LOCAL ] RNG: Loaded 48600 existing records from primary storage. [2025-09-18T22:57:11.666843] [INFO ] [MAIN ] RNG: Loaded 48600 primary data records. [2025-09-18T22:57:12.005791] [DEBUG] [MAIN ] RMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:12.007377] [INFO ] [MAIN ] RMT: Generated 1807 derivative records from 17886 primary records. [2025-09-18T22:57:12.008256] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-09-18T22:57:12.038878] [DEBUG] [MAIN ] RNGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:12.040417] [INFO ] [MAIN ] RNGR: Generated 1807 derivative records from 20620 primary records. [2025-09-18T22:57:12.040700] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-09-18T22:57:12.055788] [DEBUG] [LOCAL ] RMT: Derivative data saved (1807 records). [2025-09-18T22:57:12.056811] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-09-18T22:57:12.059620] [INFO ] [MAIN ] Derivative Progress: 1564/2075 symbols completed. RMT took 1.1s. Estimated remaining: 3m 18s. Rate: 154.6 symbols/min [2025-09-18T22:57:12.060755] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:12.069190] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1807 records). [2025-09-18T22:57:12.069582] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-09-18T22:57:12.072579] [INFO ] [MAIN ] Derivative Progress: 1565/2075 symbols completed. RNGR took 1.1s. Estimated remaining: 3m 18s. Rate: 154.7 symbols/min [2025-09-18T22:57:12.086057] [DEBUG] [MAIN ] RNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:12.086395] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:12.087164] [INFO ] [MAIN ] RNG: Generated 1807 derivative records from 48600 primary records. [2025-09-18T22:57:12.087384] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-09-18T22:57:12.112143] [DEBUG] [LOCAL ] RNP: Loaded 15981 existing records from primary storage. [2025-09-18T22:57:12.113095] [INFO ] [MAIN ] RNP: Loaded 15981 primary data records. [2025-09-18T22:57:12.238302] [DEBUG] [LOCAL ] RNG: Derivative data saved (1807 records). [2025-09-18T22:57:12.269007] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-09-18T22:57:12.283220] [INFO ] [MAIN ] Derivative Progress: 1566/2075 symbols completed. RNG took 1.3s. Estimated remaining: 3m 17s. Rate: 154.7 symbols/min [2025-09-18T22:57:12.343551] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:12.335435] [DEBUG] [LOCAL ] RNR: Loaded 34997 existing records from primary storage. [2025-09-18T22:57:12.344361] [INFO ] [MAIN ] RNR: Loaded 34997 primary data records. [2025-09-18T22:57:12.842542] [DEBUG] [LOCAL ] RNST: Loaded 37630 existing records from primary storage. [2025-09-18T22:57:12.843060] [INFO ] [MAIN ] RNST: Loaded 37630 primary data records. [2025-09-18T22:57:12.968865] [DEBUG] [MAIN ] RNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:12.973869] [INFO ] [MAIN ] RNP: Generated 1807 derivative records from 15981 primary records. [2025-09-18T22:57:12.974074] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-09-18T22:57:13.196058] [DEBUG] [LOCAL ] RNP: Derivative data saved (1807 records). [2025-09-18T22:57:13.198238] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-09-18T22:57:13.200507] [INFO ] [MAIN ] Derivative Progress: 1567/2075 symbols completed. RNP took 1.1s. Estimated remaining: 3m 17s. Rate: 154.6 symbols/min [2025-09-18T22:57:13.201024] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:13.215625] [DEBUG] [MAIN ] RNR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:13.218091] [INFO ] [MAIN ] RNR: Generated 1807 derivative records from 34997 primary records. [2025-09-18T22:57:13.218275] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-09-18T22:57:13.269465] [DEBUG] [LOCAL ] ROG: Loaded 23600 existing records from primary storage. [2025-09-18T22:57:13.268907] [DEBUG] [LOCAL ] RNR: Derivative data saved (1807 records). [2025-09-18T22:57:13.270051] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-09-18T22:57:13.270173] [INFO ] [MAIN ] ROG: Loaded 23600 primary data records. [2025-09-18T22:57:13.269850] [DEBUG] [MAIN ] RNST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:13.272895] [INFO ] [MAIN ] Derivative Progress: 1568/2075 symbols completed. RNR took 1.2s. Estimated remaining: 3m 17s. Rate: 154.7 symbols/min [2025-09-18T22:57:13.273986] [INFO ] [MAIN ] RNST: Generated 1807 derivative records from 37630 primary records. [2025-09-18T22:57:13.274338] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:13.274093] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-09-18T22:57:13.430850] [DEBUG] [LOCAL ] RNST: Derivative data saved (1807 records). [2025-09-18T22:57:13.447477] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-09-18T22:57:13.485544] [INFO ] [MAIN ] Derivative Progress: 1569/2075 symbols completed. RNST took 1.2s. Estimated remaining: 3m 16s. Rate: 154.7 symbols/min [2025-09-18T22:57:13.492102] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:13.653304] [DEBUG] [LOCAL ] ROK: Loaded 44486 existing records from primary storage. [2025-09-18T22:57:13.653803] [INFO ] [MAIN ] ROK: Loaded 44486 primary data records. [2025-09-18T22:57:13.791130] [DEBUG] [MAIN ] ROG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:13.831066] [INFO ] [MAIN ] ROG: Generated 1807 derivative records from 23600 primary records. [2025-09-18T22:57:13.854908] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-09-18T22:57:13.890522] [DEBUG] [LOCAL ] ROL: Loaded 50671 existing records from primary storage. [2025-09-18T22:57:14.013707] [INFO ] [MAIN ] ROL: Loaded 50671 primary data records. [2025-09-18T22:57:14.210814] [DEBUG] [LOCAL ] ROG: Derivative data saved (1807 records). [2025-09-18T22:57:14.238092] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-09-18T22:57:14.356211] [INFO ] [MAIN ] Derivative Progress: 1570/2075 symbols completed. ROG took 1.2s. Estimated remaining: 3m 16s. Rate: 154.6 symbols/min [2025-09-18T22:57:14.366222] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:14.390186] [DEBUG] [MAIN ] ROK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:14.391169] [INFO ] [MAIN ] ROK: Generated 1807 derivative records from 44486 primary records. [2025-09-18T22:57:14.391515] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-09-18T22:57:14.422827] [DEBUG] [LOCAL ] ROK: Derivative data saved (1807 records). [2025-09-18T22:57:14.423065] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-09-18T22:57:14.425593] [INFO ] [MAIN ] Derivative Progress: 1571/2075 symbols completed. ROK took 1.2s. Estimated remaining: 3m 16s. Rate: 154.7 symbols/min [2025-09-18T22:57:14.439826] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:14.456882] [DEBUG] [MAIN ] ROL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:14.458102] [DEBUG] [LOCAL ] RPM: Loaded 41355 existing records from primary storage. [2025-09-18T22:57:14.459530] [INFO ] [MAIN ] ROL: Generated 1807 derivative records from 50671 primary records. [2025-09-18T22:57:14.459883] [INFO ] [MAIN ] RPM: Loaded 41355 primary data records. [2025-09-18T22:57:14.459988] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-09-18T22:57:14.658167] [DEBUG] [LOCAL ] RQI: Loaded 29386 existing records from primary storage. [2025-09-18T22:57:14.667269] [INFO ] [MAIN ] RQI: Loaded 29386 primary data records. [2025-09-18T22:57:14.667349] [DEBUG] [LOCAL ] ROL: Derivative data saved (1807 records). [2025-09-18T22:57:14.706602] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-09-18T22:57:14.739796] [INFO ] [MAIN ] Derivative Progress: 1572/2075 symbols completed. ROL took 1.3s. Estimated remaining: 3m 15s. Rate: 154.7 symbols/min [2025-09-18T22:57:14.740147] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:15.205019] [DEBUG] [MAIN ] RPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:15.219056] [INFO ] [MAIN ] RPM: Generated 1807 derivative records from 41355 primary records. [2025-09-18T22:57:15.220171] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-09-18T22:57:15.229773] [DEBUG] [LOCAL ] RRC: Loaded 53166 existing records from primary storage. [2025-09-18T22:57:15.230073] [INFO ] [MAIN ] RRC: Loaded 53166 primary data records. [2025-09-18T22:57:15.334615] [DEBUG] [LOCAL ] RPM: Derivative data saved (1807 records). [2025-09-18T22:57:15.346717] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-09-18T22:57:15.349218] [INFO ] [MAIN ] Derivative Progress: 1573/2075 symbols completed. RPM took 1.0s. Estimated remaining: 3m 15s. Rate: 154.6 symbols/min [2025-09-18T22:57:15.382734] [DEBUG] [MAIN ] RQI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:15.401870] [INFO ] [MAIN ] RQI: Generated 1807 derivative records from 29386 primary records. [2025-09-18T22:57:15.410708] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-09-18T22:57:15.583914] [DEBUG] [LOCAL ] RQI: Derivative data saved (1807 records). [2025-09-18T22:57:15.584702] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-09-18T22:57:15.587301] [INFO ] [MAIN ] Derivative Progress: 1574/2075 symbols completed. RQI took 1.1s. Estimated remaining: 3m 14s. Rate: 154.7 symbols/min [2025-09-18T22:57:15.607064] [DEBUG] [MAIN ] RRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:15.607748] [INFO ] [MAIN ] RRC: Generated 1807 derivative records from 53166 primary records. [2025-09-18T22:57:15.607811] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-09-18T22:57:15.623387] [DEBUG] [LOCAL ] RRC: Derivative data saved (1807 records). [2025-09-18T22:57:15.623451] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-09-18T22:57:15.625728] [INFO ] [MAIN ] Derivative Progress: 1575/2075 symbols completed. RRC took 0.9s. Estimated remaining: 3m 14s. Rate: 154.8 symbols/min [2025-09-18T22:57:15.626420] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:15.626543] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:15.626729] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:15.633736] [DEBUG] [LOCAL ] RSF: Loaded 4178 existing records from primary storage. [2025-09-18T22:57:15.633865] [INFO ] [MAIN ] RSF: Loaded 4178 primary data records. [2025-09-18T22:57:15.965790] [DEBUG] [LOCAL ] RS: Loaded 26060 existing records from primary storage. [2025-09-18T22:57:15.966257] [INFO ] [MAIN ] RS: Loaded 26060 primary data records. [2025-09-18T22:57:16.032190] [DEBUG] [LOCAL ] RRX: Loaded 41467 existing records from primary storage. [2025-09-18T22:57:16.062983] [INFO ] [MAIN ] RRX: Loaded 41467 primary data records. [2025-09-18T22:57:16.687822] [DEBUG] [MAIN ] RSF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:16.689045] [INFO ] [MAIN ] RSF: Generated 1807 derivative records from 4178 primary records. [2025-09-18T22:57:16.689323] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-09-18T22:57:16.710100] [DEBUG] [LOCAL ] RSF: Derivative data saved (1807 records). [2025-09-18T22:57:16.710752] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-09-18T22:57:16.713143] [INFO ] [MAIN ] Derivative Progress: 1576/2075 symbols completed. RSF took 1.1s. Estimated remaining: 3m 14s. Rate: 154.6 symbols/min [2025-09-18T22:57:16.713577] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:16.734940] [DEBUG] [MAIN ] RS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:16.735721] [INFO ] [MAIN ] RS: Generated 1807 derivative records from 26060 primary records. [2025-09-18T22:57:16.735894] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-09-18T22:57:16.765725] [DEBUG] [MAIN ] RRX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:16.767541] [INFO ] [MAIN ] RRX: Generated 1807 derivative records from 41467 primary records. [2025-09-18T22:57:16.768574] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-09-18T22:57:16.782519] [DEBUG] [LOCAL ] RS: Derivative data saved (1807 records). [2025-09-18T22:57:16.783264] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-09-18T22:57:16.785611] [INFO ] [MAIN ] Derivative Progress: 1577/2075 symbols completed. RS took 1.2s. Estimated remaining: 3m 13s. Rate: 154.7 symbols/min [2025-09-18T22:57:16.786579] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:16.800671] [DEBUG] [LOCAL ] RRX: Derivative data saved (1807 records). [2025-09-18T22:57:16.800929] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-09-18T22:57:16.803809] [INFO ] [MAIN ] Derivative Progress: 1578/2075 symbols completed. RRX took 1.2s. Estimated remaining: 3m 13s. Rate: 154.8 symbols/min [2025-09-18T22:57:16.804278] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:16.824051] [DEBUG] [LOCAL ] RSG: Loaded 47819 existing records from primary storage. [2025-09-18T22:57:16.824241] [INFO ] [MAIN ] RSG: Loaded 47819 primary data records. [2025-09-18T22:57:17.023509] [DEBUG] [LOCAL ] RSKD: Loaded 34536 existing records from primary storage. [2025-09-18T22:57:17.052234] [INFO ] [MAIN ] RSKD: Loaded 34536 primary data records. [2025-09-18T22:57:17.116190] [DEBUG] [LOCAL ] RSI: Loaded 47640 existing records from primary storage. [2025-09-18T22:57:17.267967] [INFO ] [MAIN ] RSI: Loaded 47640 primary data records. [2025-09-18T22:57:17.848425] [DEBUG] [MAIN ] RSG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:17.849477] [INFO ] [MAIN ] RSG: Generated 1807 derivative records from 47819 primary records. [2025-09-18T22:57:17.849581] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-09-18T22:57:17.871536] [DEBUG] [LOCAL ] RSG: Derivative data saved (1807 records). [2025-09-18T22:57:17.871988] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-09-18T22:57:17.874218] [INFO ] [MAIN ] Derivative Progress: 1579/2075 symbols completed. RSG took 1.2s. Estimated remaining: 3m 13s. Rate: 154.6 symbols/min [2025-09-18T22:57:17.874466] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:17.887637] [DEBUG] [MAIN ] RSKD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:17.889454] [INFO ] [MAIN ] RSKD: Generated 1807 derivative records from 34536 primary records. [2025-09-18T22:57:17.889622] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-09-18T22:57:17.917069] [DEBUG] [MAIN ] RSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:17.918789] [INFO ] [MAIN ] RSI: Generated 1807 derivative records from 47640 primary records. [2025-09-18T22:57:17.918951] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-09-18T22:57:17.934064] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1807 records). [2025-09-18T22:57:17.934963] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-09-18T22:57:17.937499] [INFO ] [MAIN ] Derivative Progress: 1580/2075 symbols completed. RSKD took 1.1s. Estimated remaining: 3m 12s. Rate: 154.7 symbols/min [2025-09-18T22:57:17.938899] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:17.953050] [DEBUG] [LOCAL ] RSI: Derivative data saved (1807 records). [2025-09-18T22:57:17.953188] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-09-18T22:57:17.955743] [INFO ] [MAIN ] Derivative Progress: 1581/2075 symbols completed. RSI took 1.2s. Estimated remaining: 3m 12s. Rate: 154.8 symbols/min [2025-09-18T22:57:17.956099] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:17.974921] [DEBUG] [LOCAL ] RTO: Loaded 40963 existing records from primary storage. [2025-09-18T22:57:17.975206] [INFO ] [MAIN ] RTO: Loaded 40963 primary data records. [2025-09-18T22:57:18.355465] [DEBUG] [LOCAL ] RVLV: Loaded 48377 existing records from primary storage. [2025-09-18T22:57:18.355754] [INFO ] [MAIN ] RVLV: Loaded 48377 primary data records. [2025-09-18T22:57:18.429559] [DEBUG] [LOCAL ] RTX: Loaded 54101 existing records from primary storage. [2025-09-18T22:57:18.444406] [INFO ] [MAIN ] RTX: Loaded 54101 primary data records. [2025-09-18T22:57:19.041925] [DEBUG] [MAIN ] RTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:19.043615] [INFO ] [MAIN ] RTO: Generated 1807 derivative records from 40963 primary records. [2025-09-18T22:57:19.044527] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-09-18T22:57:19.064975] [DEBUG] [LOCAL ] RTO: Derivative data saved (1807 records). [2025-09-18T22:57:19.065856] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-09-18T22:57:19.069015] [INFO ] [MAIN ] Derivative Progress: 1582/2075 symbols completed. RTO took 1.2s. Estimated remaining: 3m 11s. Rate: 154.6 symbols/min [2025-09-18T22:57:19.070454] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:19.085038] [DEBUG] [MAIN ] RVLV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:19.086383] [INFO ] [MAIN ] RVLV: Generated 1807 derivative records from 48377 primary records. [2025-09-18T22:57:19.086678] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-09-18T22:57:19.111165] [DEBUG] [MAIN ] RTX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:19.113596] [INFO ] [MAIN ] RTX: Generated 1807 derivative records from 54101 primary records. [2025-09-18T22:57:19.113737] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-09-18T22:57:19.130916] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1807 records). [2025-09-18T22:57:19.134717] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-09-18T22:57:19.137411] [INFO ] [MAIN ] Derivative Progress: 1583/2075 symbols completed. RVLV took 1.2s. Estimated remaining: 3m 11s. Rate: 154.7 symbols/min [2025-09-18T22:57:19.138830] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:19.151009] [DEBUG] [LOCAL ] RTX: Derivative data saved (1807 records). [2025-09-18T22:57:19.151174] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-09-18T22:57:19.153951] [INFO ] [MAIN ] Derivative Progress: 1584/2075 symbols completed. RTX took 1.2s. Estimated remaining: 3m 10s. Rate: 154.7 symbols/min [2025-09-18T22:57:19.163325] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:19.164457] [DEBUG] [LOCAL ] RVT: Loaded 27715 existing records from primary storage. [2025-09-18T22:57:19.164558] [INFO ] [MAIN ] RVT: Loaded 27715 primary data records. [2025-09-18T22:57:19.518329] [DEBUG] [LOCAL ] RWT: Loaded 40816 existing records from primary storage. [2025-09-18T22:57:19.519782] [DEBUG] [LOCAL ] RVTY: Loaded 47953 existing records from primary storage. [2025-09-18T22:57:19.521729] [INFO ] [MAIN ] RVTY: Loaded 47953 primary data records. [2025-09-18T22:57:19.521800] [INFO ] [MAIN ] RWT: Loaded 40816 primary data records. [2025-09-18T22:57:20.168044] [DEBUG] [MAIN ] RVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:20.168919] [INFO ] [MAIN ] RVT: Generated 1807 derivative records from 27715 primary records. [2025-09-18T22:57:20.169965] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-09-18T22:57:20.194954] [DEBUG] [LOCAL ] RVT: Derivative data saved (1807 records). [2025-09-18T22:57:20.195191] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-09-18T22:57:20.197627] [INFO ] [MAIN ] Derivative Progress: 1585/2075 symbols completed. RVT took 1.1s. Estimated remaining: 3m 10s. Rate: 154.6 symbols/min [2025-09-18T22:57:20.198163] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:20.221445] [DEBUG] [MAIN ] RVTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:20.233877] [INFO ] [MAIN ] RVTY: Generated 1807 derivative records from 47953 primary records. [2025-09-18T22:57:20.241599] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-09-18T22:57:20.241527] [DEBUG] [MAIN ] RWT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:20.242477] [INFO ] [MAIN ] RWT: Generated 1807 derivative records from 40816 primary records. [2025-09-18T22:57:20.243109] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-09-18T22:57:20.271071] [DEBUG] [LOCAL ] RVTY: Derivative data saved (1807 records). [2025-09-18T22:57:20.271229] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-09-18T22:57:20.273571] [INFO ] [MAIN ] Derivative Progress: 1586/2075 symbols completed. RVTY took 1.1s. Estimated remaining: 3m 10s. Rate: 154.7 symbols/min [2025-09-18T22:57:20.285404] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:20.304137] [DEBUG] [LOCAL ] RWT: Derivative data saved (1807 records). [2025-09-18T22:57:20.304298] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-09-18T22:57:20.307768] [INFO ] [MAIN ] Derivative Progress: 1587/2075 symbols completed. RWT took 1.1s. Estimated remaining: 3m 9s. Rate: 154.7 symbols/min [2025-09-18T22:57:20.305166] [DEBUG] [LOCAL ] RXO: Loaded 48105 existing records from primary storage. [2025-09-18T22:57:20.308071] [INFO ] [MAIN ] RXO: Loaded 48105 primary data records. [2025-09-18T22:57:20.308367] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:20.689125] [DEBUG] [LOCAL ] RYAM: Loaded 35504 existing records from primary storage. [2025-09-18T22:57:20.705027] [INFO ] [MAIN ] RYAM: Loaded 35504 primary data records. [2025-09-18T22:57:20.706053] [DEBUG] [LOCAL ] RY: Loaded 48378 existing records from primary storage. [2025-09-18T22:57:20.717702] [INFO ] [MAIN ] RY: Loaded 48378 primary data records. [2025-09-18T22:57:21.334396] [DEBUG] [MAIN ] RXO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:21.335478] [INFO ] [MAIN ] RXO: Generated 1807 derivative records from 48105 primary records. [2025-09-18T22:57:21.335819] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-09-18T22:57:21.354394] [DEBUG] [LOCAL ] RXO: Derivative data saved (1807 records). [2025-09-18T22:57:21.354700] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-09-18T22:57:21.357075] [INFO ] [MAIN ] Derivative Progress: 1588/2075 symbols completed. RXO took 1.2s. Estimated remaining: 3m 9s. Rate: 154.6 symbols/min [2025-09-18T22:57:21.373413] [DEBUG] [MAIN ] RYAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:21.374909] [INFO ] [MAIN ] RYAM: Generated 1807 derivative records from 35504 primary records. [2025-09-18T22:57:21.375637] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-09-18T22:57:21.400747] [DEBUG] [MAIN ] RY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:21.401601] [INFO ] [MAIN ] RY: Generated 1807 derivative records from 48378 primary records. [2025-09-18T22:57:21.401909] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-09-18T22:57:21.420569] [DEBUG] [LOCAL ] RY: Derivative data saved (1807 records). [2025-09-18T22:57:21.420967] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1807 records). [2025-09-18T22:57:21.421051] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-09-18T22:57:21.421124] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-09-18T22:57:21.423212] [INFO ] [MAIN ] Derivative Progress: 1589/2075 symbols completed. RYAM took 1.1s. Estimated remaining: 3m 9s. Rate: 154.7 symbols/min [2025-09-18T22:57:21.425846] [INFO ] [MAIN ] Derivative Progress: 1590/2075 symbols completed. RY took 1.1s. Estimated remaining: 3m 8s. Rate: 154.8 symbols/min [2025-09-18T22:57:21.426571] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:21.426442] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:21.427073] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:21.450401] [DEBUG] [LOCAL ] RYI: Loaded 21745 existing records from primary storage. [2025-09-18T22:57:21.450619] [INFO ] [MAIN ] RYI: Loaded 21745 primary data records. [2025-09-18T22:57:21.651875] [DEBUG] [LOCAL ] RYAN: Loaded 44329 existing records from primary storage. [2025-09-18T22:57:21.699092] [INFO ] [MAIN ] RYAN: Loaded 44329 primary data records. [2025-09-18T22:57:21.811970] [DEBUG] [LOCAL ] RYN: Loaded 46202 existing records from primary storage. [2025-09-18T22:57:21.866942] [INFO ] [MAIN ] RYN: Loaded 46202 primary data records. [2025-09-18T22:57:22.485133] [DEBUG] [MAIN ] RYI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:22.486336] [INFO ] [MAIN ] RYI: Generated 1807 derivative records from 21745 primary records. [2025-09-18T22:57:22.486491] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-09-18T22:57:22.508459] [DEBUG] [LOCAL ] RYI: Derivative data saved (1807 records). [2025-09-18T22:57:22.509391] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-09-18T22:57:22.511949] [INFO ] [MAIN ] Derivative Progress: 1591/2075 symbols completed. RYI took 1.1s. Estimated remaining: 3m 8s. Rate: 154.6 symbols/min [2025-09-18T22:57:22.513354] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:22.536417] [DEBUG] [MAIN ] RYAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:22.542338] [DEBUG] [MAIN ] RYN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:22.544725] [INFO ] [MAIN ] RYN: Generated 1807 derivative records from 46202 primary records. [2025-09-18T22:57:22.542059] [INFO ] [MAIN ] RYAN: Generated 1807 derivative records from 44329 primary records. [2025-09-18T22:57:22.544983] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-09-18T22:57:22.548811] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-09-18T22:57:22.549233] [DEBUG] [LOCAL ] RZB: Loaded 6390 existing records from primary storage. [2025-09-18T22:57:22.560013] [INFO ] [MAIN ] RZB: Loaded 6390 primary data records. [2025-09-18T22:57:22.576097] [DEBUG] [LOCAL ] RYN: Derivative data saved (1807 records). [2025-09-18T22:57:22.616274] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-09-18T22:57:22.631081] [INFO ] [MAIN ] Derivative Progress: 1592/2075 symbols completed. RYN took 1.2s. Estimated remaining: 3m 7s. Rate: 154.7 symbols/min [2025-09-18T22:57:22.649298] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:22.660482] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1807 records). [2025-09-18T22:57:22.665777] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-09-18T22:57:22.679358] [INFO ] [MAIN ] Derivative Progress: 1593/2075 symbols completed. RYAN took 1.3s. Estimated remaining: 3m 7s. Rate: 154.7 symbols/min [2025-09-18T22:57:22.698168] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:22.744713] [DEBUG] [LOCAL ] RZC: Loaded 6915 existing records from primary storage. [2025-09-18T22:57:22.750700] [INFO ] [MAIN ] RZC: Loaded 6915 primary data records. [2025-09-18T22:57:23.279286] [DEBUG] [LOCAL ] S: Loaded 53934 existing records from primary storage. [2025-09-18T22:57:23.280835] [INFO ] [MAIN ] S: Loaded 53934 primary data records. [2025-09-18T22:57:23.437923] [DEBUG] [MAIN ] RZB: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:57:23.509373] [INFO ] [MAIN ] RZB: Generated 1806 derivative records from 6390 primary records. [2025-09-18T22:57:23.628706] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-09-18T22:57:23.662326] [DEBUG] [MAIN ] RZC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:23.664914] [INFO ] [MAIN ] RZC: Generated 1807 derivative records from 6915 primary records. [2025-09-18T22:57:23.665286] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-09-18T22:57:23.666177] [DEBUG] [LOCAL ] RZB: Derivative data saved (1806 records). [2025-09-18T22:57:23.667982] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-09-18T22:57:23.670509] [INFO ] [MAIN ] Derivative Progress: 1594/2075 symbols completed. RZB took 1.2s. Estimated remaining: 3m 7s. Rate: 154.6 symbols/min [2025-09-18T22:57:23.682071] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:23.689608] [DEBUG] [LOCAL ] RZC: Derivative data saved (1807 records). [2025-09-18T22:57:23.689827] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-09-18T22:57:23.693166] [INFO ] [MAIN ] Derivative Progress: 1595/2075 symbols completed. RZC took 1.0s. Estimated remaining: 3m 6s. Rate: 154.7 symbols/min [2025-09-18T22:57:23.694419] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:23.708793] [DEBUG] [MAIN ] S: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:23.709475] [INFO ] [MAIN ] S: Generated 1807 derivative records from 53934 primary records. [2025-09-18T22:57:23.709691] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-09-18T22:57:23.730099] [DEBUG] [LOCAL ] S: Derivative data saved (1807 records). [2025-09-18T22:57:23.730336] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-09-18T22:57:23.732550] [INFO ] [MAIN ] Derivative Progress: 1596/2075 symbols completed. S took 1.0s. Estimated remaining: 3m 6s. Rate: 154.8 symbols/min [2025-09-18T22:57:23.741759] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:23.746421] [DEBUG] [LOCAL ] SABA: Loaded 9484 existing records from primary storage. [2025-09-18T22:57:23.746535] [INFO ] [MAIN ] SABA: Loaded 9484 primary data records. [2025-09-18T22:57:23.873111] [DEBUG] [LOCAL ] SA: Loaded 43277 existing records from primary storage. [2025-09-18T22:57:23.889376] [INFO ] [MAIN ] SA: Loaded 43277 primary data records. [2025-09-18T22:57:24.206622] [DEBUG] [LOCAL ] SAFE: Loaded 30726 existing records from primary storage. [2025-09-18T22:57:24.211508] [INFO ] [MAIN ] SAFE: Loaded 30726 primary data records. [2025-09-18T22:57:24.813748] [DEBUG] [MAIN ] SABA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:24.817284] [INFO ] [MAIN ] SABA: Generated 1807 derivative records from 9484 primary records. [2025-09-18T22:57:24.819242] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-09-18T22:57:24.843083] [DEBUG] [MAIN ] SA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:24.847238] [INFO ] [MAIN ] SA: Generated 1807 derivative records from 43277 primary records. [2025-09-18T22:57:24.847512] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-09-18T22:57:24.867826] [DEBUG] [LOCAL ] SA: Derivative data saved (1807 records). [2025-09-18T22:57:24.869031] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-09-18T22:57:24.871787] [INFO ] [MAIN ] Derivative Progress: 1597/2075 symbols completed. SA took 1.2s. Estimated remaining: 3m 6s. Rate: 154.6 symbols/min [2025-09-18T22:57:24.873029] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:24.873870] [DEBUG] [LOCAL ] SABA: Derivative data saved (1807 records). [2025-09-18T22:57:24.874045] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-09-18T22:57:24.876922] [INFO ] [MAIN ] Derivative Progress: 1598/2075 symbols completed. SABA took 1.2s. Estimated remaining: 3m 5s. Rate: 154.7 symbols/min [2025-09-18T22:57:24.878560] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:24.894494] [DEBUG] [MAIN ] SAFE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:24.895407] [INFO ] [MAIN ] SAFE: Generated 1807 derivative records from 30726 primary records. [2025-09-18T22:57:24.895557] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-09-18T22:57:24.919343] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1807 records). [2025-09-18T22:57:24.919505] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-09-18T22:57:24.922310] [INFO ] [MAIN ] Derivative Progress: 1599/2075 symbols completed. SAFE took 1.2s. Estimated remaining: 3m 5s. Rate: 154.8 symbols/min [2025-09-18T22:57:24.927305] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:24.936389] [DEBUG] [LOCAL ] SAH: Loaded 22501 existing records from primary storage. [2025-09-18T22:57:24.936600] [INFO ] [MAIN ] SAH: Loaded 22501 primary data records. [2025-09-18T22:57:24.993985] [DEBUG] [LOCAL ] SAM: Loaded 21867 existing records from primary storage. [2025-09-18T22:57:24.999775] [INFO ] [MAIN ] SAM: Loaded 21867 primary data records. [2025-09-18T22:57:25.623925] [DEBUG] [LOCAL ] SAN: Loaded 53427 existing records from primary storage. [2025-09-18T22:57:25.637940] [INFO ] [MAIN ] SAN: Loaded 53427 primary data records. [2025-09-18T22:57:25.983838] [DEBUG] [MAIN ] SAH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:25.992468] [INFO ] [MAIN ] SAH: Generated 1807 derivative records from 22501 primary records. [2025-09-18T22:57:25.997797] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-09-18T22:57:25.997718] [DEBUG] [MAIN ] SAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:25.999069] [INFO ] [MAIN ] SAM: Generated 1807 derivative records from 21867 primary records. [2025-09-18T22:57:26.000989] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-09-18T22:57:26.025517] [DEBUG] [LOCAL ] SAH: Derivative data saved (1807 records). [2025-09-18T22:57:26.028328] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-09-18T22:57:26.031206] [INFO ] [MAIN ] Derivative Progress: 1600/2075 symbols completed. SAH took 1.2s. Estimated remaining: 3m 4s. Rate: 154.6 symbols/min [2025-09-18T22:57:26.032352] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:26.041318] [DEBUG] [LOCAL ] SAM: Derivative data saved (1807 records). [2025-09-18T22:57:26.041530] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-09-18T22:57:26.044037] [INFO ] [MAIN ] Derivative Progress: 1601/2075 symbols completed. SAM took 1.2s. Estimated remaining: 3m 4s. Rate: 154.7 symbols/min [2025-09-18T22:57:26.057404] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:26.057338] [DEBUG] [MAIN ] SAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:26.058790] [INFO ] [MAIN ] SAN: Generated 1807 derivative records from 53427 primary records. [2025-09-18T22:57:26.058977] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-09-18T22:57:26.078710] [DEBUG] [LOCAL ] SAN: Derivative data saved (1807 records). [2025-09-18T22:57:26.078999] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-09-18T22:57:26.081615] [INFO ] [MAIN ] Derivative Progress: 1602/2075 symbols completed. SAN took 1.2s. Estimated remaining: 3m 3s. Rate: 154.8 symbols/min [2025-09-18T22:57:26.082789] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:26.148346] [DEBUG] [LOCAL ] SAP: Loaded 50481 existing records from primary storage. [2025-09-18T22:57:26.149715] [INFO ] [MAIN ] SAP: Loaded 50481 primary data records. [2025-09-18T22:57:26.151068] [DEBUG] [LOCAL ] SAND: Loaded 52120 existing records from primary storage. [2025-09-18T22:57:26.156390] [INFO ] [MAIN ] SAND: Loaded 52120 primary data records. [2025-09-18T22:57:26.652216] [DEBUG] [LOCAL ] SARO: Loaded 49159 existing records from primary storage. [2025-09-18T22:57:26.817137] [INFO ] [MAIN ] SARO: Loaded 49159 primary data records. [2025-09-18T22:57:27.162348] [DEBUG] [MAIN ] SAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:27.164544] [INFO ] [MAIN ] SAP: Generated 1807 derivative records from 50481 primary records. [2025-09-18T22:57:27.164723] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-09-18T22:57:27.191090] [DEBUG] [MAIN ] SAND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:27.193300] [INFO ] [MAIN ] SAND: Generated 1807 derivative records from 52120 primary records. [2025-09-18T22:57:27.193814] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-09-18T22:57:27.211769] [DEBUG] [LOCAL ] SAP: Derivative data saved (1807 records). [2025-09-18T22:57:27.212336] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-09-18T22:57:27.214587] [INFO ] [MAIN ] Derivative Progress: 1603/2075 symbols completed. SAP took 1.2s. Estimated remaining: 3m 3s. Rate: 154.6 symbols/min [2025-09-18T22:57:27.221689] [DEBUG] [LOCAL ] SAND: Derivative data saved (1807 records). [2025-09-18T22:57:27.221900] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-09-18T22:57:27.225803] [INFO ] [MAIN ] Derivative Progress: 1604/2075 symbols completed. SAND took 1.2s. Estimated remaining: 3m 3s. Rate: 154.7 symbols/min [2025-09-18T22:57:27.238406] [DEBUG] [MAIN ] SARO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:27.239023] [INFO ] [MAIN ] SARO: Generated 1807 derivative records from 49159 primary records. [2025-09-18T22:57:27.239083] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-09-18T22:57:27.254875] [DEBUG] [LOCAL ] SARO: Derivative data saved (1807 records). [2025-09-18T22:57:27.254945] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-09-18T22:57:27.257541] [INFO ] [MAIN ] Derivative Progress: 1605/2075 symbols completed. SARO took 1.2s. Estimated remaining: 3m 2s. Rate: 154.8 symbols/min [2025-09-18T22:57:27.258064] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:27.258214] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:27.258768] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:27.268533] [DEBUG] [LOCAL ] SBI: Loaded 7844 existing records from primary storage. [2025-09-18T22:57:27.268794] [INFO ] [MAIN ] SBI: Loaded 7844 primary data records. [2025-09-18T22:57:27.488900] [DEBUG] [LOCAL ] SB: Loaded 33925 existing records from primary storage. [2025-09-18T22:57:27.489308] [INFO ] [MAIN ] SB: Loaded 33925 primary data records. [2025-09-18T22:57:27.729274] [DEBUG] [LOCAL ] SBH: Loaded 50188 existing records from primary storage. [2025-09-18T22:57:27.752866] [INFO ] [MAIN ] SBH: Loaded 50188 primary data records. [2025-09-18T22:57:28.307977] [DEBUG] [MAIN ] SBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:28.309883] [INFO ] [MAIN ] SBI: Generated 1807 derivative records from 7844 primary records. [2025-09-18T22:57:28.310591] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-09-18T22:57:28.331904] [DEBUG] [LOCAL ] SBI: Derivative data saved (1807 records). [2025-09-18T22:57:28.332177] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-09-18T22:57:28.334618] [INFO ] [MAIN ] Derivative Progress: 1606/2075 symbols completed. SBI took 1.1s. Estimated remaining: 3m 2s. Rate: 154.6 symbols/min [2025-09-18T22:57:28.336125] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:28.351256] [DEBUG] [MAIN ] SB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:28.352214] [INFO ] [MAIN ] SB: Generated 1807 derivative records from 33925 primary records. [2025-09-18T22:57:28.354430] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-09-18T22:57:28.372461] [DEBUG] [LOCAL ] SBR: Loaded 7318 existing records from primary storage. [2025-09-18T22:57:28.376562] [INFO ] [MAIN ] SBR: Loaded 7318 primary data records. [2025-09-18T22:57:28.410198] [DEBUG] [LOCAL ] SB: Derivative data saved (1807 records). [2025-09-18T22:57:28.420775] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-09-18T22:57:28.428288] [INFO ] [MAIN ] Derivative Progress: 1607/2075 symbols completed. SB took 1.2s. Estimated remaining: 3m 2s. Rate: 154.7 symbols/min [2025-09-18T22:57:28.448610] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:28.436084] [DEBUG] [MAIN ] SBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:28.449352] [INFO ] [MAIN ] SBH: Generated 1807 derivative records from 50188 primary records. [2025-09-18T22:57:28.463372] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-09-18T22:57:28.536508] [DEBUG] [LOCAL ] SBH: Derivative data saved (1807 records). [2025-09-18T22:57:28.563616] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-09-18T22:57:28.590713] [INFO ] [MAIN ] Derivative Progress: 1608/2075 symbols completed. SBH took 1.3s. Estimated remaining: 3m 1s. Rate: 154.7 symbols/min [2025-09-18T22:57:28.705123] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:28.743563] [DEBUG] [LOCAL ] SBSI: Loaded 14759 existing records from primary storage. [2025-09-18T22:57:28.743760] [INFO ] [MAIN ] SBSI: Loaded 14759 primary data records. [2025-09-18T22:57:28.862447] [DEBUG] [LOCAL ] SBS: Loaded 49756 existing records from primary storage. [2025-09-18T22:57:28.884346] [INFO ] [MAIN ] SBS: Loaded 49756 primary data records. [2025-09-18T22:57:29.037636] [DEBUG] [MAIN ] SBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:29.210273] [INFO ] [MAIN ] SBR: Generated 1807 derivative records from 7318 primary records. [2025-09-18T22:57:29.247728] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-09-18T22:57:29.459570] [DEBUG] [LOCAL ] SBR: Derivative data saved (1807 records). [2025-09-18T22:57:29.461629] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-09-18T22:57:29.464023] [INFO ] [MAIN ] Derivative Progress: 1609/2075 symbols completed. SBR took 1.1s. Estimated remaining: 3m 1s. Rate: 154.6 symbols/min [2025-09-18T22:57:29.464534] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:29.495434] [DEBUG] [MAIN ] SBSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:29.496934] [INFO ] [MAIN ] SBSI: Generated 1807 derivative records from 14759 primary records. [2025-09-18T22:57:29.497261] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-09-18T22:57:29.516477] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1807 records). [2025-09-18T22:57:29.516943] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-09-18T22:57:29.519237] [INFO ] [MAIN ] Derivative Progress: 1610/2075 symbols completed. SBSI took 0.8s. Estimated remaining: 3m 0s. Rate: 154.7 symbols/min [2025-09-18T22:57:29.519759] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:29.536172] [DEBUG] [MAIN ] SBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:29.550847] [INFO ] [MAIN ] SBS: Generated 1807 derivative records from 49756 primary records. [2025-09-18T22:57:29.551158] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-09-18T22:57:29.583125] [DEBUG] [LOCAL ] SBS: Derivative data saved (1807 records). [2025-09-18T22:57:29.583285] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-09-18T22:57:29.586872] [INFO ] [MAIN ] Derivative Progress: 1611/2075 symbols completed. SBS took 1.2s. Estimated remaining: 2m 60s. Rate: 154.8 symbols/min [2025-09-18T22:57:29.587271] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:29.584066] [DEBUG] [LOCAL ] SBSW: Loaded 53305 existing records from primary storage. [2025-09-18T22:57:29.587457] [INFO ] [MAIN ] SBSW: Loaded 53305 primary data records. [2025-09-18T22:57:29.720706] [DEBUG] [LOCAL ] SCD: Loaded 12673 existing records from primary storage. [2025-09-18T22:57:29.744931] [INFO ] [MAIN ] SCD: Loaded 12673 primary data records. [2025-09-18T22:57:29.751200] [DEBUG] [LOCAL ] SCCO: Loaded 49767 existing records from primary storage. [2025-09-18T22:57:29.822534] [INFO ] [MAIN ] SCCO: Loaded 49767 primary data records. [2025-09-18T22:57:30.625892] [DEBUG] [MAIN ] SBSW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:30.627329] [INFO ] [MAIN ] SBSW: Generated 1807 derivative records from 53305 primary records. [2025-09-18T22:57:30.627535] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-09-18T22:57:30.646605] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1807 records). [2025-09-18T22:57:30.648881] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-09-18T22:57:30.650879] [INFO ] [MAIN ] Derivative Progress: 1612/2075 symbols completed. SBSW took 1.2s. Estimated remaining: 2m 60s. Rate: 154.6 symbols/min [2025-09-18T22:57:30.660053] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:30.667688] [DEBUG] [MAIN ] SCCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:30.668678] [INFO ] [MAIN ] SCCO: Generated 1807 derivative records from 49767 primary records. [2025-09-18T22:57:30.668929] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-09-18T22:57:30.698208] [DEBUG] [MAIN ] SCD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:30.700727] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1807 records). [2025-09-18T22:57:30.700863] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-09-18T22:57:30.701804] [INFO ] [MAIN ] SCD: Generated 1807 derivative records from 12673 primary records. [2025-09-18T22:57:30.704618] [INFO ] [MAIN ] Derivative Progress: 1613/2075 symbols completed. SCCO took 1.2s. Estimated remaining: 2m 59s. Rate: 154.7 symbols/min [2025-09-18T22:57:30.704880] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-09-18T22:57:30.706359] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:30.724355] [DEBUG] [LOCAL ] SCD: Derivative data saved (1807 records). [2025-09-18T22:57:30.724512] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-09-18T22:57:30.727161] [INFO ] [MAIN ] Derivative Progress: 1614/2075 symbols completed. SCD took 1.1s. Estimated remaining: 2m 59s. Rate: 154.8 symbols/min [2025-09-18T22:57:30.727556] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:30.761189] [DEBUG] [LOCAL ] SCL: Loaded 14926 existing records from primary storage. [2025-09-18T22:57:30.761424] [INFO ] [MAIN ] SCL: Loaded 14926 primary data records. [2025-09-18T22:57:30.909047] [DEBUG] [LOCAL ] SCHW: Loaded 54075 existing records from primary storage. [2025-09-18T22:57:30.913456] [INFO ] [MAIN ] SCHW: Loaded 54075 primary data records. [2025-09-18T22:57:30.941598] [DEBUG] [LOCAL ] SCI: Loaded 47062 existing records from primary storage. [2025-09-18T22:57:31.061305] [INFO ] [MAIN ] SCI: Loaded 47062 primary data records. [2025-09-18T22:57:31.825243] [DEBUG] [MAIN ] SCL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:31.827101] [INFO ] [MAIN ] SCL: Generated 1807 derivative records from 14926 primary records. [2025-09-18T22:57:31.827311] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-09-18T22:57:31.848760] [DEBUG] [LOCAL ] SCL: Derivative data saved (1807 records). [2025-09-18T22:57:31.849218] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-09-18T22:57:31.859194] [INFO ] [MAIN ] Derivative Progress: 1615/2075 symbols completed. SCL took 1.1s. Estimated remaining: 2m 59s. Rate: 154.6 symbols/min [2025-09-18T22:57:31.864729] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:31.865445] [DEBUG] [MAIN ] SCHW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:31.866557] [INFO ] [MAIN ] SCHW: Generated 1807 derivative records from 54075 primary records. [2025-09-18T22:57:31.866882] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-09-18T22:57:31.907151] [DEBUG] [MAIN ] SCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:31.908691] [INFO ] [MAIN ] SCI: Generated 1807 derivative records from 47062 primary records. [2025-09-18T22:57:31.907898] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1807 records). [2025-09-18T22:57:31.908882] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-09-18T22:57:31.909038] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-09-18T22:57:31.912428] [INFO ] [MAIN ] Derivative Progress: 1616/2075 symbols completed. SCHW took 1.3s. Estimated remaining: 2m 58s. Rate: 154.7 symbols/min [2025-09-18T22:57:31.912764] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:31.936815] [DEBUG] [LOCAL ] SCI: Derivative data saved (1807 records). [2025-09-18T22:57:31.936950] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-09-18T22:57:31.933086] [DEBUG] [LOCAL ] SCM: Loaded 20323 existing records from primary storage. [2025-09-18T22:57:31.939676] [INFO ] [MAIN ] Derivative Progress: 1617/2075 symbols completed. SCI took 1.2s. Estimated remaining: 2m 58s. Rate: 154.7 symbols/min [2025-09-18T22:57:31.940098] [INFO ] [MAIN ] SCM: Loaded 20323 primary data records. [2025-09-18T22:57:31.940012] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:32.274167] [DEBUG] [LOCAL ] SD: Loaded 29439 existing records from primary storage. [2025-09-18T22:57:32.279627] [INFO ] [MAIN ] SD: Loaded 29439 primary data records. [2025-09-18T22:57:32.281242] [DEBUG] [LOCAL ] SCS: Loaded 43154 existing records from primary storage. [2025-09-18T22:57:32.303912] [INFO ] [MAIN ] SCS: Loaded 43154 primary data records. [2025-09-18T22:57:33.024691] [DEBUG] [MAIN ] SCM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:33.025753] [INFO ] [MAIN ] SCM: Generated 1807 derivative records from 20323 primary records. [2025-09-18T22:57:33.025989] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-09-18T22:57:33.044398] [DEBUG] [LOCAL ] SCM: Derivative data saved (1807 records). [2025-09-18T22:57:33.044758] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-09-18T22:57:33.047890] [INFO ] [MAIN ] Derivative Progress: 1618/2075 symbols completed. SCM took 1.2s. Estimated remaining: 2m 57s. Rate: 154.6 symbols/min [2025-09-18T22:57:33.067380] [DEBUG] [MAIN ] SD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:33.069174] [INFO ] [MAIN ] SD: Generated 1807 derivative records from 29439 primary records. [2025-09-18T22:57:33.070131] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-09-18T22:57:33.095688] [DEBUG] [MAIN ] SCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:33.098299] [INFO ] [MAIN ] SCS: Generated 1807 derivative records from 43154 primary records. [2025-09-18T22:57:33.098602] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-09-18T22:57:33.114572] [DEBUG] [LOCAL ] SD: Derivative data saved (1807 records). [2025-09-18T22:57:33.116734] [DEBUG] [LOCAL ] SCS: Derivative data saved (1807 records). [2025-09-18T22:57:33.116836] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-09-18T22:57:33.116917] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-09-18T22:57:33.119775] [INFO ] [MAIN ] Derivative Progress: 1619/2075 symbols completed. SCS took 1.2s. Estimated remaining: 2m 57s. Rate: 154.6 symbols/min [2025-09-18T22:57:33.122212] [INFO ] [MAIN ] Derivative Progress: 1620/2075 symbols completed. SD took 1.2s. Estimated remaining: 2m 56s. Rate: 154.7 symbols/min [2025-09-18T22:57:33.123259] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:33.123044] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:33.123358] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:33.139587] [DEBUG] [LOCAL ] SDHC: Loaded 10681 existing records from primary storage. [2025-09-18T22:57:33.139794] [INFO ] [MAIN ] SDHC: Loaded 10681 primary data records. [2025-09-18T22:57:33.187521] [DEBUG] [LOCAL ] SDHY: Loaded 10805 existing records from primary storage. [2025-09-18T22:57:33.214772] [INFO ] [MAIN ] SDHY: Loaded 10805 primary data records. [2025-09-18T22:57:33.453269] [DEBUG] [LOCAL ] SDRL: Loaded 42440 existing records from primary storage. [2025-09-18T22:57:33.470711] [INFO ] [MAIN ] SDRL: Loaded 42440 primary data records. [2025-09-18T22:57:34.127626] [DEBUG] [MAIN ] SDHC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:57:34.129680] [INFO ] [MAIN ] SDHC: Generated 1806 derivative records from 10681 primary records. [2025-09-18T22:57:34.130908] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-09-18T22:57:34.161512] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1806 records). [2025-09-18T22:57:34.161376] [DEBUG] [MAIN ] SDHY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:34.161660] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-09-18T22:57:34.162475] [INFO ] [MAIN ] SDHY: Generated 1807 derivative records from 10805 primary records. [2025-09-18T22:57:34.164728] [INFO ] [MAIN ] Derivative Progress: 1621/2075 symbols completed. SDHC took 1.0s. Estimated remaining: 2m 56s. Rate: 154.6 symbols/min [2025-09-18T22:57:34.164968] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-09-18T22:57:34.166217] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:34.183095] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1807 records). [2025-09-18T22:57:34.183277] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-09-18T22:57:34.185894] [INFO ] [MAIN ] Derivative Progress: 1622/2075 symbols completed. SDHY took 1.1s. Estimated remaining: 2m 56s. Rate: 154.7 symbols/min [2025-09-18T22:57:34.187957] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:34.201699] [DEBUG] [MAIN ] SDRL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:34.202502] [INFO ] [MAIN ] SDRL: Generated 1807 derivative records from 42440 primary records. [2025-09-18T22:57:34.202636] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-09-18T22:57:34.219468] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1807 records). [2025-09-18T22:57:34.219696] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-09-18T22:57:34.222502] [INFO ] [MAIN ] Derivative Progress: 1623/2075 symbols completed. SDRL took 1.1s. Estimated remaining: 2m 55s. Rate: 154.8 symbols/min [2025-09-18T22:57:34.222798] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:34.252359] [DEBUG] [LOCAL ] SEG: Loaded 14020 existing records from primary storage. [2025-09-18T22:57:34.252590] [INFO ] [MAIN ] SEG: Loaded 14020 primary data records. [2025-09-18T22:57:34.394416] [DEBUG] [LOCAL ] SE: Loaded 53786 existing records from primary storage. [2025-09-18T22:57:34.435079] [INFO ] [MAIN ] SE: Loaded 53786 primary data records. [2025-09-18T22:57:34.429800] [DEBUG] [LOCAL ] SEE: Loaded 48830 existing records from primary storage. [2025-09-18T22:57:34.502534] [INFO ] [MAIN ] SEE: Loaded 48830 primary data records. [2025-09-18T22:57:35.285725] [DEBUG] [MAIN ] SEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:35.286705] [INFO ] [MAIN ] SEG: Generated 1807 derivative records from 14020 primary records. [2025-09-18T22:57:35.287142] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-09-18T22:57:35.307767] [DEBUG] [LOCAL ] SEG: Derivative data saved (1807 records). [2025-09-18T22:57:35.307989] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-09-18T22:57:35.309978] [INFO ] [MAIN ] Derivative Progress: 1624/2075 symbols completed. SEG took 1.1s. Estimated remaining: 2m 55s. Rate: 154.6 symbols/min [2025-09-18T22:57:35.310260] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:35.326773] [DEBUG] [MAIN ] SE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:35.327624] [INFO ] [MAIN ] SE: Generated 1807 derivative records from 53786 primary records. [2025-09-18T22:57:35.327773] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-09-18T22:57:35.341186] [DEBUG] [MAIN ] SEE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:35.355256] [INFO ] [MAIN ] SEE: Generated 1807 derivative records from 48830 primary records. [2025-09-18T22:57:35.355433] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-09-18T22:57:35.358233] [DEBUG] [LOCAL ] SE: Derivative data saved (1807 records). [2025-09-18T22:57:35.359138] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-09-18T22:57:35.361966] [INFO ] [MAIN ] Derivative Progress: 1625/2075 symbols completed. SE took 1.2s. Estimated remaining: 2m 55s. Rate: 154.7 symbols/min [2025-09-18T22:57:35.369861] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:35.379178] [DEBUG] [LOCAL ] SEE: Derivative data saved (1807 records). [2025-09-18T22:57:35.379299] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-09-18T22:57:35.382041] [INFO ] [MAIN ] Derivative Progress: 1626/2075 symbols completed. SEE took 1.2s. Estimated remaining: 2m 54s. Rate: 154.8 symbols/min [2025-09-18T22:57:35.382325] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:35.414322] [DEBUG] [LOCAL ] SEI: Loaded 49991 existing records from primary storage. [2025-09-18T22:57:35.415320] [INFO ] [MAIN ] SEI: Loaded 49991 primary data records. [2025-09-18T22:57:35.640840] [DEBUG] [LOCAL ] SEM: Loaded 43446 existing records from primary storage. [2025-09-18T22:57:35.641469] [DEBUG] [LOCAL ] SEMR: Loaded 42078 existing records from primary storage. [2025-09-18T22:57:35.641604] [INFO ] [MAIN ] SEM: Loaded 43446 primary data records. [2025-09-18T22:57:35.743206] [INFO ] [MAIN ] SEMR: Loaded 42078 primary data records. [2025-09-18T22:57:36.409424] [DEBUG] [MAIN ] SEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:36.411062] [INFO ] [MAIN ] SEI: Generated 1807 derivative records from 49991 primary records. [2025-09-18T22:57:36.411264] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-09-18T22:57:36.430847] [DEBUG] [LOCAL ] SEI: Derivative data saved (1807 records). [2025-09-18T22:57:36.434035] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-09-18T22:57:36.436155] [INFO ] [MAIN ] Derivative Progress: 1627/2075 symbols completed. SEI took 1.1s. Estimated remaining: 2m 54s. Rate: 154.6 symbols/min [2025-09-18T22:57:36.436685] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:36.451054] [DEBUG] [MAIN ] SEMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:36.452379] [INFO ] [MAIN ] SEMR: Generated 1807 derivative records from 42078 primary records. [2025-09-18T22:57:36.452600] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-09-18T22:57:36.484071] [DEBUG] [MAIN ] SEM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:36.486048] [INFO ] [MAIN ] SEM: Generated 1807 derivative records from 43446 primary records. [2025-09-18T22:57:36.487354] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-09-18T22:57:36.487290] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1807 records). [2025-09-18T22:57:36.487630] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-09-18T22:57:36.490455] [INFO ] [MAIN ] Derivative Progress: 1628/2075 symbols completed. SEMR took 1.1s. Estimated remaining: 2m 53s. Rate: 154.7 symbols/min [2025-09-18T22:57:36.491688] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:36.509442] [DEBUG] [LOCAL ] SEM: Derivative data saved (1807 records). [2025-09-18T22:57:36.522899] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-09-18T22:57:36.525572] [INFO ] [MAIN ] Derivative Progress: 1629/2075 symbols completed. SEM took 1.2s. Estimated remaining: 2m 53s. Rate: 154.8 symbols/min [2025-09-18T22:57:36.526089] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:36.547077] [DEBUG] [LOCAL ] SES: Loaded 51906 existing records from primary storage. [2025-09-18T22:57:36.554479] [DEBUG] [LOCAL ] SFB: Loaded 4099 existing records from primary storage. [2025-09-18T22:57:36.554604] [INFO ] [MAIN ] SES: Loaded 51906 primary data records. [2025-09-18T22:57:36.555059] [INFO ] [MAIN ] SFB: Loaded 4099 primary data records. [2025-09-18T22:57:37.053118] [DEBUG] [LOCAL ] SF: Loaded 42264 existing records from primary storage. [2025-09-18T22:57:37.090308] [INFO ] [MAIN ] SF: Loaded 42264 primary data records. [2025-09-18T22:57:37.609980] [DEBUG] [MAIN ] SFB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:37.614020] [INFO ] [MAIN ] SFB: Generated 1807 derivative records from 4099 primary records. [2025-09-18T22:57:37.614246] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-09-18T22:57:37.639885] [DEBUG] [MAIN ] SES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:37.641508] [INFO ] [MAIN ] SES: Generated 1807 derivative records from 51906 primary records. [2025-09-18T22:57:37.644317] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-09-18T22:57:37.644449] [DEBUG] [LOCAL ] SFB: Derivative data saved (1807 records). [2025-09-18T22:57:37.645064] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-09-18T22:57:37.647388] [INFO ] [MAIN ] Derivative Progress: 1630/2075 symbols completed. SFB took 1.1s. Estimated remaining: 2m 53s. Rate: 154.6 symbols/min [2025-09-18T22:57:37.647910] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:37.664854] [DEBUG] [LOCAL ] SES: Derivative data saved (1807 records). [2025-09-18T22:57:37.666694] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-09-18T22:57:37.669847] [INFO ] [MAIN ] Derivative Progress: 1631/2075 symbols completed. SES took 1.2s. Estimated remaining: 2m 52s. Rate: 154.7 symbols/min [2025-09-18T22:57:37.671125] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:37.686031] [DEBUG] [MAIN ] SF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:37.692206] [INFO ] [MAIN ] SF: Generated 1807 derivative records from 42264 primary records. [2025-09-18T22:57:37.692428] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-09-18T22:57:37.714075] [DEBUG] [LOCAL ] SFBS: Loaded 21591 existing records from primary storage. [2025-09-18T22:57:37.714792] [INFO ] [MAIN ] SFBS: Loaded 21591 primary data records. [2025-09-18T22:57:37.814693] [DEBUG] [LOCAL ] SF: Derivative data saved (1807 records). [2025-09-18T22:57:37.833050] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-09-18T22:57:37.839177] [INFO ] [MAIN ] Derivative Progress: 1632/2075 symbols completed. SF took 1.3s. Estimated remaining: 2m 52s. Rate: 154.7 symbols/min [2025-09-18T22:57:37.845257] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:38.052683] [DEBUG] [LOCAL ] SFL: Loaded 45807 existing records from primary storage. [2025-09-18T22:57:38.053008] [INFO ] [MAIN ] SFL: Loaded 45807 primary data records. [2025-09-18T22:57:38.392507] [DEBUG] [LOCAL ] SG: Loaded 53850 existing records from primary storage. [2025-09-18T22:57:38.393536] [INFO ] [MAIN ] SG: Loaded 53850 primary data records. [2025-09-18T22:57:38.527442] [DEBUG] [MAIN ] SFBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:38.538897] [INFO ] [MAIN ] SFBS: Generated 1807 derivative records from 21591 primary records. [2025-09-18T22:57:38.539113] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-09-18T22:57:38.734242] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1807 records). [2025-09-18T22:57:38.734747] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-09-18T22:57:38.737245] [INFO ] [MAIN ] Derivative Progress: 1633/2075 symbols completed. SFBS took 1.1s. Estimated remaining: 2m 52s. Rate: 154.6 symbols/min [2025-09-18T22:57:38.751186] [DEBUG] [MAIN ] SFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:38.752047] [INFO ] [MAIN ] SFL: Generated 1807 derivative records from 45807 primary records. [2025-09-18T22:57:38.752368] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-09-18T22:57:38.770991] [DEBUG] [LOCAL ] SFL: Derivative data saved (1807 records). [2025-09-18T22:57:38.771322] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-09-18T22:57:38.773897] [INFO ] [MAIN ] Derivative Progress: 1634/2075 symbols completed. SFL took 1.1s. Estimated remaining: 2m 51s. Rate: 154.7 symbols/min [2025-09-18T22:57:38.790063] [DEBUG] [MAIN ] SG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:38.790597] [INFO ] [MAIN ] SG: Generated 1807 derivative records from 53850 primary records. [2025-09-18T22:57:38.790680] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-09-18T22:57:38.805777] [DEBUG] [LOCAL ] SG: Derivative data saved (1807 records). [2025-09-18T22:57:38.805837] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-09-18T22:57:38.808372] [INFO ] [MAIN ] Derivative Progress: 1635/2075 symbols completed. SG took 1.0s. Estimated remaining: 2m 51s. Rate: 154.8 symbols/min [2025-09-18T22:57:38.809391] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:38.809316] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:38.809098] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:38.819456] [DEBUG] [LOCAL ] SGU: Loaded 6692 existing records from primary storage. [2025-09-18T22:57:38.819584] [INFO ] [MAIN ] SGU: Loaded 6692 primary data records. [2025-09-18T22:57:39.186331] [DEBUG] [LOCAL ] SGHC: Loaded 45772 existing records from primary storage. [2025-09-18T22:57:39.187956] [INFO ] [MAIN ] SGHC: Loaded 45772 primary data records. [2025-09-18T22:57:39.269948] [DEBUG] [LOCAL ] SHAK: Loaded 49593 existing records from primary storage. [2025-09-18T22:57:39.301068] [INFO ] [MAIN ] SHAK: Loaded 49593 primary data records. [2025-09-18T22:57:39.828128] [DEBUG] [MAIN ] SGU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:39.842926] [INFO ] [MAIN ] SGU: Generated 1807 derivative records from 6692 primary records. [2025-09-18T22:57:39.843043] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-09-18T22:57:39.861547] [DEBUG] [LOCAL ] SGU: Derivative data saved (1807 records). [2025-09-18T22:57:39.862113] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-09-18T22:57:39.864928] [INFO ] [MAIN ] Derivative Progress: 1636/2075 symbols completed. SGU took 1.1s. Estimated remaining: 2m 50s. Rate: 154.6 symbols/min [2025-09-18T22:57:39.865842] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:39.886735] [DEBUG] [MAIN ] SGHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:39.887530] [INFO ] [MAIN ] SGHC: Generated 1807 derivative records from 45772 primary records. [2025-09-18T22:57:39.887742] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-09-18T22:57:39.919534] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1807 records). [2025-09-18T22:57:39.919660] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-09-18T22:57:39.923454] [INFO ] [MAIN ] Derivative Progress: 1637/2075 symbols completed. SGHC took 1.1s. Estimated remaining: 2m 50s. Rate: 154.7 symbols/min [2025-09-18T22:57:39.925434] [DEBUG] [LOCAL ] SHCO: Loaded 26461 existing records from primary storage. [2025-09-18T22:57:39.926661] [INFO ] [MAIN ] SHCO: Loaded 26461 primary data records. [2025-09-18T22:57:39.926775] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:40.016493] [DEBUG] [MAIN ] SHAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:40.044408] [INFO ] [MAIN ] SHAK: Generated 1807 derivative records from 49593 primary records. [2025-09-18T22:57:40.050209] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-09-18T22:57:40.269471] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1807 records). [2025-09-18T22:57:40.269984] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-09-18T22:57:40.272882] [INFO ] [MAIN ] Derivative Progress: 1638/2075 symbols completed. SHAK took 1.5s. Estimated remaining: 2m 49s. Rate: 154.7 symbols/min [2025-09-18T22:57:40.273358] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:40.325599] [DEBUG] [MAIN ] SHCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:40.325262] [DEBUG] [LOCAL ] SHEL: Loaded 54062 existing records from primary storage. [2025-09-18T22:57:40.326208] [INFO ] [MAIN ] SHEL: Loaded 54062 primary data records. [2025-09-18T22:57:40.327160] [INFO ] [MAIN ] SHCO: Generated 1807 derivative records from 26461 primary records. [2025-09-18T22:57:40.366614] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-09-18T22:57:40.435535] [DEBUG] [LOCAL ] SHG: Loaded 27806 existing records from primary storage. [2025-09-18T22:57:40.438286] [INFO ] [MAIN ] SHG: Loaded 27806 primary data records. [2025-09-18T22:57:40.487737] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1807 records). [2025-09-18T22:57:40.487847] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-09-18T22:57:40.490205] [INFO ] [MAIN ] Derivative Progress: 1639/2075 symbols completed. SHCO took 0.6s. Estimated remaining: 2m 49s. Rate: 154.7 symbols/min [2025-09-18T22:57:40.522479] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:41.049205] [DEBUG] [MAIN ] SHEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:41.051016] [INFO ] [MAIN ] SHEL: Generated 1807 derivative records from 54062 primary records. [2025-09-18T22:57:41.051235] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-09-18T22:57:41.084089] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1807 records). [2025-09-18T22:57:41.085872] [DEBUG] [LOCAL ] SHO: Loaded 50219 existing records from primary storage. [2025-09-18T22:57:41.086299] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-09-18T22:57:41.088405] [INFO ] [MAIN ] Derivative Progress: 1640/2075 symbols completed. SHEL took 1.2s. Estimated remaining: 2m 49s. Rate: 154.7 symbols/min [2025-09-18T22:57:41.086478] [INFO ] [MAIN ] SHO: Loaded 50219 primary data records. [2025-09-18T22:57:41.088860] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:41.148417] [DEBUG] [MAIN ] SHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:41.189875] [DEBUG] [LOCAL ] SHOC: Loaded 4243 existing records from primary storage. [2025-09-18T22:57:41.195813] [INFO ] [MAIN ] SHG: Generated 1807 derivative records from 27806 primary records. [2025-09-18T22:57:41.209924] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-09-18T22:57:41.209807] [INFO ] [MAIN ] SHOC: Loaded 4243 primary data records. [2025-09-18T22:57:41.549507] [DEBUG] [LOCAL ] SHG: Derivative data saved (1807 records). [2025-09-18T22:57:41.555448] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-09-18T22:57:41.568807] [INFO ] [MAIN ] Derivative Progress: 1641/2075 symbols completed. SHG took 1.3s. Estimated remaining: 2m 48s. Rate: 154.7 symbols/min [2025-09-18T22:57:41.569745] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:41.766177] [DEBUG] [MAIN ] SHO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:41.767009] [INFO ] [MAIN ] SHO: Generated 1807 derivative records from 50219 primary records. [2025-09-18T22:57:41.767170] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-09-18T22:57:41.807953] [DEBUG] [LOCAL ] SHO: Derivative data saved (1807 records). [2025-09-18T22:57:41.813342] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-09-18T22:57:41.815329] [INFO ] [MAIN ] Derivative Progress: 1642/2075 symbols completed. SHO took 1.3s. Estimated remaining: 2m 48s. Rate: 154.7 symbols/min [2025-09-18T22:57:41.813207] [DEBUG] [MAIN ] SHOC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:57:41.817226] [INFO ] [MAIN ] SHOC: Generated 1806 derivative records from 4243 primary records. [2025-09-18T22:57:41.817565] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:41.817495] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-09-18T22:57:41.833153] [DEBUG] [LOCAL ] SHW: Loaded 50914 existing records from primary storage. [2025-09-18T22:57:41.840743] [INFO ] [MAIN ] SHW: Loaded 50914 primary data records. [2025-09-18T22:57:41.878878] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1806 records). [2025-09-18T22:57:41.891212] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-09-18T22:57:41.906210] [INFO ] [MAIN ] Derivative Progress: 1643/2075 symbols completed. SHOC took 0.8s. Estimated remaining: 2m 47s. Rate: 154.8 symbols/min [2025-09-18T22:57:41.920773] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:42.188580] [DEBUG] [LOCAL ] SID: Loaded 42466 existing records from primary storage. [2025-09-18T22:57:42.189079] [INFO ] [MAIN ] SID: Loaded 42466 primary data records. [2025-09-18T22:57:42.526350] [DEBUG] [LOCAL ] SIG: Loaded 47088 existing records from primary storage. [2025-09-18T22:57:42.528752] [INFO ] [MAIN ] SIG: Loaded 47088 primary data records. [2025-09-18T22:57:42.642161] [DEBUG] [MAIN ] SHW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:42.655741] [INFO ] [MAIN ] SHW: Generated 1807 derivative records from 50914 primary records. [2025-09-18T22:57:42.656343] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-09-18T22:57:42.869463] [DEBUG] [LOCAL ] SHW: Derivative data saved (1807 records). [2025-09-18T22:57:42.870353] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-09-18T22:57:42.872678] [INFO ] [MAIN ] Derivative Progress: 1644/2075 symbols completed. SHW took 1.3s. Estimated remaining: 2m 47s. Rate: 154.6 symbols/min [2025-09-18T22:57:42.873171] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:42.896287] [DEBUG] [MAIN ] SID: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:42.897296] [INFO ] [MAIN ] SID: Generated 1807 derivative records from 42466 primary records. [2025-09-18T22:57:42.897498] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-09-18T22:57:42.923057] [DEBUG] [LOCAL ] SID: Derivative data saved (1807 records). [2025-09-18T22:57:42.923255] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-09-18T22:57:42.925721] [INFO ] [MAIN ] Derivative Progress: 1645/2075 symbols completed. SID took 1.1s. Estimated remaining: 2m 47s. Rate: 154.7 symbols/min [2025-09-18T22:57:42.926219] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:42.935280] [DEBUG] [LOCAL ] SII: Loaded 23155 existing records from primary storage. [2025-09-18T22:57:42.935548] [INFO ] [MAIN ] SII: Loaded 23155 primary data records. [2025-09-18T22:57:43.106145] [DEBUG] [MAIN ] SIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:43.143289] [INFO ] [MAIN ] SIG: Generated 1807 derivative records from 47088 primary records. [2025-09-18T22:57:43.155699] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-09-18T22:57:43.310434] [DEBUG] [LOCAL ] SILA: Loaded 31543 existing records from primary storage. [2025-09-18T22:57:43.310882] [INFO ] [MAIN ] SILA: Loaded 31543 primary data records. [2025-09-18T22:57:43.406569] [DEBUG] [LOCAL ] SIG: Derivative data saved (1807 records). [2025-09-18T22:57:43.425013] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-09-18T22:57:43.435820] [INFO ] [MAIN ] Derivative Progress: 1646/2075 symbols completed. SIG took 1.5s. Estimated remaining: 2m 46s. Rate: 154.7 symbols/min [2025-09-18T22:57:43.441059] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:43.665176] [DEBUG] [MAIN ] SII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:43.666303] [INFO ] [MAIN ] SII: Generated 1807 derivative records from 23155 primary records. [2025-09-18T22:57:43.676028] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-09-18T22:57:43.706700] [DEBUG] [LOCAL ] SII: Derivative data saved (1807 records). [2025-09-18T22:57:43.707061] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-09-18T22:57:43.710297] [DEBUG] [LOCAL ] SITC: Loaded 41957 existing records from primary storage. [2025-09-18T22:57:43.709250] [INFO ] [MAIN ] Derivative Progress: 1647/2075 symbols completed. SII took 0.8s. Estimated remaining: 2m 46s. Rate: 154.7 symbols/min [2025-09-18T22:57:43.710833] [INFO ] [MAIN ] SITC: Loaded 41957 primary data records. [2025-09-18T22:57:43.711397] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:43.864539] [DEBUG] [MAIN ] SILA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:43.896281] [INFO ] [MAIN ] SILA: Generated 1807 derivative records from 31543 primary records. [2025-09-18T22:57:43.929398] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-09-18T22:57:44.078893] [DEBUG] [LOCAL ] SILA: Derivative data saved (1807 records). [2025-09-18T22:57:44.079779] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-09-18T22:57:44.080891] [DEBUG] [LOCAL ] SITE: Loaded 35589 existing records from primary storage. [2025-09-18T22:57:44.083478] [INFO ] [MAIN ] Derivative Progress: 1648/2075 symbols completed. SILA took 1.2s. Estimated remaining: 2m 46s. Rate: 154.7 symbols/min [2025-09-18T22:57:44.084853] [INFO ] [MAIN ] SITE: Loaded 35589 primary data records. [2025-09-18T22:57:44.401116] [DEBUG] [MAIN ] SITC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:44.402379] [INFO ] [MAIN ] SITC: Generated 1807 derivative records from 41957 primary records. [2025-09-18T22:57:44.402881] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-09-18T22:57:44.421745] [DEBUG] [LOCAL ] SITC: Derivative data saved (1807 records). [2025-09-18T22:57:44.421956] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-09-18T22:57:44.424121] [INFO ] [MAIN ] Derivative Progress: 1649/2075 symbols completed. SITC took 1.0s. Estimated remaining: 2m 45s. Rate: 154.7 symbols/min [2025-09-18T22:57:44.439778] [DEBUG] [MAIN ] SITE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:44.440427] [INFO ] [MAIN ] SITE: Generated 1807 derivative records from 35589 primary records. [2025-09-18T22:57:44.440488] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-09-18T22:57:44.456237] [DEBUG] [LOCAL ] SITE: Derivative data saved (1807 records). [2025-09-18T22:57:44.456300] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-09-18T22:57:44.458385] [INFO ] [MAIN ] Derivative Progress: 1650/2075 symbols completed. SITE took 0.7s. Estimated remaining: 2m 45s. Rate: 154.8 symbols/min [2025-09-18T22:57:44.459519] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:44.459124] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:44.459444] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:44.482827] [DEBUG] [LOCAL ] SJT: Loaded 22312 existing records from primary storage. [2025-09-18T22:57:44.482967] [INFO ] [MAIN ] SJT: Loaded 22312 primary data records. [2025-09-18T22:57:44.636978] [DEBUG] [LOCAL ] SKE: Loaded 35645 existing records from primary storage. [2025-09-18T22:57:44.650487] [INFO ] [MAIN ] SKE: Loaded 35645 primary data records. [2025-09-18T22:57:44.695755] [DEBUG] [LOCAL ] SJM: Loaded 50511 existing records from primary storage. [2025-09-18T22:57:44.705301] [INFO ] [MAIN ] SJM: Loaded 50511 primary data records. [2025-09-18T22:57:45.516461] [DEBUG] [MAIN ] SJT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:45.518117] [INFO ] [MAIN ] SJT: Generated 1807 derivative records from 22312 primary records. [2025-09-18T22:57:45.518418] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-09-18T22:57:45.537208] [DEBUG] [LOCAL ] SJT: Derivative data saved (1807 records). [2025-09-18T22:57:45.537416] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-09-18T22:57:45.539832] [INFO ] [MAIN ] Derivative Progress: 1651/2075 symbols completed. SJT took 1.1s. Estimated remaining: 2m 45s. Rate: 154.6 symbols/min [2025-09-18T22:57:45.540211] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:45.563779] [DEBUG] [LOCAL ] SKIL: Loaded 6445 existing records from primary storage. [2025-09-18T22:57:45.560353] [DEBUG] [MAIN ] SKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:45.567295] [INFO ] [MAIN ] SKIL: Loaded 6445 primary data records. [2025-09-18T22:57:45.605286] [INFO ] [MAIN ] SKE: Generated 1807 derivative records from 35645 primary records. [2025-09-18T22:57:45.665780] [DEBUG] [MAIN ] SJM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:45.665363] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-09-18T22:57:45.678375] [INFO ] [MAIN ] SJM: Generated 1807 derivative records from 50511 primary records. [2025-09-18T22:57:45.690725] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-09-18T22:57:45.918822] [DEBUG] [LOCAL ] SJM: Derivative data saved (1807 records). [2025-09-18T22:57:45.919917] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-09-18T22:57:45.923025] [DEBUG] [LOCAL ] SKE: Derivative data saved (1807 records). [2025-09-18T22:57:45.922512] [INFO ] [MAIN ] Derivative Progress: 1652/2075 symbols completed. SJM took 1.5s. Estimated remaining: 2m 44s. Rate: 154.6 symbols/min [2025-09-18T22:57:45.923373] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-09-18T22:57:45.923300] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:45.926806] [INFO ] [MAIN ] Derivative Progress: 1653/2075 symbols completed. SKE took 1.5s. Estimated remaining: 2m 44s. Rate: 154.7 symbols/min [2025-09-18T22:57:45.927428] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:45.941942] [DEBUG] [LOCAL ] SKLZ: Loaded 12122 existing records from primary storage. [2025-09-18T22:57:45.942308] [INFO ] [MAIN ] SKLZ: Loaded 12122 primary data records. [2025-09-18T22:57:46.061975] [DEBUG] [MAIN ] SKIL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:46.074143] [INFO ] [MAIN ] SKIL: Generated 1807 derivative records from 6445 primary records. [2025-09-18T22:57:46.074303] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-09-18T22:57:46.184514] [DEBUG] [LOCAL ] SKM: Loaded 35636 existing records from primary storage. [2025-09-18T22:57:46.237892] [INFO ] [MAIN ] SKM: Loaded 35636 primary data records. [2025-09-18T22:57:46.344756] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1807 records). [2025-09-18T22:57:46.372136] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-09-18T22:57:46.391511] [INFO ] [MAIN ] Derivative Progress: 1654/2075 symbols completed. SKIL took 0.9s. Estimated remaining: 2m 43s. Rate: 154.7 symbols/min [2025-09-18T22:57:46.410616] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:46.630234] [DEBUG] [MAIN ] SKLZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:46.641177] [INFO ] [MAIN ] SKLZ: Generated 1807 derivative records from 12122 primary records. [2025-09-18T22:57:46.641349] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-09-18T22:57:46.670886] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1807 records). [2025-09-18T22:57:46.671384] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-09-18T22:57:46.672192] [DEBUG] [LOCAL ] SKT: Loaded 42905 existing records from primary storage. [2025-09-18T22:57:46.674427] [INFO ] [MAIN ] Derivative Progress: 1655/2075 symbols completed. SKLZ took 0.8s. Estimated remaining: 2m 43s. Rate: 154.7 symbols/min [2025-09-18T22:57:46.674764] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:46.675507] [INFO ] [MAIN ] SKT: Loaded 42905 primary data records. [2025-09-18T22:57:46.850422] [DEBUG] [MAIN ] SKM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:46.868626] [INFO ] [MAIN ] SKM: Generated 1807 derivative records from 35636 primary records. [2025-09-18T22:57:47.043101] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-09-18T22:57:47.084316] [DEBUG] [LOCAL ] SKY: Loaded 37932 existing records from primary storage. [2025-09-18T22:57:47.084715] [INFO ] [MAIN ] SKY: Loaded 37932 primary data records. [2025-09-18T22:57:47.162956] [DEBUG] [LOCAL ] SKM: Derivative data saved (1807 records). [2025-09-18T22:57:47.175096] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-09-18T22:57:47.188069] [INFO ] [MAIN ] Derivative Progress: 1656/2075 symbols completed. SKM took 1.3s. Estimated remaining: 2m 42s. Rate: 154.7 symbols/min [2025-09-18T22:57:47.195959] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:47.410837] [DEBUG] [LOCAL ] SKYH: Loaded 16725 existing records from primary storage. [2025-09-18T22:57:47.411325] [INFO ] [MAIN ] SKYH: Loaded 16725 primary data records. [2025-09-18T22:57:47.555524] [DEBUG] [MAIN ] SKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:47.608797] [INFO ] [MAIN ] SKT: Generated 1807 derivative records from 42905 primary records. [2025-09-18T22:57:47.614588] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-09-18T22:57:47.754920] [DEBUG] [LOCAL ] SKT: Derivative data saved (1807 records). [2025-09-18T22:57:47.757311] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-09-18T22:57:47.760562] [INFO ] [MAIN ] Derivative Progress: 1657/2075 symbols completed. SKT took 1.4s. Estimated remaining: 2m 42s. Rate: 154.7 symbols/min [2025-09-18T22:57:47.761183] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:47.775267] [DEBUG] [MAIN ] SKY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:47.776250] [INFO ] [MAIN ] SKY: Generated 1807 derivative records from 37932 primary records. [2025-09-18T22:57:47.776420] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-09-18T22:57:47.811844] [DEBUG] [MAIN ] SKYH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:47.812471] [DEBUG] [LOCAL ] SKY: Derivative data saved (1807 records). [2025-09-18T22:57:47.813217] [INFO ] [MAIN ] SKYH: Generated 1807 derivative records from 16725 primary records. [2025-09-18T22:57:47.813396] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-09-18T22:57:47.815543] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-09-18T22:57:47.815473] [INFO ] [MAIN ] Derivative Progress: 1658/2075 symbols completed. SKY took 1.1s. Estimated remaining: 2m 42s. Rate: 154.8 symbols/min [2025-09-18T22:57:47.817102] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:47.847784] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1807 records). [2025-09-18T22:57:47.847928] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-09-18T22:57:47.850485] [INFO ] [MAIN ] Derivative Progress: 1659/2075 symbols completed. SKYH took 0.7s. Estimated remaining: 2m 41s. Rate: 154.8 symbols/min [2025-09-18T22:57:47.850988] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:47.872058] [DEBUG] [LOCAL ] SLB: Loaded 54087 existing records from primary storage. [2025-09-18T22:57:47.880576] [INFO ] [MAIN ] SLB: Loaded 54087 primary data records. [2025-09-18T22:57:48.028526] [DEBUG] [LOCAL ] SLF: Loaded 39573 existing records from primary storage. [2025-09-18T22:57:48.039807] [INFO ] [MAIN ] SLF: Loaded 39573 primary data records. [2025-09-18T22:57:48.315076] [DEBUG] [LOCAL ] SLG: Loaded 46009 existing records from primary storage. [2025-09-18T22:57:48.326921] [INFO ] [MAIN ] SLG: Loaded 46009 primary data records. [2025-09-18T22:57:48.891811] [DEBUG] [MAIN ] SLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:48.892609] [INFO ] [MAIN ] SLB: Generated 1807 derivative records from 54087 primary records. [2025-09-18T22:57:48.892946] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-09-18T22:57:48.913797] [DEBUG] [LOCAL ] SLB: Derivative data saved (1807 records). [2025-09-18T22:57:48.927159] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-09-18T22:57:48.927048] [DEBUG] [MAIN ] SLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:48.930350] [INFO ] [MAIN ] SLF: Generated 1807 derivative records from 39573 primary records. [2025-09-18T22:57:48.930483] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-09-18T22:57:48.929439] [INFO ] [MAIN ] Derivative Progress: 1660/2075 symbols completed. SLB took 1.2s. Estimated remaining: 2m 41s. Rate: 154.7 symbols/min [2025-09-18T22:57:48.939065] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:48.962112] [DEBUG] [MAIN ] SLG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:48.963362] [INFO ] [MAIN ] SLG: Generated 1807 derivative records from 46009 primary records. [2025-09-18T22:57:48.963715] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-09-18T22:57:48.965739] [DEBUG] [LOCAL ] SLF: Derivative data saved (1807 records). [2025-09-18T22:57:48.966109] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-09-18T22:57:48.979103] [INFO ] [MAIN ] Derivative Progress: 1661/2075 symbols completed. SLF took 1.2s. Estimated remaining: 2m 41s. Rate: 154.8 symbols/min [2025-09-18T22:57:48.980720] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:48.984945] [DEBUG] [LOCAL ] SLG: Derivative data saved (1807 records). [2025-09-18T22:57:48.993824] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-09-18T22:57:48.996571] [INFO ] [MAIN ] Derivative Progress: 1662/2075 symbols completed. SLG took 1.1s. Estimated remaining: 2m 40s. Rate: 154.8 symbols/min [2025-09-18T22:57:48.997117] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:49.013068] [DEBUG] [LOCAL ] SLGN: Loaded 40594 existing records from primary storage. [2025-09-18T22:57:49.013296] [INFO ] [MAIN ] SLGN: Loaded 40594 primary data records. [2025-09-18T22:57:49.215937] [DEBUG] [LOCAL ] SLVM: Loaded 28220 existing records from primary storage. [2025-09-18T22:57:49.235566] [INFO ] [MAIN ] SLVM: Loaded 28220 primary data records. [2025-09-18T22:57:49.241765] [DEBUG] [LOCAL ] SLQT: Loaded 44598 existing records from primary storage. [2025-09-18T22:57:49.253671] [INFO ] [MAIN ] SLQT: Loaded 44598 primary data records. [2025-09-18T22:57:49.994687] [DEBUG] [MAIN ] SLGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:49.995700] [INFO ] [MAIN ] SLGN: Generated 1807 derivative records from 40594 primary records. [2025-09-18T22:57:49.995896] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-09-18T22:57:50.018031] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1807 records). [2025-09-18T22:57:50.018389] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-09-18T22:57:50.020626] [INFO ] [MAIN ] Derivative Progress: 1663/2075 symbols completed. SLGN took 1.1s. Estimated remaining: 2m 40s. Rate: 154.7 symbols/min [2025-09-18T22:57:50.039818] [DEBUG] [MAIN ] SLVM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:50.040947] [INFO ] [MAIN ] SLVM: Generated 1807 derivative records from 28220 primary records. [2025-09-18T22:57:50.041886] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-09-18T22:57:50.070388] [DEBUG] [MAIN ] SLQT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:50.072181] [INFO ] [MAIN ] SLQT: Generated 1807 derivative records from 44598 primary records. [2025-09-18T22:57:50.073733] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-09-18T22:57:50.074870] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1807 records). [2025-09-18T22:57:50.075545] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-09-18T22:57:50.078729] [INFO ] [MAIN ] Derivative Progress: 1664/2075 symbols completed. SLVM took 1.1s. Estimated remaining: 2m 39s. Rate: 154.8 symbols/min [2025-09-18T22:57:50.093906] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1807 records). [2025-09-18T22:57:50.093980] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-09-18T22:57:50.098082] [INFO ] [MAIN ] Derivative Progress: 1665/2075 symbols completed. SLQT took 1.1s. Estimated remaining: 2m 39s. Rate: 154.9 symbols/min [2025-09-18T22:57:50.098769] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:50.098699] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:50.099103] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:50.115366] [DEBUG] [LOCAL ] SMBK: Loaded 8341 existing records from primary storage. [2025-09-18T22:57:50.115572] [INFO ] [MAIN ] SMBK: Loaded 8341 primary data records. [2025-09-18T22:57:50.165492] [DEBUG] [LOCAL ] SMC: Loaded 11545 existing records from primary storage. [2025-09-18T22:57:50.192594] [INFO ] [MAIN ] SMC: Loaded 11545 primary data records. [2025-09-18T22:57:50.610207] [DEBUG] [LOCAL ] SM: Loaded 52708 existing records from primary storage. [2025-09-18T22:57:50.627596] [INFO ] [MAIN ] SM: Loaded 52708 primary data records. [2025-09-18T22:57:51.159416] [DEBUG] [MAIN ] SMBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:51.160862] [INFO ] [MAIN ] SMBK: Generated 1807 derivative records from 8341 primary records. [2025-09-18T22:57:51.161071] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-09-18T22:57:51.196501] [DEBUG] [MAIN ] SMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:51.196212] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1807 records). [2025-09-18T22:57:51.197316] [INFO ] [MAIN ] SMC: Generated 1807 derivative records from 11545 primary records. [2025-09-18T22:57:51.197550] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-09-18T22:57:51.199866] [INFO ] [MAIN ] Derivative Progress: 1666/2075 symbols completed. SMBK took 1.1s. Estimated remaining: 2m 39s. Rate: 154.7 symbols/min [2025-09-18T22:57:51.200112] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:51.200333] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-09-18T22:57:51.234081] [DEBUG] [LOCAL ] SMC: Derivative data saved (1807 records). [2025-09-18T22:57:51.234388] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-09-18T22:57:51.236951] [INFO ] [MAIN ] Derivative Progress: 1667/2075 symbols completed. SMC took 1.1s. Estimated remaining: 2m 38s. Rate: 154.8 symbols/min [2025-09-18T22:57:51.237357] [DEBUG] [MAIN ] SM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:51.238604] [INFO ] [MAIN ] SM: Generated 1807 derivative records from 52708 primary records. [2025-09-18T22:57:51.237733] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:51.238891] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-09-18T22:57:51.256988] [DEBUG] [LOCAL ] SM: Derivative data saved (1807 records). [2025-09-18T22:57:51.257185] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-09-18T22:57:51.259828] [INFO ] [MAIN ] Derivative Progress: 1668/2075 symbols completed. SM took 1.2s. Estimated remaining: 2m 38s. Rate: 154.9 symbols/min [2025-09-18T22:57:51.271463] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:51.299372] [DEBUG] [LOCAL ] SMHI: Loaded 14702 existing records from primary storage. [2025-09-18T22:57:51.313594] [INFO ] [MAIN ] SMHI: Loaded 14702 primary data records. [2025-09-18T22:57:51.336627] [DEBUG] [LOCAL ] SMFG: Loaded 48525 existing records from primary storage. [2025-09-18T22:57:51.372547] [INFO ] [MAIN ] SMFG: Loaded 48525 primary data records. [2025-09-18T22:57:51.407264] [DEBUG] [LOCAL ] SMG: Loaded 44583 existing records from primary storage. [2025-09-18T22:57:51.465177] [INFO ] [MAIN ] SMG: Loaded 44583 primary data records. [2025-09-18T22:57:52.308949] [DEBUG] [MAIN ] SMHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:52.312151] [INFO ] [MAIN ] SMHI: Generated 1807 derivative records from 14702 primary records. [2025-09-18T22:57:52.312511] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-09-18T22:57:52.343606] [DEBUG] [MAIN ] SMFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:52.343927] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1807 records). [2025-09-18T22:57:52.344884] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-09-18T22:57:52.344626] [INFO ] [MAIN ] SMFG: Generated 1807 derivative records from 48525 primary records. [2025-09-18T22:57:52.347002] [INFO ] [MAIN ] Derivative Progress: 1669/2075 symbols completed. SMHI took 1.1s. Estimated remaining: 2m 37s. Rate: 154.7 symbols/min [2025-09-18T22:57:52.359665] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:52.360280] [DEBUG] [MAIN ] SMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:52.360778] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-09-18T22:57:52.361790] [INFO ] [MAIN ] SMG: Generated 1807 derivative records from 44583 primary records. [2025-09-18T22:57:52.363357] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-09-18T22:57:52.407277] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1807 records). [2025-09-18T22:57:52.407914] [DEBUG] [LOCAL ] SMG: Derivative data saved (1807 records). [2025-09-18T22:57:52.408051] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-09-18T22:57:52.408155] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-09-18T22:57:52.408544] [DEBUG] [LOCAL ] SMP: Loaded 20119 existing records from primary storage. [2025-09-18T22:57:52.410923] [INFO ] [MAIN ] Derivative Progress: 1670/2075 symbols completed. SMFG took 1.2s. Estimated remaining: 2m 37s. Rate: 154.8 symbols/min [2025-09-18T22:57:52.413951] [INFO ] [MAIN ] Derivative Progress: 1671/2075 symbols completed. SMG took 1.2s. Estimated remaining: 2m 37s. Rate: 154.9 symbols/min [2025-09-18T22:57:52.414303] [INFO ] [MAIN ] SMP: Loaded 20119 primary data records. [2025-09-18T22:57:52.414469] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:52.414555] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:52.766702] [DEBUG] [LOCAL ] SMRT: Loaded 44785 existing records from primary storage. [2025-09-18T22:57:52.767701] [INFO ] [MAIN ] SMRT: Loaded 44785 primary data records. [2025-09-18T22:57:52.873504] [DEBUG] [LOCAL ] SMR: Loaded 54187 existing records from primary storage. [2025-09-18T22:57:52.897207] [INFO ] [MAIN ] SMR: Loaded 54187 primary data records. [2025-09-18T22:57:53.473526] [DEBUG] [MAIN ] SMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:53.474592] [INFO ] [MAIN ] SMP: Generated 1807 derivative records from 20119 primary records. [2025-09-18T22:57:53.476040] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-09-18T22:57:53.502815] [DEBUG] [LOCAL ] SMP: Derivative data saved (1807 records). [2025-09-18T22:57:53.503075] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-09-18T22:57:53.505321] [INFO ] [MAIN ] Derivative Progress: 1672/2075 symbols completed. SMP took 1.2s. Estimated remaining: 2m 36s. Rate: 154.7 symbols/min [2025-09-18T22:57:53.505791] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:53.519818] [DEBUG] [MAIN ] SMRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:53.520947] [INFO ] [MAIN ] SMRT: Generated 1807 derivative records from 44785 primary records. [2025-09-18T22:57:53.521321] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-09-18T22:57:53.556066] [DEBUG] [MAIN ] SMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:53.555686] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1807 records). [2025-09-18T22:57:53.556230] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-09-18T22:57:53.560522] [INFO ] [MAIN ] SMR: Generated 1807 derivative records from 54187 primary records. [2025-09-18T22:57:53.559403] [INFO ] [MAIN ] Derivative Progress: 1673/2075 symbols completed. SMRT took 1.1s. Estimated remaining: 2m 36s. Rate: 154.8 symbols/min [2025-09-18T22:57:53.560724] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-09-18T22:57:53.561894] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:53.589795] [DEBUG] [LOCAL ] SMR: Derivative data saved (1807 records). [2025-09-18T22:57:53.589959] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-09-18T22:57:53.593151] [INFO ] [MAIN ] Derivative Progress: 1674/2075 symbols completed. SMR took 1.2s. Estimated remaining: 2m 35s. Rate: 154.9 symbols/min [2025-09-18T22:57:53.602728] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:53.605060] [DEBUG] [LOCAL ] SMWB: Loaded 33579 existing records from primary storage. [2025-09-18T22:57:53.605258] [INFO ] [MAIN ] SMWB: Loaded 33579 primary data records. [2025-09-18T22:57:53.733749] [DEBUG] [LOCAL ] SNA: Loaded 26615 existing records from primary storage. [2025-09-18T22:57:53.740526] [INFO ] [MAIN ] SNA: Loaded 26615 primary data records. [2025-09-18T22:57:54.160746] [DEBUG] [LOCAL ] SNAP: Loaded 54186 existing records from primary storage. [2025-09-18T22:57:54.217587] [INFO ] [MAIN ] SNAP: Loaded 54186 primary data records. [2025-09-18T22:57:54.686855] [DEBUG] [MAIN ] SMWB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:54.688319] [INFO ] [MAIN ] SMWB: Generated 1807 derivative records from 33579 primary records. [2025-09-18T22:57:54.689454] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-09-18T22:57:54.721357] [DEBUG] [MAIN ] SNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:54.722777] [INFO ] [MAIN ] SNA: Generated 1807 derivative records from 26615 primary records. [2025-09-18T22:57:54.723099] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-09-18T22:57:54.738350] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1807 records). [2025-09-18T22:57:54.738842] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-09-18T22:57:54.741410] [INFO ] [MAIN ] Derivative Progress: 1675/2075 symbols completed. SMWB took 1.2s. Estimated remaining: 2m 35s. Rate: 154.7 symbols/min [2025-09-18T22:57:54.741995] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:54.758181] [DEBUG] [LOCAL ] SNA: Derivative data saved (1807 records). [2025-09-18T22:57:54.763707] [DEBUG] [MAIN ] SNAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:54.763932] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-09-18T22:57:54.767126] [INFO ] [MAIN ] SNAP: Generated 1807 derivative records from 54186 primary records. [2025-09-18T22:57:54.769395] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-09-18T22:57:54.769296] [INFO ] [MAIN ] Derivative Progress: 1676/2075 symbols completed. SNA took 1.2s. Estimated remaining: 2m 35s. Rate: 154.8 symbols/min [2025-09-18T22:57:54.770602] [DEBUG] [LOCAL ] SNDA: Loaded 4786 existing records from primary storage. [2025-09-18T22:57:54.770943] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:54.771250] [INFO ] [MAIN ] SNDA: Loaded 4786 primary data records. [2025-09-18T22:57:54.807677] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1807 records). [2025-09-18T22:57:54.823715] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-09-18T22:57:54.826477] [INFO ] [MAIN ] Derivative Progress: 1677/2075 symbols completed. SNAP took 1.2s. Estimated remaining: 2m 34s. Rate: 154.8 symbols/min [2025-09-18T22:57:54.854804] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:55.167797] [DEBUG] [LOCAL ] SNDR: Loaded 40781 existing records from primary storage. [2025-09-18T22:57:55.168189] [INFO ] [MAIN ] SNDR: Loaded 40781 primary data records. [2025-09-18T22:57:55.249774] [DEBUG] [LOCAL ] SNN: Loaded 44690 existing records from primary storage. [2025-09-18T22:57:55.257596] [INFO ] [MAIN ] SNN: Loaded 44690 primary data records. [2025-09-18T22:57:55.371415] [DEBUG] [MAIN ] SNDA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:55.400004] [INFO ] [MAIN ] SNDA: Generated 1807 derivative records from 4786 primary records. [2025-09-18T22:57:55.421618] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-09-18T22:57:55.823682] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1807 records). [2025-09-18T22:57:55.824614] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-09-18T22:57:55.826900] [INFO ] [MAIN ] Derivative Progress: 1678/2075 symbols completed. SNDA took 1.1s. Estimated remaining: 2m 34s. Rate: 154.7 symbols/min [2025-09-18T22:57:55.852739] [DEBUG] [MAIN ] SNDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:55.865302] [INFO ] [MAIN ] SNDR: Generated 1807 derivative records from 40781 primary records. [2025-09-18T22:57:55.865487] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-09-18T22:57:55.866126] [DEBUG] [MAIN ] SNN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:55.866926] [INFO ] [MAIN ] SNN: Generated 1807 derivative records from 44690 primary records. [2025-09-18T22:57:55.867167] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-09-18T22:57:55.893851] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1807 records). [2025-09-18T22:57:55.894347] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-09-18T22:57:55.896356] [INFO ] [MAIN ] Derivative Progress: 1679/2075 symbols completed. SNDR took 1.1s. Estimated remaining: 2m 34s. Rate: 154.8 symbols/min [2025-09-18T22:57:55.900616] [DEBUG] [LOCAL ] SNN: Derivative data saved (1807 records). [2025-09-18T22:57:55.900710] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-09-18T22:57:55.903255] [INFO ] [MAIN ] Derivative Progress: 1680/2075 symbols completed. SNN took 1.0s. Estimated remaining: 2m 33s. Rate: 154.9 symbols/min [2025-09-18T22:57:55.903793] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:55.903880] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:55.904256] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:55.983170] [DEBUG] [LOCAL ] SNX: Loaded 39913 existing records from primary storage. [2025-09-18T22:57:55.984452] [INFO ] [MAIN ] SNX: Loaded 39913 primary data records. [2025-09-18T22:57:55.996538] [DEBUG] [LOCAL ] SNV: Loaded 49306 existing records from primary storage. [2025-09-18T22:57:56.022182] [INFO ] [MAIN ] SNV: Loaded 49306 primary data records. [2025-09-18T22:57:56.136250] [DEBUG] [LOCAL ] SNOW: Loaded 53959 existing records from primary storage. [2025-09-18T22:57:56.173042] [INFO ] [MAIN ] SNOW: Loaded 53959 primary data records. [2025-09-18T22:57:56.946876] [DEBUG] [MAIN ] SNX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:56.947746] [INFO ] [MAIN ] SNX: Generated 1807 derivative records from 39913 primary records. [2025-09-18T22:57:56.948052] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-09-18T22:57:56.967078] [DEBUG] [LOCAL ] SNX: Derivative data saved (1807 records). [2025-09-18T22:57:56.968223] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-09-18T22:57:56.971433] [INFO ] [MAIN ] Derivative Progress: 1681/2075 symbols completed. SNX took 1.1s. Estimated remaining: 2m 33s. Rate: 154.7 symbols/min [2025-09-18T22:57:56.972563] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:56.999375] [DEBUG] [MAIN ] SNOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:56.999103] [DEBUG] [MAIN ] SNV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:57.000377] [INFO ] [MAIN ] SNV: Generated 1807 derivative records from 49306 primary records. [2025-09-18T22:57:57.001073] [INFO ] [MAIN ] SNOW: Generated 1807 derivative records from 53959 primary records. [2025-09-18T22:57:57.001170] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-09-18T22:57:57.001268] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-09-18T22:57:57.044895] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1807 records). [2025-09-18T22:57:57.043333] [DEBUG] [LOCAL ] SNV: Derivative data saved (1807 records). [2025-09-18T22:57:57.045229] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-09-18T22:57:57.045173] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-09-18T22:57:57.048154] [INFO ] [MAIN ] Derivative Progress: 1682/2075 symbols completed. SNV took 1.1s. Estimated remaining: 2m 32s. Rate: 154.8 symbols/min [2025-09-18T22:57:57.051524] [INFO ] [MAIN ] Derivative Progress: 1683/2075 symbols completed. SNOW took 1.1s. Estimated remaining: 2m 32s. Rate: 154.9 symbols/min [2025-09-18T22:57:57.051844] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:57.051805] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:57.113889] [DEBUG] [LOCAL ] SO: Loaded 53993 existing records from primary storage. [2025-09-18T22:57:57.114124] [INFO ] [MAIN ] SO: Loaded 53993 primary data records. [2025-09-18T22:57:57.227548] [DEBUG] [LOCAL ] SOBO: Loaded 40351 existing records from primary storage. [2025-09-18T22:57:57.256578] [INFO ] [MAIN ] SOBO: Loaded 40351 primary data records. [2025-09-18T22:57:57.450773] [DEBUG] [LOCAL ] SOC: Loaded 50598 existing records from primary storage. [2025-09-18T22:57:57.502685] [INFO ] [MAIN ] SOC: Loaded 50598 primary data records. [2025-09-18T22:57:58.126447] [DEBUG] [MAIN ] SO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:58.128132] [INFO ] [MAIN ] SO: Generated 1807 derivative records from 53993 primary records. [2025-09-18T22:57:58.131001] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-09-18T22:57:58.158490] [DEBUG] [MAIN ] SOBO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:58.160160] [INFO ] [MAIN ] SOBO: Generated 1807 derivative records from 40351 primary records. [2025-09-18T22:57:58.161359] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-09-18T22:57:58.162807] [DEBUG] [LOCAL ] SO: Derivative data saved (1807 records). [2025-09-18T22:57:58.163141] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-09-18T22:57:58.165139] [INFO ] [MAIN ] Derivative Progress: 1684/2075 symbols completed. SO took 1.2s. Estimated remaining: 2m 32s. Rate: 154.7 symbols/min [2025-09-18T22:57:58.172858] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:58.202349] [DEBUG] [LOCAL ] SOJC: Loaded 5199 existing records from primary storage. [2025-09-18T22:57:58.203356] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1807 records). [2025-09-18T22:57:58.203913] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-09-18T22:57:58.203767] [DEBUG] [MAIN ] SOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:58.207040] [INFO ] [MAIN ] Derivative Progress: 1685/2075 symbols completed. SOBO took 1.2s. Estimated remaining: 2m 31s. Rate: 154.8 symbols/min [2025-09-18T22:57:58.204798] [INFO ] [MAIN ] SOC: Generated 1807 derivative records from 50598 primary records. [2025-09-18T22:57:58.207233] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-09-18T22:57:58.207331] [INFO ] [MAIN ] SOJC: Loaded 5199 primary data records. [2025-09-18T22:57:58.207561] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:58.268999] [DEBUG] [LOCAL ] SOC: Derivative data saved (1807 records). [2025-09-18T22:57:58.295870] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-09-18T22:57:58.319253] [INFO ] [MAIN ] Derivative Progress: 1686/2075 symbols completed. SOC took 1.3s. Estimated remaining: 2m 31s. Rate: 154.8 symbols/min [2025-09-18T22:57:58.336483] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:58.419250] [DEBUG] [LOCAL ] SOJD: Loaded 13089 existing records from primary storage. [2025-09-18T22:57:58.535717] [INFO ] [MAIN ] SOJD: Loaded 13089 primary data records. [2025-09-18T22:57:58.599680] [DEBUG] [LOCAL ] SOJE: Loaded 9537 existing records from primary storage. [2025-09-18T22:57:58.640277] [INFO ] [MAIN ] SOJE: Loaded 9537 primary data records. [2025-09-18T22:57:59.270327] [DEBUG] [MAIN ] SOJC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:59.272506] [INFO ] [MAIN ] SOJC: Generated 1807 derivative records from 5199 primary records. [2025-09-18T22:57:59.272966] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-09-18T22:57:59.296491] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1807 records). [2025-09-18T22:57:59.297543] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-09-18T22:57:59.299737] [INFO ] [MAIN ] Derivative Progress: 1687/2075 symbols completed. SOJC took 1.1s. Estimated remaining: 2m 30s. Rate: 154.7 symbols/min [2025-09-18T22:57:59.300179] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:59.321986] [DEBUG] [MAIN ] SOJD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:59.339930] [DEBUG] [MAIN ] SOJE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:59.340932] [INFO ] [MAIN ] SOJE: Generated 1807 derivative records from 9537 primary records. [2025-09-18T22:57:59.341018] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-09-18T22:57:59.342403] [INFO ] [MAIN ] SOJD: Generated 1807 derivative records from 13089 primary records. [2025-09-18T22:57:59.342729] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-09-18T22:57:59.357182] [DEBUG] [LOCAL ] SOL: Loaded 13829 existing records from primary storage. [2025-09-18T22:57:59.368799] [INFO ] [MAIN ] SOL: Loaded 13829 primary data records. [2025-09-18T22:57:59.435635] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1807 records). [2025-09-18T22:57:59.445602] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-09-18T22:57:59.460480] [INFO ] [MAIN ] Derivative Progress: 1688/2075 symbols completed. SOJE took 1.1s. Estimated remaining: 2m 30s. Rate: 154.7 symbols/min [2025-09-18T22:57:59.471754] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:59.487870] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1807 records). [2025-09-18T22:57:59.491730] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-09-18T22:57:59.494078] [INFO ] [MAIN ] Derivative Progress: 1689/2075 symbols completed. SOJD took 1.3s. Estimated remaining: 2m 30s. Rate: 154.8 symbols/min [2025-09-18T22:57:59.500072] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:59.736403] [DEBUG] [MAIN ] SOL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:57:59.737165] [INFO ] [MAIN ] SOL: Generated 1807 derivative records from 13829 primary records. [2025-09-18T22:57:59.737300] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-09-18T22:57:59.774669] [DEBUG] [LOCAL ] SOL: Derivative data saved (1807 records). [2025-09-18T22:57:59.775416] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-09-18T22:57:59.776433] [DEBUG] [LOCAL ] SOLV: Loaded 44615 existing records from primary storage. [2025-09-18T22:57:59.789530] [INFO ] [MAIN ] Derivative Progress: 1690/2075 symbols completed. SOL took 0.5s. Estimated remaining: 2m 29s. Rate: 154.9 symbols/min [2025-09-18T22:57:59.790809] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:57:59.791026] [INFO ] [MAIN ] SOLV: Loaded 44615 primary data records. [2025-09-18T22:57:59.791970] [DEBUG] [LOCAL ] SON: Loaded 43197 existing records from primary storage. [2025-09-18T22:57:59.792140] [INFO ] [MAIN ] SON: Loaded 43197 primary data records. [2025-09-18T22:58:00.491098] [DEBUG] [LOCAL ] SONY: Loaded 53752 existing records from primary storage. [2025-09-18T22:58:00.493090] [INFO ] [MAIN ] SONY: Loaded 53752 primary data records. [2025-09-18T22:58:00.851995] [DEBUG] [MAIN ] SOLV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:00.853604] [INFO ] [MAIN ] SOLV: Generated 1807 derivative records from 44615 primary records. [2025-09-18T22:58:00.861280] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-09-18T22:58:00.866862] [DEBUG] [MAIN ] SON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:00.867735] [INFO ] [MAIN ] SON: Generated 1807 derivative records from 43197 primary records. [2025-09-18T22:58:00.868045] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-09-18T22:58:00.899097] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1807 records). [2025-09-18T22:58:00.900602] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-09-18T22:58:00.903288] [INFO ] [MAIN ] Derivative Progress: 1691/2075 symbols completed. SOLV took 1.4s. Estimated remaining: 2m 29s. Rate: 154.7 symbols/min [2025-09-18T22:58:00.904074] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:00.905878] [DEBUG] [LOCAL ] SON: Derivative data saved (1807 records). [2025-09-18T22:58:00.907950] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-09-18T22:58:00.910510] [INFO ] [MAIN ] Derivative Progress: 1692/2075 symbols completed. SON took 1.4s. Estimated remaining: 2m 28s. Rate: 154.8 symbols/min [2025-09-18T22:58:00.911138] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:00.928016] [DEBUG] [LOCAL ] SOR: Loaded 3003 existing records from primary storage. [2025-09-18T22:58:00.927822] [DEBUG] [MAIN ] SONY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:00.928818] [INFO ] [MAIN ] SONY: Generated 1807 derivative records from 53752 primary records. [2025-09-18T22:58:00.929006] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-09-18T22:58:00.928943] [INFO ] [MAIN ] SOR: Loaded 3003 primary data records. [2025-09-18T22:58:01.008189] [DEBUG] [LOCAL ] SOS: Loaded 7525 existing records from primary storage. [2025-09-18T22:58:01.030098] [INFO ] [MAIN ] SOS: Loaded 7525 primary data records. [2025-09-18T22:58:01.209963] [DEBUG] [LOCAL ] SONY: Derivative data saved (1807 records). [2025-09-18T22:58:01.246082] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-09-18T22:58:01.436320] [INFO ] [MAIN ] Derivative Progress: 1693/2075 symbols completed. SONY took 1.6s. Estimated remaining: 2m 28s. Rate: 154.7 symbols/min [2025-09-18T22:58:01.646862] [DEBUG] [MAIN ] SOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:01.647887] [INFO ] [MAIN ] SOR: Generated 1807 derivative records from 3003 primary records. [2025-09-18T22:58:01.648106] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-09-18T22:58:01.665429] [DEBUG] [LOCAL ] SOR: Derivative data saved (1807 records). [2025-09-18T22:58:01.667114] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-09-18T22:58:01.669338] [INFO ] [MAIN ] Derivative Progress: 1694/2075 symbols completed. SOR took 0.8s. Estimated remaining: 2m 28s. Rate: 154.8 symbols/min [2025-09-18T22:58:01.682440] [DEBUG] [MAIN ] SOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:01.683134] [INFO ] [MAIN ] SOS: Generated 1807 derivative records from 7525 primary records. [2025-09-18T22:58:01.683198] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-09-18T22:58:01.697180] [DEBUG] [LOCAL ] SOS: Derivative data saved (1807 records). [2025-09-18T22:58:01.697286] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-09-18T22:58:01.699800] [INFO ] [MAIN ] Derivative Progress: 1695/2075 symbols completed. SOS took 0.8s. Estimated remaining: 2m 27s. Rate: 154.9 symbols/min [2025-09-18T22:58:01.700688] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:01.700590] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:01.700751] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:01.719165] [DEBUG] [LOCAL ] SPE: Loaded 6451 existing records from primary storage. [2025-09-18T22:58:01.719323] [INFO ] [MAIN ] SPE: Loaded 6451 primary data records. [2025-09-18T22:58:02.093332] [DEBUG] [LOCAL ] SPB: Loaded 34447 existing records from primary storage. [2025-09-18T22:58:02.093849] [INFO ] [MAIN ] SPB: Loaded 34447 primary data records. [2025-09-18T22:58:02.179118] [DEBUG] [LOCAL ] SPCE: Loaded 50170 existing records from primary storage. [2025-09-18T22:58:02.184923] [INFO ] [MAIN ] SPCE: Loaded 50170 primary data records. [2025-09-18T22:58:02.749495] [DEBUG] [MAIN ] SPE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:02.750501] [INFO ] [MAIN ] SPE: Generated 1807 derivative records from 6451 primary records. [2025-09-18T22:58:02.750835] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-09-18T22:58:02.770584] [DEBUG] [LOCAL ] SPE: Derivative data saved (1807 records). [2025-09-18T22:58:02.770969] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-09-18T22:58:02.774056] [INFO ] [MAIN ] Derivative Progress: 1696/2075 symbols completed. SPE took 1.1s. Estimated remaining: 2m 27s. Rate: 154.7 symbols/min [2025-09-18T22:58:02.775704] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:02.791496] [DEBUG] [MAIN ] SPB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:02.794312] [INFO ] [MAIN ] SPB: Generated 1807 derivative records from 34447 primary records. [2025-09-18T22:58:02.795280] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-09-18T22:58:02.824782] [DEBUG] [LOCAL ] SPB: Derivative data saved (1807 records). [2025-09-18T22:58:02.825543] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-09-18T22:58:02.825341] [DEBUG] [MAIN ] SPCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:02.827741] [INFO ] [MAIN ] Derivative Progress: 1697/2075 symbols completed. SPB took 1.1s. Estimated remaining: 2m 27s. Rate: 154.8 symbols/min [2025-09-18T22:58:02.828730] [INFO ] [MAIN ] SPCE: Generated 1807 derivative records from 50170 primary records. [2025-09-18T22:58:02.828933] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-09-18T22:58:02.829628] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:02.847252] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1807 records). [2025-09-18T22:58:02.847503] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-09-18T22:58:02.849938] [INFO ] [MAIN ] Derivative Progress: 1698/2075 symbols completed. SPCE took 1.1s. Estimated remaining: 2m 26s. Rate: 154.9 symbols/min [2025-09-18T22:58:02.850378] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:02.899724] [DEBUG] [LOCAL ] SPH: Loaded 18652 existing records from primary storage. [2025-09-18T22:58:02.899916] [INFO ] [MAIN ] SPH: Loaded 18652 primary data records. [2025-09-18T22:58:02.950260] [DEBUG] [LOCAL ] SPGI: Loaded 46192 existing records from primary storage. [2025-09-18T22:58:02.969775] [INFO ] [MAIN ] SPGI: Loaded 46192 primary data records. [2025-09-18T22:58:03.058880] [DEBUG] [LOCAL ] SPG: Loaded 50828 existing records from primary storage. [2025-09-18T22:58:03.114305] [INFO ] [MAIN ] SPG: Loaded 50828 primary data records. [2025-09-18T22:58:03.939703] [DEBUG] [MAIN ] SPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:03.953476] [INFO ] [MAIN ] SPH: Generated 1807 derivative records from 18652 primary records. [2025-09-18T22:58:03.953869] [DEBUG] [MAIN ] SPGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:03.954809] [INFO ] [MAIN ] SPGI: Generated 1807 derivative records from 46192 primary records. [2025-09-18T22:58:03.955262] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-09-18T22:58:03.955153] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-09-18T22:58:04.000860] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1807 records). [2025-09-18T22:58:04.002471] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-09-18T22:58:04.005942] [INFO ] [MAIN ] Derivative Progress: 1699/2075 symbols completed. SPGI took 1.2s. Estimated remaining: 2m 26s. Rate: 154.7 symbols/min [2025-09-18T22:58:04.007210] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:04.006709] [DEBUG] [MAIN ] SPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:04.007824] [DEBUG] [LOCAL ] SPH: Derivative data saved (1807 records). [2025-09-18T22:58:04.008404] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-09-18T22:58:04.010482] [INFO ] [MAIN ] Derivative Progress: 1700/2075 symbols completed. SPH took 1.2s. Estimated remaining: 2m 25s. Rate: 154.8 symbols/min [2025-09-18T22:58:04.011344] [INFO ] [MAIN ] SPG: Generated 1807 derivative records from 50828 primary records. [2025-09-18T22:58:04.011835] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:04.011952] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-09-18T22:58:04.030906] [DEBUG] [LOCAL ] SPG: Derivative data saved (1807 records). [2025-09-18T22:58:04.031111] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-09-18T22:58:04.038020] [INFO ] [MAIN ] Derivative Progress: 1701/2075 symbols completed. SPG took 1.3s. Estimated remaining: 2m 25s. Rate: 154.9 symbols/min [2025-09-18T22:58:04.041930] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:04.069194] [DEBUG] [LOCAL ] SPMC: Loaded 5759 existing records from primary storage. [2025-09-18T22:58:04.069409] [INFO ] [MAIN ] SPMC: Loaded 5759 primary data records. [2025-09-18T22:58:04.178169] [DEBUG] [LOCAL ] SPIR: Loaded 37819 existing records from primary storage. [2025-09-18T22:58:04.199998] [INFO ] [MAIN ] SPIR: Loaded 37819 primary data records. [2025-09-18T22:58:04.227006] [DEBUG] [LOCAL ] SPHR: Loaded 40490 existing records from primary storage. [2025-09-18T22:58:04.271428] [INFO ] [MAIN ] SPHR: Loaded 40490 primary data records. [2025-09-18T22:58:05.048412] [DEBUG] [MAIN ] SPMC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:58:05.049496] [INFO ] [MAIN ] SPMC: Generated 1806 derivative records from 5759 primary records. [2025-09-18T22:58:05.049809] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-09-18T22:58:05.097551] [DEBUG] [MAIN ] SPIR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:05.097269] [DEBUG] [MAIN ] SPHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:05.096981] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1806 records). [2025-09-18T22:58:05.098403] [INFO ] [MAIN ] SPIR: Generated 1807 derivative records from 37819 primary records. [2025-09-18T22:58:05.099148] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-09-18T22:58:05.101194] [INFO ] [MAIN ] Derivative Progress: 1702/2075 symbols completed. SPMC took 1.1s. Estimated remaining: 2m 25s. Rate: 154.7 symbols/min [2025-09-18T22:58:05.099193] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-09-18T22:58:05.101558] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:05.099080] [INFO ] [MAIN ] SPHR: Generated 1807 derivative records from 40490 primary records. [2025-09-18T22:58:05.101758] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-09-18T22:58:05.132492] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1807 records). [2025-09-18T22:58:05.133162] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-09-18T22:58:05.136244] [INFO ] [MAIN ] Derivative Progress: 1703/2075 symbols completed. SPHR took 1.1s. Estimated remaining: 2m 24s. Rate: 154.8 symbols/min [2025-09-18T22:58:05.138171] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:05.140064] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1807 records). [2025-09-18T22:58:05.140541] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-09-18T22:58:05.143014] [INFO ] [MAIN ] Derivative Progress: 1704/2075 symbols completed. SPIR took 1.1s. Estimated remaining: 2m 24s. Rate: 154.9 symbols/min [2025-09-18T22:58:05.143595] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:05.169236] [DEBUG] [LOCAL ] SPNT: Loaded 35016 existing records from primary storage. [2025-09-18T22:58:05.169493] [INFO ] [MAIN ] SPNT: Loaded 35016 primary data records. [2025-09-18T22:58:05.390036] [DEBUG] [LOCAL ] SPR: Loaded 41763 existing records from primary storage. [2025-09-18T22:58:05.531603] [INFO ] [MAIN ] SPR: Loaded 41763 primary data records. [2025-09-18T22:58:05.558330] [DEBUG] [LOCAL ] SPOT: Loaded 51433 existing records from primary storage. [2025-09-18T22:58:05.580548] [INFO ] [MAIN ] SPOT: Loaded 51433 primary data records. [2025-09-18T22:58:06.201886] [DEBUG] [MAIN ] SPNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:06.203506] [INFO ] [MAIN ] SPNT: Generated 1807 derivative records from 35016 primary records. [2025-09-18T22:58:06.204420] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-09-18T22:58:06.227260] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1807 records). [2025-09-18T22:58:06.228451] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-09-18T22:58:06.231397] [INFO ] [MAIN ] Derivative Progress: 1705/2075 symbols completed. SPNT took 1.1s. Estimated remaining: 2m 23s. Rate: 154.7 symbols/min [2025-09-18T22:58:06.231906] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:06.245472] [DEBUG] [MAIN ] SPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:06.258984] [INFO ] [MAIN ] SPR: Generated 1807 derivative records from 41763 primary records. [2025-09-18T22:58:06.259389] [DEBUG] [MAIN ] SPOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:06.259528] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-09-18T22:58:06.260393] [INFO ] [MAIN ] SPOT: Generated 1807 derivative records from 51433 primary records. [2025-09-18T22:58:06.261328] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-09-18T22:58:06.292096] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1807 records). [2025-09-18T22:58:06.298148] [DEBUG] [LOCAL ] SPRU: Loaded 8414 existing records from primary storage. [2025-09-18T22:58:06.298279] [INFO ] [MAIN ] SPRU: Loaded 8414 primary data records. [2025-09-18T22:58:06.292909] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-09-18T22:58:06.312345] [INFO ] [MAIN ] Derivative Progress: 1706/2075 symbols completed. SPOT took 1.2s. Estimated remaining: 2m 23s. Rate: 154.8 symbols/min [2025-09-18T22:58:06.322685] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:06.337081] [DEBUG] [LOCAL ] SPR: Derivative data saved (1807 records). [2025-09-18T22:58:06.357842] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-09-18T22:58:06.374052] [INFO ] [MAIN ] Derivative Progress: 1707/2075 symbols completed. SPR took 1.2s. Estimated remaining: 2m 23s. Rate: 154.9 symbols/min [2025-09-18T22:58:06.391937] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:06.634533] [DEBUG] [LOCAL ] SPXC: Loaded 23627 existing records from primary storage. [2025-09-18T22:58:06.633819] [DEBUG] [LOCAL ] SPXX: Loaded 9084 existing records from primary storage. [2025-09-18T22:58:06.634880] [INFO ] [MAIN ] SPXX: Loaded 9084 primary data records. [2025-09-18T22:58:06.634978] [INFO ] [MAIN ] SPXC: Loaded 23627 primary data records. [2025-09-18T22:58:07.302107] [DEBUG] [MAIN ] SPRU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:07.303171] [INFO ] [MAIN ] SPRU: Generated 1807 derivative records from 8414 primary records. [2025-09-18T22:58:07.303589] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-09-18T22:58:07.323634] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1807 records). [2025-09-18T22:58:07.324018] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-09-18T22:58:07.326229] [INFO ] [MAIN ] Derivative Progress: 1708/2075 symbols completed. SPRU took 1.1s. Estimated remaining: 2m 22s. Rate: 154.7 symbols/min [2025-09-18T22:58:07.343673] [DEBUG] [MAIN ] SPXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:07.356101] [INFO ] [MAIN ] SPXC: Generated 1807 derivative records from 23627 primary records. [2025-09-18T22:58:07.356272] [DEBUG] [MAIN ] SPXX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:07.357026] [INFO ] [MAIN ] SPXX: Generated 1807 derivative records from 9084 primary records. [2025-09-18T22:58:07.357084] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-09-18T22:58:07.357226] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-09-18T22:58:07.385430] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1807 records). [2025-09-18T22:58:07.385746] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-09-18T22:58:07.388173] [INFO ] [MAIN ] Derivative Progress: 1709/2075 symbols completed. SPXC took 1.1s. Estimated remaining: 2m 22s. Rate: 154.8 symbols/min [2025-09-18T22:58:07.390348] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1807 records). [2025-09-18T22:58:07.390415] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-09-18T22:58:07.393085] [INFO ] [MAIN ] Derivative Progress: 1710/2075 symbols completed. SPXX took 1.0s. Estimated remaining: 2m 21s. Rate: 154.9 symbols/min [2025-09-18T22:58:07.393612] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:07.393719] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:07.393907] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:07.435837] [DEBUG] [LOCAL ] SQNS: Loaded 25398 existing records from primary storage. [2025-09-18T22:58:07.436062] [INFO ] [MAIN ] SQNS: Loaded 25398 primary data records. [2025-09-18T22:58:07.563405] [DEBUG] [LOCAL ] SR: Loaded 32904 existing records from primary storage. [2025-09-18T22:58:07.563582] [INFO ] [MAIN ] SR: Loaded 32904 primary data records. [2025-09-18T22:58:07.732781] [DEBUG] [LOCAL ] SQM: Loaded 49038 existing records from primary storage. [2025-09-18T22:58:07.847906] [INFO ] [MAIN ] SQM: Loaded 49038 primary data records. [2025-09-18T22:58:08.427171] [DEBUG] [MAIN ] SQNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:08.428280] [INFO ] [MAIN ] SQNS: Generated 1807 derivative records from 25398 primary records. [2025-09-18T22:58:08.428598] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-09-18T22:58:08.454907] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1807 records). [2025-09-18T22:58:08.455676] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-09-18T22:58:08.458561] [INFO ] [MAIN ] Derivative Progress: 1711/2075 symbols completed. SQNS took 1.1s. Estimated remaining: 2m 21s. Rate: 154.7 symbols/min [2025-09-18T22:58:08.460464] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:08.476717] [DEBUG] [MAIN ] SR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:08.480198] [INFO ] [MAIN ] SR: Generated 1807 derivative records from 32904 primary records. [2025-09-18T22:58:08.480412] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-09-18T22:58:08.505870] [DEBUG] [MAIN ] SQM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:08.507168] [INFO ] [MAIN ] SQM: Generated 1807 derivative records from 49038 primary records. [2025-09-18T22:58:08.507474] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-09-18T22:58:08.526292] [DEBUG] [LOCAL ] SR: Derivative data saved (1807 records). [2025-09-18T22:58:08.527756] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-09-18T22:58:08.530727] [INFO ] [MAIN ] Derivative Progress: 1712/2075 symbols completed. SR took 1.1s. Estimated remaining: 2m 21s. Rate: 154.8 symbols/min [2025-09-18T22:58:08.530935] [DEBUG] [LOCAL ] SQM: Derivative data saved (1807 records). [2025-09-18T22:58:08.531031] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-09-18T22:58:08.531280] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:08.533822] [INFO ] [MAIN ] Derivative Progress: 1713/2075 symbols completed. SQM took 1.1s. Estimated remaining: 2m 20s. Rate: 154.9 symbols/min [2025-09-18T22:58:08.534602] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:08.564379] [DEBUG] [LOCAL ] SREA: Loaded 10496 existing records from primary storage. [2025-09-18T22:58:08.564614] [INFO ] [MAIN ] SREA: Loaded 10496 primary data records. [2025-09-18T22:58:08.695577] [DEBUG] [LOCAL ] SRE: Loaded 53812 existing records from primary storage. [2025-09-18T22:58:08.732389] [DEBUG] [LOCAL ] SRFM: Loaded 35211 existing records from primary storage. [2025-09-18T22:58:08.731861] [INFO ] [MAIN ] SRE: Loaded 53812 primary data records. [2025-09-18T22:58:08.760912] [INFO ] [MAIN ] SRFM: Loaded 35211 primary data records. [2025-09-18T22:58:09.731940] [DEBUG] [MAIN ] SREA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:09.735811] [INFO ] [MAIN ] SREA: Generated 1807 derivative records from 10496 primary records. [2025-09-18T22:58:09.738102] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-09-18T22:58:09.770893] [DEBUG] [LOCAL ] SREA: Derivative data saved (1807 records). [2025-09-18T22:58:09.771316] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-09-18T22:58:09.774346] [INFO ] [MAIN ] Derivative Progress: 1714/2075 symbols completed. SREA took 1.2s. Estimated remaining: 2m 20s. Rate: 154.7 symbols/min [2025-09-18T22:58:09.775346] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:09.816751] [DEBUG] [MAIN ] SRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:09.818456] [INFO ] [MAIN ] SRE: Generated 1807 derivative records from 53812 primary records. [2025-09-18T22:58:09.819148] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-09-18T22:58:09.831846] [DEBUG] [LOCAL ] SRG: Loaded 16295 existing records from primary storage. [2025-09-18T22:58:09.847333] [INFO ] [MAIN ] SRG: Loaded 16295 primary data records. [2025-09-18T22:58:09.861986] [DEBUG] [LOCAL ] SRE: Derivative data saved (1807 records). [2025-09-18T22:58:09.904297] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-09-18T22:58:09.922924] [INFO ] [MAIN ] Derivative Progress: 1715/2075 symbols completed. SRE took 1.5s. Estimated remaining: 2m 20s. Rate: 154.8 symbols/min [2025-09-18T22:58:09.961024] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:09.975012] [DEBUG] [MAIN ] SRFM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:10.006427] [INFO ] [MAIN ] SRFM: Generated 1807 derivative records from 35211 primary records. [2025-09-18T22:58:10.006709] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-09-18T22:58:10.300943] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1807 records). [2025-09-18T22:58:10.301227] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-09-18T22:58:10.304290] [INFO ] [MAIN ] Derivative Progress: 1716/2075 symbols completed. SRFM took 1.8s. Estimated remaining: 2m 19s. Rate: 154.8 symbols/min [2025-09-18T22:58:10.305809] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:10.327059] [DEBUG] [LOCAL ] SRI: Loaded 28249 existing records from primary storage. [2025-09-18T22:58:10.330013] [INFO ] [MAIN ] SRI: Loaded 28249 primary data records. [2025-09-18T22:58:10.399130] [DEBUG] [LOCAL ] SRV: Loaded 7846 existing records from primary storage. [2025-09-18T22:58:10.442859] [INFO ] [MAIN ] SRV: Loaded 7846 primary data records. [2025-09-18T22:58:10.902239] [DEBUG] [MAIN ] SRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:10.907590] [INFO ] [MAIN ] SRG: Generated 1807 derivative records from 16295 primary records. [2025-09-18T22:58:11.025718] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-09-18T22:58:11.051181] [DEBUG] [LOCAL ] SRG: Derivative data saved (1807 records). [2025-09-18T22:58:11.052337] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-09-18T22:58:11.056534] [INFO ] [MAIN ] Derivative Progress: 1717/2075 symbols completed. SRG took 1.3s. Estimated remaining: 2m 19s. Rate: 154.7 symbols/min [2025-09-18T22:58:11.057418] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:11.071036] [DEBUG] [MAIN ] SRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:11.071970] [INFO ] [MAIN ] SRI: Generated 1807 derivative records from 28249 primary records. [2025-09-18T22:58:11.072314] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-09-18T22:58:11.090815] [DEBUG] [LOCAL ] SRI: Derivative data saved (1807 records). [2025-09-18T22:58:11.091124] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-09-18T22:58:11.093689] [INFO ] [MAIN ] Derivative Progress: 1718/2075 symbols completed. SRI took 1.1s. Estimated remaining: 2m 18s. Rate: 154.7 symbols/min [2025-09-18T22:58:11.094214] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:11.109000] [DEBUG] [MAIN ] SRV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:11.110270] [INFO ] [MAIN ] SRV: Generated 1807 derivative records from 7846 primary records. [2025-09-18T22:58:11.110483] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-09-18T22:58:11.136247] [DEBUG] [LOCAL ] SRV: Derivative data saved (1807 records). [2025-09-18T22:58:11.152555] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-09-18T22:58:11.152468] [DEBUG] [LOCAL ] SSD: Loaded 22625 existing records from primary storage. [2025-09-18T22:58:11.155389] [INFO ] [MAIN ] SSD: Loaded 22625 primary data records. [2025-09-18T22:58:11.155302] [INFO ] [MAIN ] Derivative Progress: 1719/2075 symbols completed. SRV took 0.8s. Estimated remaining: 2m 18s. Rate: 154.8 symbols/min [2025-09-18T22:58:11.177289] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:11.285448] [DEBUG] [LOCAL ] SSB: Loaded 43282 existing records from primary storage. [2025-09-18T22:58:11.301042] [INFO ] [MAIN ] SSB: Loaded 43282 primary data records. [2025-09-18T22:58:11.717903] [DEBUG] [LOCAL ] SSL: Loaded 41419 existing records from primary storage. [2025-09-18T22:58:11.831409] [INFO ] [MAIN ] SSL: Loaded 41419 primary data records. [2025-09-18T22:58:12.165503] [DEBUG] [MAIN ] SSD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:12.166559] [INFO ] [MAIN ] SSD: Generated 1807 derivative records from 22625 primary records. [2025-09-18T22:58:12.167479] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-09-18T22:58:12.185931] [DEBUG] [LOCAL ] SSD: Derivative data saved (1807 records). [2025-09-18T22:58:12.187671] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-09-18T22:58:12.189800] [INFO ] [MAIN ] Derivative Progress: 1720/2075 symbols completed. SSD took 1.1s. Estimated remaining: 2m 18s. Rate: 154.7 symbols/min [2025-09-18T22:58:12.190371] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:12.206764] [DEBUG] [MAIN ] SSB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:12.207803] [INFO ] [MAIN ] SSB: Generated 1807 derivative records from 43282 primary records. [2025-09-18T22:58:12.207983] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-09-18T22:58:12.230869] [DEBUG] [LOCAL ] SST: Loaded 12511 existing records from primary storage. [2025-09-18T22:58:12.231322] [INFO ] [MAIN ] SST: Loaded 12511 primary data records. [2025-09-18T22:58:12.319931] [DEBUG] [LOCAL ] SSB: Derivative data saved (1807 records). [2025-09-18T22:58:12.361710] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-09-18T22:58:12.370014] [INFO ] [MAIN ] Derivative Progress: 1721/2075 symbols completed. SSB took 1.3s. Estimated remaining: 2m 17s. Rate: 154.7 symbols/min [2025-09-18T22:58:12.392587] [DEBUG] [MAIN ] SSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:12.441552] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:12.448353] [INFO ] [MAIN ] SSL: Generated 1807 derivative records from 41419 primary records. [2025-09-18T22:58:12.448882] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-09-18T22:58:12.602687] [DEBUG] [LOCAL ] SSL: Derivative data saved (1807 records). [2025-09-18T22:58:12.602901] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-09-18T22:58:12.605582] [INFO ] [MAIN ] Derivative Progress: 1722/2075 symbols completed. SSL took 1.4s. Estimated remaining: 2m 17s. Rate: 154.8 symbols/min [2025-09-18T22:58:12.606432] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:12.646280] [DEBUG] [MAIN ] SST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:12.647014] [DEBUG] [LOCAL ] SSTK: Loaded 27288 existing records from primary storage. [2025-09-18T22:58:12.648202] [INFO ] [MAIN ] SST: Generated 1807 derivative records from 12511 primary records. [2025-09-18T22:58:12.648462] [INFO ] [MAIN ] SSTK: Loaded 27288 primary data records. [2025-09-18T22:58:12.648531] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-09-18T22:58:12.843871] [DEBUG] [LOCAL ] SST: Derivative data saved (1807 records). [2025-09-18T22:58:12.854860] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-09-18T22:58:12.866783] [DEBUG] [LOCAL ] ST: Loaded 50255 existing records from primary storage. [2025-09-18T22:58:12.869682] [INFO ] [MAIN ] ST: Loaded 50255 primary data records. [2025-09-18T22:58:12.869518] [INFO ] [MAIN ] Derivative Progress: 1723/2075 symbols completed. SST took 0.7s. Estimated remaining: 2m 16s. Rate: 154.8 symbols/min [2025-09-18T22:58:13.335740] [DEBUG] [MAIN ] SSTK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:13.336541] [INFO ] [MAIN ] SSTK: Generated 1807 derivative records from 27288 primary records. [2025-09-18T22:58:13.336907] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-09-18T22:58:13.355215] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1807 records). [2025-09-18T22:58:13.356059] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-09-18T22:58:13.358191] [INFO ] [MAIN ] Derivative Progress: 1724/2075 symbols completed. SSTK took 0.9s. Estimated remaining: 2m 16s. Rate: 154.8 symbols/min [2025-09-18T22:58:13.371137] [DEBUG] [MAIN ] ST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:13.371874] [INFO ] [MAIN ] ST: Generated 1807 derivative records from 50255 primary records. [2025-09-18T22:58:13.371939] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-09-18T22:58:13.388519] [DEBUG] [LOCAL ] ST: Derivative data saved (1807 records). [2025-09-18T22:58:13.388602] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-09-18T22:58:13.390837] [INFO ] [MAIN ] Derivative Progress: 1725/2075 symbols completed. ST took 0.8s. Estimated remaining: 2m 16s. Rate: 154.8 symbols/min [2025-09-18T22:58:13.391810] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:13.391902] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:13.391690] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:13.417443] [DEBUG] [LOCAL ] STC: Loaded 18054 existing records from primary storage. [2025-09-18T22:58:13.417584] [INFO ] [MAIN ] STC: Loaded 18054 primary data records. [2025-09-18T22:58:13.564146] [DEBUG] [LOCAL ] STE: Loaded 35784 existing records from primary storage. [2025-09-18T22:58:13.575540] [INFO ] [MAIN ] STE: Loaded 35784 primary data records. [2025-09-18T22:58:13.887610] [DEBUG] [LOCAL ] STAG: Loaded 50407 existing records from primary storage. [2025-09-18T22:58:13.905464] [INFO ] [MAIN ] STAG: Loaded 50407 primary data records. [2025-09-18T22:58:14.476141] [DEBUG] [MAIN ] STC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:14.479687] [INFO ] [MAIN ] STC: Generated 1807 derivative records from 18054 primary records. [2025-09-18T22:58:14.479897] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-09-18T22:58:14.512162] [DEBUG] [MAIN ] STE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:14.514621] [INFO ] [MAIN ] STE: Generated 1807 derivative records from 35784 primary records. [2025-09-18T22:58:14.515314] [DEBUG] [LOCAL ] STC: Derivative data saved (1807 records). [2025-09-18T22:58:14.515569] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-09-18T22:58:14.518272] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-09-18T22:58:14.518197] [INFO ] [MAIN ] Derivative Progress: 1726/2075 symbols completed. STC took 1.1s. Estimated remaining: 2m 15s. Rate: 154.7 symbols/min [2025-09-18T22:58:14.519452] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:14.538270] [DEBUG] [LOCAL ] STE: Derivative data saved (1807 records). [2025-09-18T22:58:14.538617] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-09-18T22:58:14.548711] [INFO ] [MAIN ] Derivative Progress: 1727/2075 symbols completed. STE took 1.2s. Estimated remaining: 2m 15s. Rate: 154.8 symbols/min [2025-09-18T22:58:14.554203] [DEBUG] [MAIN ] STAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:14.554316] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:14.555180] [INFO ] [MAIN ] STAG: Generated 1807 derivative records from 50407 primary records. [2025-09-18T22:58:14.555390] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-09-18T22:58:14.577714] [DEBUG] [LOCAL ] STAG: Derivative data saved (1807 records). [2025-09-18T22:58:14.577840] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-09-18T22:58:14.580253] [INFO ] [MAIN ] Derivative Progress: 1728/2075 symbols completed. STAG took 1.2s. Estimated remaining: 2m 14s. Rate: 154.8 symbols/min [2025-09-18T22:58:14.580677] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:14.590807] [DEBUG] [LOCAL ] STEL: Loaded 24014 existing records from primary storage. [2025-09-18T22:58:14.590988] [INFO ] [MAIN ] STEL: Loaded 24014 primary data records. [2025-09-18T22:58:14.719831] [DEBUG] [LOCAL ] STEW: Loaded 16546 existing records from primary storage. [2025-09-18T22:58:14.736556] [INFO ] [MAIN ] STEW: Loaded 16546 primary data records. [2025-09-18T22:58:14.860496] [DEBUG] [LOCAL ] STEM: Loaded 40575 existing records from primary storage. [2025-09-18T22:58:15.030690] [INFO ] [MAIN ] STEM: Loaded 40575 primary data records. [2025-09-18T22:58:15.624269] [DEBUG] [MAIN ] STEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:15.625903] [INFO ] [MAIN ] STEL: Generated 1807 derivative records from 24014 primary records. [2025-09-18T22:58:15.626011] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-09-18T22:58:15.649393] [DEBUG] [LOCAL ] STEL: Derivative data saved (1807 records). [2025-09-18T22:58:15.649635] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-09-18T22:58:15.651868] [INFO ] [MAIN ] Derivative Progress: 1729/2075 symbols completed. STEL took 1.1s. Estimated remaining: 2m 14s. Rate: 154.7 symbols/min [2025-09-18T22:58:15.660127] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:15.665715] [DEBUG] [MAIN ] STEW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:15.666846] [INFO ] [MAIN ] STEW: Generated 1807 derivative records from 16546 primary records. [2025-09-18T22:58:15.668997] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-09-18T22:58:15.701362] [DEBUG] [LOCAL ] STEW: Derivative data saved (1807 records). [2025-09-18T22:58:15.701689] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-09-18T22:58:15.704197] [INFO ] [MAIN ] Derivative Progress: 1730/2075 symbols completed. STEW took 1.1s. Estimated remaining: 2m 14s. Rate: 154.8 symbols/min [2025-09-18T22:58:15.700925] [DEBUG] [MAIN ] STEM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:15.708773] [INFO ] [MAIN ] STEM: Generated 1807 derivative records from 40575 primary records. [2025-09-18T22:58:15.709079] [DEBUG] [LOCAL ] STK: Loaded 9502 existing records from primary storage. [2025-09-18T22:58:15.709150] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-09-18T22:58:15.709462] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:15.710382] [INFO ] [MAIN ] STK: Loaded 9502 primary data records. [2025-09-18T22:58:15.763555] [DEBUG] [LOCAL ] STEM: Derivative data saved (1807 records). [2025-09-18T22:58:15.769963] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-09-18T22:58:15.786022] [INFO ] [MAIN ] Derivative Progress: 1731/2075 symbols completed. STEM took 1.2s. Estimated remaining: 2m 13s. Rate: 154.8 symbols/min [2025-09-18T22:58:15.801122] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:16.086177] [DEBUG] [LOCAL ] STLA: Loaded 53936 existing records from primary storage. [2025-09-18T22:58:16.086449] [INFO ] [MAIN ] STLA: Loaded 53936 primary data records. [2025-09-18T22:58:16.210770] [DEBUG] [LOCAL ] STM: Loaded 53979 existing records from primary storage. [2025-09-18T22:58:16.211266] [INFO ] [MAIN ] STM: Loaded 53979 primary data records. [2025-09-18T22:58:16.388344] [DEBUG] [MAIN ] STK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:16.525024] [INFO ] [MAIN ] STK: Generated 1807 derivative records from 9502 primary records. [2025-09-18T22:58:16.545574] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-09-18T22:58:16.764284] [DEBUG] [LOCAL ] STK: Derivative data saved (1807 records). [2025-09-18T22:58:16.764672] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-09-18T22:58:16.767234] [INFO ] [MAIN ] Derivative Progress: 1732/2075 symbols completed. STK took 1.1s. Estimated remaining: 2m 13s. Rate: 154.7 symbols/min [2025-09-18T22:58:16.767504] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:16.789915] [DEBUG] [MAIN ] STLA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:16.790695] [INFO ] [MAIN ] STLA: Generated 1807 derivative records from 53936 primary records. [2025-09-18T22:58:16.790992] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-09-18T22:58:16.815397] [DEBUG] [LOCAL ] STLA: Derivative data saved (1807 records). [2025-09-18T22:58:16.823728] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-09-18T22:58:16.825883] [INFO ] [MAIN ] Derivative Progress: 1733/2075 symbols completed. STLA took 1.1s. Estimated remaining: 2m 13s. Rate: 154.8 symbols/min [2025-09-18T22:58:16.826498] [DEBUG] [LOCAL ] STN: Loaded 23348 existing records from primary storage. [2025-09-18T22:58:16.839419] [INFO ] [MAIN ] STN: Loaded 23348 primary data records. [2025-09-18T22:58:16.839353] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:16.839742] [DEBUG] [MAIN ] STM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:16.872796] [INFO ] [MAIN ] STM: Generated 1807 derivative records from 53979 primary records. [2025-09-18T22:58:16.897862] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-09-18T22:58:17.175963] [DEBUG] [LOCAL ] STM: Derivative data saved (1807 records). [2025-09-18T22:58:17.177344] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-09-18T22:58:17.180062] [INFO ] [MAIN ] Derivative Progress: 1734/2075 symbols completed. STM took 1.4s. Estimated remaining: 2m 12s. Rate: 154.8 symbols/min [2025-09-18T22:58:17.180414] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:17.195898] [DEBUG] [LOCAL ] STNG: Loaded 44534 existing records from primary storage. [2025-09-18T22:58:17.197064] [INFO ] [MAIN ] STNG: Loaded 44534 primary data records. [2025-09-18T22:58:17.293392] [DEBUG] [LOCAL ] STRV: Loaded 11795 existing records from primary storage. [2025-09-18T22:58:17.323469] [INFO ] [MAIN ] STRV: Loaded 11795 primary data records. [2025-09-18T22:58:17.800394] [DEBUG] [MAIN ] STN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:17.911946] [INFO ] [MAIN ] STN: Generated 1807 derivative records from 23348 primary records. [2025-09-18T22:58:17.920505] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-09-18T22:58:17.940771] [DEBUG] [LOCAL ] STN: Derivative data saved (1807 records). [2025-09-18T22:58:17.941712] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-09-18T22:58:17.944194] [INFO ] [MAIN ] Derivative Progress: 1735/2075 symbols completed. STN took 1.2s. Estimated remaining: 2m 12s. Rate: 154.7 symbols/min [2025-09-18T22:58:17.944602] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:17.966616] [DEBUG] [MAIN ] STNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:17.968161] [INFO ] [MAIN ] STNG: Generated 1807 derivative records from 44534 primary records. [2025-09-18T22:58:17.970160] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-09-18T22:58:17.996198] [DEBUG] [MAIN ] STRV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:58:17.997241] [INFO ] [MAIN ] STRV: Generated 1806 derivative records from 11795 primary records. [2025-09-18T22:58:17.997633] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-09-18T22:58:18.027872] [DEBUG] [LOCAL ] STNG: Derivative data saved (1807 records). [2025-09-18T22:58:18.028523] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-09-18T22:58:18.031237] [INFO ] [MAIN ] Derivative Progress: 1736/2075 symbols completed. STNG took 1.2s. Estimated remaining: 2m 11s. Rate: 154.8 symbols/min [2025-09-18T22:58:18.031871] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:18.033808] [DEBUG] [LOCAL ] STRV: Derivative data saved (1806 records). [2025-09-18T22:58:18.033983] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-09-18T22:58:18.037056] [INFO ] [MAIN ] Derivative Progress: 1737/2075 symbols completed. STRV took 0.9s. Estimated remaining: 2m 11s. Rate: 154.8 symbols/min [2025-09-18T22:58:18.038242] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:18.053515] [DEBUG] [LOCAL ] STT: Loaded 51602 existing records from primary storage. [2025-09-18T22:58:18.053833] [INFO ] [MAIN ] STT: Loaded 51602 primary data records. [2025-09-18T22:58:18.237516] [DEBUG] [LOCAL ] STVN: Loaded 26785 existing records from primary storage. [2025-09-18T22:58:18.365556] [INFO ] [MAIN ] STVN: Loaded 26785 primary data records. [2025-09-18T22:58:18.538624] [DEBUG] [LOCAL ] STWD: Loaded 52277 existing records from primary storage. [2025-09-18T22:58:18.588464] [INFO ] [MAIN ] STWD: Loaded 52277 primary data records. [2025-09-18T22:58:19.067689] [DEBUG] [MAIN ] STT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:19.069231] [INFO ] [MAIN ] STT: Generated 1807 derivative records from 51602 primary records. [2025-09-18T22:58:19.069682] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-09-18T22:58:19.090436] [DEBUG] [LOCAL ] STT: Derivative data saved (1807 records). [2025-09-18T22:58:19.091089] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-09-18T22:58:19.093149] [INFO ] [MAIN ] Derivative Progress: 1738/2075 symbols completed. STT took 1.1s. Estimated remaining: 2m 11s. Rate: 154.7 symbols/min [2025-09-18T22:58:19.110119] [DEBUG] [MAIN ] STVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:19.110889] [INFO ] [MAIN ] STVN: Generated 1807 derivative records from 26785 primary records. [2025-09-18T22:58:19.111047] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-09-18T22:58:19.142586] [DEBUG] [LOCAL ] STVN: Derivative data saved (1807 records). [2025-09-18T22:58:19.142883] [DEBUG] [MAIN ] STWD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:19.143691] [INFO ] [MAIN ] STWD: Generated 1807 derivative records from 52277 primary records. [2025-09-18T22:58:19.143016] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-09-18T22:58:19.146050] [INFO ] [MAIN ] Derivative Progress: 1739/2075 symbols completed. STVN took 1.1s. Estimated remaining: 2m 10s. Rate: 154.8 symbols/min [2025-09-18T22:58:19.146160] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-09-18T22:58:19.162957] [DEBUG] [LOCAL ] STWD: Derivative data saved (1807 records). [2025-09-18T22:58:19.163022] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-09-18T22:58:19.165442] [INFO ] [MAIN ] Derivative Progress: 1740/2075 symbols completed. STWD took 1.1s. Estimated remaining: 2m 10s. Rate: 154.9 symbols/min [2025-09-18T22:58:19.166073] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:19.166022] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:19.166362] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:19.170964] [DEBUG] [LOCAL ] STXD: Loaded 1374 existing records from primary storage. [2025-09-18T22:58:19.171867] [INFO ] [MAIN ] STXD: Loaded 1374 primary data records. [2025-09-18T22:58:19.221816] [DEBUG] [LOCAL ] STXE: Loaded 2267 existing records from primary storage. [2025-09-18T22:58:19.220030] [DEBUG] [LOCAL ] STXG: Loaded 2693 existing records from primary storage. [2025-09-18T22:58:19.244089] [INFO ] [MAIN ] STXE: Loaded 2267 primary data records. [2025-09-18T22:58:19.255101] [INFO ] [MAIN ] STXG: Loaded 2693 primary data records. [2025-09-18T22:58:20.169202] [DEBUG] [MAIN ] STXE: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:58:20.170565] [DEBUG] [MAIN ] STXD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:58:20.171334] [INFO ] [MAIN ] STXE: Generated 1806 derivative records from 2267 primary records. [2025-09-18T22:58:20.171569] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-09-18T22:58:20.179777] [INFO ] [MAIN ] STXD: Generated 1806 derivative records from 1374 primary records. [2025-09-18T22:58:20.185411] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-09-18T22:58:20.185731] [DEBUG] [MAIN ] STXG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:58:20.187062] [INFO ] [MAIN ] STXG: Generated 1806 derivative records from 2693 primary records. [2025-09-18T22:58:20.187519] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-09-18T22:58:20.211450] [DEBUG] [LOCAL ] STXE: Derivative data saved (1806 records). [2025-09-18T22:58:20.222140] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-09-18T22:58:20.224698] [INFO ] [MAIN ] Derivative Progress: 1741/2075 symbols completed. STXE took 1.1s. Estimated remaining: 2m 10s. Rate: 154.7 symbols/min [2025-09-18T22:58:20.225552] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:20.229246] [DEBUG] [LOCAL ] STXD: Derivative data saved (1806 records). [2025-09-18T22:58:20.229904] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-09-18T22:58:20.232237] [INFO ] [MAIN ] Derivative Progress: 1742/2075 symbols completed. STXD took 1.1s. Estimated remaining: 2m 9s. Rate: 154.8 symbols/min [2025-09-18T22:58:20.232825] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:20.237498] [DEBUG] [LOCAL ] STXG: Derivative data saved (1806 records). [2025-09-18T22:58:20.237812] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-09-18T22:58:20.237665] [DEBUG] [LOCAL ] STXK: Loaded 1540 existing records from primary storage. [2025-09-18T22:58:20.237996] [INFO ] [MAIN ] STXK: Loaded 1540 primary data records. [2025-09-18T22:58:20.240489] [INFO ] [MAIN ] Derivative Progress: 1743/2075 symbols completed. STXG took 1.1s. Estimated remaining: 2m 9s. Rate: 154.9 symbols/min [2025-09-18T22:58:20.272801] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:20.309295] [DEBUG] [LOCAL ] STXT: Loaded 2644 existing records from primary storage. [2025-09-18T22:58:20.322703] [INFO ] [MAIN ] STXT: Loaded 2644 primary data records. [2025-09-18T22:58:20.473492] [DEBUG] [LOCAL ] STXV: Loaded 1704 existing records from primary storage. [2025-09-18T22:58:20.509843] [INFO ] [MAIN ] STXV: Loaded 1704 primary data records. [2025-09-18T22:58:21.214464] [DEBUG] [MAIN ] STXK: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:58:21.215668] [INFO ] [MAIN ] STXK: Generated 1806 derivative records from 1540 primary records. [2025-09-18T22:58:21.215886] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-09-18T22:58:21.214917] [DEBUG] [MAIN ] STXT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:58:21.217516] [INFO ] [MAIN ] STXT: Generated 1806 derivative records from 2644 primary records. [2025-09-18T22:58:21.217718] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-09-18T22:58:21.242603] [DEBUG] [LOCAL ] STXK: Derivative data saved (1806 records). [2025-09-18T22:58:21.245536] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-09-18T22:58:21.247858] [INFO ] [MAIN ] Derivative Progress: 1744/2075 symbols completed. STXK took 1.0s. Estimated remaining: 2m 8s. Rate: 154.7 symbols/min [2025-09-18T22:58:21.248812] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:21.259387] [DEBUG] [LOCAL ] STXT: Derivative data saved (1806 records). [2025-09-18T22:58:21.263703] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-09-18T22:58:21.266598] [INFO ] [MAIN ] Derivative Progress: 1745/2075 symbols completed. STXT took 1.0s. Estimated remaining: 2m 8s. Rate: 154.8 symbols/min [2025-09-18T22:58:21.267344] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:21.267045] [DEBUG] [MAIN ] STXV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:58:21.268390] [INFO ] [MAIN ] STXV: Generated 1806 derivative records from 1704 primary records. [2025-09-18T22:58:21.268953] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-09-18T22:58:21.283728] [DEBUG] [LOCAL ] STXV: Derivative data saved (1806 records). [2025-09-18T22:58:21.283910] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-09-18T22:58:21.286511] [INFO ] [MAIN ] Derivative Progress: 1746/2075 symbols completed. STXV took 1.0s. Estimated remaining: 2m 7s. Rate: 154.9 symbols/min [2025-09-18T22:58:21.286960] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:21.369008] [DEBUG] [LOCAL ] SU: Loaded 53850 existing records from primary storage. [2025-09-18T22:58:21.369226] [INFO ] [MAIN ] SU: Loaded 53850 primary data records. [2025-09-18T22:58:21.391777] [DEBUG] [LOCAL ] STZ: Loaded 52658 existing records from primary storage. [2025-09-18T22:58:21.414474] [INFO ] [MAIN ] STZ: Loaded 52658 primary data records. [2025-09-18T22:58:21.533164] [DEBUG] [LOCAL ] SUI: Loaded 42541 existing records from primary storage. [2025-09-18T22:58:21.571622] [INFO ] [MAIN ] SUI: Loaded 42541 primary data records. [2025-09-18T22:58:22.384444] [DEBUG] [MAIN ] SU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:22.398570] [INFO ] [MAIN ] SU: Generated 1807 derivative records from 53850 primary records. [2025-09-18T22:58:22.399037] [DEBUG] [MAIN ] STZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:22.399573] [DEBUG] [MAIN ] SUI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:22.400614] [INFO ] [MAIN ] STZ: Generated 1807 derivative records from 52658 primary records. [2025-09-18T22:58:22.400817] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-09-18T22:58:22.399724] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-09-18T22:58:22.403322] [INFO ] [MAIN ] SUI: Generated 1807 derivative records from 42541 primary records. [2025-09-18T22:58:22.403432] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-09-18T22:58:22.443666] [DEBUG] [LOCAL ] STZ: Derivative data saved (1807 records). [2025-09-18T22:58:22.444939] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-09-18T22:58:22.447069] [INFO ] [MAIN ] Derivative Progress: 1747/2075 symbols completed. STZ took 1.2s. Estimated remaining: 2m 7s. Rate: 154.7 symbols/min [2025-09-18T22:58:22.448171] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:22.456436] [DEBUG] [LOCAL ] SU: Derivative data saved (1807 records). [2025-09-18T22:58:22.456965] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-09-18T22:58:22.459930] [INFO ] [MAIN ] Derivative Progress: 1748/2075 symbols completed. SU took 1.2s. Estimated remaining: 2m 7s. Rate: 154.8 symbols/min [2025-09-18T22:58:22.460774] [DEBUG] [LOCAL ] SUI: Derivative data saved (1807 records). [2025-09-18T22:58:22.460913] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:22.461109] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-09-18T22:58:22.463899] [INFO ] [MAIN ] Derivative Progress: 1749/2075 symbols completed. SUI took 1.2s. Estimated remaining: 2m 6s. Rate: 154.9 symbols/min [2025-09-18T22:58:22.464454] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:22.502412] [DEBUG] [LOCAL ] SUN: Loaded 37520 existing records from primary storage. [2025-09-18T22:58:22.502711] [INFO ] [MAIN ] SUN: Loaded 37520 primary data records. [2025-09-18T22:58:22.670598] [DEBUG] [LOCAL ] SUZ: Loaded 46263 existing records from primary storage. [2025-09-18T22:58:22.671297] [DEBUG] [LOCAL ] SUPV: Loaded 47311 existing records from primary storage. [2025-09-18T22:58:22.697441] [INFO ] [MAIN ] SUPV: Loaded 47311 primary data records. [2025-09-18T22:58:22.697325] [INFO ] [MAIN ] SUZ: Loaded 46263 primary data records. [2025-09-18T22:58:23.579471] [DEBUG] [MAIN ] SUN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:23.580258] [INFO ] [MAIN ] SUN: Generated 1807 derivative records from 37520 primary records. [2025-09-18T22:58:23.580535] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-09-18T22:58:23.614073] [DEBUG] [MAIN ] SUZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:23.615044] [DEBUG] [LOCAL ] SUN: Derivative data saved (1807 records). [2025-09-18T22:58:23.616258] [INFO ] [MAIN ] SUZ: Generated 1807 derivative records from 46263 primary records. [2025-09-18T22:58:23.615414] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-09-18T22:58:23.618407] [INFO ] [MAIN ] Derivative Progress: 1750/2075 symbols completed. SUN took 1.2s. Estimated remaining: 2m 6s. Rate: 154.7 symbols/min [2025-09-18T22:58:23.616564] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-09-18T22:58:23.631901] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:23.640358] [DEBUG] [MAIN ] SUPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:23.641277] [INFO ] [MAIN ] SUPV: Generated 1807 derivative records from 47311 primary records. [2025-09-18T22:58:23.642615] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-09-18T22:58:23.650476] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1807 records). [2025-09-18T22:58:23.650951] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-09-18T22:58:23.660818] [INFO ] [MAIN ] Derivative Progress: 1751/2075 symbols completed. SUZ took 1.2s. Estimated remaining: 2m 6s. Rate: 154.8 symbols/min [2025-09-18T22:58:23.665258] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:23.671852] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1807 records). [2025-09-18T22:58:23.672107] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-09-18T22:58:23.678252] [INFO ] [MAIN ] Derivative Progress: 1752/2075 symbols completed. SUPV took 1.2s. Estimated remaining: 2m 5s. Rate: 154.9 symbols/min [2025-09-18T22:58:23.678682] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:23.710185] [DEBUG] [LOCAL ] SVV: Loaded 39709 existing records from primary storage. [2025-09-18T22:58:23.710463] [INFO ] [MAIN ] SVV: Loaded 39709 primary data records. [2025-09-18T22:58:24.062845] [DEBUG] [LOCAL ] SW: Loaded 53554 existing records from primary storage. [2025-09-18T22:58:24.079741] [INFO ] [MAIN ] SW: Loaded 53554 primary data records. [2025-09-18T22:58:24.133438] [DEBUG] [LOCAL ] SWK: Loaded 52912 existing records from primary storage. [2025-09-18T22:58:24.155580] [INFO ] [MAIN ] SWK: Loaded 52912 primary data records. [2025-09-18T22:58:24.757438] [DEBUG] [MAIN ] SVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:24.759208] [INFO ] [MAIN ] SVV: Generated 1807 derivative records from 39709 primary records. [2025-09-18T22:58:24.759433] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-09-18T22:58:24.794520] [DEBUG] [MAIN ] SW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:24.796190] [INFO ] [MAIN ] SW: Generated 1807 derivative records from 53554 primary records. [2025-09-18T22:58:24.796408] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-09-18T22:58:24.798326] [DEBUG] [LOCAL ] SVV: Derivative data saved (1807 records). [2025-09-18T22:58:24.806698] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-09-18T22:58:24.809122] [INFO ] [MAIN ] Derivative Progress: 1753/2075 symbols completed. SVV took 1.2s. Estimated remaining: 2m 5s. Rate: 154.7 symbols/min [2025-09-18T22:58:24.833562] [DEBUG] [MAIN ] SWK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:24.835144] [INFO ] [MAIN ] SWK: Generated 1807 derivative records from 52912 primary records. [2025-09-18T22:58:24.835469] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-09-18T22:58:24.836022] [DEBUG] [LOCAL ] SW: Derivative data saved (1807 records). [2025-09-18T22:58:24.836579] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-09-18T22:58:24.838939] [INFO ] [MAIN ] Derivative Progress: 1754/2075 symbols completed. SW took 1.2s. Estimated remaining: 2m 4s. Rate: 154.8 symbols/min [2025-09-18T22:58:24.854771] [DEBUG] [LOCAL ] SWK: Derivative data saved (1807 records). [2025-09-18T22:58:24.854955] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-09-18T22:58:24.857472] [INFO ] [MAIN ] Derivative Progress: 1755/2075 symbols completed. SWK took 1.2s. Estimated remaining: 2m 4s. Rate: 154.9 symbols/min [2025-09-18T22:58:24.858506] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:24.858587] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:24.858437] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:24.868181] [DEBUG] [LOCAL ] SWZ: Loaded 6201 existing records from primary storage. [2025-09-18T22:58:24.868320] [INFO ] [MAIN ] SWZ: Loaded 6201 primary data records. [2025-09-18T22:58:25.069854] [DEBUG] [LOCAL ] SWX: Loaded 31595 existing records from primary storage. [2025-09-18T22:58:25.092826] [INFO ] [MAIN ] SWX: Loaded 31595 primary data records. [2025-09-18T22:58:25.283163] [DEBUG] [LOCAL ] SXC: Loaded 42124 existing records from primary storage. [2025-09-18T22:58:25.293826] [INFO ] [MAIN ] SXC: Loaded 42124 primary data records. [2025-09-18T22:58:25.933742] [DEBUG] [MAIN ] SWZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:25.935315] [INFO ] [MAIN ] SWZ: Generated 1807 derivative records from 6201 primary records. [2025-09-18T22:58:25.935763] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-09-18T22:58:25.969523] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1807 records). [2025-09-18T22:58:25.970378] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-09-18T22:58:25.970308] [DEBUG] [MAIN ] SWX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:25.972628] [INFO ] [MAIN ] Derivative Progress: 1756/2075 symbols completed. SWZ took 1.1s. Estimated remaining: 2m 4s. Rate: 154.7 symbols/min [2025-09-18T22:58:25.973829] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:25.973742] [INFO ] [MAIN ] SWX: Generated 1807 derivative records from 31595 primary records. [2025-09-18T22:58:25.974662] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-09-18T22:58:26.017135] [DEBUG] [LOCAL ] SXI: Loaded 11512 existing records from primary storage. [2025-09-18T22:58:26.017388] [DEBUG] [LOCAL ] SWX: Derivative data saved (1807 records). [2025-09-18T22:58:26.016719] [DEBUG] [MAIN ] SXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:26.017546] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-09-18T22:58:26.018541] [INFO ] [MAIN ] SXC: Generated 1807 derivative records from 42124 primary records. [2025-09-18T22:58:26.021314] [INFO ] [MAIN ] Derivative Progress: 1757/2075 symbols completed. SWX took 1.2s. Estimated remaining: 2m 3s. Rate: 154.8 symbols/min [2025-09-18T22:58:26.017475] [INFO ] [MAIN ] SXI: Loaded 11512 primary data records. [2025-09-18T22:58:26.021680] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:26.018701] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-09-18T22:58:26.162481] [DEBUG] [LOCAL ] SXC: Derivative data saved (1807 records). [2025-09-18T22:58:26.214281] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-09-18T22:58:26.236673] [INFO ] [MAIN ] Derivative Progress: 1758/2075 symbols completed. SXC took 1.4s. Estimated remaining: 2m 3s. Rate: 154.8 symbols/min [2025-09-18T22:58:26.253126] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:26.375177] [DEBUG] [LOCAL ] SXT: Loaded 29141 existing records from primary storage. [2025-09-18T22:58:26.375591] [INFO ] [MAIN ] SXT: Loaded 29141 primary data records. [2025-09-18T22:58:26.729152] [DEBUG] [LOCAL ] SYF: Loaded 53850 existing records from primary storage. [2025-09-18T22:58:26.730140] [INFO ] [MAIN ] SYF: Loaded 53850 primary data records. [2025-09-18T22:58:26.748447] [DEBUG] [MAIN ] SXI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:26.783987] [INFO ] [MAIN ] SXI: Generated 1807 derivative records from 11512 primary records. [2025-09-18T22:58:26.784133] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-09-18T22:58:26.898077] [DEBUG] [LOCAL ] SXI: Derivative data saved (1807 records). [2025-09-18T22:58:26.935702] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-09-18T22:58:26.967332] [INFO ] [MAIN ] Derivative Progress: 1759/2075 symbols completed. SXI took 1.0s. Estimated remaining: 2m 3s. Rate: 154.8 symbols/min [2025-09-18T22:58:27.089285] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:27.076170] [DEBUG] [MAIN ] SXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:27.090673] [INFO ] [MAIN ] SXT: Generated 1807 derivative records from 29141 primary records. [2025-09-18T22:58:27.090908] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-09-18T22:58:27.109404] [DEBUG] [LOCAL ] SXT: Derivative data saved (1807 records). [2025-09-18T22:58:27.109896] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-09-18T22:58:27.112508] [INFO ] [MAIN ] Derivative Progress: 1760/2075 symbols completed. SXT took 1.1s. Estimated remaining: 2m 2s. Rate: 154.8 symbols/min [2025-09-18T22:58:27.112928] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:27.136607] [DEBUG] [MAIN ] SYF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:27.137472] [INFO ] [MAIN ] SYF: Generated 1807 derivative records from 53850 primary records. [2025-09-18T22:58:27.137592] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-09-18T22:58:27.164588] [DEBUG] [LOCAL ] SYF: Derivative data saved (1807 records). [2025-09-18T22:58:27.164759] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-09-18T22:58:27.166894] [INFO ] [MAIN ] Derivative Progress: 1761/2075 symbols completed. SYF took 0.9s. Estimated remaining: 2m 2s. Rate: 154.9 symbols/min [2025-09-18T22:58:27.180252] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:27.197690] [DEBUG] [LOCAL ] SYK: Loaded 47505 existing records from primary storage. [2025-09-18T22:58:27.197954] [INFO ] [MAIN ] SYK: Loaded 47505 primary data records. [2025-09-18T22:58:27.324528] [DEBUG] [LOCAL ] SYY: Loaded 53641 existing records from primary storage. [2025-09-18T22:58:27.324765] [INFO ] [MAIN ] SYY: Loaded 53641 primary data records. [2025-09-18T22:58:27.747295] [DEBUG] [LOCAL ] T: Loaded 54188 existing records from primary storage. [2025-09-18T22:58:27.905033] [INFO ] [MAIN ] T: Loaded 54188 primary data records. [2025-09-18T22:58:28.237180] [DEBUG] [MAIN ] SYK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:28.238844] [INFO ] [MAIN ] SYK: Generated 1807 derivative records from 47505 primary records. [2025-09-18T22:58:28.239054] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-09-18T22:58:28.257566] [DEBUG] [LOCAL ] SYK: Derivative data saved (1807 records). [2025-09-18T22:58:28.258724] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-09-18T22:58:28.262924] [INFO ] [MAIN ] Derivative Progress: 1762/2075 symbols completed. SYK took 1.2s. Estimated remaining: 2m 1s. Rate: 154.7 symbols/min [2025-09-18T22:58:28.276680] [DEBUG] [MAIN ] SYY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:28.276945] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:28.277787] [INFO ] [MAIN ] SYY: Generated 1807 derivative records from 53641 primary records. [2025-09-18T22:58:28.277996] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-09-18T22:58:28.295546] [DEBUG] [LOCAL ] SYY: Derivative data saved (1807 records). [2025-09-18T22:58:28.295698] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-09-18T22:58:28.298123] [INFO ] [MAIN ] Derivative Progress: 1763/2075 symbols completed. SYY took 1.2s. Estimated remaining: 2m 1s. Rate: 154.8 symbols/min [2025-09-18T22:58:28.298727] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:28.316186] [DEBUG] [MAIN ] T: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:28.317069] [INFO ] [MAIN ] T: Generated 1807 derivative records from 54188 primary records. [2025-09-18T22:58:28.317274] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-09-18T22:58:28.334892] [DEBUG] [LOCAL ] T: Derivative data saved (1807 records). [2025-09-18T22:58:28.335134] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-09-18T22:58:28.337588] [INFO ] [MAIN ] Derivative Progress: 1764/2075 symbols completed. T took 1.2s. Estimated remaining: 2m 0s. Rate: 154.9 symbols/min [2025-09-18T22:58:28.347930] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:28.377299] [DEBUG] [LOCAL ] TAC: Loaded 43355 existing records from primary storage. [2025-09-18T22:58:28.377523] [INFO ] [MAIN ] TAC: Loaded 43355 primary data records. [2025-09-18T22:58:28.516190] [DEBUG] [LOCAL ] TAK: Loaded 50341 existing records from primary storage. [2025-09-18T22:58:28.558852] [INFO ] [MAIN ] TAK: Loaded 50341 primary data records. [2025-09-18T22:58:28.852345] [DEBUG] [LOCAL ] TAL: Loaded 52549 existing records from primary storage. [2025-09-18T22:58:28.868986] [INFO ] [MAIN ] TAL: Loaded 52549 primary data records. [2025-09-18T22:58:29.400477] [DEBUG] [MAIN ] TAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:29.401994] [INFO ] [MAIN ] TAC: Generated 1807 derivative records from 43355 primary records. [2025-09-18T22:58:29.402274] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-09-18T22:58:29.421002] [DEBUG] [LOCAL ] TAC: Derivative data saved (1807 records). [2025-09-18T22:58:29.421627] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-09-18T22:58:29.424084] [INFO ] [MAIN ] Derivative Progress: 1765/2075 symbols completed. TAC took 1.1s. Estimated remaining: 2m 0s. Rate: 154.7 symbols/min [2025-09-18T22:58:29.425831] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:29.447096] [DEBUG] [MAIN ] TAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:29.448044] [INFO ] [MAIN ] TAK: Generated 1807 derivative records from 50341 primary records. [2025-09-18T22:58:29.448177] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-09-18T22:58:29.484452] [DEBUG] [LOCAL ] TAK: Derivative data saved (1807 records). [2025-09-18T22:58:29.483610] [DEBUG] [MAIN ] TAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:29.484607] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-09-18T22:58:29.485610] [INFO ] [MAIN ] TAL: Generated 1807 derivative records from 52549 primary records. [2025-09-18T22:58:29.487768] [INFO ] [MAIN ] Derivative Progress: 1766/2075 symbols completed. TAK took 1.2s. Estimated remaining: 1m 60s. Rate: 154.8 symbols/min [2025-09-18T22:58:29.488215] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:29.488150] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-09-18T22:58:29.520195] [DEBUG] [LOCAL ] TAL: Derivative data saved (1807 records). [2025-09-18T22:58:29.520422] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-09-18T22:58:29.523048] [INFO ] [MAIN ] Derivative Progress: 1767/2075 symbols completed. TAL took 1.2s. Estimated remaining: 1m 59s. Rate: 154.9 symbols/min [2025-09-18T22:58:29.523372] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:29.540321] [DEBUG] [LOCAL ] TALO: Loaded 51209 existing records from primary storage. [2025-09-18T22:58:29.540520] [INFO ] [MAIN ] TALO: Loaded 51209 primary data records. [2025-09-18T22:58:29.645921] [DEBUG] [LOCAL ] TBB: Loaded 11813 existing records from primary storage. [2025-09-18T22:58:29.656194] [INFO ] [MAIN ] TBB: Loaded 11813 primary data records. [2025-09-18T22:58:30.033444] [DEBUG] [LOCAL ] TAP: Loaded 53235 existing records from primary storage. [2025-09-18T22:58:30.086445] [INFO ] [MAIN ] TAP: Loaded 53235 primary data records. [2025-09-18T22:58:30.561386] [DEBUG] [MAIN ] TALO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:30.562844] [INFO ] [MAIN ] TALO: Generated 1807 derivative records from 51209 primary records. [2025-09-18T22:58:30.563214] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-09-18T22:58:30.581953] [DEBUG] [LOCAL ] TALO: Derivative data saved (1807 records). [2025-09-18T22:58:30.583859] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-09-18T22:58:30.586206] [INFO ] [MAIN ] Derivative Progress: 1768/2075 symbols completed. TALO took 1.2s. Estimated remaining: 1m 59s. Rate: 154.7 symbols/min [2025-09-18T22:58:30.600080] [DEBUG] [MAIN ] TBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:30.600902] [INFO ] [MAIN ] TBB: Generated 1807 derivative records from 11813 primary records. [2025-09-18T22:58:30.601177] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-09-18T22:58:30.618345] [DEBUG] [LOCAL ] TBB: Derivative data saved (1807 records). [2025-09-18T22:58:30.618711] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-09-18T22:58:30.621931] [INFO ] [MAIN ] Derivative Progress: 1769/2075 symbols completed. TBB took 1.1s. Estimated remaining: 1m 59s. Rate: 154.8 symbols/min [2025-09-18T22:58:30.643471] [DEBUG] [MAIN ] TAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:30.644468] [INFO ] [MAIN ] TAP: Generated 1807 derivative records from 53235 primary records. [2025-09-18T22:58:30.644555] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-09-18T22:58:30.660049] [DEBUG] [LOCAL ] TAP: Derivative data saved (1807 records). [2025-09-18T22:58:30.660175] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-09-18T22:58:30.662546] [INFO ] [MAIN ] Derivative Progress: 1770/2075 symbols completed. TAP took 1.2s. Estimated remaining: 1m 58s. Rate: 154.9 symbols/min [2025-09-18T22:58:30.663133] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:30.663411] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:30.663711] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:30.671105] [DEBUG] [LOCAL ] TBN: Loaded 3059 existing records from primary storage. [2025-09-18T22:58:30.671254] [INFO ] [MAIN ] TBN: Loaded 3059 primary data records. [2025-09-18T22:58:30.855026] [DEBUG] [LOCAL ] TBI: Loaded 22917 existing records from primary storage. [2025-09-18T22:58:30.915325] [INFO ] [MAIN ] TBI: Loaded 22917 primary data records. [2025-09-18T22:58:30.916445] [DEBUG] [LOCAL ] TBBB: Loaded 36224 existing records from primary storage. [2025-09-18T22:58:30.916686] [INFO ] [MAIN ] TBBB: Loaded 36224 primary data records. [2025-09-18T22:58:31.739739] [DEBUG] [MAIN ] TBN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:31.740878] [INFO ] [MAIN ] TBN: Generated 1807 derivative records from 3059 primary records. [2025-09-18T22:58:31.740983] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-09-18T22:58:31.756746] [DEBUG] [LOCAL ] TBN: Derivative data saved (1807 records). [2025-09-18T22:58:31.757410] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-09-18T22:58:31.759674] [INFO ] [MAIN ] Derivative Progress: 1771/2075 symbols completed. TBN took 1.1s. Estimated remaining: 1m 58s. Rate: 154.7 symbols/min [2025-09-18T22:58:31.760473] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:31.777352] [DEBUG] [MAIN ] TBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:31.778612] [INFO ] [MAIN ] TBI: Generated 1807 derivative records from 22917 primary records. [2025-09-18T22:58:31.778951] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-09-18T22:58:31.797478] [DEBUG] [LOCAL ] TBI: Derivative data saved (1807 records). [2025-09-18T22:58:31.798835] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-09-18T22:58:31.802577] [INFO ] [MAIN ] Derivative Progress: 1772/2075 symbols completed. TBI took 1.1s. Estimated remaining: 1m 57s. Rate: 154.8 symbols/min [2025-09-18T22:58:31.802876] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:31.817946] [DEBUG] [MAIN ] TBBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:31.818891] [INFO ] [MAIN ] TBBB: Generated 1807 derivative records from 36224 primary records. [2025-09-18T22:58:31.819106] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-09-18T22:58:31.836726] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1807 records). [2025-09-18T22:58:31.836936] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-09-18T22:58:31.839436] [INFO ] [MAIN ] Derivative Progress: 1773/2075 symbols completed. TBBB took 1.2s. Estimated remaining: 1m 57s. Rate: 154.9 symbols/min [2025-09-18T22:58:31.839817] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:31.849163] [DEBUG] [LOCAL ] TDF: Loaded 6549 existing records from primary storage. [2025-09-18T22:58:31.849357] [INFO ] [MAIN ] TDF: Loaded 6549 primary data records. [2025-09-18T22:58:32.091221] [DEBUG] [LOCAL ] TDC: Loaded 47386 existing records from primary storage. [2025-09-18T22:58:32.037081] [DEBUG] [LOCAL ] TD: Loaded 52676 existing records from primary storage. [2025-09-18T22:58:32.099165] [INFO ] [MAIN ] TDC: Loaded 47386 primary data records. [2025-09-18T22:58:32.217369] [INFO ] [MAIN ] TD: Loaded 52676 primary data records. [2025-09-18T22:58:32.864134] [DEBUG] [MAIN ] TDF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:32.865439] [INFO ] [MAIN ] TDF: Generated 1807 derivative records from 6549 primary records. [2025-09-18T22:58:32.865622] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-09-18T22:58:32.884277] [DEBUG] [LOCAL ] TDF: Derivative data saved (1807 records). [2025-09-18T22:58:32.884524] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-09-18T22:58:32.886465] [INFO ] [MAIN ] Derivative Progress: 1774/2075 symbols completed. TDF took 1.0s. Estimated remaining: 1m 57s. Rate: 154.7 symbols/min [2025-09-18T22:58:32.901023] [DEBUG] [MAIN ] TDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:32.900139] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:32.902211] [INFO ] [MAIN ] TDC: Generated 1807 derivative records from 47386 primary records. [2025-09-18T22:58:32.902304] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-09-18T22:58:32.921902] [DEBUG] [LOCAL ] TDC: Derivative data saved (1807 records). [2025-09-18T22:58:32.929717] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-09-18T22:58:32.937563] [DEBUG] [MAIN ] TD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:32.937215] [INFO ] [MAIN ] Derivative Progress: 1775/2075 symbols completed. TDC took 1.1s. Estimated remaining: 1m 56s. Rate: 154.8 symbols/min [2025-09-18T22:58:32.938392] [INFO ] [MAIN ] TD: Generated 1807 derivative records from 52676 primary records. [2025-09-18T22:58:32.938560] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-09-18T22:58:32.939360] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:32.961353] [DEBUG] [LOCAL ] TD: Derivative data saved (1807 records). [2025-09-18T22:58:32.961559] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-09-18T22:58:32.963944] [INFO ] [MAIN ] Derivative Progress: 1776/2075 symbols completed. TD took 1.2s. Estimated remaining: 1m 56s. Rate: 154.9 symbols/min [2025-09-18T22:58:32.964282] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:32.973738] [DEBUG] [LOCAL ] TDG: Loaded 22331 existing records from primary storage. [2025-09-18T22:58:32.973928] [INFO ] [MAIN ] TDG: Loaded 22331 primary data records. [2025-09-18T22:58:33.221761] [DEBUG] [LOCAL ] TDOC: Loaded 53744 existing records from primary storage. [2025-09-18T22:58:33.344611] [DEBUG] [LOCAL ] TDS: Loaded 43200 existing records from primary storage. [2025-09-18T22:58:33.345738] [INFO ] [MAIN ] TDS: Loaded 43200 primary data records. [2025-09-18T22:58:33.344785] [INFO ] [MAIN ] TDOC: Loaded 53744 primary data records. [2025-09-18T22:58:34.028982] [DEBUG] [MAIN ] TDG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:34.030845] [INFO ] [MAIN ] TDG: Generated 1807 derivative records from 22331 primary records. [2025-09-18T22:58:34.031339] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-09-18T22:58:34.050796] [DEBUG] [LOCAL ] TDG: Derivative data saved (1807 records). [2025-09-18T22:58:34.051219] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-09-18T22:58:34.053554] [INFO ] [MAIN ] Derivative Progress: 1777/2075 symbols completed. TDG took 1.2s. Estimated remaining: 1m 56s. Rate: 154.7 symbols/min [2025-09-18T22:58:34.053956] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:34.078193] [DEBUG] [MAIN ] TDOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:34.086879] [INFO ] [MAIN ] TDOC: Generated 1807 derivative records from 53744 primary records. [2025-09-18T22:58:34.091769] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-09-18T22:58:34.093164] [DEBUG] [MAIN ] TDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:34.094216] [INFO ] [MAIN ] TDS: Generated 1807 derivative records from 43200 primary records. [2025-09-18T22:58:34.105429] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-09-18T22:58:34.122806] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1807 records). [2025-09-18T22:58:34.127316] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-09-18T22:58:34.130379] [INFO ] [MAIN ] Derivative Progress: 1778/2075 symbols completed. TDOC took 1.2s. Estimated remaining: 1m 55s. Rate: 154.8 symbols/min [2025-09-18T22:58:34.131041] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:34.144747] [DEBUG] [LOCAL ] TDS: Derivative data saved (1807 records). [2025-09-18T22:58:34.145077] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-09-18T22:58:34.147480] [INFO ] [MAIN ] Derivative Progress: 1779/2075 symbols completed. TDS took 1.2s. Estimated remaining: 1m 55s. Rate: 154.9 symbols/min [2025-09-18T22:58:34.148046] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:34.171528] [DEBUG] [LOCAL ] TDW: Loaded 46057 existing records from primary storage. [2025-09-18T22:58:34.175421] [DEBUG] [LOCAL ] TEAF: Loaded 7310 existing records from primary storage. [2025-09-18T22:58:34.175533] [INFO ] [MAIN ] TDW: Loaded 46057 primary data records. [2025-09-18T22:58:34.175628] [INFO ] [MAIN ] TEAF: Loaded 7310 primary data records. [2025-09-18T22:58:34.311588] [DEBUG] [LOCAL ] TDY: Loaded 23132 existing records from primary storage. [2025-09-18T22:58:34.368193] [INFO ] [MAIN ] TDY: Loaded 23132 primary data records. [2025-09-18T22:58:35.140182] [DEBUG] [MAIN ] TEAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:35.142249] [INFO ] [MAIN ] TEAF: Generated 1807 derivative records from 7310 primary records. [2025-09-18T22:58:35.142635] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-09-18T22:58:35.160376] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1807 records). [2025-09-18T22:58:35.160770] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-09-18T22:58:35.162856] [INFO ] [MAIN ] Derivative Progress: 1780/2075 symbols completed. TEAF took 1.0s. Estimated remaining: 1m 54s. Rate: 154.7 symbols/min [2025-09-18T22:58:35.167086] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:35.182847] [DEBUG] [MAIN ] TDW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:35.183947] [INFO ] [MAIN ] TDW: Generated 1807 derivative records from 46057 primary records. [2025-09-18T22:58:35.184208] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-09-18T22:58:35.197678] [DEBUG] [MAIN ] TDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:35.206882] [INFO ] [MAIN ] TDY: Generated 1807 derivative records from 23132 primary records. [2025-09-18T22:58:35.209683] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-09-18T22:58:35.229882] [DEBUG] [LOCAL ] TDY: Derivative data saved (1807 records). [2025-09-18T22:58:35.230794] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-09-18T22:58:35.234156] [INFO ] [MAIN ] Derivative Progress: 1781/2075 symbols completed. TDY took 1.1s. Estimated remaining: 1m 54s. Rate: 154.8 symbols/min [2025-09-18T22:58:35.235002] [DEBUG] [LOCAL ] TDW: Derivative data saved (1807 records). [2025-09-18T22:58:35.235210] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:35.235428] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-09-18T22:58:35.238128] [INFO ] [MAIN ] Derivative Progress: 1782/2075 symbols completed. TDW took 1.2s. Estimated remaining: 1m 53s. Rate: 154.9 symbols/min [2025-09-18T22:58:35.238424] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:35.286925] [DEBUG] [LOCAL ] TEI: Loaded 20582 existing records from primary storage. [2025-09-18T22:58:35.288048] [DEBUG] [LOCAL ] TECK: Loaded 53829 existing records from primary storage. [2025-09-18T22:58:35.287199] [INFO ] [MAIN ] TEI: Loaded 20582 primary data records. [2025-09-18T22:58:35.296129] [INFO ] [MAIN ] TECK: Loaded 53829 primary data records. [2025-09-18T22:58:35.507740] [DEBUG] [LOCAL ] TEF: Loaded 37836 existing records from primary storage. [2025-09-18T22:58:35.525907] [INFO ] [MAIN ] TEF: Loaded 37836 primary data records. [2025-09-18T22:58:36.301749] [DEBUG] [MAIN ] TECK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:36.302746] [INFO ] [MAIN ] TECK: Generated 1807 derivative records from 53829 primary records. [2025-09-18T22:58:36.302978] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-09-18T22:58:36.318710] [DEBUG] [MAIN ] TEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:36.319402] [INFO ] [MAIN ] TEI: Generated 1807 derivative records from 20582 primary records. [2025-09-18T22:58:36.326607] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-09-18T22:58:36.355439] [DEBUG] [MAIN ] TEF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:36.347366] [DEBUG] [LOCAL ] TECK: Derivative data saved (1807 records). [2025-09-18T22:58:36.362596] [DEBUG] [LOCAL ] TEI: Derivative data saved (1807 records). [2025-09-18T22:58:36.361602] [INFO ] [MAIN ] TEF: Generated 1807 derivative records from 37836 primary records. [2025-09-18T22:58:36.362748] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-09-18T22:58:36.362875] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-09-18T22:58:36.366047] [INFO ] [MAIN ] Derivative Progress: 1783/2075 symbols completed. TEI took 1.1s. Estimated remaining: 1m 53s. Rate: 154.7 symbols/min [2025-09-18T22:58:36.362943] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-09-18T22:58:36.368588] [INFO ] [MAIN ] Derivative Progress: 1784/2075 symbols completed. TECK took 1.2s. Estimated remaining: 1m 53s. Rate: 154.8 symbols/min [2025-09-18T22:58:36.383160] [DEBUG] [LOCAL ] TEF: Derivative data saved (1807 records). [2025-09-18T22:58:36.383221] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-09-18T22:58:36.385792] [INFO ] [MAIN ] Derivative Progress: 1785/2075 symbols completed. TEF took 1.2s. Estimated remaining: 1m 52s. Rate: 154.9 symbols/min [2025-09-18T22:58:36.386322] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:36.386477] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:36.386795] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:36.416753] [DEBUG] [LOCAL ] TEO: Loaded 21772 existing records from primary storage. [2025-09-18T22:58:36.416924] [INFO ] [MAIN ] TEO: Loaded 21772 primary data records. [2025-09-18T22:58:36.542182] [DEBUG] [LOCAL ] TEN: Loaded 31428 existing records from primary storage. [2025-09-18T22:58:36.545881] [INFO ] [MAIN ] TEN: Loaded 31428 primary data records. [2025-09-18T22:58:36.869140] [DEBUG] [LOCAL ] TEL: Loaded 51567 existing records from primary storage. [2025-09-18T22:58:36.885267] [INFO ] [MAIN ] TEL: Loaded 51567 primary data records. [2025-09-18T22:58:37.403232] [DEBUG] [MAIN ] TEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:37.404120] [INFO ] [MAIN ] TEO: Generated 1807 derivative records from 21772 primary records. [2025-09-18T22:58:37.404327] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-09-18T22:58:37.423126] [DEBUG] [LOCAL ] TEO: Derivative data saved (1807 records). [2025-09-18T22:58:37.423329] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-09-18T22:58:37.425688] [INFO ] [MAIN ] Derivative Progress: 1786/2075 symbols completed. TEO took 1.0s. Estimated remaining: 1m 52s. Rate: 154.8 symbols/min [2025-09-18T22:58:37.428068] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:37.442389] [DEBUG] [MAIN ] TEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:37.443409] [INFO ] [MAIN ] TEN: Generated 1807 derivative records from 31428 primary records. [2025-09-18T22:58:37.443576] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-09-18T22:58:37.474002] [DEBUG] [MAIN ] TEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:37.475792] [INFO ] [MAIN ] TEL: Generated 1807 derivative records from 51567 primary records. [2025-09-18T22:58:37.476143] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-09-18T22:58:37.479049] [DEBUG] [LOCAL ] TEN: Derivative data saved (1807 records). [2025-09-18T22:58:37.479225] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-09-18T22:58:37.481944] [INFO ] [MAIN ] Derivative Progress: 1787/2075 symbols completed. TEN took 1.1s. Estimated remaining: 1m 52s. Rate: 154.8 symbols/min [2025-09-18T22:58:37.493859] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:37.498781] [DEBUG] [LOCAL ] TEL: Derivative data saved (1807 records). [2025-09-18T22:58:37.498952] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-09-18T22:58:37.501902] [INFO ] [MAIN ] Derivative Progress: 1788/2075 symbols completed. TEL took 1.1s. Estimated remaining: 1m 51s. Rate: 154.9 symbols/min [2025-09-18T22:58:37.502336] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:37.543534] [DEBUG] [LOCAL ] TEVA: Loaded 54022 existing records from primary storage. [2025-09-18T22:58:37.543842] [INFO ] [MAIN ] TEVA: Loaded 54022 primary data records. [2025-09-18T22:58:37.711977] [DEBUG] [LOCAL ] TEX: Loaded 45339 existing records from primary storage. [2025-09-18T22:58:37.760398] [INFO ] [MAIN ] TEX: Loaded 45339 primary data records. [2025-09-18T22:58:37.992246] [DEBUG] [LOCAL ] TFC: Loaded 54057 existing records from primary storage. [2025-09-18T22:58:38.021821] [INFO ] [MAIN ] TFC: Loaded 54057 primary data records. [2025-09-18T22:58:38.606497] [DEBUG] [MAIN ] TEVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:38.607479] [INFO ] [MAIN ] TEVA: Generated 1807 derivative records from 54022 primary records. [2025-09-18T22:58:38.607876] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-09-18T22:58:38.628578] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1807 records). [2025-09-18T22:58:38.641877] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-09-18T22:58:38.642499] [DEBUG] [MAIN ] TEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:38.643485] [INFO ] [MAIN ] TEX: Generated 1807 derivative records from 45339 primary records. [2025-09-18T22:58:38.646206] [INFO ] [MAIN ] Derivative Progress: 1789/2075 symbols completed. TEVA took 1.2s. Estimated remaining: 1m 51s. Rate: 154.7 symbols/min [2025-09-18T22:58:38.646702] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-09-18T22:58:38.647042] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:38.682123] [DEBUG] [MAIN ] TFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:38.683025] [INFO ] [MAIN ] TFC: Generated 1807 derivative records from 54057 primary records. [2025-09-18T22:58:38.683114] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-09-18T22:58:38.681770] [DEBUG] [LOCAL ] TEX: Derivative data saved (1807 records). [2025-09-18T22:58:38.683669] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-09-18T22:58:38.686267] [INFO ] [MAIN ] Derivative Progress: 1790/2075 symbols completed. TEX took 1.2s. Estimated remaining: 1m 50s. Rate: 154.8 symbols/min [2025-09-18T22:58:38.686897] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:38.705895] [DEBUG] [LOCAL ] TFC: Derivative data saved (1807 records). [2025-09-18T22:58:38.706043] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-09-18T22:58:38.709528] [INFO ] [MAIN ] Derivative Progress: 1791/2075 symbols completed. TFC took 1.2s. Estimated remaining: 1m 50s. Rate: 154.9 symbols/min [2025-09-18T22:58:38.710148] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:38.746171] [DEBUG] [LOCAL ] TFII: Loaded 35116 existing records from primary storage. [2025-09-18T22:58:38.746406] [INFO ] [MAIN ] TFII: Loaded 35116 primary data records. [2025-09-18T22:58:38.817340] [DEBUG] [LOCAL ] TFIN: Loaded 23775 existing records from primary storage. [2025-09-18T22:58:38.859377] [INFO ] [MAIN ] TFIN: Loaded 23775 primary data records. [2025-09-18T22:58:39.077204] [DEBUG] [LOCAL ] TFPM: Loaded 37239 existing records from primary storage. [2025-09-18T22:58:39.200104] [INFO ] [MAIN ] TFPM: Loaded 37239 primary data records. [2025-09-18T22:58:39.817773] [DEBUG] [MAIN ] TFII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:39.819138] [INFO ] [MAIN ] TFII: Generated 1807 derivative records from 35116 primary records. [2025-09-18T22:58:39.819690] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-09-18T22:58:39.850031] [DEBUG] [LOCAL ] TFII: Derivative data saved (1807 records). [2025-09-18T22:58:39.855057] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-09-18T22:58:39.858115] [DEBUG] [MAIN ] TFIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:39.858988] [INFO ] [MAIN ] TFIN: Generated 1807 derivative records from 23775 primary records. [2025-09-18T22:58:39.857255] [INFO ] [MAIN ] Derivative Progress: 1792/2075 symbols completed. TFII took 1.2s. Estimated remaining: 1m 50s. Rate: 154.7 symbols/min [2025-09-18T22:58:39.859895] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:39.859832] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-09-18T22:58:39.887272] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1807 records). [2025-09-18T22:58:39.892752] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-09-18T22:58:39.892552] [DEBUG] [MAIN ] TFPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:39.895512] [INFO ] [MAIN ] Derivative Progress: 1793/2075 symbols completed. TFIN took 1.2s. Estimated remaining: 1m 49s. Rate: 154.8 symbols/min [2025-09-18T22:58:39.896293] [INFO ] [MAIN ] TFPM: Generated 1807 derivative records from 37239 primary records. [2025-09-18T22:58:39.896521] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-09-18T22:58:39.897743] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:39.915285] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1807 records). [2025-09-18T22:58:39.915453] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-09-18T22:58:39.918162] [INFO ] [MAIN ] Derivative Progress: 1794/2075 symbols completed. TFPM took 1.2s. Estimated remaining: 1m 49s. Rate: 154.9 symbols/min [2025-09-18T22:58:39.918696] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:39.939260] [DEBUG] [LOCAL ] TG: Loaded 10478 existing records from primary storage. [2025-09-18T22:58:39.939409] [INFO ] [MAIN ] TG: Loaded 10478 primary data records. [2025-09-18T22:58:40.066811] [DEBUG] [LOCAL ] TFX: Loaded 38015 existing records from primary storage. [2025-09-18T22:58:40.072603] [INFO ] [MAIN ] TFX: Loaded 38015 primary data records. [2025-09-18T22:58:40.222892] [DEBUG] [LOCAL ] TGLS: Loaded 28792 existing records from primary storage. [2025-09-18T22:58:40.232182] [INFO ] [MAIN ] TGLS: Loaded 28792 primary data records. [2025-09-18T22:58:40.936911] [DEBUG] [MAIN ] TG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:40.937885] [INFO ] [MAIN ] TG: Generated 1807 derivative records from 10478 primary records. [2025-09-18T22:58:40.937990] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-09-18T22:58:40.955910] [DEBUG] [LOCAL ] TG: Derivative data saved (1807 records). [2025-09-18T22:58:40.956744] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-09-18T22:58:40.958814] [INFO ] [MAIN ] Derivative Progress: 1795/2075 symbols completed. TG took 1.1s. Estimated remaining: 1m 49s. Rate: 154.7 symbols/min [2025-09-18T22:58:40.959336] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:40.975473] [DEBUG] [MAIN ] TFX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:40.976506] [INFO ] [MAIN ] TFX: Generated 1807 derivative records from 38015 primary records. [2025-09-18T22:58:40.976744] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-09-18T22:58:41.001233] [DEBUG] [MAIN ] TGLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:41.005306] [INFO ] [MAIN ] TGLS: Generated 1807 derivative records from 28792 primary records. [2025-09-18T22:58:41.006781] [DEBUG] [LOCAL ] TFX: Derivative data saved (1807 records). [2025-09-18T22:58:41.006437] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-09-18T22:58:41.006902] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-09-18T22:58:41.010470] [INFO ] [MAIN ] Derivative Progress: 1796/2075 symbols completed. TFX took 1.2s. Estimated remaining: 1m 48s. Rate: 154.8 symbols/min [2025-09-18T22:58:41.018358] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:41.026687] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1807 records). [2025-09-18T22:58:41.027022] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-09-18T22:58:41.029690] [INFO ] [MAIN ] Derivative Progress: 1797/2075 symbols completed. TGLS took 1.1s. Estimated remaining: 1m 48s. Rate: 154.9 symbols/min [2025-09-18T22:58:41.030072] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:41.105435] [DEBUG] [LOCAL ] TGS: Loaded 32525 existing records from primary storage. [2025-09-18T22:58:41.105769] [INFO ] [MAIN ] TGS: Loaded 32525 primary data records. [2025-09-18T22:58:41.104938] [DEBUG] [LOCAL ] TGNA: Loaded 49066 existing records from primary storage. [2025-09-18T22:58:41.106459] [INFO ] [MAIN ] TGNA: Loaded 49066 primary data records. [2025-09-18T22:58:41.313322] [DEBUG] [LOCAL ] TGT: Loaded 54168 existing records from primary storage. [2025-09-18T22:58:41.322997] [INFO ] [MAIN ] TGT: Loaded 54168 primary data records. [2025-09-18T22:58:42.155932] [DEBUG] [MAIN ] TGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:42.157723] [DEBUG] [MAIN ] TGNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:42.158744] [INFO ] [MAIN ] TGS: Generated 1807 derivative records from 32525 primary records. [2025-09-18T22:58:42.162289] [INFO ] [MAIN ] TGNA: Generated 1807 derivative records from 49066 primary records. [2025-09-18T22:58:42.162399] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-09-18T22:58:42.162976] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-09-18T22:58:42.199735] [DEBUG] [LOCAL ] TGS: Derivative data saved (1807 records). [2025-09-18T22:58:42.213539] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-09-18T22:58:42.213431] [DEBUG] [MAIN ] TGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:42.216359] [INFO ] [MAIN ] Derivative Progress: 1798/2075 symbols completed. TGS took 1.2s. Estimated remaining: 1m 47s. Rate: 154.7 symbols/min [2025-09-18T22:58:42.217230] [INFO ] [MAIN ] TGT: Generated 1807 derivative records from 54168 primary records. [2025-09-18T22:58:42.219578] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1807 records). [2025-09-18T22:58:42.219764] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-09-18T22:58:42.218121] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-09-18T22:58:42.221664] [INFO ] [MAIN ] Derivative Progress: 1799/2075 symbols completed. TGNA took 1.3s. Estimated remaining: 1m 47s. Rate: 154.8 symbols/min [2025-09-18T22:58:42.238104] [DEBUG] [LOCAL ] TGT: Derivative data saved (1807 records). [2025-09-18T22:58:42.238241] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-09-18T22:58:42.240974] [INFO ] [MAIN ] Derivative Progress: 1800/2075 symbols completed. TGT took 1.2s. Estimated remaining: 1m 47s. Rate: 154.9 symbols/min [2025-09-18T22:58:42.241496] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:42.241877] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:42.242562] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:42.248003] [DEBUG] [LOCAL ] THIR: Loaded 2166 existing records from primary storage. [2025-09-18T22:58:42.248319] [INFO ] [MAIN ] THIR: Loaded 2166 primary data records. [2025-09-18T22:58:42.442639] [DEBUG] [LOCAL ] THG: Loaded 22325 existing records from primary storage. [2025-09-18T22:58:42.444276] [INFO ] [MAIN ] THG: Loaded 22325 primary data records. [2025-09-18T22:58:42.699876] [DEBUG] [LOCAL ] THC: Loaded 48664 existing records from primary storage. [2025-09-18T22:58:42.711979] [INFO ] [MAIN ] THC: Loaded 48664 primary data records. [2025-09-18T22:58:43.269829] [DEBUG] [MAIN ] THIR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:58:43.272361] [INFO ] [MAIN ] THIR: Generated 1806 derivative records from 2166 primary records. [2025-09-18T22:58:43.272799] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-09-18T22:58:43.287306] [DEBUG] [LOCAL ] THIR: Derivative data saved (1806 records). [2025-09-18T22:58:43.290185] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-09-18T22:58:43.292729] [INFO ] [MAIN ] Derivative Progress: 1801/2075 symbols completed. THIR took 1.1s. Estimated remaining: 1m 46s. Rate: 154.7 symbols/min [2025-09-18T22:58:43.293102] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:43.307730] [DEBUG] [MAIN ] THG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:43.308621] [INFO ] [MAIN ] THG: Generated 1807 derivative records from 22325 primary records. [2025-09-18T22:58:43.308804] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-09-18T22:58:43.311398] [DEBUG] [LOCAL ] THLV: Loaded 1687 existing records from primary storage. [2025-09-18T22:58:43.311859] [INFO ] [MAIN ] THLV: Loaded 1687 primary data records. [2025-09-18T22:58:43.368801] [DEBUG] [LOCAL ] THG: Derivative data saved (1807 records). [2025-09-18T22:58:43.399540] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-09-18T22:58:43.419301] [INFO ] [MAIN ] Derivative Progress: 1802/2075 symbols completed. THG took 1.2s. Estimated remaining: 1m 46s. Rate: 154.8 symbols/min [2025-09-18T22:58:43.452507] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:43.457268] [DEBUG] [MAIN ] THC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:43.459031] [INFO ] [MAIN ] THC: Generated 1807 derivative records from 48664 primary records. [2025-09-18T22:58:43.459114] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-09-18T22:58:43.550801] [DEBUG] [LOCAL ] THC: Derivative data saved (1807 records). [2025-09-18T22:58:43.556672] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-09-18T22:58:43.681018] [INFO ] [MAIN ] Derivative Progress: 1803/2075 symbols completed. THC took 1.4s. Estimated remaining: 1m 45s. Rate: 154.8 symbols/min [2025-09-18T22:58:43.681570] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:43.742972] [DEBUG] [LOCAL ] THO: Loaded 42800 existing records from primary storage. [2025-09-18T22:58:43.743703] [INFO ] [MAIN ] THO: Loaded 42800 primary data records. [2025-09-18T22:58:43.744090] [DEBUG] [LOCAL ] THQ: Loaded 24478 existing records from primary storage. [2025-09-18T22:58:43.743583] [DEBUG] [MAIN ] THLV: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-09-18T22:58:43.744397] [INFO ] [MAIN ] THQ: Loaded 24478 primary data records. [2025-09-18T22:58:43.756816] [INFO ] [MAIN ] THLV: Generated 1805 derivative records from 1687 primary records. [2025-09-18T22:58:43.781824] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-09-18T22:58:43.934028] [DEBUG] [LOCAL ] THLV: Derivative data saved (1805 records). [2025-09-18T22:58:43.941895] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-09-18T22:58:43.958627] [INFO ] [MAIN ] Derivative Progress: 1804/2075 symbols completed. THLV took 0.7s. Estimated remaining: 1m 45s. Rate: 154.9 symbols/min [2025-09-18T22:58:43.969980] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:44.404409] [DEBUG] [LOCAL ] THR: Loaded 20234 existing records from primary storage. [2025-09-18T22:58:44.404559] [INFO ] [MAIN ] THR: Loaded 20234 primary data records. [2025-09-18T22:58:44.770831] [DEBUG] [MAIN ] THQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:44.776386] [DEBUG] [MAIN ] THO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:44.777133] [INFO ] [MAIN ] THQ: Generated 1807 derivative records from 24478 primary records. [2025-09-18T22:58:44.777949] [INFO ] [MAIN ] THO: Generated 1807 derivative records from 42800 primary records. [2025-09-18T22:58:44.778046] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-09-18T22:58:44.778263] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-09-18T22:58:44.806256] [DEBUG] [LOCAL ] THQ: Derivative data saved (1807 records). [2025-09-18T22:58:44.807666] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-09-18T22:58:44.811886] [INFO ] [MAIN ] Derivative Progress: 1805/2075 symbols completed. THQ took 1.1s. Estimated remaining: 1m 45s. Rate: 154.8 symbols/min [2025-09-18T22:58:44.813226] [DEBUG] [LOCAL ] THO: Derivative data saved (1807 records). [2025-09-18T22:58:44.813299] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:44.813731] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-09-18T22:58:44.818503] [INFO ] [MAIN ] Derivative Progress: 1806/2075 symbols completed. THO took 1.4s. Estimated remaining: 1m 44s. Rate: 154.8 symbols/min [2025-09-18T22:58:44.819794] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:44.833024] [DEBUG] [MAIN ] THR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:44.833805] [INFO ] [MAIN ] THR: Generated 1807 derivative records from 20234 primary records. [2025-09-18T22:58:44.834030] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-09-18T22:58:44.849986] [DEBUG] [LOCAL ] THR: Derivative data saved (1807 records). [2025-09-18T22:58:44.850157] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-09-18T22:58:44.853635] [INFO ] [MAIN ] Derivative Progress: 1807/2075 symbols completed. THR took 0.9s. Estimated remaining: 1m 44s. Rate: 154.9 symbols/min [2025-09-18T22:58:44.858929] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:44.877021] [DEBUG] [LOCAL ] THW: Loaded 19276 existing records from primary storage. [2025-09-18T22:58:44.877237] [INFO ] [MAIN ] THW: Loaded 19276 primary data records. [2025-09-18T22:58:45.011772] [DEBUG] [LOCAL ] THS: Loaded 38245 existing records from primary storage. [2025-09-18T22:58:45.017759] [INFO ] [MAIN ] THS: Loaded 38245 primary data records. [2025-09-18T22:58:45.141475] [DEBUG] [LOCAL ] TIMB: Loaded 37389 existing records from primary storage. [2025-09-18T22:58:45.146853] [INFO ] [MAIN ] TIMB: Loaded 37389 primary data records. [2025-09-18T22:58:45.927002] [DEBUG] [MAIN ] THW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:45.928189] [INFO ] [MAIN ] THW: Generated 1807 derivative records from 19276 primary records. [2025-09-18T22:58:45.928695] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-09-18T22:58:45.946267] [DEBUG] [LOCAL ] THW: Derivative data saved (1807 records). [2025-09-18T22:58:45.946464] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-09-18T22:58:45.949263] [INFO ] [MAIN ] Derivative Progress: 1808/2075 symbols completed. THW took 1.1s. Estimated remaining: 1m 44s. Rate: 154.8 symbols/min [2025-09-18T22:58:45.949906] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:45.965296] [DEBUG] [MAIN ] THS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:45.967244] [INFO ] [MAIN ] THS: Generated 1807 derivative records from 38245 primary records. [2025-09-18T22:58:45.967516] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-09-18T22:58:45.979209] [DEBUG] [LOCAL ] TISI: Loaded 3886 existing records from primary storage. [2025-09-18T22:58:45.981563] [INFO ] [MAIN ] TISI: Loaded 3886 primary data records. [2025-09-18T22:58:46.040667] [DEBUG] [LOCAL ] THS: Derivative data saved (1807 records). [2025-09-18T22:58:46.056333] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-09-18T22:58:46.082436] [DEBUG] [MAIN ] TIMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:46.109691] [INFO ] [MAIN ] Derivative Progress: 1809/2075 symbols completed. THS took 1.3s. Estimated remaining: 1m 43s. Rate: 154.8 symbols/min [2025-09-18T22:58:46.113544] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:46.099585] [INFO ] [MAIN ] TIMB: Generated 1807 derivative records from 37389 primary records. [2025-09-18T22:58:46.113797] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-09-18T22:58:46.205770] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1807 records). [2025-09-18T22:58:46.209711] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-09-18T22:58:46.316265] [INFO ] [MAIN ] Derivative Progress: 1810/2075 symbols completed. TIMB took 1.5s. Estimated remaining: 1m 43s. Rate: 154.8 symbols/min [2025-09-18T22:58:46.330784] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:46.357842] [DEBUG] [LOCAL ] TIXT: Loaded 31399 existing records from primary storage. [2025-09-18T22:58:46.358214] [INFO ] [MAIN ] TIXT: Loaded 31399 primary data records. [2025-09-18T22:58:46.486680] [DEBUG] [MAIN ] TISI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:46.518839] [INFO ] [MAIN ] TISI: Generated 1807 derivative records from 3886 primary records. [2025-09-18T22:58:46.534754] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-09-18T22:58:46.744964] [DEBUG] [LOCAL ] TISI: Derivative data saved (1807 records). [2025-09-18T22:58:46.745884] [DEBUG] [LOCAL ] TJX: Loaded 54066 existing records from primary storage. [2025-09-18T22:58:46.746135] [INFO ] [MAIN ] TJX: Loaded 54066 primary data records. [2025-09-18T22:58:46.746231] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-09-18T22:58:46.770450] [INFO ] [MAIN ] Derivative Progress: 1811/2075 symbols completed. TISI took 0.8s. Estimated remaining: 1m 42s. Rate: 154.8 symbols/min [2025-09-18T22:58:46.807000] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:47.095968] [DEBUG] [MAIN ] TIXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:47.097150] [INFO ] [MAIN ] TIXT: Generated 1807 derivative records from 31399 primary records. [2025-09-18T22:58:47.097299] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-09-18T22:58:47.127136] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1807 records). [2025-09-18T22:58:47.127268] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-09-18T22:58:47.125967] [DEBUG] [LOCAL ] TK: Loaded 40271 existing records from primary storage. [2025-09-18T22:58:47.129949] [INFO ] [MAIN ] Derivative Progress: 1812/2075 symbols completed. TIXT took 1.0s. Estimated remaining: 1m 42s. Rate: 154.8 symbols/min [2025-09-18T22:58:47.127378] [INFO ] [MAIN ] TK: Loaded 40271 primary data records. [2025-09-18T22:58:47.130232] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:47.467090] [DEBUG] [MAIN ] TJX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:47.479283] [INFO ] [MAIN ] TJX: Generated 1807 derivative records from 54066 primary records. [2025-09-18T22:58:47.479565] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-09-18T22:58:47.490184] [DEBUG] [LOCAL ] TKC: Loaded 38120 existing records from primary storage. [2025-09-18T22:58:47.494565] [INFO ] [MAIN ] TKC: Loaded 38120 primary data records. [2025-09-18T22:58:47.498768] [DEBUG] [LOCAL ] TJX: Derivative data saved (1807 records). [2025-09-18T22:58:47.498883] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-09-18T22:58:47.501259] [INFO ] [MAIN ] Derivative Progress: 1813/2075 symbols completed. TJX took 1.2s. Estimated remaining: 1m 42s. Rate: 154.8 symbols/min [2025-09-18T22:58:47.855210] [DEBUG] [MAIN ] TK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:47.856031] [INFO ] [MAIN ] TK: Generated 1807 derivative records from 40271 primary records. [2025-09-18T22:58:47.856262] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-09-18T22:58:47.874407] [DEBUG] [LOCAL ] TK: Derivative data saved (1807 records). [2025-09-18T22:58:47.874525] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-09-18T22:58:47.876951] [INFO ] [MAIN ] Derivative Progress: 1814/2075 symbols completed. TK took 1.1s. Estimated remaining: 1m 41s. Rate: 154.8 symbols/min [2025-09-18T22:58:47.896498] [DEBUG] [MAIN ] TKC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:47.897206] [INFO ] [MAIN ] TKC: Generated 1807 derivative records from 38120 primary records. [2025-09-18T22:58:47.897270] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-09-18T22:58:47.912464] [DEBUG] [LOCAL ] TKC: Derivative data saved (1807 records). [2025-09-18T22:58:47.912540] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-09-18T22:58:47.914583] [INFO ] [MAIN ] Derivative Progress: 1815/2075 symbols completed. TKC took 0.8s. Estimated remaining: 1m 41s. Rate: 154.9 symbols/min [2025-09-18T22:58:47.915203] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:47.915481] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:47.915557] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:47.997040] [DEBUG] [LOCAL ] TLK: Loaded 40251 existing records from primary storage. [2025-09-18T22:58:47.998622] [DEBUG] [LOCAL ] TKR: Loaded 40482 existing records from primary storage. [2025-09-18T22:58:47.999071] [INFO ] [MAIN ] TLK: Loaded 40251 primary data records. [2025-09-18T22:58:47.998994] [INFO ] [MAIN ] TKR: Loaded 40482 primary data records. [2025-09-18T22:58:47.999741] [DEBUG] [LOCAL ] TKO: Loaded 44746 existing records from primary storage. [2025-09-18T22:58:48.000090] [INFO ] [MAIN ] TKO: Loaded 44746 primary data records. [2025-09-18T22:58:49.029423] [DEBUG] [MAIN ] TKO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:49.033250] [INFO ] [MAIN ] TKO: Generated 1807 derivative records from 44746 primary records. [2025-09-18T22:58:49.033460] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-09-18T22:58:49.079378] [DEBUG] [MAIN ] TLK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:49.079934] [DEBUG] [MAIN ] TKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:49.082320] [INFO ] [MAIN ] TLK: Generated 1807 derivative records from 40251 primary records. [2025-09-18T22:58:49.083248] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-09-18T22:58:49.081343] [DEBUG] [LOCAL ] TKO: Derivative data saved (1807 records). [2025-09-18T22:58:49.083184] [INFO ] [MAIN ] TKR: Generated 1807 derivative records from 40482 primary records. [2025-09-18T22:58:49.084231] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-09-18T22:58:49.084344] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-09-18T22:58:49.087283] [INFO ] [MAIN ] Derivative Progress: 1816/2075 symbols completed. TKO took 1.2s. Estimated remaining: 1m 40s. Rate: 154.7 symbols/min [2025-09-18T22:58:49.112576] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:49.116356] [DEBUG] [LOCAL ] TKR: Derivative data saved (1807 records). [2025-09-18T22:58:49.117559] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-09-18T22:58:49.121023] [INFO ] [MAIN ] Derivative Progress: 1817/2075 symbols completed. TKR took 1.2s. Estimated remaining: 1m 40s. Rate: 154.8 symbols/min [2025-09-18T22:58:49.122457] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:49.124501] [DEBUG] [LOCAL ] TLK: Derivative data saved (1807 records). [2025-09-18T22:58:49.125029] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-09-18T22:58:49.127476] [INFO ] [MAIN ] Derivative Progress: 1818/2075 symbols completed. TLK took 1.2s. Estimated remaining: 1m 40s. Rate: 154.9 symbols/min [2025-09-18T22:58:49.127989] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:49.142924] [DEBUG] [LOCAL ] TLYS: Loaded 17081 existing records from primary storage. [2025-09-18T22:58:49.143068] [INFO ] [MAIN ] TLYS: Loaded 17081 primary data records. [2025-09-18T22:58:49.483362] [DEBUG] [LOCAL ] TM: Loaded 37307 existing records from primary storage. [2025-09-18T22:58:49.483694] [INFO ] [MAIN ] TM: Loaded 37307 primary data records. [2025-09-18T22:58:49.614136] [DEBUG] [LOCAL ] TME: Loaded 53590 existing records from primary storage. [2025-09-18T22:58:49.626164] [INFO ] [MAIN ] TME: Loaded 53590 primary data records. [2025-09-18T22:58:50.199306] [DEBUG] [MAIN ] TLYS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:50.201232] [INFO ] [MAIN ] TLYS: Generated 1807 derivative records from 17081 primary records. [2025-09-18T22:58:50.201712] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-09-18T22:58:50.224451] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1807 records). [2025-09-18T22:58:50.225282] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-09-18T22:58:50.227821] [INFO ] [MAIN ] Derivative Progress: 1819/2075 symbols completed. TLYS took 1.1s. Estimated remaining: 1m 39s. Rate: 154.8 symbols/min [2025-09-18T22:58:50.228453] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:50.248025] [DEBUG] [MAIN ] TM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:50.249065] [INFO ] [MAIN ] TM: Generated 1807 derivative records from 37307 primary records. [2025-09-18T22:58:50.249335] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-09-18T22:58:50.268275] [DEBUG] [LOCAL ] TM: Derivative data saved (1807 records). [2025-09-18T22:58:50.268785] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-09-18T22:58:50.270812] [INFO ] [MAIN ] Derivative Progress: 1820/2075 symbols completed. TM took 1.1s. Estimated remaining: 1m 39s. Rate: 154.8 symbols/min [2025-09-18T22:58:50.281833] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:50.298004] [DEBUG] [MAIN ] TME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:50.298901] [INFO ] [MAIN ] TME: Generated 1807 derivative records from 53590 primary records. [2025-09-18T22:58:50.299017] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-09-18T22:58:50.329399] [DEBUG] [LOCAL ] TME: Derivative data saved (1807 records). [2025-09-18T22:58:50.329544] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-09-18T22:58:50.332176] [INFO ] [MAIN ] Derivative Progress: 1821/2075 symbols completed. TME took 1.2s. Estimated remaining: 1m 38s. Rate: 154.9 symbols/min [2025-09-18T22:58:50.332583] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:50.333679] [DEBUG] [LOCAL ] TMHC: Loaded 45970 existing records from primary storage. [2025-09-18T22:58:50.334155] [INFO ] [MAIN ] TMHC: Loaded 45970 primary data records. [2025-09-18T22:58:50.469392] [DEBUG] [LOCAL ] TNC: Loaded 15629 existing records from primary storage. [2025-09-18T22:58:50.495018] [INFO ] [MAIN ] TNC: Loaded 15629 primary data records. [2025-09-18T22:58:50.786053] [DEBUG] [LOCAL ] TMO: Loaded 52722 existing records from primary storage. [2025-09-18T22:58:50.787502] [INFO ] [MAIN ] TMO: Loaded 52722 primary data records. [2025-09-18T22:58:51.318253] [DEBUG] [MAIN ] TMHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:51.321189] [INFO ] [MAIN ] TMHC: Generated 1807 derivative records from 45970 primary records. [2025-09-18T22:58:51.322264] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-09-18T22:58:51.351982] [DEBUG] [MAIN ] TNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:51.353145] [INFO ] [MAIN ] TNC: Generated 1807 derivative records from 15629 primary records. [2025-09-18T22:58:51.352067] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1807 records). [2025-09-18T22:58:51.353419] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-09-18T22:58:51.353606] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-09-18T22:58:51.356242] [INFO ] [MAIN ] Derivative Progress: 1822/2075 symbols completed. TMHC took 1.1s. Estimated remaining: 1m 38s. Rate: 154.8 symbols/min [2025-09-18T22:58:51.357458] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:51.373354] [DEBUG] [LOCAL ] TNC: Derivative data saved (1807 records). [2025-09-18T22:58:51.373453] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-09-18T22:58:51.376452] [INFO ] [MAIN ] Derivative Progress: 1823/2075 symbols completed. TNC took 1.0s. Estimated remaining: 1m 38s. Rate: 154.8 symbols/min [2025-09-18T22:58:51.377773] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:51.392381] [DEBUG] [MAIN ] TMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:51.393302] [INFO ] [MAIN ] TMO: Generated 1807 derivative records from 52722 primary records. [2025-09-18T22:58:51.393430] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-09-18T22:58:51.417944] [DEBUG] [LOCAL ] TMO: Derivative data saved (1807 records). [2025-09-18T22:58:51.418139] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-09-18T22:58:51.420920] [INFO ] [MAIN ] Derivative Progress: 1824/2075 symbols completed. TMO took 1.1s. Estimated remaining: 1m 37s. Rate: 154.9 symbols/min [2025-09-18T22:58:51.421233] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:51.432680] [DEBUG] [LOCAL ] TNET: Loaded 29368 existing records from primary storage. [2025-09-18T22:58:51.432883] [INFO ] [MAIN ] TNET: Loaded 29368 primary data records. [2025-09-18T22:58:51.561046] [DEBUG] [LOCAL ] TNK: Loaded 35731 existing records from primary storage. [2025-09-18T22:58:51.561627] [INFO ] [MAIN ] TNK: Loaded 35731 primary data records. [2025-09-18T22:58:51.925445] [DEBUG] [LOCAL ] TNL: Loaded 42273 existing records from primary storage. [2025-09-18T22:58:51.957242] [INFO ] [MAIN ] TNL: Loaded 42273 primary data records. [2025-09-18T22:58:52.475568] [DEBUG] [MAIN ] TNET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:52.476963] [INFO ] [MAIN ] TNET: Generated 1807 derivative records from 29368 primary records. [2025-09-18T22:58:52.477079] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-09-18T22:58:52.504131] [DEBUG] [LOCAL ] TNET: Derivative data saved (1807 records). [2025-09-18T22:58:52.509697] [DEBUG] [MAIN ] TNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:52.509416] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-09-18T22:58:52.510420] [INFO ] [MAIN ] TNK: Generated 1807 derivative records from 35731 primary records. [2025-09-18T22:58:52.512830] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-09-18T22:58:52.512604] [INFO ] [MAIN ] Derivative Progress: 1825/2075 symbols completed. TNET took 1.2s. Estimated remaining: 1m 37s. Rate: 154.8 symbols/min [2025-09-18T22:58:52.514170] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:52.530716] [DEBUG] [LOCAL ] TNK: Derivative data saved (1807 records). [2025-09-18T22:58:52.531049] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-09-18T22:58:52.533526] [INFO ] [MAIN ] Derivative Progress: 1826/2075 symbols completed. TNK took 1.2s. Estimated remaining: 1m 36s. Rate: 154.8 symbols/min [2025-09-18T22:58:52.533848] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:52.550619] [DEBUG] [MAIN ] TNL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:52.551939] [INFO ] [MAIN ] TNL: Generated 1807 derivative records from 42273 primary records. [2025-09-18T22:58:52.552094] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-09-18T22:58:52.569414] [DEBUG] [LOCAL ] TNL: Derivative data saved (1807 records). [2025-09-18T22:58:52.569614] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-09-18T22:58:52.572321] [INFO ] [MAIN ] Derivative Progress: 1827/2075 symbols completed. TNL took 1.2s. Estimated remaining: 1m 36s. Rate: 154.9 symbols/min [2025-09-18T22:58:52.572753] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:52.622763] [DEBUG] [LOCAL ] TPB: Loaded 25169 existing records from primary storage. [2025-09-18T22:58:52.623098] [INFO ] [MAIN ] TPB: Loaded 25169 primary data records. [2025-09-18T22:58:52.683288] [DEBUG] [LOCAL ] TOL: Loaded 51509 existing records from primary storage. [2025-09-18T22:58:52.740716] [INFO ] [MAIN ] TOL: Loaded 51509 primary data records. [2025-09-18T22:58:52.755424] [DEBUG] [LOCAL ] TOST: Loaded 54071 existing records from primary storage. [2025-09-18T22:58:52.769955] [INFO ] [MAIN ] TOST: Loaded 54071 primary data records. [2025-09-18T22:58:53.592297] [DEBUG] [MAIN ] TPB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:53.593360] [INFO ] [MAIN ] TPB: Generated 1807 derivative records from 25169 primary records. [2025-09-18T22:58:53.594449] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-09-18T22:58:53.626413] [DEBUG] [MAIN ] TOST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:53.627562] [INFO ] [MAIN ] TOST: Generated 1807 derivative records from 54071 primary records. [2025-09-18T22:58:53.639723] [DEBUG] [LOCAL ] TPB: Derivative data saved (1807 records). [2025-09-18T22:58:53.639921] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-09-18T22:58:53.642063] [INFO ] [MAIN ] Derivative Progress: 1828/2075 symbols completed. TPB took 1.1s. Estimated remaining: 1m 36s. Rate: 154.8 symbols/min [2025-09-18T22:58:53.640302] [DEBUG] [MAIN ] TOL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:53.639822] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-09-18T22:58:53.643593] [INFO ] [MAIN ] TOL: Generated 1807 derivative records from 51509 primary records. [2025-09-18T22:58:53.643877] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-09-18T22:58:53.671811] [DEBUG] [LOCAL ] TOL: Derivative data saved (1807 records). [2025-09-18T22:58:53.672097] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-09-18T22:58:53.675246] [INFO ] [MAIN ] Derivative Progress: 1829/2075 symbols completed. TOL took 1.2s. Estimated remaining: 1m 35s. Rate: 154.8 symbols/min [2025-09-18T22:58:53.677000] [DEBUG] [LOCAL ] TOST: Derivative data saved (1807 records). [2025-09-18T22:58:53.677067] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-09-18T22:58:53.679292] [INFO ] [MAIN ] Derivative Progress: 1830/2075 symbols completed. TOST took 1.1s. Estimated remaining: 1m 35s. Rate: 154.9 symbols/min [2025-09-18T22:58:53.679907] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:53.679801] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:53.680001] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:53.695637] [DEBUG] [LOCAL ] TPL: Loaded 12528 existing records from primary storage. [2025-09-18T22:58:53.695904] [INFO ] [MAIN ] TPL: Loaded 12528 primary data records. [2025-09-18T22:58:53.859359] [DEBUG] [LOCAL ] TPC: Loaded 39263 existing records from primary storage. [2025-09-18T22:58:53.923453] [INFO ] [MAIN ] TPC: Loaded 39263 primary data records. [2025-09-18T22:58:53.924192] [DEBUG] [LOCAL ] TPH: Loaded 45657 existing records from primary storage. [2025-09-18T22:58:53.924508] [INFO ] [MAIN ] TPH: Loaded 45657 primary data records. [2025-09-18T22:58:54.742571] [DEBUG] [MAIN ] TPL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:54.744309] [INFO ] [MAIN ] TPL: Generated 1807 derivative records from 12528 primary records. [2025-09-18T22:58:54.744575] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-09-18T22:58:54.764890] [DEBUG] [LOCAL ] TPL: Derivative data saved (1807 records). [2025-09-18T22:58:54.765211] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-09-18T22:58:54.767360] [INFO ] [MAIN ] Derivative Progress: 1831/2075 symbols completed. TPL took 1.1s. Estimated remaining: 1m 35s. Rate: 154.8 symbols/min [2025-09-18T22:58:54.769314] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:54.787061] [DEBUG] [MAIN ] TPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:54.788360] [INFO ] [MAIN ] TPC: Generated 1807 derivative records from 39263 primary records. [2025-09-18T22:58:54.788705] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-09-18T22:58:54.824543] [DEBUG] [MAIN ] TPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:54.826270] [INFO ] [MAIN ] TPH: Generated 1807 derivative records from 45657 primary records. [2025-09-18T22:58:54.826779] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-09-18T22:58:54.846332] [DEBUG] [LOCAL ] TPC: Derivative data saved (1807 records). [2025-09-18T22:58:54.847672] [DEBUG] [LOCAL ] TPH: Derivative data saved (1807 records). [2025-09-18T22:58:54.847911] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-09-18T22:58:54.847799] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-09-18T22:58:54.850814] [INFO ] [MAIN ] Derivative Progress: 1832/2075 symbols completed. TPC took 1.2s. Estimated remaining: 1m 34s. Rate: 154.8 symbols/min [2025-09-18T22:58:54.854100] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:54.854000] [INFO ] [MAIN ] Derivative Progress: 1833/2075 symbols completed. TPH took 1.2s. Estimated remaining: 1m 34s. Rate: 154.9 symbols/min [2025-09-18T22:58:54.854520] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:54.878446] [DEBUG] [LOCAL ] TPYP: Loaded 8065 existing records from primary storage. [2025-09-18T22:58:54.878630] [INFO ] [MAIN ] TPYP: Loaded 8065 primary data records. [2025-09-18T22:58:55.006715] [DEBUG] [LOCAL ] TPR: Loaded 53875 existing records from primary storage. [2025-09-18T22:58:55.011103] [INFO ] [MAIN ] TPR: Loaded 53875 primary data records. [2025-09-18T22:58:55.159861] [DEBUG] [LOCAL ] TPVG: Loaded 27300 existing records from primary storage. [2025-09-18T22:58:55.210482] [INFO ] [MAIN ] TPVG: Loaded 27300 primary data records. [2025-09-18T22:58:55.876425] [DEBUG] [MAIN ] TPYP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:55.879175] [INFO ] [MAIN ] TPYP: Generated 1807 derivative records from 8065 primary records. [2025-09-18T22:58:55.880069] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-09-18T22:58:55.909858] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1807 records). [2025-09-18T22:58:55.910332] [DEBUG] [MAIN ] TPR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:58:55.910429] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-09-18T22:58:55.912544] [INFO ] [MAIN ] Derivative Progress: 1834/2075 symbols completed. TPYP took 1.1s. Estimated remaining: 1m 33s. Rate: 154.8 symbols/min [2025-09-18T22:58:55.912979] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:55.915227] [INFO ] [MAIN ] TPR: Generated 1806 derivative records from 53875 primary records. [2025-09-18T22:58:55.916192] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-09-18T22:58:55.940380] [DEBUG] [MAIN ] TPVG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:55.949195] [DEBUG] [LOCAL ] TPZ: Loaded 5323 existing records from primary storage. [2025-09-18T22:58:55.945755] [INFO ] [MAIN ] TPVG: Generated 1807 derivative records from 27300 primary records. [2025-09-18T22:58:55.949944] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-09-18T22:58:55.950755] [INFO ] [MAIN ] TPZ: Loaded 5323 primary data records. [2025-09-18T22:58:56.015975] [DEBUG] [LOCAL ] TPR: Derivative data saved (1806 records). [2025-09-18T22:58:56.022154] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1807 records). [2025-09-18T22:58:56.044536] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-09-18T22:58:56.047105] [INFO ] [MAIN ] Derivative Progress: 1835/2075 symbols completed. TPR took 1.3s. Estimated remaining: 1m 33s. Rate: 154.8 symbols/min [2025-09-18T22:58:56.047381] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:56.052719] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-09-18T22:58:56.061060] [INFO ] [MAIN ] Derivative Progress: 1836/2075 symbols completed. TPVG took 1.2s. Estimated remaining: 1m 33s. Rate: 154.9 symbols/min [2025-09-18T22:58:56.066992] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:56.319067] [DEBUG] [LOCAL ] TRAK: Loaded 9519 existing records from primary storage. [2025-09-18T22:58:56.327937] [INFO ] [MAIN ] TRAK: Loaded 9519 primary data records. [2025-09-18T22:58:56.391938] [DEBUG] [LOCAL ] TR: Loaded 18344 existing records from primary storage. [2025-09-18T22:58:56.424865] [INFO ] [MAIN ] TR: Loaded 18344 primary data records. [2025-09-18T22:58:56.977317] [DEBUG] [MAIN ] TPZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:56.978776] [INFO ] [MAIN ] TPZ: Generated 1807 derivative records from 5323 primary records. [2025-09-18T22:58:56.978946] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-09-18T22:58:56.998474] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1807 records). [2025-09-18T22:58:56.999910] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-09-18T22:58:57.002575] [INFO ] [MAIN ] Derivative Progress: 1837/2075 symbols completed. TPZ took 1.1s. Estimated remaining: 1m 32s. Rate: 154.8 symbols/min [2025-09-18T22:58:57.003294] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:57.024366] [DEBUG] [MAIN ] TRAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:57.032228] [INFO ] [MAIN ] TRAK: Generated 1807 derivative records from 9519 primary records. [2025-09-18T22:58:57.032457] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-09-18T22:58:57.054007] [DEBUG] [LOCAL ] TRC: Loaded 16154 existing records from primary storage. [2025-09-18T22:58:57.068331] [INFO ] [MAIN ] TRC: Loaded 16154 primary data records. [2025-09-18T22:58:57.061516] [DEBUG] [MAIN ] TR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:57.069882] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1807 records). [2025-09-18T22:58:57.070238] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-09-18T22:58:57.076302] [INFO ] [MAIN ] TR: Generated 1807 derivative records from 18344 primary records. [2025-09-18T22:58:57.076473] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-09-18T22:58:57.078910] [INFO ] [MAIN ] Derivative Progress: 1838/2075 symbols completed. TRAK took 1.0s. Estimated remaining: 1m 32s. Rate: 154.9 symbols/min [2025-09-18T22:58:57.103694] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:57.216761] [DEBUG] [LOCAL ] TR: Derivative data saved (1807 records). [2025-09-18T22:58:57.222097] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-09-18T22:58:57.225068] [INFO ] [MAIN ] Derivative Progress: 1839/2075 symbols completed. TR took 1.2s. Estimated remaining: 1m 31s. Rate: 154.9 symbols/min [2025-09-18T22:58:57.265080] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:57.450096] [DEBUG] [LOCAL ] TREX: Loaded 50357 existing records from primary storage. [2025-09-18T22:58:57.451365] [INFO ] [MAIN ] TREX: Loaded 50357 primary data records. [2025-09-18T22:58:57.687507] [DEBUG] [LOCAL ] TRGP: Loaded 51262 existing records from primary storage. [2025-09-18T22:58:57.688165] [DEBUG] [MAIN ] TRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:57.809373] [INFO ] [MAIN ] TRGP: Loaded 51262 primary data records. [2025-09-18T22:58:57.809073] [INFO ] [MAIN ] TRC: Generated 1807 derivative records from 16154 primary records. [2025-09-18T22:58:57.814964] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-09-18T22:58:58.190699] [DEBUG] [LOCAL ] TRC: Derivative data saved (1807 records). [2025-09-18T22:58:58.199880] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-09-18T22:58:58.202134] [INFO ] [MAIN ] Derivative Progress: 1840/2075 symbols completed. TRC took 1.2s. Estimated remaining: 1m 31s. Rate: 154.8 symbols/min [2025-09-18T22:58:58.202923] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:58.223137] [DEBUG] [MAIN ] TREX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:58.224468] [INFO ] [MAIN ] TREX: Generated 1807 derivative records from 50357 primary records. [2025-09-18T22:58:58.224795] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-09-18T22:58:58.242894] [DEBUG] [LOCAL ] TREX: Derivative data saved (1807 records). [2025-09-18T22:58:58.243014] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-09-18T22:58:58.245356] [INFO ] [MAIN ] Derivative Progress: 1841/2075 symbols completed. TREX took 1.2s. Estimated remaining: 1m 31s. Rate: 154.9 symbols/min [2025-09-18T22:58:58.246061] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:58.275574] [DEBUG] [MAIN ] TRGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:58.287359] [INFO ] [MAIN ] TRGP: Generated 1807 derivative records from 51262 primary records. [2025-09-18T22:58:58.287514] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-09-18T22:58:58.288176] [DEBUG] [LOCAL ] TRN: Loaded 37803 existing records from primary storage. [2025-09-18T22:58:58.289776] [INFO ] [MAIN ] TRN: Loaded 37803 primary data records. [2025-09-18T22:58:58.407430] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1807 records). [2025-09-18T22:58:58.421497] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-09-18T22:58:58.428262] [INFO ] [MAIN ] Derivative Progress: 1842/2075 symbols completed. TRGP took 1.2s. Estimated remaining: 1m 30s. Rate: 154.9 symbols/min [2025-09-18T22:58:58.434461] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:58.483249] [DEBUG] [LOCAL ] TRNO: Loaded 44567 existing records from primary storage. [2025-09-18T22:58:58.503274] [INFO ] [MAIN ] TRNO: Loaded 44567 primary data records. [2025-09-18T22:58:58.997389] [DEBUG] [LOCAL ] TROX: Loaded 52140 existing records from primary storage. [2025-09-18T22:58:58.997955] [INFO ] [MAIN ] TROX: Loaded 52140 primary data records. [2025-09-18T22:58:59.017827] [DEBUG] [MAIN ] TRN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:59.058289] [INFO ] [MAIN ] TRN: Generated 1807 derivative records from 37803 primary records. [2025-09-18T22:58:59.085089] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-09-18T22:58:59.148041] [DEBUG] [LOCAL ] TRN: Derivative data saved (1807 records). [2025-09-18T22:58:59.158480] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-09-18T22:58:59.165981] [INFO ] [MAIN ] Derivative Progress: 1843/2075 symbols completed. TRN took 1.0s. Estimated remaining: 1m 30s. Rate: 154.8 symbols/min [2025-09-18T22:58:59.353405] [DEBUG] [MAIN ] TRNO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:59.354193] [INFO ] [MAIN ] TRNO: Generated 1807 derivative records from 44567 primary records. [2025-09-18T22:58:59.354301] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-09-18T22:58:59.373358] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1807 records). [2025-09-18T22:58:59.373912] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-09-18T22:58:59.376028] [INFO ] [MAIN ] Derivative Progress: 1844/2075 symbols completed. TRNO took 1.1s. Estimated remaining: 1m 29s. Rate: 154.9 symbols/min [2025-09-18T22:58:59.396392] [DEBUG] [MAIN ] TROX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:58:59.397090] [INFO ] [MAIN ] TROX: Generated 1807 derivative records from 52140 primary records. [2025-09-18T22:58:59.397152] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-09-18T22:58:59.413059] [DEBUG] [LOCAL ] TROX: Derivative data saved (1807 records). [2025-09-18T22:58:59.413157] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-09-18T22:58:59.415400] [INFO ] [MAIN ] Derivative Progress: 1845/2075 symbols completed. TROX took 1.0s. Estimated remaining: 1m 29s. Rate: 154.9 symbols/min [2025-09-18T22:58:59.416305] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:59.416230] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:59.416462] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:58:59.466485] [DEBUG] [LOCAL ] TRTX: Loaded 37676 existing records from primary storage. [2025-09-18T22:58:59.466629] [INFO ] [MAIN ] TRTX: Loaded 37676 primary data records. [2025-09-18T22:58:59.667466] [DEBUG] [LOCAL ] TRU: Loaded 51565 existing records from primary storage. [2025-09-18T22:58:59.701957] [INFO ] [MAIN ] TRU: Loaded 51565 primary data records. [2025-09-18T22:58:59.823682] [DEBUG] [LOCAL ] TRP: Loaded 52542 existing records from primary storage. [2025-09-18T22:58:59.884394] [INFO ] [MAIN ] TRP: Loaded 52542 primary data records. [2025-09-18T22:59:00.543253] [DEBUG] [MAIN ] TRTX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:00.544395] [INFO ] [MAIN ] TRTX: Generated 1807 derivative records from 37676 primary records. [2025-09-18T22:59:00.544722] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-09-18T22:59:00.588473] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1807 records). [2025-09-18T22:59:00.586883] [DEBUG] [MAIN ] TRU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:00.588712] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-09-18T22:59:00.591893] [INFO ] [MAIN ] Derivative Progress: 1846/2075 symbols completed. TRTX took 1.2s. Estimated remaining: 1m 29s. Rate: 154.8 symbols/min [2025-09-18T22:59:00.593107] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:00.589586] [INFO ] [MAIN ] TRU: Generated 1807 derivative records from 51565 primary records. [2025-09-18T22:59:00.593805] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-09-18T22:59:00.609077] [DEBUG] [MAIN ] TRP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:00.617436] [INFO ] [MAIN ] TRP: Generated 1807 derivative records from 52542 primary records. [2025-09-18T22:59:00.621761] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-09-18T22:59:00.627269] [DEBUG] [LOCAL ] TRU: Derivative data saved (1807 records). [2025-09-18T22:59:00.636008] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-09-18T22:59:00.641620] [INFO ] [MAIN ] Derivative Progress: 1847/2075 symbols completed. TRU took 1.2s. Estimated remaining: 1m 28s. Rate: 154.9 symbols/min [2025-09-18T22:59:00.643209] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:00.648147] [DEBUG] [LOCAL ] TRP: Derivative data saved (1807 records). [2025-09-18T22:59:00.648388] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-09-18T22:59:00.651310] [INFO ] [MAIN ] Derivative Progress: 1848/2075 symbols completed. TRP took 1.2s. Estimated remaining: 1m 28s. Rate: 154.9 symbols/min [2025-09-18T22:59:00.651699] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:00.710995] [DEBUG] [LOCAL ] TRV: Loaded 48772 existing records from primary storage. [2025-09-18T22:59:00.711310] [INFO ] [MAIN ] TRV: Loaded 48772 primary data records. [2025-09-18T22:59:00.862637] [DEBUG] [LOCAL ] TSE: Loaded 29154 existing records from primary storage. [2025-09-18T22:59:00.862054] [DEBUG] [LOCAL ] TS: Loaded 52076 existing records from primary storage. [2025-09-18T22:59:00.878901] [INFO ] [MAIN ] TS: Loaded 52076 primary data records. [2025-09-18T22:59:00.884305] [INFO ] [MAIN ] TSE: Loaded 29154 primary data records. [2025-09-18T22:59:01.764116] [DEBUG] [MAIN ] TRV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:01.765264] [INFO ] [MAIN ] TRV: Generated 1807 derivative records from 48772 primary records. [2025-09-18T22:59:01.765375] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-09-18T22:59:01.805485] [DEBUG] [MAIN ] TS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:01.803667] [DEBUG] [LOCAL ] TRV: Derivative data saved (1807 records). [2025-09-18T22:59:01.807590] [INFO ] [MAIN ] TS: Generated 1807 derivative records from 52076 primary records. [2025-09-18T22:59:01.808666] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-09-18T22:59:01.809091] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-09-18T22:59:01.811133] [INFO ] [MAIN ] Derivative Progress: 1849/2075 symbols completed. TRV took 1.2s. Estimated remaining: 1m 28s. Rate: 154.8 symbols/min [2025-09-18T22:59:01.813041] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:01.841497] [DEBUG] [MAIN ] TSE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:01.843282] [INFO ] [MAIN ] TSE: Generated 1807 derivative records from 29154 primary records. [2025-09-18T22:59:01.843971] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-09-18T22:59:01.849206] [DEBUG] [LOCAL ] TS: Derivative data saved (1807 records). [2025-09-18T22:59:01.869080] [DEBUG] [LOCAL ] TSI: Loaded 8718 existing records from primary storage. [2025-09-18T22:59:01.868684] [DEBUG] [LOCAL ] TSE: Derivative data saved (1807 records). [2025-09-18T22:59:01.868817] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-09-18T22:59:01.869356] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-09-18T22:59:01.872702] [INFO ] [MAIN ] Derivative Progress: 1850/2075 symbols completed. TS took 1.2s. Estimated remaining: 1m 27s. Rate: 154.8 symbols/min [2025-09-18T22:59:01.869220] [INFO ] [MAIN ] TSI: Loaded 8718 primary data records. [2025-09-18T22:59:01.876145] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:01.875994] [INFO ] [MAIN ] Derivative Progress: 1851/2075 symbols completed. TSE took 1.2s. Estimated remaining: 1m 27s. Rate: 154.9 symbols/min [2025-09-18T22:59:01.924250] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:02.292123] [DEBUG] [LOCAL ] TSLX: Loaded 35680 existing records from primary storage. [2025-09-18T22:59:02.292424] [INFO ] [MAIN ] TSLX: Loaded 35680 primary data records. [2025-09-18T22:59:02.539357] [DEBUG] [LOCAL ] TSM: Loaded 54209 existing records from primary storage. [2025-09-18T22:59:02.544146] [INFO ] [MAIN ] TSM: Loaded 54209 primary data records. [2025-09-18T22:59:03.053615] [DEBUG] [MAIN ] TSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:03.074164] [INFO ] [MAIN ] TSI: Generated 1807 derivative records from 8718 primary records. [2025-09-18T22:59:03.074578] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-09-18T22:59:03.334171] [DEBUG] [LOCAL ] TSI: Derivative data saved (1807 records). [2025-09-18T22:59:03.334858] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-09-18T22:59:03.336905] [INFO ] [MAIN ] Derivative Progress: 1852/2075 symbols completed. TSI took 1.5s. Estimated remaining: 1m 26s. Rate: 154.7 symbols/min [2025-09-18T22:59:03.337718] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:03.358710] [DEBUG] [MAIN ] TSLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:03.359504] [INFO ] [MAIN ] TSLX: Generated 1807 derivative records from 35680 primary records. [2025-09-18T22:59:03.359811] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-09-18T22:59:03.381769] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1807 records). [2025-09-18T22:59:03.382898] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-09-18T22:59:03.385856] [INFO ] [MAIN ] Derivative Progress: 1853/2075 symbols completed. TSLX took 1.5s. Estimated remaining: 1m 26s. Rate: 154.8 symbols/min [2025-09-18T22:59:03.386308] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:03.402494] [DEBUG] [MAIN ] TSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:03.403424] [INFO ] [MAIN ] TSM: Generated 1807 derivative records from 54209 primary records. [2025-09-18T22:59:03.403816] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-09-18T22:59:03.439490] [DEBUG] [LOCAL ] TSM: Derivative data saved (1807 records). [2025-09-18T22:59:03.439755] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-09-18T22:59:03.442533] [INFO ] [MAIN ] Derivative Progress: 1854/2075 symbols completed. TSM took 1.5s. Estimated remaining: 1m 26s. Rate: 154.8 symbols/min [2025-09-18T22:59:03.447786] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:03.448211] [DEBUG] [LOCAL ] TSQ: Loaded 12099 existing records from primary storage. [2025-09-18T22:59:03.449107] [INFO ] [MAIN ] TSQ: Loaded 12099 primary data records. [2025-09-18T22:59:03.530856] [DEBUG] [LOCAL ] TSN: Loaded 53226 existing records from primary storage. [2025-09-18T22:59:03.562018] [INFO ] [MAIN ] TSN: Loaded 53226 primary data records. [2025-09-18T22:59:04.129725] [DEBUG] [LOCAL ] TT: Loaded 48402 existing records from primary storage. [2025-09-18T22:59:04.130144] [INFO ] [MAIN ] TT: Loaded 48402 primary data records. [2025-09-18T22:59:04.463914] [DEBUG] [MAIN ] TSQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:04.464729] [INFO ] [MAIN ] TSQ: Generated 1807 derivative records from 12099 primary records. [2025-09-18T22:59:04.464962] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-09-18T22:59:04.500305] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1807 records). [2025-09-18T22:59:04.499566] [DEBUG] [MAIN ] TSN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:04.501164] [INFO ] [MAIN ] TSN: Generated 1807 derivative records from 53226 primary records. [2025-09-18T22:59:04.501285] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-09-18T22:59:04.501479] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-09-18T22:59:04.503496] [INFO ] [MAIN ] Derivative Progress: 1855/2075 symbols completed. TSQ took 1.1s. Estimated remaining: 1m 25s. Rate: 154.7 symbols/min [2025-09-18T22:59:04.505460] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:04.523080] [DEBUG] [LOCAL ] TSN: Derivative data saved (1807 records). [2025-09-18T22:59:04.523461] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-09-18T22:59:04.526116] [INFO ] [MAIN ] Derivative Progress: 1856/2075 symbols completed. TSN took 1.2s. Estimated remaining: 1m 25s. Rate: 154.8 symbols/min [2025-09-18T22:59:04.526463] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:04.545668] [DEBUG] [MAIN ] TT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:04.546398] [INFO ] [MAIN ] TT: Generated 1807 derivative records from 48402 primary records. [2025-09-18T22:59:04.546536] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-09-18T22:59:04.574031] [DEBUG] [LOCAL ] TT: Derivative data saved (1807 records). [2025-09-18T22:59:04.574204] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-09-18T22:59:04.576894] [INFO ] [MAIN ] Derivative Progress: 1857/2075 symbols completed. TT took 1.1s. Estimated remaining: 1m 24s. Rate: 154.8 symbols/min [2025-09-18T22:59:04.577229] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:04.607358] [DEBUG] [LOCAL ] TTC: Loaded 43308 existing records from primary storage. [2025-09-18T22:59:04.607748] [INFO ] [MAIN ] TTC: Loaded 43308 primary data records. [2025-09-18T22:59:04.731568] [DEBUG] [LOCAL ] TTE: Loaded 52053 existing records from primary storage. [2025-09-18T22:59:04.753373] [INFO ] [MAIN ] TTE: Loaded 52053 primary data records. [2025-09-18T22:59:05.085400] [DEBUG] [LOCAL ] TTI: Loaded 45604 existing records from primary storage. [2025-09-18T22:59:05.085766] [INFO ] [MAIN ] TTI: Loaded 45604 primary data records. [2025-09-18T22:59:05.628472] [DEBUG] [MAIN ] TTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:05.629747] [INFO ] [MAIN ] TTC: Generated 1807 derivative records from 43308 primary records. [2025-09-18T22:59:05.630131] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-09-18T22:59:05.663731] [DEBUG] [MAIN ] TTE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:05.664692] [DEBUG] [LOCAL ] TTC: Derivative data saved (1807 records). [2025-09-18T22:59:05.665390] [INFO ] [MAIN ] TTE: Generated 1807 derivative records from 52053 primary records. [2025-09-18T22:59:05.665710] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-09-18T22:59:05.665934] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-09-18T22:59:05.668379] [INFO ] [MAIN ] Derivative Progress: 1858/2075 symbols completed. TTC took 1.2s. Estimated remaining: 1m 24s. Rate: 154.7 symbols/min [2025-09-18T22:59:05.685990] [DEBUG] [LOCAL ] TTE: Derivative data saved (1807 records). [2025-09-18T22:59:05.686163] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-09-18T22:59:05.688920] [INFO ] [MAIN ] Derivative Progress: 1859/2075 symbols completed. TTE took 1.2s. Estimated remaining: 1m 24s. Rate: 154.8 symbols/min [2025-09-18T22:59:05.703928] [DEBUG] [MAIN ] TTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:05.704580] [INFO ] [MAIN ] TTI: Generated 1807 derivative records from 45604 primary records. [2025-09-18T22:59:05.704685] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-09-18T22:59:05.719944] [DEBUG] [LOCAL ] TTI: Derivative data saved (1807 records). [2025-09-18T22:59:05.720015] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-09-18T22:59:05.722872] [INFO ] [MAIN ] Derivative Progress: 1860/2075 symbols completed. TTI took 1.1s. Estimated remaining: 1m 23s. Rate: 154.8 symbols/min [2025-09-18T22:59:05.723591] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:05.723517] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:05.723777] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:05.797885] [DEBUG] [LOCAL ] TUYA: Loaded 47037 existing records from primary storage. [2025-09-18T22:59:05.798222] [INFO ] [MAIN ] TUYA: Loaded 47037 primary data records. [2025-09-18T22:59:05.928445] [DEBUG] [LOCAL ] TV: Loaded 43423 existing records from primary storage. [2025-09-18T22:59:05.934210] [INFO ] [MAIN ] TV: Loaded 43423 primary data records. [2025-09-18T22:59:05.968540] [DEBUG] [LOCAL ] TU: Loaded 50329 existing records from primary storage. [2025-09-18T22:59:06.037399] [INFO ] [MAIN ] TU: Loaded 50329 primary data records. [2025-09-18T22:59:06.814553] [DEBUG] [MAIN ] TUYA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:06.815544] [INFO ] [MAIN ] TUYA: Generated 1807 derivative records from 47037 primary records. [2025-09-18T22:59:06.815935] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-09-18T22:59:06.833387] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1807 records). [2025-09-18T22:59:06.833710] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-09-18T22:59:06.836511] [INFO ] [MAIN ] Derivative Progress: 1861/2075 symbols completed. TUYA took 1.1s. Estimated remaining: 1m 23s. Rate: 154.7 symbols/min [2025-09-18T22:59:06.838685] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:06.852735] [DEBUG] [MAIN ] TV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:06.855220] [INFO ] [MAIN ] TV: Generated 1807 derivative records from 43423 primary records. [2025-09-18T22:59:06.855346] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-09-18T22:59:06.858889] [DEBUG] [LOCAL ] TVC: Loaded 3569 existing records from primary storage. [2025-09-18T22:59:06.860905] [INFO ] [MAIN ] TVC: Loaded 3569 primary data records. [2025-09-18T22:59:06.943576] [DEBUG] [MAIN ] TU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:06.965916] [INFO ] [MAIN ] TU: Generated 1807 derivative records from 50329 primary records. [2025-09-18T22:59:06.976503] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-09-18T22:59:06.998811] [DEBUG] [LOCAL ] TV: Derivative data saved (1807 records). [2025-09-18T22:59:07.020750] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-09-18T22:59:07.023224] [INFO ] [MAIN ] Derivative Progress: 1862/2075 symbols completed. TV took 1.3s. Estimated remaining: 1m 23s. Rate: 154.7 symbols/min [2025-09-18T22:59:07.028922] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:07.043220] [DEBUG] [LOCAL ] TU: Derivative data saved (1807 records). [2025-09-18T22:59:07.066407] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-09-18T22:59:07.078501] [INFO ] [MAIN ] Derivative Progress: 1863/2075 symbols completed. TU took 1.4s. Estimated remaining: 1m 22s. Rate: 154.8 symbols/min [2025-09-18T22:59:07.082206] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:07.228582] [DEBUG] [LOCAL ] TVE: Loaded 2867 existing records from primary storage. [2025-09-18T22:59:07.228865] [INFO ] [MAIN ] TVE: Loaded 2867 primary data records. [2025-09-18T22:59:07.433434] [DEBUG] [LOCAL ] TWI: Loaded 35162 existing records from primary storage. [2025-09-18T22:59:07.573807] [INFO ] [MAIN ] TWI: Loaded 35162 primary data records. [2025-09-18T22:59:07.762427] [DEBUG] [MAIN ] TVC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:07.785039] [INFO ] [MAIN ] TVC: Generated 1807 derivative records from 3569 primary records. [2025-09-18T22:59:07.907540] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-09-18T22:59:07.925308] [DEBUG] [LOCAL ] TVC: Derivative data saved (1807 records). [2025-09-18T22:59:07.926943] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-09-18T22:59:07.929433] [INFO ] [MAIN ] Derivative Progress: 1864/2075 symbols completed. TVC took 1.1s. Estimated remaining: 1m 22s. Rate: 154.7 symbols/min [2025-09-18T22:59:07.930311] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:07.950034] [DEBUG] [MAIN ] TVE: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-09-18T22:59:07.950795] [INFO ] [MAIN ] TVE: Generated 1805 derivative records from 2867 primary records. [2025-09-18T22:59:07.951007] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-09-18T22:59:07.966224] [DEBUG] [LOCAL ] TVE: Derivative data saved (1805 records). [2025-09-18T22:59:07.966424] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-09-18T22:59:07.968630] [INFO ] [MAIN ] Derivative Progress: 1865/2075 symbols completed. TVE took 0.9s. Estimated remaining: 1m 21s. Rate: 154.8 symbols/min [2025-09-18T22:59:07.969350] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:07.978480] [DEBUG] [LOCAL ] TWN: Loaded 3362 existing records from primary storage. [2025-09-18T22:59:07.978794] [INFO ] [MAIN ] TWN: Loaded 3362 primary data records. [2025-09-18T22:59:08.035030] [DEBUG] [MAIN ] TWI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:08.084418] [INFO ] [MAIN ] TWI: Generated 1807 derivative records from 35162 primary records. [2025-09-18T22:59:08.109539] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-09-18T22:59:08.342033] [DEBUG] [LOCAL ] TWLO: Loaded 53108 existing records from primary storage. [2025-09-18T22:59:08.342827] [INFO ] [MAIN ] TWLO: Loaded 53108 primary data records. [2025-09-18T22:59:08.344031] [DEBUG] [LOCAL ] TWI: Derivative data saved (1807 records). [2025-09-18T22:59:08.344145] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-09-18T22:59:08.346896] [INFO ] [MAIN ] Derivative Progress: 1866/2075 symbols completed. TWI took 1.3s. Estimated remaining: 1m 21s. Rate: 154.8 symbols/min [2025-09-18T22:59:08.359843] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:08.694427] [DEBUG] [MAIN ] TWN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:08.695416] [INFO ] [MAIN ] TWN: Generated 1807 derivative records from 3362 primary records. [2025-09-18T22:59:08.695662] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-09-18T22:59:08.712091] [DEBUG] [LOCAL ] TWN: Derivative data saved (1807 records). [2025-09-18T22:59:08.725179] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-09-18T22:59:08.730109] [INFO ] [MAIN ] Derivative Progress: 1867/2075 symbols completed. TWN took 0.8s. Estimated remaining: 1m 21s. Rate: 154.8 symbols/min [2025-09-18T22:59:08.730616] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:08.731871] [DEBUG] [LOCAL ] TWO: Loaded 48571 existing records from primary storage. [2025-09-18T22:59:08.732055] [INFO ] [MAIN ] TWO: Loaded 48571 primary data records. [2025-09-18T22:59:08.931114] [DEBUG] [LOCAL ] TX: Loaded 23999 existing records from primary storage. [2025-09-18T22:59:08.987869] [DEBUG] [MAIN ] TWLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:08.988861] [INFO ] [MAIN ] TX: Loaded 23999 primary data records. [2025-09-18T22:59:08.988789] [INFO ] [MAIN ] TWLO: Generated 1807 derivative records from 53108 primary records. [2025-09-18T22:59:09.108874] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-09-18T22:59:09.285965] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1807 records). [2025-09-18T22:59:09.296952] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-09-18T22:59:09.319542] [INFO ] [MAIN ] Derivative Progress: 1868/2075 symbols completed. TWLO took 1.4s. Estimated remaining: 1m 20s. Rate: 154.7 symbols/min [2025-09-18T22:59:09.451736] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:09.479713] [DEBUG] [MAIN ] TWO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:09.480518] [INFO ] [MAIN ] TWO: Generated 1807 derivative records from 48571 primary records. [2025-09-18T22:59:09.480793] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-09-18T22:59:09.499391] [DEBUG] [LOCAL ] TWO: Derivative data saved (1807 records). [2025-09-18T22:59:09.499929] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-09-18T22:59:09.501937] [INFO ] [MAIN ] Derivative Progress: 1869/2075 symbols completed. TWO took 1.1s. Estimated remaining: 1m 20s. Rate: 154.8 symbols/min [2025-09-18T22:59:09.514255] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:09.528219] [DEBUG] [MAIN ] TX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:09.529018] [INFO ] [MAIN ] TX: Generated 1807 derivative records from 23999 primary records. [2025-09-18T22:59:09.529170] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-09-18T22:59:09.561944] [DEBUG] [LOCAL ] TXNM: Loaded 44448 existing records from primary storage. [2025-09-18T22:59:09.562953] [INFO ] [MAIN ] TXNM: Loaded 44448 primary data records. [2025-09-18T22:59:09.605313] [DEBUG] [LOCAL ] TXO: Loaded 18834 existing records from primary storage. [2025-09-18T22:59:09.611199] [DEBUG] [LOCAL ] TX: Derivative data saved (1807 records). [2025-09-18T22:59:09.611463] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-09-18T22:59:09.621233] [INFO ] [MAIN ] Derivative Progress: 1870/2075 symbols completed. TX took 0.9s. Estimated remaining: 1m 19s. Rate: 154.8 symbols/min [2025-09-18T22:59:09.640994] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:09.641120] [INFO ] [MAIN ] TXO: Loaded 18834 primary data records. [2025-09-18T22:59:10.246016] [DEBUG] [LOCAL ] TXT: Loaded 50166 existing records from primary storage. [2025-09-18T22:59:10.246684] [INFO ] [MAIN ] TXT: Loaded 50166 primary data records. [2025-09-18T22:59:10.395237] [DEBUG] [MAIN ] TXNM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:10.425436] [INFO ] [MAIN ] TXNM: Generated 1807 derivative records from 44448 primary records. [2025-09-18T22:59:10.434063] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-09-18T22:59:10.472402] [DEBUG] [MAIN ] TXO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:10.593159] [INFO ] [MAIN ] TXO: Generated 1807 derivative records from 18834 primary records. [2025-09-18T22:59:10.601893] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-09-18T22:59:10.626938] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1807 records). [2025-09-18T22:59:10.628583] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-09-18T22:59:10.631155] [INFO ] [MAIN ] Derivative Progress: 1871/2075 symbols completed. TXNM took 1.2s. Estimated remaining: 1m 19s. Rate: 154.7 symbols/min [2025-09-18T22:59:10.632452] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:10.634295] [DEBUG] [LOCAL ] TXO: Derivative data saved (1807 records). [2025-09-18T22:59:10.634883] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-09-18T22:59:10.637516] [INFO ] [MAIN ] Derivative Progress: 1872/2075 symbols completed. TXO took 1.1s. Estimated remaining: 1m 19s. Rate: 154.8 symbols/min [2025-09-18T22:59:10.637870] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:10.647493] [DEBUG] [LOCAL ] TY: Loaded 7746 existing records from primary storage. [2025-09-18T22:59:10.647886] [INFO ] [MAIN ] TY: Loaded 7746 primary data records. [2025-09-18T22:59:10.763520] [DEBUG] [LOCAL ] TYG: Loaded 14583 existing records from primary storage. [2025-09-18T22:59:10.763743] [INFO ] [MAIN ] TYG: Loaded 14583 primary data records. [2025-09-18T22:59:11.115844] [DEBUG] [MAIN ] TXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:11.129239] [INFO ] [MAIN ] TXT: Generated 1807 derivative records from 50166 primary records. [2025-09-18T22:59:11.129949] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-09-18T22:59:11.375324] [DEBUG] [LOCAL ] TXT: Derivative data saved (1807 records). [2025-09-18T22:59:11.376370] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-09-18T22:59:11.383987] [INFO ] [MAIN ] Derivative Progress: 1873/2075 symbols completed. TXT took 1.7s. Estimated remaining: 1m 18s. Rate: 154.7 symbols/min [2025-09-18T22:59:11.407844] [DEBUG] [MAIN ] TY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:11.408805] [INFO ] [MAIN ] TY: Generated 1807 derivative records from 7746 primary records. [2025-09-18T22:59:11.408981] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-09-18T22:59:11.447462] [DEBUG] [LOCAL ] TY: Derivative data saved (1807 records). [2025-09-18T22:59:11.446735] [DEBUG] [MAIN ] TYG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:11.447675] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-09-18T22:59:11.448581] [INFO ] [MAIN ] TYG: Generated 1807 derivative records from 14583 primary records. [2025-09-18T22:59:11.451889] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-09-18T22:59:11.451799] [INFO ] [MAIN ] Derivative Progress: 1874/2075 symbols completed. TY took 0.8s. Estimated remaining: 1m 18s. Rate: 154.8 symbols/min [2025-09-18T22:59:11.467758] [DEBUG] [LOCAL ] TYG: Derivative data saved (1807 records). [2025-09-18T22:59:11.467876] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-09-18T22:59:11.470199] [INFO ] [MAIN ] Derivative Progress: 1875/2075 symbols completed. TYG took 0.8s. Estimated remaining: 1m 17s. Rate: 154.9 symbols/min [2025-09-18T22:59:11.471371] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:11.471295] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:11.471216] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:11.509868] [DEBUG] [LOCAL ] TYL: Loaded 22643 existing records from primary storage. [2025-09-18T22:59:11.510074] [INFO ] [MAIN ] TYL: Loaded 22643 primary data records. [2025-09-18T22:59:11.718314] [DEBUG] [LOCAL ] UA: Loaded 50758 existing records from primary storage. [2025-09-18T22:59:11.778067] [DEBUG] [LOCAL ] U: Loaded 54189 existing records from primary storage. [2025-09-18T22:59:11.784695] [INFO ] [MAIN ] UA: Loaded 50758 primary data records. [2025-09-18T22:59:11.785117] [INFO ] [MAIN ] U: Loaded 54189 primary data records. [2025-09-18T22:59:12.556068] [DEBUG] [MAIN ] TYL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:12.557378] [INFO ] [MAIN ] TYL: Generated 1807 derivative records from 22643 primary records. [2025-09-18T22:59:12.557811] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-09-18T22:59:12.576531] [DEBUG] [LOCAL ] TYL: Derivative data saved (1807 records). [2025-09-18T22:59:12.576789] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-09-18T22:59:12.578835] [INFO ] [MAIN ] Derivative Progress: 1876/2075 symbols completed. TYL took 1.1s. Estimated remaining: 1m 17s. Rate: 154.7 symbols/min [2025-09-18T22:59:12.581112] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:12.598001] [DEBUG] [MAIN ] U: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:12.599151] [INFO ] [MAIN ] U: Generated 1807 derivative records from 54189 primary records. [2025-09-18T22:59:12.599291] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-09-18T22:59:12.612830] [DEBUG] [MAIN ] UA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:12.621136] [INFO ] [MAIN ] UA: Generated 1807 derivative records from 50758 primary records. [2025-09-18T22:59:12.622570] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-09-18T22:59:12.643871] [DEBUG] [LOCAL ] U: Derivative data saved (1807 records). [2025-09-18T22:59:12.644197] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-09-18T22:59:12.647045] [INFO ] [MAIN ] Derivative Progress: 1877/2075 symbols completed. U took 1.2s. Estimated remaining: 1m 17s. Rate: 154.8 symbols/min [2025-09-18T22:59:12.648315] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:12.649898] [DEBUG] [LOCAL ] UA: Derivative data saved (1807 records). [2025-09-18T22:59:12.649982] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-09-18T22:59:12.652252] [INFO ] [MAIN ] Derivative Progress: 1878/2075 symbols completed. UA took 1.2s. Estimated remaining: 1m 16s. Rate: 154.9 symbols/min [2025-09-18T22:59:12.652666] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:12.660125] [DEBUG] [LOCAL ] UAN: Loaded 5573 existing records from primary storage. [2025-09-18T22:59:12.660311] [INFO ] [MAIN ] UAN: Loaded 5573 primary data records. [2025-09-18T22:59:13.038866] [DEBUG] [LOCAL ] UAA: Loaded 53900 existing records from primary storage. [2025-09-18T22:59:13.039313] [INFO ] [MAIN ] UAA: Loaded 53900 primary data records. [2025-09-18T22:59:13.159357] [DEBUG] [LOCAL ] UBER: Loaded 54196 existing records from primary storage. [2025-09-18T22:59:13.172622] [INFO ] [MAIN ] UBER: Loaded 54196 primary data records. [2025-09-18T22:59:13.711455] [DEBUG] [MAIN ] UAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:13.713014] [INFO ] [MAIN ] UAN: Generated 1807 derivative records from 5573 primary records. [2025-09-18T22:59:13.713322] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-09-18T22:59:13.735781] [DEBUG] [LOCAL ] UAN: Derivative data saved (1807 records). [2025-09-18T22:59:13.736194] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-09-18T22:59:13.738353] [INFO ] [MAIN ] Derivative Progress: 1879/2075 symbols completed. UAN took 1.1s. Estimated remaining: 1m 16s. Rate: 154.7 symbols/min [2025-09-18T22:59:13.739330] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:13.753200] [DEBUG] [MAIN ] UAA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:13.756275] [INFO ] [MAIN ] UAA: Generated 1807 derivative records from 53900 primary records. [2025-09-18T22:59:13.757197] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-09-18T22:59:13.782797] [DEBUG] [MAIN ] UBER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:13.784114] [INFO ] [MAIN ] UBER: Generated 1807 derivative records from 54196 primary records. [2025-09-18T22:59:13.785467] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-09-18T22:59:13.804724] [DEBUG] [LOCAL ] UAA: Derivative data saved (1807 records). [2025-09-18T22:59:13.805869] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-09-18T22:59:13.807903] [INFO ] [MAIN ] Derivative Progress: 1880/2075 symbols completed. UAA took 1.2s. Estimated remaining: 1m 16s. Rate: 154.8 symbols/min [2025-09-18T22:59:13.808899] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:13.812211] [DEBUG] [LOCAL ] UBER: Derivative data saved (1807 records). [2025-09-18T22:59:13.812363] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-09-18T22:59:13.815264] [INFO ] [MAIN ] Derivative Progress: 1881/2075 symbols completed. UBER took 1.2s. Estimated remaining: 1m 15s. Rate: 154.9 symbols/min [2025-09-18T22:59:13.815604] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:13.853811] [DEBUG] [LOCAL ] UBS: Loaded 52883 existing records from primary storage. [2025-09-18T22:59:13.863676] [INFO ] [MAIN ] UBS: Loaded 52883 primary data records. [2025-09-18T22:59:14.008876] [DEBUG] [LOCAL ] UCB: Loaded 38471 existing records from primary storage. [2025-09-18T22:59:14.013670] [INFO ] [MAIN ] UCB: Loaded 38471 primary data records. [2025-09-18T22:59:14.216136] [DEBUG] [LOCAL ] UDR: Loaded 52187 existing records from primary storage. [2025-09-18T22:59:14.221727] [INFO ] [MAIN ] UDR: Loaded 52187 primary data records. [2025-09-18T22:59:14.983597] [DEBUG] [MAIN ] UBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:14.987022] [INFO ] [MAIN ] UBS: Generated 1807 derivative records from 52883 primary records. [2025-09-18T22:59:14.987178] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-09-18T22:59:15.017386] [DEBUG] [MAIN ] UCB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:15.020184] [INFO ] [MAIN ] UCB: Generated 1807 derivative records from 38471 primary records. [2025-09-18T22:59:15.020626] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-09-18T22:59:15.023150] [DEBUG] [LOCAL ] UBS: Derivative data saved (1807 records). [2025-09-18T22:59:15.023400] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-09-18T22:59:15.025353] [INFO ] [MAIN ] Derivative Progress: 1882/2075 symbols completed. UBS took 1.3s. Estimated remaining: 1m 15s. Rate: 154.7 symbols/min [2025-09-18T22:59:15.027103] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:15.058341] [DEBUG] [LOCAL ] UCB: Derivative data saved (1807 records). [2025-09-18T22:59:15.058804] [DEBUG] [MAIN ] UDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:15.059718] [INFO ] [MAIN ] UDR: Generated 1807 derivative records from 52187 primary records. [2025-09-18T22:59:15.059880] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-09-18T22:59:15.060001] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-09-18T22:59:15.062179] [INFO ] [MAIN ] Derivative Progress: 1883/2075 symbols completed. UCB took 1.3s. Estimated remaining: 1m 14s. Rate: 154.8 symbols/min [2025-09-18T22:59:15.063372] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:15.087275] [DEBUG] [LOCAL ] UFI: Loaded 8340 existing records from primary storage. [2025-09-18T22:59:15.088192] [INFO ] [MAIN ] UFI: Loaded 8340 primary data records. [2025-09-18T22:59:15.127242] [DEBUG] [LOCAL ] UDR: Derivative data saved (1807 records). [2025-09-18T22:59:15.162745] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-09-18T22:59:15.171134] [INFO ] [MAIN ] Derivative Progress: 1884/2075 symbols completed. UDR took 1.4s. Estimated remaining: 1m 14s. Rate: 154.8 symbols/min [2025-09-18T22:59:15.194432] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:15.317328] [DEBUG] [LOCAL ] UE: Loaded 43394 existing records from primary storage. [2025-09-18T22:59:15.317725] [INFO ] [MAIN ] UE: Loaded 43394 primary data records. [2025-09-18T22:59:15.777813] [DEBUG] [LOCAL ] UGI: Loaded 50925 existing records from primary storage. [2025-09-18T22:59:15.792546] [INFO ] [MAIN ] UGI: Loaded 50925 primary data records. [2025-09-18T22:59:15.972018] [DEBUG] [MAIN ] UFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:16.042590] [INFO ] [MAIN ] UFI: Generated 1807 derivative records from 8340 primary records. [2025-09-18T22:59:16.122994] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-09-18T22:59:16.142518] [DEBUG] [LOCAL ] UFI: Derivative data saved (1807 records). [2025-09-18T22:59:16.142998] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-09-18T22:59:16.145069] [INFO ] [MAIN ] Derivative Progress: 1885/2075 symbols completed. UFI took 1.1s. Estimated remaining: 1m 14s. Rate: 154.7 symbols/min [2025-09-18T22:59:16.145801] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:16.159382] [DEBUG] [MAIN ] UE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:16.160228] [INFO ] [MAIN ] UE: Generated 1807 derivative records from 43394 primary records. [2025-09-18T22:59:16.160523] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-09-18T22:59:16.179692] [DEBUG] [LOCAL ] UE: Derivative data saved (1807 records). [2025-09-18T22:59:16.179822] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-09-18T22:59:16.182235] [INFO ] [MAIN ] Derivative Progress: 1886/2075 symbols completed. UE took 1.2s. Estimated remaining: 1m 13s. Rate: 154.8 symbols/min [2025-09-18T22:59:16.182795] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:16.200426] [DEBUG] [MAIN ] UGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:16.201251] [INFO ] [MAIN ] UGI: Generated 1807 derivative records from 50925 primary records. [2025-09-18T22:59:16.201386] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-09-18T22:59:16.235054] [DEBUG] [LOCAL ] UHAL: Loaded 16528 existing records from primary storage. [2025-09-18T22:59:16.235728] [INFO ] [MAIN ] UHAL: Loaded 16528 primary data records. [2025-09-18T22:59:16.270123] [DEBUG] [LOCAL ] UGI: Derivative data saved (1807 records). [2025-09-18T22:59:16.304754] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-09-18T22:59:16.312290] [INFO ] [MAIN ] Derivative Progress: 1887/2075 symbols completed. UGI took 1.1s. Estimated remaining: 1m 13s. Rate: 154.8 symbols/min [2025-09-18T22:59:16.359544] [DEBUG] [LOCAL ] UGP: Loaded 42890 existing records from primary storage. [2025-09-18T22:59:16.359766] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:16.359875] [INFO ] [MAIN ] UGP: Loaded 42890 primary data records. [2025-09-18T22:59:16.896332] [DEBUG] [LOCAL ] UHS: Loaded 41794 existing records from primary storage. [2025-09-18T22:59:16.897140] [INFO ] [MAIN ] UHS: Loaded 41794 primary data records. [2025-09-18T22:59:17.041999] [DEBUG] [MAIN ] UHAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:17.071733] [INFO ] [MAIN ] UHAL: Generated 1807 derivative records from 16528 primary records. [2025-09-18T22:59:17.094177] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-09-18T22:59:17.318492] [DEBUG] [MAIN ] UGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:17.320100] [INFO ] [MAIN ] UGP: Generated 1807 derivative records from 42890 primary records. [2025-09-18T22:59:17.321456] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-09-18T22:59:17.336698] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1807 records). [2025-09-18T22:59:17.337346] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-09-18T22:59:17.339766] [INFO ] [MAIN ] Derivative Progress: 1888/2075 symbols completed. UHAL took 1.2s. Estimated remaining: 1m 13s. Rate: 154.7 symbols/min [2025-09-18T22:59:17.347638] [DEBUG] [LOCAL ] UGP: Derivative data saved (1807 records). [2025-09-18T22:59:17.347889] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-09-18T22:59:17.350397] [INFO ] [MAIN ] Derivative Progress: 1889/2075 symbols completed. UGP took 1.2s. Estimated remaining: 1m 12s. Rate: 154.8 symbols/min [2025-09-18T22:59:17.368291] [DEBUG] [MAIN ] UHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:17.368952] [INFO ] [MAIN ] UHS: Generated 1807 derivative records from 41794 primary records. [2025-09-18T22:59:17.369014] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-09-18T22:59:17.385066] [DEBUG] [LOCAL ] UHS: Derivative data saved (1807 records). [2025-09-18T22:59:17.385140] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-09-18T22:59:17.387681] [INFO ] [MAIN ] Derivative Progress: 1890/2075 symbols completed. UHS took 1.0s. Estimated remaining: 1m 12s. Rate: 154.8 symbols/min [2025-09-18T22:59:17.388516] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:17.388720] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:17.388426] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:17.405520] [DEBUG] [LOCAL ] UHT: Loaded 10094 existing records from primary storage. [2025-09-18T22:59:17.405738] [INFO ] [MAIN ] UHT: Loaded 10094 primary data records. [2025-09-18T22:59:17.455157] [DEBUG] [LOCAL ] UI: Loaded 12646 existing records from primary storage. [2025-09-18T22:59:17.491484] [INFO ] [MAIN ] UI: Loaded 12646 primary data records. [2025-09-18T22:59:17.644720] [DEBUG] [LOCAL ] UIS: Loaded 37454 existing records from primary storage. [2025-09-18T22:59:17.660867] [INFO ] [MAIN ] UIS: Loaded 37454 primary data records. [2025-09-18T22:59:18.399177] [DEBUG] [MAIN ] UHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:18.401102] [INFO ] [MAIN ] UHT: Generated 1807 derivative records from 10094 primary records. [2025-09-18T22:59:18.401361] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-09-18T22:59:18.422823] [DEBUG] [MAIN ] UI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:18.428227] [INFO ] [MAIN ] UI: Generated 1807 derivative records from 12646 primary records. [2025-09-18T22:59:18.430452] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-09-18T22:59:18.459407] [DEBUG] [MAIN ] UIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:18.461173] [INFO ] [MAIN ] UIS: Generated 1807 derivative records from 37454 primary records. [2025-09-18T22:59:18.462016] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-09-18T22:59:18.463564] [DEBUG] [LOCAL ] UHT: Derivative data saved (1807 records). [2025-09-18T22:59:18.463728] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-09-18T22:59:18.465987] [INFO ] [MAIN ] Derivative Progress: 1891/2075 symbols completed. UHT took 1.1s. Estimated remaining: 1m 11s. Rate: 154.7 symbols/min [2025-09-18T22:59:18.467220] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:18.481701] [DEBUG] [LOCAL ] UI: Derivative data saved (1807 records). [2025-09-18T22:59:18.481902] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-09-18T22:59:18.484449] [INFO ] [MAIN ] Derivative Progress: 1892/2075 symbols completed. UI took 1.1s. Estimated remaining: 1m 11s. Rate: 154.8 symbols/min [2025-09-18T22:59:18.485122] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:18.488383] [DEBUG] [LOCAL ] UIS: Derivative data saved (1807 records). [2025-09-18T22:59:18.488604] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-09-18T22:59:18.491465] [INFO ] [MAIN ] Derivative Progress: 1893/2075 symbols completed. UIS took 1.1s. Estimated remaining: 1m 11s. Rate: 154.8 symbols/min [2025-09-18T22:59:18.491828] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:18.557696] [DEBUG] [LOCAL ] ULS: Loaded 39475 existing records from primary storage. [2025-09-18T22:59:18.557906] [INFO ] [MAIN ] ULS: Loaded 39475 primary data records. [2025-09-18T22:59:18.704935] [DEBUG] [LOCAL ] UL: Loaded 53461 existing records from primary storage. [2025-09-18T22:59:18.720630] [INFO ] [MAIN ] UL: Loaded 53461 primary data records. [2025-09-18T22:59:18.821422] [DEBUG] [LOCAL ] UMC: Loaded 53118 existing records from primary storage. [2025-09-18T22:59:18.978091] [INFO ] [MAIN ] UMC: Loaded 53118 primary data records. [2025-09-18T22:59:19.601782] [DEBUG] [MAIN ] ULS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:19.604607] [INFO ] [MAIN ] ULS: Generated 1807 derivative records from 39475 primary records. [2025-09-18T22:59:19.606126] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-09-18T22:59:19.633988] [DEBUG] [LOCAL ] ULS: Derivative data saved (1807 records). [2025-09-18T22:59:19.640138] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-09-18T22:59:19.641282] [DEBUG] [MAIN ] UL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:19.643461] [INFO ] [MAIN ] Derivative Progress: 1894/2075 symbols completed. ULS took 1.2s. Estimated remaining: 1m 10s. Rate: 154.7 symbols/min [2025-09-18T22:59:19.643855] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:19.645078] [INFO ] [MAIN ] UL: Generated 1807 derivative records from 53461 primary records. [2025-09-18T22:59:19.645541] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-09-18T22:59:19.660275] [DEBUG] [MAIN ] UMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:19.668394] [INFO ] [MAIN ] UMC: Generated 1807 derivative records from 53118 primary records. [2025-09-18T22:59:19.672288] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-09-18T22:59:19.692683] [DEBUG] [LOCAL ] UMC: Derivative data saved (1807 records). [2025-09-18T22:59:19.693309] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-09-18T22:59:19.697704] [DEBUG] [LOCAL ] UL: Derivative data saved (1807 records). [2025-09-18T22:59:19.697470] [INFO ] [MAIN ] Derivative Progress: 1895/2075 symbols completed. UMC took 1.2s. Estimated remaining: 1m 10s. Rate: 154.8 symbols/min [2025-09-18T22:59:19.698278] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:19.697882] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-09-18T22:59:19.701432] [INFO ] [MAIN ] Derivative Progress: 1896/2075 symbols completed. UL took 1.2s. Estimated remaining: 1m 9s. Rate: 154.8 symbols/min [2025-09-18T22:59:19.702372] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:19.732305] [DEBUG] [LOCAL ] UNF: Loaded 11907 existing records from primary storage. [2025-09-18T22:59:19.732502] [INFO ] [MAIN ] UNF: Loaded 11907 primary data records. [2025-09-18T22:59:19.744583] [DEBUG] [LOCAL ] UMH: Loaded 33251 existing records from primary storage. [2025-09-18T22:59:19.764623] [INFO ] [MAIN ] UMH: Loaded 33251 primary data records. [2025-09-18T22:59:20.237308] [DEBUG] [LOCAL ] UNFI: Loaded 42263 existing records from primary storage. [2025-09-18T22:59:20.242818] [INFO ] [MAIN ] UNFI: Loaded 42263 primary data records. [2025-09-18T22:59:20.718962] [DEBUG] [MAIN ] UMH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:20.720384] [INFO ] [MAIN ] UMH: Generated 1807 derivative records from 33251 primary records. [2025-09-18T22:59:20.732951] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-09-18T22:59:20.734312] [DEBUG] [MAIN ] UNF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:20.736449] [INFO ] [MAIN ] UNF: Generated 1807 derivative records from 11907 primary records. [2025-09-18T22:59:20.748693] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-09-18T22:59:20.754173] [DEBUG] [LOCAL ] UMH: Derivative data saved (1807 records). [2025-09-18T22:59:20.765106] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-09-18T22:59:20.769968] [INFO ] [MAIN ] Derivative Progress: 1897/2075 symbols completed. UMH took 1.1s. Estimated remaining: 1m 9s. Rate: 154.7 symbols/min [2025-09-18T22:59:20.772866] [DEBUG] [LOCAL ] UNF: Derivative data saved (1807 records). [2025-09-18T22:59:20.773154] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-09-18T22:59:20.770564] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:20.775775] [INFO ] [MAIN ] Derivative Progress: 1898/2075 symbols completed. UNF took 1.1s. Estimated remaining: 1m 9s. Rate: 154.8 symbols/min [2025-09-18T22:59:20.776196] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:20.793389] [DEBUG] [MAIN ] UNFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:20.794279] [INFO ] [MAIN ] UNFI: Generated 1807 derivative records from 42263 primary records. [2025-09-18T22:59:20.794404] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-09-18T22:59:20.822491] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1807 records). [2025-09-18T22:59:20.822808] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-09-18T22:59:20.825620] [INFO ] [MAIN ] Derivative Progress: 1899/2075 symbols completed. UNFI took 1.1s. Estimated remaining: 1m 8s. Rate: 154.8 symbols/min [2025-09-18T22:59:20.825959] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:20.832534] [DEBUG] [LOCAL ] UNMA: Loaded 3759 existing records from primary storage. [2025-09-18T22:59:20.843188] [INFO ] [MAIN ] UNMA: Loaded 3759 primary data records. [2025-09-18T22:59:21.009421] [DEBUG] [LOCAL ] UNM: Loaded 49184 existing records from primary storage. [2025-09-18T22:59:21.025083] [INFO ] [MAIN ] UNM: Loaded 49184 primary data records. [2025-09-18T22:59:21.071613] [DEBUG] [LOCAL ] UNH: Loaded 54183 existing records from primary storage. [2025-09-18T22:59:21.113921] [INFO ] [MAIN ] UNH: Loaded 54183 primary data records. [2025-09-18T22:59:21.910326] [DEBUG] [MAIN ] UNMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:21.912558] [INFO ] [MAIN ] UNMA: Generated 1807 derivative records from 3759 primary records. [2025-09-18T22:59:21.913221] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-09-18T22:59:21.934438] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1807 records). [2025-09-18T22:59:21.949890] [DEBUG] [MAIN ] UNM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:21.949384] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-09-18T22:59:21.952172] [INFO ] [MAIN ] Derivative Progress: 1900/2075 symbols completed. UNMA took 1.1s. Estimated remaining: 1m 8s. Rate: 154.7 symbols/min [2025-09-18T22:59:21.953190] [INFO ] [MAIN ] UNM: Generated 1807 derivative records from 49184 primary records. [2025-09-18T22:59:21.953562] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:21.953739] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-09-18T22:59:21.975828] [DEBUG] [MAIN ] UNH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:21.976579] [INFO ] [MAIN ] UNH: Generated 1807 derivative records from 54183 primary records. [2025-09-18T22:59:21.981024] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-09-18T22:59:22.007045] [DEBUG] [LOCAL ] UNM: Derivative data saved (1807 records). [2025-09-18T22:59:22.008288] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-09-18T22:59:22.010905] [INFO ] [MAIN ] Derivative Progress: 1901/2075 symbols completed. UNM took 1.2s. Estimated remaining: 1m 7s. Rate: 154.8 symbols/min [2025-09-18T22:59:22.011841] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:22.011911] [DEBUG] [LOCAL ] UNH: Derivative data saved (1807 records). [2025-09-18T22:59:22.012021] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-09-18T22:59:22.015269] [INFO ] [MAIN ] Derivative Progress: 1902/2075 symbols completed. UNH took 1.2s. Estimated remaining: 1m 7s. Rate: 154.8 symbols/min [2025-09-18T22:59:22.015891] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:22.091148] [DEBUG] [LOCAL ] UNP: Loaded 53610 existing records from primary storage. [2025-09-18T22:59:22.091436] [INFO ] [MAIN ] UNP: Loaded 53610 primary data records. [2025-09-18T22:59:22.221304] [DEBUG] [LOCAL ] UPS: Loaded 54100 existing records from primary storage. [2025-09-18T22:59:22.225517] [INFO ] [MAIN ] UPS: Loaded 54100 primary data records. [2025-09-18T22:59:22.225363] [DEBUG] [LOCAL ] UP: Loaded 43319 existing records from primary storage. [2025-09-18T22:59:22.231415] [INFO ] [MAIN ] UP: Loaded 43319 primary data records. [2025-09-18T22:59:23.149179] [DEBUG] [MAIN ] UNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:23.150625] [INFO ] [MAIN ] UNP: Generated 1807 derivative records from 53610 primary records. [2025-09-18T22:59:23.150828] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-09-18T22:59:23.191222] [DEBUG] [MAIN ] UPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:23.193475] [DEBUG] [LOCAL ] UNP: Derivative data saved (1807 records). [2025-09-18T22:59:23.194259] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-09-18T22:59:23.197796] [INFO ] [MAIN ] Derivative Progress: 1903/2075 symbols completed. UNP took 1.2s. Estimated remaining: 1m 7s. Rate: 154.7 symbols/min [2025-09-18T22:59:23.195133] [INFO ] [MAIN ] UPS: Generated 1807 derivative records from 54100 primary records. [2025-09-18T22:59:23.198033] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-09-18T22:59:23.212227] [DEBUG] [MAIN ] UP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:23.226673] [INFO ] [MAIN ] UP: Generated 1807 derivative records from 43319 primary records. [2025-09-18T22:59:23.228194] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-09-18T22:59:23.246167] [DEBUG] [LOCAL ] UPS: Derivative data saved (1807 records). [2025-09-18T22:59:23.247349] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-09-18T22:59:23.249705] [INFO ] [MAIN ] Derivative Progress: 1904/2075 symbols completed. UPS took 1.2s. Estimated remaining: 1m 6s. Rate: 154.7 symbols/min [2025-09-18T22:59:23.249798] [DEBUG] [LOCAL ] UP: Derivative data saved (1807 records). [2025-09-18T22:59:23.249944] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-09-18T22:59:23.252876] [INFO ] [MAIN ] Derivative Progress: 1905/2075 symbols completed. UP took 1.2s. Estimated remaining: 1m 6s. Rate: 154.8 symbols/min [2025-09-18T22:59:23.253822] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:23.253518] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:23.253716] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:23.300335] [DEBUG] [LOCAL ] USAC: Loaded 23233 existing records from primary storage. [2025-09-18T22:59:23.300550] [INFO ] [MAIN ] USAC: Loaded 23233 primary data records. [2025-09-18T22:59:23.398087] [DEBUG] [LOCAL ] URI: Loaded 37118 existing records from primary storage. [2025-09-18T22:59:23.420295] [DEBUG] [LOCAL ] USA: Loaded 36577 existing records from primary storage. [2025-09-18T22:59:23.443360] [INFO ] [MAIN ] USA: Loaded 36577 primary data records. [2025-09-18T22:59:23.425787] [INFO ] [MAIN ] URI: Loaded 37118 primary data records. [2025-09-18T22:59:24.352998] [DEBUG] [MAIN ] USAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:24.367127] [INFO ] [MAIN ] USAC: Generated 1807 derivative records from 23233 primary records. [2025-09-18T22:59:24.366259] [DEBUG] [MAIN ] USA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:24.368208] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-09-18T22:59:24.368117] [INFO ] [MAIN ] USA: Generated 1807 derivative records from 36577 primary records. [2025-09-18T22:59:24.368978] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-09-18T22:59:24.413386] [DEBUG] [MAIN ] URI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:24.415066] [INFO ] [MAIN ] URI: Generated 1807 derivative records from 37118 primary records. [2025-09-18T22:59:24.415423] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-09-18T22:59:24.418312] [DEBUG] [LOCAL ] USAC: Derivative data saved (1807 records). [2025-09-18T22:59:24.426504] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-09-18T22:59:24.433389] [INFO ] [MAIN ] Derivative Progress: 1906/2075 symbols completed. USAC took 1.2s. Estimated remaining: 1m 6s. Rate: 154.7 symbols/min [2025-09-18T22:59:24.433974] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:24.434931] [DEBUG] [LOCAL ] USA: Derivative data saved (1807 records). [2025-09-18T22:59:24.437827] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-09-18T22:59:24.441174] [INFO ] [MAIN ] Derivative Progress: 1907/2075 symbols completed. USA took 1.2s. Estimated remaining: 1m 5s. Rate: 154.7 symbols/min [2025-09-18T22:59:24.441799] [DEBUG] [LOCAL ] URI: Derivative data saved (1807 records). [2025-09-18T22:59:24.442061] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-09-18T22:59:24.442131] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:24.444858] [INFO ] [MAIN ] Derivative Progress: 1908/2075 symbols completed. URI took 1.2s. Estimated remaining: 1m 5s. Rate: 154.8 symbols/min [2025-09-18T22:59:24.445459] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:24.475047] [DEBUG] [LOCAL ] USNA: Loaded 18545 existing records from primary storage. [2025-09-18T22:59:24.475212] [INFO ] [MAIN ] USNA: Loaded 18545 primary data records. [2025-09-18T22:59:24.795393] [DEBUG] [LOCAL ] USFD: Loaded 51643 existing records from primary storage. [2025-09-18T22:59:24.796935] [DEBUG] [LOCAL ] USB: Loaded 54078 existing records from primary storage. [2025-09-18T22:59:24.839379] [INFO ] [MAIN ] USFD: Loaded 51643 primary data records. [2025-09-18T22:59:24.839258] [INFO ] [MAIN ] USB: Loaded 54078 primary data records. [2025-09-18T22:59:25.531458] [DEBUG] [MAIN ] USNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:25.533601] [INFO ] [MAIN ] USNA: Generated 1807 derivative records from 18545 primary records. [2025-09-18T22:59:25.533895] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-09-18T22:59:25.552283] [DEBUG] [LOCAL ] USNA: Derivative data saved (1807 records). [2025-09-18T22:59:25.552601] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-09-18T22:59:25.554917] [INFO ] [MAIN ] Derivative Progress: 1909/2075 symbols completed. USNA took 1.1s. Estimated remaining: 1m 4s. Rate: 154.7 symbols/min [2025-09-18T22:59:25.555742] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:25.575264] [DEBUG] [MAIN ] USB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:25.580618] [INFO ] [MAIN ] USB: Generated 1807 derivative records from 54078 primary records. [2025-09-18T22:59:25.580893] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-09-18T22:59:25.601007] [DEBUG] [LOCAL ] USB: Derivative data saved (1807 records). [2025-09-18T22:59:25.606945] [DEBUG] [LOCAL ] USPH: Loaded 16781 existing records from primary storage. [2025-09-18T22:59:25.607101] [INFO ] [MAIN ] USPH: Loaded 16781 primary data records. [2025-09-18T22:59:25.607289] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-09-18T22:59:25.609301] [INFO ] [MAIN ] Derivative Progress: 1910/2075 symbols completed. USB took 1.2s. Estimated remaining: 1m 4s. Rate: 154.7 symbols/min [2025-09-18T22:59:25.658199] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:25.663834] [DEBUG] [MAIN ] USFD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:25.699294] [INFO ] [MAIN ] USFD: Generated 1807 derivative records from 51643 primary records. [2025-09-18T22:59:25.709708] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-09-18T22:59:25.822586] [DEBUG] [LOCAL ] USFD: Derivative data saved (1807 records). [2025-09-18T22:59:25.826767] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-09-18T22:59:25.933516] [INFO ] [MAIN ] Derivative Progress: 1911/2075 symbols completed. USFD took 1.5s. Estimated remaining: 1m 4s. Rate: 154.7 symbols/min [2025-09-18T22:59:25.955697] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:25.969612] [DEBUG] [LOCAL ] UTF: Loaded 28516 existing records from primary storage. [2025-09-18T22:59:25.970076] [INFO ] [MAIN ] UTF: Loaded 28516 primary data records. [2025-09-18T22:59:26.294914] [DEBUG] [LOCAL ] UTI: Loaded 40997 existing records from primary storage. [2025-09-18T22:59:26.295307] [INFO ] [MAIN ] UTI: Loaded 40997 primary data records. [2025-09-18T22:59:26.421441] [DEBUG] [MAIN ] USPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:26.443905] [INFO ] [MAIN ] USPH: Generated 1807 derivative records from 16781 primary records. [2025-09-18T22:59:26.481990] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-09-18T22:59:26.643202] [DEBUG] [LOCAL ] USPH: Derivative data saved (1807 records). [2025-09-18T22:59:26.645866] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-09-18T22:59:26.648106] [INFO ] [MAIN ] Derivative Progress: 1912/2075 symbols completed. USPH took 1.1s. Estimated remaining: 1m 3s. Rate: 154.7 symbols/min [2025-09-18T22:59:26.649802] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:26.665334] [DEBUG] [MAIN ] UTF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:26.668151] [INFO ] [MAIN ] UTF: Generated 1807 derivative records from 28516 primary records. [2025-09-18T22:59:26.668808] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-09-18T22:59:26.690036] [DEBUG] [LOCAL ] UTF: Derivative data saved (1807 records). [2025-09-18T22:59:26.690271] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-09-18T22:59:26.693020] [INFO ] [MAIN ] Derivative Progress: 1913/2075 symbols completed. UTF took 1.0s. Estimated remaining: 1m 3s. Rate: 154.8 symbols/min [2025-09-18T22:59:26.693507] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:26.698629] [DEBUG] [LOCAL ] UTL: Loaded 10959 existing records from primary storage. [2025-09-18T22:59:26.699906] [INFO ] [MAIN ] UTL: Loaded 10959 primary data records. [2025-09-18T22:59:26.818756] [DEBUG] [MAIN ] UTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:26.820022] [INFO ] [MAIN ] UTI: Generated 1807 derivative records from 40997 primary records. [2025-09-18T22:59:26.830804] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-09-18T22:59:27.050750] [DEBUG] [LOCAL ] UTI: Derivative data saved (1807 records). [2025-09-18T22:59:27.051134] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-09-18T22:59:27.053588] [INFO ] [MAIN ] Derivative Progress: 1914/2075 symbols completed. UTI took 1.1s. Estimated remaining: 1m 2s. Rate: 154.8 symbols/min [2025-09-18T22:59:27.053963] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:27.069518] [DEBUG] [LOCAL ] UTZ: Loaded 45153 existing records from primary storage. [2025-09-18T22:59:27.069933] [INFO ] [MAIN ] UTZ: Loaded 45153 primary data records. [2025-09-18T22:59:27.251138] [DEBUG] [LOCAL ] UVE: Loaded 22022 existing records from primary storage. [2025-09-18T22:59:27.274435] [INFO ] [MAIN ] UVE: Loaded 22022 primary data records. [2025-09-18T22:59:27.707999] [DEBUG] [MAIN ] UTL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:27.768128] [INFO ] [MAIN ] UTL: Generated 1807 derivative records from 10959 primary records. [2025-09-18T22:59:27.768383] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-09-18T22:59:27.785444] [DEBUG] [LOCAL ] UTL: Derivative data saved (1807 records). [2025-09-18T22:59:27.785776] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-09-18T22:59:27.788195] [INFO ] [MAIN ] Derivative Progress: 1915/2075 symbols completed. UTL took 1.1s. Estimated remaining: 1m 2s. Rate: 154.7 symbols/min [2025-09-18T22:59:27.788506] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:27.807790] [DEBUG] [MAIN ] UTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:27.808596] [INFO ] [MAIN ] UTZ: Generated 1807 derivative records from 45153 primary records. [2025-09-18T22:59:27.809751] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-09-18T22:59:27.831604] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1807 records). [2025-09-18T22:59:27.839301] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-09-18T22:59:27.839957] [DEBUG] [LOCAL ] UVV: Loaded 22438 existing records from primary storage. [2025-09-18T22:59:27.840127] [INFO ] [MAIN ] UVV: Loaded 22438 primary data records. [2025-09-18T22:59:27.842313] [INFO ] [MAIN ] Derivative Progress: 1916/2075 symbols completed. UTZ took 1.1s. Estimated remaining: 1m 2s. Rate: 154.8 symbols/min [2025-09-18T22:59:27.842718] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:27.980013] [DEBUG] [MAIN ] UVE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:27.996584] [INFO ] [MAIN ] UVE: Generated 1807 derivative records from 22022 primary records. [2025-09-18T22:59:28.016938] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-09-18T22:59:28.196329] [DEBUG] [LOCAL ] UVE: Derivative data saved (1807 records). [2025-09-18T22:59:28.196478] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-09-18T22:59:28.198929] [INFO ] [MAIN ] Derivative Progress: 1917/2075 symbols completed. UVE took 1.1s. Estimated remaining: 1m 1s. Rate: 154.8 symbols/min [2025-09-18T22:59:28.200027] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:28.218685] [DEBUG] [LOCAL ] UWMC: Loaded 53104 existing records from primary storage. [2025-09-18T22:59:28.220910] [INFO ] [MAIN ] UWMC: Loaded 53104 primary data records. [2025-09-18T22:59:28.273888] [DEBUG] [LOCAL ] UZD: Loaded 6388 existing records from primary storage. [2025-09-18T22:59:28.303233] [INFO ] [MAIN ] UZD: Loaded 6388 primary data records. [2025-09-18T22:59:28.856900] [DEBUG] [MAIN ] UVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:28.858303] [INFO ] [MAIN ] UVV: Generated 1807 derivative records from 22438 primary records. [2025-09-18T22:59:28.858558] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-09-18T22:59:28.877260] [DEBUG] [LOCAL ] UVV: Derivative data saved (1807 records). [2025-09-18T22:59:28.877789] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-09-18T22:59:28.879846] [INFO ] [MAIN ] Derivative Progress: 1918/2075 symbols completed. UVV took 1.1s. Estimated remaining: 1m 1s. Rate: 154.7 symbols/min [2025-09-18T22:59:28.898615] [DEBUG] [MAIN ] UWMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:28.900988] [INFO ] [MAIN ] UWMC: Generated 1807 derivative records from 53104 primary records. [2025-09-18T22:59:28.901701] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-09-18T22:59:28.922766] [DEBUG] [MAIN ] UZD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:59:28.926047] [INFO ] [MAIN ] UZD: Generated 1806 derivative records from 6388 primary records. [2025-09-18T22:59:28.928321] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-09-18T22:59:28.930600] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1807 records). [2025-09-18T22:59:28.930850] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-09-18T22:59:28.939538] [INFO ] [MAIN ] Derivative Progress: 1919/2075 symbols completed. UWMC took 1.1s. Estimated remaining: 1m 0s. Rate: 154.8 symbols/min [2025-09-18T22:59:28.946875] [DEBUG] [LOCAL ] UZD: Derivative data saved (1806 records). [2025-09-18T22:59:28.946942] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-09-18T22:59:28.949365] [INFO ] [MAIN ] Derivative Progress: 1920/2075 symbols completed. UZD took 0.7s. Estimated remaining: 1m 0s. Rate: 154.8 symbols/min [2025-09-18T22:59:28.950220] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:28.950316] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:28.950132] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:28.961965] [DEBUG] [LOCAL ] UZF: Loaded 6526 existing records from primary storage. [2025-09-18T22:59:28.965491] [INFO ] [MAIN ] UZF: Loaded 6526 primary data records. [2025-09-18T22:59:28.965424] [DEBUG] [LOCAL ] UZE: Loaded 7530 existing records from primary storage. [2025-09-18T22:59:28.976884] [INFO ] [MAIN ] UZE: Loaded 7530 primary data records. [2025-09-18T22:59:29.624922] [DEBUG] [LOCAL ] V: Loaded 54153 existing records from primary storage. [2025-09-18T22:59:29.625257] [INFO ] [MAIN ] V: Loaded 54153 primary data records. [2025-09-18T22:59:29.961164] [DEBUG] [MAIN ] UZE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:29.962252] [INFO ] [MAIN ] UZE: Generated 1807 derivative records from 7530 primary records. [2025-09-18T22:59:29.962408] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-09-18T22:59:29.988767] [DEBUG] [MAIN ] UZF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:29.991766] [INFO ] [MAIN ] UZF: Generated 1807 derivative records from 6526 primary records. [2025-09-18T22:59:29.992538] [DEBUG] [LOCAL ] UZE: Derivative data saved (1807 records). [2025-09-18T22:59:29.992619] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-09-18T22:59:29.992768] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-09-18T22:59:29.995987] [INFO ] [MAIN ] Derivative Progress: 1921/2075 symbols completed. UZE took 1.0s. Estimated remaining: 59.7s. Rate: 154.7 symbols/min [2025-09-18T22:59:29.996601] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:30.012360] [DEBUG] [LOCAL ] UZF: Derivative data saved (1807 records). [2025-09-18T22:59:30.012783] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-09-18T22:59:30.014915] [INFO ] [MAIN ] Derivative Progress: 1922/2075 symbols completed. UZF took 1.1s. Estimated remaining: 59.3s. Rate: 154.8 symbols/min [2025-09-18T22:59:30.015403] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:30.032041] [DEBUG] [MAIN ] V: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:30.032876] [INFO ] [MAIN ] V: Generated 1807 derivative records from 54153 primary records. [2025-09-18T22:59:30.032941] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-09-18T22:59:30.061067] [DEBUG] [LOCAL ] V: Derivative data saved (1807 records). [2025-09-18T22:59:30.061267] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-09-18T22:59:30.063601] [INFO ] [MAIN ] Derivative Progress: 1923/2075 symbols completed. V took 1.1s. Estimated remaining: 58.9s. Rate: 154.9 symbols/min [2025-09-18T22:59:30.063964] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:30.076877] [DEBUG] [LOCAL ] VAC: Loaded 35090 existing records from primary storage. [2025-09-18T22:59:30.077018] [INFO ] [MAIN ] VAC: Loaded 35090 primary data records. [2025-09-18T22:59:30.250846] [DEBUG] [LOCAL ] VAL: Loaded 50908 existing records from primary storage. [2025-09-18T22:59:30.304095] [INFO ] [MAIN ] VAL: Loaded 50908 primary data records. [2025-09-18T22:59:30.555286] [DEBUG] [LOCAL ] VALE: Loaded 54084 existing records from primary storage. [2025-09-18T22:59:30.566767] [INFO ] [MAIN ] VALE: Loaded 54084 primary data records. [2025-09-18T22:59:31.098303] [DEBUG] [MAIN ] VAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:31.099188] [INFO ] [MAIN ] VAC: Generated 1807 derivative records from 35090 primary records. [2025-09-18T22:59:31.099617] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-09-18T22:59:31.118120] [DEBUG] [LOCAL ] VAC: Derivative data saved (1807 records). [2025-09-18T22:59:31.118288] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-09-18T22:59:31.121244] [INFO ] [MAIN ] Derivative Progress: 1924/2075 symbols completed. VAC took 1.1s. Estimated remaining: 58.6s. Rate: 154.7 symbols/min [2025-09-18T22:59:31.121972] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:31.142270] [DEBUG] [LOCAL ] VATE: Loaded 5913 existing records from primary storage. [2025-09-18T22:59:31.147597] [DEBUG] [MAIN ] VAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:31.147309] [INFO ] [MAIN ] VATE: Loaded 5913 primary data records. [2025-09-18T22:59:31.159939] [INFO ] [MAIN ] VAL: Generated 1807 derivative records from 50908 primary records. [2025-09-18T22:59:31.180352] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-09-18T22:59:31.260852] [DEBUG] [LOCAL ] VAL: Derivative data saved (1807 records). [2025-09-18T22:59:31.270599] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-09-18T22:59:31.277376] [INFO ] [MAIN ] Derivative Progress: 1925/2075 symbols completed. VAL took 1.3s. Estimated remaining: 58.2s. Rate: 154.8 symbols/min [2025-09-18T22:59:31.306363] [DEBUG] [MAIN ] VALE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:31.316998] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:31.340174] [INFO ] [MAIN ] VALE: Generated 1807 derivative records from 54084 primary records. [2025-09-18T22:59:31.370041] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-09-18T22:59:31.554376] [DEBUG] [LOCAL ] VALE: Derivative data saved (1807 records). [2025-09-18T22:59:31.559021] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-09-18T22:59:31.562349] [INFO ] [MAIN ] Derivative Progress: 1926/2075 symbols completed. VALE took 1.5s. Estimated remaining: 57.8s. Rate: 154.8 symbols/min [2025-09-18T22:59:31.559519] [DEBUG] [LOCAL ] VBF: Loaded 7200 existing records from primary storage. [2025-09-18T22:59:31.563415] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:31.563703] [INFO ] [MAIN ] VBF: Loaded 7200 primary data records. [2025-09-18T22:59:31.682997] [DEBUG] [LOCAL ] VCV: Loaded 13530 existing records from primary storage. [2025-09-18T22:59:31.683260] [INFO ] [MAIN ] VCV: Loaded 13530 primary data records. [2025-09-18T22:59:32.057224] [DEBUG] [MAIN ] VATE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:32.060581] [INFO ] [MAIN ] VATE: Generated 1807 derivative records from 5913 primary records. [2025-09-18T22:59:32.062747] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-09-18T22:59:32.223051] [DEBUG] [LOCAL ] VATE: Derivative data saved (1807 records). [2025-09-18T22:59:32.223541] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-09-18T22:59:32.226205] [INFO ] [MAIN ] Derivative Progress: 1927/2075 symbols completed. VATE took 1.1s. Estimated remaining: 57.4s. Rate: 154.7 symbols/min [2025-09-18T22:59:32.227044] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:32.248145] [DEBUG] [MAIN ] VBF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:32.248907] [INFO ] [MAIN ] VBF: Generated 1807 derivative records from 7200 primary records. [2025-09-18T22:59:32.248999] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-09-18T22:59:32.278439] [DEBUG] [MAIN ] VCV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:32.279731] [INFO ] [MAIN ] VCV: Generated 1807 derivative records from 13530 primary records. [2025-09-18T22:59:32.280252] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-09-18T22:59:32.281569] [DEBUG] [LOCAL ] VBF: Derivative data saved (1807 records). [2025-09-18T22:59:32.281772] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-09-18T22:59:32.295181] [INFO ] [MAIN ] Derivative Progress: 1928/2075 symbols completed. VBF took 1.0s. Estimated remaining: 57.0s. Rate: 154.8 symbols/min [2025-09-18T22:59:32.299556] [DEBUG] [LOCAL ] VCV: Derivative data saved (1807 records). [2025-09-18T22:59:32.310412] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-09-18T22:59:32.313256] [INFO ] [MAIN ] Derivative Progress: 1929/2075 symbols completed. VCV took 0.8s. Estimated remaining: 56.6s. Rate: 154.9 symbols/min [2025-09-18T22:59:32.313335] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:32.313843] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:32.336811] [DEBUG] [LOCAL ] VEEV: Loaded 47866 existing records from primary storage. [2025-09-18T22:59:32.337104] [INFO ] [MAIN ] VEEV: Loaded 47866 primary data records. [2025-09-18T22:59:32.382219] [DEBUG] [LOCAL ] VEL: Loaded 13087 existing records from primary storage. [2025-09-18T22:59:32.418118] [INFO ] [MAIN ] VEL: Loaded 13087 primary data records. [2025-09-18T22:59:32.858988] [DEBUG] [LOCAL ] VET: Loaded 44645 existing records from primary storage. [2025-09-18T22:59:32.899684] [INFO ] [MAIN ] VET: Loaded 44645 primary data records. [2025-09-18T22:59:33.406368] [DEBUG] [MAIN ] VEEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:33.422229] [DEBUG] [MAIN ] VEL: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:59:33.423098] [INFO ] [MAIN ] VEEV: Generated 1807 derivative records from 47866 primary records. [2025-09-18T22:59:33.423827] [INFO ] [MAIN ] VEL: Generated 1806 derivative records from 13087 primary records. [2025-09-18T22:59:33.424100] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-09-18T22:59:33.424036] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-09-18T22:59:33.454055] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1807 records). [2025-09-18T22:59:33.455194] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-09-18T22:59:33.457477] [INFO ] [MAIN ] Derivative Progress: 1930/2075 symbols completed. VEEV took 1.2s. Estimated remaining: 56.2s. Rate: 154.7 symbols/min [2025-09-18T22:59:33.458375] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:33.461868] [DEBUG] [LOCAL ] VEL: Derivative data saved (1806 records). [2025-09-18T22:59:33.462020] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-09-18T22:59:33.464568] [INFO ] [MAIN ] Derivative Progress: 1931/2075 symbols completed. VEL took 1.2s. Estimated remaining: 55.8s. Rate: 154.8 symbols/min [2025-09-18T22:59:33.465139] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:33.482257] [DEBUG] [LOCAL ] VGI: Loaded 5270 existing records from primary storage. [2025-09-18T22:59:33.487366] [DEBUG] [MAIN ] VET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:33.487931] [INFO ] [MAIN ] VGI: Loaded 5270 primary data records. [2025-09-18T22:59:33.488680] [INFO ] [MAIN ] VET: Generated 1807 derivative records from 44645 primary records. [2025-09-18T22:59:33.509813] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-09-18T22:59:33.697450] [DEBUG] [LOCAL ] VET: Derivative data saved (1807 records). [2025-09-18T22:59:33.804455] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-09-18T22:59:33.812742] [INFO ] [MAIN ] Derivative Progress: 1932/2075 symbols completed. VET took 1.5s. Estimated remaining: 55.4s. Rate: 154.8 symbols/min [2025-09-18T22:59:33.836458] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:33.838142] [DEBUG] [LOCAL ] VFC: Loaded 53999 existing records from primary storage. [2025-09-18T22:59:33.838516] [INFO ] [MAIN ] VFC: Loaded 53999 primary data records. [2025-09-18T22:59:34.011453] [DEBUG] [LOCAL ] VGM: Loaded 18403 existing records from primary storage. [2025-09-18T22:59:34.036062] [INFO ] [MAIN ] VGM: Loaded 18403 primary data records. [2025-09-18T22:59:34.366370] [DEBUG] [MAIN ] VGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:34.516174] [INFO ] [MAIN ] VGI: Generated 1807 derivative records from 5270 primary records. [2025-09-18T22:59:34.516525] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-09-18T22:59:34.539173] [DEBUG] [LOCAL ] VGI: Derivative data saved (1807 records). [2025-09-18T22:59:34.539372] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-09-18T22:59:34.541838] [INFO ] [MAIN ] Derivative Progress: 1933/2075 symbols completed. VGI took 1.1s. Estimated remaining: 55.1s. Rate: 154.7 symbols/min [2025-09-18T22:59:34.556370] [DEBUG] [MAIN ] VFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:34.557106] [INFO ] [MAIN ] VFC: Generated 1807 derivative records from 53999 primary records. [2025-09-18T22:59:34.557366] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-09-18T22:59:34.577805] [DEBUG] [LOCAL ] VFC: Derivative data saved (1807 records). [2025-09-18T22:59:34.577898] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-09-18T22:59:34.580393] [INFO ] [MAIN ] Derivative Progress: 1934/2075 symbols completed. VFC took 1.1s. Estimated remaining: 54.7s. Rate: 154.8 symbols/min [2025-09-18T22:59:34.592896] [DEBUG] [MAIN ] VGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:34.593699] [INFO ] [MAIN ] VGM: Generated 1807 derivative records from 18403 primary records. [2025-09-18T22:59:34.593766] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-09-18T22:59:34.609398] [DEBUG] [LOCAL ] VGM: Derivative data saved (1807 records). [2025-09-18T22:59:34.609470] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-09-18T22:59:34.612117] [INFO ] [MAIN ] Derivative Progress: 1935/2075 symbols completed. VGM took 0.8s. Estimated remaining: 54.2s. Rate: 154.9 symbols/min [2025-09-18T22:59:34.612913] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:34.612833] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:34.613083] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:34.619220] [DEBUG] [LOCAL ] VHI: Loaded 3006 existing records from primary storage. [2025-09-18T22:59:34.619382] [INFO ] [MAIN ] VHI: Loaded 3006 primary data records. [2025-09-18T22:59:34.968169] [DEBUG] [LOCAL ] VIK: Loaded 52904 existing records from primary storage. [2025-09-18T22:59:34.969006] [INFO ] [MAIN ] VIK: Loaded 52904 primary data records. [2025-09-18T22:59:35.057278] [DEBUG] [LOCAL ] VICI: Loaded 54038 existing records from primary storage. [2025-09-18T22:59:35.076084] [INFO ] [MAIN ] VICI: Loaded 54038 primary data records. [2025-09-18T22:59:35.674483] [DEBUG] [MAIN ] VHI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T22:59:35.676379] [INFO ] [MAIN ] VHI: Generated 1806 derivative records from 3006 primary records. [2025-09-18T22:59:35.676753] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-09-18T22:59:35.693811] [DEBUG] [LOCAL ] VHI: Derivative data saved (1806 records). [2025-09-18T22:59:35.694012] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-09-18T22:59:35.696557] [INFO ] [MAIN ] Derivative Progress: 1936/2075 symbols completed. VHI took 1.1s. Estimated remaining: 53.9s. Rate: 154.7 symbols/min [2025-09-18T22:59:35.697162] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:35.715174] [DEBUG] [MAIN ] VIK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:35.715980] [INFO ] [MAIN ] VIK: Generated 1807 derivative records from 52904 primary records. [2025-09-18T22:59:35.716261] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-09-18T22:59:35.744184] [DEBUG] [LOCAL ] VIK: Derivative data saved (1807 records). [2025-09-18T22:59:35.749265] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-09-18T22:59:35.749455] [DEBUG] [MAIN ] VICI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:35.752484] [INFO ] [MAIN ] VICI: Generated 1807 derivative records from 54038 primary records. [2025-09-18T22:59:35.752633] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-09-18T22:59:35.751601] [INFO ] [MAIN ] Derivative Progress: 1937/2075 symbols completed. VIK took 1.1s. Estimated remaining: 53.5s. Rate: 154.8 symbols/min [2025-09-18T22:59:35.753223] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:35.786363] [DEBUG] [LOCAL ] VICI: Derivative data saved (1807 records). [2025-09-18T22:59:35.786568] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-09-18T22:59:35.789101] [INFO ] [MAIN ] Derivative Progress: 1938/2075 symbols completed. VICI took 1.2s. Estimated remaining: 53.1s. Rate: 154.9 symbols/min [2025-09-18T22:59:35.789439] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:35.806882] [DEBUG] [LOCAL ] VIPS: Loaded 51777 existing records from primary storage. [2025-09-18T22:59:35.807124] [INFO ] [MAIN ] VIPS: Loaded 51777 primary data records. [2025-09-18T22:59:36.141151] [DEBUG] [LOCAL ] VIRT: Loaded 47404 existing records from primary storage. [2025-09-18T22:59:36.141482] [INFO ] [MAIN ] VIRT: Loaded 47404 primary data records. [2025-09-18T22:59:36.267394] [DEBUG] [LOCAL ] VIST: Loaded 46331 existing records from primary storage. [2025-09-18T22:59:36.283608] [INFO ] [MAIN ] VIST: Loaded 46331 primary data records. [2025-09-18T22:59:36.794102] [DEBUG] [MAIN ] VIPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:36.796403] [INFO ] [MAIN ] VIPS: Generated 1807 derivative records from 51777 primary records. [2025-09-18T22:59:36.796929] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-09-18T22:59:36.816802] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1807 records). [2025-09-18T22:59:36.817787] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-09-18T22:59:36.822376] [INFO ] [MAIN ] Derivative Progress: 1939/2075 symbols completed. VIPS took 1.1s. Estimated remaining: 52.7s. Rate: 154.7 symbols/min [2025-09-18T22:59:36.822881] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:36.838303] [DEBUG] [MAIN ] VIRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:36.840043] [INFO ] [MAIN ] VIRT: Generated 1807 derivative records from 47404 primary records. [2025-09-18T22:59:36.840363] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-09-18T22:59:36.860861] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1807 records). [2025-09-18T22:59:36.861094] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-09-18T22:59:36.870573] [INFO ] [MAIN ] Derivative Progress: 1940/2075 symbols completed. VIRT took 1.1s. Estimated remaining: 52.3s. Rate: 154.8 symbols/min [2025-09-18T22:59:36.879519] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:36.880579] [DEBUG] [MAIN ] VIST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:36.881405] [INFO ] [MAIN ] VIST: Generated 1807 derivative records from 46331 primary records. [2025-09-18T22:59:36.881677] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-09-18T22:59:36.914201] [DEBUG] [LOCAL ] VIST: Derivative data saved (1807 records). [2025-09-18T22:59:36.914292] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-09-18T22:59:36.916954] [INFO ] [MAIN ] Derivative Progress: 1941/2075 symbols completed. VIST took 1.1s. Estimated remaining: 51.9s. Rate: 154.9 symbols/min [2025-09-18T22:59:36.917193] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:36.924164] [DEBUG] [LOCAL ] VKQ: Loaded 17670 existing records from primary storage. [2025-09-18T22:59:36.924297] [INFO ] [MAIN ] VKQ: Loaded 17670 primary data records. [2025-09-18T22:59:37.023372] [DEBUG] [LOCAL ] VIV: Loaded 45797 existing records from primary storage. [2025-09-18T22:59:37.054032] [INFO ] [MAIN ] VIV: Loaded 45797 primary data records. [2025-09-18T22:59:37.142812] [DEBUG] [LOCAL ] VLN: Loaded 28337 existing records from primary storage. [2025-09-18T22:59:37.168131] [INFO ] [MAIN ] VLN: Loaded 28337 primary data records. [2025-09-18T22:59:38.011476] [DEBUG] [MAIN ] VKQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:38.013553] [INFO ] [MAIN ] VKQ: Generated 1807 derivative records from 17670 primary records. [2025-09-18T22:59:38.014007] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-09-18T22:59:38.013833] [DEBUG] [MAIN ] VIV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:38.016018] [INFO ] [MAIN ] VIV: Generated 1807 derivative records from 45797 primary records. [2025-09-18T22:59:38.016301] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-09-18T22:59:38.063626] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1807 records). [2025-09-18T22:59:38.063790] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-09-18T22:59:38.066356] [INFO ] [MAIN ] Derivative Progress: 1942/2075 symbols completed. VKQ took 1.2s. Estimated remaining: 51.6s. Rate: 154.7 symbols/min [2025-09-18T22:59:38.067441] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:38.066743] [DEBUG] [MAIN ] VLN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:38.069019] [INFO ] [MAIN ] VLN: Generated 1807 derivative records from 28337 primary records. [2025-09-18T22:59:38.069913] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-09-18T22:59:38.071944] [DEBUG] [LOCAL ] VIV: Derivative data saved (1807 records). [2025-09-18T22:59:38.084199] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-09-18T22:59:38.088909] [DEBUG] [LOCAL ] VLN: Derivative data saved (1807 records). [2025-09-18T22:59:38.091667] [INFO ] [MAIN ] Derivative Progress: 1943/2075 symbols completed. VIV took 1.3s. Estimated remaining: 51.2s. Rate: 154.8 symbols/min [2025-09-18T22:59:38.092104] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:38.092242] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-09-18T22:59:38.095223] [INFO ] [MAIN ] Derivative Progress: 1944/2075 symbols completed. VLN took 1.2s. Estimated remaining: 50.7s. Rate: 154.9 symbols/min [2025-09-18T22:59:38.098684] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:38.106375] [DEBUG] [LOCAL ] VLT: Loaded 4732 existing records from primary storage. [2025-09-18T22:59:38.106632] [INFO ] [MAIN ] VLT: Loaded 4732 primary data records. [2025-09-18T22:59:38.486618] [DEBUG] [LOCAL ] VLRS: Loaded 41361 existing records from primary storage. [2025-09-18T22:59:38.487615] [INFO ] [MAIN ] VLRS: Loaded 41361 primary data records. [2025-09-18T22:59:38.488462] [DEBUG] [LOCAL ] VLO: Loaded 53482 existing records from primary storage. [2025-09-18T22:59:38.494112] [INFO ] [MAIN ] VLO: Loaded 53482 primary data records. [2025-09-18T22:59:39.155950] [DEBUG] [MAIN ] VLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:39.157525] [INFO ] [MAIN ] VLT: Generated 1807 derivative records from 4732 primary records. [2025-09-18T22:59:39.157879] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-09-18T22:59:39.178293] [DEBUG] [LOCAL ] VLT: Derivative data saved (1807 records). [2025-09-18T22:59:39.178852] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-09-18T22:59:39.181587] [INFO ] [MAIN ] Derivative Progress: 1945/2075 symbols completed. VLT took 1.1s. Estimated remaining: 50.4s. Rate: 154.7 symbols/min [2025-09-18T22:59:39.182833] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:39.201926] [DEBUG] [MAIN ] VLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:39.203873] [INFO ] [MAIN ] VLO: Generated 1807 derivative records from 53482 primary records. [2025-09-18T22:59:39.204122] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-09-18T22:59:39.236595] [DEBUG] [MAIN ] VLRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:39.238413] [INFO ] [MAIN ] VLRS: Generated 1807 derivative records from 41361 primary records. [2025-09-18T22:59:39.238812] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-09-18T22:59:39.259466] [DEBUG] [LOCAL ] VLO: Derivative data saved (1807 records). [2025-09-18T22:59:39.260258] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-09-18T22:59:39.263565] [INFO ] [MAIN ] Derivative Progress: 1946/2075 symbols completed. VLO took 1.2s. Estimated remaining: 50.0s. Rate: 154.8 symbols/min [2025-09-18T22:59:39.264948] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:39.278903] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1807 records). [2025-09-18T22:59:39.279080] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-09-18T22:59:39.281954] [INFO ] [MAIN ] Derivative Progress: 1947/2075 symbols completed. VLRS took 1.2s. Estimated remaining: 49.6s. Rate: 154.9 symbols/min [2025-09-18T22:59:39.282404] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:39.299422] [DEBUG] [LOCAL ] VLTO: Loaded 46408 existing records from primary storage. [2025-09-18T22:59:39.299799] [INFO ] [MAIN ] VLTO: Loaded 46408 primary data records. [2025-09-18T22:59:39.427470] [DEBUG] [LOCAL ] VMI: Loaded 15650 existing records from primary storage. [2025-09-18T22:59:39.448181] [INFO ] [MAIN ] VMI: Loaded 15650 primary data records. [2025-09-18T22:59:39.586462] [DEBUG] [LOCAL ] VMC: Loaded 44373 existing records from primary storage. [2025-09-18T22:59:39.596985] [INFO ] [MAIN ] VMC: Loaded 44373 primary data records. [2025-09-18T22:59:40.349091] [DEBUG] [MAIN ] VLTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:40.350979] [INFO ] [MAIN ] VLTO: Generated 1807 derivative records from 46408 primary records. [2025-09-18T22:59:40.351624] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-09-18T22:59:40.381200] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1807 records). [2025-09-18T22:59:40.381345] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-09-18T22:59:40.390263] [DEBUG] [MAIN ] VMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:40.389190] [INFO ] [MAIN ] Derivative Progress: 1948/2075 symbols completed. VLTO took 1.2s. Estimated remaining: 49.2s. Rate: 154.7 symbols/min [2025-09-18T22:59:40.405452] [INFO ] [MAIN ] VMI: Generated 1807 derivative records from 15650 primary records. [2025-09-18T22:59:40.406163] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-09-18T22:59:40.406082] [DEBUG] [MAIN ] VMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:40.407944] [INFO ] [MAIN ] VMC: Generated 1807 derivative records from 44373 primary records. [2025-09-18T22:59:40.408269] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-09-18T22:59:40.440120] [DEBUG] [LOCAL ] VMI: Derivative data saved (1807 records). [2025-09-18T22:59:40.440728] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-09-18T22:59:40.443499] [INFO ] [MAIN ] Derivative Progress: 1949/2075 symbols completed. VMI took 1.2s. Estimated remaining: 48.8s. Rate: 154.8 symbols/min [2025-09-18T22:59:40.443946] [DEBUG] [LOCAL ] VMC: Derivative data saved (1807 records). [2025-09-18T22:59:40.444195] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-09-18T22:59:40.446860] [INFO ] [MAIN ] Derivative Progress: 1950/2075 symbols completed. VMC took 1.2s. Estimated remaining: 48.4s. Rate: 154.9 symbols/min [2025-09-18T22:59:40.447569] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:40.447817] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:40.447631] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:40.458695] [DEBUG] [LOCAL ] VNCE: Loaded 6374 existing records from primary storage. [2025-09-18T22:59:40.458834] [INFO ] [MAIN ] VNCE: Loaded 6374 primary data records. [2025-09-18T22:59:40.590083] [DEBUG] [LOCAL ] VMO: Loaded 21187 existing records from primary storage. [2025-09-18T22:59:40.605715] [INFO ] [MAIN ] VMO: Loaded 21187 primary data records. [2025-09-18T22:59:40.945021] [DEBUG] [LOCAL ] VNO: Loaded 49344 existing records from primary storage. [2025-09-18T22:59:40.973685] [INFO ] [MAIN ] VNO: Loaded 49344 primary data records. [2025-09-18T22:59:41.530934] [DEBUG] [MAIN ] VNCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:41.531965] [INFO ] [MAIN ] VNCE: Generated 1807 derivative records from 6374 primary records. [2025-09-18T22:59:41.532725] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-09-18T22:59:41.551023] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1807 records). [2025-09-18T22:59:41.551267] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-09-18T22:59:41.553562] [INFO ] [MAIN ] Derivative Progress: 1951/2075 symbols completed. VNCE took 1.1s. Estimated remaining: 48.1s. Rate: 154.7 symbols/min [2025-09-18T22:59:41.556329] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:41.573079] [DEBUG] [MAIN ] VMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:41.574357] [INFO ] [MAIN ] VMO: Generated 1807 derivative records from 21187 primary records. [2025-09-18T22:59:41.574738] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-09-18T22:59:41.607165] [DEBUG] [MAIN ] VNO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:41.608279] [INFO ] [MAIN ] VNO: Generated 1807 derivative records from 49344 primary records. [2025-09-18T22:59:41.608447] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-09-18T22:59:41.611291] [DEBUG] [LOCAL ] VMO: Derivative data saved (1807 records). [2025-09-18T22:59:41.631957] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-09-18T22:59:41.635722] [INFO ] [MAIN ] Derivative Progress: 1952/2075 symbols completed. VMO took 1.2s. Estimated remaining: 47.7s. Rate: 154.8 symbols/min [2025-09-18T22:59:41.637057] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:41.653629] [DEBUG] [LOCAL ] VNO: Derivative data saved (1807 records). [2025-09-18T22:59:41.653864] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-09-18T22:59:41.656554] [DEBUG] [LOCAL ] VNT: Loaded 44664 existing records from primary storage. [2025-09-18T22:59:41.659260] [INFO ] [MAIN ] Derivative Progress: 1953/2075 symbols completed. VNO took 1.2s. Estimated remaining: 47.3s. Rate: 154.9 symbols/min [2025-09-18T22:59:41.659766] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:41.659862] [INFO ] [MAIN ] VNT: Loaded 44664 primary data records. [2025-09-18T22:59:41.687023] [DEBUG] [LOCAL ] VOC: Loaded 9063 existing records from primary storage. [2025-09-18T22:59:41.721546] [INFO ] [MAIN ] VOC: Loaded 9063 primary data records. [2025-09-18T22:59:42.321206] [DEBUG] [LOCAL ] VOYA: Loaded 43279 existing records from primary storage. [2025-09-18T22:59:42.322343] [INFO ] [MAIN ] VOYA: Loaded 43279 primary data records. [2025-09-18T22:59:42.663719] [DEBUG] [MAIN ] VNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:42.676889] [INFO ] [MAIN ] VNT: Generated 1807 derivative records from 44664 primary records. [2025-09-18T22:59:42.677044] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-09-18T22:59:42.678767] [DEBUG] [MAIN ] VOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:42.679516] [INFO ] [MAIN ] VOC: Generated 1807 derivative records from 9063 primary records. [2025-09-18T22:59:42.679870] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-09-18T22:59:42.695241] [DEBUG] [LOCAL ] VNT: Derivative data saved (1807 records). [2025-09-18T22:59:42.695817] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-09-18T22:59:42.699056] [INFO ] [MAIN ] Derivative Progress: 1954/2075 symbols completed. VNT took 1.1s. Estimated remaining: 46.9s. Rate: 154.7 symbols/min [2025-09-18T22:59:42.699539] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:42.718767] [DEBUG] [LOCAL ] VOC: Derivative data saved (1807 records). [2025-09-18T22:59:42.723685] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-09-18T22:59:42.726273] [INFO ] [MAIN ] Derivative Progress: 1955/2075 symbols completed. VOC took 1.1s. Estimated remaining: 46.5s. Rate: 154.8 symbols/min [2025-09-18T22:59:42.726622] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:42.739990] [DEBUG] [MAIN ] VOYA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:42.746857] [INFO ] [MAIN ] VOYA: Generated 1807 derivative records from 43279 primary records. [2025-09-18T22:59:42.747284] [DEBUG] [LOCAL ] VPG: Loaded 17345 existing records from primary storage. [2025-09-18T22:59:42.747405] [INFO ] [MAIN ] VPG: Loaded 17345 primary data records. [2025-09-18T22:59:42.747002] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-09-18T22:59:42.846119] [DEBUG] [LOCAL ] VPV: Loaded 5405 existing records from primary storage. [2025-09-18T22:59:42.851611] [INFO ] [MAIN ] VPV: Loaded 5405 primary data records. [2025-09-18T22:59:43.162797] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1807 records). [2025-09-18T22:59:43.183461] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-09-18T22:59:43.197266] [INFO ] [MAIN ] Derivative Progress: 1956/2075 symbols completed. VOYA took 1.5s. Estimated remaining: 46.1s. Rate: 154.8 symbols/min [2025-09-18T22:59:43.203762] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:43.405936] [DEBUG] [MAIN ] VPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:43.406739] [INFO ] [MAIN ] VPG: Generated 1807 derivative records from 17345 primary records. [2025-09-18T22:59:43.406892] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-09-18T22:59:43.434058] [DEBUG] [LOCAL ] VPG: Derivative data saved (1807 records). [2025-09-18T22:59:43.435540] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-09-18T22:59:43.438615] [INFO ] [MAIN ] Derivative Progress: 1957/2075 symbols completed. VPG took 0.7s. Estimated remaining: 45.7s. Rate: 154.8 symbols/min [2025-09-18T22:59:43.439629] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:43.440591] [DEBUG] [LOCAL ] VRE: Loaded 35060 existing records from primary storage. [2025-09-18T22:59:43.454333] [INFO ] [MAIN ] VRE: Loaded 35060 primary data records. [2025-09-18T22:59:43.466255] [DEBUG] [MAIN ] VPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:43.511346] [INFO ] [MAIN ] VPV: Generated 1807 derivative records from 5405 primary records. [2025-09-18T22:59:43.525467] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-09-18T22:59:43.814431] [DEBUG] [LOCAL ] VPV: Derivative data saved (1807 records). [2025-09-18T22:59:43.814999] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-09-18T22:59:43.818131] [INFO ] [MAIN ] Derivative Progress: 1958/2075 symbols completed. VPV took 1.1s. Estimated remaining: 45.3s. Rate: 154.8 symbols/min [2025-09-18T22:59:43.832589] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:43.847853] [DEBUG] [LOCAL ] VRTS: Loaded 9119 existing records from primary storage. [2025-09-18T22:59:43.848585] [INFO ] [MAIN ] VRTS: Loaded 9119 primary data records. [2025-09-18T22:59:43.919844] [DEBUG] [LOCAL ] VRT: Loaded 54143 existing records from primary storage. [2025-09-18T22:59:43.941115] [INFO ] [MAIN ] VRT: Loaded 54143 primary data records. [2025-09-18T22:59:44.369633] [DEBUG] [MAIN ] VRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:44.481537] [INFO ] [MAIN ] VRE: Generated 1807 derivative records from 35060 primary records. [2025-09-18T22:59:44.497991] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-09-18T22:59:44.522984] [DEBUG] [LOCAL ] VRE: Derivative data saved (1807 records). [2025-09-18T22:59:44.524635] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-09-18T22:59:44.526927] [INFO ] [MAIN ] Derivative Progress: 1959/2075 symbols completed. VRE took 1.3s. Estimated remaining: 45.0s. Rate: 154.8 symbols/min [2025-09-18T22:59:44.528027] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:44.564491] [DEBUG] [MAIN ] VRTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:44.564815] [DEBUG] [MAIN ] VRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:44.569927] [INFO ] [MAIN ] VRTS: Generated 1807 derivative records from 9119 primary records. [2025-09-18T22:59:44.570979] [INFO ] [MAIN ] VRT: Generated 1807 derivative records from 54143 primary records. [2025-09-18T22:59:44.571182] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-09-18T22:59:44.572408] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-09-18T22:59:44.604144] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1807 records). [2025-09-18T22:59:44.604574] [DEBUG] [LOCAL ] VRT: Derivative data saved (1807 records). [2025-09-18T22:59:44.604902] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-09-18T22:59:44.604982] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-09-18T22:59:44.607415] [INFO ] [MAIN ] Derivative Progress: 1960/2075 symbols completed. VRTS took 0.8s. Estimated remaining: 44.6s. Rate: 154.8 symbols/min [2025-09-18T22:59:44.610487] [INFO ] [MAIN ] Derivative Progress: 1961/2075 symbols completed. VRT took 1.2s. Estimated remaining: 44.2s. Rate: 154.9 symbols/min [2025-09-18T22:59:44.610746] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:44.611122] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:44.653104] [DEBUG] [LOCAL ] VSCO: Loaded 53285 existing records from primary storage. [2025-09-18T22:59:44.653412] [INFO ] [MAIN ] VSCO: Loaded 53285 primary data records. [2025-09-18T22:59:45.017247] [DEBUG] [LOCAL ] VSH: Loaded 49135 existing records from primary storage. [2025-09-18T22:59:45.031382] [INFO ] [MAIN ] VSH: Loaded 49135 primary data records. [2025-09-18T22:59:45.043879] [DEBUG] [LOCAL ] VST: Loaded 54110 existing records from primary storage. [2025-09-18T22:59:45.063945] [INFO ] [MAIN ] VST: Loaded 54110 primary data records. [2025-09-18T22:59:45.712343] [DEBUG] [MAIN ] VSCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:45.713428] [INFO ] [MAIN ] VSCO: Generated 1807 derivative records from 53285 primary records. [2025-09-18T22:59:45.713538] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-09-18T22:59:45.733347] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1807 records). [2025-09-18T22:59:45.733507] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-09-18T22:59:45.736164] [INFO ] [MAIN ] Derivative Progress: 1962/2075 symbols completed. VSCO took 1.2s. Estimated remaining: 43.8s. Rate: 154.7 symbols/min [2025-09-18T22:59:45.736731] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:45.770908] [DEBUG] [MAIN ] VST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:45.772843] [DEBUG] [MAIN ] VSH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:45.772529] [INFO ] [MAIN ] VST: Generated 1807 derivative records from 54110 primary records. [2025-09-18T22:59:45.773693] [INFO ] [MAIN ] VSH: Generated 1807 derivative records from 49135 primary records. [2025-09-18T22:59:45.773923] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-09-18T22:59:45.773842] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-09-18T22:59:45.804849] [DEBUG] [LOCAL ] VSH: Derivative data saved (1807 records). [2025-09-18T22:59:45.805686] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-09-18T22:59:45.817606] [INFO ] [MAIN ] Derivative Progress: 1963/2075 symbols completed. VSH took 1.2s. Estimated remaining: 43.4s. Rate: 154.8 symbols/min [2025-09-18T22:59:45.820394] [DEBUG] [LOCAL ] VST: Derivative data saved (1807 records). [2025-09-18T22:59:45.820591] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-09-18T22:59:45.823185] [INFO ] [MAIN ] Derivative Progress: 1964/2075 symbols completed. VST took 1.2s. Estimated remaining: 43.0s. Rate: 154.9 symbols/min [2025-09-18T22:59:45.838718] [DEBUG] [LOCAL ] VSTS: Loaded 49379 existing records from primary storage. [2025-09-18T22:59:45.838843] [INFO ] [MAIN ] VSTS: Loaded 49379 primary data records. [2025-09-18T22:59:46.154166] [DEBUG] [MAIN ] VSTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:46.154925] [INFO ] [MAIN ] VSTS: Generated 1807 derivative records from 49379 primary records. [2025-09-18T22:59:46.154992] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-09-18T22:59:46.170158] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1807 records). [2025-09-18T22:59:46.170217] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-09-18T22:59:46.172296] [INFO ] [MAIN ] Derivative Progress: 1965/2075 symbols completed. VSTS took 0.4s. Estimated remaining: 42.6s. Rate: 154.9 symbols/min [2025-09-18T22:59:46.173124] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:46.173401] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:46.174025] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:46.192611] [DEBUG] [LOCAL ] VTMX: Loaded 17532 existing records from primary storage. [2025-09-18T22:59:46.192771] [INFO ] [MAIN ] VTMX: Loaded 17532 primary data records. [2025-09-18T22:59:46.546402] [DEBUG] [LOCAL ] VTEX: Loaded 43859 existing records from primary storage. [2025-09-18T22:59:46.547806] [INFO ] [MAIN ] VTEX: Loaded 43859 primary data records. [2025-09-18T22:59:46.559949] [DEBUG] [LOCAL ] VTLE: Loaded 49049 existing records from primary storage. [2025-09-18T22:59:46.569976] [INFO ] [MAIN ] VTLE: Loaded 49049 primary data records. [2025-09-18T22:59:47.186912] [DEBUG] [MAIN ] VTMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:47.188379] [INFO ] [MAIN ] VTMX: Generated 1807 derivative records from 17532 primary records. [2025-09-18T22:59:47.188712] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-09-18T22:59:47.207638] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1807 records). [2025-09-18T22:59:47.207862] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-09-18T22:59:47.211386] [INFO ] [MAIN ] Derivative Progress: 1966/2075 symbols completed. VTMX took 1.0s. Estimated remaining: 42.3s. Rate: 154.8 symbols/min [2025-09-18T22:59:47.212007] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:47.222386] [DEBUG] [LOCAL ] VTN: Loaded 7219 existing records from primary storage. [2025-09-18T22:59:47.222602] [INFO ] [MAIN ] VTN: Loaded 7219 primary data records. [2025-09-18T22:59:47.338036] [DEBUG] [MAIN ] VTLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:47.351823] [INFO ] [MAIN ] VTLE: Generated 1807 derivative records from 49049 primary records. [2025-09-18T22:59:47.357534] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-09-18T22:59:47.413897] [DEBUG] [MAIN ] VTEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:47.421752] [INFO ] [MAIN ] VTEX: Generated 1807 derivative records from 43859 primary records. [2025-09-18T22:59:47.509932] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-09-18T22:59:47.630868] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1807 records). [2025-09-18T22:59:47.631429] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-09-18T22:59:47.642178] [INFO ] [MAIN ] Derivative Progress: 1967/2075 symbols completed. VTLE took 1.5s. Estimated remaining: 41.9s. Rate: 154.7 symbols/min [2025-09-18T22:59:47.649888] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:47.650388] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1807 records). [2025-09-18T22:59:47.651100] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-09-18T22:59:47.654760] [INFO ] [MAIN ] Derivative Progress: 1968/2075 symbols completed. VTEX took 1.5s. Estimated remaining: 41.5s. Rate: 154.8 symbols/min [2025-09-18T22:59:47.655611] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:47.683784] [DEBUG] [MAIN ] VTN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:47.684483] [INFO ] [MAIN ] VTN: Generated 1807 derivative records from 7219 primary records. [2025-09-18T22:59:47.684612] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-09-18T22:59:47.693782] [DEBUG] [LOCAL ] VTOL: Loaded 20021 existing records from primary storage. [2025-09-18T22:59:47.701049] [INFO ] [MAIN ] VTOL: Loaded 20021 primary data records. [2025-09-18T22:59:47.856354] [DEBUG] [LOCAL ] VTN: Derivative data saved (1807 records). [2025-09-18T22:59:47.905804] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-09-18T22:59:47.929512] [INFO ] [MAIN ] Derivative Progress: 1969/2075 symbols completed. VTN took 0.7s. Estimated remaining: 41.1s. Rate: 154.8 symbols/min [2025-09-18T22:59:47.935758] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:48.047967] [DEBUG] [LOCAL ] VTR: Loaded 53219 existing records from primary storage. [2025-09-18T22:59:48.057144] [INFO ] [MAIN ] VTR: Loaded 53219 primary data records. [2025-09-18T22:59:48.244351] [DEBUG] [LOCAL ] VTS: Loaded 30584 existing records from primary storage. [2025-09-18T22:59:48.259580] [INFO ] [MAIN ] VTS: Loaded 30584 primary data records. [2025-09-18T22:59:48.699976] [DEBUG] [MAIN ] VTOL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:48.715692] [INFO ] [MAIN ] VTOL: Generated 1807 derivative records from 20021 primary records. [2025-09-18T22:59:48.716137] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-09-18T22:59:48.744412] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1807 records). [2025-09-18T22:59:48.745152] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-09-18T22:59:48.748177] [INFO ] [MAIN ] Derivative Progress: 1970/2075 symbols completed. VTOL took 1.1s. Estimated remaining: 40.7s. Rate: 154.8 symbols/min [2025-09-18T22:59:48.750419] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:48.766411] [DEBUG] [MAIN ] VTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:48.767194] [INFO ] [MAIN ] VTR: Generated 1807 derivative records from 53219 primary records. [2025-09-18T22:59:48.767424] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-09-18T22:59:48.784564] [DEBUG] [LOCAL ] VTR: Derivative data saved (1807 records). [2025-09-18T22:59:48.784806] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-09-18T22:59:48.787050] [INFO ] [MAIN ] Derivative Progress: 1971/2075 symbols completed. VTR took 1.1s. Estimated remaining: 40.3s. Rate: 154.8 symbols/min [2025-09-18T22:59:48.787601] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:48.829303] [DEBUG] [MAIN ] VTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:48.831507] [INFO ] [MAIN ] VTS: Generated 1807 derivative records from 30584 primary records. [2025-09-18T22:59:48.831722] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-09-18T22:59:48.833589] [DEBUG] [LOCAL ] VVR: Loaded 30479 existing records from primary storage. [2025-09-18T22:59:48.834092] [INFO ] [MAIN ] VVR: Loaded 30479 primary data records. [2025-09-18T22:59:49.059284] [DEBUG] [LOCAL ] VTS: Derivative data saved (1807 records). [2025-09-18T22:59:49.062478] [DEBUG] [LOCAL ] VVV: Loaded 50526 existing records from primary storage. [2025-09-18T22:59:49.117706] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-09-18T22:59:49.065883] [INFO ] [MAIN ] VVV: Loaded 50526 primary data records. [2025-09-18T22:59:49.128024] [INFO ] [MAIN ] Derivative Progress: 1972/2075 symbols completed. VTS took 1.2s. Estimated remaining: 39.9s. Rate: 154.8 symbols/min [2025-09-18T22:59:49.214107] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:49.399102] [DEBUG] [LOCAL ] VVX: Loaded 23575 existing records from primary storage. [2025-09-18T22:59:49.399509] [INFO ] [MAIN ] VVX: Loaded 23575 primary data records. [2025-09-18T22:59:49.892741] [DEBUG] [MAIN ] VVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:49.893550] [INFO ] [MAIN ] VVR: Generated 1807 derivative records from 30479 primary records. [2025-09-18T22:59:49.893814] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-09-18T22:59:49.914395] [DEBUG] [LOCAL ] VVR: Derivative data saved (1807 records). [2025-09-18T22:59:49.915043] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-09-18T22:59:49.917179] [INFO ] [MAIN ] Derivative Progress: 1973/2075 symbols completed. VVR took 1.2s. Estimated remaining: 39.5s. Rate: 154.8 symbols/min [2025-09-18T22:59:49.917568] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:49.931211] [DEBUG] [MAIN ] VVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:49.932273] [INFO ] [MAIN ] VVV: Generated 1807 derivative records from 50526 primary records. [2025-09-18T22:59:49.933358] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-09-18T22:59:49.952199] [DEBUG] [LOCAL ] VVV: Derivative data saved (1807 records). [2025-09-18T22:59:49.953947] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-09-18T22:59:49.956683] [INFO ] [MAIN ] Derivative Progress: 1974/2075 symbols completed. VVV took 1.2s. Estimated remaining: 39.1s. Rate: 154.8 symbols/min [2025-09-18T22:59:49.957105] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:49.971018] [DEBUG] [MAIN ] VVX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:49.982362] [INFO ] [MAIN ] VVX: Generated 1807 derivative records from 23575 primary records. [2025-09-18T22:59:49.982541] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-09-18T22:59:50.014468] [DEBUG] [LOCAL ] VVX: Derivative data saved (1807 records). [2025-09-18T22:59:50.014610] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-09-18T22:59:50.015360] [DEBUG] [LOCAL ] VYX: Loaded 49577 existing records from primary storage. [2025-09-18T22:59:50.018059] [INFO ] [MAIN ] VYX: Loaded 49577 primary data records. [2025-09-18T22:59:50.017791] [INFO ] [MAIN ] Derivative Progress: 1975/2075 symbols completed. VVX took 0.8s. Estimated remaining: 38.7s. Rate: 154.9 symbols/min [2025-09-18T22:59:50.042881] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:50.312950] [DEBUG] [LOCAL ] VZ: Loaded 54181 existing records from primary storage. [2025-09-18T22:59:50.349673] [INFO ] [MAIN ] VZ: Loaded 54181 primary data records. [2025-09-18T22:59:50.488135] [DEBUG] [LOCAL ] W: Loaded 53901 existing records from primary storage. [2025-09-18T22:59:50.494361] [INFO ] [MAIN ] W: Loaded 53901 primary data records. [2025-09-18T22:59:50.999144] [DEBUG] [MAIN ] VYX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:51.000168] [INFO ] [MAIN ] VYX: Generated 1807 derivative records from 49577 primary records. [2025-09-18T22:59:51.000856] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-09-18T22:59:51.018820] [DEBUG] [LOCAL ] VYX: Derivative data saved (1807 records). [2025-09-18T22:59:51.019441] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-09-18T22:59:51.021446] [INFO ] [MAIN ] Derivative Progress: 1976/2075 symbols completed. VYX took 1.1s. Estimated remaining: 38.4s. Rate: 154.8 symbols/min [2025-09-18T22:59:51.021893] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:51.039907] [DEBUG] [MAIN ] VZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:51.040797] [INFO ] [MAIN ] VZ: Generated 1807 derivative records from 54181 primary records. [2025-09-18T22:59:51.041032] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-09-18T22:59:51.073723] [DEBUG] [MAIN ] W: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:51.074939] [INFO ] [MAIN ] W: Generated 1807 derivative records from 53901 primary records. [2025-09-18T22:59:51.075292] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-09-18T22:59:51.076182] [DEBUG] [LOCAL ] VZ: Derivative data saved (1807 records). [2025-09-18T22:59:51.076353] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-09-18T22:59:51.079097] [INFO ] [MAIN ] Derivative Progress: 1977/2075 symbols completed. VZ took 1.1s. Estimated remaining: 38.0s. Rate: 154.8 symbols/min [2025-09-18T22:59:51.090500] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:51.104394] [DEBUG] [LOCAL ] W: Derivative data saved (1807 records). [2025-09-18T22:59:51.104542] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-09-18T22:59:51.107385] [INFO ] [MAIN ] Derivative Progress: 1978/2075 symbols completed. W took 1.1s. Estimated remaining: 37.6s. Rate: 154.9 symbols/min [2025-09-18T22:59:51.123083] [DEBUG] [LOCAL ] WAB: Loaded 44728 existing records from primary storage. [2025-09-18T22:59:51.123248] [INFO ] [MAIN ] WAB: Loaded 44728 primary data records. [2025-09-18T22:59:51.442860] [DEBUG] [LOCAL ] WAL: Loaded 45891 existing records from primary storage. [2025-09-18T22:59:51.443086] [INFO ] [MAIN ] WAL: Loaded 45891 primary data records. [2025-09-18T22:59:51.792188] [DEBUG] [MAIN ] WAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:51.793199] [INFO ] [MAIN ] WAB: Generated 1807 derivative records from 44728 primary records. [2025-09-18T22:59:51.793555] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-09-18T22:59:51.811025] [DEBUG] [LOCAL ] WAB: Derivative data saved (1807 records). [2025-09-18T22:59:51.811106] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-09-18T22:59:51.813477] [INFO ] [MAIN ] Derivative Progress: 1979/2075 symbols completed. WAB took 0.8s. Estimated remaining: 37.2s. Rate: 154.8 symbols/min [2025-09-18T22:59:51.830221] [DEBUG] [MAIN ] WAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:51.830865] [INFO ] [MAIN ] WAL: Generated 1807 derivative records from 45891 primary records. [2025-09-18T22:59:51.830929] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-09-18T22:59:51.846314] [DEBUG] [LOCAL ] WAL: Derivative data saved (1807 records). [2025-09-18T22:59:51.846375] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-09-18T22:59:51.848824] [INFO ] [MAIN ] Derivative Progress: 1980/2075 symbols completed. WAL took 0.8s. Estimated remaining: 36.8s. Rate: 154.9 symbols/min [2025-09-18T22:59:51.850449] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:51.850340] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:51.850274] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:51.865737] [DEBUG] [LOCAL ] WBX: Loaded 13459 existing records from primary storage. [2025-09-18T22:59:51.865942] [INFO ] [MAIN ] WBX: Loaded 13459 primary data records. [2025-09-18T22:59:52.193312] [DEBUG] [LOCAL ] WAT: Loaded 35393 existing records from primary storage. [2025-09-18T22:59:52.193599] [INFO ] [MAIN ] WAT: Loaded 35393 primary data records. [2025-09-18T22:59:52.251553] [DEBUG] [LOCAL ] WBS: Loaded 49249 existing records from primary storage. [2025-09-18T22:59:52.281162] [INFO ] [MAIN ] WBS: Loaded 49249 primary data records. [2025-09-18T22:59:52.872901] [DEBUG] [MAIN ] WBX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:52.874436] [INFO ] [MAIN ] WBX: Generated 1807 derivative records from 13459 primary records. [2025-09-18T22:59:52.874636] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-09-18T22:59:52.899780] [DEBUG] [LOCAL ] WBX: Derivative data saved (1807 records). [2025-09-18T22:59:52.900046] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-09-18T22:59:52.902611] [INFO ] [MAIN ] Derivative Progress: 1981/2075 symbols completed. WBX took 1.1s. Estimated remaining: 36.4s. Rate: 154.8 symbols/min [2025-09-18T22:59:52.903274] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:52.916767] [DEBUG] [MAIN ] WAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:52.917695] [INFO ] [MAIN ] WAT: Generated 1807 derivative records from 35393 primary records. [2025-09-18T22:59:52.917866] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-09-18T22:59:52.946184] [DEBUG] [MAIN ] WBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:52.947302] [INFO ] [MAIN ] WBS: Generated 1807 derivative records from 49249 primary records. [2025-09-18T22:59:52.947694] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-09-18T22:59:52.964313] [DEBUG] [LOCAL ] WAT: Derivative data saved (1807 records). [2025-09-18T22:59:52.965894] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-09-18T22:59:52.966980] [DEBUG] [LOCAL ] WBS: Derivative data saved (1807 records). [2025-09-18T22:59:52.969287] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-09-18T22:59:52.969224] [INFO ] [MAIN ] Derivative Progress: 1982/2075 symbols completed. WAT took 1.1s. Estimated remaining: 36.0s. Rate: 154.8 symbols/min [2025-09-18T22:59:52.972196] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:52.972589] [INFO ] [MAIN ] Derivative Progress: 1983/2075 symbols completed. WBS took 1.1s. Estimated remaining: 35.6s. Rate: 154.9 symbols/min [2025-09-18T22:59:52.983020] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:53.001910] [DEBUG] [LOCAL ] WCC: Loaded 40584 existing records from primary storage. [2025-09-18T22:59:53.002058] [INFO ] [MAIN ] WCC: Loaded 40584 primary data records. [2025-09-18T22:59:53.187200] [DEBUG] [LOCAL ] WD: Loaded 23701 existing records from primary storage. [2025-09-18T22:59:53.188066] [INFO ] [MAIN ] WD: Loaded 23701 primary data records. [2025-09-18T22:59:53.457473] [DEBUG] [LOCAL ] WCN: Loaded 48451 existing records from primary storage. [2025-09-18T22:59:53.458137] [INFO ] [MAIN ] WCN: Loaded 48451 primary data records. [2025-09-18T22:59:54.044034] [DEBUG] [MAIN ] WCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:54.044956] [INFO ] [MAIN ] WCC: Generated 1807 derivative records from 40584 primary records. [2025-09-18T22:59:54.045255] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-09-18T22:59:54.082033] [DEBUG] [MAIN ] WD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:54.083817] [INFO ] [MAIN ] WD: Generated 1807 derivative records from 23701 primary records. [2025-09-18T22:59:54.084782] [DEBUG] [LOCAL ] WCC: Derivative data saved (1807 records). [2025-09-18T22:59:54.085240] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-09-18T22:59:54.085112] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-09-18T22:59:54.089336] [INFO ] [MAIN ] Derivative Progress: 1984/2075 symbols completed. WCC took 1.2s. Estimated remaining: 35.3s. Rate: 154.8 symbols/min [2025-09-18T22:59:54.091109] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:54.117554] [DEBUG] [MAIN ] WCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:54.120409] [INFO ] [MAIN ] WCN: Generated 1807 derivative records from 48451 primary records. [2025-09-18T22:59:54.120762] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-09-18T22:59:54.123207] [DEBUG] [LOCAL ] WD: Derivative data saved (1807 records). [2025-09-18T22:59:54.130553] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-09-18T22:59:54.137000] [INFO ] [MAIN ] Derivative Progress: 1985/2075 symbols completed. WD took 1.2s. Estimated remaining: 34.9s. Rate: 154.8 symbols/min [2025-09-18T22:59:54.141292] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:54.150744] [DEBUG] [LOCAL ] WDH: Loaded 16529 existing records from primary storage. [2025-09-18T22:59:54.151456] [INFO ] [MAIN ] WDH: Loaded 16529 primary data records. [2025-09-18T22:59:54.254144] [DEBUG] [LOCAL ] WCN: Derivative data saved (1807 records). [2025-09-18T22:59:54.282595] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-09-18T22:59:54.335225] [INFO ] [MAIN ] Derivative Progress: 1986/2075 symbols completed. WCN took 1.4s. Estimated remaining: 34.5s. Rate: 154.9 symbols/min [2025-09-18T22:59:54.354358] [DEBUG] [LOCAL ] WDI: Loaded 21478 existing records from primary storage. [2025-09-18T22:59:54.481450] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:54.481681] [INFO ] [MAIN ] WDI: Loaded 21478 primary data records. [2025-09-18T22:59:54.914932] [DEBUG] [MAIN ] WDH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:54.940191] [INFO ] [MAIN ] WDH: Generated 1807 derivative records from 16529 primary records. [2025-09-18T22:59:54.942455] [DEBUG] [LOCAL ] WDS: Loaded 44163 existing records from primary storage. [2025-09-18T22:59:54.940718] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-09-18T22:59:54.944487] [INFO ] [MAIN ] WDS: Loaded 44163 primary data records. [2025-09-18T22:59:55.019229] [DEBUG] [LOCAL ] WDH: Derivative data saved (1807 records). [2025-09-18T22:59:55.046879] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-09-18T22:59:55.065964] [INFO ] [MAIN ] Derivative Progress: 1987/2075 symbols completed. WDH took 1.0s. Estimated remaining: 34.1s. Rate: 154.8 symbols/min [2025-09-18T22:59:55.077888] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:55.149501] [DEBUG] [MAIN ] WDI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:55.156783] [INFO ] [MAIN ] WDI: Generated 1807 derivative records from 21478 primary records. [2025-09-18T22:59:55.183574] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-09-18T22:59:55.218489] [DEBUG] [LOCAL ] WEA: Loaded 7523 existing records from primary storage. [2025-09-18T22:59:55.247569] [INFO ] [MAIN ] WEA: Loaded 7523 primary data records. [2025-09-18T22:59:55.577022] [DEBUG] [LOCAL ] WDI: Derivative data saved (1807 records). [2025-09-18T22:59:55.588509] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-09-18T22:59:55.618444] [INFO ] [MAIN ] Derivative Progress: 1988/2075 symbols completed. WDI took 1.5s. Estimated remaining: 33.7s. Rate: 154.8 symbols/min [2025-09-18T22:59:55.619408] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:55.933933] [DEBUG] [MAIN ] WDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:55.935584] [INFO ] [MAIN ] WDS: Generated 1807 derivative records from 44163 primary records. [2025-09-18T22:59:55.935738] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-09-18T22:59:55.962809] [DEBUG] [LOCAL ] WEAV: Loaded 42365 existing records from primary storage. [2025-09-18T22:59:55.964536] [INFO ] [MAIN ] WEAV: Loaded 42365 primary data records. [2025-09-18T22:59:56.086721] [DEBUG] [LOCAL ] WDS: Derivative data saved (1807 records). [2025-09-18T22:59:56.097277] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-09-18T22:59:56.099532] [INFO ] [MAIN ] Derivative Progress: 1989/2075 symbols completed. WDS took 1.7s. Estimated remaining: 33.3s. Rate: 154.8 symbols/min [2025-09-18T22:59:56.134625] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:56.296533] [DEBUG] [MAIN ] WEA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:56.309223] [INFO ] [MAIN ] WEA: Generated 1807 derivative records from 7523 primary records. [2025-09-18T22:59:56.309387] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-09-18T22:59:56.328356] [DEBUG] [LOCAL ] WEA: Derivative data saved (1807 records). [2025-09-18T22:59:56.328891] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-09-18T22:59:56.331383] [INFO ] [MAIN ] Derivative Progress: 1990/2075 symbols completed. WEA took 1.3s. Estimated remaining: 32.9s. Rate: 154.8 symbols/min [2025-09-18T22:59:56.332621] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:56.354952] [DEBUG] [MAIN ] WEAV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:56.355811] [INFO ] [MAIN ] WEAV: Generated 1807 derivative records from 42365 primary records. [2025-09-18T22:59:56.355876] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-09-18T22:59:56.387136] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1807 records). [2025-09-18T22:59:56.387259] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-09-18T22:59:56.389381] [INFO ] [MAIN ] Derivative Progress: 1991/2075 symbols completed. WEAV took 0.8s. Estimated remaining: 32.5s. Rate: 154.9 symbols/min [2025-09-18T22:59:56.389729] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:56.422803] [DEBUG] [LOCAL ] WEC: Loaded 52605 existing records from primary storage. [2025-09-18T22:59:56.423013] [INFO ] [MAIN ] WEC: Loaded 52605 primary data records. [2025-09-18T22:59:56.542628] [DEBUG] [LOCAL ] WELL: Loaded 52746 existing records from primary storage. [2025-09-18T22:59:56.558972] [INFO ] [MAIN ] WELL: Loaded 52746 primary data records. [2025-09-18T22:59:56.880921] [DEBUG] [LOCAL ] WES: Loaded 48435 existing records from primary storage. [2025-09-18T22:59:56.881258] [INFO ] [MAIN ] WES: Loaded 48435 primary data records. [2025-09-18T22:59:57.427500] [DEBUG] [MAIN ] WEC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:57.428805] [INFO ] [MAIN ] WEC: Generated 1807 derivative records from 52605 primary records. [2025-09-18T22:59:57.428938] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-09-18T22:59:57.449430] [DEBUG] [LOCAL ] WEC: Derivative data saved (1807 records). [2025-09-18T22:59:57.450496] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-09-18T22:59:57.452749] [INFO ] [MAIN ] Derivative Progress: 1992/2075 symbols completed. WEC took 1.3s. Estimated remaining: 32.2s. Rate: 154.7 symbols/min [2025-09-18T22:59:57.453456] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:57.468583] [DEBUG] [MAIN ] WELL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:57.470007] [INFO ] [MAIN ] WELL: Generated 1807 derivative records from 52746 primary records. [2025-09-18T22:59:57.470237] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-09-18T22:59:57.506164] [DEBUG] [MAIN ] WES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:57.507800] [INFO ] [MAIN ] WES: Generated 1807 derivative records from 48435 primary records. [2025-09-18T22:59:57.508163] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-09-18T22:59:57.526440] [DEBUG] [LOCAL ] WELL: Derivative data saved (1807 records). [2025-09-18T22:59:57.527357] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-09-18T22:59:57.532043] [INFO ] [MAIN ] Derivative Progress: 1993/2075 symbols completed. WELL took 1.2s. Estimated remaining: 31.8s. Rate: 154.8 symbols/min [2025-09-18T22:59:57.536853] [DEBUG] [LOCAL ] WES: Derivative data saved (1807 records). [2025-09-18T22:59:57.536916] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-09-18T22:59:57.539347] [INFO ] [MAIN ] Derivative Progress: 1994/2075 symbols completed. WES took 1.1s. Estimated remaining: 31.4s. Rate: 154.9 symbols/min [2025-09-18T22:59:57.551427] [DEBUG] [LOCAL ] WEX: Loaded 35964 existing records from primary storage. [2025-09-18T22:59:57.551672] [INFO ] [MAIN ] WEX: Loaded 35964 primary data records. [2025-09-18T22:59:57.885440] [DEBUG] [MAIN ] WEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:57.886208] [INFO ] [MAIN ] WEX: Generated 1807 derivative records from 35964 primary records. [2025-09-18T22:59:57.886280] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-09-18T22:59:57.902744] [DEBUG] [LOCAL ] WEX: Derivative data saved (1807 records). [2025-09-18T22:59:57.902809] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-09-18T22:59:57.905011] [INFO ] [MAIN ] Derivative Progress: 1995/2075 symbols completed. WEX took 0.5s. Estimated remaining: 31.0s. Rate: 154.9 symbols/min [2025-09-18T22:59:57.905887] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:57.906106] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:57.906210] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:57.920694] [DEBUG] [LOCAL ] WF: Loaded 11177 existing records from primary storage. [2025-09-18T22:59:57.920857] [INFO ] [MAIN ] WF: Loaded 11177 primary data records. [2025-09-18T22:59:58.049119] [DEBUG] [LOCAL ] WFG: Loaded 25332 existing records from primary storage. [2025-09-18T22:59:58.055189] [INFO ] [MAIN ] WFG: Loaded 25332 primary data records. [2025-09-18T22:59:58.422453] [DEBUG] [LOCAL ] WFC: Loaded 54138 existing records from primary storage. [2025-09-18T22:59:58.445240] [INFO ] [MAIN ] WFC: Loaded 54138 primary data records. [2025-09-18T22:59:58.983872] [DEBUG] [MAIN ] WF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:58.985249] [INFO ] [MAIN ] WF: Generated 1807 derivative records from 11177 primary records. [2025-09-18T22:59:58.986556] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-09-18T22:59:59.016525] [DEBUG] [MAIN ] WFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:59.018256] [INFO ] [MAIN ] WFG: Generated 1807 derivative records from 25332 primary records. [2025-09-18T22:59:59.019584] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-09-18T22:59:59.038879] [DEBUG] [LOCAL ] WFG: Derivative data saved (1807 records). [2025-09-18T22:59:59.041017] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-09-18T22:59:59.043014] [INFO ] [MAIN ] Derivative Progress: 1996/2075 symbols completed. WFG took 1.1s. Estimated remaining: 30.6s. Rate: 154.7 symbols/min [2025-09-18T22:59:59.040314] [DEBUG] [LOCAL ] WF: Derivative data saved (1807 records). [2025-09-18T22:59:59.043569] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:59.043775] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-09-18T22:59:59.046755] [INFO ] [MAIN ] Derivative Progress: 1997/2075 symbols completed. WF took 1.1s. Estimated remaining: 30.2s. Rate: 154.8 symbols/min [2025-09-18T22:59:59.047117] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:59.060841] [DEBUG] [MAIN ] WFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T22:59:59.061690] [INFO ] [MAIN ] WFC: Generated 1807 derivative records from 54138 primary records. [2025-09-18T22:59:59.061898] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-09-18T22:59:59.078639] [DEBUG] [LOCAL ] WFC: Derivative data saved (1807 records). [2025-09-18T22:59:59.078860] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-09-18T22:59:59.081402] [INFO ] [MAIN ] Derivative Progress: 1998/2075 symbols completed. WFC took 1.2s. Estimated remaining: 29.8s. Rate: 154.9 symbols/min [2025-09-18T22:59:59.081785] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-09-18T22:59:59.123214] [DEBUG] [LOCAL ] WGO: Loaded 39934 existing records from primary storage. [2025-09-18T22:59:59.123480] [INFO ] [MAIN ] WGO: Loaded 39934 primary data records. [2025-09-18T22:59:59.274302] [DEBUG] [LOCAL ] WH: Loaded 46318 existing records from primary storage. [2025-09-18T22:59:59.289973] [INFO ] [MAIN ] WH: Loaded 46318 primary data records. [2025-09-18T22:59:59.344268] [DEBUG] [LOCAL ] WHD: Loaded 41111 existing records from primary storage. [2025-09-18T22:59:59.390067] [INFO ] [MAIN ] WHD: Loaded 41111 primary data records. [2025-09-18T23:00:00.164210] [DEBUG] [MAIN ] WGO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:00.165184] [INFO ] [MAIN ] WGO: Generated 1807 derivative records from 39934 primary records. [2025-09-18T23:00:00.165492] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-09-18T23:00:00.183526] [DEBUG] [LOCAL ] WGO: Derivative data saved (1807 records). [2025-09-18T23:00:00.183912] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-09-18T23:00:00.186244] [INFO ] [MAIN ] Derivative Progress: 1999/2075 symbols completed. WGO took 1.1s. Estimated remaining: 29.5s. Rate: 154.7 symbols/min [2025-09-18T23:00:00.187670] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:00.207710] [DEBUG] [MAIN ] WH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:00.212380] [INFO ] [MAIN ] WH: Generated 1807 derivative records from 46318 primary records. [2025-09-18T23:00:00.212538] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-09-18T23:00:00.212767] [DEBUG] [LOCAL ] WHG: Loaded 3438 existing records from primary storage. [2025-09-18T23:00:00.215389] [INFO ] [MAIN ] WHG: Loaded 3438 primary data records. [2025-09-18T23:00:00.319498] [DEBUG] [MAIN ] WHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:00.327904] [INFO ] [MAIN ] WHD: Generated 1807 derivative records from 41111 primary records. [2025-09-18T23:00:00.339342] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-09-18T23:00:00.348796] [DEBUG] [LOCAL ] WH: Derivative data saved (1807 records). [2025-09-18T23:00:00.361407] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-09-18T23:00:00.363754] [INFO ] [MAIN ] Derivative Progress: 2000/2075 symbols completed. WH took 1.3s. Estimated remaining: 29.1s. Rate: 154.8 symbols/min [2025-09-18T23:00:00.371417] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:00.587671] [DEBUG] [LOCAL ] WHD: Derivative data saved (1807 records). [2025-09-18T23:00:00.588041] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-09-18T23:00:00.590414] [INFO ] [MAIN ] Derivative Progress: 2001/2075 symbols completed. WHD took 1.5s. Estimated remaining: 28.7s. Rate: 154.8 symbols/min [2025-09-18T23:00:00.591605] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:00.599779] [DEBUG] [LOCAL ] WIA: Loaded 4916 existing records from primary storage. [2025-09-18T23:00:00.600707] [INFO ] [MAIN ] WIA: Loaded 4916 primary data records. [2025-09-18T23:00:00.806825] [DEBUG] [LOCAL ] WHR: Loaded 48527 existing records from primary storage. [2025-09-18T23:00:00.813741] [INFO ] [MAIN ] WHR: Loaded 48527 primary data records. [2025-09-18T23:00:01.027257] [DEBUG] [MAIN ] WHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:01.039920] [INFO ] [MAIN ] WHG: Generated 1807 derivative records from 3438 primary records. [2025-09-18T23:00:01.047662] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-09-18T23:00:01.269542] [DEBUG] [LOCAL ] WHG: Derivative data saved (1807 records). [2025-09-18T23:00:01.270080] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-09-18T23:00:01.272392] [INFO ] [MAIN ] Derivative Progress: 2002/2075 symbols completed. WHG took 1.1s. Estimated remaining: 28.3s. Rate: 154.7 symbols/min [2025-09-18T23:00:01.274517] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:01.307517] [DEBUG] [MAIN ] WIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:01.313404] [INFO ] [MAIN ] WIA: Generated 1807 derivative records from 4916 primary records. [2025-09-18T23:00:01.314170] [DEBUG] [LOCAL ] WINN: Loaded 12035 existing records from primary storage. [2025-09-18T23:00:01.314436] [INFO ] [MAIN ] WINN: Loaded 12035 primary data records. [2025-09-18T23:00:01.313793] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-09-18T23:00:01.459958] [DEBUG] [LOCAL ] WIA: Derivative data saved (1807 records). [2025-09-18T23:00:01.470512] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-09-18T23:00:01.540698] [INFO ] [MAIN ] Derivative Progress: 2003/2075 symbols completed. WIA took 0.9s. Estimated remaining: 27.9s. Rate: 154.8 symbols/min [2025-09-18T23:00:01.651756] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:01.646321] [DEBUG] [MAIN ] WHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:01.662444] [INFO ] [MAIN ] WHR: Generated 1807 derivative records from 48527 primary records. [2025-09-18T23:00:01.662781] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-09-18T23:00:01.681324] [DEBUG] [LOCAL ] WHR: Derivative data saved (1807 records). [2025-09-18T23:00:01.682924] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-09-18T23:00:01.686011] [INFO ] [MAIN ] Derivative Progress: 2004/2075 symbols completed. WHR took 1.3s. Estimated remaining: 27.5s. Rate: 154.8 symbols/min [2025-09-18T23:00:01.687271] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:01.719305] [DEBUG] [LOCAL ] WIW: Loaded 21003 existing records from primary storage. [2025-09-18T23:00:01.719805] [INFO ] [MAIN ] WIW: Loaded 21003 primary data records. [2025-09-18T23:00:01.784059] [DEBUG] [MAIN ] WINN: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T23:00:01.823607] [INFO ] [MAIN ] WINN: Generated 1806 derivative records from 12035 primary records. [2025-09-18T23:00:01.847219] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-09-18T23:00:01.973206] [DEBUG] [LOCAL ] WIT: Loaded 52651 existing records from primary storage. [2025-09-18T23:00:02.126989] [INFO ] [MAIN ] WIT: Loaded 52651 primary data records. [2025-09-18T23:00:02.237245] [DEBUG] [LOCAL ] WINN: Derivative data saved (1806 records). [2025-09-18T23:00:02.257266] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-09-18T23:00:02.283159] [INFO ] [MAIN ] Derivative Progress: 2005/2075 symbols completed. WINN took 1.0s. Estimated remaining: 27.1s. Rate: 154.8 symbols/min [2025-09-18T23:00:02.304453] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:02.541371] [DEBUG] [MAIN ] WIW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:02.542932] [INFO ] [MAIN ] WIW: Generated 1807 derivative records from 21003 primary records. [2025-09-18T23:00:02.543330] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-09-18T23:00:02.578284] [DEBUG] [LOCAL ] WIW: Derivative data saved (1807 records). [2025-09-18T23:00:02.591133] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-09-18T23:00:02.593884] [INFO ] [MAIN ] Derivative Progress: 2006/2075 symbols completed. WIW took 0.9s. Estimated remaining: 26.7s. Rate: 154.8 symbols/min [2025-09-18T23:00:02.596005] [DEBUG] [LOCAL ] WK: Loaded 36780 existing records from primary storage. [2025-09-18T23:00:02.594569] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:02.596970] [INFO ] [MAIN ] WK: Loaded 36780 primary data records. [2025-09-18T23:00:02.738069] [DEBUG] [MAIN ] WIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:02.751195] [INFO ] [MAIN ] WIT: Generated 1807 derivative records from 52651 primary records. [2025-09-18T23:00:02.794367] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-09-18T23:00:02.989832] [DEBUG] [LOCAL ] WKC: Loaded 35580 existing records from primary storage. [2025-09-18T23:00:02.992811] [INFO ] [MAIN ] WKC: Loaded 35580 primary data records. [2025-09-18T23:00:03.115448] [DEBUG] [LOCAL ] WIT: Derivative data saved (1807 records). [2025-09-18T23:00:03.116060] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-09-18T23:00:03.144532] [INFO ] [MAIN ] Derivative Progress: 2007/2075 symbols completed. WIT took 1.5s. Estimated remaining: 26.4s. Rate: 154.7 symbols/min [2025-09-18T23:00:03.177828] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:03.348450] [DEBUG] [MAIN ] WK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:03.349283] [INFO ] [MAIN ] WK: Generated 1807 derivative records from 36780 primary records. [2025-09-18T23:00:03.349454] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-09-18T23:00:03.369265] [DEBUG] [LOCAL ] WK: Derivative data saved (1807 records). [2025-09-18T23:00:03.369402] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-09-18T23:00:03.371729] [INFO ] [MAIN ] Derivative Progress: 2008/2075 symbols completed. WK took 1.1s. Estimated remaining: 26.0s. Rate: 154.8 symbols/min [2025-09-18T23:00:03.403096] [DEBUG] [MAIN ] WKC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:03.404045] [INFO ] [MAIN ] WKC: Generated 1807 derivative records from 35580 primary records. [2025-09-18T23:00:03.404207] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-09-18T23:00:03.433984] [DEBUG] [LOCAL ] WLK: Loaded 45575 existing records from primary storage. [2025-09-18T23:00:03.434586] [INFO ] [MAIN ] WLK: Loaded 45575 primary data records. [2025-09-18T23:00:03.541298] [DEBUG] [LOCAL ] WKC: Derivative data saved (1807 records). [2025-09-18T23:00:03.544403] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-09-18T23:00:03.546791] [INFO ] [MAIN ] Derivative Progress: 2009/2075 symbols completed. WKC took 1.0s. Estimated remaining: 25.6s. Rate: 154.8 symbols/min [2025-09-18T23:00:03.765822] [DEBUG] [MAIN ] WLK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:03.766440] [INFO ] [MAIN ] WLK: Generated 1807 derivative records from 45575 primary records. [2025-09-18T23:00:03.766505] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-09-18T23:00:03.782289] [DEBUG] [LOCAL ] WLK: Derivative data saved (1807 records). [2025-09-18T23:00:03.782359] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-09-18T23:00:03.784526] [INFO ] [MAIN ] Derivative Progress: 2010/2075 symbols completed. WLK took 0.6s. Estimated remaining: 25.2s. Rate: 154.9 symbols/min [2025-09-18T23:00:03.785258] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:03.785405] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:03.785335] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:03.795763] [DEBUG] [LOCAL ] WLKP: Loaded 6570 existing records from primary storage. [2025-09-18T23:00:03.795894] [INFO ] [MAIN ] WLKP: Loaded 6570 primary data records. [2025-09-18T23:00:04.178375] [DEBUG] [LOCAL ] WLY: Loaded 30818 existing records from primary storage. [2025-09-18T23:00:04.187233] [INFO ] [MAIN ] WLY: Loaded 30818 primary data records. [2025-09-18T23:00:04.322108] [DEBUG] [LOCAL ] WM: Loaded 51376 existing records from primary storage. [2025-09-18T23:00:04.348919] [INFO ] [MAIN ] WM: Loaded 51376 primary data records. [2025-09-18T23:00:04.925043] [DEBUG] [MAIN ] WLKP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:04.927335] [INFO ] [MAIN ] WLKP: Generated 1807 derivative records from 6570 primary records. [2025-09-18T23:00:04.927546] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-09-18T23:00:04.948159] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1807 records). [2025-09-18T23:00:04.948865] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-09-18T23:00:04.951774] [INFO ] [MAIN ] Derivative Progress: 2011/2075 symbols completed. WLKP took 1.2s. Estimated remaining: 24.8s. Rate: 154.7 symbols/min [2025-09-18T23:00:04.952581] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:04.972668] [DEBUG] [MAIN ] WLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:04.973515] [INFO ] [MAIN ] WLY: Generated 1807 derivative records from 30818 primary records. [2025-09-18T23:00:04.974101] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-09-18T23:00:04.993475] [DEBUG] [LOCAL ] WLY: Derivative data saved (1807 records). [2025-09-18T23:00:04.995495] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-09-18T23:00:04.997709] [INFO ] [MAIN ] Derivative Progress: 2012/2075 symbols completed. WLY took 1.2s. Estimated remaining: 24.4s. Rate: 154.8 symbols/min [2025-09-18T23:00:04.998337] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:05.012483] [DEBUG] [MAIN ] WM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:05.013476] [INFO ] [MAIN ] WM: Generated 1807 derivative records from 51376 primary records. [2025-09-18T23:00:05.013665] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-09-18T23:00:05.055671] [DEBUG] [LOCAL ] WMK: Loaded 14621 existing records from primary storage. [2025-09-18T23:00:05.056706] [INFO ] [MAIN ] WMK: Loaded 14621 primary data records. [2025-09-18T23:00:05.056563] [DEBUG] [LOCAL ] WM: Derivative data saved (1807 records). [2025-09-18T23:00:05.100692] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-09-18T23:00:05.144589] [INFO ] [MAIN ] Derivative Progress: 2013/2075 symbols completed. WM took 1.4s. Estimated remaining: 24.0s. Rate: 154.8 symbols/min [2025-09-18T23:00:05.162480] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:05.163684] [DEBUG] [LOCAL ] WMB: Loaded 54061 existing records from primary storage. [2025-09-18T23:00:05.181473] [INFO ] [MAIN ] WMB: Loaded 54061 primary data records. [2025-09-18T23:00:05.723076] [DEBUG] [LOCAL ] WMS: Loaded 39951 existing records from primary storage. [2025-09-18T23:00:05.725903] [INFO ] [MAIN ] WMS: Loaded 39951 primary data records. [2025-09-18T23:00:05.921778] [DEBUG] [MAIN ] WMK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:05.943438] [INFO ] [MAIN ] WMK: Generated 1807 derivative records from 14621 primary records. [2025-09-18T23:00:05.943632] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-09-18T23:00:06.097852] [DEBUG] [MAIN ] WMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:06.101267] [INFO ] [MAIN ] WMB: Generated 1807 derivative records from 54061 primary records. [2025-09-18T23:00:06.100409] [DEBUG] [LOCAL ] WMK: Derivative data saved (1807 records). [2025-09-18T23:00:06.101906] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-09-18T23:00:06.101821] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-09-18T23:00:06.107790] [INFO ] [MAIN ] Derivative Progress: 2014/2075 symbols completed. WMK took 1.1s. Estimated remaining: 23.7s. Rate: 154.7 symbols/min [2025-09-18T23:00:06.115593] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:06.126807] [DEBUG] [LOCAL ] WMB: Derivative data saved (1807 records). [2025-09-18T23:00:06.127060] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-09-18T23:00:06.129118] [INFO ] [MAIN ] Derivative Progress: 2015/2075 symbols completed. WMB took 1.2s. Estimated remaining: 23.3s. Rate: 154.8 symbols/min [2025-09-18T23:00:06.129626] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:06.160956] [DEBUG] [MAIN ] WMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:06.161752] [INFO ] [MAIN ] WMS: Generated 1807 derivative records from 39951 primary records. [2025-09-18T23:00:06.161908] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-09-18T23:00:06.205328] [DEBUG] [LOCAL ] WMS: Derivative data saved (1807 records). [2025-09-18T23:00:06.205538] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-09-18T23:00:06.207867] [INFO ] [MAIN ] Derivative Progress: 2016/2075 symbols completed. WMS took 1.0s. Estimated remaining: 22.9s. Rate: 154.8 symbols/min [2025-09-18T23:00:06.208259] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:06.226770] [DEBUG] [LOCAL ] WNC: Loaded 40856 existing records from primary storage. [2025-09-18T23:00:06.239999] [INFO ] [MAIN ] WNC: Loaded 40856 primary data records. [2025-09-18T23:00:06.279408] [DEBUG] [LOCAL ] WMT: Loaded 54190 existing records from primary storage. [2025-09-18T23:00:06.299002] [INFO ] [MAIN ] WMT: Loaded 54190 primary data records. [2025-09-18T23:00:06.560122] [DEBUG] [LOCAL ] WNS: Loaded 40016 existing records from primary storage. [2025-09-18T23:00:06.579340] [INFO ] [MAIN ] WNS: Loaded 40016 primary data records. [2025-09-18T23:00:07.287827] [DEBUG] [MAIN ] WMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:07.288988] [INFO ] [MAIN ] WMT: Generated 1807 derivative records from 54190 primary records. [2025-09-18T23:00:07.289634] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-09-18T23:00:07.304466] [DEBUG] [MAIN ] WNC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T23:00:07.305493] [INFO ] [MAIN ] WNC: Generated 1806 derivative records from 40856 primary records. [2025-09-18T23:00:07.305968] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-09-18T23:00:07.339674] [DEBUG] [LOCAL ] WNC: Derivative data saved (1806 records). [2025-09-18T23:00:07.340567] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-09-18T23:00:07.346587] [INFO ] [MAIN ] Derivative Progress: 2017/2075 symbols completed. WNC took 1.2s. Estimated remaining: 22.5s. Rate: 154.7 symbols/min [2025-09-18T23:00:07.347718] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:07.349261] [DEBUG] [LOCAL ] WMT: Derivative data saved (1807 records). [2025-09-18T23:00:07.349801] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-09-18T23:00:07.353836] [INFO ] [MAIN ] Derivative Progress: 2018/2075 symbols completed. WMT took 1.2s. Estimated remaining: 22.1s. Rate: 154.8 symbols/min [2025-09-18T23:00:07.354498] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:07.372790] [DEBUG] [MAIN ] WNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:07.373546] [INFO ] [MAIN ] WNS: Generated 1807 derivative records from 40016 primary records. [2025-09-18T23:00:07.373632] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-09-18T23:00:07.390119] [DEBUG] [LOCAL ] WNS: Derivative data saved (1807 records). [2025-09-18T23:00:07.401351] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-09-18T23:00:07.403783] [INFO ] [MAIN ] Derivative Progress: 2019/2075 symbols completed. WNS took 1.2s. Estimated remaining: 21.7s. Rate: 154.8 symbols/min [2025-09-18T23:00:07.404240] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:07.416105] [DEBUG] [LOCAL ] WOR: Loaded 24959 existing records from primary storage. [2025-09-18T23:00:07.416287] [INFO ] [MAIN ] WOR: Loaded 24959 primary data records. [2025-09-18T23:00:07.634116] [DEBUG] [LOCAL ] WOW: Loaded 30017 existing records from primary storage. [2025-09-18T23:00:07.670463] [DEBUG] [LOCAL ] WOLF: Loaded 53922 existing records from primary storage. [2025-09-18T23:00:07.670627] [INFO ] [MAIN ] WOW: Loaded 30017 primary data records. [2025-09-18T23:00:07.670724] [INFO ] [MAIN ] WOLF: Loaded 53922 primary data records. [2025-09-18T23:00:08.477910] [DEBUG] [MAIN ] WOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:08.480002] [INFO ] [MAIN ] WOR: Generated 1807 derivative records from 24959 primary records. [2025-09-18T23:00:08.480305] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-09-18T23:00:08.514219] [DEBUG] [LOCAL ] WOR: Derivative data saved (1807 records). [2025-09-18T23:00:08.514605] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-09-18T23:00:08.516774] [INFO ] [MAIN ] Derivative Progress: 2020/2075 symbols completed. WOR took 1.2s. Estimated remaining: 21.3s. Rate: 154.7 symbols/min [2025-09-18T23:00:08.513206] [DEBUG] [MAIN ] WOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:08.517336] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:08.518214] [INFO ] [MAIN ] WOW: Generated 1807 derivative records from 30017 primary records. [2025-09-18T23:00:08.520912] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-09-18T23:00:08.549282] [DEBUG] [MAIN ] WOLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:08.551134] [DEBUG] [LOCAL ] WOW: Derivative data saved (1807 records). [2025-09-18T23:00:08.552374] [INFO ] [MAIN ] WOLF: Generated 1807 derivative records from 53922 primary records. [2025-09-18T23:00:08.552570] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-09-18T23:00:08.552624] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-09-18T23:00:08.555085] [INFO ] [MAIN ] Derivative Progress: 2021/2075 symbols completed. WOW took 1.2s. Estimated remaining: 20.9s. Rate: 154.8 symbols/min [2025-09-18T23:00:08.556490] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:08.584230] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1807 records). [2025-09-18T23:00:08.584385] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-09-18T23:00:08.586838] [INFO ] [MAIN ] Derivative Progress: 2022/2075 symbols completed. WOLF took 1.2s. Estimated remaining: 20.5s. Rate: 154.8 symbols/min [2025-09-18T23:00:08.587179] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:08.637111] [DEBUG] [LOCAL ] WPC: Loaded 49108 existing records from primary storage. [2025-09-18T23:00:08.637468] [INFO ] [MAIN ] WPC: Loaded 49108 primary data records. [2025-09-18T23:00:08.794423] [DEBUG] [LOCAL ] WPM: Loaded 53099 existing records from primary storage. [2025-09-18T23:00:08.820591] [INFO ] [MAIN ] WPM: Loaded 53099 primary data records. [2025-09-18T23:00:08.821965] [DEBUG] [LOCAL ] WPP: Loaded 33871 existing records from primary storage. [2025-09-18T23:00:08.934004] [INFO ] [MAIN ] WPP: Loaded 33871 primary data records. [2025-09-18T23:00:09.701357] [DEBUG] [MAIN ] WPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:09.702763] [INFO ] [MAIN ] WPC: Generated 1807 derivative records from 49108 primary records. [2025-09-18T23:00:09.703051] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-09-18T23:00:09.738701] [DEBUG] [LOCAL ] WPC: Derivative data saved (1807 records). [2025-09-18T23:00:09.739034] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-09-18T23:00:09.743230] [DEBUG] [MAIN ] WPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:09.744396] [INFO ] [MAIN ] WPM: Generated 1807 derivative records from 53099 primary records. [2025-09-18T23:00:09.742490] [INFO ] [MAIN ] Derivative Progress: 2023/2075 symbols completed. WPC took 1.2s. Estimated remaining: 20.2s. Rate: 154.7 symbols/min [2025-09-18T23:00:09.744571] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-09-18T23:00:09.778326] [DEBUG] [MAIN ] WPP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:09.779141] [DEBUG] [LOCAL ] WPM: Derivative data saved (1807 records). [2025-09-18T23:00:09.779393] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-09-18T23:00:09.780104] [INFO ] [MAIN ] WPP: Generated 1807 derivative records from 33871 primary records. [2025-09-18T23:00:09.782422] [INFO ] [MAIN ] Derivative Progress: 2024/2075 symbols completed. WPM took 1.2s. Estimated remaining: 19.8s. Rate: 154.7 symbols/min [2025-09-18T23:00:09.780222] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-09-18T23:00:09.798152] [DEBUG] [LOCAL ] WPP: Derivative data saved (1807 records). [2025-09-18T23:00:09.798225] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-09-18T23:00:09.800588] [INFO ] [MAIN ] Derivative Progress: 2025/2075 symbols completed. WPP took 1.2s. Estimated remaining: 19.4s. Rate: 154.8 symbols/min [2025-09-18T23:00:09.801409] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:09.801530] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:09.802729] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:09.831961] [DEBUG] [LOCAL ] WS: Loaded 24126 existing records from primary storage. [2025-09-18T23:00:09.832225] [INFO ] [MAIN ] WS: Loaded 24126 primary data records. [2025-09-18T23:00:10.053902] [DEBUG] [LOCAL ] WRB: Loaded 50994 existing records from primary storage. [2025-09-18T23:00:10.057591] [INFO ] [MAIN ] WRB: Loaded 50994 primary data records. [2025-09-18T23:00:10.095733] [DEBUG] [LOCAL ] WRBY: Loaded 51304 existing records from primary storage. [2025-09-18T23:00:10.150678] [INFO ] [MAIN ] WRBY: Loaded 51304 primary data records. [2025-09-18T23:00:10.876881] [DEBUG] [MAIN ] WS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:10.878154] [INFO ] [MAIN ] WS: Generated 1807 derivative records from 24126 primary records. [2025-09-18T23:00:10.878314] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-09-18T23:00:10.899555] [DEBUG] [LOCAL ] WS: Derivative data saved (1807 records). [2025-09-18T23:00:10.900902] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-09-18T23:00:10.902989] [INFO ] [MAIN ] Derivative Progress: 2026/2075 symbols completed. WS took 1.1s. Estimated remaining: 19.0s. Rate: 154.7 symbols/min [2025-09-18T23:00:10.916529] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:10.936800] [DEBUG] [MAIN ] WRB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:10.938701] [INFO ] [MAIN ] WRB: Generated 1807 derivative records from 50994 primary records. [2025-09-18T23:00:10.938925] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-09-18T23:00:10.939118] [DEBUG] [MAIN ] WRBY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:10.939946] [INFO ] [MAIN ] WRBY: Generated 1807 derivative records from 51304 primary records. [2025-09-18T23:00:10.941713] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-09-18T23:00:10.972993] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1807 records). [2025-09-18T23:00:10.973943] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-09-18T23:00:10.982129] [INFO ] [MAIN ] Derivative Progress: 2027/2075 symbols completed. WRBY took 1.2s. Estimated remaining: 18.6s. Rate: 154.7 symbols/min [2025-09-18T23:00:10.983663] [DEBUG] [LOCAL ] WRB: Derivative data saved (1807 records). [2025-09-18T23:00:10.983997] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:10.983945] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-09-18T23:00:10.987785] [INFO ] [MAIN ] Derivative Progress: 2028/2075 symbols completed. WRB took 1.2s. Estimated remaining: 18.2s. Rate: 154.8 symbols/min [2025-09-18T23:00:10.988314] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:11.023825] [DEBUG] [LOCAL ] WSO: Loaded 24862 existing records from primary storage. [2025-09-18T23:00:11.029505] [INFO ] [MAIN ] WSO: Loaded 24862 primary data records. [2025-09-18T23:00:11.116583] [DEBUG] [LOCAL ] WSR: Loaded 23770 existing records from primary storage. [2025-09-18T23:00:11.122957] [DEBUG] [LOCAL ] WSM: Loaded 50456 existing records from primary storage. [2025-09-18T23:00:11.145910] [INFO ] [MAIN ] WSR: Loaded 23770 primary data records. [2025-09-18T23:00:11.146019] [INFO ] [MAIN ] WSM: Loaded 50456 primary data records. [2025-09-18T23:00:11.987159] [DEBUG] [MAIN ] WSO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:11.987919] [INFO ] [MAIN ] WSO: Generated 1807 derivative records from 24862 primary records. [2025-09-18T23:00:11.988107] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-09-18T23:00:12.010730] [DEBUG] [LOCAL ] WSO: Derivative data saved (1807 records). [2025-09-18T23:00:12.023524] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-09-18T23:00:12.023910] [DEBUG] [MAIN ] WSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:12.027106] [INFO ] [MAIN ] WSM: Generated 1807 derivative records from 50456 primary records. [2025-09-18T23:00:12.026223] [INFO ] [MAIN ] Derivative Progress: 2029/2075 symbols completed. WSO took 1.0s. Estimated remaining: 17.8s. Rate: 154.7 symbols/min [2025-09-18T23:00:12.027400] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-09-18T23:00:12.027671] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:12.042032] [DEBUG] [MAIN ] WSR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:12.055174] [INFO ] [MAIN ] WSR: Generated 1807 derivative records from 23770 primary records. [2025-09-18T23:00:12.055535] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-09-18T23:00:12.075703] [DEBUG] [LOCAL ] WSM: Derivative data saved (1807 records). [2025-09-18T23:00:12.076561] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-09-18T23:00:12.079244] [INFO ] [MAIN ] Derivative Progress: 2030/2075 symbols completed. WSM took 1.2s. Estimated remaining: 17.4s. Rate: 154.7 symbols/min [2025-09-18T23:00:12.080294] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:12.080769] [DEBUG] [LOCAL ] WSR: Derivative data saved (1807 records). [2025-09-18T23:00:12.081257] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-09-18T23:00:12.083738] [INFO ] [MAIN ] Derivative Progress: 2031/2075 symbols completed. WSR took 1.1s. Estimated remaining: 17.1s. Rate: 154.8 symbols/min [2025-09-18T23:00:12.084295] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:12.117586] [DEBUG] [LOCAL ] WST: Loaded 38269 existing records from primary storage. [2025-09-18T23:00:12.117882] [INFO ] [MAIN ] WST: Loaded 38269 primary data records. [2025-09-18T23:00:12.293731] [DEBUG] [LOCAL ] WTI: Loaded 44095 existing records from primary storage. [2025-09-18T23:00:12.321685] [INFO ] [MAIN ] WTI: Loaded 44095 primary data records. [2025-09-18T23:00:12.342872] [DEBUG] [LOCAL ] WT: Loaded 47905 existing records from primary storage. [2025-09-18T23:00:12.378444] [INFO ] [MAIN ] WT: Loaded 47905 primary data records. [2025-09-18T23:00:13.143970] [DEBUG] [MAIN ] WST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:13.144926] [INFO ] [MAIN ] WST: Generated 1807 derivative records from 38269 primary records. [2025-09-18T23:00:13.145092] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-09-18T23:00:13.170712] [DEBUG] [LOCAL ] WST: Derivative data saved (1807 records). [2025-09-18T23:00:13.170997] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-09-18T23:00:13.173011] [INFO ] [MAIN ] Derivative Progress: 2032/2075 symbols completed. WST took 1.1s. Estimated remaining: 16.7s. Rate: 154.7 symbols/min [2025-09-18T23:00:13.173382] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:13.197994] [DEBUG] [MAIN ] WTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:13.199686] [DEBUG] [MAIN ] WT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:13.199389] [INFO ] [MAIN ] WTI: Generated 1807 derivative records from 44095 primary records. [2025-09-18T23:00:13.200348] [INFO ] [MAIN ] WT: Generated 1807 derivative records from 47905 primary records. [2025-09-18T23:00:13.200504] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-09-18T23:00:13.200572] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-09-18T23:00:13.241182] [DEBUG] [LOCAL ] WT: Derivative data saved (1807 records). [2025-09-18T23:00:13.241339] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-09-18T23:00:13.240861] [DEBUG] [LOCAL ] WTI: Derivative data saved (1807 records). [2025-09-18T23:00:13.244341] [INFO ] [MAIN ] Derivative Progress: 2033/2075 symbols completed. WT took 1.2s. Estimated remaining: 16.3s. Rate: 154.7 symbols/min [2025-09-18T23:00:13.244895] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-09-18T23:00:13.244768] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:13.247520] [INFO ] [MAIN ] Derivative Progress: 2034/2075 symbols completed. WTI took 1.2s. Estimated remaining: 15.9s. Rate: 154.8 symbols/min [2025-09-18T23:00:13.248349] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:13.288166] [DEBUG] [LOCAL ] WTRG: Loaded 51341 existing records from primary storage. [2025-09-18T23:00:13.288418] [INFO ] [MAIN ] WTRG: Loaded 51341 primary data records. [2025-09-18T23:00:13.372094] [DEBUG] [LOCAL ] WTS: Loaded 18888 existing records from primary storage. [2025-09-18T23:00:13.399982] [INFO ] [MAIN ] WTS: Loaded 18888 primary data records. [2025-09-18T23:00:13.725687] [DEBUG] [LOCAL ] WTTR: Loaded 45470 existing records from primary storage. [2025-09-18T23:00:13.737162] [INFO ] [MAIN ] WTTR: Loaded 45470 primary data records. [2025-09-18T23:00:14.257264] [DEBUG] [MAIN ] WTRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:14.258801] [INFO ] [MAIN ] WTRG: Generated 1807 derivative records from 51341 primary records. [2025-09-18T23:00:14.260178] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-09-18T23:00:14.290482] [DEBUG] [MAIN ] WTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:14.291825] [INFO ] [MAIN ] WTS: Generated 1807 derivative records from 18888 primary records. [2025-09-18T23:00:14.292367] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-09-18T23:00:14.310497] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1807 records). [2025-09-18T23:00:14.312317] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-09-18T23:00:14.315089] [INFO ] [MAIN ] Derivative Progress: 2035/2075 symbols completed. WTRG took 1.1s. Estimated remaining: 15.5s. Rate: 154.7 symbols/min [2025-09-18T23:00:14.315880] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:14.329855] [DEBUG] [MAIN ] WTTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:14.331049] [INFO ] [MAIN ] WTTR: Generated 1807 derivative records from 45470 primary records. [2025-09-18T23:00:14.331497] [DEBUG] [LOCAL ] WTS: Derivative data saved (1807 records). [2025-09-18T23:00:14.331731] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-09-18T23:00:14.331424] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-09-18T23:00:14.334332] [INFO ] [MAIN ] Derivative Progress: 2036/2075 symbols completed. WTS took 1.1s. Estimated remaining: 15.1s. Rate: 154.8 symbols/min [2025-09-18T23:00:14.335196] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:14.353628] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1807 records). [2025-09-18T23:00:14.353790] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-09-18T23:00:14.356343] [INFO ] [MAIN ] Derivative Progress: 2037/2075 symbols completed. WTTR took 1.1s. Estimated remaining: 14.7s. Rate: 154.8 symbols/min [2025-09-18T23:00:14.356745] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:14.409912] [DEBUG] [LOCAL ] WU: Loaded 53835 existing records from primary storage. [2025-09-18T23:00:14.410267] [INFO ] [MAIN ] WU: Loaded 53835 primary data records. [2025-09-18T23:00:14.543382] [DEBUG] [LOCAL ] WWW: Loaded 49510 existing records from primary storage. [2025-09-18T23:00:14.555187] [INFO ] [MAIN ] WWW: Loaded 49510 primary data records. [2025-09-18T23:00:14.689996] [DEBUG] [LOCAL ] WY: Loaded 53503 existing records from primary storage. [2025-09-18T23:00:14.717090] [INFO ] [MAIN ] WY: Loaded 53503 primary data records. [2025-09-18T23:00:15.411171] [DEBUG] [MAIN ] WU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:15.412877] [INFO ] [MAIN ] WU: Generated 1807 derivative records from 53835 primary records. [2025-09-18T23:00:15.413149] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-09-18T23:00:15.443070] [DEBUG] [MAIN ] WWW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:15.444123] [INFO ] [MAIN ] WWW: Generated 1807 derivative records from 49510 primary records. [2025-09-18T23:00:15.445492] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-09-18T23:00:15.449331] [DEBUG] [LOCAL ] WU: Derivative data saved (1807 records). [2025-09-18T23:00:15.449775] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-09-18T23:00:15.458931] [INFO ] [MAIN ] Derivative Progress: 2038/2075 symbols completed. WU took 1.1s. Estimated remaining: 14.4s. Rate: 154.7 symbols/min [2025-09-18T23:00:15.475854] [DEBUG] [MAIN ] WY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:15.476822] [INFO ] [MAIN ] WY: Generated 1807 derivative records from 53503 primary records. [2025-09-18T23:00:15.477349] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-09-18T23:00:15.493325] [DEBUG] [LOCAL ] WWW: Derivative data saved (1807 records). [2025-09-18T23:00:15.493568] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-09-18T23:00:15.496262] [INFO ] [MAIN ] Derivative Progress: 2039/2075 symbols completed. WWW took 1.2s. Estimated remaining: 14.0s. Rate: 154.8 symbols/min [2025-09-18T23:00:15.499195] [DEBUG] [LOCAL ] WY: Derivative data saved (1807 records). [2025-09-18T23:00:15.499259] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-09-18T23:00:15.501711] [INFO ] [MAIN ] Derivative Progress: 2040/2075 symbols completed. WY took 1.1s. Estimated remaining: 13.6s. Rate: 154.8 symbols/min [2025-09-18T23:00:15.502313] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:15.502410] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:15.502474] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:15.544442] [DEBUG] [LOCAL ] XFLT: Loaded 30172 existing records from primary storage. [2025-09-18T23:00:15.544744] [INFO ] [MAIN ] XFLT: Loaded 30172 primary data records. [2025-09-18T23:00:15.741616] [DEBUG] [LOCAL ] XHR: Loaded 44783 existing records from primary storage. [2025-09-18T23:00:15.741846] [INFO ] [MAIN ] XHR: Loaded 44783 primary data records. [2025-09-18T23:00:15.768271] [DEBUG] [LOCAL ] XOM: Loaded 54183 existing records from primary storage. [2025-09-18T23:00:15.773932] [INFO ] [MAIN ] XOM: Loaded 54183 primary data records. [2025-09-18T23:00:16.601415] [DEBUG] [MAIN ] XFLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:16.603199] [INFO ] [MAIN ] XFLT: Generated 1807 derivative records from 30172 primary records. [2025-09-18T23:00:16.603754] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-09-18T23:00:16.625915] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1807 records). [2025-09-18T23:00:16.640271] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-09-18T23:00:16.643188] [INFO ] [MAIN ] Derivative Progress: 2041/2075 symbols completed. XFLT took 1.1s. Estimated remaining: 13.2s. Rate: 154.7 symbols/min [2025-09-18T23:00:16.644262] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:16.643888] [DEBUG] [MAIN ] XHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:16.645893] [INFO ] [MAIN ] XHR: Generated 1807 derivative records from 44783 primary records. [2025-09-18T23:00:16.646157] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-09-18T23:00:16.668664] [DEBUG] [MAIN ] XOM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:16.673946] [INFO ] [MAIN ] XOM: Generated 1807 derivative records from 54183 primary records. [2025-09-18T23:00:16.674063] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-09-18T23:00:16.700167] [DEBUG] [LOCAL ] XHR: Derivative data saved (1807 records). [2025-09-18T23:00:16.700858] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-09-18T23:00:16.703397] [INFO ] [MAIN ] Derivative Progress: 2042/2075 symbols completed. XHR took 1.2s. Estimated remaining: 12.8s. Rate: 154.8 symbols/min [2025-09-18T23:00:16.704273] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:16.716364] [DEBUG] [LOCAL ] XOM: Derivative data saved (1807 records). [2025-09-18T23:00:16.716514] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-09-18T23:00:16.719394] [INFO ] [MAIN ] Derivative Progress: 2043/2075 symbols completed. XOM took 1.2s. Estimated remaining: 12.4s. Rate: 154.8 symbols/min [2025-09-18T23:00:16.720235] [DEBUG] [LOCAL ] XPER: Loaded 29858 existing records from primary storage. [2025-09-18T23:00:16.720457] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:16.720672] [INFO ] [MAIN ] XPER: Loaded 29858 primary data records. [2025-09-18T23:00:17.073774] [DEBUG] [LOCAL ] XPEV: Loaded 54033 existing records from primary storage. [2025-09-18T23:00:17.074555] [INFO ] [MAIN ] XPEV: Loaded 54033 primary data records. [2025-09-18T23:00:17.178681] [DEBUG] [LOCAL ] XPO: Loaded 48679 existing records from primary storage. [2025-09-18T23:00:17.196995] [INFO ] [MAIN ] XPO: Loaded 48679 primary data records. [2025-09-18T23:00:17.595389] [DEBUG] [MAIN ] XPER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:17.723529] [INFO ] [MAIN ] XPER: Generated 1807 derivative records from 29858 primary records. [2025-09-18T23:00:17.724859] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-09-18T23:00:17.749840] [DEBUG] [LOCAL ] XPER: Derivative data saved (1807 records). [2025-09-18T23:00:17.750213] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-09-18T23:00:17.752528] [INFO ] [MAIN ] Derivative Progress: 2044/2075 symbols completed. XPER took 1.1s. Estimated remaining: 12.0s. Rate: 154.7 symbols/min [2025-09-18T23:00:17.754172] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:17.773455] [DEBUG] [MAIN ] XPEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:17.775061] [INFO ] [MAIN ] XPEV: Generated 1807 derivative records from 54033 primary records. [2025-09-18T23:00:17.776744] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-09-18T23:00:17.812300] [DEBUG] [MAIN ] XPO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:17.813583] [INFO ] [MAIN ] XPO: Generated 1807 derivative records from 48679 primary records. [2025-09-18T23:00:17.814497] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-09-18T23:00:17.830440] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1807 records). [2025-09-18T23:00:17.831273] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-09-18T23:00:17.844366] [INFO ] [MAIN ] Derivative Progress: 2045/2075 symbols completed. XPEV took 1.1s. Estimated remaining: 11.6s. Rate: 154.8 symbols/min [2025-09-18T23:00:17.847210] [DEBUG] [LOCAL ] XPO: Derivative data saved (1807 records). [2025-09-18T23:00:17.847552] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:17.847354] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-09-18T23:00:17.848414] [DEBUG] [LOCAL ] XPOF: Loaded 39147 existing records from primary storage. [2025-09-18T23:00:17.851435] [INFO ] [MAIN ] Derivative Progress: 2046/2075 symbols completed. XPO took 1.1s. Estimated remaining: 11.2s. Rate: 154.8 symbols/min [2025-09-18T23:00:17.848736] [INFO ] [MAIN ] XPOF: Loaded 39147 primary data records. [2025-09-18T23:00:17.852024] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:18.176747] [DEBUG] [LOCAL ] XYF: Loaded 27857 existing records from primary storage. [2025-09-18T23:00:18.177902] [INFO ] [MAIN ] XYF: Loaded 27857 primary data records. [2025-09-18T23:00:18.295337] [DEBUG] [LOCAL ] XPRO: Loaded 46557 existing records from primary storage. [2025-09-18T23:00:18.307520] [INFO ] [MAIN ] XPRO: Loaded 46557 primary data records. [2025-09-18T23:00:18.894773] [DEBUG] [MAIN ] XPOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:18.896491] [INFO ] [MAIN ] XPOF: Generated 1807 derivative records from 39147 primary records. [2025-09-18T23:00:18.897108] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-09-18T23:00:18.920057] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1807 records). [2025-09-18T23:00:18.922097] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-09-18T23:00:18.924931] [INFO ] [MAIN ] Derivative Progress: 2047/2075 symbols completed. XPOF took 1.2s. Estimated remaining: 10.9s. Rate: 154.7 symbols/min [2025-09-18T23:00:18.925730] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:18.941154] [DEBUG] [MAIN ] XYF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:18.942457] [INFO ] [MAIN ] XYF: Generated 1807 derivative records from 27857 primary records. [2025-09-18T23:00:18.942833] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-09-18T23:00:18.988925] [DEBUG] [MAIN ] XPRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:18.990916] [INFO ] [MAIN ] XPRO: Generated 1807 derivative records from 46557 primary records. [2025-09-18T23:00:18.991011] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-09-18T23:00:18.993009] [DEBUG] [LOCAL ] XYF: Derivative data saved (1807 records). [2025-09-18T23:00:18.993093] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-09-18T23:00:18.995280] [INFO ] [MAIN ] Derivative Progress: 2048/2075 symbols completed. XYF took 1.1s. Estimated remaining: 10.5s. Rate: 154.8 symbols/min [2025-09-18T23:00:18.995594] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:19.019597] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1807 records). [2025-09-18T23:00:19.019763] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-09-18T23:00:19.022952] [INFO ] [MAIN ] Derivative Progress: 2049/2075 symbols completed. XPRO took 1.2s. Estimated remaining: 10.1s. Rate: 154.8 symbols/min [2025-09-18T23:00:19.023410] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:19.064312] [DEBUG] [LOCAL ] XYL: Loaded 48586 existing records from primary storage. [2025-09-18T23:00:19.064519] [INFO ] [MAIN ] XYL: Loaded 48586 primary data records. [2025-09-18T23:00:19.214194] [DEBUG] [LOCAL ] YALA: Loaded 37536 existing records from primary storage. [2025-09-18T23:00:19.215234] [INFO ] [MAIN ] YALA: Loaded 37536 primary data records. [2025-09-18T23:00:19.372128] [DEBUG] [LOCAL ] YELP: Loaded 45701 existing records from primary storage. [2025-09-18T23:00:19.540619] [INFO ] [MAIN ] YELP: Loaded 45701 primary data records. [2025-09-18T23:00:20.081482] [DEBUG] [MAIN ] XYL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:20.082507] [INFO ] [MAIN ] XYL: Generated 1807 derivative records from 48586 primary records. [2025-09-18T23:00:20.082746] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-09-18T23:00:20.115070] [DEBUG] [MAIN ] YALA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:20.115838] [INFO ] [MAIN ] YALA: Generated 1807 derivative records from 37536 primary records. [2025-09-18T23:00:20.116025] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-09-18T23:00:20.114747] [DEBUG] [LOCAL ] XYL: Derivative data saved (1807 records). [2025-09-18T23:00:20.117223] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-09-18T23:00:20.119033] [INFO ] [MAIN ] Derivative Progress: 2050/2075 symbols completed. XYL took 1.2s. Estimated remaining: 9.7s. Rate: 154.7 symbols/min [2025-09-18T23:00:20.126412] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:20.136225] [DEBUG] [LOCAL ] YALA: Derivative data saved (1807 records). [2025-09-18T23:00:20.137453] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-09-18T23:00:20.139760] [INFO ] [MAIN ] Derivative Progress: 2051/2075 symbols completed. YALA took 1.1s. Estimated remaining: 9.3s. Rate: 154.8 symbols/min [2025-09-18T23:00:20.140975] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:20.154721] [DEBUG] [MAIN ] YELP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:20.155525] [INFO ] [MAIN ] YELP: Generated 1807 derivative records from 45701 primary records. [2025-09-18T23:00:20.155703] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-09-18T23:00:20.173246] [DEBUG] [LOCAL ] YELP: Derivative data saved (1807 records). [2025-09-18T23:00:20.173488] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-09-18T23:00:20.176223] [INFO ] [MAIN ] Derivative Progress: 2052/2075 symbols completed. YELP took 1.2s. Estimated remaining: 8.9s. Rate: 154.8 symbols/min [2025-09-18T23:00:20.176509] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:20.224352] [DEBUG] [LOCAL ] YETI: Loaded 52894 existing records from primary storage. [2025-09-18T23:00:20.225081] [INFO ] [MAIN ] YETI: Loaded 52894 primary data records. [2025-09-18T23:00:20.308855] [DEBUG] [LOCAL ] YEXT: Loaded 43747 existing records from primary storage. [2025-09-18T23:00:20.334460] [INFO ] [MAIN ] YEXT: Loaded 43747 primary data records. [2025-09-18T23:00:20.547857] [DEBUG] [LOCAL ] YMM: Loaded 53095 existing records from primary storage. [2025-09-18T23:00:20.598959] [INFO ] [MAIN ] YMM: Loaded 53095 primary data records. [2025-09-18T23:00:21.282475] [DEBUG] [MAIN ] YETI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:21.285457] [INFO ] [MAIN ] YETI: Generated 1807 derivative records from 52894 primary records. [2025-09-18T23:00:21.285971] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-09-18T23:00:21.309001] [DEBUG] [MAIN ] YEXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:21.311560] [INFO ] [MAIN ] YEXT: Generated 1807 derivative records from 43747 primary records. [2025-09-18T23:00:21.312021] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-09-18T23:00:21.333665] [DEBUG] [LOCAL ] YETI: Derivative data saved (1807 records). [2025-09-18T23:00:21.334052] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-09-18T23:00:21.337756] [INFO ] [MAIN ] Derivative Progress: 2053/2075 symbols completed. YETI took 1.2s. Estimated remaining: 8.5s. Rate: 154.7 symbols/min [2025-09-18T23:00:21.342258] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1807 records). [2025-09-18T23:00:21.342482] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-09-18T23:00:21.345041] [INFO ] [MAIN ] Derivative Progress: 2054/2075 symbols completed. YEXT took 1.2s. Estimated remaining: 8.1s. Rate: 154.8 symbols/min [2025-09-18T23:00:21.357670] [DEBUG] [MAIN ] YMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:21.358309] [INFO ] [MAIN ] YMM: Generated 1807 derivative records from 53095 primary records. [2025-09-18T23:00:21.358369] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-09-18T23:00:21.374340] [DEBUG] [LOCAL ] YMM: Derivative data saved (1807 records). [2025-09-18T23:00:21.374401] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-09-18T23:00:21.377374] [INFO ] [MAIN ] Derivative Progress: 2055/2075 symbols completed. YMM took 1.2s. Estimated remaining: 7.8s. Rate: 154.8 symbols/min [2025-09-18T23:00:21.377945] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:21.378228] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:21.378285] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:21.394330] [DEBUG] [LOCAL ] YRD: Loaded 12743 existing records from primary storage. [2025-09-18T23:00:21.394494] [INFO ] [MAIN ] YRD: Loaded 12743 primary data records. [2025-09-18T23:00:21.766187] [DEBUG] [LOCAL ] YOU: Loaded 50326 existing records from primary storage. [2025-09-18T23:00:21.767557] [DEBUG] [LOCAL ] YPF: Loaded 50842 existing records from primary storage. [2025-09-18T23:00:21.768016] [INFO ] [MAIN ] YOU: Loaded 50326 primary data records. [2025-09-18T23:00:21.768128] [INFO ] [MAIN ] YPF: Loaded 50842 primary data records. [2025-09-18T23:00:22.414593] [DEBUG] [MAIN ] YRD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:22.416149] [INFO ] [MAIN ] YRD: Generated 1807 derivative records from 12743 primary records. [2025-09-18T23:00:22.416513] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-09-18T23:00:22.434682] [DEBUG] [LOCAL ] YRD: Derivative data saved (1807 records). [2025-09-18T23:00:22.434995] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-09-18T23:00:22.437092] [INFO ] [MAIN ] Derivative Progress: 2056/2075 symbols completed. YRD took 1.1s. Estimated remaining: 7.4s. Rate: 154.7 symbols/min [2025-09-18T23:00:22.437824] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:22.482573] [DEBUG] [MAIN ] YOU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:22.482273] [DEBUG] [MAIN ] YPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:22.483588] [INFO ] [MAIN ] YOU: Generated 1807 derivative records from 50326 primary records. [2025-09-18T23:00:22.483741] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-09-18T23:00:22.484325] [INFO ] [MAIN ] YPF: Generated 1807 derivative records from 50842 primary records. [2025-09-18T23:00:22.484769] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-09-18T23:00:22.501468] [DEBUG] [LOCAL ] YSG: Loaded 24787 existing records from primary storage. [2025-09-18T23:00:22.519205] [INFO ] [MAIN ] YSG: Loaded 24787 primary data records. [2025-09-18T23:00:22.520370] [DEBUG] [LOCAL ] YOU: Derivative data saved (1807 records). [2025-09-18T23:00:22.520539] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-09-18T23:00:22.522733] [INFO ] [MAIN ] Derivative Progress: 2057/2075 symbols completed. YOU took 1.1s. Estimated remaining: 7.0s. Rate: 154.8 symbols/min [2025-09-18T23:00:22.523421] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:22.565729] [DEBUG] [LOCAL ] YPF: Derivative data saved (1807 records). [2025-09-18T23:00:22.599433] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-09-18T23:00:22.614251] [INFO ] [MAIN ] Derivative Progress: 2058/2075 symbols completed. YPF took 1.2s. Estimated remaining: 6.6s. Rate: 154.8 symbols/min [2025-09-18T23:00:22.637071] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:22.915133] [DEBUG] [LOCAL ] YUM: Loaded 51701 existing records from primary storage. [2025-09-18T23:00:22.915791] [INFO ] [MAIN ] YUM: Loaded 51701 primary data records. [2025-09-18T23:00:23.042308] [DEBUG] [LOCAL ] YUMC: Loaded 53118 existing records from primary storage. [2025-09-18T23:00:23.027399] [DEBUG] [MAIN ] YSG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:23.054204] [INFO ] [MAIN ] YSG: Generated 1807 derivative records from 24787 primary records. [2025-09-18T23:00:23.052985] [INFO ] [MAIN ] YUMC: Loaded 53118 primary data records. [2025-09-18T23:00:23.071977] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-09-18T23:00:23.408243] [DEBUG] [LOCAL ] YSG: Derivative data saved (1807 records). [2025-09-18T23:00:23.426773] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-09-18T23:00:23.461922] [INFO ] [MAIN ] Derivative Progress: 2059/2075 symbols completed. YSG took 1.0s. Estimated remaining: 6.2s. Rate: 154.7 symbols/min [2025-09-18T23:00:23.487842] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:23.664012] [DEBUG] [MAIN ] YUM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:23.673473] [INFO ] [MAIN ] YUM: Generated 1807 derivative records from 51701 primary records. [2025-09-18T23:00:23.678824] [DEBUG] [MAIN ] YUMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:23.678920] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-09-18T23:00:23.693670] [INFO ] [MAIN ] YUMC: Generated 1807 derivative records from 53118 primary records. [2025-09-18T23:00:23.694392] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-09-18T23:00:23.724761] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1807 records). [2025-09-18T23:00:23.738903] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-09-18T23:00:23.741731] [INFO ] [MAIN ] Derivative Progress: 2060/2075 symbols completed. YUMC took 1.1s. Estimated remaining: 5.8s. Rate: 154.7 symbols/min [2025-09-18T23:00:23.742456] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:23.743436] [DEBUG] [LOCAL ] ZBH: Loaded 51591 existing records from primary storage. [2025-09-18T23:00:23.744794] [INFO ] [MAIN ] ZBH: Loaded 51591 primary data records. [2025-09-18T23:00:23.846553] [DEBUG] [LOCAL ] YUM: Derivative data saved (1807 records). [2025-09-18T23:00:23.857777] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-09-18T23:00:23.859754] [INFO ] [MAIN ] Derivative Progress: 2061/2075 symbols completed. YUM took 1.3s. Estimated remaining: 5.4s. Rate: 154.8 symbols/min [2025-09-18T23:00:23.866399] [DEBUG] [LOCAL ] ZEPP: Loaded 16264 existing records from primary storage. [2025-09-18T23:00:23.865796] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:23.882072] [INFO ] [MAIN ] ZEPP: Loaded 16264 primary data records. [2025-09-18T23:00:24.422312] [DEBUG] [LOCAL ] ZETA: Loaded 53985 existing records from primary storage. [2025-09-18T23:00:24.424718] [INFO ] [MAIN ] ZETA: Loaded 53985 primary data records. [2025-09-18T23:00:24.511022] [DEBUG] [MAIN ] ZBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:24.535930] [INFO ] [MAIN ] ZBH: Generated 1807 derivative records from 51591 primary records. [2025-09-18T23:00:24.548097] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-09-18T23:00:24.638148] [DEBUG] [MAIN ] ZEPP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:24.653049] [INFO ] [MAIN ] ZEPP: Generated 1807 derivative records from 16264 primary records. [2025-09-18T23:00:24.660161] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1807 records). [2025-09-18T23:00:24.655710] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-09-18T23:00:24.660312] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-09-18T23:00:24.812283] [INFO ] [MAIN ] Derivative Progress: 2062/2075 symbols completed. ZBH took 1.3s. Estimated remaining: 5.0s. Rate: 154.7 symbols/min [2025-09-18T23:00:24.827076] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:24.843498] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1807 records). [2025-09-18T23:00:24.844124] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-09-18T23:00:24.846118] [INFO ] [MAIN ] Derivative Progress: 2063/2075 symbols completed. ZEPP took 1.1s. Estimated remaining: 4.7s. Rate: 154.8 symbols/min [2025-09-18T23:00:24.846670] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:24.886209] [DEBUG] [MAIN ] ZETA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:24.887202] [INFO ] [MAIN ] ZETA: Generated 1807 derivative records from 53985 primary records. [2025-09-18T23:00:24.898142] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-09-18T23:00:24.899712] [DEBUG] [LOCAL ] ZGN: Loaded 41220 existing records from primary storage. [2025-09-18T23:00:24.900115] [INFO ] [MAIN ] ZGN: Loaded 41220 primary data records. [2025-09-18T23:00:24.963009] [DEBUG] [LOCAL ] ZH: Loaded 27380 existing records from primary storage. [2025-09-18T23:00:24.979301] [INFO ] [MAIN ] ZH: Loaded 27380 primary data records. [2025-09-18T23:00:25.108218] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1807 records). [2025-09-18T23:00:25.153427] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-09-18T23:00:25.185776] [INFO ] [MAIN ] Derivative Progress: 2064/2075 symbols completed. ZETA took 1.3s. Estimated remaining: 4.3s. Rate: 154.8 symbols/min [2025-09-18T23:00:25.327444] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:25.557162] [DEBUG] [MAIN ] ZGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:25.558331] [INFO ] [MAIN ] ZGN: Generated 1807 derivative records from 41220 primary records. [2025-09-18T23:00:25.572093] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-09-18T23:00:25.588548] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1807 records). [2025-09-18T23:00:25.588784] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-09-18T23:00:25.591827] [INFO ] [MAIN ] Derivative Progress: 2065/2075 symbols completed. ZGN took 0.8s. Estimated remaining: 3.9s. Rate: 154.8 symbols/min [2025-09-18T23:00:25.592829] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:25.610813] [DEBUG] [LOCAL ] ZIM: Loaded 53941 existing records from primary storage. [2025-09-18T23:00:25.623231] [INFO ] [MAIN ] ZIM: Loaded 53941 primary data records. [2025-09-18T23:00:25.635314] [DEBUG] [MAIN ] ZH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:25.646164] [INFO ] [MAIN ] ZH: Generated 1807 derivative records from 27380 primary records. [2025-09-18T23:00:25.646343] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-09-18T23:00:25.747468] [DEBUG] [LOCAL ] ZH: Derivative data saved (1807 records). [2025-09-18T23:00:25.757980] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-09-18T23:00:25.789028] [INFO ] [MAIN ] Derivative Progress: 2066/2075 symbols completed. ZH took 0.9s. Estimated remaining: 3.5s. Rate: 154.8 symbols/min [2025-09-18T23:00:25.815631] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:25.971020] [DEBUG] [LOCAL ] ZIP: Loaded 44909 existing records from primary storage. [2025-09-18T23:00:25.972012] [INFO ] [MAIN ] ZIP: Loaded 44909 primary data records. [2025-09-18T23:00:26.305710] [DEBUG] [LOCAL ] ZK: Loaded 40457 existing records from primary storage. [2025-09-18T23:00:26.306223] [INFO ] [MAIN ] ZK: Loaded 40457 primary data records. [2025-09-18T23:00:26.518343] [DEBUG] [MAIN ] ZIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:26.542421] [INFO ] [MAIN ] ZIM: Generated 1807 derivative records from 53941 primary records. [2025-09-18T23:00:26.542663] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-09-18T23:00:26.683203] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1807 records). [2025-09-18T23:00:26.685156] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-09-18T23:00:26.689858] [INFO ] [MAIN ] Derivative Progress: 2067/2075 symbols completed. ZIM took 1.5s. Estimated remaining: 3.1s. Rate: 154.7 symbols/min [2025-09-18T23:00:26.690677] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:26.705456] [DEBUG] [MAIN ] ZIP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:26.706253] [INFO ] [MAIN ] ZIP: Generated 1807 derivative records from 44909 primary records. [2025-09-18T23:00:26.706393] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-09-18T23:00:26.728427] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1807 records). [2025-09-18T23:00:26.728704] [DEBUG] [LOCAL ] ZKH: Loaded 8114 existing records from primary storage. [2025-09-18T23:00:26.728902] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-09-18T23:00:26.728822] [INFO ] [MAIN ] ZKH: Loaded 8114 primary data records. [2025-09-18T23:00:26.751888] [INFO ] [MAIN ] Derivative Progress: 2068/2075 symbols completed. ZIP took 1.2s. Estimated remaining: 2.7s. Rate: 154.8 symbols/min [2025-09-18T23:00:27.077103] [DEBUG] [MAIN ] ZK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:27.086188] [INFO ] [MAIN ] ZK: Generated 1807 derivative records from 40457 primary records. [2025-09-18T23:00:27.086404] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-09-18T23:00:27.104124] [DEBUG] [LOCAL ] ZK: Derivative data saved (1807 records). [2025-09-18T23:00:27.104399] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-09-18T23:00:27.107134] [INFO ] [MAIN ] Derivative Progress: 2069/2075 symbols completed. ZK took 1.3s. Estimated remaining: 2.3s. Rate: 154.8 symbols/min [2025-09-18T23:00:27.126823] [DEBUG] [MAIN ] ZKH: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-18T23:00:27.127399] [INFO ] [MAIN ] ZKH: Generated 1806 derivative records from 8114 primary records. [2025-09-18T23:00:27.127459] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-09-18T23:00:27.141182] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1806 records). [2025-09-18T23:00:27.141245] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-09-18T23:00:27.143464] [INFO ] [MAIN ] Derivative Progress: 2070/2075 symbols completed. ZKH took 0.5s. Estimated remaining: 1.9s. Rate: 154.8 symbols/min [2025-09-18T23:00:27.143990] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:27.144079] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:27.144535] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:27.162528] [DEBUG] [LOCAL ] ZTR: Loaded 16956 existing records from primary storage. [2025-09-18T23:00:27.162830] [INFO ] [MAIN ] ZTR: Loaded 16956 primary data records. [2025-09-18T23:00:27.527672] [DEBUG] [LOCAL ] ZTS: Loaded 53375 existing records from primary storage. [2025-09-18T23:00:27.527001] [DEBUG] [LOCAL ] ZTO: Loaded 50566 existing records from primary storage. [2025-09-18T23:00:27.527971] [INFO ] [MAIN ] ZTO: Loaded 50566 primary data records. [2025-09-18T23:00:27.528145] [INFO ] [MAIN ] ZTS: Loaded 53375 primary data records. [2025-09-18T23:00:28.153502] [DEBUG] [MAIN ] ZTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:28.154927] [INFO ] [MAIN ] ZTR: Generated 1807 derivative records from 16956 primary records. [2025-09-18T23:00:28.155267] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-09-18T23:00:28.172788] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1807 records). [2025-09-18T23:00:28.172925] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-09-18T23:00:28.174961] [INFO ] [MAIN ] Derivative Progress: 2071/2075 symbols completed. ZTR took 1.0s. Estimated remaining: 1.6s. Rate: 154.7 symbols/min [2025-09-18T23:00:28.175501] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:28.195963] [DEBUG] [MAIN ] ZTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:28.196890] [INFO ] [MAIN ] ZTO: Generated 1807 derivative records from 50566 primary records. [2025-09-18T23:00:28.197181] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-09-18T23:00:28.238023] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1807 records). [2025-09-18T23:00:28.238548] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-09-18T23:00:28.238413] [DEBUG] [MAIN ] ZTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:28.240394] [INFO ] [MAIN ] Derivative Progress: 2072/2075 symbols completed. ZTO took 1.1s. Estimated remaining: 1.2s. Rate: 154.8 symbols/min [2025-09-18T23:00:28.240827] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-09-18T23:00:28.242099] [INFO ] [MAIN ] ZTS: Generated 1807 derivative records from 53375 primary records. [2025-09-18T23:00:28.242272] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-09-18T23:00:28.268368] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1807 records). [2025-09-18T23:00:28.269475] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-09-18T23:00:28.272053] [INFO ] [MAIN ] Derivative Progress: 2073/2075 symbols completed. ZTS took 1.1s. Estimated remaining: 0.8s. Rate: 154.8 symbols/min [2025-09-18T23:00:28.273025] [DEBUG] [LOCAL ] ZVIA: Loaded 35635 existing records from primary storage. [2025-09-18T23:00:28.273196] [INFO ] [MAIN ] ZVIA: Loaded 35635 primary data records. [2025-09-18T23:00:28.594163] [DEBUG] [LOCAL ] ZWS: Loaded 42869 existing records from primary storage. [2025-09-18T23:00:28.594391] [INFO ] [MAIN ] ZWS: Loaded 42869 primary data records. [2025-09-18T23:00:28.983945] [DEBUG] [MAIN ] ZVIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:28.986079] [INFO ] [MAIN ] ZVIA: Generated 1807 derivative records from 35635 primary records. [2025-09-18T23:00:28.986235] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-09-18T23:00:29.006552] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1807 records). [2025-09-18T23:00:29.006712] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-09-18T23:00:29.008786] [INFO ] [MAIN ] Derivative Progress: 2074/2075 symbols completed. ZVIA took 0.8s. Estimated remaining: 0.4s. Rate: 154.8 symbols/min [2025-09-18T23:00:29.023383] [DEBUG] [MAIN ] ZWS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-18T23:00:29.024033] [INFO ] [MAIN ] ZWS: Generated 1807 derivative records from 42869 primary records. [2025-09-18T23:00:29.024097] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-09-18T23:00:29.039305] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1807 records). [2025-09-18T23:00:29.039365] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-09-18T23:00:29.041363] [INFO ] [MAIN ] Derivative Progress: 2075/2075 symbols completed. ZWS took 0.8s. Estimated remaining: 0.0s. Rate: 154.8 symbols/min [2025-09-18T23:00:29.044111] [INFO ] [MAIN ] Parallel derivative generation completed in 13m 24s [2025-09-18T23:00:29.044320] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2075/2075 symbols) [2025-09-18T23:00:29.671588] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2075/2075 @ 100.00%)' [2025-09-18T23:00:29.672502] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-18T23:00:29.672811] [INFO ] [STATE ] Last completion updated: 2025-09-18T23:00:29.672609